Skip to main content

Lustre best practices

  • Lustre is best suited to large/huge files
  • Avoid create many small files
  • Avoid perform operations that imply access to many small files
  • Avoid having a large number of files in a single directory
  • Do not perform operations such as find over large directory trees
  • Perform regular backups of your data to a safe location (INCD does not perform data backups)
  • Instead of allowing all processes to do the I/O, choose just a few processes to do the work.
  • Avoid performing many repetitive open/close operations