Directories and filesystems

The INCD filesystems are based on the Lustre shared filesystem which is mounted in the compute nodes and in the submission/login nodes. Lustre is mostly suited to the storage of large/huge files.

  • For more specific information regarding the Lustre deployment at INCD please see the lustre section

Summary

INCD-Lisbon cluster

Name[1] Purpose Availability Quota [2] TimeLimit [3] Backup
/home/unixgrp/user User default home always 20GB/user none no
/data/unixgrp Group data large data files [4]. always 100GB/group temporary (will be deleted after 6 months)[4] no
/exper-sw/unixgrp Install software for groups on request 20GB/group permanent no

ISEC-Coimbra cluster

Name[1] Purpose Availability Quota [2] TimeLimit [3] Backup
/home/ User default home always none no

INCD-Minho cluster

Name[1] Purpose Availability Quota [2] TimeLimit [3] Backup
/home/unixgrp/user User default home always 200GB/user none no
/scratch/unixgrp/user User working directory always 10TB/group none no

[1] Each user belongs to a Unix group: unixgrp - determined by the project they are attached to
[2] Increases to these quotas will be considered on a case-by-case basis.
[3] Time limit defines time after which a file is erased on the file system since its most recent access time, as defined by the file access timestamp.
[4] This folder has read+write permission to all users belong same group

NOTE: To know your unix group id type the command: id

Filesystems

/home

  • Intended to be used for source code, executables and immutable data (input files etc), NOT large data sets.
  • Globally accessible from all nodes within a system.
  • Quotas apply. Please read our Disk Quota Policy To know your actual quota limit:
lfs quota -uh username /home/unixgrp/username

Disk quotas for usr username (uid XXXXXX):
     Filesystem           used   quota  limit grace  files   quota   limit   grace
  /home/unixgrp/username  11.6G  20G   20G     -      1395    10400  10400    -

NOTE: if your used >=quota users are not allowed to write

/data

  • Each project has a directory with pathname /data/unixgrp on each compute node. Users connected to the project have rwx permissions in that directory and so may create their own files in those areas.
  • Globally accessible from all nodes within a system.
  • Quotas apply. Please read our Disk Quota Policy To know your actual quota limite:
lfs quota -uh username /data/unixgrp

Disk quotas for usr username (uid XXXXXX):
     Filesystem    used   quota  limit   grace   files    quota    limit   grace
  /data/unixgrp/  219.6G  300G   300G     -      81395    1102400  102400    -

NOTE: There are also limits on the number of files (files) that can be owned by a group (project) on /data.

/exper-sw

  • Intended to be used for software, shared by group
  • Globally accessible from all nodes within a system.
  • Permissions to use based on request