Directories and filesystems
INCD filesystem is based on lustre. Lustre is a shared filesystem (present in the execution hosts and in the submission hosts) dedicated for the storage of big/huge files.
- For more specific information regarding Lustre deployed at INCD please click here
Summary
Name[1] | Purpose | Availability | Quota [2] | TimeLimit [3] | Backup |
---|---|---|---|---|---|
/home/unixgrp/user | User default home | always | 20GB/user | none | no |
/data/unixgrp | Group data large data files [4]. | always | 100GB/group | temporary (will be deleted after 6 months)[4] | no |
/exper-sw/unixgrp | Install software for groups | on request | permanent | no |
[1] Each user belongs to a Unix group:
- unixgrp - determined by the project they are attached to [2] Increases to these quotas will be considered on a case-by-case basis.
[3] Timelimit defines time after which a file is erased on the file system since its most recent access time, as defined by the file access timestamp.
[4] This folder has read+write permission to all users belong same group
NOTE: To know your unix group id type: id username
Filesystems
/home
- Intended to be used for source code, executables and irreproducible data (input files etc), NOT large data sets.
- Globally accessible from all nodes within a system.
- Quotas apply. Please read our Disk Quota Policy To know your actual quota limite:
lfs quota -uh username /home/unixgrp/username
Disk quotas for usr username (uid XXXXXX):
Filesystem used quota limit grace files quota limit grace
/home/unixgrp/username 11.6G 20G 20G - 1395 10400 10400 -
NOTE: if your used >=quota users are not allowed to write
/data
- Each project has a directory with pathname /data/unixgrp on each compute system. Users connected to the project have rwx permissions in that directory and so may create their own files in those areas.
- Globally accessible from all nodes within a system.
- Quotas apply. Please read our Disk Quota Policy To know your actual quota limite:
lfs quota -uh username /data/unixgrp
Disk quotas for usr username (uid XXXXXX):
Filesystem used quota limit grace files quota limit grace
/data/unixgrp/ 219.6G 300G 300G - 81395 1102400 102400 -
NOTE: There are also limits on the number of files (files) that can be owned by a group (project) on /data.
/exper-sw
- Intended to be used for source code, executables to be shared by a group
- Globally accessible from all nodes within a system.
- Permissions to use based on request