Skip to main content
Advanced Search
Search Terms
Content Type

Exact Matches
Tag Searches
Date Options
Updated after
Updated before
Created after
Created before

Search Results

70 total results found

Lustre Basics

Filesystem User Guide Lustre

The latest Lustre documentation is available at Lustre

Lustre best practices

Filesystem User Guide Lustre

Distributed filesystems such as Lustre are ideal for HPC and HTC environments. In these environments the typical workload consists of large files that have to be accessed from many compute nodes with very high bandwidth and/or low latency. Therefore these file...

How to connect to the HPC and HTC clusters

How to access Public access

public login services Access to the INCD clusters is only available to registered users. To use the HPC services users need to login via SSH into a front-end server. The login servers can be customized according to the user requirements (OS, Hardware resou...

Create a ssh key

How to access Using ssh keys

Access to the INCD computing clusters is performed via SSH and requires the use of SSH keys for authentication. Authentication with passwords is not supported. Each SSH key pair has two components a public key that must be added to the hosts to be remotely acc...

Security

How to access Using ssh keys

Choose strong passwords - at least 9 characters long, a mixture of alphanumeric mixed case and symbol characters. The password should be completely different from the password you use on any other system. Never use the same password across different systems ...

Configuring SSH

How to access Using ssh keys

In order to simplify SSH access to remote hosts we recommend INCD users to adopt the following recommendatios and configuration defaults. Enabling SSH agents and X11 forwarding Activate the forwarding of both SSH authentication credentials and X11 graphical ...

Access

Getting Started

INCD is open to all academic and scientific researchers and institutions. In order to use our services please go to the INCD portal and follow the instructions there. For guidance and further information about the access conditions see the FAQ List warning P...

Login and network access

Getting Started

Access to INCD infrastructure is available only to registered users. Access to login machines may be filtered by IP address of origin. During the registration process you may be asked to provide your IP address in order to enable remote access. Access to virt...

My jobs need to run longer than the queues permit

Manage jobs Troubleshooting information

At INCD the default max elapsed time for the queues is 72h. The values for all queues can be consulted here In case you cannot parallelize your job (split one single job into multiple parallel jobs) you can use job dependencies. In this case you creat...

Directories and filesystems

Filesystem User Guide

The INCD filesystems are based on the Lustre shared filesystem which is mounted in the compute nodes and in the submission/login nodes. Lustre is mostly suited to the storage of large/huge files. For more specific information regarding the Lustre deployment ...

Disk Quota Policy

Filesystem User Guide

To prevent storage misuse and problems resulting from filesystems becoming full, INCD has implemented the following data usage policies and limits. File system Hard Limit Exceeded /home Once quota or number of files exceeded, new files will not be all...

How to transfer files between INCD and a local machine

Filesystem User Guide

NOTE Please note that INCD Lustre storage is not designed for small files. Attempting to store or retrieve files less than a few megabytes will result in extremely poor performance for all users. If you wish to store lots of small files to massdata, please u...

How to access files belonging to someone else or another project

Filesystem User Guide

Users are allowed to change the default permissions file permissions in all folders they own. The default access rights to INCD filesystem is the folllowing: /home All files under /home are only accessible by the user. /data All files under /data/unixgr...

Install Miniconda

Software User Software Installation

Small tutorial on how to install and run miniconda on the HPC clusters. 1. Login into your login machine 2. Download Miniconda into your local home $ wget https://repo.anaconda.com/miniconda/Miniconda2-latest-Linux-x86_64.sh 3. Execute Miniconda $ ch...

Software Management

Software

The INCD software is managed using a tool called modules. This tool allows the user to load the correct environment (PATH, LD_LIBRARY_PATH, etc) for each specific software package. The main commands are explained in the next sections. List of available Softwa...

Allowed directories for users software installations

Software User Software Installation

There are a few options for local users installation locations as showed on the next table, create appropriate paths bellow the base directory. Site Base Directory Comments INCD-Lisbon /home/GROUP/USERNAME INCD-Lisbon /data/GROUP/USERNAME ...

User Portal

User Support

For specific user portal issues please use the following contact: portal (at) incd.pt

Queues information

Manage jobs

List of Queues INCD-Lisbon cluster (cirrus.a.incd.pt) Name Jobs max elapsed time access Memory Max #cores[1] Comments gpu 72h everyone 2 GB/Core 16 queue for GPU resources hpc 72h everyone 8 GB/Core 64 default queue fct 72h reser...

How to acknowledge INCD

Acknowledgements

INCD is required to provide evidence of the work made possible through the usage of the infrastructure services. The metric of success is the scientific publications produced through the usage of the INCD services. Please help us to continue delivering servic...

2017

Scientific Publications

Journal Paper with direct contribution Quarkonium production at the LHC: A data-driven analysis of remarkably simple experimental patterns P. Faccioli, C. Lourenço, M. Araújo, V. Knünz, I. Krätschmer, J. Seixas Phys.Lett. B773 (2017) 476-486 10.1016/j.physle...