File Systems
Anvil provides users with separate home, scratch, and project areas for managing files. These will be accessible via the $HOME
, $SCRATCH
, $PROJECT
and $WORK
environment variables. Each file system is available from all Anvil nodes but has different purge policies and ideal use cases (see table below). Users in the same allocation will share read and write access to the data in the $PROJECT
space. The project space will be created for each allocation. $PROJECT
and $WORK
variables refer to the same location and can be used interchangeably.
$SCRATCH
is a high-performance, internally resilient GPFS parallel file system with 10 PB of usable capacity, configured to deliver up to 150 GB/s bandwidth. The scratch filesystems are for limited-duration, high-performance storage of data for running jobs or workflows and are explicitly not intended to be used as a long-term storage. Doing so, or engaging in measures to circumvent purging, is adversely affecting all users of the system and is prohibited.
Files in scratch directories are not recoverable. Files in scratch directories are not backed up. If you accidentally delete a file, a disk crashes, or old files are purged, they cannot be restored.
File System | Mount Point | Quota | Snapshots | Purpose | Purge policy |
---|---|---|---|---|---|
Anvil ZFS | /home | 25 GB | Full schedule* | Home directories: area for storing personal software, scripts, compiling, editing, etc. | Not purged |
Anvil ZFS | /apps | N/A | Weekly* | Applications | |
Anvil GPFS | /anvil | N/A | No | ||
Anvil GPFS | /anvil/scratch | 100 TB | No | User scratch: area for job I/O activity, temporary storage | Files older than 30-day (access time) will be purged |
Anvil GPFS | /anvil/projects | 5 TB | Full schedule* | Per allocation: area for shared data in a project, common datasets and software installation | Not purged while allocation is active. Removed 90 days after allocation expiration |
Anvil GPFS | /anvil/datasets | N/A | Weekly* | Common data sets (not allocated to users) |
* Full schedule keeps nightly snapshots for 7 days, weekly snapshots for 3 weeks, and monthly snapshots for 2 months.
Link to section 'Useful tool' of 'File Systems' Useful tool
To check the quota of different file systems, type myquota
at the command line.
x-anvilusername@login03.anvil:[~] $myquota
Type Location Size Limit Use Files Limit Use
==============================================================================
home x-anvilusername 261.5MB 25.0GB 1% - - -
scratch anvil 6.3GB 100.0TB 0.01% 3k 1,048k 0.36%
projects accountname1 37.2GB 5.0TB 0.73% 403k 1,048k 39%
projects accountname2 135.8GB 5.0TB 3% 20k 1,048k 2%