Storage OptionsΒΆ

Storage on the CoSTAR cluster is designed for active computing, not long-term archiving. Choosing the correct location for your scripts, temporary scratch files, and massive datasets ensures your jobs run as fast as possible.

Select a topic below to learn how to manage your data effectively:

File Systems & Quotas

Learn about the different storage areas (Home vs. Scratch), check your space limitations, and understand file retention policies.

HPC Local Storage
Transferring Data

Learn how to move files to and from the cluster using Open OnDemand, scp, rsync, or SFTP tools.

Transferring data to/from HPC storage
File Management

Practical guides on how to browse, edit, and manage your files using the terminal or graphical tools like VS Code.

Working with files on the cluster
Large Datasets

Best practices for handling, sharing, and storing larger datasets required for AI and machine learning workflows.

Dataset Management

Important

No automatic backups:

Cluster storage is highly performant but is generally not backed up. You are responsible for transferring your critical results and final datasets off the cluster for safe keeping.