Automated tool for filesystem cleanup

What is it about?

Large-scale simulation often generates an extensive volume of transitional data that is only needed during the runtime of jobs. Efficient management of temporary storage space for transitional data is critical for HPC centers. An automated tool cleans up temporary storage and significantly increases storage usage.

Featured Image

Why is it important?

We create a tool with automatic workflow to manage two parallel filesystems: GPFS and Lustre by periodically cleaning up the storage space. This tool significantly reduced staff time on storage management and enforced the policy.