This morning, we found the hp8, hp10, hp12, hp14, hp16, hp18, hp20, hp22, hp24, and hp26 filesystems full. All of these filesystems reside on the same fileserver and share capacity. The root cause was a an oversight on our part – a lack of quota enforcement on a particular users home directory. The proper 5GB home directory quotas have been reinstated and we are working with this user to move their data to their project directory. We’ve managed to free up a little space at the moment, but it will take a little time to move a couple TB of data. We’re also doing an audit to ensure that all appropriate storage quotas are in place.
This would have affected users on the following clusters:
- Athena
- BioCluster
- Aryabhata
- Atlantis
- FoRCE
- Optimius (not production yet)
- ECE (not production yet)
- Prometheus (not production yet)
- Math (not production yet)
- CEE (not production yet)