Advances in HPC compute and storage workloads continue to drive data management challenges; as new storage technologies are leveraged come the challenges of multiple storage silos, heterogeneous file systems and long-term storage requirements which drive the need for reliable and powerful solutions. OCF and Atempo have partnered to offer HPC customers the Data Management solutions required to move, protect, archive and synchronize massive data workflows.
Atempo partners with OCF on large and very large scale projects in the HPC community including DiRAC (Distributed Research Utilizing Advanced Computing) the integrated supercomputing facility for theoretical modelling and HPC-based research in particle physics, astronomy and cosmology and nuclear physics. Miria currently archives and backs up several petabytes of research data at DiRAC’s Durham facility.
The Atempo Miria Data Management software platform securely and rapidly moves, protects and archives petabytes of data and billions of files between different vendor storages and different file systems. Miria’s FastScan feature allows efficient file tree walking management for massive HPC data sets running GPFS, Lustre and many other storages. Miria is not tied to a specific vendor and runs on a multitude of hybrid infrastructures including cloud, tape and on-prem.