6533b871fe1ef96bd12d2345

RESEARCH PRODUCT

ADA-FS—Advanced Data Placement via Ad hoc File Systems at Extreme Scales

Wolfgang E. NagelMehmet SoysalAchim StreitSebastian OesteAndré BrinkmannMarc-andré Vef

subject

MetadataFile systemComputer scienceData_FILESOperating systemcomputer.software_genrecomputerFlash storageData placement

description

Today’s High-Performance Computing (HPC) environments increasingly have to manage relatively new access patterns (e.g., large numbers of metadata operations) which general-purpose parallel file systems (PFS) were not optimized for. Burst-buffer file systems aim to solve that challenge by spanning an ad hoc file system across node-local flash storage at compute nodes to relief the PFS from such access patterns. However, existing burst-buffer file systems still support many of the traditional file system features, which are often not required in HPC applications, at the cost of file system performance.

https://doi.org/10.1007/978-3-030-47956-5_4