Summary
This technical paper addresses anticipated storage capacity challenges for the High-Luminosity Large Hadron Collider by proposing a federated data lake architecture distributed across multiple large data centres. The authors present their prototype implementation, demonstrating how policy-driven data placement and retention decisions, combined with tiered storage classes, can optimise both hardware and operational costs whilst serving diverse organisational needs from regional consolidation to international data provisioning. The system leverages distributed architecture and economies of scale to interoperate with existing federated storage solutions.
Regional applicability
This paper is not applicable to United Kingdom farming systems, soil health, or food system research. It concerns high-energy physics computing infrastructure and is outside the scope of Vitagri's Pulse Brain.
Key measures
Storage resource requirements, data placement policies, operational costs, system benchmarks for data processing models
Outcomes reported
The paper describes the architecture of a geographically distributed WLCG data lake storage service and presents a prototype implementation demonstrating how the system can serve different scales of consolidation from regional to international data provisioning. It reports benchmarks for data processing models within this distributed storage environment.
Topic tags
Dig deeper with Pulse AI.
Pulse AI has read the whole catalogue. Ask about this record, its theme, or how the findings apply to UK farming and policy — every answer cites the underlying studies.