Currently, the data that is collected at F2 and at F3/G3 (with the Maia detector) is being written directly to this new centralized data storage, and we plan to extend this system to other beamlines and detectors in future cycles. This data is accessible for analysis on the CLASSE compute cluster, and long-term archival storage is provided by an offsite magnetic tape library. This expansion in CHESS' computing infrastructure represents a new model for data acquisition and analysis, and it was developed in response to the expected growth in data volume due to the installation of compact undulators for increased x-ray flux, as well as advances in the spatial, temporal, and energy resolution of new x-ray detectors.
CHESS tackles big data
Starting last October, the CLASSE IT group has been commissioning a new data acquisition network with high-speed low-latency connections from the CHESS beamlines to over 130 terabytes of redundant disk arrays dedicated to the storage of CHESS x-ray data.
