Published August 30, 2019 | Version v1

CMS DAQ monitoring data storage technology evaluation

Authors/Creators

Contributors

Description

Up until the summer of 2019 the CMS DAQ system monitoring data have been stored in compressed JSON files in so called 'snapshots' taken during 2-3 second intervals. This storage method has made analysis of the stored data an inconvenient process. To address this issue, an evaluation of some contemporary storage systems have been made and benchmarked with our monitoring data. The two most promising technologies, Elasticsearch and PostgreSQL with Timescale has been selected and evaluated on data for a two-month period.

Other

Abbreviations: DAQ - data acquisition

Files

CMS DAQ monitoring data storage technology evaluation.pdf

Files (1.5 MB)

Additional details

Identifiers

CDS Report Number
CERN-STUDENTS-Note-2019-169

Linked records