Published August 24, 2022 | Version v1
Report Open

Exploration of GPU-enabled lossless compressors

Authors/Creators

Contributors

  • 1. ROR icon European Organization for Nuclear Research

Description

The CMS collaboration has a growing interest in the use of heterogeneous computing and accelerators to reduce the costs and improve the efficiency of the online and offline data processing: online, the High Level Trigger is fully equipped with NVIDIA GPUs; offline, a growing fraction of the computing power is coming from GPU-equipped HPC centres. One of the topics where accelerators could be used for both online and offline processing is data compression. In the past decade a number of research papers exploring the use of GPUs for lossless data compression have appeared in academic literature, but very few practical application have emerged. In the industry, NVIDIA has recently published the nvcomp GPU-accelerated data compression library, based on closed-source implementations of standard and dedicated algorithms. Other platforms, like the IBM Power 9 processors, offer dedicated hardware for the acceleration data compression tasks. In this work we review the recent developments on the use of accelerators for data compression. After summarising the recent academic research, we will measure the performance of representative open- and closed-source algorithms over CMS data, and compare it with the CPU-only algorithms currently used by ROOT and CMS (lz4, zlib, zstd).

Other

Abbreviations: GPU = Graphics Processing Unit

Files

report.pdf

Files (549.5 kB)

Name Size Download all
md5:283f6bf403eac892d5c075bf78902577
549.5 kB Preview Download

Additional details

Identifiers

CDS Report Number
CERN-STUDENTS-Note-2022-065

CERN

Linked records