Compress Backup Data from CBack

The primary motivation behind my project at CERN was to address the growing need for efficient data storage management. User data at CERN is stored in Restic repositories, and we utilize a custom-developed software named CBack to perform automatic daily backups of this data. With the release of Restic version 0.14.0, a new feature was introduced that allows for the compression of repository data, including backup data. This feature presents a significant opportunity to optimize storage space. Given that CERN's user data amounts to a staggering 8 petabytes, leveraging this compression capability is crucial for enhancing storage efficiency and managing resources effectively. This project aims to implement and utilize this new feature to compress the vast amount of user data, thereby achieving substantial space savings.