Published July 10, 2018 | Version v1
Presentation Open

Sharing server nodes for storage and compute Batch on EOS Extra Resources

Authors/Creators

  • 1. ROR icon European Organization for Nuclear Research
  • 1. ROR icon European Organization for Nuclear Research
  • 2. Petersburg Nuclear Physics Institute RU
  • 3. Norwegian University of Science and Technology NTNU NO

Description

Based on the observation of low average CPU utilisation of several hundred disk servers in the EOS storage system at CERN, the Batch on EOS Extra Resources (BEER) project developed an approach to utilise these resources for batch processing. After initial proof of concept tests, showing almost no interference between the batch and storage services, a model for production has been developed and implemented. This has been deployed on part the CERN EOS preproduction instance. The implementation and test results will be presented. The potential for additional resources at the CERN T0 centre is of the order of ten thousand hardware threads, as well as being a step towards a hyper-converged infrastructure.

Files

Files (7.1 MB)

Name Size Download all
md5:1f702f8a32f574a8453103553ec6b5b4
7.1 MB Download

Additional details

Identifiers

CDS
2653016
CDS Report Number
IT-TALK-2018-011

Related works

References
Conference paper: 2653012 (CDS)

CERN

Department
IT

Linked records