Published August 25, 2021 | Version v1
Technical note

Integration of CMS Operational Intelligence projects

Authors/Creators

  • 1. CERNSummerStudent

Description

Integration of CMS Operational Intelligence projects In order to handle CMS central production and data processing, jobs are automatically submitted to the CMS computing grid within workflows. Jobs may fail due to temporary issues in computing sites or mis-configuration of workflow parameters. Although many of the failed jobs are recovered automatically, there are still a large number of workflows every day that need manual intervention for resubmission. Operational Intelligence (OpInt) is a cross-experiment project aiming to reduce the cost of computing operations by increasing automation in repetitive tasks. OpInt is going to provide a framework to model the workflow management and to store metadata information. This framework can be used to facilitate error handling and the stored information will be used later to train machine learning models for automation of workflow management. The goal of this project is to integrate the CMS workflow management into the OpInt framework. This project requires mainly python and linux background and is a great candidate for a summer student project. Actually,This project was in the field of work related to CMS, the goal was to design a web application which could be used to analyze data received from CMS and receive existing errors. In fact, the goal was to design a server that, when we told it, would come up with information about the broccoli waiting for our action ,Come and call this workflow package.This layer is called the first layer or workflows. This layer takes all the information and returns it to the format we want. The second layer is called RestAPI. This server will run on a computer called the tni-test-cern.ch. The code is written in Python and we used the django package. In fact, django is an intermediary between the server and the client. The output that Jang returns to us at this point is just raw information in format of javascript that then, by designing an application that works on Firefox, we processed the server or restapi output. Which can be used to display the information required by the user in a good way on the web page.This is called the last layer or front end. In this project, the second layer(restAPI) was written using Django and the last layer (frontend) using Backbone.js. Finally, we were able to design a web application so that the client could access the required parameter in the CMS by using the search option on their browser page.

Additional details

Identifiers

CDS Report Number
CERN-STUDENTS-Note-2021-050

CERN

Department
PH - Physics Department
Experiment
CMS

Linked records