GSoC 2020 — CERN HSF — Framework for Automating the Retrieval and Analysis of System Information of ALICE Grid Sites in WLCG

3 min readAug 30, 2020

Introduction

Project: Framework for Automating the Retrieval and Analysis of System Information of ALICE Grid Sites in WLCG

Organization: CERN-HSF(http://hepsoftwarefoundation.org)

Mentors: Maksim Melnik Storetvedt, Nikola Hardi, Costin Grigoras

Description: This project intends to build a framework to monitor the configuration of ALICE Grid Sites in WLCG(Worldwide Large Hadron Collider Grid). At the beginning of the GSoC 2020, users had to manually submit jobs and analyze results to identify the configuration of ALICE Grid sites. This project aims to automate this process and provides web and CLI interfaces to read ALICE Grid Site information.

Project Requirements

Create a new generic JAliEn job for obtaining Grid node system information
Automate retrieving of system information from Grid worker nodes
Analyze the system information of Grid sites from the collected information of the nodes
Present the collected information of WLCG Grid sites in a user-friendly way

Tools/components built under the project

Site Sonar Job Submission and Information Querying Tool — Automate the submission of jobs to each Grid Site in ALICE Grid Sites

Repository: https://gitlab.cern.ch/kwijethu/site-sonar

Mirror: https://github.com/KalanaDananjaya/Site-Sonar-Mirror

2. Site Sonar MonAlisa Client — Automate the collection of data from the executed jobs

Repository: https://gitlab.cern.ch/kwijethu/site-sonar-ml-client

Mirror: https://github.com/KalanaDananjaya/Site-Sonar-ML-Client-Mirror

3. Site Sonar Website Backend — API to connect to the backend

Reposirotry: https://gitlab.cern.ch/kwijethu/site-sonar-backend

Mirror: https://github.com/KalanaDananjaya/Site-Sonar-Backend-Mirror

4. Site Sonar Website FrontEnd — Allow users to query the collected data

Repository: https://gitlab.cern.ch/kwijethu/site-sonar-frontend

Mirror: https://github.com/KalanaDananjaya/Site-Sonar-Frontend-Mirror

All the work of these components is finished and can be used as-is to achieve the project goals. A temporary deployment has been created and made available to the organization.