Published January 31, 2023 | Version 1.0.0
Dataset Open

M100 dataset 8: 22-05

Description

This entry is a part of a larger data set collected from the most recent Tier-0 supercomputer hosted at CINECA (Marconi100, https://www.hpc.cineca.it/hardware/marconi100). The data covers the entirety of the system, ranging from the computing nodes (980+ computing nodes) internal information such as core loads, temperatures, frequencies, memory write/read operations, CPU power consumption, fan speed, GPU usage details, etc., to the system-wide information, including the liquid cooling infrastructure, the air conditioning system, the power supply units, workload manager statistics, and job-related information, system status alerts, and weather forecast.
It comprises hundreds of metrics measured on each computing node, in addition to hundreds of other metrics gathered from sensors monitored along all system components.
The whole data set is stored as a collection of Zenodo entries; this particular entry corresponds to the period: 22-05.

The dataset is stored as a partitioned Parquet dataset, with this partitioning hierarchy: year_month ("YY-MM"), plugin, metric. The data is distributed as tarball files, each corresponding to one month of data (first-level partitioning, year_month).
The collected data is generated by a monitoring infrastructure working on unstructured data (to improve efficiency and scalability); however, this data has been organized in a structured manner to facilitate its fruition. The simplest way to understand how the access the data is to refer to the companion software modules released together with the dataset itself, which can be found at: https://gitlab.com/ecs-lab/exadata.

Files

Files (33.2 GB)

Name Size Download all
md5:54d6c1de33aa934bee6215f4a4a2ddb6
33.2 GB Download

Additional details

Funding

European Commission
REGALE – An open architecture to equip next generation HPC applications with exascale capabilities 956560
European Commission
EUPEX – EUROPEAN PILOT FOR EXASCALE 101033975
European Commission
The European PILOT – Pilot using Independent Local & Open Technologies 101034126
European Commission
DECICE – Device-Edge-Cloud Intelligent Collaboration framEwork 101092582
European Commission
Graph-Massivizer – Extreme and Sustainable Graph Processing for Urgent Societal Challenges in Europe 101093202