ESiWACE2 HPDA and VIS Course 2022

Europe/Berlin
Donatello Elia (CMCC), Florian Ziemen (DKRZ)
Description

 

As the volumes of weather and climate data expand, it is of paramount importance for scientists to exploit techniques and solutions able to efficiently extract knowledge from these data. 

This online training course aims to increase scientists’ expertise on data analysis and visualisation applied to climate and weather domains, using high-performance data analytics (HPDA) and visualisation tools available from the open source market (i.e., Ophidia and ParaView). 

Ocean currents and clouds overlain on a satellite image

The training covers topics from simple analytics tasks to workflows and applications (e.g., Python-based) and provides best practices and guidelines on dealing with massive scientific datasets on HPC architectures. 

Examples of real applications of the tools for data analytics and visualisation (i.e., Ophidia and ParaView) in the climate and weather domain will be presented. The training will include demos and hands-on sessions concerning the different tools. 

This course is organised in the context of the “Centre of Excellence in Simulation of Weather and Climate in Europe” (ESiWACE) phase 2 project.

Topics:

  • Introduction to big data, scientific data management and analytics at scale

  • The open-source High Performance Data Analytics (HPDA) tool Ophidia

  • Data Analytics workflows for eScience

  • Introduction to data visualisation using ParaView

  • Discussion of visualisation workflows, from post to in-situ

 

Audience: The training targets the audience in the field of weather and climate research with different backgrounds, from computer to Earth system scientists. This course is open to students, young scientists and also more experienced researchers/engineers who wish to improve their data analytics and visualisation skills. Basic knowledge of Python, Linux, NetCDF data format and general aspects concerning climate/weather data is required to fully take advantage of the training.

 

Preliminary Schedule: The training is organised as an 8-hour online course, divided into 4 sessions, with 2 hours of work per day required for the participants. The event is scheduled for September 6-9, 2022 according to the following calendar:

  • Session 1: Introduction to Ophidia, 6th September 2022, 14.30-16.30

  • Session 2: Ophidia advanced concepts, 7th September 2022, 14.30-16.30

  • Session 3: Introduction to ParaView, 8th September 2022, 14.30-16.30

  • Session 4: Advanced ParaView use, 9th September 2022, 14.30-16.30

Each session combines presentations about the various topics and practical tutorials/hands-on.

Participation: Registration is required for attending the online live training sessions. The training materials (e.g., slides, instructions, notebooks, scripts, etc.) will be made available. Instructions and materials for the practical sessions will be made available beforehand to registered users. Note that the registration closes on the 2nd of September AoE.

We encourage registration and participation of attendees with diverse backgrounds and of all genders in order to foster diversity and inclusion.

Admin
Surveys
ESiWACE2 2022 HPDA and VIS course survey