Skip to Content

Blue Waters Webinars

Jupyter as the Interface to High Performance Computing

Photograph Placeholder Matthias Bussonnier

Research Facilitator
UC Merced

Photograph Placeholder Shreyas Cholia

Group Leader (Usable Software Systems)
Computational Research Division / National Energy Research Scientific Computing Center
Lawrence Berkeley National Laboratory

Photograph Placeholder Rollin Thomas

Big Data Architect
National Energy Research Scientific Computing Center
Lawrence Berkeley National Laboratory


Presenters' Bios

Matthias Bussonnier is a Research Facilitator at UC Merced and one of the founding members and core contributors to the Jupyter project.

Shreyas Cholia leads the Usable Software Systems Group in the Computational Research Division at Lawrence Berkeley National Laboratory. His group focuses on the usability aspects of computational and data analysis systems. He is involved in various Jupyter related efforts at NERSC and LBL. Projects include the NERSC JupyterHub deployment and seamless integration of Jupyter with remote distributed resources at scale.

Rollin Thomas is a data architect in the Data and Analytics Services group at NERSC. He directs Python support on NERSC's Cray XC30 (Edison) and XC40 (Cori) systems, oversees the NERSC Exascale Science Application Program for Data, and is part of the Spin containers-as-a-service team. He also leads efforts to enable interactive supercomputing at NERSC through Jupyter notebooks.


Abstract

During the last few years the Jupyter notebook has become one of the tools of choice for the data science and high-performance computing (HPC) communities. This webinar will provide an overview of why Jupyter is gaining traction in education, data science, and HPC, with emphasis on how notebooks can be used as interactive documents for exploration and reporting. We will present an overview of how Jupyter works and how the network protocol can be leveraged for both a local single machine and remote-cluster work. We will discuss the nuts and bolts of how Jupyter has been deployed at NERSC as a case study in implementation of Jupyter in an HPC environment. This work implies learning the Jupyter ecosystem to take advantage of its powerful abstractions to develop custom infrastructure to satisfy policies and user needs.


Session details

When: 10:00 CDT, April 24, 2019
Length of session: 1 hour
Prerequisites: None.
Target Audience: Jupyter users, Python enthusiasts, HPC practitioners, HPC facility staff and management.


Webinar video

URL: https://youtu.be/P1hIVZL_7jA
Slides: PDF (Bussonnier, 4.4 MB), PDF (Thomas & Cholia, 2.1 MB)
Survey: Link (Google Forms)