|Makeflow and Work Queue|
|Computational Data Workflow Mapping|
|Kepler Scientific Workflow System|
High-performance workflows with Swift/T
Swift/T is a workflow system that enables users to combine traditional workflow features like the execution of external programs with calls to in-memory functions. Swift/T runs as an MPI program managed by a scalable load balancer, allowing it to handle trillions of tasks on large supercomputers. It offers a concise high-level language for describing data dependencies and iterations. It also allows workflows to call into embedded scripting interpreters, such as Python, R, and JVM scripting languages, allowing scripts and systems (e.g., Numpy) in these languages to be applied at large scale. In this demo, we will demonstrate Swift/T usage with Python functions on Blue Waters.
When: 10:00 CST, September 20, 2017
Length of session: 1 hour
Target audience: Researchers, developers, and scientific teams.
Training and reference materials: