Configure Executioncourse¶
-
Course summary
Configure Execution is a hands-on introduction to adapting Nextflow pipeline execution to different compute environments.
Working through goal-oriented exercises, you will learn how to switch software packaging technology, select an execution platform, control compute resource allocations and retries, and bundle configuration into switchable profiles.
You will take away the skills and confidence to configure Nextflow pipeline execution like a pro.
-
Additional information
Technical requirements
You will need a GitHub account OR a local installation of Nextflow. Our training courses are compatible with Nextflow version 25.10.2 or later and require the use of the v2 parser. See Environment options for more details.
Learning objectives
- Switch software packaging technology between Docker and Conda
- Select an execution platform and understand how Nextflow adapts task execution to it
- Control compute resource allocations, and automatically retry tasks that fail
- Define and combine profiles to switch between preset configurations
Audience & prerequisites
- Audience: This course is designed for learners who already know how to launch local Nextflow pipelines and want to configure execution in more depth.
- Skills: Some familiarity with the command line is assumed.
- Courses: Must have completed Nextflow Run or otherwise be comfortable running a local pipeline with
nextflow run.
Course overview¶
This course is hands-on, and builds on the skills covered in Nextflow Run.
You will take the same multi-step pipeline from that course and progressively adapt its configuration to different compute environments, then bundle everything into profiles you can switch between at runtime.
Lesson plan¶
| Course chapter | Summary | Estimated duration |
|---|---|---|
| Part 1: Adapt to your compute environment | Switch software packaging technology and select an execution platform | 20 mins |
| Part 2: Manage compute resources and failures | Control resource allocations, and automatically retry tasks that fail | 15 mins |
| Part 3: Use profiles to switch configurations | Define and combine profiles, and inspect the fully resolved configuration | 15 mins |
By the end of this course, you will be comfortable configuring Nextflow pipelines for a range of compute environments, and switching between them with minimal hassle.
Ready to take the course?