AWS megatests overhaul

Edit

Goal

Overhaul the nf-core AWS megatests: the full-size test runs that every pipeline executes on release.

Tasks

Tasks will be added closer to the event. Check back for updates.

• Update CE definitions to be more stable for on-demand fallbacks
• Port CE definitions to Terraform
• Change user management to Teams
• Add ‘Write’ permission to launch users, so they can add pipelines to the launchpad. Consider adding pipelines to the launchpad automatically and manage new releases with pipeline versions
• Update platform action to use the latest release:
  • Make use of new features, such as wait on submission
• Write and update user docs + docs for the core team:
  • How to switch CEs on failures
  • Most common work arounds
  • What to do when the action fails
• Wipe CEs on AWS account and remove all invalid CEs
• Consider if we can get a dashboard for which pipeline has full size data available on which release