Building Bridges: Cloud Native and High Performance Computing

Transcript

1. WELCOME TO VALENCIA
2. Building Bridges: Cloud Native and High Performance Computing Ricardo Rocha, CERN @ahcorporto
4. “ High Performance Computing most generally refers to the practice of aggregating computing power in a way that delivers much higher performance than one could get out of a typical desktop computer or workstation in order to solve large problems in science, engineering, or business. “
5. “ High Performance Computing most generally refers to the practice of aggregating computing power in a way that delivers much higher performance than one could get out of a typical desktop computer or workstation in order to solve large problems in science, engineering, or business. “
6. Source: https://www.top500.org/ November 2021
7. Source: https://www.top500.org/ November 2021
8. Low Latency High Throughput NUMA Awareness Advanced Scheduling Software Distribution
9. “ High Throughput Computing is a computing paradigm that focuses on the efficient execution of a large number of loosely-coupled tasks. HTC systems are independent, sequential jobs that can be individually scheduled on many different computing resources across multiple administrative boundaries “
11. Low Latency High Throughput NUMA Awareness Advanced Scheduling Software Distribution
12. Low Latency High Throughput NUMA Awareness Advanced Scheduling Software Distribution Cross Boundaries
13. Workloads, not just Pods Queues and Priorities, not all workloads are equal Fair Sharing, resource usage optimization Gang Scheduling, Array jobs Advanced Scheduling and Batch
18. Cluster Queue Cluster Queue Cluster Queue Cluster Queue Queue Queue Queue Queue ATLAS CMS ALICE LHCb Cluster Queue ATLAS CMS ALICE LHCb SIG Scheduling: Kueue https://github.com/kubernetes-sigs/kueue
19. The Last Mile Kubernetes Batch WG https://github.com/kubernetes/community/tree/master/wg-batch CNCF Batch System Initiative https://github.com/cncf/tag-runtime/issues/38 CNCF Research User Group https://community.cncf.io/research-end-user-group/