Upgrade to Pro — share decks privately, control downloads, hide ads and more …

從零開始導入 Singularity Container 歷程雜談

Avatar for Frank Lin Frank Lin
January 13, 2021
Programming
330
1

從零開始導入 Singularity Container 歷程雜談

Cloud Native Taiwan 年末聚會 Lighting talks

Avatar for Frank Lin

Frank Lin

January 13, 2021

More Decks by Frank Lin

See All by Frank Lin
那些年我們在開源社群的日子 - Cloud Native Taiwan
Avatar for Frank Lin yylin1
0
300
DeepOps – An efficient way to deploy GPU cluster for computing
Avatar for Frank Lin yylin1
0
1.2k
Kubeflow 進行分散式深度學習訓練之作業排程瓶頸
Avatar for Frank Lin yylin1
0
1.4k
Kubeflow 對於機器學習平台的願景
Avatar for Frank Lin yylin1
1
1.3k
kubeCon經驗分享-搭上KubeCon大船遇見 Kubeflow Community大牛們
Avatar for Frank Lin yylin1
1
290
Kubeflow:容器機器學習實戰
Avatar for Frank Lin yylin1
2
630

Other Decks in Programming

See All in Programming
AgentCore Optimizationを始めよう！
Avatar for matsukada licux
3
230
Cache-moi si tu peux : patterns et pièges du cache en production - Devoxx France 2026 - Conférence
Avatar for Sébastien LECACHEUR slecache
0
340
GitHubCopilotCLIをはじめよう.pdf
Avatar for tkym htkym
0
330
Augmenting AI with the Power of Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
300
Structured Concurrency, Scoped Values and Joiners in the JDK 25 26 27
Avatar for José josepaumard
1
150
AI-DLC Deep Dive
Avatar for yuukiyo yuukiyo
9
5.6k
書き換えて学ぶTemporal #fukts
Avatar for Hiroyuki ANAI pirosikick
2
360
Making the RBS Parser Faster
Avatar for Soutaro Matsumoto soutaro
0
680
Liberating Ruby's Parser from Lexer Hacks
Avatar for ydah ydah
2
2.6k
Spec Driven Development | AI Summit Vilnius
Avatar for Daniel Sogl danielsogl
PRO
1
140
実用！Hono RPC2026
Avatar for yodaka yodaka
2
310
認証統合から始めるフロントエンドの機能単位開発 — マイクロサービス思想の適用
Avatar for kouki.miura koukimiura
0
100

Featured

See All Featured
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
66
8.4k
Design in an AI World
Avatar for tapps tapps
1
210
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
120
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
180
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
170
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
1
360
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
870
Unsuck your backbone
Avatar for Amy Palamountain ammeep
672
58k
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
450
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
540

Transcript

  1. 從零開始導入 Singularity Container 歷程雜談 Frank Lin

  2. Frank Lin 林義洋 • Infrastructure Engineer at Cadence • Co-organizer

    of Cloud Native Taiwan User Group

  3. 選擇 Contaienr Runtime • 安全性 • 效能減損問題 • Developer 對開發版本環境依賴性

  4. Singularity Container • 專門為HPC和深度學習(DL)工作負載開發，具備輕量資源開銷小、 啟動迅速、快速部署、方便遷移與擴展 • 無需 root 權限的特性廣受 HPC

    相關應用服務採用

  5. 選擇 Singularity Container • 限制容器使用者權限，使用者權限在容器內部和外部都是相同的 • 能直接在容器啟動目錄下切換環境, 無同步上問題，會有沒有進入容器的錯覺 • 授權

    fakeroot 就可以建立/修改自己需要的 image 環境, 無需 root 權限 • 可使用 Docker Hub / 的資源 • 簡單的 image / sandbox 概念設計 • 符合 OCI 標準, CRI 介面 • 單文件格式SIF增強環境遷徙

  6. Singularity 安利! - Linux Developer 都應該學習 Ref: https://champyen.blogspot.com/2020/10/linux-developer-container-singularity.html

  7. 可以一起從零開始 • 基本介紹 Ref: https://yylin.io/2020/06/16/singularity-introduction/

  8. k8s + singularity-cri

  9. Singularity CRI • Sylabs 供應商沒有計畫要持續支援 2019 !!!!!

  10. None

  11. k8s + singularity-cri

  12. 從零開始到放棄

  13. https://indico.cern.ch/event/757415/contributions/3421576/attachments/1856070/3048604/Solving_Problems_in_H PC_with_Singularity.pdf