Upgrade to Pro — share decks privately, control downloads, hide ads and more …

從零開始導入 Singularity Container 歷程雜談

Avatar for Frank Lin Frank Lin
January 13, 2021
Programming
1
270

從零開始導入 Singularity Container 歷程雜談

Cloud Native Taiwan 年末聚會 Lighting talks
Avatar for Frank Lin

Frank Lin

January 13, 2021
Tweet

More Decks by Frank Lin

See All by Frank Lin
那些年我們在開源社群的日子 - Cloud Native Taiwan
Avatar for Frank Lin yylin1
0
240
DeepOps – An efficient way to deploy GPU cluster for computing
Avatar for Frank Lin yylin1
0
950
Kubeflow 進行分散式深度學習訓練之作業排程瓶頸
Avatar for Frank Lin yylin1
0
1.3k
Kubeflow 對於機器學習平台的願景
Avatar for Frank Lin yylin1
1
1.2k
kubeCon經驗分享-搭上KubeCon大船遇見 Kubeflow Community大牛們
Avatar for Frank Lin yylin1
1
250
Kubeflow:容器機器學習實戰
Avatar for Frank Lin yylin1
2
550

Other Decks in Programming

See All in Programming
監視 やばい
Avatar for syossan27 syossan27
12
10k
読書シェア会 vol.4 『ダイナミックリチーミング 第2版』
Avatar for Kotaro Kamashima kotaro666
0
110
파급효과: From AI to Android Development
Avatar for HyunWoo Lee l2hyunwoo
0
160
マイコンでもRustのtestがしたい/KernelVM Kansai 11
Avatar for Toshifumi NISHINAGA tnishinaga
0
820
2025-04-25 GitHub Copilot Agent ライブデモ（スクリプト）
Avatar for GOAMI Takaaki goataka
0
110
RuboCop: Modularity and AST Insights
Avatar for Koichi ITO koic
2
2.6k
ASP.NETアプリケーションのモダナイゼーションについて
Avatar for tomokusaba tomokusaba
0
260
プロダクト横断分析に役立つ、事前集計しないサマリーテーブル設計
Avatar for Uchide Hiroki(ucchi-) hanon52_
3
550
Ruby on Railroad: The Power of Visualizing CFG
Avatar for ydah ydah
0
300
Beyond_the_Prompt__Evaluating__Testing__and_Securing_LLM_Applications.pdf
Avatar for Mete Atamel meteatamel
0
110
20250429 - CNTUG Meetup #67 / DevOps Taiwan Meetup #69 - Deep Dive into Tetragon: Building Runtime Security and Observability with eBPF
Avatar for ChengHao Yang tico88612
0
170
GitHub Copilot for Azureを使い倒したい
Avatar for Kento.Yamada ymd65536
1
330

Featured

See All Featured
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
19
1.2k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
329
39k
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
29
930
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.2k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
45
9.5k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
Building Applications with DynamoDB
Avatar for Matt Wood mza
94
6.4k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
133
9.3k
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.1k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
51
3.2k
Building Adaptive Systems
Avatar for Chris Keathley keathley
41
2.5k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
91
6k

Transcript

  1. 從零開始導入 Singularity Container 歷程雜談 Frank Lin

  2. Frank Lin 林義洋 • Infrastructure Engineer at Cadence • Co-organizer

    of Cloud Native Taiwan User Group

  3. 選擇 Contaienr Runtime • 安全性 • 效能減損問題 • Developer 對開發版本環境依賴性

  4. Singularity Container • 專門為HPC和深度學習(DL)工作負載開發，具備輕量資源開銷小、 啟動迅速、快速部署、方便遷移與擴展 • 無需 root 權限的特性廣受 HPC

    相關應用服務採用

  5. 選擇 Singularity Container • 限制容器使用者權限，使用者權限在容器內部和外部都是相同的 • 能直接在容器啟動目錄下切換環境, 無同步上問題，會有沒有進入容器的錯覺 • 授權

    fakeroot 就可以建立/修改自己需要的 image 環境, 無需 root 權限 • 可使用 Docker Hub / 的資源 • 簡單的 image / sandbox 概念設計 • 符合 OCI 標準, CRI 介面 • 單文件格式SIF增強環境遷徙

  6. Singularity 安利! - Linux Developer 都應該學習 Ref: https://champyen.blogspot.com/2020/10/linux-developer-container-singularity.html

  7. 可以一起從零開始 • 基本介紹 Ref: https://yylin.io/2020/06/16/singularity-introduction/

  8. k8s + singularity-cri

  9. Singularity CRI • Sylabs 供應商沒有計畫要持續支援 2019 !!!!!

  10. None

  11. k8s + singularity-cri

  12. 從零開始到放棄

  13. https://indico.cern.ch/event/757415/contributions/3421576/attachments/1856070/3048604/Solving_Problems_in_H PC_with_Singularity.pdf