Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

從零開始導入 Singularity Container 歷程雜談

Avatar for Frank Lin Frank Lin
January 13, 2021
Programming
380
1

從零開始導入 Singularity Container 歷程雜談

Cloud Native Taiwan 年末聚會 Lighting talks

Avatar for Frank Lin

Frank Lin

January 13, 2021

More Decks by Frank Lin

See All by Frank Lin
那些年我們在開源社群的日子 - Cloud Native Taiwan
Avatar for Frank Lin yylin1
0
350
DeepOps – An efficient way to deploy GPU cluster for computing
Avatar for Frank Lin yylin1
0
1.3k
Kubeflow 進行分散式深度學習訓練之作業排程瓶頸
Avatar for Frank Lin yylin1
0
1.5k
Kubeflow 對於機器學習平台的願景
Avatar for Frank Lin yylin1
1
1.3k
kubeCon經驗分享-搭上KubeCon大船遇見 Kubeflow Community大牛們
Avatar for Frank Lin yylin1
1
330
Kubeflow:容器機器學習實戰
Avatar for Frank Lin yylin1
2
680

Other Decks in Programming

See All in Programming
APNsからLive Activityを開始する話
Avatar for Ryotaro Onoue yumnumm
0
150
モジュールの視点からSwiftを読み解く #iosdc
Avatar for Shigure Shimotori s_shimotori
0
340
Verilogで学ぶCPU自作入門.pdf
Avatar for uyuki uyuki234
8
4k
[ハンズオン]AIへの指示だけで「五目並べ」を作ってみよう
Avatar for Satoshi Kaneyasu satoshi256kbyte
1
340
SalesForceを内製化！？ ~ HR事業を支える顧客管理基盤のインフラを大公開 ~
Avatar for Kobujee_53 oku053
0
120
FreeBSDでZabbixを動かす
Avatar for kenkino kenkino
0
350
Webの地図
Avatar for Yosuke Furukawa yosuke_furukawa
PRO
6
5k
難しいけど、読めた。- OSSの入口に立った話。
Avatar for shota sts11142
0
140
IBM Bob Dojo #1 仕様駆動開発入門
Avatar for Akira Onishi (IBM) oniak3ibm
PRO
0
350
The Rails Doctrine Decade
Avatar for Koichi ITO koic
2
490
マイコン向けの軽量Ruby「PicoRuby」で各種デバイスを制御するネイティブアプリの実現手法
Avatar for bash0C7 bash0c7
0
470
Domain-Driven Transformation
Avatar for Henning Schwentner hschwentner
2
2.3k

Featured

See All Featured
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
123
22k
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
420
Data-driven link building: lessons from a $708K investment (BrightonSEO talk)
Avatar for Szymon Słowik szymonslowik
1
1.4k
A better future with KSS
Avatar for Kyle Neath kneath
240
18k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
How To Speak Unicorn (iThemes Webinar)
Avatar for Michelle Schulp Hunt marktimemedia
1
590
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
360
31k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
672
58k
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
530
Avoiding the “Bad Training, Faster” Trap in the Age of AI
Avatar for Mike Taylor tmiket
0
260
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon Słowik szymonslowik
1
460
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
970

Transcript

  1. 從零開始導入 Singularity Container 歷程雜談 Frank Lin

  2. Frank Lin 林義洋 • Infrastructure Engineer at Cadence • Co-organizer

    of Cloud Native Taiwan User Group

  3. 選擇 Contaienr Runtime • 安全性 • 效能減損問題 • Developer 對開發版本環境依賴性

  4. Singularity Container • 專門為HPC和深度學習(DL)工作負載開發，具備輕量資源開銷小、 啟動迅速、快速部署、方便遷移與擴展 • 無需 root 權限的特性廣受 HPC

    相關應用服務採用

  5. 選擇 Singularity Container • 限制容器使用者權限，使用者權限在容器內部和外部都是相同的 • 能直接在容器啟動目錄下切換環境, 無同步上問題，會有沒有進入容器的錯覺 • 授權

    fakeroot 就可以建立/修改自己需要的 image 環境, 無需 root 權限 • 可使用 Docker Hub / 的資源 • 簡單的 image / sandbox 概念設計 • 符合 OCI 標準, CRI 介面 • 單文件格式SIF增強環境遷徙

  6. Singularity 安利! - Linux Developer 都應該學習 Ref: https://champyen.blogspot.com/2020/10/linux-developer-container-singularity.html

  7. 可以一起從零開始 • 基本介紹 Ref: https://yylin.io/2020/06/16/singularity-introduction/

  8. k8s + singularity-cri

  9. Singularity CRI • Sylabs 供應商沒有計畫要持續支援 2019 !!!!!

  10. None

  11. k8s + singularity-cri

  12. 從零開始到放棄

  13. https://indico.cern.ch/event/757415/contributions/3421576/attachments/1856070/3048604/Solving_Problems_in_H PC_with_Singularity.pdf