Share
Embed
Transcript
28 slides
-
AI Company Upstage Upstudy Hyperconnect Director of AI Sungjoo Ha
June 17th, 2022 Sungjoo Ha 1 -
AI Company • য়ט ઁ: AI company • ੋఠ֔ ӝࣿਸ
ੜ ഝਊೠ ӝস internet companyۄ ࠛ۷Ҋ ח ݽ߄ੌ दө য • Amazon, Alphabet, Facebook, Alibaba, Tencent, etc. • AI द AI companyח ޖ ܳө? • ݽܰ݅ ѐੋਵ۽ ࢤп೮؍ ݻ о ನੋী ೠ ࣗѐ Sungjoo Ha 2 -
Jeff Bezos in 1997 In the book space, there are
more than three million different books worldwide active and in print at any given time across all languages, so when you have that many items, you can literally build a store online that couldn't exist any other way. 1 1 https://youtu.be/rWRbTnE1PEM Sungjoo Ha 4 -
Aggregators • Zero marginal cost • ٣ణ ইమਸ ౸ݒೞחؘী ୶о
࠺ਊ ٜ ঋ • Distributionী ࠺ਊ ٜ ঋ • Transactionী ࠺ਊ ٜ ঋ • ܳ ӓೠਵ۽ ഝਊೠ Ѫ ҳӖա ಕझ࠘җ э super-aggregator2 • ੋఠ֔ী ઓೞח Ѫ value proposition ইש • ੋఠ֔ ࢜۽ ח оܳ ߉ইٜҊ ੋఠ֔ ইפݶ ࢿ݀ೡ ࣻ হח ࠺ૉפझܳ ݅ٝ 2 https://stratechery.com/concept/aggregation-theory/ Sungjoo Ha 5 -
Internet-Enabled Technology • Internet द ӝࣿ • ੋఠ֔ दী ਢಕח
݅ ੋఠ֔ਵ۽ ੋ೧ оמ೧ ӝࣿਸ ഝਊೞח ӝস ઁೠ • ਬ ೯زী ೠ ࣻਸ ߄ఔਵ۽ ࢎਊܳ ೧ೞח Ѫ • ೠ ߊ աইоࢲ A/B test ೞח Ѫ3 • 1֙ী ೠ ف ߣ ߓನೞ؍ Ѫ • Continuous integration4, continuous deployment ١ਵ۽ ݒੌݒੌ ߓನ • ӓױਵ۽ ૣ ఠۨ࣌ ࢎਸ ٜ݅যղҊ product-market-fitਸ ӝ ਤ೧ ࡅܰѱ ח Ѫ оמ೧ • ܳ оמாೞח ઑ ҳઑ 4 Martin Fowlerо ࢿೠ 2006֙ Ӗীࢲ CI ਊযо ࢎਊ 3 Google 2000֙ী A/B పझܳ दب Sungjoo Ha 6 -
Learnings From The Past • Internet company द۽ࠗఠ ࢤп೧ࠁח AI
company • AIо ইפݶ ࢿ݀غ ঋח ࠺ૉפझ • ӝઓী ഃ ࠛоמೞ؍ Ѫ оמ೧ח Ѫ • ઑӘ ؊ ևѱ ೧ࢳ೧ࠁݶ AI दী оמ೧ ࢜۽ ӝࣿਸ ੜ ഝਊೞ ח ഥࢎ Sungjoo Ha 7 -
Algorithm + Compute + Data • ML ޙઁীࢲ ݏׯڰܻח ف
о ޙઁ • ݽ؛ ࢿמ णࣇীࢲ ծ ҃ • underfitting: ݽ؛ ࣻਊ۱ ૐо • ݽ؛ ࢿמ పझࣇীࢲ ծ ҃ • overfitting: ؘఠ ୶о • അ ML ӝࣿ ݽ؛ ࣻਊ۱(capacity)ਸ ޖೠ טܾ ࣻ • ܳ جܻӝ ਤೠ ҅ ਗҗ • ࠙ೠ ন ؘఠ݅ ਵݶ ҅ࣘ ࢿמ જই • 2010֙ ୡ߈ ীח ۠ ѐ֛ হਵݴ ୭Ӕ ٜয ۠ ܴ ؊ ъചغҊ Sungjoo Ha 8 -
AI Strategy • ܲ ۨযٜ যڃ ࢤпਸ ೞҊ ਸө? AI
ۚ ަө? • ٜ ৈ۞ оמࢿਸ ࠁݶࢲ ߬ೞҊ • Google: AI 3ਃࣗܳ ೠ ۽ ݽف ы୶Ҋ ח ݻ উغח ӝস • OpenAI: Ѣ ݽ؛ী ೠ ъೠ ਸ ాೠ ߬ • Tesla: അઓೞח ӝࣿਸ ӓೠਵ۽ ഝਊೞח ߡ౭ஸ ా Sungjoo Ha 9 -
AI Strategy -- Google • AI 3ਃࣗܳ ೠ ۽ ݽف
ы୶Ҋ ח ݻ উغח ӝস • Google Brainա Deepmind৬ э ೠ োҳࣗ5 • TPUܳ ੌଧх ઁ6 • ࣁ҅ ݽٚ ؘఠܳ ൚ࣻ • নೠ AI Ӕ ߑߨਸ ನಫܻয়۽ • AI investment fund • AI M&A • Scaling, neuroscience, ... 6 2015֙ द 5 GBח 2011֙ founding, DMח 2014֙ acquisition Sungjoo Ha 10 -
AI Strategy -- OpenAI Conviction that if you take the
right stuff, which already exists, and apply and mix it with a lot of data and a lot of compute, that it will in fact work. And so that was the missing piece.7 • Scaling hypothesis ߬ 7 https://www.youtube.com/watch?v=13CZPWmke6A&t=950s Sungjoo Ha 11 -
AI Strategy -- Tesla • അઓೞח ӝࣿਸ ӓೠਵ۽ ഝਊೞח ߡ౭ஸ
ా • Data engine • Auto labeling8 • Shadow mode 8 https://youtu.be/j0z4FweCy4M?t=5157 Sungjoo Ha 12 -
Zero Marginal Content • AIо ইפݶ ࢿ݀ೡ ࣻ হח ࠺ૉפझח
ޖੌ ө? • ݻ о ൦ח • Zero marginal cost content creation • GPT-3 (copilot), DALL·E 2 • Sampling റ ࢎۈ ࢶఖೞѱ ೞח Ѫ • Super-human decision making • AlphaGo, AlphaFold Sungjoo Ha 14 -
AI-Enabled Technology • ӝসٜঠ নೠ ߬ਸ ೡ ࣻ ݅
ഥࢎח যڌѱ? • AI दীח ੋఠ֔ द ܴҗ ࠺तೞѱ AI ݽ؛ ٜ ࢎਊೡ Ѫ • ৈӝীࢲ بػ 2ରੋ ѐ֛/ӝࣿ/ޙചܳ ݃ա ੜ ഝਊೞջب ਃೠ ನੋо ؼ Ѫ • ݃ A/B పझܳ ೞח ഥࢎ৬ ইצ ഥࢎо աҊ • CI/CDܳ ഝਊೞח ഥࢎ৬ ইפפ ഥࢎо աח Ѫۢ Sungjoo Ha 15 -
Learned Business Logic • ࠺ૉפझ ۽ -> ݽ؛ Үജ •
࠺ૉפझ ۽: A ݶ B • ۽Ӓېݠٜ ٜ݅যղח ٘ ݆ ࠗ࠙ ࠺ૉפझ ۽ • ѱ ޤо ؘܲ? ۽Ӓېݠо ೞܖݶ ٜ݅؍Ѧ ҡ ML ॄࢲ ೠ׳ Ѧ۰ࢲ ݅٘ח Ѣ ইפঠ? • ࢎۈࠁ ੜ ೡ ࣻ ח ҃о • Aݶ Bীࢲ A ઑѤ ցޖցޖ ࠂ೮ݶ ࢎۈ ޅೣ • Software 2.0 Sungjoo Ha 16 -
Software Rot • ࠺ૉפझ ۽ب ࣗਝযب ॅ • ߸ ജ҃
߄Շӝ ٸޙ • ࢜۽ ӝמ ࢤӝҊ, ઁಿਸ Ցয оҊ ೞח ߑೱ ߄ՇҊ, ࢎਊо ߄ՇҊ... Ӓېࢲ ॅ • ࠁా Ѧ যڌѱ ೞջ? ࣗਝয ূפযо ٘ܳ ࣻ • Aݶ B ೮חؘ ઁח Aݶ C ೧ঠ ೠ • Ӕؘ ѱ ݽ؛ݶ • ࣘਵ۽ ؘఠ ࣻೞҊ ܳ ߄ఔਵ۽ ݽ؛ ঌইࢲ ജ҃ী • ؘఠ ऺݶ ࢿמب ؊ જই ࣻ Sungjoo Ha 17 -
Example • ോܻझ౮ vs ݽ؛ • द ࢎۈ ݅ٚ ോܻझ౮
જওਵա ࣘਵ۽ ࢿמ ೞۅ • ݽ؛ द աࡍਵա ࣘਵ۽ ࢿמ ࢚ थ Sungjoo Ha 18 -
Ideal • ݽٚ ࢎ Ѿ ਃೠ Ҕী ݽ؛ਸ ഝਊ •
ݽٚ Ѫ زച • ҳӖ द • ݂ झாેਸ زਵ۽ ೞৈ ؘఠࣃఠ պߑ࠺ܳ 40 ಌࣃ х • ౠ ࠺ૉפझ/۽؋ ਃ ޙઁܳ AI ޙઁ۽ ജೡ ࣻ ਵݶ ߬झ • Ӓ۞ݶ ҅ࣘ೧ࢲ ࣘਵ۽ ઁಿ ѐࢶغח ҃ਸ ೡ ࣻ ਸ Ѫ Sungjoo Ha 19 -
Easy? • औա? No • ML/ঌҊ્ܻ, ҅ਗ, ؘఠ ыঠ
ೣ • ݅ ॶݽӝ ਤ೧ ೦࢚ ఠޖפ হ ݆ ҅ਗҗ ؘఠо ਃೞח ঋ • ೡ ࣻח ח ب • Ӓېب ݆ਸࣻ۾ ٙ • ӒܻҊ അ ӝࣿ۽ب оמ • ҙ۲ػ ঠӝ ઑӘ ؊ ೧ࠁݶ... Sungjoo Ha 20 -
ML Model • ೠػ ؘఠ۽ જ Ѿҗܳ যղ۰ݶ ݽ؛ ஏݶ
Ҋ ݆ ਃ • AI ӝࣿ ߊ ࣘبо ցޖ ࡅܴ • ী ղܽ Ѿۿ ࢜۽ ӝࣿ աয়ݶࢲ Ҋغযঠ ೞח ҃ب ݆ • ୭न ӝࣿ زೱਸ ੜ ಝঠ ೣ • ݽ؛۞ٜ ࣗਝয ূפয݂ب ੜೞח Ѫ ൨ٝ • ݽ؍ೠ ஶపց ӝ߈ ূפয݂ী ೠ Ҋ ਃ • ӝࣿ Բ݅ ߄Շযࢲ ࡅܰѱ ٮۄоࠁݶ ߸҃ ݆ • ഈস ҳઑী ೠ Ҋ ਃ Sungjoo Ha 21 -
Compute • ݽ؛ਸ ٜ݅ӝ ਤ೧ ҅ ਗ ਃ •
҅ ਗਸ ؘఠ۽ ߄Բח ҃ب ݆ • AlphaGo • Data augmentation • ݽ؛ ࢲࡂب য۰ Sungjoo Ha 22 -
MLOps • ML ݽ؛җ ࣗਝয ਬӝੋ Ѿਸ ਤೠ Ҋ ਃ
• അੋ بҳ ѐߊ • ؘఠ ۄੋ • ࣘਵ۽ ݽ؛ णೞח ۄੋ • ݽ؛ ࢿמ ز ಣо • ز ݽ؛ ߓನ • Shadow mode Sungjoo Ha 23 -
Data • ઁಿਸ ా೧ ؘఠܳ ദٙೡ ࣻ ח ؘఠ ۚ
ਃ • যڃ ؘఠܳ যڌѱ ࣻೡө? • যڌѱ ਸ ਸө? • Negative sampling ١ • human-in-the-loop दझమਸ যڌѱ ੜ ೡө? • ݽ؛ ੜ ೞҊ ח যڌѱ ࣘਵ۽ ݽפఠ݂ೞ? • ా ؘఠ ਝযೞझ • Feature store • ؘఠ ࢿ • ML ࢿמী о ೱਸ ח ࠗ࠙ • ߡӒ োࣘ Sungjoo Ha 24 -
AI PM • ۽؋ ਃ ޙઁܳ AI ޙઁ۽ যڌѱ ജೡ
ࣻ ਸө? • ܳ ా೧ ࢎਊٜ ݅بо য়ܰҊ ؊ ݆ ؘఠܳ ٜ݅যղҊ ؊ ա ઁಿਵ۽ যח • ਸ ӝ ए ҃ب Ҋ য۰ ҃ب Ҋ • AI ӝࣿਸ ೧ೞҊ ী ݏ ઁಿਸ э ҳࢿ೧ঠ ೣ • ӝദী ೠ ࢎ ࣗాਸ ਤೠ ࢜۽ য/بҳ/۽ࣁझ ਃ Sungjoo Ha 25 -
TikTok • ߑೠ ন బஎ • ন ਸ ࠁೠח Ѻೞী
ӏݽ ݃ாਸ ాೠ ݽٚ פ ൚ࣻ • ࣚऔѱ బஎܳ ٜ݅ ࣻ ب۾ ب৬ח নೠ ઁ بҳ ઁҕ • ݺߔೠ ਸ ਵ۽ ਸ ࣻ ח ߑधਵ۽ UIܳ ҳࢿ • ೠ ߣী ೞա ࠺٣য়݅ ࠁݴ ࢎਊ swipe ৈࠗ۽ ஂೱਸ ݺߔೞѱ ഛੋ • implicit feedback -> explicit feedback • ஏ ӝ߈ ࢎਊ ݽ؛݂ • ױࣽ ੋध(recognition)ীࢲ Ӓח Ѫ ইפۄ ࢎਊо যڌѱ ೯زೞח ݺߔೠ ೖ٘ߔਸ ߉ب۾ ҳࢿ Sungjoo Ha 26 -
Culture • ੌೞח ߑध, ޙചب ਃ • AI ӝദۄחѱ ই
ઓೞח ঋ • Ӓ۞ࠁפ э যڌѱ ੌೡী ೧ࢲب Ҋ೧ࠊঠ ೣ • ݽٚ ઑ/ҳࢿਗ ী ೠ Ӓܿਸ ݠ݁ࣘী ыҊ ӝৈ೧ঠ ೣ • ࢎ Ѿӂٜب ח ࣻળਵ۽ AIী ೧ ೧೧ঠ • ઑҳઑب ۞ೠ ղਊਸ ߈೧ঠ • Conway ߨ Sungjoo Ha 27 -
Conclusion • AI ӝࣿਸ ా೧ ী ೡ ࣻ হ؍ Ѫਸ
ೡ ࣻ ח ഥࢎٜ ࢤӡ Ѫ • AI ӝࣿ ݅ ੜ ഝਊೞח Ѫਵ۽ ର߹ചח оמ • ӝࣿী ೠ ೧৬ ઑ ҳઑ ߂ সޖ ߑध ߂ ޙച ١ নೠ ஏݶীࢲ Ҋ۰೧ঠ AI ӝࣿਸ ੜ ഝਊೡ ࣻ • ࢎ Ѿ ܖযח ݽٚ Ҕীࢲ ݽ؛ ഝਊؼ ৈо • ۽؋ ਃೠ ޙઁܳ AI ޙઁ۽ ജೞݶ ࢚ • ܳ ߄ఔਵ۽ ML ݽ؛ ѐࢶ ۽؋ ѐࢶਵ۽ যҊ ח ؊ ݆ ؘఠ۽ য ח ࢶࣽജ ҳઑܳ ٜ݅যյ ࣻ Sungjoo Ha 28