Virtual influencer를 위한 face swapping 기술 개발기

ա࢚അ0SDB/B ஠஠য়࠳ۨੋ $PQZSJHIU,BLBP$PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP 7JSUVBMJO fl VFODFSܳਤೠ GBDFTXBQQJOHӝࣿѐߊӝ

7JSUVBMJO fl VFODFSۆ 'BDFTXBQQJOH੉ۆ ӝઓݽ؛੄ೠ҅ ਋ܻ੄ݽ؛
.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO খਵ۽ӝ؀غח੼

7JSUVBMJO fl VFODFSۆ

7JSUVBMJO fl VFODFSۆ ୹୊IUUQT LPXJLJQFEJBPSHXJLJ&##&$#&$#$@&$%#&%$&#""&$#&$$

7JSUVBMJO fl VFODFSۆ ୹୊IUUQT XXXTBNTVOHQPQDPNDPNNPOEP DNEEPXOTBWF,FZSFTFBSDIQEG fi MF/BNF,@@QEGDPOUFOU5ZQFBQQMJDBUJPOQEG

7JSUVBMJO fl VFODFSۆ ؀৉ߓ਋оౠ੿৔࢚ਸ୫৔ ੋҕ૑מӝࣿਸ੉ਊೞৈ৔࢚੄঴ҷਸਗೞח঴ҷ۽߄Է

7JSUVBMJO fl VFODFSۆ ؀৉ߓ਋оౠ੿৔࢚ਸ୫৔ ੋҕ૑מӝࣿਸ੉ਊೞৈ৔࢚੄঴ҷਸਗೞח঴ҷ۽߄Է Face swapping

'BDFTXBQQJOH੉ۆ

'BDFTXBQQJOH੉ۆ + = ਗࠄ ৔࢚ ਗೞח ঴ҷ Face swapping!

*%JNBHFࢎਊ੗оਗೞח঴ҷ ↟ ׀ݽন ঴ҷഋ١JEFOUJUZীҙ۲ػ੿ࠁ *%੿ࠁ ઁҕ "* 'BDFTXBQQJOH੉ۆ

3FGFSFODFJNBHFWJEFPਗࠄ৔࢚ ↟ ߓ҃ ݠܻझఋੌ١JEFOUJUZܳઁ৻ೠաݠ૑੿ࠁ SFGFSFODF੿ࠁ ઁҕ 'BDFTXBQQJOH੉ۆ *%JNBHFࢎਊ੗оਗೞח঴ҷ ↟ ׀ݽন
঴ҷഋ١JEFOUJUZীҙ۲ػ੿ࠁ *%੿ࠁ ઁҕ "*

'BDF - TXBQQFEJNBHFWJEFPо૞۽ࢤࢿػ৔࢚ ↟ ઱য૓SFGFSFODF *%੿ࠁܳ೤ࢿ೧ࢲ࢜۽਍৔࢚ࢤࢿ 3FGFSFODFJNBHFWJEFPਗࠄ৔࢚ ↟ ߓ҃ ݠܻझఋੌ١JEFOUJUZܳઁ৻ೠաݠ૑੿ࠁ
SFGFSFODF੿ࠁ ઁҕ 'BDFTXBQQJOH੉ۆ *%JNBHFࢎਊ੗оਗೞח঴ҷ ↟ ׀ݽন ঴ҷഋ١JEFOUJUZীҙ۲ػ੿ࠁ *%੿ࠁ ઁҕ "*

'BDF - TXBQQJOHNPEFM 'BDFTXBQQJOH੉ۆ "*

(FOFSBUJWF"EWFSTBSJBM/FUXPSLT ("/ ↟ ѐਃ ↟ ૓૞э਷о૞੉޷૑ܳࢤࢿ೧ղח"*ݽ؛ ↟ 5BTL ↟ 3BOEPNJNBHFHFOFSBUJPO
↟ ೟णঌҊ્ܻ ↟ "EWFSTBSJBMMPTT 14 ੉޷૑୹୊,BSSBT 5FSP FUBM"OBMZ[JOHBOEJNQSPWJOHUIFJNBHFRVBMJUZPGTUZMFHBO1SPDFFEJOHTPGUIF*&&&$7'DPOGFSFODFPODPNQVUFSWJTJPOBOEQBUUFSOSFDPHOJUJPO 'BDFTXBQQJOH੉ۆ 4UZMF("/ (FOFSBU 3BOEPNDPEF 3BOEPNDPEF 3BOEPNDPEF 3BOEPNDPEF 3BOEPNJNBHF 3BOEPNJNBHF 3BOEPNJNBHF 3BOEPNJNBHF

'BDFTXBQQJOH੉ۆ 'BDFTXBQQJOHXJUI("/ *%JNBHF 3FGFSFODF JNBHF (FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT
*%MPTT 3FDPOTUSVDUJPOMPTT

૓૞୊ۢࠁੌ੿ب۽ࢎप੸ੋ о૞੉޷૑ܳࢤࢿೞب۾೟ण 'BDFTXBQQJOHXJUI("/ 'BDFTXBQQJOH੉ۆ *%JNBHF 3FGFSFODF JNBHF (FOFSBUFE JNBHF "*
"EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

*%JNBHF੄*%੿ࠁ ׀ݽন ঴ҷഋ ܳ ୭؀ೠ߈৔೧ࢲ੉޷૑ܳࢤࢿೞب۾೟ण 'BDFTXBQQJOHXJUI("/ 'BDFTXBQQJOH੉ۆ *%JNBHF 3FGFSFODF JNBHF
(FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

3FGFSFODFJNBHF੄SFGFSFODF੿ࠁ ߓ҃ ݠܻझఋੌ١ ܳ୭؀ೠ߈৔೧ࢲ ੉޷૑ܳࢤࢿೞب۾೟ण 'BDFTXBQQJOHXJUI("/ 'BDFTXBQQJOH੉ۆ *%JNBHF 3FGFSFODF JNBHF
(FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

ӝઓݽ؛੄ೠ҅

ӝઓݽ؛੄ೠ҅ ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ അ੤ࢎۈ঴ҷࢤࢿӝࣿ਷NFHBQJYFM੉޷૑ܳࢤࢿೡࣻ੓਺ ↟ ೞ૑݅ GBDFTXBQӝࣿ਷ই૒੉ী୽࠙൤޷஖૑ޅೣ ੉޷૑୹୊,BSSBT 5FSP
FUBM"OBMZ[JOHBOEJNQSPWJOHUIFJNBHFRVBMJUZPGTUZMFHBO1SPDFFEJOHTPGUIF*&&&$7'DPOGFSFODFPODPNQVUFSWJTJPOBOEQBUUFSOSFDPHOJUJPO 4UZMF("/੉ࢤࢿೠNFHBQJYFM੉޷૑

ӝઓݽ؛੄ೠ҅ 'BDFTFHNFOUBUJPONPEFM੄ب਑ਸ߉ইঠೣ ↟ 3FGFSFODFJNBHF੄BUUSJCVUFT ߓ҃ ಴੿ оੜ߈৔غ૑ޅೞӝٸޙ ↟ 4FHNFOUBUJPONPEFM੄ب਑ਸ߉ইSFGFSFODFJNBHF۽ࠗఠ೙ਃೠٜࠗ࠙ਸੜۄࢲоઉ১ 'BDFTFNHFOUBUJPO৘द
੉޷૑୹୊IUUQT HJUIVCDPNTXJUDIBCMFOPSNT$FMFC".BTL - )2

ӝઓݽ؛੄ೠ҅ ߈৔غযঠೡBUUSJCVUFTо୽࠙൤߈৔غ૑ঋ਺ ↟ 3FGFSFODFJNBHF੄಴੿ ݠܻпب ↟ *%JNBHF੄঴ҷഋ 3FGFSFODFJNBHF *%JNBHF 'BDF
- TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT

਋ܻ੄ݽ؛ .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

ӝઓ੄ޙઁ੼ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ 4PMVUJPO("/JOWFSTJPOӝ߈੄NPEFM٣੗ੋ .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

("/JOWFSTJPO 1SF - USBJOFE 4UZMF("/ (FOFSBUPS 1SF - USBJOFE 4UZMF("/
(FOFSBUPS &ODPEFS .BOJQVMBUJPO 0SJHJOBMJNBHF 3FDPOTUSVDUFEJNBHF &EJUFEJNBHF w ̂ w &YUSBDUFEDPEF .BOJQVMBUFEDPEF 3FDPOTUSVDUJPOMPTT ੉޷૑୹୊"MBMVG :VWBM 0S1BUBTIOJL BOE%BOJFM$PIFO - 0S3FTUZMF"SFTJEVBM - CBTFETUZMFHBOFODPEFSWJBJUFSBUJWFSF fi OFNFOU1SPDFFEJOHTPGUIF*&&&$7'*OUFSOBUJPOBM$POGFSFODFPO$PNQVUFS7JTJPO .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

ӝઓ੄ޙઁ੼ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ 4PMVUJPO("/JOWFSTJPOӝ߈੄NPEFM٣੗ੋ 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF
&ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODFJNBHF 'BDF - TXBQQFEJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 3FDPOTUSVDUJPO MPTT *%MPTT "EWFSTBSJBMMPTT ("/JOWFSTJPOӝ߈NPEFM .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

ӝઓ੄ޙઁ੼ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ 4PMVUJPO("/JOWFSTJPOӝ߈੄NPEFM٣੗ੋ 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF
&ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF "* 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF *%MPTT 3FDPOTUSVDUJPOMPTT "EWFSTBSJBMMPTT ("/JOWFSTJPOӝ߈NPEFM .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

3FGFSFODFJNBHF *%JNBHF W#BTFMJOF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ
4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT ? ? W W 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

ӝઓ੄ޙઁ੼'BDFTFHNFOUBUJPONPEFM੄ب਑ਸ߉ইঠೣ ↟ 4PMVUJPO'BDJBMBUUSJCVUFFODPEFSীࢲDPEF৻ীNBQө૑୶୹ೞب۾٣੗ੋ &YUSBDUFENBQ 1SF - USBJOFE   4UZMF("/ 'BDJBM
"UUSJCVUF &ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

3FGFSFODFJNBHF *%JNBHF W#BTFMJOF W#BTFMJOF &YUSBDUFENBQ 'BDF - TXBQQFEJNBHF 'BDF -
TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT ? 'BDF - TXBQQFEJNBHF W .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

ӝઓ੄ޙઁ੼߈৔غযঠೡBUUSJCVUFTо୽࠙൤߈৔غ૑ঋ਺ ↟ 3FGFSFODFJNBHF۽ࠗఠ಴੿ ݠܻпب ↟ *%JNBHF۽ࠗఠ঴ҷഋ ↟ 4PMVUJPO%..TVQFSWJTJPOਸ೟णҗ੿ী୶о .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

%.. ↟ %੉޷૑۽ࠗఠ%QBSBNUFSܳ୶୹೧ࢲ%SFDPOTUSVDUJPO%NBOJQVMBUJPO %..   &ODPEFS %..   %FDPEFS 4IBQF
&YQSFTTJPO 1PTF %JOQVUJNBHF %SFDPOTUSVDUJPO ੉޷૑୹୊'FOH :BP FUBM-FBSOJOHBOBOJNBUBCMFEFUBJMFE%GBDFNPEFMGSPNJO - UIF - XJMEJNBHFT"$.5SBOTBDUJPOTPO(SBQIJDT 5P( .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

ӝઓ੄ޙઁ੼߈৔غযঠೡBUUSJCVUFTо୽࠙൤߈৔غ૑ঋ਺ ↟ 4PMVUJPO%..TVQFSWJTJPOਸ೟णҗ੿ী୶о 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF
&ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF *%JNBHF %..   &ODPEFS sref sswap sid pref pswap pid eref eswap eid 3FGFSFODFJNBHF 'BDF - TXBQQFEJNBHF &YUSBDUFENBQ 4IBQF &YQSFTTJPO 1PTF .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

3FGFSFODFJNBHF *%JNBHF W#BTFMJOF W#BTFMJOF &YUSBDUFENBQ W#BTFMJOF &YUSBDUFENBQ %..TVQFSWJTJPO 'BDF -
TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

*EFOUJUZ 4IBQF &YQSFTTJPO 1PTF 1PTF - )/ %FFQGBLFT
FaceShifter 4JNTXBQ )J fi 'BDF *OGP4XBQ .FHB'4 4NPPUI4XBQ .'*. PVST .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ
BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

'BDFTXBQQJOH 3FGFSFODF WJEFP *%JNBHF 'BDF - TXBQQFE GSBNFT 1SF -
QSPDFTT     'BDFEFUFDUJPO   4NPPUIJOH $SPQQJOH "MJHONFOU 1SF - QSPDFTT     'BDFEFUFDUJPO   4NPPUIJOH $SPQQJOH "MJHONFOU 1PTU - QSPDFTT   3FUPVDI   6ODSPQQJOH 'BDF - TXBQQJOHQJQFMJOF GPSWJEFP 3FGFSFODF GSBNFT 'BDF - TXBQQFE WJEFP .'*. .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

খਵ۽ӝ؀غח੼

খਵ۽ӝ؀غח੼ օܻഝਊغחѪ ؀৉ߓ਋оౠ੿৔࢚ਸ୫৔ ੋҕ૑מӝࣿਸ੉ਊೞৈ৔࢚੄঴ҷਸਗೞח঴ҷ۽߄Է ↟ ਬݺো৘ੋ੉૒੽৔࢚ਸ୫৔ೡ೙ਃহ੉GBDFTXBQQJOHਵ۽ઁ੘ ↟ ઓ੤ೞ૑ঋח࢜۽਍JEFOUJUZ٣੗ੋറ٣૑ణോݢਵ۽ٜ݅ӝ

хࢎ೤פ׮

Virtual influencer를 위한 face swapping 기술 개발기

Virtual influencer를 위한 face swapping 기술 개발기

More Decks by kakao

Other Decks in Programming

Featured

Transcript