Share
Embed
オンライン広告におけるCTR/CVR推定関係の論文を30本くらい雑に紹介する / rtb-papers-ctr
todesking
December 23, 2019
Transcript
38 slides
-
CTR/CVRਪఆ • Click Through Rate/Conversion Rate • ࠂΛݟͨͱ͖ͷϢʔβͷԠΛ༧ଌ͢ΔͷͰɺ·ͱΊͯ user response
predictionͱ͔ݺΕΔ • ࠂͷΫϦοΫ/ίϯόʔδϣϯ(ͷߪೖͳͲɺͦͷ ࠂ͕ୡ͍ͨ͠త)Λ༧ଌ͢ΔλεΫ • యܕྫ: WebϖʔδpʹϢʔβu͕དྷ๚ͨ͠ɻࠂaΛදࣔ ͨ͠߹ɺΫϦοΫ/ίϯόʔδϣϯ͕ൃੜ͢Δ͍֬ ͘Β͔ • ಛྔΧςΰϦΧϧσʔλ͕ଟ͍ -
CTR/CVRਪఆ • ҰൠతʹɺCVRਪఆͷ΄͏͕͍͠ • ਖ਼ྫ͕গͳ͍ • ΫϦοΫͰ~1%ఔɺCVR͞Βʹ͍ • CVͷఆٛଟ༷ •
ಛఆϖʔδͷΞΫηε͔Βͷߪೖ·Ͱ༷ʑ • ΞτϦϏϡʔγϣϯϞσϧ • ෳͷimp/clickͷޙCVͨ͠߹ɺͲͷimpͷՌʹ͢Δ͔ • ͍Ζ͍ΖͳϞσϧ͕͋Δ(࠷ޙʹΫϦοΫ͞ΕͨͷΛ࠾༻ɺෳͷ impʹՌΛ) • ԆϑΟʔυόοΫ • imp ʙ click͍͍͕ͤͥͩɺCV͢Δʹͬͱ͍͕͔͔࣌ؒΔ • ʮෛྫʯͱʮCVσʔλະ౸ணʯͷݟ͚͕͔ͭͳ͍ -
Evaluating and Optimizing Online Advertising: Forget the click, but there
are good proxies by Brian Dalessandro et al. SSRN 2012. • "ΦϯϥΠϯࠂͷධՁͱ࠷దԽ: ΫϦοΫΑΓྑ͍ସࢦඪ" • ͋ΔϒϥϯυͷࠂΛݟͨਓ͕7ҎʹͦͷϒϥϯυͷΛങ ͏͔Λ༧ଌ͢Δέʔε • CVσʔλεύʔεա͗ͯେม • ؆୯ʹखʹೖͬͯɺCVͱ૬͕ؔ͋ΔΑ͏ͳସࢦඪ(proxy)͕͋Δ ͱخ͍͠ • ײతʹΫϦοΫ͕ସͱͳΓͦ͏͕ͩɺ࣮΄΅ؔͳ͍ • ΫϦΤΠςΟϒͷσβΠϯ͕ΫϦοΫ࠷దԽΛతͱ͍ͯ͠Δ ͔ΒͰ? • ͦͷΘΓʹɺϒϥϯυαΠτͷ๚Α͍ସࢦඪͱͳΔ -
Estimating Conversion Rate in Display Advertising from Past Performance Data
by Kuang-chih Lee et al. KDD 2012. • "աڈͷύϑΥʔϚϯεσʔλ͔ΒͷCVRਪఆ" • ϢʔβɺWebϖʔδɺࠂͷΈ߹Θ͔ͤΒCVRΛ༧ଌ͢ Δ • ͦΕͧΕΛ֊తʹׂͯ͠աڈͷύϑΥʔϚϯεΛूܭ • ϩδεςΟοΫճؼͰͦΕΒΛ౷߹ͯ͠CVR༧ଌ -
Ad Click Prediction: a View from the Trenches by H.
Brendan McMahan. KDD 2013. • "ΫϦοΫਪఆ: ᆠߺ͔ΒͷோΊ" • Google • େنͳCTR༧ଌϞσϧͷӡ༻͔ΒಘΒΕͨݟͷհ • ϩδεςΟοΫճؼͷΦϯϥΠϯֶश(FTRL-Proximal, Per- coordinate learning rates) • ϝϞϦઅͷٕ๏ • ϞσϧධՁख๏ • ༧ଌͷ৴པΛද͢uncertainty score • ༧ଌͷΩϟϦϒϨʔγϣϯ • ಛྔͷཧ • ͏·͍͔͘ͳ͔ٕͬͨ๏ -
Practical Lessons from Predicting Clicks on Ads at Facebook by
Xinran He et al. ADKDD 2014. • "Facebookʹ͓͚ΔΫϦοΫ༧ଌ͔Βͷڭ܇" • GBDTͷ݁ՌΛઢܗճؼͰ͏stackingϞσϧ • ઢܗճؼLRͱBOPR • BOPR: Bayesian online learning scheme for probit regression • σʔλ͕ॏཁͳͷͰΦϯϥΠϯֶश͢Δ • Online joiner: ϩάσʔλΛΦϯϥΠϯֶशػʹ৯Θͨ͢ ΊͷγεςϜ • ϞσϧαΠζͷݮ • ֶशσʔλͷμϯαϯϓϦϯά -
Modeling Delayed Feedback in Display Advertising by Olivier Chapelle. KDD
2014. • "σΟεϓϨΠࠂʹ͓͚ΔԆϑΟʔυόοΫϞσϦϯ ά" • Criteo • CVimpޙ࣌ؒܦ͔ͬͯΒൃੜ͢Δ • ͜ͷԆΛߟྀͨ͠CV༧ଌϞσϧΛ࡞ͬͨ -
Scalable Hands-Free Transfer Learning for Online Advertising by Brian Dalessandro
et al. KDD 2014. • "ΦϯϥΠϯࠂʹ͓͚Δεέʔϥϒϧͳख͍ؒΒͣసҠֶश" • DistilleryͷCVR༧ଌγεςϜ • Ωϟϯϖʔϯ͝ͱʹϞσϧ͕͋Δ • ίʔϧυελʔτɺCVͷଟ༷ੑɺϝϯςͷखؒͳͲͷ ʹରॲ • Bayesian transfer learning: ࣄલʹΑΓίʔϧυελʔτ Λ؇ • ϋΠύʔύϥϝʔλෆཁͳSGD LR(NoPesky learning rates + Adaptive regularization) -
Scalable Hierarchical Multitask Learning Algorithms for Conversion Optimization in Display
Advertising by Amr Ahmed et al. WSDM 2014. • "CV࠷దԽͷͨΊͷεέʔϥϒϧͳ֊ϚϧνλεΫֶश" • Google • ؔ࿈ͨ͠·ͱΊͯղ͍ͨ΄͏͕ੑೳ͕ྑ͍ • CV(attributed/non-attributed)ɺΫϦοΫΛҰʹ༧ଌ͢Δ Ϟσϧ • Multitask-learning • ֊తͳ֬ϞσϧͰΩϟϯϖʔϯɾλεΫؒͷґଘΛදݱ • ֊ϚϧνλεΫֶशΛࢄॲཧͰεέʔϧͤ͞Δ -
Predicting Response in Mobile Advertising with Hierarchical Importance-Aware Factorization Machine
by Richard J. Oentaryo et al. WSDM 2014. • "֊తImportance-aware FMʹΑΔϞόΠϧࠂͷϨεϙϯε ༧ଌ" • Λਪఆ͍ͨ͠(Ͳ͏͍͏ঢ়گઃఆ??) • page, adʹ֊ߏ͕͋Δ • ֊ͷ֤ϊʔυʹରԠ͢ΔॏΈΛਖ਼ଇԽͰ੍ޚ(ಉ͡ʹଐ͢ ΔϊʔυͷॏΈ͍ۙ) • ֊͝ͱʹूֶͨ͠शσʔλΛ࡞Γɺαϯϓϧͷଟ͞Λॏཁ ͱͯ͠ॏΈֶ͚ͯ͠श • Ͳ͔ͬͰtemporal dynamicsΛߟྀͯ͠ΔΒ͍͕͠ݟࣦͬͨ P(click|page, ad, day) -
Simple and Scalable Response Prediction for Display Advertising by Olivier
Chapelle Criteo, Eren Manavoglu, Romer Rosales. ACM TIST 2014. • "σΟεϓϨΠࠂʹ͓͚ΔγϯϓϧͰεέʔϥϒϧͳԠ༧ଌ" • Criteo+MS+LinkedIn • LRͰCTR/CVR͢Δ • Bayesian LRͰThompson sampling͢Δ -
Offline Evaluation of Response Prediction in Online Advertising Auctions by
Olivier Chapelle. WWW 2015. • "ΦϯϥΠϯࠂΦʔΫγϣϯʹ͓͚ΔԠ༧ଌͷΦϑϥ ΠϯධՁ" • Criteo • CTRਪఆͷධՁͱͯ͠Ұൠతͳڭࢣֶ͖शͷࢦඪ͕ ΘΕ͍ͯΔ͕ɺਪఆ݁Ռ͕Ͳ͏ΘΕΔͷ͔ߟ͑Δ͖ • ਪఆͨ͠CTRʹΑͬͯbidՁ֨ΛܾΊΔγφϦΦʹ͓͚Δ ධՁࢦඪͱͯ͠expected utility[5]ΛఏҊɺ࣮σʔλͰݕূ -
Deep Learning over Multi-field Categorical Data: A Case Study on
User Response Prediction by Weinan Zhang, Tianming Du, Jun Wang. ECIR 2016. • "ϚϧνϑΟʔϧυΧςΰϦΧϧσʔ λͷਂֶश: ϢʔβԠਪఆͷࣄྫ" • ը૾ԻͱҟͳΓɺࠂͰ͏ σʔλෳϑΟʔϧυͷΧςΰϦΧ ϧ • ͜ΕΒͷަޓ࡞༻ͷ͏ͪ༗ޮͳͷ ΛࣗಈͰൃݟ͍ͨ͠ • Factorization Machine supported NN ͓Αͼ Sampling-based NNͱ͍͏Ϟ σϧΛఏҊ -
Factorization Machines with Follow-The- Regularized-Leader for CTR prediction in Display
Advertising by Anh-Phuong Ta. BigData 2015. • "FMͱFTRLʹΑΔCTRਪఆ" • ΦϯϥΠϯ࠷దԽΞϧΰϦζϜͰ͋ΔFTRL-ProximalΛ FMʹద༻ͨ͠FTRFL(Follow-The-Regularized-Factorized- Leader)ͷఏҊ • FMͷΦϯϥΠϯֶश͕ߴ+ߴੑೳʹͳͬͨ -
A Convolutional Click Prediction Model by Qiang Liu, Feng Yu,
Shu Wu, Liang Wang. CIKM 2015. • "ΈࠐΈΫϦοΫ༧ଌϞσϧ" • imp୯ମͰͳ͘ܥྻΛͬͯCTR༧ଌ͢ΔϞσϧ • impͷܥྻʹରԠ͢ΔಛྔΛೖྗɺΈࠐΈ͢Δ -
Cost-sensitive Learning for Utility Optimization in Online Advertising Auctions by
Flavian Vasile, Damien Lefortier, Olivier Chapelle. Extension under-review of the paper presented at the Workshop on E-Commerce, NIPS 2015. • "ίετΛߟֶྀͨ͠शʹΑΔΦϯϥΠϯࠂͷutility࠷దԽ" • Criteo+FB+Google • CTRਪఆͷੑೳutilityͰଌΔͷ͕࣮ʹ߹͍ͬͯΔ • ͩͬͨΒ࠷ॳ͔ΒutilityΛ࠷దԽ͍ͨ͠ • ॏΈ͖log lossΛ࠷దԽ͢Δ͜ͱͰۙࣅతʹutilityΛ࠷దԽ Ͱ͖Δ • ղઆ: https://k11i.biz/blog/2017/08/15/2017-adkdd-criteo/ -
User Response Learning for Directly Optimizing Campaign Performance in Display
Advertising by Kan Ren, Weinan Zhang, Yifei Rong, Haifeng Zhang, Yong Yu, Jun Wang. CIKM 2016. • "ΩϟϯϖʔϯͷύϑΥʔϚϯεΛ࠷దԽ͢ΔͨΊͷ ϢʔβԠͷֶश" • CTR༧ଌϞσϧࠂ৴γεςϜͷҰ෦Ͱ͋Δ • Ϟσϧ୯ମΛ࠷దԽ͢ΔΑΓɺγεςϜશମΛ࠷దԽͨ͠ ͍ • LRʹΑΔCTR༧ଌΛؚΉ৴γεςϜΛϞσϧԽ͠ɺ ΩϟϯϖʔϯͷརӹΛ࠷దԽͨ͠ • A/BςετͰ -
Predicting ad click-through rates via feature-based fully coupled interaction tensor
factorization by Lili Shan, Lei Lin, Chengjie Sun, Xiaolong Wang. Electronic Commerce Research and Applications 2016. • "Feature-based fully coupled interaction tensor factorizationʹΑ ΔCTR༧ଌ" • (Ϣʔβ, Webϖʔδ, ࠂ)Λςϯιϧͱͯ͠දݱɺCTRਪఆΛς ϯιϧิͱͯ͠ղ͘ • Fully-Coupled interactions Tensor Factorizationͱ͍͏ΞϧΰϦζ ϜΛఏҊ -
Bid-aware Gradient Descent for Unbiased Learning with Censored Data in
Display Advertising by Weinan Zhang, Tianxiong Zhou, Jun Wang, Jian Xu. KDD 2016. • "ܽଛͷ͋ΔσʔλͷͨΊͷೖࡳߟྀܕޯ߱Լ๏ʹΑΔ όΠΞεͳֶ͠श" • RTBࠂʹ͓͍ͯɺCTRਪఆʹΘΕΔσʔλ͔Βʮམ ࡳͰ͖ͳ͔ͬͨimpʯ͕ܽམ͍ͯ͠Δ(Censored data) • ੜଘੳΛద༻ͯ͠ɺ͜ΕΒͷܽଛΛߟྀͨ͠SGDΛՄ ೳʹ͢Δख๏ͷఏҊ -
Deep CTR Prediction in Display Advertising by Junxuan Chen et
al. MM 2016. • "ਂCTRਪఆ" • Alibaba • ඪ४తͳಛྔʹՃ͑ͯόφʔը૾Λ༻ͨ͠CTRਪఆ -
Sparse Factorization Machines for Click- through Rate Prediction by Zhen
Pan et al. ICDM 2016. • "εύʔεFMʹΑΔCTR༧ଌ" • CTRਪఆʹ͏σʔλඇৗʹεύʔε • ͜ͷΑ͏ͳσʔλʹରԠͨ͠Sparse Factorization MachinesͷఏҊ • ύϥϝʔλͷͱͯ͠ਖ਼نͷ͔ΘΓʹϥϓϥε Λ༻(εύʔεσʔλʹڧ͍) • Spark্ͰͷࢄֶशΛ࣮ -
Product-based Neural Networks for User Response Prediction by Yanru Qu
et al. ICDM 2016. • "ProductϕʔεNNʹΑΔϢʔβԠ༧ଌ" • Product layerʹ͓͍ͯɺੵ/֎ੵΛͬͯಛྔͷมΛ͍ͯ͠Δ -
Field-aware Factorization Machines in a Real- world Online Advertising System
by Yuchin Juan, Damien Lefortier, Olivier Chapelle. ArXiv 2017. • "ΦϯϥΠϯࠂγεςϜʹ͓͚ΔFFM" • ࣮γεςϜͷCTR/CVR༧ଌʹFFMΛಋೖͨ͠ • ࢄֶश • ϞσϧΛ࠶ֶश͢Δͱ͖ʹաڈͷύϥϝʔλΛ࠶ར༻͢Δ warm-startingख๏ -
Neural Feature Embedding for User Response Prediction in Real-Time Bidding
(RTB) by Enno Shioji, Masayuki Arai. ArXiv 2017. • "ϢʔβԠਪఆͷͨΊͷχϡʔϥϧຒΊࠐΈ" • ϢʔβͷಛΛදݱͨ͠ࢄදݱΛ࡞Γ͍ͨ • ϢʔβͷӾཡཤྺΛݩʹɺwebϖʔδΛ୯ޠͱݟͳͯ͠ CBOWͰϕΫτϧԽ • Ϣʔβ͕Ӿཡͨ͠ίϯςϯπͷϕΫτϧΛ౷߹ͯ͠Ϣʔβ ͷຒΊࠐΈΛಘΔ(ਖ਼نԽ+ฏۉ) • ྨࣅ: Tagami, Yukihiro, Hayato Kobayashi, Shingo Ono and Akira Tajima. “Distributed Representations of Web Browsing Sequences for Ad Targeting.” (2016). -
SEM: A Softmax-based Ensemble Model for CTR Estimation in Real-Time
Bidding Advertising by Wen-Yuan Zhu et al. BigComp 2017. • "SEM: SoftmaxϕʔεΞϯαϯϒϧϞσϧʹΑΔCTRਪఆ" • ಛྔ͕ΧςΰϦΧϧσʔλͷ߹ɺtest࣌ʹॳΊͯग़Δ ແࢹ͞ΕΔͱ͍͏ • Hashing trickͰಛྔΛϕΫτϧԽˠࣗಈಛྔબˠಛ ྔ͝ͱʹφΠʔϒϕΠζͯ͠Softmax • ৽ن͕hashing trickͰղܾ͢Δͱ͍͏ओுΘ͔Β ͳ͍Ͱ͢Ͷ…… • શମతʹṖ -
Learning Piece-wise Linear Models from Large Scale Data for Ad
Click Prediction by Kun Gai, Xiaoqiang Zhu, Han Li, et al. Arxiv 2017. • "CTR༧ଌͷͨΊͷPeace-wiceઢܕϞσϧͷେنֶश" • Alibaba • 2012ҎདྷAlibabaͰΘΕ͍ͯΔCTR༧ଌϞσϧ • Linear Modelͱݴ͍ͭͭඇઢܗͳݱΛѻ͑Δ • ಛۭؒΛׂ͠ɺྖҬ͝ͱʹઢܕϞσϧΛద༻͢Δ • େنσʔλͷֶशʹ͑Δ σ: dividing function η: fitting function -
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction by
Huifeng Guo et al. IJCAI 2017 • "DeppFM: CTR༧ଌͷͨΊͷFMϕʔεNN" • ಛΤϯδχΞϦϯάෆཁͱ͔ڧ͍͜ͱ͕ॻ͍ͯ͋Δ • Wide and Deepͷൃలܥ • ୯ମͷಛྔߴ࣍ͷަޓ࡞༻େࣄʹ͍ͨ͠ͱ͍͏ؾ࣋ͪ • ղઆ: https://data.gunosy.io/entry/deep-factorization-machines-2018 -
Deep Interest Network for Click-Through Rate Prediction by Guorui Zhou
et al. ArXiv 2017. • "CTRਪఆͷͨΊͷDeep Interest Network" • Alibaba • ϢʔβͷߦಈཤྺΛݩʹCTRਪఆ͍ͨ͠ • ࣌ܥྻσʔλΛݩʹɺϢʔβͷࠓͷঢ়ଶΛϞσϦϯά͢Δ -
An Ensemble-Based Approach to Click- Through Rate Prediction for Promoted
Listings at Etsy by Kamelia Aryafar et al. ADKDD 2017. • "EtsyͷϦεςΟϯάࠂʹ͓͚ΔΞϯαϯϒϧϕʔεCTRਪఆ" • ΦϯϥΠϯγϣοϐϯάαΠτEtsyʹ͓͚ΔCTR༧ଌ • ϩδεςΟοΫճؼ+FTRL-Proxima • ෳͷํ๏ͰCTRΛਪఆͯ͠ϩδεςΟοΫճؼͰ݁߹ • աڈσʔλΛεϜʔδϯάͯ͠ਪఆͨ͠CTR(σʔλ͕ଟ͍ͱྑ͘ ޮ͘) • ςΩετσʔλunigram/bigramΛhashing trickͯ͠ϕΫτϧԽ • ը૾DNNͰຒΊࠐΈ -
A Practical Framework of Conversion Rate Prediction for Online Display
Advertising by Quan Lu et al. ADKDD 2017. • CVR༧ଌʹؔ͢Δ༷ʑͳख๏ͷఏҊ • Over predictionͷରԠ • delayed feedbackΛߟֶྀͨ͠श • ΞτϦϏϡʔγϣϯϞσϧΛߟྀͨ͠ೖࡳֹิਖ਼ -
Ranking and Calibrating Click-Attributed Purchases in Performance Display Advertising by
Sougata Chaudhuri et al. ADKDD 2017. • click-attributionͰCV՝ۚϞσϧͷࠂ৴ • bidͷࡍʹҎԼͷखॱ͕ඞཁ • CV͞Ε͍͢ࠂͷީิΛྻڍ(ΞτϦϏϡʔγϣϯͷ੍ ͰɺΫϦοΫߴ͍ඞཁ͕͋Δ) • CVʹԠͯ͡ೖࡳֹۚΛܾఆ(ਖ਼֬ͳCVͷਪఆࠔ) • ϥϯΩϯά+ΩϟϦϒϨʔγϣϯʹΑͬͯ͜ͷΛղ͘ -
Deep & Cross Network for Ad Click Predictions by Ruoxi
Wang et al. ADKDD & TargetAd 2017. • Google • Deep & Cross NetworkϞσ ϧͷఏҊ • ߴ࣍ͷަޓ࡞༻Λཅʹѻ͏ ωοτϫʔΫ(Cross)Λ࣋ͭ -
Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising
by Junwei Pan et al. WWW 2018. • Field-aware FMੑೳ͍͍͕ύϥϝʔλଟա͗ͳͷͰվ ળͨ͠ • ղઆ: https://www.smartbowwow.com/2019/06/field- weighted-factorization-machines.html -
Robust Factorization Machines for User Response Prediction by Surabhi Punjabi
and Priyanka Bhatt. WWW 2018. • Webͷಛੑ্ɺϢʔβΛਖ਼֬ʹࣝผͰ͖ͳ͍ • ผΞϓϦ/σόΠε͔ΒͷΞΫηε • CookieແޮԽ • ϩόετ࠷దԽͱݺΕΔख๏ΛFMʹద༻ɺֶशσʔλ ͷϊΠζʹڧ͍ϞσϧΛಘΒΕͨ • ஶऀʹΑΔղઆ: https://medium.com/@priyankabhatt91/ robust-factorization-machines-b44e2d906f15 -
A Nonparametric Delayed Feedback Model for Conversion Rate Prediction by
Yuya Yoshikawa and Yusaku Imai. ArXiv 2018. • CVRਪఆʹ͓͍ͯɺϑΟʔυόοΫͷԆ͕ʹͳΔ • imp͔ͯ͠Β࣌ؒͨͳ͍ͱCV͢Δ͔Ͳ͏͔Θ͔Βͳ͍ • ਖ਼ֶ͍͠शͷͨΊʹ࣌ؒΕͷΛਪఆ͢Δඞཁ͕͋Δ͕ɺ ಛఆͷΛԾఆͤͣϊϯύϥϝτϦοΫʹΓ͍ͨ • CVRਪఆϞσϧʹϊϯύϥԆϞσϧΛΈࠐΜͩख๏ΛఏҊ • ຊޠ: https://www.jstage.jst.go.jp/article/pjsai/JSAI2018/0/ JSAI2018_1N202/_article/-char/ja/