Share
Embed
CVPR2020読み会 Proxy Anchor Loss for Deep Metric Learning
CVPR2020読み会(後編)の資料です
なるべくMetric Learningに良い感じに入門できるようになってます
SatoKeiju
July 18, 2020
Transcript
110 slides
-
·ͣࣗݾհ !2 • ໊લ: ࠤ౻ ܒथ Sato Keiju • Twitter:
@TodayInsane -
·ͣࣗݾհ !3 • ໊લ: ࠤ౻ ܒथ Sato Keiju • Twitter:
@TodayInsane K-POPେ͖ͳͷͰ Metric LearningͰ PyTorchͱTWICEΛΔ ABEJAΞυϕϯτΧϨϯμʔ ॻ͖·ͨ͠ -
·ͣࣗݾհ !4 • ໊લ: ࠤ౻ ܒथ Sato Keiju • Twitter:
@TodayInsane • ॴଐ: ౦ژେֶిؾܥֶઐ߈ͷใܥ म࢜2 • ֶ෦: CMOSΞφϩάిࢠճ࿏ in ਆށେֶిి • גࣜձࣾABEJAͰظΠϯλʔϯ 2019/4 ʙ • Vue.jsͱ͔Firebaseͱ͔Goͱ͔Kubernetesͱ͔AWSͱ͔Deep Learningͱ͔Λϝϯλʔ͞Μํʹڭ͑ͯΒ͍·͍ͬͯ͘·͢ -
·ͣࣗݾհ !5 • ໊લ: ࠤ౻ ܒथ Sato Keiju • Twitter:
@TodayInsane • ॴଐ: ౦ژେֶిؾܥֶઐ߈ͷใܥ म࢜2 • ֶ෦: CMOSΞφϩάిࢠճ࿏ in ਆށେֶిి • גࣜձࣾABEJAͰظΠϯλʔϯ 2019/4 ʙ • Vue.jsͱ͔Firebaseͱ͔Goͱ͔Kubernetesͱ͔AWSͱ͔Deep Learningͱ͔Λϝϯλʔ͞Μํʹڭ͑ͯΒ͍·͍ͬͯ͘·͢ -
• ໊લ: ࠤ౻ ܒथ Sato Keiju • Twitter: @TodayInsane •
ॴଐ: ౦ژେֶిؾܥֶઐ߈ͷใܥ म࢜2 • ֶ෦: CMOSΞφϩάిࢠճ࿏ in ਆށେֶిి • גࣜձࣾABEJAͰظΠϯλʔϯ 2019/4 ʙ • Vue.jsͱ͔Firebaseͱ͔Goͱ͔Kubernetesͱ͔AWSͱ͔Deep Learningͱ͔Λϝϯλʔ͞Μํʹڭ͑ͯΒ͍·͍ͬͯ͘·͢ ·ͣࣗݾհ !6 ΤϯδχΞ: @xecus͞Μ ͕։ൃͨ͠ɺإೝূٕज़Λͬͨ ΊͪΌͪ͘Ό໘ന͍ϓϩμΫτͷ ੜൿ ݱࡏΠϯλʔϯͰ͓ख͍ͨ͠ Λଓฤͱͯࣥ͠චதͰ͢ -
• ໊લ: ࠤ౻ ܒथ Sato Keiju • Twitter: @TodayInsane •
ॴଐ: ౦ژେֶిؾܥֶઐ߈ͷใܥ म࢜2 • ֶ෦: CMOSΞφϩάిࢠճ࿏ in ਆށେֶిి • גࣜձࣾABEJAͰظΠϯλʔϯ 2019/4 ʙ • Vue.jsͱ͔Firebaseͱ͔Goͱ͔Kubernetesͱ͔AWSͱ͔Deep Learningͱ͔Λϝϯλʔ͞Μํʹڭ͑ͯΒ͍·͍ͬͯ͘·͢ ·ͣࣗݾհ !7 Ϧαʔν: @peisuke͞Μ ʹ༏͘͠എதΛԡ͍͖ͯͨͩ͠ ຊਓੜॳొஃͰ͢ -
͓͠ͳ͕͖ • Metric Learningͬͯʁ • CVʹ͓͚ΔMetric LearningͷྲྀΕ • ຊͷจհ !12
ͷ3ຊͰɺMetric LearningͷੈքͷུਤΛ͓͠Ͱ͖Εͱࢥ͍ͬͯ·͢ ͍ΖΜͳํͱ͍ΖΜͳ͓͍ͨ͠ͷͰTwitterͳͲ͓ؾܰʹʂ͓ئ͍͠·͢ʂ -
Metric Learning: σʔλͷڑࢦඪΛ֫ಘ͢Δ !15 Black footed Albatross Sooty Albatross Black
footed Albatross Sooty Albatross • ಉ͡Ϋϥεͷσʔλಉ͍࢜ۙ • ҟͳΔΫϥεؒΕ͍ͯΔ -
Metric Learning: σʔλͷڑࢦඪΛ֫ಘ͢Δ !16 Black footed Albatross Sooty Albatross Black
footed Albatross Sooty Albatross • ಉ͡Ϋϥεͷσʔλಉ͍࢜ۙ • ҟͳΔΫϥεؒΕ͍ͯΔ σʔλ ͦͷಛྔ ࣅͯΔͱ ۙ͘ͳΔ ۭؒ -
Metric Learning: σʔλͷڑࢦඪΛ֫ಘ͢Δ !17 Black footed Albatross Sooty Albatross Black
footed Albatross Sooty Albatross • ಉ͡Ϋϥεͷσʔλಉ͍࢜ۙ • ҟͳΔΫϥεؒΕ͍ͯΔ σʔλ ͦͷಛྔ ࣅͯΔͱ ۙ͘ͳΔ ۭؒ ͜ΕΒΛ֫ಘ͢Δͷ͕Metric(ࢦඪ)Learning(ֶश) -
Deep LearningͷൃలͰMetric LearningΞπ͍ !21 Channel Width Height ը૾: H ×
W × C࣍ݩσʔλ Hand-craftedͳಛྔઃܭ x1 x2 : : : : : : : : : xN N࣍ݩಛϕΫτϧ = N࣍ݩۭؒͷ -
Deep LearningͷൃలͰMetric LearningΞπ͍ !22 Channel Width Height ը૾: H ×
W × C࣍ݩσʔλ Hand-craftedͳಛྔઃܭ x1 x2 : : : : : : : : : xN N࣍ݩಛϕΫτϧ = N࣍ݩۭؒͷ Deep CNN -
Deep LearningͷൃలͰMetric LearningΞπ͍ !23 Channel Width Height ը૾: H ×
W × C࣍ݩσʔλ Hand-craftedͳಛྔઃܭ x1 x2 : : : : : : : : : xN N࣍ݩಛϕΫτϧ = N࣍ݩۭؒͷ Deep CNN ࣮ݱ͍ۭͨؒ͠ͷڑతͳ ͓ؾ͕࣋ͪ࿅Γ͜·ΕͨLossؔ ֶश -
ը૾ೝࣝ: ֤Ϋϥε͕·ͱ·ΔಛྔۭؒͰࣝผ !27 ಉ͡Ϋϥεϥϕϧͷ͍ͭͨը૾ۙ͘ ҧ͏ΫϥεΕͯຒΊࠐ·ΕΔ ʮಉ͡Ϋϥεͱஅ͢ΔڑͷᮢʯΛ ͍͍ײ͡ʹઃఆ͢Δ ը૾ྨ (ओʹϢʔΫϦουڑͰ)ΫΤϦը૾ͷ ຒΊࠐΈʹ͍ۙॱʹྨࣅը૾ͱ͢Δ
ը૾ݕࡧ ΫΤϦ Top-1(࠷ۙ) https://twitter.com/JYPETWICE_JAPAN/status/1156761954024734721 -
ը૾ೝࣝ: ֤Ϋϥε͕·ͱ·ΔಛྔۭؒͰࣝผ !28 ಉ͡Ϋϥεϥϕϧͷ͍ͭͨը૾ۙ͘ ҧ͏ΫϥεΕͯຒΊࠐ·ΕΔ ʮಉ͡Ϋϥεͱஅ͢ΔڑͷᮢʯΛ ͍͍ײ͡ʹઃఆ͢Δ ը૾ྨ (ओʹϢʔΫϦουڑͰ)ΫΤϦը૾ͷ ຒΊࠐΈʹ͍ۙॱʹྨࣅը૾ͱ͢Δ
ը૾ݕࡧ ྨʹՃ͑ͯະͷΫϥε ʮະͷΫϥεʯͱͯ͠ରԠͰ͖Δ ը૾ࣝผ https://twitter.com/JYPETWICE_JAPAN/status/1156761692547629056 New? -
ը૾ೝࣝ: ֤Ϋϥε͕·ͱ·ΔಛྔۭؒͰࣝผ !30 ະͷΫϥεʮະͷΫϥεʯͱͯ͠ରԠͰ͖Δ ʮֶश࣌ʹແ͍Ϋϥε͕ਪʹग़ͯ͘Δʯ՝ઃఆʹ˕ • Face Recognition / Verification
• Person Re-Identification • Image Retrieval ͳͲͳͲ... -
Adversarial Attack(ݸਓతʹ໘ന͔ͬͨͷͰ͝հ) !32 “Metric Learning for Adversarial Robustness”(NeurIPS’19) Adversarial Example
ಛྔۭؒʹ͓͍ͯ ΫϥεͷڥքۙʹҐஔ͍ͯ͠Δʁ(͔Βؒҧ͑Δʁ) Adversarial ExampleΛ ຊͷΫϥεʹ͍ۙํʹ ಈ͔͢Loss ը૾ͱAdversarialͳը૾ΛಛྔۭؒʹӨ͢Δͱ…ʁ -
!33 “OpenGAN: Open Set Generative Adversarial Networks”(arXiv 2020/5/18) ҟৗݕ “Unsupervised
Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery”(IPMI’17) GAN Distillation “Relational Knowledge Distillation”(CVPR’19) -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !37 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ಉ͡Ϋϥεͷը૾ -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !38 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ಉ͡Ϋϥεͷը૾ -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !39 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ΑΓ ۙͮ͘ ಉ͡Ϋϥεͷը૾ -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !40 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ҧ͏Ϋϥεͷը૾ -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !41 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ҧ͏Ϋϥεͷը૾ -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !42 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ΑΓ ΕΔ ҧ͏Ϋϥεͷը૾ -
࢝: 2ͭͷσʔλΛ͚ۙͮΔ/͢Contrastive Loss !43 Deep CNN x1 x2 : :
: : : : : : : xN x1 x2 : : : : : : : : : xN ҧ͏Ϋϥεͷը૾ “Dimensionality Reduction by Learning an Invariant Mapping” (CVPR’06) -
࢝ͷࢠ(ʁ): 3ͭͷσʔλΛ͚ۙͮΔ/͢Triplet Loss !45 Deep CNN anchor: ͋Δσʔλ positive: anchorͱ
ಉΫϥε negative: ผͷΫϥε [~]+: ώϯδؔ(= max(~, 0)) negative anchor positive -
࢝ͷࢠ(ʁ): 3ͭͷσʔλΛ͚ۙͮΔ/͢Triplet Loss !46 Deep CNN anchor: ͋Δσʔλ positive: anchorͱ
ಉΫϥε negative: ผͷΫϥε [~]+: ώϯδؔ(= max(~, 0)) anchor positive negative dn dp dp ʹϚʔδϯαΛͯ͠ ·ͩdn ͷํ͕σΧ͘ͳͬͯ΄͍͠ • จ຺(ϥϕϧͱλεΫ)ʹؔͳ͘ ૬ରతʹۙ͘/ԕ͘͢ΕΑ͍ • Έ߹Θ͕ͤେͰ ֶश͕ऩଋ͠ͳ͍… -
࢝ͷࢠ(ʁ): 3ͭͷσʔλΛ͚ۙͮΔ/͢Triplet Loss !47 Deep CNN anchor: ͋Δσʔλ positive: anchorͱ
ಉΫϥε negative: ผͷΫϥε [~]+: ώϯδؔ(= max(~, 0)) anchor positive negative dn dp dpʹϚʔδϯαΛͯ͠ dnΑΓখ͘͢͞Δ • จ຺(ϥϕϧͱλεΫ)ʹؔͳ͘ ૬ରతʹۙ͘/ԕ͘͢ΕΑ͍ • Έ߹Θ͕ͤେͰ ֶश͕ऩଋ͠ͳ͍… “Learning Fine-grained Image Similarity with Deep Ranking” (CVPR’14) -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு • ۭؒΛٿ໘্ʹ੍
• ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ !48 ͳͲͳͲ… -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ !49 “FaceNet: A Unified Embedding for
Face Recognition and Clustering”(CVPR’15) !49 !49 • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு • ۭؒΛٿ໘্ʹ੍ • ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ TripletͷΈ߹Θͤʹ͍ͭͯͷʮ͠͞ʯΛఆٛ Loss͕େ͖͘ͳΔSemi-hard NegativeϖΞΛޮΑ͘࡞ -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ !50 “Improved Deep Metric Learning with
Multi-class N-pair Loss Objective”(NIPS’16) NΫϥε͔Β2ը૾ͣͭ औΓग़ͯ͠ಛྔʹม NͷηοτΛ࡞Γ LossΛܭࢉ • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு • ۭؒΛٿ໘্ʹ੍ • ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு • ۭؒΛٿ໘্ʹ੍
• ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ !51 “L2-constrained Softmax Loss for Discriminative Face Verification”(arXiv 2017/3) ໌ࣔతͳڑ࠷దԽ͠ͳ͍͕ ಛྔϕΫτϧΛϊϧϜͰׂͬͯ ಛྔ࣍ݩۭؒͷٿ໘্ʹ ੵ(cosྨࣅ)Ͱදݱྗͷௐ ֶशͷқεέʔϦϯάύϥϝʔλαͰௐ -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ !52 “Deep Metric Learning with Angular
Loss”(ICCV’17) anchorɺpositiveɺ negativeΛಈ͔͢ ͖(ޯ)Λ ͔֯Βߟ͑Δ • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு • ۭؒΛٿ໘্ʹ੍ • ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ !53 • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு •
ۭؒΛٿ໘্ʹ੍ • ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ “No Fuss Distance Metric Learning using proxies”(ICCV’17) positiveͱnegativeʹ ݸผͷσʔλͰͳ͘ ֤Ϋϥεͷදͷ ຒΊࠐΈϕΫτϧ(proxy) Λ༻͍Δ ѹతऩଋͷ͞ ຊͷจͷϥΠόϧ -
Contrastive / Triplet Loss͔Βੜ→Γ্͕͖ͬͯͨ !54 • ֶशʹ༗ޮͳϖΞΛ୳͢/࡞Δ • ͞Βʹߟྀ͢ΔΫϥεΛ֦ு •
ۭؒΛٿ໘্ʹ੍ • ڑࢦඪΛ֯Ͱ • දͰMetric Learning • ΫϥεྨܕωοτϫʔΫߏ “ArcFace: Additive Angular Margin Loss for Deep Face Recognition”(CVPR’19) ಛྔϕΫτϧͷޙஈʹશ݁߹Λଓ SoftmaxؔͱCross Entropy LossͰ Metric LearningΛߦ͏(ਪ࣌શ݁߹Λ֎͢) ຊͷจͷϥΠόϧ Ͱͳ͍͕ඞಡʂ -
͓·͚: CVPR’20ͰMetric Learningͷͯ͠Δจ(ͷҰ෦) !55 •Deep Metric Learning via Adaptive Learnable
Assessment •End-to-End Illuminant Estimation Based on Deep Metric Learning •Cross-Batch Memory for Embedding Learning •Optimizing Rank-Based Metrics With Blackbox Differentiation •Universal Weighting Metric Learning for Cross-Modal Matching •Fast(er) Reconstruction of Shredded Text Documents via Self-Supervised Deep Asymmetric Metric Learning •Moving in the Right Direction: A Regularization for Deep Metric Learning •CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognition •Circle Loss: A Unified Perspective of Pair Similarity Optimization -
ࠓͷΰʔϧ(࠶ܝ) !58 Triplet Loss • anchor: ͋Δσʔλ • positive: anchorͱಉ͡Ϋϥεʹ
ଐ͢Δผͷσʔλ • negative: anchorɺpositiveͱ ҟͳΔΫϥεͷσʔλ ↓ • anchorͱpositive͕͖ۙͮɺ anchorͱnegative͕ΕΔLoss • σʔλͷΈ߹Θͤ૯ଟ͗͢ • ֶशʹޮ͘ϖΞʹͨΓʹ͍͘ -
ࠓͷΰʔϧ(࠶ܝ) !59 N-pair Loss • anchor: ͋Δσʔλ • positive: anchorͱಉ͡Ϋϥεʹ
ଐ͢Δผͷσʔλ • negatives: anchorɺpositiveͰ ͳ͍Ϋϥεͷσʔλ(1ͭͣͭ) • ۙ͞Λߟྀ ↓ • TripletΑΓҰʹશମΛݟΕΔ • ·ͩσʔλશମͱݴ͑ͳ͍ (ϛχόονͷதͷ͞ΒʹҰ෦) -
ࠓͷΰʔϧ(࠶ܝ) !60 Lifted Structure Loss • anchor: ͋Δσʔλ • positive:
anchorͱಉ͡Ϋϥεʹ ଐ͢Δผͷσʔλ • negatives: anchorɺpositiveͰ ͳ͍Ϋϥεͷશσʔλ ↓ • N-pairΑΓҰʹશମΛݟΕΔ • ·ͩσʔλશମͱݴ͑ͳ͍ (anchorΫϥεͷҰ෦σʔλϛ χόονͷΈͰݶఆత) -
ࠓͷΰʔϧ(࠶ܝ) !61 Proxy-NCA Loss • anchor: ͋Δσʔλ • proxy: ֤Ϋϥεʹ͖ͭ1ͭ͋Δ
ʮදʯ ↓ • anchorͱશproxyͰ N-pair Lossతͳֶश • ऩଋ͕ΊͪΌͪ͘Ό͍ • σʔλશମͷۭؒతใ ׆͔͖͠Εͯͳ͍ -
ࠓͷΰʔϧ(࠶ܝ) !63 Proxy Anchor Loss • anchor: ͋ΔΫϥεͷproxy • positive:
anchorͷproxyʹଐ͢ ΔΫϥεͷϛχόονશσʔλ • negative: anchorͱҟͳΔΫϥε ͷϛχόονશσʔλ ↓ • ऩଋ͕͞ΒʹΊͪΌͪ͘Ό͍ • σʔλશମͷۭؒతใΛ׆͔͠ ·͍ͬͯ͘Δ -
ఏҊͯ͠Δ༰: Proxy Anchor Loss α: εέʔϦϯάύϥϝʔλ δ: Ϛʔδϯ ϛχόονͷσʔλ શΫϥεͷproxyͨͪͱ
ͦͷݸ proxy pͷΫϥεʹଐ͢Δ ϛχόονͷશembedding (σʔλಛྔ)ϕΫτϧ embeddingϕΫτϧxͱ ରԠ͢ΔΫϥεͷproxyϕΫτϧpͷ ྨࣅ(ຊจͰcosྨࣅ) શproxyͱ ͦͷݸ(=Ϋϥε) proxy pͷΫϥεʹଐ͞ͳ͍ ϛχόονͷશembedding (σʔλಛྔ)ϕΫτϧ -
ఏҊͯ͠Δ༰: Proxy Anchor Loss α: εέʔϦϯάύϥϝʔλ δ: Ϛʔδϯ ϛχόονͷσʔλ શΫϥεͷproxyͨͪͱ
ͦͷݸ proxy pͷΫϥεʹଐ͢Δ શembedding(σʔλಛྔ) ϕΫτϧ embeddingϕΫτϧxͱ ରԠ͢ΔΫϥεͷproxyϕΫτϧpͷ ྨࣅ(ຊจͰcosྨࣅ) શproxyͱ ͦͷݸ(=Ϋϥε) proxy pͷΫϥεʹଐ͞ͳ͍ શembedding(σʔλಛྔ)ϕΫτϧ ʁ -
“easier-to-interpret form” Proxy Anchor Lossͷ͓ؾ࣋ͪ !73 ͋Δproxy pͱhardest positive (p͔ΒҰ൪ԕ͍positive)͕ۙͮ͘
͋Δproxy pͱhardest negative (p͔ΒҰ൪͍ۙnegative)͕ΕΔ “smooth approximation of max function” -
จᐌ͘1: ੑೳྑͯ͘ऩଋ͍ʂ !82 Recall@1είΞ͕ Ұ൪ߴ͍ʂ ऩଋ͕͍ʂ Recall@KείΞ • Retrieval(ݕࡧ)λεΫMetric LearningͷੑೳΛଌΔͷʹΑ͘ΘΕΔ
• ֶशͨ͠ม(ωοτϫʔΫ)ʹςετσʔλΛશͯೖྗͯ͠embeddingԽͨ࣌͠ʹ ֤σʔλʹ͍ͭͯɺͦͷۭؒͰ͍ۙॱϥϯΩϯάTop-KҐͷதʹ ಉ͡Ϋϥεͷσʔλ͕͋ΔΑ͏ͳͷׂ߹ • ྫ͑Recall@2ͳΒɺRecall@1(࠷͕ۙಉ͡ΫϥεͰ͋ΔΑ͏ͳͷׂ߹)ʹ ʮ࠷دΓผΫϥεͷσʔλ͕ͩ2൪ʹ͍ۙͳΒಉ͡ΫϥεʯͰ͋ΔϠπΒΛͨ͠ είΞͱͳΔ • ʮະΫϥεΛ͖ͪΜͱͰ͖Δ͔ʯΛଌΔͨΊɺσʔληοτΛ2ׂͯ͠ ֶशͱςετΛશʹผͷΫϥεͰߦ͏(ͳ͔ͳ͔ϋʔυ) -
จᐌ͘2: ྨࣅʹԠ͕ͯͪ͡ΌΜͱมΘΔʂ !83 Proxy-NCA Loss Proxy Anchor Loss positive proxyʹ͍ͭͯ
มԽ͕ݻఆ શσʔλʹ͍ͭͯ hard͞ʹԠֶͨ͡श -
ΫϥεC << σʔλ૯M จᐌ͘3: Έ߹Θ͕ͤ(طଘݚڀͷதͰ)࠷খʂ !85 M: ֶशσʔλͷ૯ C: ֶशσʔλͷΫϥε
B: 1epochͷόον U: 1Ϋϥε͋ͨΓͷproxy ϙΠϯτ -
จᐌ͘3: Έ߹Θ͕ͤ(طଘݚڀͷதͰ)࠷খʂ !86 Έ߹Θͤ૯͕ଟ͗ͯ͢ ֶशʹ༗ޮͳσʔλϖΞΛ Ҿ͖ͯΔͷʹ͔͔࣌ؒΔ ΫϥεC << σʔλ૯M M:
ֶशσʔλͷ૯ C: ֶशσʔλͷΫϥε B: 1epochͷόον U: 1Ϋϥε͋ͨΓͷproxy ϙΠϯτ -
ϋΠύϥߟͦͷ3: εέʔϦϯάύϥϝʔλαͱϚʔδϯδ !101 ʮεέʔϦϯάύϥϝʔλ 16Ҏ্Ͱ҆ఆͯ͠Δɺ ͕ͦͬͪेͳେ͖ͩ͞ͱ ϚʔδϯͰ͋Μ·Γ͕ࠩग़ͳ͍ʯ εέʔϦϯά ύϥϝʔλ ࢮ׆͡ΌΜ…
• ෳͷೖྗಉ࢜ͷʮࠩΛڧௐ͢Δ߹͍ʯ • cosྨࣅΛ͏Metric LearningͰΑ͘ಋೖ͞ΕΔ (ͦͦͷҬ͕-1 ≦ cosx ≦ 1ͳͷͰ͕͖ࠩͭʹ͍ͨ͘Ί) • DistillationΛఏҊͨ͠จͰొͨ͠softmaxԹύϥϝʔλΛٯʹͨ͠ͷ ※͍͔ͭ͘ͷจΛݟ͖ͯͨײ͡20~60͙Β͍͕ଥͳΠϝʔδͩͬͨͷͰೲಘ εέʔϦϯάύϥϝʔλ “Distilling the Knowledge in a Neural Network”(NIPS’14 Workshop) -
͔ͳΓ៉ྷͳஶऀPyTorch࣮ʂ !107 https://github.com/tjddus9597/Proxy-Anchor-CVPR2020 • LossΫϥε͔Βtrain/testίʔυͷ࣮ͪΖΜ • σʔληοτ4छͷDatasetΫϥε࣮͋Γ • backbone networkͨͪͷ࣮͋Γ
• طଘݚڀͷLossͨͪࢼͤΔΑ͏ʹͳͬͯΔ (Pytorch-Metric-Learningύοέʔδ͕ඞཁ) ※͜ͷൃද·Ͱʹಈ͔͓͖͔ͯͨͬͨ͠ͷͰ͕࣌ؒ͢Γͣʀʀ