Upgrade to Pro — share decks privately, control downloads, hide ads and more …

画像ディープラーニングコンペの基本

Avatar for Jun Koda Jun Koda
August 07, 2025
1k

 画像ディープラーニングコンペの基本

上位Kagglerに学ぶ~画像コンペの戦い方~
2025-08-07

Avatar for Jun Koda

Jun Koda

August 07, 2025
Tweet

Transcript

  1. ෺ཧ GMɻը૾ GM Ͱ͸ͳ͍ ⇧ ᠳΜͰ࡛ۄͷʮ࡛ۄʹॅΜͰΔͷʹ౦ژͬͯॻౕ͘ʯͰக໋ইΛෛͬͨ AI ʹΑͬͯ Notebook ͕ෆཁʹͳΔલʹ

    Notebook GM ʹͳΖ͏͔ͳ ϙευΫͱͯ͠Ӊ஦෺ཧΛ΍͖ͬͯͨ ࠓ͸ۀ຿ҕୗͰػցֶशݚڀ։ൃ
  2. G2Net (2021) ͷࢥ͍ग़ ϒϥοΫϗʔϧ߹ମ৴߸͕͋Δ͔Ͳ͏͔Λ൑ఆ͢Δ ࣌ܥྻ৴߸Λ spectrogram ͬΆ͘ը૾ʹ͢Δ “࠷େͷϒϨʔΫεϧʔ͕ learning rate

    Λ্͛Δͩͬͨ” • Public notebook Λࣸܦ • ৴߸ॲཧΛ޻෉͢Δ΋ϝμϧݍ͔Β΄ Ͳԕ͍ • ৽͍͠ public notebook ΛΈΔ • lr 1e-5 → 1e-4 ͰείΞര্͕Γ
  3. جຊతͳσΟʔϓϥʔχϯά܇࿅ͷ ίίϩ͸ॻ͍ͯ͋Δ learning rate warm up, batch size, ͳͲͳͲ খ͍͞

    batch size ͸ over fi t Λ๷͙͚ͲɺͦͷͨΊʹখ͘͢͞Δͷ͸अಓͳؾ͕͢Δ
  4. Grid search ʹ͢Δʁ Optunaʁ ͦΕͱ΋ G • S • Dʁ

    ͱ͜ΖͰ Hyperparameter optimization Ͳ͏ͯ͠·͔͢ʁ
  5. ΠϯυਓΛӈʹ ϋϯυϧΛࠨʹ ੔߹ੑͷऔΕΔΑ͏ʹ൓స - atmacup ंͷيಓ༧ଌ hakubisin ͞Μ 1st place

    solution https://speakerdeck.com/hakubishin3/turing-x-atmacup-number-18-1st-place-solution ը૾ɾϋϯυϧ֯౓ɾ΢ΟϯΧʔͳͲΛҰ؏ͯ͠൓స͢Δ ※ ͜ΕͰ΋ं͕ӈଆΛ૸Γͩͨ͠Βେมͳ৔߹͸μϝ
  6. σʔλ͕গͳ͍ͱ͖͸ Augmentation Λڧ͘ɺϞσϧ͸খ͞Ί Theo Viel https://www.kaggle.com/competitions/rsna-2023-abdominal-trauma-detection/writeups/on-strike-2nd-place-solution Cut Mix Yun et

    al (2019) https://arxiv.org/pdf/1905.04899 ϥϯμϜʹը૾ΛࠞͥΔ ϥϕϧ͸໘ੵൺ soft label ͦΜͳཚ๫ͳ! RSNA 2023 ೣ͕4෼ʹݘ͕6෼ʂ
  7. Augmentation ͸ڧ͍ ௥Ճσʔλ͸΋ͬͱڧ͍ G2Net (2021) ѹ౗త1Ґ https://www.kaggle.com/competitions/g2net-gravitational-wave-detection/writeups/kdl-top-1-solution-deep-learning-part ஍਒೾ (Geophysical Waveform

    Inversion) https://www.kaggle.com/competitions/waveform-inversion/leaderboard 13TB Ҏ্ͷσʔλΛੜ੒ On-the- fl y σʔλੜ੒ͷͨΊʹ CUDA Λॻ͍ͨ Augmentation ͸ٖࣅతͳ௥Ճσʔλͳͷ͔ͩΒͦΕ͸ͦ͏ ࢲ: 660 GB ͷσʔλ͕େ͖ͯ͘ਏ͍ → ශऑ!
  8. ʮʓʓ͚ͨ͠Ͳޮ͔ͳ͔ͬͨʯ͸ҙຯ͕ͳ͍ • ৚͕݅ͦΖͬͯॳΊͯޮՌΛൃش͢Δ͜ͱ͕Α͋͘Δ • ྫ͑͹ը૾Λେ͖ͨ͘͠ͱ͖ɺϞσϧΛେ͖ͨ͘͠ͱ͖ɺ௕͘܇࿅ͨ͠ͱ͖ʹॳΊͯ ޮՌΛൃش͢Δ • ؆୯ͳྫͩͱ augmentation ͨ͠Β

    epoch Λ૿΍͢ • ͦͷ··ͩͱɺ୯ʹσʔλ͕ྼԽ͚ͨͩ͠ tattaka ͞ΜʮҰ౓ࣺͯͨΞΠσΟΞʹҙࣝతʹཱͪฦΖ͏ͱߟ͑ͯΔʯ ؔ౦ Kaggler ձ 2025 य़ private communication ޙ͔Βߟ͑Δͱਖ਼ղͷۙ͘ΛԿ౓΋௨Γա͗ͯΔɺͱ͍͏͜ͱ͸Կ౓΋͋Δ
  9. G2Net Ͱҹ৅ʹ࢒ͬͨ͜ͱ έϩοϐઌੜʮը૾Ͱ͸ 0.88 ͸௒͑ΒΕͳ͍ɺ௚઀৴߸Λݟͳ͍ͱʯ ࣮ࡍɺ্Ґ solution ͸ͦͷ௨Γͩͬͨ GMʹͳΔͱඍௐ੔Ͱ͸௒͑ΒΕͳ͍ݶք͕೺ѲͰ͖ΔΒ͍͠ ͳͷͰ

    Hyperparameter tuning ΋ࡉ͔͍ௐ੔΋͖ͬͱྑ͍ܦݧ ͍Ζ͍Ζࢼߦࡨޡͯ͠ɺͲͷ͘Β͍·ͰվળͰ͖Δ͔Θ͔Ε͹Ұਓલ ʢࢲ͸Θ͔Βͳ͍ʣ
  10. • ແ৬Λଓ͚Δ͓͕ۚ΋͏ͳ͍ • Grandmaster ʹͳΓ͍ͨ • ͓͕ۚͳ͍ͷͰϥετνϟϯε • Cloud GPU

    Λ࢖ͬͯͰ΋ۚϝμϧ • ࠷ޙͷ1िؒʹ A100 Λ 4~5୆ • େ͖ͳϞσϧ → ࣦഊ • ը૾Λେ͖͘ • 256 pixel ͷೖྗը૾Λ 1024 ʹ Ryushi ͞Μ͔Βͷ͓୊ ্Ґೖ৆࣌ʹߟ͑ͨ͜ͱ ্Ґ..ೖ৆...? ΋͏௕͍͜ͱۚϝμϧ΋औͬͯͳ͍ͷͰ๨Ε·ͨ͠ ը૾ΛͰ͔ͬ͘ 1024×1024 ඈߦػӢίϯϖ Google Research - Identify Contrails to Reduce Global Warming ৴߸͕ࡉ͍͔Βޮ͍ͨͷ͔΋ɻG2Net Ͱ΋ޮ͍ͨ
  11. ίϯϐϡʔλࣄ৘ ϩʔΧϧϚγϯ Ubuntu RTX 4090 (RAM 24 GB) Intel Core

    i5 13500 (TDP 65W) ਫྫྷΛආ͚ۭͯྫྷʹ͢ΔͨΊ߇͑Ίʹ͚ͨ͠ͲɺίΞ͕ͨ͘͞Μ͋Δͱ͸͍͑ҙ֎ͱCPU΋࢖͏ M.2 SSD WD Black 2TB (Gen 4 ~7000MB/s) σʔλಡΈࠐΈ଎౓΋ҙ֎ͱେࣄ ۚϝμϧ͕औΕͦ͏ͳΒ࠷ޙͷ1िؒʹ Cloud GPU Fractal Design "North"