• ֶशύϥϝʔλɺଛࣦؔަࠩΤϯτϩϐʔޡࠩɺ࠷దԽؔ AdamW<5>ɺֶश2e-5 19 BERT+ fi ne-tuning(1/2) [3] Huggingface, Transformers library, https://huggingface.co/transformers [5] Loshchilov, I. and Hutter, F.: Decoupled weight decay regularization, arXiv preprint arXiv:1711.05101 (2017). [9] Toshinori, S.: Neologism dictionary based on the language resources on the Web for Mecab (2015). [10] ౻ : MeCab, https://taku910.github.io/ [11] ౦େֶެ։ͷຊޠࣄલֶशࡁΈBERT: https://github.com/cl-tohoku/bert-japanese
Sun, C., Qiu, X., Xu, Y. and Huang, X.: How to fine-tune bert for text classification?, China National Conference on Chinese Computational Linguistics, Springer, pp. 194–206 (2019) ਤ1ɹখΧςΰϦྨλεΫʹ͓͚ΔBERT+fine-tuningͷֶशঢ়گ(ೖྗλΠτϧ) ਤɹখΧςΰϦྨλεΫʹ͓͚ΔBERT+fine-tuningͷֶशঢ়گ(ೖྗλΠτϧ આ໌จ)