Upgrade to Pro — share decks privately, control downloads, hide ads and more …

UKARA 1.0 Challenge Track 1

Ali Akbar S.
October 14, 2019

UKARA 1.0 Challenge Track 1

Our results from UKARA 1.0 Challenge Track 1, an NLP challenge to build an automatic short-answer scoring.

Ali Akbar S.

October 14, 2019
Tweet

More Decks by Ali Akbar S.

Other Decks in Research

Transcript

  1. Task A Task B # Positive Train 191 (71%) 168

    (55%) # Negative Train 77 (29%) 137 (45%) Avg. # Char 87.23 97.33 # Dev 215 244 # Test 855 974
  2. • Tokenizer + lemmatizer • Unigram / TF-IDF ◦ •

    Latent Semantic Analysis (LSA) ◦ ◦ • ML algorithms ◦ ◦ ◦ • Evaluation metric ◦
  3. Train A Train B Dev Test Best 0.879 0.764 0.810

    0.812 Ensemble+Original 0.885 0.764 0.799 0.801 Ensemble+Updated 0.898 0.831 0.810 0.803