Single Best Answer question classifier
This model classifies multiple choice questions as Single-Best-Answer MCQs or not. SBA are MCQs where the question requires selecting the best or most correct answer among the set of choices.
The model is trained on 3K labeled questions from MMLU, MMLU_redux, and MMLU_pro benchmarks.
The model aligns with manual annotation (recall: 0.97, precision:0.93)
TODO: link to the paper preprint when it is published.
- Downloads last month
- 1,930
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for ahmedselhady/bert-base-uncased-sba-clf
Base model
google-bert/bert-base-uncased