File size: 2,727 Bytes
01c9403 44ebb1e 7f1f3b1 01c9403 77597ea 01c9403 fd68fe6 8802d8c 01c9403 c7fa9d5 e8c909f a151363 01c9403 44ebb1e 753a079 01c9403 7f1f3b1 17aac37 44ebb1e 01c9403 44ebb1e 01c9403 44ebb1e 01c9403 0742ada 01c9403 44ebb1e 01c9403 44ebb1e 01c9403 17aac37 44ebb1e 01c9403 354e650 44ebb1e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 |
---
license: mit
datasets:
- openlifescienceai/medmcqa
language:
- en
base_model:
- Qwen/Qwen2.5-0.5B-Instruct
tags:
- grpo
- rl
- biomed
- medmcqa
- medical
- explainableAI
- XAI
- tramsformers
- trl
metrics:
- accuracy
pipeline_tag: question-answering
---
# BioXP-0.5B
BioXP-0.5B is a 🤗 Medical-AI model trained using our two-stage fine-tuning approach:
1. Supervised Fine-Tuning (SFT): The model was initially fine-tuned on labeled data(MedMCQA) to achieve strong baseline accuracy on multiple-choice medical QA tasks.
2. Group Relative Policy Optimization (GRPO): In the second stage, GRPO was applied to further align the model with human-like reasoning patterns.
This reinforcement learning technique enhances the model’s ability to generate coherent, high-quality explanations and improve answer reliability.
The final model achieves an accuracy of 64.58% on the MedMCQA benchmark.
## Model Details
This model is a finetuned version of Qwen/Qwen2.5-0.5B-Instruct, a 0.5 billion parameter language model from the Qwen2 family.
The finetuning was performed using SFT following by Group Relative Policy Optimization (GRPO).
- **Developed by:** Qwen (original model), finetuning by Abaryan
- **Funded & Shared by :** Abaryan
- **Model type:** Causal Language Model
- **Language(s) (NLP):** English
- **License:** MIT
- **Finetuned from model:** Qwen/Qwen2.5-0.5B-Instruct
### Out-of-Scope Use
This model should not be used for generating harmful, biased, or inappropriate content. It's important to be aware of the potential limitations and biases inherited from the base model and the finetuning data.
## Bias, Risks, and Limitations
As a large language model, this model may exhibit biases present in the training data. The finetuning process may have amplified or mitigated certain biases. Further evaluation is needed to understand the full extent of these biases and limitations.
## How to Get Started with the Model
Use Below Space for a quick demo
https://huggingface.co/spaces/rgb2gbr/BioXP-0.5b-v2
You can load this model using the `transformers` library in Python:
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "abaryan/BioXP-0.5B-MedMCQA"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", torch_dtype="auto")
prompt = "Identify the right answer and elaborate your reasoning"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=200)
print(tokenizer.decode(outputs[0], skip_special_tokens=True)) |