README.md

metadata

language:
  - en
  - ko
tags:
  - krx
datasets:
  - amphora/krx-sample-instructions
base_model:
  - Qwen/Qwen2.5-7B-Instruct

Qwen2-KRX-LoRA

이 모델은 Qwen2.5-7B-Instruct 모델을 금융 데이터셋으로 파인튜닝한 버전입니다.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel, PeftConfig

# 1. Load base model
base_model_id = "Qwen/Qwen2.5-7B-Instruct"
base_model = AutoModelForCausalLM.from_pretrained(base_model_id)
tokenizer = AutoTokenizer.from_pretrained(base_model_id)

# 2. Load LoRA adapter
peft_model_id = "seong67360/Qwen2.5-7B-Instruct_v1"
model = PeftModel.from_pretrained(base_model, peft_model_id)