Model save

README.md

@@ -0,0 +1,74 @@
+---
+library_name: peft
+license: other
+base_model: mistralai/Ministral-8B-Instruct-2410
+tags:
+- llama-factory
+- generated_from_trainer
+model-index:
+- name: Ministral-8B-Instruct-2410-PsyCourse-info-fold5
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# Ministral-8B-Instruct-2410-PsyCourse-info-fold5
+
+This model is a fine-tuned version of [mistralai/Ministral-8B-Instruct-2410](https://huggingface.co/mistralai/Ministral-8B-Instruct-2410) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.1479
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 1
+- eval_batch_size: 1
+- seed: 42
+- gradient_accumulation_steps: 16
+- total_train_batch_size: 16
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 5.0
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 0.4174        | 0.3951 | 10   | 0.3537          |
+| 0.1926        | 0.7901 | 20   | 0.1861          |
+| 0.1219        | 1.1852 | 30   | 0.1573          |
+| 0.1156        | 1.5802 | 40   | 0.1453          |
+| 0.1196        | 1.9753 | 50   | 0.1509          |
+| 0.0994        | 2.3704 | 60   | 0.1486          |
+| 0.0806        | 2.7654 | 70   | 0.1455          |
+| 0.058         | 3.1605 | 80   | 0.1420          |
+| 0.0492        | 3.5556 | 90   | 0.1440          |
+| 0.041         | 3.9506 | 100  | 0.1470          |
+| 0.0391        | 4.3457 | 110  | 0.1494          |
+| 0.0489        | 4.7407 | 120  | 0.1479          |
+
+
+### Framework versions
+
+- PEFT 0.12.0
+- Transformers 4.46.1
+- Pytorch 2.5.1+cu124
+- Datasets 3.1.0
+- Tokenizers 0.20.3

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7e9788e14b7248727bd8518e0590f313780a08251a7191a20d822f35f6924f70
+oid sha256:fe8cd9d3d567e14bf826ad64d837203f84cf2177465e879843738d410794f9e9
 size 87360584

trainer_log.jsonl

@@ -130,3 +130,9 @@
 {"current_steps": 119, "total_steps": 125, "loss": 0.035, "lr": 7.064490740882057e-07, "epoch": 4.701234567901235, "percentage": 95.2, "elapsed_time": "0:59:01", "remaining_time": "0:02:58"}
 {"current_steps": 120, "total_steps": 125, "loss": 0.0489, "lr": 4.909437331777179e-07, "epoch": 4.7407407407407405, "percentage": 96.0, "elapsed_time": "0:59:30", "remaining_time": "0:02:28"}
 {"current_steps": 120, "total_steps": 125, "eval_loss": 0.14789894223213196, "epoch": 4.7407407407407405, "percentage": 96.0, "elapsed_time": "0:59:53", "remaining_time": "0:02:29"}
+{"current_steps": 121, "total_steps": 125, "loss": 0.0455, "lr": 3.143895053378698e-07, "epoch": 4.780246913580247, "percentage": 96.8, "elapsed_time": "1:00:28", "remaining_time": "0:01:59"}
+{"current_steps": 122, "total_steps": 125, "loss": 0.0426, "lr": 1.7692529411904578e-07, "epoch": 4.8197530864197535, "percentage": 97.6, "elapsed_time": "1:00:53", "remaining_time": "0:01:29"}
+{"current_steps": 123, "total_steps": 125, "loss": 0.0363, "lr": 7.865924910916977e-08, "epoch": 4.859259259259259, "percentage": 98.4, "elapsed_time": "1:01:23", "remaining_time": "0:00:59"}
+{"current_steps": 124, "total_steps": 125, "loss": 0.0486, "lr": 1.9668680847356735e-08, "epoch": 4.898765432098766, "percentage": 99.2, "elapsed_time": "1:01:54", "remaining_time": "0:00:29"}
+{"current_steps": 125, "total_steps": 125, "loss": 0.0416, "lr": 0.0, "epoch": 4.938271604938271, "percentage": 100.0, "elapsed_time": "1:02:21", "remaining_time": "0:00:00"}
+{"current_steps": 125, "total_steps": 125, "epoch": 4.938271604938271, "percentage": 100.0, "elapsed_time": "1:02:26", "remaining_time": "0:00:00"}