Ashkchamp commited on
Commit
cab5988
·
verified ·
1 Parent(s): 3f1ddb2

ashk/pokemon

Browse files
Files changed (5) hide show
  1. README.md +64 -0
  2. config.json +29 -0
  3. generation_config.json +7 -0
  4. model.safetensors +3 -0
  5. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: bsd-3-clause
4
+ base_model: Salesforce/blip-image-captioning-base
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: blip-finetuned-kag100
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # blip-finetuned-kag100
16
+
17
+ This model is a fine-tuned version of [Salesforce/blip-image-captioning-base](https://huggingface.co/Salesforce/blip-image-captioning-base) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 0.7570
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 3e-06
39
+ - train_batch_size: 8
40
+ - eval_batch_size: 8
41
+ - seed: 42
42
+ - gradient_accumulation_steps: 2
43
+ - total_train_batch_size: 16
44
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
45
+ - lr_scheduler_type: linear
46
+ - lr_scheduler_warmup_steps: 50
47
+ - num_epochs: 8
48
+ - mixed_precision_training: Native AMP
49
+
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss |
53
+ |:-------------:|:------:|:----:|:---------------:|
54
+ | No log | 2.1277 | 100 | 0.8710 |
55
+ | No log | 4.2553 | 200 | 0.7686 |
56
+ | No log | 6.3830 | 300 | 0.7570 |
57
+
58
+
59
+ ### Framework versions
60
+
61
+ - Transformers 4.47.0
62
+ - Pytorch 2.5.1+cu121
63
+ - Datasets 3.2.0
64
+ - Tokenizers 0.21.0
config.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "Salesforce/blip-image-captioning-base",
3
+ "architectures": [
4
+ "BlipForConditionalGeneration"
5
+ ],
6
+ "image_text_hidden_size": 256,
7
+ "initializer_factor": 1.0,
8
+ "initializer_range": 0.02,
9
+ "label_smoothing": 0.0,
10
+ "logit_scale_init_value": 2.6592,
11
+ "model_type": "blip",
12
+ "projection_dim": 512,
13
+ "text_config": {
14
+ "_attn_implementation_autoset": true,
15
+ "initializer_factor": 1.0,
16
+ "model_type": "blip_text_model",
17
+ "num_attention_heads": 12
18
+ },
19
+ "torch_dtype": "float32",
20
+ "transformers_version": "4.47.0",
21
+ "vision_config": {
22
+ "_attn_implementation_autoset": true,
23
+ "dropout": 0.0,
24
+ "initializer_factor": 1.0,
25
+ "initializer_range": 0.02,
26
+ "model_type": "blip_vision_model",
27
+ "num_channels": 3
28
+ }
29
+ }
generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 30522,
4
+ "eos_token_id": 2,
5
+ "pad_token_id": 0,
6
+ "transformers_version": "4.47.0"
7
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5f1303175bff20588318a29349ff3c4cddee46d3b10593302ec2dbee566e1dc
3
+ size 989717056
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4139f1f28e64b59df96ede484c116447fef86749be869e6caab59f4fa92520af
3
+ size 5304