CriteriaPO
/

qwen2.5-3b-dpo-finegrained-40-vanilla

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

qwen2.5-3b-dpo-finegrained-40-vanilla / checkpoint-5000

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

obiwit's picture

Training in progress, step 5000, checkpoint

140c47f verified 18 days ago

global_step5000
Training in progress, step 5000, checkpoint 18 days ago
added_tokens.json

605 Bytes

Training in progress, step 5000, checkpoint 18 days ago
config.json

784 Bytes

Training in progress, step 5000, checkpoint 18 days ago
generation_config.json

143 Bytes

Training in progress, step 5000, checkpoint 18 days ago
latest

15 Bytes

Training in progress, step 5000, checkpoint 18 days ago
merges.txt

1.67 MB

Training in progress, step 5000, checkpoint 18 days ago
model-00001-of-00002.safetensors

4.96 GB
xet

Training in progress, step 5000, checkpoint 18 days ago
model-00002-of-00002.safetensors

1.21 GB
xet

Training in progress, step 5000, checkpoint 18 days ago
model.safetensors.index.json

35.6 kB

Training in progress, step 5000, checkpoint 18 days ago
rng_state_0.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_1.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_2.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_3.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_4.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_5.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_6.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
rng_state_7.pth
Detected Pickle imports (7)
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "numpy.dtype",
- "collections.OrderedDict"
How to fix it?
16 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
1.06 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
special_tokens_map.json

509 Bytes

Training in progress, step 5000, checkpoint 18 days ago
tokenizer.json

11.4 MB
xet

Training in progress, step 5000, checkpoint 18 days ago
tokenizer_config.json

6.99 kB

Training in progress, step 5000, checkpoint 18 days ago
trainer_state.json

230 kB

Training in progress, step 5000, checkpoint 18 days ago
training_args.bin
Detected Pickle imports (14)
- "transformers.trainer_utils.HubStrategy",
- "torch.bfloat16",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.state.PartialState",
- "alignment.configs.DPOConfig",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType",
- "trl.trainer.dpo_config.FDivergenceType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig"
How to fix it?
7.99 kB
xet

Training in progress, step 5000, checkpoint 18 days ago
vocab.json

2.78 MB

Training in progress, step 5000, checkpoint 18 days ago
zero_to_fp32.py

29.2 kB

Training in progress, step 5000, checkpoint 18 days ago