File size: 2,005 Bytes
3789ca1 30f4313 63ad280 3789ca1 30f4313 63ad280 3789ca1 30f4313 3789ca1 63ad280 3789ca1 30f4313 63ad280 3789ca1 30f4313 3789ca1 30f4313 3789ca1 30f4313 3789ca1 30f4313 63ad280 3789ca1 30f4313 3789ca1 30f4313 3789ca1 30f4313 3789ca1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 |
---
base_model:
- Columbidae/Qwen25-32B
- trashpanda-org/Qwen2.5-32B-Marigold-v1-ep3
- trashpanda-org/Qwen2.5-32B-Marigold-v1
- trashpanda-org/Qwen2.5-32B-Marigold-v0
- Columbidae/QwQ-32B
- trashpanda-org/Qwen2.5-32B-Marigold-v0-exp
library_name: transformers
tags:
- mergekit
- merge
---
# snowdrop-exp-2
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Columbidae/Qwen25-32B](https://huggingface.co/Columbidae/Qwen25-32B) as a base.
### Models Merged
The following models were included in the merge:
* [trashpanda-org/Qwen2.5-32B-Marigold-v1-ep3](https://huggingface.co/trashpanda-org/Qwen2.5-32B-Marigold-v1-ep3)
* [trashpanda-org/Qwen2.5-32B-Marigold-v1](https://huggingface.co/trashpanda-org/Qwen2.5-32B-Marigold-v1)
* [trashpanda-org/Qwen2.5-32B-Marigold-v0](https://huggingface.co/trashpanda-org/Qwen2.5-32B-Marigold-v0)
* [Columbidae/QwQ-32B](https://huggingface.co/Columbidae/QwQ-32B)
* [trashpanda-org/Qwen2.5-32B-Marigold-v0-exp](https://huggingface.co/trashpanda-org/Qwen2.5-32B-Marigold-v0-exp)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: trashpanda-org/Qwen2.5-32B-Marigold-v0-exp
parameters:
weight: 0.5
density: 0.5
- model: trashpanda-org/Qwen2.5-32B-Marigold-v0
parameters:
weight: 0.5
density: 0.5
- model: trashpanda-org/Qwen2.5-32B-Marigold-v1
parameters:
weight: 0.5
density: 0.5
- model: trashpanda-org/Qwen2.5-32B-Marigold-v1-ep3
parameters:
weight: 0.5
density: 0.5
- model: Columbidae/QwQ-32B
parameters:
weight: 0.9
density: 0.9
merge_method: ties
base_model: Columbidae/Qwen25-32B
parameters:
weight: 0.9
density: 0.9
normalize: true
int8_mask: true
tokenizer_source: Columbidae/Qwen25-32B-Instruct
dtype: bfloat16
```
|