---
base_model:
- mergekit-community/L3.3-Oddbase-70B
- mergekit-community/ignore_L3.x-Monk-70B
- mergekit-community/ignore_L3.1-Deity-70B
- mergekit-community/ignore_L3.x-Hero-70B
library_name: transformers
tags:
- mergekit
- merge

---
# merge

It sucks. Alas.

## Merge Details
### Merge Method

This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using [mergekit-community/L3.3-Oddbase-70B](https://huggingface.co/mergekit-community/L3.3-Oddbase-70B) as a base.

### Models Merged

The following models were included in the merge:
* [mergekit-community/ignore_L3.x-Monk-70B](https://huggingface.co/mergekit-community/ignore_L3.x-Monk-70B)
* [mergekit-community/ignore_L3.1-Deity-70B](https://huggingface.co/mergekit-community/ignore_L3.1-Deity-70B)
* [mergekit-community/ignore_L3.x-Hero-70B](https://huggingface.co/mergekit-community/ignore_L3.x-Hero-70B)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
 - model: mergekit-community/ignore_L3.x-Monk-70B
   parameters:
     density: 0.7
     weight: 0.5
 - model: mergekit-community/ignore_L3.x-Hero-70B
   parameters:
     density: 0.9
     weight: 1
 - model: mergekit-community/ignore_L3.1-Deity-70B
   parameters:
     density: 0.5
     weight: 0.7
merge_method: dare_ties
base_model: mergekit-community/L3.3-Oddbase-70B
tokenizer_source: base
```