--- base_model: - redrix/patricide-12B-Unslop-Mell - yamatazen/NeonMaid-12B-v2 library_name: transformers tags: - mergekit - merge --- # PatriMaid-12B-Forgottenslop-NeonMell ![image/png](https://cdn-uploads.huggingface.co/production/uploads/636ea389fd9751c3d081e88e/mo-FmOk5emk1c0kWS6pxm.png) Blinding Neon Lights # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). Use ChatML or Mistral for preset. ## Merge Details ### Merge Method This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [redrix/patricide-12B-Unslop-Mell](https://huggingface.co/redrix/patricide-12B-Unslop-Mell) as a base. ### Models Merged The following models were included in the merge: * [yamatazen/NeonMaid-12B-v2](https://huggingface.co/yamatazen/NeonMaid-12B-v2) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: redrix/patricide-12B-Unslop-Mell #no parameters necessary for base model - model: redrix/patricide-12B-Unslop-Mell parameters: density: 0.5 weight: 0.5 - model: yamatazen/NeonMaid-12B-v2 parameters: density: 0.5 weight: 0.5 merge_method: ties base_model: redrix/patricide-12B-Unslop-Mell parameters: normalize: false int8_mask: true dtype: float16 ```