--- base_model: - Qwen/QwQ-32B - EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2 - arcee-ai/Virtuoso-Medium-v2 - ArliAI/QwQ-32B-ArliAI-RpR-v4 - trashpanda-org/QwQ-32B-Snowdrop-v0 license: apache-2.0 license_name: qwen license_link: https://huggingface.co/Qwen/Qwen2.5-32B-Instruct/blob/main/LICENSE language: - en pipeline_tag: text-generation tags: - chat - merge - roleplay library_name: transformers --- # RareBit-v2-32B Another big merge, similar in idea to RP-Stew. V2 here hasn't dropped a random Chinese character like V1 did yet after 100 swipes, which might be because I regulated QwQ to only being used as the base model, instead of mixing it wholesale. Only other change was using v4 of ArliAI's model in the mix. I still need to do some more testing with it to see if it's fully ready to be shared in a broader sense, but it's been pretty good so far: **Pros:** - Prose seem natural and creative. - Hasn't made any big logical mistakes. - Stays in-character and hasn't responded as user. - Decent thinking capabilities. - No refusals, even during the thinking stage. **Cons:** - None so far from testing, but I doubt it's perfect. I'm sure there's something I missed, so consider this pending full critique. Big thanks to the original model creators for providing the ingredients! - Qwen - EVA-UNIT-01 - arcee-ai - ArliAI - trashpanda ## GGUF (provided by mradermacher) https://huggingface.co/mradermacher/RareBit-v2-32B-GGUF https://huggingface.co/mradermacher/RareBit-v2-32B-i1-GGUF ## EXL3 (provided by async0x42) https://huggingface.co/async0x42/RareBit-v2-32B-exl3_4.0bpw https://huggingface.co/async0x42/RareBit-v2-32B-exl3_4.5bpw ### Prompt Format: ChatML ``` <|im_start|>system System prompt<|im_end|> <|im_start|>user User prompt<|im_end|> <|im_start|>assistant Bot response<|im_end|> ``` ### Models Merged The following models were included in the merge: https://huggingface.co/Qwen/QwQ-32B https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2 https://huggingface.co/arcee-ai/Virtuoso-Medium-v2 https://huggingface.co/ArliAI/QwQ-32B-ArliAI-RpR-v4 https://huggingface.co/trashpanda-org/QwQ-32B-Snowdrop-v0