    base_model: mistralai/Mistral-7B-Instruct-v0.2
    gate_mode: hidden # one of "hidden", "cheap_embed", or "random"
    dtype: bfloat16 # output dtype (float32, float16, or bfloat16)
    experts:
      - source_model: SanjiWatsuki/Silicon-Maid-7B
        positive_prompts:
            - "roleplay"
      - source_model: mistralai/Mistral-7B-Instruct-v0.2
        positive_prompts:
            - "chat"

chatml format

Downloads last month: 83

GGUF

Model size

12.9B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

View +1 file

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.