File size: 777 Bytes
7e1398c
 
 
 
877504b
7e1398c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
877504b
 
7e1398c
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
---
license: other
license_name: mrl
license_link: https://mistral.ai/licenses/MRL-0.1.md
base_model: anthracite-org/magnum-v2-123b
language:
  - en
  - fr
  - de
  - es
  - it
  - pt
  - ru
  - zh
  - ja
pipeline_tag: text-generation
tags:
- chat
---

# magnum-v2-123b-fp8-dynamic

```
This is the sixth in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus.
This model is fine-tuned on top of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407).
```
**Converted to fp8 dynamic by leafspark; original model link here: [anthracite-org/magnum-v2-123b](https://huggingface.co/anthracite-org/magnum-v2-123b)**

Using 6xL40 on RunPod Ubuntu container; quantizaton took 30 minutes.