|
--- |
|
tags: |
|
- vllm |
|
- fp8 |
|
license: apache-2.0 |
|
base_model: unsloth/gpt-oss-20b-BF16 |
|
library_name: transformers |
|
--- |
|
|
|
# RedHatAI/gpt-oss-20b-FP8-Dynamic |
|
|
|
## Model Overview |
|
- **Model Architecture:** gpt-oss-20b-BF16 |
|
- **Input:** Text |
|
- **Output:** Text |
|
- **Model Optimizations:** |
|
- **Weight quantization:** FP8 |
|
- **Activation quantization:** FP8 |
|
- **Release Date:** 08/13/2025 |
|
- **Version:** 1.0 |
|
- **Model Developers:** RedHatAI |
|
|
|
Quantized version of [unsloth/gpt-oss-20b-BF16](https://huggingface.co/unsloth/gpt-oss-20b-BF16). |