Models

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • 8B • Updated Oct 23, 2024 • 1.05k • 4

RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16

Text Generation • 4B • Updated Oct 9, 2024 • 15

RedHatAI/starcoder2-15b-FP8

Text Generation • 16B • Updated Oct 9, 2024 • 24

RedHatAI/starcoder2-7b-FP8

Text Generation • 7B • Updated Oct 9, 2024 • 17

RedHatAI/starcoder2-3b-FP8

Text Generation • 3B • Updated Oct 9, 2024 • 21

RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16

Text Generation • 19B • Updated Oct 9, 2024 • 5

RedHatAI/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Oct 9, 2024 • 230

RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8

Text Generation • 71B • Updated Oct 9, 2024 • 7

RedHatAI/starcoder2-15b-quantized.w8a16

Text Generation • 4B • Updated Oct 9, 2024 • 16

RedHatAI/starcoder2-3b-quantized.w8a16

Text Generation • 1B • Updated Oct 9, 2024 • 20

RedHatAI/starcoder2-7b-quantized.w8a16

Text Generation • 2B • Updated Oct 9, 2024 • 17

RedHatAI/starcoder2-3b-quantized.w8a8

Text Generation • 3B • Updated Oct 9, 2024 • 22

RedHatAI/starcoder2-7b-quantized.w8a8

Text Generation • 7B • Updated Oct 9, 2024 • 22

RedHatAI/starcoder2-15b-quantized.w8a8

Text Generation • 16B • Updated Oct 9, 2024 • 35

RedHatAI/gemma-2-2b-it-FP8

3B • Updated Oct 9, 2024 • 1.05k • 1

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized

6B • Updated Oct 9, 2024 • 1.25k

nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

12B • Updated Oct 9, 2024 • 1.25k

nm-testing/Phi-3-mini-128k-instruct-FP8

4B • Updated Oct 9, 2024 • 19.5k

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • 58B • Updated Oct 10, 2024 • 125 • 12

nm-testing/Meta-Llama-3-8B-Instruct-fp8-compressed

8B • Updated Oct 9, 2024 • 4

RedHatAI/gemma-2-9b-it-quantized.w8a16

Text Generation • 4B • Updated Oct 9, 2024 • 1.02k • 1

RedHatAI/gemma-2-2b-it-quantized.w8a16

Text Generation • 2B • Updated Oct 9, 2024 • 32 • 1

RedHatAI/gemma-2-2b-quantized.w8a16

Text Generation • 2B • Updated Oct 9, 2024 • 7

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized

6B • Updated Oct 9, 2024 • 1.25k

RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16

Text Generation • 3B • Updated Oct 9, 2024 • 5

RedHatAI/gemma-2-9b-it-quantized.w4a16

Text Generation • 3B • Updated Oct 9, 2024 • 1.2k • 2

RedHatAI/gemma-2-2b-it-quantized.w4a16

Text Generation • 1B • Updated Oct 9, 2024 • 2.61k • 1

RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • 0.6B • Updated Oct 9, 2024 • 5

RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16

Text Generation • 3B • Updated Oct 9, 2024 • 105 • 4

RedHatAI/gemma-2-2b-it-quantized.w8a8

Text Generation • 3B • Updated Oct 9, 2024 • 6