Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7,686

Full-text search

Active filters: pruna-ai

PrunaAI/bigscience-bloom-3b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 90

PrunaAI/bigscience-bloom-1b7-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 83

PrunaAI/bigscience-bloomz-560m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 87

PrunaAI/bigscience-bloomz-7b1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 89

PrunaAI/bigscience-bloom-3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 92

PrunaAI/bigscience-bloom-1b1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 86

PrunaAI/huggyllama-llama-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 99

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 87

PrunaAI/bigscience-bloomz-3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 86

PrunaAI/yahma-llama-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 85

PrunaAI/vj1148-llama-2-7b-legal-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 89

PrunaAI/huggyllama-llama-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 92

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 88

PrunaAI/yahma-llama-7b-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 84

PrunaAI/mosaicml-mpt-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 56

PrunaAI/mosaicml-mpt-7b-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 66

PrunaAI/daryl149-llama-2-7b-chat-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 85

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 77

PrunaAI/mosaicml-mpt-7b-instruct-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 52

PrunaAI/mosaicml-mpt-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 51

PrunaAI/mosaicml-mpt-7b-8k-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 49

PrunaAI/vj1148-llama-2-7b-legal-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 77

PrunaAI/openlm-research-open_llama_3b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 76

PrunaAI/mosaicml-mpt-7b-8k-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 48

PrunaAI/openlm-research-open_llama_7b_v2-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 76

PrunaAI/mosaicml-mpt-7b-chat-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 50

PrunaAI/openlm-research-open_llama_3b_v2-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 76

PrunaAI/openlm-research-open_llama_3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 85

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 77

PrunaAI/openlm-research-open_llama_7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 77