Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

4,727

Full-text search

Active filters: dpo

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q8_0-GGUF

Text Generation • Updated Jan 16 • 53 • 1

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q6_K-GGUF

Text Generation • Updated Jan 16 • 23 • 1

NikolayKozloff/Human-Like-Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

Text Generation • Updated Jan 16 • 24 • 1

NikolayKozloff/Human-Like-LLama3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jan 16 • 18 • 1

NikolayKozloff/Human-Like-Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jan 16 • 21 • 1

mradermacher/lambda-qwen2.5-14b-dpo-test-i1-GGUF

Updated about 1 month ago • 1.13k • 1

mradermacher/Qwen2.5-7B-sft-SPIN-gpt4o-rm-GGUF

Updated about 1 month ago • 654 • 1

jessemeng/TwinLlama-3.2-1B-DPO

Text Generation • Updated 28 days ago • 30 • 1

jpacifico/Chocolatine-2-14B-Instruct-v2.0

Text Generation • Updated 11 days ago • 127 • 1

mradermacher/Chocolatine-2-14B-Instruct-v2.0-GGUF

Updated 17 days ago • 314 • 1

mlfoundations-dev/dpo_from_stratos_judged_annotated_rejected_responses

Text Generation • Updated 18 days ago • 418 • 1

mradermacher/Chocolatine-2-14B-Instruct-v2.0.3-GGUF

Updated 16 days ago • 472 • 1

mradermacher/eeve_dpo-v3-GGUF

Updated 14 days ago • 262 • 1

mradermacher/eeve_dpo-v3-i1-GGUF

Updated 14 days ago • 452 • 1

DebateLabKIT/Llama-3.1-Argunaut-1-8B-SPIN

Text Generation • Updated 4 days ago • 85 • 1

WasamiKirua/Samanta-NewGenesis-Phi4-DPO

Text Generation • Updated 7 days ago • 20 • 1

Johnhan/Rude-AI-1.5B

Updated 9 days ago • 2 • 1

mradermacher/Rude-AI-1.5B-GGUF

Updated 9 days ago • 224 • 1

mradermacher/Samanta-NewGenesis-Gemma2B-DPO-GGUF

Updated 7 days ago • 310 • 1

mradermacher/Llama-3.1-Argunaut-1-8B-SPIN-i1-GGUF

Updated 2 days ago • 623 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 13 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • Updated Oct 31, 2023 • 1.94k • 19

lewtun/zephyr-7b-dpo-full

Text Generation • Updated Jan 5, 2024 • 14

alignment-handbook/zephyr-7b-dpo-full

Text Generation • Updated Jan 10, 2024 • 119 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 57 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 27 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • Updated Dec 5, 2023 • 7.42k • 122

ContextualAI/archangel_sft_pythia1-4b

Text Generation • Updated Jan 11, 2024 • 212