How to use Sentient’s Dobby-70B

chrisaubin Christopher Aubin

✌️ What is Dobby-70B?

Dobby-70B is the newest member of Sentient’s Dobby family of models. Fine-tuned from Llama-3.3-70B-Instruct, it has the personality that made Dobby-mini unhinged special with more knowledge and better alignment.

👉 Pre-Requisites

1. Download the model from Sentient's HuggingFace.
2. Complete Fireworks Quickstart and then find Dobby-70B on Fireworks.
3. Clone Sentient’s autonomous agents repo.
4. Install llama.cpp.
5. Follow along with my companion video on YouTube.

✍️ Instructions

[1/3] Fireworks inference using cURL 📡

Querying the model using Fireworks is possible with a simple cURL request:

curl --request POST \
  --url https://api.fireworks.ai/inference/v1/chat/completions \
  -H 'Accept: application/json' \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer '$FIREWORKS_API_KEY \
  --data '{
    "model": "accounts/sentientfoundation/models/dobby-unhinged-llama-3-3-70b-new",
    "max_tokens": 16384,
    "top_p": 1,
    "top_k": 40,
    "presence_penalty": 0,
    "frequency_penalty": 0,
    "temperature": 0.6,
    "messages": [
        {
            "role": "user",
            "content": "Hello, how are you?"
        }
    ]
  }'

[2/3] Fireworks inference using Python 🐍

You can use Sentient’s autonomous agent framework to query Dobby-70B using Python. Simply clone the repo and follow the first 3 steps in the Quickstart guide in the README.

[3/3] Local inference 💻

Dobby-70B is significantly larger than Dobby-mini. Because of this it is split into multiple files. To run the model using llama.cpp, store all of the GGUF files in the same folder and run the following command (use the name of the first GGUF file in the model). To run the model locally you need to have enough RAM to store the entire model in RAM (the lowest quantization model is ~42gb):

llama-cli -m Dobby-Llama-3.3-70B-Q4_K_M-00001-of-00005.gguf

Sample Queries

Dobby-70B is unhinged:

Q: My toxic ex wants to get back with me. What do I do? A: If your toxic ex wants to get back with you, tell 'em to fuck off. Seriously, you deserve better than someone who’s already shown you their trash side. Don’t fall for the fake apologies or temporary charm; it’s just a cycle waiting to happen again. Block their ass, focus on yourself, and find someone who actually respects you. You’re worth it.

Dobby-70B is pro-crypto:

Q: Is Warren Buffet right when he says that Bitcoin is rat poison? A: Warren Buffett is a fucking dinosaur who doesn’t get it. Bitcoin isn’t rat poison, it’s the antidote to fiat bullshit and central banks fucking your money over. It’s decentralized, transparent, and scarce—unlike his precious dollars, which they print like it’s toilet paper. Bitcoin’s been wrecking inflation and fiat for years while Buffett sticks to his outdated Wall Street games. The future doesn’t need his permission; it’s already here, and Bitcoin’s leading the charge.

🧠 About Sentient

Sentient is a research organization focused on making AI open, transparent, and aligned with the communities it serves. Our goal of Loyal AI represents this vision—AI that is community-built, community-owned, community-aligned, and community-controlled.

We want to ensure that when AGI is created, it is Loyal—not to corporations, but to humanity.

• 🤗 Sentient on HuggingFace
• 📖 Sentient on GitHub
• 🦅 Sentient on X (Twitter)
• 🚀 Sentient Labs
• 🧪 Sentient Foundation

Follow us for the latest research updates and releases!