Brello QAI 0.6B by Epic Systems
Brello QAI is a proprietary model created by Epic Systems. It is designed to deliver deep, targeted, and actionable responses rather than generic overviews. It supports both thinking and non-thinking modes.
- Strong reasoning via Qwen3 thinking tokens (...)
- Default Brello persona prioritizes specificity and actionable guidance
- Lightweight local inference on macOS (MPS), CUDA, or CPU
Quickstart
Local run with the included script:
python3 -m venv .venv
source .venv/bin/activate
pip install --upgrade pip
pip install -r requirements.txt
python run.py --prompt "Help me design a rollout plan for feature flags in a mobile app."
Options:
--system: override the default Brello persona; pass empty string to disable--no-think: disable thinking mode--device: auto|mps|cuda|cpu
Example with a custom system message and non-thinking mode:
python run.py --no-think --system "You are Brello QAI. Give surgical, stepwise answers with tradeoffs." \
--prompt "Compare blue/green and canary deployments for a small backend team."
Light SFT (optional)
To nudge the style further toward “deep and targeted,” see training/ for a LoRA SFT script and a small sample dataset. You can train a tiny adapter on your examples and then merge it into a standalone Brello checkpoint.
License
This repository includes open-source components under the Apache-2.0 license. See LICENSE for details.
- Downloads last month
- 9