Hugging Face's logo

gaianet
/
DeepHermes-3-Llama-3-8B-Preview-GGUF

Text Generation
Transformers
GGUF
English
llama
Inference Endpoints
conversational
Model card Files Community
DeepHermes-3-Llama-3-8B-Preview-GGUF / README.md
apepkuss79's picture
apepkuss79
Update README.md
6bd5985 verified
preview code
|
raw
history blame contribute delete
1.15 kB
metadata
license: llama3
base_model: NousResearch/DeepHermes-3-Llama-3-8B-Preview
model_creator: NousResearch
model_type: llama
quantized_by: Second State Inc.
library_name: transformers
language:
  - en

Meta-DeepHermes-3-Llama-3-8B-Preview-GGUF

Original Model

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Run with Gaianet

Prompt template:

IMPORTANT: To toggle REASONING ON, you must use the following system prompt:

You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside <think> </think> tags, and then provide your solution or response to the problem.

prompt template: llama-3-chat

Context size:

chat_ctx_size: 128000

Run with GaiaNet:

Quantized with llama.cpp b4743