Vortex5/Starlit-Shadow-12B

Starlit-Shadow-12B

Overview

Starry-Shadow-12B was created through a multi-stage merge involving Red-Synthesis-12B, KansenSakura-Erosion-RP-12B, NoctyxCosma-12B, and Crimson-Twilight-12B,

Multi-stage merge configuration

name: First
models:
  - model: Vortex5/Red-Synthesis-12B
merge_method: sm2f
base_model: Retreatcost/KansenSakura-Erosion-RP-12b
dtype: bfloat16
tokenizer:
  source: Retreatcost/KansenSakura-Erosion-RP-12b
---
name: Second
models:
  - model: Vortex5/NoctyxCosma-12B
merge_method: sm2f
base_model: Vortex5/Crimson-Twilight-12B
dtype: bfloat16
tokenizer:
  source: Vortex5/Crimson-Twilight-12B
---
models:
  - model: First
  - model: Second
merge_method: karcher
dtype: bfloat16
parameters:
  tol: 1e-9
  max_iter: 1000
tokenizer:
  source: Vortex5/Crimson-Twilight-12B
      

Intended Use

🎭 Roleplay

📜 Storytelling

🌌 Creative Writing