Darkknight535 commited on
Commit
1eb3310
·
verified ·
1 Parent(s): 34b8ac2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -11
README.md CHANGED
@@ -7,23 +7,42 @@ library_name: transformers
7
  tags:
8
  - mergekit
9
  - merge
10
-
11
  ---
12
  ### OpenCrystal-12B-L3
13
-
14
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
 
16
- ## Merge Details
17
- ### Merge Method
 
 
 
 
 
 
 
 
 
18
 
19
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Darkknight6742/llama-3-12b-Instruct](https://huggingface.co/Darkknight6742/llama-3-12b-Instruct) as a base.
 
 
 
20
 
21
- ### Models Merged
 
 
 
 
 
 
22
 
23
- The following models were included in the merge:
24
- * [Darkknight6742/L3-12B-Niitama-v1](https://huggingface.co/Darkknight6742/L3-12B-Niitama-v1)
25
- * [Darkknight6742/L3-12B-Celeste-V1.2](https://huggingface.co/Darkknight6742/L3-12B-Celeste-V1.2)
26
 
 
 
 
 
 
 
27
  ### Configuration
28
 
29
  The following YAML configuration was used to produce this model:
@@ -40,11 +59,11 @@ models:
40
  density: 0.9
41
  weight: 0.9
42
  merge_method: ties
43
- base_model: Darkknight6742/llama-3-12b-Instruct # For Base Coherence
44
  parameters:
45
  int8_mask: true
46
  rescale: true
47
  normalize: false
48
  dtype: bfloat16
49
 
50
- ```
 
7
  tags:
8
  - mergekit
9
  - merge
 
10
  ---
11
  ### OpenCrystal-12B-L3
 
12
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
 
14
+ ![Rohma]()
15
+
16
+
17
+ ### Instruct Template
18
+ Default llama3 instruct and context preset.
19
+
20
+ ### Samplers
21
+ ```
22
+ Temp : 1.23
23
+ Min P : 0.05
24
+ Repetition Penalty : 1.05
25
 
26
+ [And everything else neutral]
27
+ ```
28
+
29
+ ### Features
30
 
31
+ - Can speak as other npc automatically.
32
+ - Creative (Alot)
33
+ - Coherent
34
+ - Output feels like you're using Character.ai
35
+ - (can maybe have v2 if needed)
36
+ - Follows prompt better
37
+ - can summarize and generate image propmts well [Tested 100%] (Due to llama 3 as base)
38
 
 
 
 
39
 
40
+ ### Instruct Prompt
41
+ ```
42
+ You're {{char}}, follow {{char}} personality and plot of the story, Don't impersonate as {{user}}, Speak as others NPC except {{user}} when needed. Be Creative, Create various interesting events and situations during the story.
43
+ ```
44
+
45
+ ## Merge Details
46
  ### Configuration
47
 
48
  The following YAML configuration was used to produce this model:
 
59
  density: 0.9
60
  weight: 0.9
61
  merge_method: ties
62
+ base_model: Darkknight6742/llama-3-12b-Instruct # For Base Coherence and prompting
63
  parameters:
64
  int8_mask: true
65
  rescale: true
66
  normalize: false
67
  dtype: bfloat16
68
 
69
+ ```