invisietch commited on
Commit
06ecc0a
·
verified ·
1 Parent(s): d0012a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -2
README.md CHANGED
@@ -68,12 +68,27 @@ for more details.
68
 
69
  # Prompting Format
70
 
71
- I'd recommend Mistral v2v3 prompting format:
72
 
73
  ```
74
- <s>[INST] User message here.[/INST] Bot response here</s>[INST] User message 2 here.
75
  ```
76
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
77
  # Sampler Settings
78
 
79
  I'm running the following sampler settings but this is an RC and they may not be optimal.
 
68
 
69
  # Prompting Format
70
 
71
+ I'd recommend Mistral v2 & v3 prompting format:
72
 
73
  ```
74
+ <s>[INST] User message here.[/INST] Bot response here</s>[INST] User message 2 here.[/INST]
75
  ```
76
 
77
+ If you're using SillyTavern, make sure the story string is set correctly to Mistral v2 & v3 (not v3 Tekken):
78
+
79
+ ```
80
+ [INST] {{#if system}}{{system}}
81
+ {{/if}}{{#if wiBefore}}{{wiBefore}}
82
+ {{/if}}{{#if description}}{{description}}
83
+ {{/if}}{{#if personality}}{{personality}}
84
+ {{/if}}{{#if scenario}}{{scenario}}
85
+ {{/if}}{{#if wiAfter}}{{wiAfter}}
86
+ {{/if}}{{#if persona}}{{persona}}
87
+ {{/if}}{{trim}}[/INST] Understood.</s>
88
+ ```
89
+
90
+ The model seems very sensitive to wrong prompting formats.
91
+
92
  # Sampler Settings
93
 
94
  I'm running the following sampler settings but this is an RC and they may not be optimal.