Update README.md

README.md

@@ -4,4 +4,21 @@ pipeline_tag: text-generation
 7.0 bpw exl2 quant of [CohereForAI/c4ai-command-a-03-2025](https://huggingface.co/CohereForAI/c4ai-command-a-03-2025)
 
 The following patch from the exllamav2 discord is needed to run command-a:
-https://discord.com/channels/1212998078668472380/1212998079339307070/1350190120833253396
+
+```
+diff --git a/exllamav2/architecture.py b/exllamav2/architecture.py
+index b2a6280..67db6ef 100644
+--- a/exllamav2/architecture.py
++++ b/exllamav2/architecture.py
+@@ -496,7 +496,7 @@ class ExLlamaV2ArchParams:
+ 
+         # Cohere
+ 
+-        if arch_string == "CohereForCausalLM":
++        if arch_string in ("CohereForCausalLM", "Cohere2ForCausalLM"):
+             arch_recognized = True
+             self.lm.layer_keys += \
+                 layer_keys_cohere_norms + \
+```
+
+(source: https://discord.com/channels/1212998078668472380/1212998079339307070/1350190120833253396)