Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-7B-q3f16_1-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
bbd6a75
·
verified ·
1 Parent(s): 906acc8

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache.json +0 -0
  3. params_shard_0.bin +3 -0
  4. params_shard_1.bin +3 -0
  5. params_shard_14.bin +3 -0
  6. params_shard_15.bin +3 -0
  7. params_shard_16.bin +3 -0
  8. params_shard_17.bin +3 -0
  9. params_shard_18.bin +3 -0
  10. params_shard_19.bin +3 -0
  11. params_shard_20.bin +3 -0
  12. params_shard_22.bin +3 -0
  13. params_shard_25.bin +3 -0
  14. params_shard_27.bin +3 -0
  15. params_shard_29.bin +3 -0
  16. params_shard_3.bin +3 -0
  17. params_shard_31.bin +3 -0
  18. params_shard_33.bin +3 -0
  19. params_shard_36.bin +3 -0
  20. params_shard_39.bin +3 -0
  21. params_shard_4.bin +3 -0
  22. params_shard_40.bin +3 -0
  23. params_shard_41.bin +3 -0
  24. params_shard_44.bin +3 -0
  25. params_shard_46.bin +3 -0
  26. params_shard_47.bin +3 -0
  27. params_shard_48.bin +3 -0
  28. params_shard_49.bin +3 -0
  29. params_shard_50.bin +3 -0
  30. params_shard_51.bin +3 -0
  31. params_shard_52.bin +3 -0
  32. params_shard_53.bin +3 -0
  33. params_shard_54.bin +3 -0
  34. params_shard_59.bin +3 -0
  35. params_shard_61.bin +3 -0
  36. params_shard_63.bin +3 -0
  37. params_shard_64.bin +3 -0
  38. params_shard_65.bin +3 -0
  39. params_shard_67.bin +3 -0
  40. params_shard_68.bin +3 -0
  41. params_shard_69.bin +3 -0
  42. params_shard_7.bin +3 -0
  43. params_shard_70.bin +3 -0
  44. params_shard_71.bin +3 -0
  45. params_shard_73.bin +3 -0
  46. params_shard_75.bin +3 -0
  47. params_shard_76.bin +3 -0
  48. params_shard_78.bin +3 -0
  49. params_shard_79.bin +3 -0
  50. params_shard_8.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-7B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-7B-q3f16_1-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-7B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-7B) model in MLC format `q3f16_1`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q3f16_1-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q3f16_1-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q3f16_1-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bddc367a8ea5c92f024997b7a6463e934b8eb4cd5adfcc75cd74a04ef1bc9c9e
3
+ size 218972160
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1f357f9420f695d073b8c9c1ba3b68656503cbadcddc23afd90b5ebcaadd36e
3
+ size 27181056
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f711fcbbf635ac1165b0e077b127357daba3b15659f00e0e8600863e85b6b15f
3
+ size 30348288
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:824df58a51f875ae992122db394dc3e979dcd92f95834a23f33406f00022c38b
3
+ size 27181056
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e8d4be19fd1c21fc44dd9a49d64dddd3e2327eee7110055a5c2498a6082c634
3
+ size 54558720
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1106a3f1ace97479b43ad268b64a35e06a9fe2207132aba2b097dd9491e39eac
3
+ size 30977024
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60bee350eb8f3e2047aa8385e7745aa1c20fdcf428f52572753803d1b9a80193
3
+ size 32994304
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0fee0b5f6aebcd75494c70f6a5da0a4b7d8ba5daa74b993d267e7b776e9983c
3
+ size 54558720
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04461c5cb8d388db60c6b3b7d45e86417a4a10483f9be7156eafee4f7dcf8692
3
+ size 27181056
params_shard_22.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4892ded27dedfd19d27b79dd265c17fb7c90b5ae621c86470f2ded836a407551
3
+ size 26909696
params_shard_25.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b625258bb2efe2b4e201941d76be16ba0123ba91088c1c5a29e9ad7f36eae350
3
+ size 30348288
params_shard_27.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c2ada0da20043b94bd699df65c33f371278d58cdc8f3bc51e8c4e728f738341
3
+ size 27371520
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e1b89287a72b187723d5481c842519034fa22074c07ea1a7aff433b9eaf1258
3
+ size 54558720
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9a0e5e8d90d3115998db9152481f09c73ad7b8d63943a084e352bf0f71c68b6
3
+ size 30776320
params_shard_31.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8146ffee0b1c87699d5a18f088472904ab4e0ee0363ed7450d3b51ef7a7bc07
3
+ size 32994304
params_shard_33.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:298447542476d4084f03f69bec2b3bb7471132f524580bd89a16e6a1c8fb0547
3
+ size 27181056
params_shard_36.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfb9e601cc0cfef8b8f86922ccf780a97105127e0d200ed2e6c6b4c2a1f1e352
3
+ size 27181056
params_shard_39.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4b3f52278f3052eadbeaa3bb2839ebe2865752a4f8234570bdff5ebd91aa0e5
3
+ size 27181056
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed35b9d48ccb883ea7a76113e5bc29547acfd841173539c29c4da83731df1b54
3
+ size 27181056
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:866b94136bea9cdaa8d818b88fadb1790e49a1bc1e4853c67a9cd5a701ac9163
3
+ size 54558720
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:091dc2a7df0161d3525a08e3f02667139762d945151f9bf2d5851bddad75af25
3
+ size 30977024
params_shard_44.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc8e509711724b6bd7687b3abc2338cd92c3047692e359b90da7421fc3df6620
3
+ size 27181056
params_shard_46.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4065d3c97f8ecc0dd4667523e60067411f0f3698c88b9edc0fc28e7ad28f993b
3
+ size 26909696
params_shard_47.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:679b3ed77f8d18f7d70df760c619014e39ca5afb5b2b070a23d66e45bb5a6fe2
3
+ size 27181056
params_shard_48.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad7dd8a6e12efb9e29a2ba347ea271a006c67f926662498e679e76aec5d418da
3
+ size 54558720
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a7883bbabcfcde35378b9fb188ae21084793d4bcb4fea9298a1f4187f1314b8
3
+ size 30348288
params_shard_50.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:392a6485f1562452d2a5fec12060b5e5fc61eb27e6ddffb08e5b1fb994834a35
3
+ size 27181056
params_shard_51.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3845afce8d5ceaba7cdf0ebe53843218fb482db70ec8f90752ba1759361865e2
3
+ size 54558720
params_shard_52.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08664bca248eac55148325929d415f97b30a73a05ed142168d67493eadee27c9
3
+ size 30977024
params_shard_53.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c93e9cbc7ff9bc19b88fdd3a5b36b0b0aea884aed875aa1a88a0f3001474ed97
3
+ size 32994304
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dd8319cfd06903e8d85eea2a84d869ab153376a1cef63fcd9b50acbfc948b51
3
+ size 54558720
params_shard_59.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf7f849e6a2f838f071668e29c249eff4b9aad527268800c9068875eb4a267d3
3
+ size 54558720
params_shard_61.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20ee8aea7523e75936f3fd88038925da74d649d35d4426b980bc72d5eebf5c83
3
+ size 27181056
params_shard_63.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cd708cb11c8d36b7eec237164ca97f5087d6682625f52dd30f8397ba4e35dfa
3
+ size 30348288
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c13f0c8c585708bfbbfe5c1e60b3d7cab5980f450bc74f0da86bde8862704f0
3
+ size 27181056
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b057041e5cac8741f0333d52413ba2a10524f6ad5445b78c2a808424bdbc7ba
3
+ size 54558720
params_shard_67.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3920e7d5b5fc51189f06600c98a1c3bb6978794046b972e85f5b2889c21d67f
3
+ size 32994304
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07722c78c83690d36d587f017f3cd53acf8c299504230b468aa22403c481aa55
3
+ size 54558720
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70010d171fe6ca41974abab2812a175a0bb33f298f6db164b417b89f3a0d80d9
3
+ size 27181056
params_shard_7.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a5d3b6fdf389e51fd21626764629a2317d37962140d0adfa102ca1f83820ad1
3
+ size 32994304
params_shard_70.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5be9a13f636f43d835e83c665e866e01a209d184b67cf6f3c34f35184489daa4
3
+ size 54558720
params_shard_71.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7ccfd0b71a180697a05ef715566cae297a1a67e56a9ba4cafb9e11a38a9bf88
3
+ size 26909696
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:417ae5d425b41641e9da4cb5ff2bc10f45f6b0f7d04f0995820326e5e212f564
3
+ size 54558720
params_shard_75.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a1ca4e55c8caf27922912d5e4cc11cddcddf1fa7b2418b9762f1001b05eeb35
3
+ size 27181056
params_shard_76.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d26bcac52fa85ecedfc91a1f5e8fe28620d8a57f6a2021ff91dfa83b249bf94
3
+ size 54558720
params_shard_78.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eac8c1f2cdbe071b346aea6235e8011b2fa41af601d0f6a26261dfeda9588717
3
+ size 32994304
params_shard_79.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:182b5c5cc39b39c8bfed614d250f1879c43e2bf1f7e7e2668b042e766fb44740
3
+ size 54558720
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef48f064da22d26fea25cea95b0aae6b2ce03f48c06bab5d3b1ac04a153c573f
3
+ size 54558720