JackBinary commited on
Commit
68370ae
·
verified ·
1 Parent(s): 430f1c5

Add files using upload-large-folder tool

Browse files
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-7B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-7B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-7B) model in MLC format `q0f16`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84f2173d872200d64a888fdc9317ae334db0d78b335fee1bf9a72c653ebf0d2e
3
+ size 25690112
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eefa5dc7be0cada543ce65149d556dcf1d14e1c5b0fc70602fac7f16416d6413
3
+ size 135790592
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dc1155ed6ca12a2d6bc03129e02815908d58923dadcbac29e5f1194d38ebc93
3
+ size 271581184
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f1ef84178870c4dcd9680470ac1a57ed14ffc3d9a5c6d9f8621fdd84a3e04e5
3
+ size 33030144
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b28e70b82f276562d995b24ed9caaa33353bf0df19b41e421b2995d4d85e0e57
3
+ size 33030144
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5739611edf3f6e8431181d33db765b4acb392f3704e384c6ba6d4d683377104
3
+ size 25690112
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8808453de5c69447f6d648558258cb4fdad0283ef412c5c518ae4b1622576ecd
3
+ size 135790592
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a58678b1c4799f21cb4b3831e80d387288d62e8257f70a86b052033a5275a8c9
3
+ size 33030144
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b92e7f70033b7203597d932b1006b8391e25755bc1493d91907370b6a3f75b7
3
+ size 26356736
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:671c62f580c96777b0e8ba52eff070a1b52f8fafb4d0bcb50609a029ba2db28f
3
+ size 25690112
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:986c9138b2d7d30f8db5c36109043222b346ca87d1ee562dd81c626aa24d3e18
3
+ size 135790592
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cac37e2d3c98aa264b103edb3a9b75791418ef9615a5b801547ee35458dc6df
3
+ size 271581184
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:048141605c1c80a74c6457e7a3e3381988947eed65cd578a1285c263786b62e4
3
+ size 33030144
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc0ed2ef3fb725a0362bf461a91aeca6c3e86a1ad7385a50aaecfc2fcc4f06c4
3
+ size 25690112
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1010fd654552741fa16352102baab0afccd5f4ea80a3a7544d57f802f023a7e
3
+ size 271581184
params_shard_25.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:182fee931c1cbcbc4bd843aef0696ad141c7905047b51918851c5d61f27a12c1
3
+ size 33030144
params_shard_26.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3208a53020edcd0cb1c98704738ca8807c4a69873bfdfd9f9b836b3ac877727f
3
+ size 25690112
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abb41db284cf4efb0cc8d3428544c8ab803e34ce58ea84cccee107f94cf67de2
3
+ size 33030144
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8e4ef7130273258bd4ff278805a73f7cbb0f1fd2b8aab7d6807e8cdb1e2394f
3
+ size 135790592
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8654fa9bf00b4a67518bd119535ba989f732de9007051fc1d254e03b71204a93
3
+ size 271581184
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe155beb61415c1e42027f334270d86c6b73592cf2c40a9793b28eb63a23a231
3
+ size 135790592
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d94d6203cd8a36cb74d74974c08214bc6b3b7e28ccbcb7c69ac75e2c965e1f38
3
+ size 271581184
params_shard_46.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3104eb31d55d7b19a463483299f6af591fde1d2730379584f3fe3ca95917090f
3
+ size 33030144
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:761860803ba43cb79de7850cd64b8089f80a2f0ed5b399cf2b2645403b2a2cf7
3
+ size 271581184
params_shard_51.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92a26bb8ddaea282e7a07c5b471c9a0f8f157c83222b78187740168af796c863
3
+ size 25690112
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:62a3ef55426250ea76e3dd5ee81a0b004b584ff62888f27023795392e37ee271
3
+ size 33030144
params_shard_59.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b53266ce7d503e9fbee82fd0e082cd1cfcbd258890315e21f7cda763a7209b97
3
+ size 25690112
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:faea0cb634cc5660cf988b3e48b353c0a37fb75d27fcca5f5ccbe4a6126eba16
3
+ size 135790592
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6241b12ce09bd0e24202566ef13cbf9e921a67a80533b98c2d0e98a7b3d01d74
3
+ size 271581184
params_shard_67.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c32d3fdc0c459352e94896358c6bb03e923be03a0308661db1732573b8ab577d
3
+ size 25690112
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29a5b7368f69a34b4e541a8a77d55c909b28f9e26721114e7948c385948ce3a7
3
+ size 135790592
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f82b72f46906e29a7a02c06d82df7bef5fc6d7297f58b70d7e627150ddfae0e3
3
+ size 271581184
params_shard_70.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc319dea79cdca8368466c4c81c9e9d445a8f27a8b90e189430410d424be73d6
3
+ size 33030144
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43bb7fd6a9387096dc1bc1fb74a2707a51936b558a7ffcfa595bbb0eb3b3102e
3
+ size 271581184
params_shard_75.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e78392d6347c01108aa4501d5455869bda50c36e071aadfd20602ca51d4112a6
3
+ size 25690112
params_shard_78.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51c754a17248bd3eaa02247cedffc0e933f2c6540cab3bfb474b03bac4c5dfc6
3
+ size 33030144
params_shard_79.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b717e4beb19250b785655a8a781902c84905db933e18c4c93060defa7cb7bfd5
3
+ size 25690112
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:343f3e606ae3fbdbebbf904fbfbe6239b6f97f210e821d4c1c27dc916f91f35c
3
+ size 271581184
params_shard_81.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02d0bb21e28f23962a178bf7434080efde93b1aa36ae0adeaf5a0b2648252a51
3
+ size 135790592
params_shard_82.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b47247044f99113e1047027ae00bece0d58e6b0d51ce98918073a25014330bd8
3
+ size 271581184
params_shard_84.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a3c5264fe4ff50bd0626eabe38ffe79218fe2bd87f1a1c3d3396c330739d93c
3
+ size 25690112
params_shard_85.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17a288550b2fe9168422dbe9c2efe7ce2a418b2b01b51c719f45de81995881e0
3
+ size 135790592
params_shard_86.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5be16069f54167b9d9ee4b12bb9318b856c4639b9ee826d08cc2210a1978945
3
+ size 271581184
params_shard_87.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70f1bba06603950563fe97086da26631fe7692ec83cd776587cdf0117aa71b2a
3
+ size 33030144
params_shard_90.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea804cd88a82a9d96a36872353e7dc61dd84896727bdc9cbdd57165ef614b6b9
3
+ size 271581184
params_shard_93.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0640163f0e419847987db5df95ce85384d6ce1a5484167d384e3c9bf36e7e89
3
+ size 135790592
params_shard_94.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:deb358be4a673c6741eb6387b80ae2e501b9bffde5f94f9bb2d236dff602b13f
3
+ size 271581184
params_shard_96.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e31f0677edb571306099fee3cfd82b96997f6754f14929589a1b20ebadc406ec
3
+ size 25690112