Add files using upload-large-folder tool
Browse files- README.md +52 -0
- ndarray-cache.json +0 -0
- params_shard_100.bin +3 -0
- params_shard_101.bin +3 -0
- params_shard_102.bin +3 -0
- params_shard_103.bin +3 -0
- params_shard_107.bin +3 -0
- params_shard_108.bin +3 -0
- params_shard_109.bin +3 -0
- params_shard_111.bin +3 -0
- params_shard_113.bin +3 -0
- params_shard_14.bin +3 -0
- params_shard_15.bin +3 -0
- params_shard_16.bin +3 -0
- params_shard_17.bin +3 -0
- params_shard_18.bin +3 -0
- params_shard_20.bin +3 -0
- params_shard_25.bin +3 -0
- params_shard_26.bin +3 -0
- params_shard_29.bin +3 -0
- params_shard_3.bin +3 -0
- params_shard_4.bin +3 -0
- params_shard_40.bin +3 -0
- params_shard_41.bin +3 -0
- params_shard_46.bin +3 -0
- params_shard_49.bin +3 -0
- params_shard_51.bin +3 -0
- params_shard_54.bin +3 -0
- params_shard_59.bin +3 -0
- params_shard_64.bin +3 -0
- params_shard_65.bin +3 -0
- params_shard_67.bin +3 -0
- params_shard_68.bin +3 -0
- params_shard_69.bin +3 -0
- params_shard_70.bin +3 -0
- params_shard_73.bin +3 -0
- params_shard_75.bin +3 -0
- params_shard_78.bin +3 -0
- params_shard_79.bin +3 -0
- params_shard_8.bin +3 -0
- params_shard_81.bin +3 -0
- params_shard_82.bin +3 -0
- params_shard_84.bin +3 -0
- params_shard_85.bin +3 -0
- params_shard_86.bin +3 -0
- params_shard_87.bin +3 -0
- params_shard_90.bin +3 -0
- params_shard_93.bin +3 -0
- params_shard_94.bin +3 -0
- params_shard_96.bin +3 -0
README.md
ADDED
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: mlc-llm
|
3 |
+
base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-7B
|
4 |
+
tags:
|
5 |
+
- mlc-llm
|
6 |
+
- web-llm
|
7 |
+
---
|
8 |
+
|
9 |
+
# OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC
|
10 |
+
|
11 |
+
This is the [OpenCodeReasoning-Nemotron-1.1-7B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-7B) model in MLC format `q0f16`.
|
12 |
+
The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
|
13 |
+
|
14 |
+
## Example Usage
|
15 |
+
|
16 |
+
Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
|
17 |
+
|
18 |
+
### Chat CLI
|
19 |
+
|
20 |
+
```bash
|
21 |
+
mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC
|
22 |
+
````
|
23 |
+
|
24 |
+
### REST Server
|
25 |
+
|
26 |
+
```bash
|
27 |
+
mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC
|
28 |
+
```
|
29 |
+
|
30 |
+
### Python API
|
31 |
+
|
32 |
+
```python
|
33 |
+
from mlc_llm import MLCEngine
|
34 |
+
|
35 |
+
model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f16-MLC"
|
36 |
+
engine = MLCEngine(model)
|
37 |
+
|
38 |
+
for response in engine.chat.completions.create(
|
39 |
+
messages=[{"role": "user", "content": "What is the meaning of life?"}],
|
40 |
+
model=model,
|
41 |
+
stream=True,
|
42 |
+
):
|
43 |
+
for choice in response.choices:
|
44 |
+
print(choice.delta.content, end="", flush=True)
|
45 |
+
print("\n")
|
46 |
+
|
47 |
+
engine.terminate()
|
48 |
+
```
|
49 |
+
|
50 |
+
## Documentation
|
51 |
+
|
52 |
+
For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
|
ndarray-cache.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
params_shard_100.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:84f2173d872200d64a888fdc9317ae334db0d78b335fee1bf9a72c653ebf0d2e
|
3 |
+
size 25690112
|
params_shard_101.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:eefa5dc7be0cada543ce65149d556dcf1d14e1c5b0fc70602fac7f16416d6413
|
3 |
+
size 135790592
|
params_shard_102.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9dc1155ed6ca12a2d6bc03129e02815908d58923dadcbac29e5f1194d38ebc93
|
3 |
+
size 271581184
|
params_shard_103.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3f1ef84178870c4dcd9680470ac1a57ed14ffc3d9a5c6d9f8621fdd84a3e04e5
|
3 |
+
size 33030144
|
params_shard_107.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b28e70b82f276562d995b24ed9caaa33353bf0df19b41e421b2995d4d85e0e57
|
3 |
+
size 33030144
|
params_shard_108.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d5739611edf3f6e8431181d33db765b4acb392f3704e384c6ba6d4d683377104
|
3 |
+
size 25690112
|
params_shard_109.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8808453de5c69447f6d648558258cb4fdad0283ef412c5c518ae4b1622576ecd
|
3 |
+
size 135790592
|
params_shard_111.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a58678b1c4799f21cb4b3831e80d387288d62e8257f70a86b052033a5275a8c9
|
3 |
+
size 33030144
|
params_shard_113.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6b92e7f70033b7203597d932b1006b8391e25755bc1493d91907370b6a3f75b7
|
3 |
+
size 26356736
|
params_shard_14.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:671c62f580c96777b0e8ba52eff070a1b52f8fafb4d0bcb50609a029ba2db28f
|
3 |
+
size 25690112
|
params_shard_15.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:986c9138b2d7d30f8db5c36109043222b346ca87d1ee562dd81c626aa24d3e18
|
3 |
+
size 135790592
|
params_shard_16.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8cac37e2d3c98aa264b103edb3a9b75791418ef9615a5b801547ee35458dc6df
|
3 |
+
size 271581184
|
params_shard_17.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:048141605c1c80a74c6457e7a3e3381988947eed65cd578a1285c263786b62e4
|
3 |
+
size 33030144
|
params_shard_18.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:dc0ed2ef3fb725a0362bf461a91aeca6c3e86a1ad7385a50aaecfc2fcc4f06c4
|
3 |
+
size 25690112
|
params_shard_20.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b1010fd654552741fa16352102baab0afccd5f4ea80a3a7544d57f802f023a7e
|
3 |
+
size 271581184
|
params_shard_25.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:182fee931c1cbcbc4bd843aef0696ad141c7905047b51918851c5d61f27a12c1
|
3 |
+
size 33030144
|
params_shard_26.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3208a53020edcd0cb1c98704738ca8807c4a69873bfdfd9f9b836b3ac877727f
|
3 |
+
size 25690112
|
params_shard_29.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:abb41db284cf4efb0cc8d3428544c8ab803e34ce58ea84cccee107f94cf67de2
|
3 |
+
size 33030144
|
params_shard_3.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e8e4ef7130273258bd4ff278805a73f7cbb0f1fd2b8aab7d6807e8cdb1e2394f
|
3 |
+
size 135790592
|
params_shard_4.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8654fa9bf00b4a67518bd119535ba989f732de9007051fc1d254e03b71204a93
|
3 |
+
size 271581184
|
params_shard_40.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:fe155beb61415c1e42027f334270d86c6b73592cf2c40a9793b28eb63a23a231
|
3 |
+
size 135790592
|
params_shard_41.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d94d6203cd8a36cb74d74974c08214bc6b3b7e28ccbcb7c69ac75e2c965e1f38
|
3 |
+
size 271581184
|
params_shard_46.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3104eb31d55d7b19a463483299f6af591fde1d2730379584f3fe3ca95917090f
|
3 |
+
size 33030144
|
params_shard_49.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:761860803ba43cb79de7850cd64b8089f80a2f0ed5b399cf2b2645403b2a2cf7
|
3 |
+
size 271581184
|
params_shard_51.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:92a26bb8ddaea282e7a07c5b471c9a0f8f157c83222b78187740168af796c863
|
3 |
+
size 25690112
|
params_shard_54.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:62a3ef55426250ea76e3dd5ee81a0b004b584ff62888f27023795392e37ee271
|
3 |
+
size 33030144
|
params_shard_59.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b53266ce7d503e9fbee82fd0e082cd1cfcbd258890315e21f7cda763a7209b97
|
3 |
+
size 25690112
|
params_shard_64.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:faea0cb634cc5660cf988b3e48b353c0a37fb75d27fcca5f5ccbe4a6126eba16
|
3 |
+
size 135790592
|
params_shard_65.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6241b12ce09bd0e24202566ef13cbf9e921a67a80533b98c2d0e98a7b3d01d74
|
3 |
+
size 271581184
|
params_shard_67.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c32d3fdc0c459352e94896358c6bb03e923be03a0308661db1732573b8ab577d
|
3 |
+
size 25690112
|
params_shard_68.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:29a5b7368f69a34b4e541a8a77d55c909b28f9e26721114e7948c385948ce3a7
|
3 |
+
size 135790592
|
params_shard_69.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f82b72f46906e29a7a02c06d82df7bef5fc6d7297f58b70d7e627150ddfae0e3
|
3 |
+
size 271581184
|
params_shard_70.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bc319dea79cdca8368466c4c81c9e9d445a8f27a8b90e189430410d424be73d6
|
3 |
+
size 33030144
|
params_shard_73.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:43bb7fd6a9387096dc1bc1fb74a2707a51936b558a7ffcfa595bbb0eb3b3102e
|
3 |
+
size 271581184
|
params_shard_75.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e78392d6347c01108aa4501d5455869bda50c36e071aadfd20602ca51d4112a6
|
3 |
+
size 25690112
|
params_shard_78.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:51c754a17248bd3eaa02247cedffc0e933f2c6540cab3bfb474b03bac4c5dfc6
|
3 |
+
size 33030144
|
params_shard_79.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b717e4beb19250b785655a8a781902c84905db933e18c4c93060defa7cb7bfd5
|
3 |
+
size 25690112
|
params_shard_8.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:343f3e606ae3fbdbebbf904fbfbe6239b6f97f210e821d4c1c27dc916f91f35c
|
3 |
+
size 271581184
|
params_shard_81.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:02d0bb21e28f23962a178bf7434080efde93b1aa36ae0adeaf5a0b2648252a51
|
3 |
+
size 135790592
|
params_shard_82.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b47247044f99113e1047027ae00bece0d58e6b0d51ce98918073a25014330bd8
|
3 |
+
size 271581184
|
params_shard_84.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7a3c5264fe4ff50bd0626eabe38ffe79218fe2bd87f1a1c3d3396c330739d93c
|
3 |
+
size 25690112
|
params_shard_85.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:17a288550b2fe9168422dbe9c2efe7ce2a418b2b01b51c719f45de81995881e0
|
3 |
+
size 135790592
|
params_shard_86.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d5be16069f54167b9d9ee4b12bb9318b856c4639b9ee826d08cc2210a1978945
|
3 |
+
size 271581184
|
params_shard_87.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:70f1bba06603950563fe97086da26631fe7692ec83cd776587cdf0117aa71b2a
|
3 |
+
size 33030144
|
params_shard_90.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ea804cd88a82a9d96a36872353e7dc61dd84896727bdc9cbdd57165ef614b6b9
|
3 |
+
size 271581184
|
params_shard_93.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c0640163f0e419847987db5df95ce85384d6ce1a5484167d384e3c9bf36e7e89
|
3 |
+
size 135790592
|
params_shard_94.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:deb358be4a673c6741eb6387b80ae2e501b9bffde5f94f9bb2d236dff602b13f
|
3 |
+
size 271581184
|
params_shard_96.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e31f0677edb571306099fee3cfd82b96997f6754f14929589a1b20ebadc406ec
|
3 |
+
size 25690112
|