Merge branch 'main' of https://huggingface.co/TMElyralab/lyraBaichuan into main
Browse files
README.md
CHANGED
|
@@ -33,14 +33,14 @@ We use the Baichuan2-7B-Base and Baichuan2-13B-Base model for measurement, but t
|
|
| 33 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
| 34 |
| --- | --- | --- | --- | --- | --- |
|
| 35 |
| Torch 2.0.1 | 41.2 | 323.2 | 640.0 | 1256.8 | 2231.0 |
|
| 36 |
-
|
|
| 37 |
|
| 38 |
### Baichuan2-13B-Base
|
| 39 |
|
| 40 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
| 41 |
| --- | --- | --- | --- | --- | --- |
|
| 42 |
| Torch 2.0.1 | 40.9 | 307.9 | 555.6 | 1010.4 | 1601.0 |
|
| 43 |
-
|
|
| 44 |
|
| 45 |
## Docker Environment Recommendation
|
| 46 |
|
|
|
|
| 33 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
| 34 |
| --- | --- | --- | --- | --- | --- |
|
| 35 |
| Torch 2.0.1 | 41.2 | 323.2 | 640.0 | 1256.8 | 2231.0 |
|
| 36 |
+
| lyraBaichuan | 125.9 | 948.1 | 1749.3 | 2974.0 | 4370.1 |
|
| 37 |
|
| 38 |
### Baichuan2-13B-Base
|
| 39 |
|
| 40 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
| 41 |
| --- | --- | --- | --- | --- | --- |
|
| 42 |
| Torch 2.0.1 | 40.9 | 307.9 | 555.6 | 1010.4 | 1601.0 |
|
| 43 |
+
| lyraBaichuan | 80.0 | 568.2 | 1124.4 | 1942.6 | 2828.0 |
|
| 44 |
|
| 45 |
## Docker Environment Recommendation
|
| 46 |
|