aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions

optimum-neuron-cache / inference-cache-config

33.9 kB

4 contributors

History: 103 commits

dacorvo's picture

dacorvo HF Staff

use longer sequence length for llama3 on trn2

f8538f0 verified 2 days ago

trn1
Update inference-cache-config/trn1/llama3.json 2 days ago
trn2
use longer sequence length for llama3 on trn2 2 days ago
granite.json
1.3 kB

Add configuration for granite models about 1 year ago
llama-variants.json
1.73 kB

Update inference-cache-config/llama-variants.json 4 months ago
llama.json
2.08 kB

Update inference-cache-config/llama.json 6 months ago
llama2-70b.json
287 Bytes

Create llama2-70b.json over 1 year ago
llama3-70b.json
584 Bytes

Add DeepSeek distilled model 12 months ago
llama3.1-70b.json
289 Bytes

Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json over 1 year ago
llama4.json
2.89 kB

Update inference-cache-config/llama4.json 4 months ago
mixtral.json
583 Bytes

Update inference-cache-config/mixtral.json over 1 year ago
phi4.json
556 Bytes

Add phi4 cached configurations 11 months ago
pixart-alpha-xl-512x512.json
206 Bytes

Rename inference-cache-config/pixart-xl-2-512x512.json to inference-cache-config/pixart-alpha-xl-512x512.json 7 months ago
pixart-sigma-xl-512x512.json
210 Bytes

Rename inference-cache-config/pixart_sigma_xl_512x512.json to inference-cache-config/pixart-sigma-xl-512x512.json 7 months ago
qwen-moe.json
530 Bytes

Update inference-cache-config/qwen-moe.json 4 months ago
qwen.json
1.96 kB

Update inference-cache-config/qwen.json 7 months ago
qwen2.5-large.json
849 Bytes

Update inference-cache-config/qwen2.5-large.json about 1 year ago
qwen2.5.json
2.69 kB

Add DeepSeek distilled models about 1 year ago
sdxl-turbo.json
370 Bytes

Create sdxl-turbo.json 7 months ago
smollm3.json
396 Bytes

Update inference-cache-config/smollm3.json 4 months ago
stable-diffusion-2-1.json
378 Bytes

Create stable-diffusion-2-1.json 7 months ago
stable-diffusion-v1-5.json
377 Bytes

Rename inference-cache-config/diffusion.json to inference-cache-config/stable-diffusion-v1-5.json 7 months ago
stable-diffusion-xl-base-1.0.json
388 Bytes

Create stable-diffusion-xl-base-1.0.json 7 months ago
stable-diffusion-xl-refiner-1.0.json
391 Bytes

Create stable-diffusion-xl-refiner-1.0.json 7 months ago