--- license: other license_name: nvidia-open-model-license license_link: >- https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/ base_model: - nvidia/NVIDIA-Nemotron-Nano-9B-v2 --- IMatrix GGUFs calibrated on https://huggingface.co/datasets/eaddario/imatrix-calibration/tree/main combined_all_small set. Note: Due to the nonstandard tensor sizes, some quantization types do not make sense. For example, due to fallbacks IQ2_M is just 300MB smaller than IQ4_NL. Thus, I only upload the quantizations that actually made sense.