Papers
arxiv:2508.14899
Accelerating GenAI Workloads by Enabling RISC-V Microkernel Support in IREE
Published on Jul 7
Authors:
Abstract
IREE supports RISC-V microkernel with MLIR linalg dialect optimizations, improving performance for the Llama-3.2-1B-Instruct model compared to upstream IREE and Llama.cpp.
AI-generated summary
This project enables RISC-V microkernel support in IREE, an MLIR-based machine learning compiler and runtime. The approach begins by enabling the lowering of MLIR linalg dialect contraction ops to linalg.mmt4d op for the RISC-V64 target within the IREE pass pipeline, followed by the development of optimized microkernels for RISC-V. The performance gains are compared with upstream IREE and Llama.cpp for the Llama-3.2-1B-Instruct model.
Models citing this paper 0
No model linking this paper
Cite arxiv.org/abs/2508.14899 in a model README.md to link it from this page.
Datasets citing this paper 0
No dataset linking this paper
Cite arxiv.org/abs/2508.14899 in a dataset README.md to link it from this page.
Spaces citing this paper 0
No Space linking this paper
Cite arxiv.org/abs/2508.14899 in a Space README.md to link it from this page.
Collections including this paper 0
No Collection including this paper
Add this paper to a
collection
to link it from this page.