Simon Mo's picture

14 3 1

Simon Mo

simon-mo

·

https://github.com/simon-mo

AI & ML interests

System for ML

Recent Activity

new activity 14 days ago

openai/gpt-oss-120b:[v1 engine][flash_attn backend] TypeError: flash_attn_varlen_func() got an unexpected keyword argument 's_aux' when running gpt-oss-120b on H200

new activity 15 days ago

openai/gpt-oss-120b:VLLM - Flash-attn 3

reacted to erikkaum's post with 🤗 about 1 month ago

We just released native support for @SGLang and @vllm-project in Inference Endpoints 🔥 Inference Endpoints is becoming the central place where you deploy high performance Inference Engines. And that provides the managed infra for it. Instead of spending weeks configuring infrastructure, managing servers, and debugging deployment issues, you can focus on what matters most: your AI model and your users 🙌

View all activity

Organizations

models 0

None public yet

datasets 0

None public yet