Sourab Mangrulkar

smangrul's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

published an article 11 months ago

view article

Article

GaLore: Advancing Large Model Training on Consumer-grade Hardware

Mar 20, 2024

• 26

published an article about 1 year ago

view article

Article

🤗 PEFT welcomes new merging methods

Feb 19, 2024

• 16

published an article about 1 year ago

view article

Article

Mixture of Experts Explained

Dec 11, 2023

• 391

published an article over 1 year ago

view article

Article

Personal Copilot: Train Your Own Coding Assistant

Oct 27, 2023

• 44

published an article over 1 year ago

view article

Article

Fine-tuning Llama 2 70B using PyTorch FSDP

Sep 13, 2023

• 19

published an article over 1 year ago

view article

Article

The Falcon has landed in the Hugging Face ecosystem

Jun 5, 2023

• 12

published an article over 1 year ago

view article

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 119

published an article almost 2 years ago

view article

Article

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 42

published an article about 2 years ago

view article

Article

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Feb 10, 2023

• 57

published an article over 2 years ago

view article

Article

Accelerate Large Model Training using DeepSpeed

Jun 28, 2022

• 3

published an article almost 3 years ago

view article

Article

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

May 2, 2022

• 3