Hugging Face's logo
Guilherme Penedo's picture
89 15 18

Guilherme Penedo

guipenedo
francois55512's profile picture daboss92's profile picture Kc1995's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a Space 4 days ago
nanotron/ultrascale-playbook
liked a model 7 days ago
deepseek-ai/DeepSeek-R1
new activity 12 days ago
HuggingFaceFW/fineweb:Downloading the 350BT sample uses 990GB of disk space
View all activity

Organizations

Hugging Face's profile picture BigScience Data's profile picture HuggingFaceBR4's profile picture Hugging Face H4's profile picture Hugging Face Extreme-Scale's profile picture Hugging Face TB Research's profile picture Hugging Face Smol Cluster's profile picture Nanotron Research's profile picture HuggingFaceFW's profile picture Data Is Better Together's profile picture mlo-data-cleaning's profile picture Dev Mode Explorers's profile picture HuggingFaceFW-Dev's profile picture Hugging Face Science's profile picture ml-fw-prerelease's profile picture Open R1's profile picture

guipenedo's activity

New activity in HuggingFaceFW/fineweb 12 days ago

Downloading the 350BT sample uses 990GB of disk space

4
#57 opened about 1 month ago by
ddh0

Create Ffcc

1
#58 opened 13 days ago by
Ricky23184
New activity in huggingface-legal/takedown-notices 23 days ago

Update 2025/2025-01-22-Torstar.md
#4 opened 23 days ago by
guipenedo
New activity in HuggingFaceFW/fineweb-edu about 1 month ago

New update returns a 500 server error using the datasets-server API

6
#18 opened about 2 months ago by
jonna32
New activity in HuggingFaceFW/fineweb-2 about 1 month ago

Synthetic Data Generator

1
#5 opened about 1 month ago by
kishorekashyap
New activity in HuggingFaceFW/fineweb-2 about 2 months ago

Cannot load with datasets

3
#4 opened about 2 months ago by
mbanon
New activity in HuggingFaceFW/fineweb-edu about 2 months ago

A lot of load errors after new update

14
#19 opened about 2 months ago by
yzhangcs

Add "date" column to "default" subset
#20 opened about 2 months ago by
lhoestq
New activity in HuggingFaceFW/fineweb 2 months ago

Simple exact deduplication removes 2/3 of data.

4
#49 opened 7 months ago by
egor-pakhomov

Torrent?

3
#4 opened 10 months ago by
emilss

Any plan to train models on larger subset of dataset?

1
#8 opened 10 months ago by
mrfakename

Are copyrighted works included in this dataset?

4
#9 opened 10 months ago by
umm-maybe

Reprocessing for a new language

14
#12 opened 10 months ago by
pere

Training configs for data ablation study

2
#14 opened 10 months ago by
jimmyhbx

tiny-fineweb

3
#19 opened 10 months ago by
3thn

Unsafe files

1
#25 opened 10 months ago by
alielfilali01

"Reproducing GPT-2 (124M) in llm.c in 90 minutes for $20" using fineweb by Karpathy
#28 opened 9 months ago by
clem

Regarding to the newly updated indexes(writen as deduplication issues)

5
#29 opened 9 months ago by
kimcando

Dedup

1
#32 opened 9 months ago by
shawnkx

Language subset

3
#33 opened 9 months ago by
talmor