SaylorTwift (Nathan Habib) – Community Activity

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

Llama-3.1 70B Math Hard doesn't match its dataset

3

#1041 opened 2 months ago by

MaziyarPanahi

New activity in hf-doc-build/doc-build 5 months ago

Create lighteval/_versions.yml

3

#28 opened 5 months ago by

SaylorTwift

New activity in open-llm-leaderboard/open_llm_leaderboard 9 months ago

bump-transformers-to-4.41.1

2

#753 opened 9 months ago by

alozowski

apply-ruff

7

#748 opened 9 months ago by

alozowski

New activity in open-llm-leaderboard/GenerationVisualizer 9 months ago

bbh_math_fixes

1

#1 opened 9 months ago by

alozowski

New activity in open-llm-leaderboard/open_llm_leaderboard 9 months ago

Understanding raw result data files

4

#729 opened 10 months ago by

jerome-white

New activity in open-llm-leaderboard/open_llm_leaderboard 10 months ago

No good way to identify number of activated parameters causes MIxtral evaluation failures

32

#680 opened 10 months ago by

0-hero

GSM8K failure with Llama 3 finetunes

12

#703 opened 10 months ago by

jeiku

New activity in open-llm-leaderboard-old/results 10 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#57 opened 10 months ago by

SaylorTwift

New activity in open-llm-leaderboard-old/requests 10 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#102 opened 10 months ago by

SaylorTwift

New activity in databricks/dbrx-base 11 months ago

Update README.md

1

#16 opened 11 months ago by

SaylorTwift

New activity in open-llm-leaderboard/open_llm_leaderboard 12 months ago

Model evaluation failed after 2 days

17

#622 opened 12 months ago by

migtissera

bigstral and bigyi both failed

1

#628 opened 12 months ago by

ehartford

New activity in open-llm-leaderboard-old/results 12 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

2

#46 opened about 1 year ago by

SaylorTwift

Renaming Model gg-hf/gemma-7b to google/gemma-7b

2

#45 opened about 1 year ago by

SaylorTwift

New activity in google/gemma-7b about 1 year ago

Fix typo

#15 opened about 1 year ago by

SaylorTwift

New activity in open-llm-leaderboard-old/details_google__gemma-2b about 1 year ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#1 opened about 1 year ago by

SaylorTwift

New activity in open-llm-leaderboard-old/details_google__gemma-7b about 1 year ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#1 opened about 1 year ago by

SaylorTwift

New activity in open-llm-leaderboard-old/requests about 1 year ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#59 opened about 1 year ago by

SaylorTwift

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#58 opened about 1 year ago by

SaylorTwift

Nathan Habib

AI & ML interests

Organizations

SaylorTwift's activity

Llama-3.1 70B Math Hard doesn't match its dataset

Create lighteval/_versions.yml

bump-transformers-to-4.41.1

apply-ruff

bbh_math_fixes

Understanding raw result data files

No good way to identify number of activated parameters causes MIxtral evaluation failures

GSM8K failure with Llama 3 finetunes

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

Update README.md

Model evaluation failed after 2 days

bigstral and bigyi both failed

Renaming Model gg-hf/gemma-2b to google/gemma-2b

Renaming Model gg-hf/gemma-7b to google/gemma-7b

Fix typo

Renaming Model gg-hf/gemma-2b to google/gemma-2b

Renaming Model gg-hf/gemma-7b to google/gemma-7b

Renaming Model gg-hf/gemma-2b to google/gemma-2b

Renaming Model gg-hf/gemma-7b to google/gemma-7b