Emin Temiz PRO

etemiz

AI & ML interests

Alignment

Recent Activity

posted an update 5 days ago
--- AHA Leaderboard --- We all want AI to be properly aligned so it benefits humans with every answer it generates. While there are tremendous research around this and so many people working on it, I am choosing another route: Curation of people and then curation of datasets that are used in the LLM training. Curation of datasets comprising of people who try to uplift humanity should result in LLMs that try to help humans. This work has revolved around two tasks: 1. Making LLMs that are benefiting humans 2. Measuring misinformation in other LLMs The idea about the second task is, once we make and gather better LLMs and set them as "ground truth" we now can measure how much other LLMs are distancing themselves from those ground truths. For that I am working on something I will call "AHA Leaderboard" (AHA stands for AI -- human alignment). Link to the spreadsheet: https://sheet.zohopublic.com/sheet/published/mz41j09cc640a29ba47729fed784a263c1d08 The columns are ground truths. The rows are the mainstream LLMs. If a mainstream LLM produces similar answers to the ground truth LLM, it gets a higher score. The LLMs that are higher in the leaderboard should be considered aligned with humans. Simple idea. This is like analyzing LLMs in different domains asking hundreds of questions and checking if they match the answers that try to mimic humans that care about other humans. Will it going to be effective? What do you think? We want mainstream LLMs to copy answers of ground truth LLMs in certain domains. This may refocus AI towards being more beneficial. There have been 5 content providers and 6 curators as of now in the project. Join us and be one of the pioneers that fixed AI! You can be a curator, content provider or general researcher or something else.
View all activity

Organizations

None yet

etemiz's activity

New activity in mradermacher/Nostr-Llama-3.1-8B-i1-GGUF 9 days ago

Old GGUFs

1
#1 opened 9 days ago by
etemiz
New activity in mradermacher/grok-1-GGUF 4 months ago

parts

1
#1 opened 4 months ago by
etemiz
New activity in hilaltekgoz/whisper-large-tr 5 months ago

nice

#1 opened 5 months ago by
etemiz
New activity in etemiz/Llama-3.1-405B-Inst-GGUF 7 months ago

Larger quants please

1
#1 opened 7 months ago by
YokaiKoibito
New activity in DontPlanToEnd/UGI-Leaderboard 10 months ago

Llama3

4
#7 opened 10 months ago by
etemiz

just for curiosity

9
#1 opened 11 months ago by
prudant
New activity in LiteLLMs/Mixtral-8x22B-v0.1-GGUF 11 months ago

ram usage

1
#1 opened 11 months ago by
Tom-Neverwinter
New activity in AlexWortega/miqu-1-70b-AQLM-2Bit-1x16-hf 11 months ago

Space before EOS

#3 opened 11 months ago by
etemiz

just for curiosity

9
#1 opened 11 months ago by
prudant

just for curiosity

9
#1 opened 11 months ago by
prudant