MrDragonFox

bro, im not that popular. its ok to do this ig?

also, no, im not saying openai's products are bad. nor im trying to like offend ANYONE or ANY company or organization. im just trying to promote my product

my problem isnt with you trying to promote a product - you asking if you should opensource something or not .. without showing anything working and state its not clickbait ..

show the goods man ..
otherwise noone cares - not how marketing works .. too many snakeoil sales men in that industry ... if you have something show it off .. if not .. well you know where this goes

the point you are mistaken here is that i dont care if he opensources it or not .. its the engagement farming for no reason while implying its not clickbait - but you do you

this is not clickbait .. if you want to opensource it .. you opensource it .. if not you dont .. its that simple - there are other approaches out there to this already

if that's not for farming what did you post it for ?

its all just attention patching .. really old stuff -https://nnsight.net/
https://github.com/ndif-team/nnsight
is the best toolkit for that

nnsight has a good toolkit for that

just limit vllm to 1 gpu and run the rest on a other one .. or use -gmu

8b repo empty and dataset empty too .. well its a little off from sota .... tbh glm4voice had better results - but its certainly a "ok" poc

gh repo empty / no paper

is that with ddr4 or 5 ?

with 250g ram used ^^ probably running it at a 2 bit quant .