And then comes the enshittification, like, ya know, Android.

Most people never create even one world-changing technology, Linus casually created two (Linux + Git).

And don’t downplay that he did swear about Microsoft and Nvidia!

Thanks, when I get some time soon, I’ll have another look at it and cherry ai with a local install of ollama

Don’t bother. Anything bad you say will be dismissed as a ‘smear’ campaign against that person because ‘they’ (big pharma, the millions of scientists who are all in on “it”) don’t want you to know and they’ll just shut off against you. Just take a step back from the dolt.

Any suggestions for solutions?

You’re conflating me asking how to use these tools with you who’s misusing them. I see you still don’t accept what you’re doing is wrong. But go you.

Please be very careful. The python code it’ll spit out will most likely be outdated, not work as well as it should (the code isn’t “thought out” as if a human did it.

If you want to learn, dive it, set yourself tasks, get stuck, and f around.

Yeah shell scripts are one of those things that you never remember how to do something and have to always look it up!

Was this system vibe coded? I get the feeling it was…

lol. Way to contradict yourself.

I haven’t actually found the coder-specific ones to be much (if at all) better than the generic ones. I wish I could have. Hopefully LLMs can become more efficient in the very near future.

Some questions and because you don’t actually understand, also, the answers.

• what does the LLM understand the context of, (other user’s data owned by Twitch)
• How is the LLM fed that data? (You store it and feed it to the LLM)
• Do you use Twitch’s data and its users data through an AI without their consent? (Most likely, yes)
• Do you have consent from the users to store ‘facts’ about them (You’re pissy, so obviously not)
• Are you then storing that processed data? (Yes, you are, written to a file)
• Is the purpose this data processing commercial (Yes, it is, designed to increase viewer count for the user of this system - and before you retort “OMG it helps twitch too”… Uhm no, Twitch has the viewers if not watching him, watching someone else)

I mean yeah, it’s a use case, but own up to the fact that you’re wrong. Or be pissy. I don’t care.

Doesn’t Twitch own all data that is written and their TOS will state something like you can’t store data yourself locally.

No, what is it? How do I try it?

Surely none of that uses a small LLM <= 3B?

But won’t this be a mish-mash of different docker containers and projects creating an installation, dependency, upgrade nightmare?

But its website is Chinese. Also what’s the github?

This looks interesting - do you have experience of it? How reliable / efficient is it?

Try the beta on the github repo, and use a smaller model!

I’m getting very-near real-time on my old laptop. Maybe a delay of 1-2s whilst it creates the response