• 0 Posts
  • 20 Comments
Joined 1 year ago
cake
Cake day: June 20th, 2023

help-circle










  • This is it. It’s your free time, OP. Don’t push yourself so hard and put these expectations on yourself to conform to how you’re “supposed” to enjoy things. In your daily life, you probably already have enough pressure to conform and have to put energy into working around your ADHD.
    Just play a game for as long as you’re having fun. If it’s not fun anymore, whatever. It’s okay to move on to something else if you enjoy that more. If you really want to know how the story ends, you can always look it up or watch some clips.








  • Yeah, if you already have it then it’s not really an extra cost. But the smaller models perform less well and less reliably.

    In order to write a book that’s convincing enough to fool at least some buyers, I wouldn’t expect a Llama2 7B to do the trick, based on what I see in my work (ML engineer). But even at work, I run Llama2 70B quantized at most, not the full size one. Full size unquantized requires 320 GPU vram, and that’s just quite expensive (even more so when you have to rent it from cloud providers).

    Although if you already have a GPU that size at home, then of course you can run any LLM you like :)