I think to some extent it’s a matter of scale, though. If I advertise something as a calculator capable of doing all math, and it can only do one problem, it is so drastically far away from its intended purpose that the meaning kinda breaks down. I don’t think it would be wrong to say “it malfunctions in 99.999999% of use cases” but it would be easier to say that it just doesn’t work.

Continuing (and torturing) that analogy, if we did the disgusting work of precomputing all 2 number math problems for integers from -1,000,000 to 1,000,000 and I think you could say you had a (really shitty and slow) calculator, which “malfunctions” for numbers outside that range if you don’t specify the limitation ahead of time. Not crazy different from software which has issues with max_int or small buffers.

If it were the case that there had only been one case of a hallucination with LLMs, I think we could pretty safely call that a malfunction (and we wouldn’t be having this conversation). If it happens 0.000001% of the time, I think we could still call it a malfunction and that it performs better than a lot of software. 99.999% of the time, it’d be better to say that it just doesn’t work. I don’t think there is, or even needs to be, some unified understanding of where the line is between them.

Really my point is there are enough things to criticize about LLMs and people’s use of them, this seems like a really silly one to try and push.

We’re talking about the meaning of “malfunction” here, we don’t need to overthink it and construct a rigorous proof or anything. The creator of the thing can decide what the thing they’re creating is supposed to do. You can say

hey, it did X, was that supposed to happen?

no, it was not supposed to do that, that’s a malfunction.

We don’t need to go to

Actually you never sufficiently defined its function to cover all cases in an objective manner, so ACTUALLY it’s not a malfunction!

Whatever, it still wasn’t supposed to do that

The purpose of an LLM, at a fundamental level, is to approximate text it was trained on.

I’d argue that’s what an LLM is, not its purpose. Continuing the car analogy, that’s like saying a car’s purpose is to burn gasoline to spin its wheels. That’s what a car does, the purpose of my car is to get me from place to place. The purpose of my friend’s car is to look cool and go fast. The purpose of my uncle’s car is to carry lumber.

I think we more or less agree on the fundamentals and it’s just differences between whether they are referring to a malfunction in the system they are trying to create, in which an LLM is a key tool/component, or a malfunction in the LLM itself. At the end of the day, I think we can all agree that it did a thing they didn’t want it to do, and that an LLM by itself may not be the correct tool for the job.

Where I don’t think your argument fits is that it could be applied to things LLMs can currently do. If I have an insufficiently trained model which produces a word salad to every prompt, one could say “that’s not a malfunction, it’s still applying weights.”

The malfunction is in having a system that produces useful results. An LLM is just the means for achieving that result, and you could argue it’s the wrong tool for the job and that’s fine. If I put gasoline in my diesel car and the engine dies, I can still say the car is malfunctioning. It’s my fault, and the engine wasn’t ever supposed to have gas in it, but the car is now “failing to function in a normal or satisfactory manner,” the definition of malfunction.

It implies that, under the hood, the LLM is “malfunctioning”. It is not - it’s doing what it is supposed to do, to chain tokens through weighted probabilities.

I don’t really agree with that argument. By that logic, there’s really no such thing as a software bug, since the software is always doing what it’s supposed to be doing: giving predefined instructions to a processor that performs some action. It’s “supposed to” provide a useful response to prompts, anything other than is it not what it should be and could be fairly called a malfunction.

I’ve definitely gone to far with that, but I kinda of enjoy it. The amount of options there are particularly with being able to map a button to the mouse moving somewhere, clicking, and moving back, have made some games feel like they have native controller support when they don’t

To be clear, your stance is it’s such a small step in the right direction, you’d prefer no step at all? Keep it cis-only or invest time/money in extra character models?

Haven’t digital price tags been used for decades? I’m sure these will be more high tech, but I remember ones like this at least 20 years ago

I think that’s been a fair description of the AAS space for a long time, which is fine. If you want innovation, go indie, if you want big budget, go AAA

Yeah, I just did a quick test in Python to do a tcp connection to “0.0.0.0” and it made a loopback connection, instead of returning an error as I would have expected.

Minor aside, I really dislike when things use life expectancy for things like this instead of adult life expectancy. Child mortality drastically skews it so much it’s useless.

Looking completely realistic and being able to discern between real and fake are competing goals. If you can discern the difference, then it does not look completely realistic.

I think what they’re alluding to is generative adversarial networks https://en.m.wikipedia.org/wiki/Generative_adversarial_network where creating a better discriminator that can detect a good image from bad is how you get a better image.

Not necessarily. If your phone uses usb-c, and if you get a usb-c flash drive, you can make a bootable USB with your phone with the flasher app. The reviews are pretty mixed for it for whether or not it works, but could be worth a shot.

Awesome, that happened to me in KOTOR 2, will have to try it again

To help give love to some games I think are underrated, here’s a list of my favorite games with 4,000 reviews or less on steam under $25 ranked by my personal play time.

Neo scavenger $15

Post apocalyptic survival sim, that reminds me a tiny bit of Oregon Trail. There’s a good chance a scratch will kill you, and finding a plastic bag so you can carry more than what you hold in your two hands makes you feel OP. I’ve put 74 hours into this game, have died and restarted countless times, and have hardly gotten anywhere in it, but it’s exactly my kind of survival game

Fae tactics $20

Turn-based grid combat reminiscent of Final Fantasy Tactics, with just a splash of pokemon. The mechanics and setting I found really fun, although the difficulty can fluctuate a good bit at times.

Xenonauts $25

If OG XCOM went more crunchy than streamlined, it’d be Xenonauts instead of Firaxis’s Enemy Unknown. The combat gives you a ton of control during combat, specifying how much time they should spend aiming before shooting, specific hours of overwatch, crouching, etc.

Star Renegades $25 (currently $5)

Roguelike turn based party RPG. It doesn’t do a crazy amount that’s new or novel, but it executes very well, and lining up a good combo with your build feels amazing.

Rogue Book $25

Slay the Spire with some smart additions. Instead of one hero, you play two, which gives some extra possibilities to mix and match between runs. Instead of an overmap with a couple branching paths, there’s a hex overworld where you can use resources to reveal tiles.

Wildfire $15

Avatar the Last Airbender as a 2d stealth action game. The level layouts are great, and the ability upgrades strike a good balance between being impactful and not trivializing encounters.

Don’t Escape: 4 Days to survive $15

A classic point and click adventure, except using human logic instead of insane Game Logic. Reminds me of a bunch of similar games I played at the height of Newgrounds. It’s a tight, solid experience that doesn’t over stay its welcome.

Alina of the Arena $15

What if Slay the Spire had a hex grid system? I’ve seen other games ask this question, but Alina is the best I’ve played. There are some really clever design decisions they’ve made where certain builds very intuitively form some classic archetypes.

Shardpunk $14 (currently $10)

Roguelike XCOM themed as a crystalpunk version of Vermintide. Combat is solid, but the theme of running to the exit while shooting rats on the way with crystal powered machine guns sets it apart for me.

The Case of the Golden Idol $18

This one breaks my “4,000 or less” review rule by a little bit, so I’m putting it at the bottom, but it is one of my favorite games. I understand the love for Obra Dinn, but Golden Idol is better in my opinion. Each puzzle is a scene more or less frozen in time, which you can click on things for clues as what’s happening. What sets it apart is how you really do need to solve the mystery to progress; the game doesn’t walk you into it nor really lets you brute force it. Hands down the best mystery game I’ve ever played.

Really fun GDC talk by spiderweb games https://youtu.be/stxVBJem3Rs?si=mZdu6eyyWD4OEWGw

I think it highlights how perverse the stock market itself is. It doesn’t really seem like it functions much as a way for riskier ventures to raise capital outside of a bank, but a giant casino that gives the illusion of not being a zero sum game.

It’s hypothetically possible for a company to make more money in the stock market by investing in themselves than by creating anything (see Tesla). And if all companies could behave this way and somehow knew what the stock market would do for 5 years, I’d wager a TON of companies wouldn’t meet it, invest in the stock market, drive up the “value,” more don’t meet it, etc. etc. until no one is making anything, and everyone is happy with their paper fortunes and try to sell.

In my experience, it has not generated results in real time. I’ve either gotten the exact same response, or a prompt asking “would you like to generate an AI response to your search?”

So it seems like, and would make sense, that in a given time period they only generate a response once per given search, and reuse that response in the future, since that’s far more efficient

https://youtu.be/uichEjBNqlg?si=EJucAkjquds16Y0s

I still don’t know it. I don’t have a huge amount of confidence in “a prominent figure in the Counter-Strike community” as a source for Valve’s internal finances.