nonsense is not owed a response.

And yet, here you are responding

if the car manufacturer tells you you don't have to think while driving anymore then yeah...

i am anti cars.

You want to drive a 2 ton vehicle on roads i pay for, don't speed.

I'm anti-cyclist. I believe we should make the roads more hazardous to cyclists.

OpenAI and Claude don't accept commits and host PRs? How are they the same?

They're getting increasing demand for tokens at an accelerating pace.

Is that the same as storing state in a DB and on a filesystem though?

Like, I get there are other features they have, and things like history, but I don't think it's quite the same.

Isn't most (not all) of the LLM's resources stateless compute to a large degree?

(Not defending MS at all though, I currently can't create a PR on the required branch for my work (won't load the branch list) and their availability is really bad recently).

> Is that the same as storing state in a DB and on a filesystem though?

Google “RLHF”.

Didn’t knew they did that.

How else?

Fundamentally, there's incoming requests, an application server, and a database. The devil is in the nature of those requests, and how do you process those requests and stick them in the database. And then serve them back out again. Different application, different database, but fundamentally, it's the same problem. Google managed to do this very well. Microsoft has not.

They're undergoing the same kind of load. Almost every AI commit that's putting pressure on GitHub's servers was written on OpenAI and Anthropic's servers.

Scaling ChatGPT and scaling GitHub are very different problems.

For LLMs, prompt handling is effectively stateless. They do try to route follow-up prompts to the same cluster to benefit from prompt caching, but those can be effectively sharded. They also need to write results to storage but that's on a per-customer basis, so also easy to shard.

GitHub is a shared space, where commits and issues and PRs need to become instantly available to all readers across all geographies. They have a very different shape of scaling challenge to the LLM vendors.

> GitHub is a shared space, where commits and issues and PRs need to become instantly available to all readers across all geographies. They have a very different shape of scaling challenge to the LLM vendors.

Github data is accessible by all (if open source), but they should be partition-able by individual repository (and their related forks.). Thus while there is more shared state across users, it isn't fully shared state.

And they have been working on this semi-shared state design for over 10 years now.

Every response from GitHub must be deterministic. OpenAI and Anthropic do not have this problem.

OpenAI, Anthropic, OpenRouter, Gemeni, etc also have another escape hatch: they can arbitrarily and potentially invisibly reduce your quality of service at their discretion. They can choose to route your request to an expensive model or a cheap one. By contrast, the best Github can do is slow your request down.

And they never even have to admit they do it.

Yes, but come on...

That's due to the need for ultra-fast memory and inference compute, it's not the same thing.

Take control of medicine away from private interests.

OK maybe but that's a completely different thing unrelated to the point of the article or comment.

And give it to who, governments? The ones that can't even get universal healthcare right anywhere it's been implemented?

That’s…the exact opposite of what the data says?

Americans pay more taxes for healthcare than Europeans do. And it doesn't even give them healthcare, so then they have to pay again to buy their healthcare. And then when they get to the hospital they find it's out of network so they have to pay a third time.

better than it connecting to one you don't own.

Or just keep it turned off entirely? Every "smart" device I have has the option to disable WiFi/bluetooth entirely so it doesn't even show up.

if you're learning code challenges you should probably learn how to run code locally.

they think art is a niche hobby and not the basis of human culture. I wouldn't listen too intently to them.

Art is perennial and omnipresent in human societies, but the sort of art that operates through a language foreign to the aficionado’s own, and learning that language would be beneficial to appreciation of it, is obviously going to be a niche subset of art.

basic puns and rhyming are niche forms of art?

If anything comedy is an excellent way of learning a language: the use of double and triple entendres helps to quickly get exposed to alternate meanings and misunderstandings of words. Comedy aimed at learners or multilinguals can also help, plenty of anglos who learned Spanish can relate to "feeling pregnant" early on :)

Puns and rhyming can generally be translated across languages. I don't think its controversial to say that its possible to get most of what a piece of art is trying to say through a translation.

Puns generally do not translate well.

Where they do, there needs to be a coincidence where words with multiple definitions happen to have the same meanings in both languages, or there happens to be a similar saying in the target language. Often this is not the case. Translators often just make up entirely new material to substitute in for that.

why do people trust the AI overview over the Im feeling lucky button?

this is an amazing youtube video idea if you could get a type writer to do it.

Maybe I'm misremembering, but I'm sure there was something on HN a few weeks ago about an electric typewriter that someone had connected to (I'm guessing) a Raspberry Pi? My search-fu is currently failing to find anything particularly recently, at the moment.