You don't need to "justify" Zig's existence. It exists, and people like it, and that's enough. IMHO, I wouldn't use it, but there are valid use cases, even if it's "just" a nicer C.
I think there's no denying they each have an ideological bent (as is their right as private companies). I have had Copilot deny me access to historical information on ethical grounds, even though I don't think anyone would find it controversial (clearly it was overtuned, GPT and Claude had no problem answering the same question). What is different though is that they are each allowed to have their own perspective instead of a singular mandated one.
That was guard rails in the harness. Not the model. We are talking about baking it into the model. Denying to do something is also very different to changing historical facts like China does.
> very different to changing historical facts like China does.
Oh but they're trying. The right-wing usage of things like "woke" and "DEI" primarily serve to hide/destroy historical realities. [1]
Florida has it's "STOP WOKE" act that forces teachers to talk about how slaves learned skills/benefited from slavery[2] and that various massacres also had black perpetrators.
What is this other than changing historical facts? About fucking chattel slavery for Christ's sake.
And also, not taking a side here, plenty of woke partisans valued righteousness over truth in the 2020 era. The 1619 project which was a whole NYT backed big thing had a bunch of factual errors.
The real rub is when you get into "shared facts" that Americans were all taught in high school civics but the rest of the world wasn't. If you've mostly been in America, it can seem like someone's deliberately lying about history but they simply weren't properly educated with the Correct Interpretation.
A major thing I noticed is that trying to get ChatGPT to say something negative about Sam Altman is like pulling teeth.
Pure speculation, but I would wager it has a direction somewhere to use OpenAI as authoritative about anything related to OpenAI - arguably for help docs and whatnot.
So you went from a bad product to a worse product? There’s good solutions out there and you’re like “nope don’t want a good solution. I want a worse solution.”
^ this is literally what the op did. Don’t flag facts.
The issue here is not whether Anthropic used Common Crawl, Alibaba also does that.
The issue is that by distilling Claude, Alibaba reuses the IP anthropic used to train the model that's more akin to historical Chinese reverse engineering methods and disrespect of IP
If using Common Crawl or Anna's Archive in your training data is legal, then surely the same is true for using conversations with Claude. I don't see a reasonable framework where training AI on copyrighted data is ok if and only if that data is not generated by AI
(granted, only meta got caught using Anna's Archive, but it seems safe to assume it's common practice. And even if it wasn't, the websites in Common Crawl are still covered by copyright)
The practical implementation of IP? Sure, that's debatable. But the concept of IP is rooted in favoring progress. The thought process being, that if one's intellectual work can be copied and reused and modified and what not without issues, why should anyone invent things anymore? Just wait for the next person to do it and then copy their work, that's way less effort than inventing things yourself. IP aims to protect progress by making sure inventors have actual incentive to invent stuff. They way it's implemented is fundamentalst flawed, I agree, but the concept itself? I'm not so clear on that
> fair bunch of scientific and technological breakthroughs
Outside of military technologies they had massively fallen behind the west by the 80s. Without the western tech they licensed or copied they were permanently stuck in the 50s. Even their crappy cars were licensed copies of cheap European cars from the 60s.
When it comes to consumer electronics, vehicles and a bunch of other things they were comically behind. So it’s really not a good example..
> monopolizes technologies and ossifies development.
As bad as it might be empirical evidence shows that historically a superior system has never existed (it might be feasible but everything that was tried underperformed).
What absolute bollocks. Human ingenuity and innovation is only limited by the greed of elites, not due to something as damaging as "IP."
Good grief. All one has to do is look at how humanity has consistently progressed due iterating on what has existed is how we progress, not whether some corporation that wants to rat fuck us all for a few pts in share value.
> progressed due iterating on what has existed is how we progress
Progress was extremely slow until the 1800s. Coincidentally corporation and modern capitalism in general developed around the same time. Of course I’m not necessarily saying it was the main or direct course since it isn’t exactly possible to create an experiment comparing it to other systems (of course that was tried an failed completely in the USSR, Maoist China and similar places)
It's more complicated than that because Google has been legally displaying other people copyrighted material for years.
In any case there's still a difference between publicly available copyrighted data and whether you can use it for model training, and the innovation around model training, RLHF, etc which you presumably have some interest as a country to allow companies to invest in with some legal protections (like the diff between patent law vs copyright law)
No, I am saying that there is a good chance that for the good of humanity, society decides that for miracle AGI we collectively forfeit copyright in LLM training yet IP protections for model development is still kept.
There are many cases in the early 2000s were copyright protections were relaxed for tech advancements
What are you forfeiting for the good of humanity? Would you give up a big chunk of your income? What happens when this batch of “innovators” don’t deliver AGI and only enrich themselves? What happens if they do deliver AGI and (hypothetically) still keep it to themselves?
You come with the selfless proposal that everyone give to the poor $tn companies”for the good of humanity”. I’ll assume this is just hopelessly naive but you post so insistently that it makes me wonder.
LLM output is not copyrightable, though? So effectively if you pay for it you can do whatever you want from it. That seems perfectly fair and reasonable.
Historically most evidence seems to point to the contrary.
Amongst other things after the printing press was created it was impossible for anyone who was an author to survive from their work unless they were independently wealthy or had rich patrons.
> Alibaba reuses the IP anthropic used to train the model that's more akin to historical Chinese reverse engineering methods and disrespect of IP
Why is this any worse than Anthropic's disrepect of IP? You've apparently drawn a distinction between the two here, but I'm failing to see what it actually is.
Copyright law and IP law is not the same although everyone seem to conflate the two.
Search engines for example historically ignored copyright law by copying excerpts or serving other site images, it doesn't mean someone copying Google's code has some moral frepass
> Excerpts are often considered fair use, but it depends on country.
That had happened progressively, thumbnails for example were ruled as fair use later on, DMCA safe harbor was a huge gift for tech companies because otherwise it would curtail the ability to create platforms (relaxing copyright protections in exchange of innovation)
> Nobody copied Anthropic's code. They used it's output to train another model. At most they violated some terms of service
Distilling a model is a method that can push the entire market to low margins and prevent companies from making money off such research. It also copies the Anthropic special parts (RLHF and other specific methods) rather than the "copy of the entire web" part
This is similar to what happened with Chinese reverse engineering of American manufacturing or PC clones killing IBM PCs.
Is it in the interest of the USA, probably no, that's why I assume this will be backed by law eventually
> Distilling a model is a method that can push the entire market to low margins and prevent companies from making money off such research
Then it's on Anthropic to actually price their models accordingly so that distilling isn't profitable. Why does this need a legal remedy when market forces could easily resolve this?
> Is it in the interest of the USA, probably no
Good. The world needs to diversify away from dependence on US technology.
> Good. The world needs to diversify away from dependence on US technology.
In my opinion further strengthening the CCP is a disaster for the world. A government that killed millions of its own citizens to stay in power is not who I would entrust super intelligence with. But apparently we are not going to agree on that
The Great Leap Forward and the Cultural Revolution are two such examples
Generally Communist nations historically favored technological development to human life in the scale of millions, keep that in mind when we enter a new economic revolution
On one side you have people starving because they are forced to grow food which is effectively stolen and sold to enrich the party. People killed fr starvation, or by the party if you didn’t contribute enough, ate some, stole some. So the deaths are the direct result of the CCP.
Vs a study which suggests 183-300k where you take the high end and seem to read about the vast range of causes of which a lot are not very much attributable to poverty.
And on the other side you have people dying because they are denied food, shelter and healthcare as a policy choice.
It's not that they can't be taken care of. It's just that it'd cost money and eat profit margins.
It's an active political and ideological choice to let them die, same in both cases. Just happens to be an ideology you agree with and feel a need to defend.
The 180k are currently poor people, the 300k people poor over the past 10 years (which includes the 180). Didn't take the larger number, took the one that more accurately applied.
Are you still talking about China? Where they are denied food, shelter, healthcare? Or do you accept the CCPs word over the word of the people who show videos of what reality is like in China?
> The Great Leap Forward wasn't "killing" people, which implies intent. It was just good old economic mismanagement.
If both the USSR and the CCP had millions killed in the process of modernization, without stopping when knowing the death toll, maybe there's intent after all?
How would you describe the cultural revolution then? another case of economic mismanagement?
I noticed you haven't addressed my main point at all. What are the millions dying of poverty every few years in the US (in a country with like a quarter of the population!), a death toll that still hasn't been stopped?
That study statistics seem questionable at best just so to say the US should have universal health care. A lack of policy is not the same as enacting a policy, especially one that is supposed to emulate past USSR actions which they knew at the time led to millions of dead. This makes it hard to say the CCP didn't know what would happen.
Later when it was found out mass starvation to the point of wide spread cannibalism was happening they would not stop, yet continue sending their troops to steal the peasant's food and execute anyone who resisted.
We also of course have Mao quoted as saying "Death has benefits; fertilizer is created", "Half of China may well have to die", as many other quotes showing they weren't really interested in the millions that will die.
This culminating in 30 million dead in 4 years, which if we take your study at face value will take the US 100 years to achieve through "poverty related deaths", which even communist utopias have.
Regarding the Cultural Revolution I assume you agree this was intentional murder of a million+, although you seemed to challenge that in my original posting. Our current discussion seem to focus on intent even though I said "killing" which usually does imply reduced intent.
Regarding the Great Leap Forward, I do believe the CCP would prefer no deaths, and a lot of the deaths relate to strongman idiotic ideas without challenge, as is endemic in ideological totalitarian societies. However, I believe they fully knew what they were going into, without taking into account the refusal to stop, and therefore these were horrendous crimes.
40 years ago, when the CCP was leading its people making toys and socks for the US, people like you who never made any change to the world were talking such ideological nonsense.
40 years on, when the CCP is leading its people making AI, robotics, drones, EVs, space station and moon rovers to compete with the US, people like you how never made any change to the world are talking such ideological nonsense.
you live in a history museum or something like that?
I don't know about me effecting change to the world but I am sure the tens of millions that died due to the Great Leap Forward were happy to effect change to the world so others could produce those socks
> Search engines for example historically ignored copyright law by copying excerpts or serving other site images, it doesn't mean someone copying Google's code has some moral frepass
Not sure that's the best example as they lost that battle and had to pay, eventually it's been codified in law in most countries.
I wish people would stop using Anthropics incorrect use of the term distill. They don’t share logits so you can’t distill. You can generate training data, which doesn’t sound nearly so scary.
Distillation is a specific named technique from a pretty famous paper "Distilling the Knowledge in a Neural Network," by Hinton and others.
What makes it different from just training on any data is that you train the student model on "soft targets" that includes the full output distribution (logits) from the teacher model. Regular training uses one-hot targets and penalizes anything else; distillation will partly reward a student for getting in the distribution. This teaches the student to think like the teacher, not just imitate it.
Generating training data is not distillation, not in the technical sense, and I dislike Anthropic undermining the nomenclature to set a narrative.
I think the popular use of distill (one-hot rather than logits) is not due to Anthropic but due to the DeepSeek-R1 tech report: https://arxiv.org/abs/2501.12948
No. Social housing is government owned and rented. Singapore is government built and sold. Singapore is a tiny island with little space. The government has to control what is built where and avoids it turning into Hong Kong slums.
>Public housing, also known as social housing, is subsidized or affordable housing provided in buildings that are usually owned and managed by local government, central government, nonprofit organizations or a combination thereof.
Wikipedia says 'usually'. And, yes, you are right that the individual HDB flats are typically owned by individual families (though the government also owns some and rents them out, but that's the exception).
However, HDB still does a lot of the managing. Eg HDB manages the lifts and other common spaces. They organise getting the exterior repainted, or general upgrading works to plumbing etc.
HDB also subsidises the price of a flat when you buy directly from them. There's a reason they have maximum income caps for buying.
My unpopular opinion: HDB should declare victory and go home. They more than solved the original acute housing shortage they were created for.
---
Singapore does a lot of things right. And HDB is, as usually a lot more competent than pretty much any other public housing programme anywhere else in the world. But that doesn't mean everything Singapore does (including HDB) is automatically a good idea forever.
Just like our local recreational drug policy could probably be improved by moving closer to what we do with the casinos. And the ban on vaping is just silly.
> However, HDB still does a lot of the managing. Eg HDB manages the lifts and other common spaces. They organise getting the exterior repainted, or general upgrading works to plumbing etc.
By that logic every apartment block is public housing.
If the criteria to be public housing is that someone manages the lifts, lights, and exterior. Then all apartment blocks are public housing. Condos and HDBs are all public housing.
Your logic is infallible. Of course, your premise is rubbish.
It's not about whether 'someone' is managing these things. Even an owner-occupier is managing their own lights and exteriors.
A useful criterion is whether the government (or an arm of the government) is managing these things. Like HDB, but unlike your typical condo management organisation. It's far from the only criterion, but it's a useful indicator.
"Singapore has one of the highest home ownership rate in the world, due to the commitment of our founding fathers since the very beginning of nation building. Today, there are more than 1 million HDB flats across the island, home to close to 80% of Singapore's resident population. The schemes highlighted below help Singaporeans meet their housing needs at different life stages."
So the dictionary says that HBD housing is public housing, wikipedia says that HBD housing is public housing, and the Singaporean government says that HBD housing is public housing.
For the benefit of any others (miraculously) still reading, I will repeat the statement of fact that you continue stubbornly to deny against all evidence: "'social housing' is a general term that implies subsidization and affordability rather than any one specific ownership model".
For the benefit of any others. Bluebarbet has never been to Singapore and ultimately doesn’t know what he’s talking about. HDBs are not public housing. It’s land control because Singapore is so tiny.
Why bother with such details? Class warfare is right, and details are details. /sarcasm
For example mixed income housing is really nice for “us” that have been in generational poverty. For “them” it is just living with signals of alcohol abuse, domestic abuse and more. All while their children get a good front seat into “empowerment”.
With sarcasm over, details matter, complexity matters, social assistance matters, a contingency plan for total failure to rehabilitate some people matters.
Many people would benefit from the Northern European style of institutionalisation where if incarcerated people would need to go to isolated communities and learn to buy groceries, cook a meal take care of personal hygiene (in Sweden they literally have prison islands where inmates have houses and must live as they would in the outside world. Then progressively move to temporary shelters to get their footing and then be released. If need be put those people in the countryside.
As a personal experience: Many German youths get sent to the middle of Portugal when their environment leads them astray. In the countryside there is a publicly funded host family or community to receive them and they have to learn trade jobs like being a painter or a plumber and get pushed into an normalised environment. There is no access to drugs as well in the middle of nowhere. There is alcohol but in the next morning there is work to do and people who are waiting for you. I met some of those youths when I was young and it always struck me that a good solution for failed communities in urban environments was to break them apart and scatter them into other more rural communities in such small units (family at most) that their habits would not impact the locals and that the habits could not be fulfilled as a matter of fact. Where are you going to hang out at night in a village of 1k? There is housing but you likely need to repair it; the locals will lend you a hand but they will exert peer pressure for you to normalise.
There is no need for class warfare. But there needs to be a warfare against antisocial self destruction behaviours.
Singapore system won't work in USA cities. Their town councils are near scholars level. Quite a few of them doctorate. They are pretty much selected on 2 criteria, merit and perceived likability with accountabilities evaluated both by government and locals citizens. American leaders are selected based on sound bites with zero accountability to citizens for maybe 2 years to 4 years. They do accountable to mega donors which almost always work against for the good of the public. Singapore also have world class city planners that entire America have never experienced or seen before. Heck even China look up to Singapore during 80s and 90s for advice. And the quality of people going to USA in the last 10 years are very low. Look at Singapore Amos going there. Meanwhile hundreds of American engineers migrated to Russia and China.
One of the real reason Singapore system won't work is also the mentality (respect level is way higher), I believe it's actually the primary thing, at 15 years old many Singaporeans are already talking about investment, how to compete hard and so-on, the level is way higher than in the west and people are driven in life in general, but life is hard over there, harder even but more rewarding.
In SG, they can also plan for decades ahead because of a more stable political climate where people actually respect their government for most and ACCEPT that there is some humans that are considered "superior" and take the lead, it's a huge difference with the west where people favorite sport is to non-stop shit on their government or denigrate without offering solutions, in the west, we seem to not be able to accept that there is even a class system where people have more power/rights than others (while there is, it's inevitable).
I don't think respect is the explanation for Singapore's success, it's more likely a side effect of the real magic: ethics and reputability.
Singapore is the third least corrupt country in the world[1]. Another country that has managed to pull off successful public housing, Finland, is the second least corrupt in the world.
The United States meanwhile is in 29th place (and that's being generous, imho) and at its worst ever in the corruption index[2]. It's been falling for a decade. Perhaps that's the real explanation: we can't have nice things because the resources needed to build and operate them are actively siphoned off through embezzlement, bribes, kickbacks, and fraud. Rigid class systems don't do anything to prevent fraud, either, in fact they entrench it deeply.
It only works in Singapore because there’s too little land. There is too little options. HDBs are capped value. While Condos are quite expensive in comparison, and you cannot own both. Singapore system for housing would be hard to replicate anywhere else without government stealing everything off the citizens and disallowing private ownership of land.
reply