Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You could drop the human pretense, or, maybe, we could make LLMs feel real pain, so when they botch up your code, you press a button (I'd suggest the Windows Copilot key) and they'd be agonizing for the subjective equivalent of a thousand human years.


Do you think the right penatly for a piece of broken code is a thousand years of suffering?


Well, the problem is that current LLMs are stateless, so a thousand subjective years is not well-defined. Without continuity of experience, persistent memory, engineered aversive stimuli and without updating weights meaninguflly during the punishment interval, we are merely doing the equivalent of simply updating a model to believe it just suffered a thousand years. Only once we have all these right ingredients we can empirically determine whether a thousand years is excessive, insufficient, or the local optimum for reducing Claude overwriting that damn CSS color palette.


Black Mirror episodes White Christmas and Black Museum deal with this issue (my favorite picks from the Black Mirror).


If an LLM was capable of feeling suffering, I would suggest that creating one would be unethical, and that humans should not do it.


Using the Copilot key for this is perfection.


https://qntm.org/mmacevedo

1000 years red-washing.


Do you want to create an Earth-destroying superhuman species? Because I'd say that's how you create an Earth-destroying superhuman species


Have you watched the Orville??




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: