> Making an LLM from raw data is value-add. > Distillation is just value extract... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

scotty79 14 days ago | parent | context | favorite | on: Who's afraid of Chinese models?

> Making an LLM from raw data is value-add. > Distillation is just value extract.

There is a value-add in selecting the valuable parts out of the garbage. And let's face it. Largest models contain a lot of garbage.

bluegatty 14 days ago [–]

I think that's kind of fair, but it still fits within the context of 'some things are value add' and 'more or less than others'.

We ought to identify that and integrate that into our thinking.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact