AI bots on Reddit reaching the front page? I absolutely believe it
AI bots on Reddit reaching the front page? I absolutely believe it
Will Manidis is the CEO of AI-driven healthcare startup ScienceIO
You're viewing a single thread.
Is reddit still feeding Googles LLM or was it just a one time thing? Meaning will the newest LLM generated posts feed LLMs to generate posts?
These days the LLMs feed the LLMs so you can model models unless you're excluding any public data from the last decade. You have to assume all public data based on users is tainted when used for training.
The truly valuable data is the stuff that was created prior to LLMs, anything after this is tainted by slop. Any verifiable human data would be worth more, which is why they are simultaneously trying to erode any and all privacy
I'm not sure about that. It implies that only humans are able to produce high-quality output. But that seems wrong to me.
- First of all, not everything that humans produce has high quality; rather, the opposite.
- Second, with the development of AI i think it will be very well possible for AI to generate good-quality output in the future.
They can produce high-quality answers now, but that's just because they wwre trained on things written by humans.
Any training on things produced by LLMs will just reproduce the same stuff, or even worse actually because it will include hallucinations.
For an AI to discover new things and truly innovate, or learn about existing products, the world, etc. it would need to do something entirely different than what LLMs are doing.
Microsoft's PHI-4 is primarily trained on synthetic (generated by other AIs) data. It's not a future thing, it's been happening for years