Wow, it’s amazing that just 3.3% of the training set coming from the same model can already start to mess it up.
Wow, it’s amazing that just 3.3% of the training set coming from the same model can already start to mess it up.
I’ve read some snippets of AI written books and it really does feel like my brain is short circuiting
At least in this case, we can be pretty confident that there’s no higher function going on. It’s true that AI models are a bit of a black box that can’t really be examined to understand why exactly they produce the results they do, but they are still just a finite amount of data. The black box doesn’t “think” any more than a river decides its course, though the eventual state of both is hard to predict or control. In the case of model collapse, we know exactly what’s going on: the AI is repeating and amplifying the little mistakes it’s made with each new generation. There’s no mystery about that part, it’s just that we lack the ability to directly tune those mistakes out of the model.
Paradox seemed like the ones to do it, what with publishing Cities Skylines, but unfortunately their life sim was canceled.
Paralives is still going strong in development, though, with a pretty constant stream of updates. Really hoping that one sees the light of day. They’ve already got a pretty impressive building system working, but they’ve got some big ambitions, particularly when it comes to adaptive interactions with character heights.
We’re committed to not only our existing slate of games but also expanding our presence in the interactive space as we continue to look for opportunities to take a more integrated approach to linear and interactive storytelling across film and TV, gaming, and theatre.
Annapurna’s no slouch when it comes to TV/Film publishing, but if I had to speculate, I’d say there was probably some friction between the film and game sides of things as far as goals and culture go. It’s possible that the film side management was being a little too controlling of Interactive with all the Alan Wake and Control IP plans, leading to the request to split.
Annapurna Interactive has published some real bangers, especially when it comes to truly small team indie devs. If they do reform as a new company, hopefully they can pick up that legacy and bring more stuff to market.
Anyway, that’s all to say… go play Outer Wilds.
Thank you!!
Being a Python simp, I find GDscript just different enough to nag. There’s a lot of QoL stuff they don’t have and aren’t (currently) looking to add in order to keep the language simple. Honestly has me looking to use C# instead.
Being a Python simp, I find GDscript just different enough to nag. There’s a lot of QoL stuff they don’t have and aren’t (currently) looking to add in order to keep the language simple. Honestly has me looking to use C# instead.
Honestly C# has grown on me quite a bit. Shakes off some of the bloat of Java and linq is pretty handy. God knows if I can’t tell you what the distinction is between C# and .NET Core and whatever the hell ASP is.
I mean, we’ve seen already that AI companies are forced to be reactive when people exploit loopholes in their models or some unexpected behavior occurs. Not that they aren’t smart people, but these things are very hard to predict, and hard to fix once they go wrong.
Also, what do you mean by synthetic data? If it’s made by AI, that’s how collapse happens.
The problem with curated data is that you have to, well, curate it, and that’s hard to do at scale. No longer do we have a few decades’ worth of unpoisoned data to work with; the only way to guarantee training data isn’t from its own model is to make it yourself