cross-posted from: https://sh.itjust.works/post/69997989
These companies should be criminally liable for training their models on child porn.
cross-posted from: https://sh.itjust.works/post/69997989
These companies should be criminally liable for training their models on child porn.
Honestly that’s a really good point. Where the fuck did the training data come from? If AI can only make what its trained on. I hadn’t really thought about that in relation to this. How isn’t that a bigger talking point?
On the one hand, diffusion models can merge concepts together pretty well (think of those bird-cat chimeras).
On the other hand, yes, there’s CSAM in training data. A while ago researchers scanned and validated thousands of CSAM images in the training data of just one dataset. This one in particular the backbone of the popular Stable Diffusion.
Lowkey feel like that’s Epstien files levels of controversy waiting to happen. Like how do you “accidentally” do that?
They probably wanted some ai generated CSAM for themselves too. I honestly wouldn’t be surprised.
I mean its either gross negligence or active criminality. If PornHub had CSAM on it and just failed to take it down they’d get into serious trouble. An AI company including it in their data sets and then letting their models be used to make more of it is arguably much more blatant than that. Data sets don’t just appear out of thin air. Someone has to make them. We know for a fact they curate them too.
If the AI knows what a naked adult looks like and knows what clothed child looks like, I don’t see why it couldn’t mash that up. I’d also assume it could train on medical reports as well.
I’m also quite certain the model reached into plenty of dark areas of the internet and picked up CSAM.