{"id":8580,"date":"2023-12-21T17:36:15","date_gmt":"2023-12-21T17:36:15","guid":{"rendered":"https:\/\/dailyai.com\/?p=8580"},"modified":"2023-12-22T13:11:53","modified_gmt":"2023-12-22T13:11:53","slug":"stanford-researchers-identify-illicit-child-imagery-in-the-laion-dataset","status":"publish","type":"post","link":"https:\/\/dailyai.com\/da\/2023\/12\/stanford-researchers-identify-illicit-child-imagery-in-the-laion-dataset\/","title":{"rendered":"Stanford-forskere identificerer ulovlige b\u00f8rnebilleder i LAION-datas\u00e6ttet"},"content":{"rendered":"

A study conducted by the Stanford Internet Observatory identified more than 3,200 images of suspected child sexual abuse in the LAION database, a large-scale index of online images and captions used to train AI image generators like Stable Diffusion.\u00a0<\/strong><\/p>\n

In collaboration with the Canadian Centre for Child Protection and other anti-abuse organizations, the Stanford team reviewed the database and reported their findings to law enforcement. LAION contains billions of images obtained through unguided web-scraping.\u00a0<\/span><\/p>\n

Over 1,000 of these images were subsequently confirmed as child sexual abuse material. The information was published in a paper, \u201c<\/span>Identifying and Eliminating CSAM in Generative ML Training Data and Models<\/span><\/a>.\u201d<\/span><\/p>\n

The researchers stated, “We find that having possession of a LAION\u20105B dataset populated even in late 2023 implies the possession of thousands of illegal images,\u201d underscoring the nature of internet-scraped datasets and their completely unverified and unchecked content.\u00a0<\/span><\/p>\n

AI image generators have been implicated in a number of child sex abuse and pornography cases. A North Carolina man was recently <\/span>imprisoned for 40 years<\/span><\/a> after being found in possession of AI-generated child abuse imagery, providing perhaps the first example in the world of someone being tried for such a crime.\u00a0<\/span><\/p>\n

LAION, an abbreviation for Large-scale Artificial Intelligence Open Network, promptly removed its datasets from public access.<\/span><\/p>\n

LAION then issued a statement emphasizing its zero-tolerance policy for illegal content and its commitment to ensuring the safety of its datasets before republishing them.<\/span><\/p>\n

Since this data was used to train popular models, they\u2019ll be able to \u2018use\u2019 it to generate entirely new content, which is already happening. An investigation found that people are creating these types of images and <\/span>selling them on sites like Patreon<\/span><\/a>.\u00a0<\/span><\/p>\n

Researchers noted that AI tools are also likely synthesizing criminal content by merging images from separate categories of online images \u2013 adult pornography and benign photos of children.<\/span><\/p>\n

David Thiel, the chief technologist at the Stanford Internet Observatory and the report’s author, stressed how these issues arise, pointing to the rushed deployment of many AI projects in the competitive tech landscape. <\/span><\/p>\n

He stated in an interview, \u201cTaking an entire internet-wide scrape and making that dataset to train models is something that should have been confined to a research operation, if anything, and is not something that should have been open-sourced without a lot more rigorous attention.\u201d<\/span><\/p>\n

The Stanford Internet Observatory has urged those building training sets based on LAION\u20105B to either delete them or collaborate with intermediaries to cleanse the material. It also recommends making older versions of Stable Diffusion, particularly those known for generating explicit imagery, less accessible online.<\/span><\/p>\n

Stability AI<\/a> stated that they only host filtered versions of Stable Diffusion and have taken proactive steps to mitigate risks of misuse.\u00a0<\/span><\/p>\n

Lloyd Richardson, the IT director at the Canadian Centre for Child Protection, commented on the irreversible nature of the problem, saying, \u201cWe can\u2019t take that back. That model is in the hands of many people on their local machines.\u201d<\/span><\/p>\n

Past research in LAION<\/span><\/h2>\n

Stanford’s study is not the first to launch investigations into databases like LAION.<\/p>\n

In 2021, computer science researchers Abeba Birhane, Vinay Uday Prabhu, and Emmanuel Kahembwe published<\/a> “Multimodal datasets: misogyny, pornography, and malignant stereotypes,” which analyzed the LAION-400M image dataset.<\/p>\n

Their paper states, “We found that the dataset contains troublesome and explicit images and text pairs of rape, pornography, malign stereotypes, racist and ethnic slurs, and other extremely problematic content.”<\/p>\n

This study also found that the labels used for images often mirrored or represented conscious and unconscious bias, which, in turn, inflicts bias onto the AI models that data is used to train.<\/p>\n

Numerous past research<\/a> has examined the link between biased datasets and biased model outputs, with impacts including sexist or gender-biased models rating women’s skills as lower value than men’s, discriminatory and inaccurate facial recognition systems, and even failures in medical AI systems designed to examine potentially cancerous skin lesions in those with darker skin.<\/p>\n

So, in addition to abusive child-related material facilitating illicit uses of AI models, issues in datasets manifest themselves throughout the machine learning lifecycle to sometimes eventually threaten people’s freedom, social standing, and health.<\/p>\n

Reacting to the Stanford study on X, a co-author of the above paper and others examining LAION and the related impacts of underlying data on model outputs, Abeba Birhane pointed out that Stanford hadn’t sufficiently discussed past research on this topic.<\/p>\n

\n

me & my collaborators have done the most extensive research of the LAION datasets (3 academic papers & the first to investigate dataset in 2021 showing misogyny, pornography, & malignant stereotypes)<\/p>\n

yet, the Stanford study has not cited us once. this is academic misconduct https:\/\/t.co\/pzhL8b3wBt<\/a><\/p>\n

\u2014 Abeba Birhane (@Abebab) December 21, 2023<\/a><\/p><\/blockquote>\n