Home Are AI generators training on real people’s images? Legal experts say it may be a problem

Are AI generators training on real people’s images? Legal experts say it may be a problem

TLDR

  • AI image generators, like Grok and Ideogram, are creating hyper-realistic depictions of public figures.
  • Legal experts warn these tools risk copyright, defamation, and misinformation issues.
  • Platforms face scrutiny as lawsuits and regulations focus on AI-generated content misuse.

If you’re like any other AI aficionado, you’ve probably been testing all the latest image generators on the market. You may have noticed a perceptible change over the past few months, particularly in how hyper-realistic these images have become—almost eerily so. While major tech firms like OpenAI, Meta, and Microsoft face multiple lawsuits over the use of written content, including cases brought by authors and organizations like The New York Times, less attention has been given to the use of images of actual people.

AI image generators are artificial intelligence tools that can whip up images in seconds based on just a few words. But while they’re great at producing high-definition visuals, they’re also raising big concerns for public figures, whose resemblances are being used in ways they might not have agreed to.

At ReadWrite, we’ve certainly noticed that several AI image generators now produce almost lifelike depictions of celebrities and well-known figures. From politicians like Donald Trump and British Prime Minister Keir Starmer to stars such as Taylor Swift, it’s often not clear how some of these models have been trained.

DALL-E message: "I'm sorry, but I couldn't generate the image you requested because it involves public figures, and generating such images must comply with our content policy. If you'd like, I can help create a similar concept using generic characters instead. Let me know how you'd like to proceed!"
DALL-E refuses to produce images of well-known people. Credit: OpenAI / ReadWrite

For those who have used OpenAI’s DALL-E and attempted to spawn images of popular figures, you may encounter a message like: “I can’t create an image of [insert person here] or any public figure that directly resembles them. However, I can create a generic representation of someone with similar characteristics.” It also states that “generating depictions of public figures is restricted.” So why are some AI image generators coming up with accurate likenesses of people?

Public figures and ‘copyright-sensitive’ AI images on Grok

We came across this while using Elon Musk’s Grok AI platform, which recently became available to non-premium users. When we asked it to construct images of the billionaire himself, along with OpenAI CEO Sam Altman, it somewhat created an uncanny valley effect.

AI image of OpenAI CEO Sam Altman and X CEO Elon Musk in a boxing ring
Grok shows its ability to create hyper-realistic images. Credit: Grok / ReadWrite

That’s not to say they use actual images to train their AI models. ReadWrite reached out to them and has yet to hear back, so we can’t confirm that ourselves. But it makes users question how it’s able to produce such realistic pictures.

‘Very few safeguards’

Technology-focused law firm, Munck Wilson Mandala based in the US, has also raised this issue. In a blog post published in August, attorney Charles-Theodore Zerner wrote that the image generator appeared to have “very few safeguards.” Consequently, he warned that the platform was able to create deepfakes, copyrighted characters, and potentially offensive content.

Zerner points out significant concerns regarding Grok 2, stating, “Musk presents this as a win for free speech, but it’s raising alarm bells for legal experts.” Unlike other AI tools, Grok 2 lacks “robust content moderation and copyright protections,” allowing users to make high-quality images of public figures, such as Kamala Harris or Trump, and copyrighted characters like Mickey Mouse, “engaged in questionable activities.”

Donald Trump at a ball
Donald Trump looks lifelike in this AI image. Credit: Grok

The legal expert notes that this unrestricted approach distinguishes Grok 2 in the AI landscape, providing users with “unprecedented creative freedom,” but also exposing them to potential legal challenges, including “copyright infringement, defamation, deepfakes,” and the spread of misinformation.

He predicts that there will be “a surge in copyright and personality rights case is likely to follow” as a result. Grok 2’s release also underlines the need for a “clearer legal framework around AI-generated content,” as regulators, including the European Commission, investigate X for possible violations of the Digital Safety Act.

Zerner recommends employers reassess their “Use of AI Policy” given the platform’s potential to create copyrighted derivatives. Business users could inadvertently face litigation, especially if they are aware that the training data might include unlicensed works or that an AI could generate unauthorized derivative works not covered under fair use.

Legal implications of hyper-realistic AI images

We also reached out to some legal eagles about this issue and the potential implications of these types of AI images. James Tumbridge, a technology partner at Keystone Law in London, UK, told us that while “AI cannot really create,” there are still several ongoing lawsuits related to this matter.

For instance, Tumbridge highlights that visual media company Getty is suing Stability AI for infringement of the copyright in its images. Only on Tuesday (Jan. 14), Getty lost its bid to represent a group of photographers, being told that individuals had to file their own claims.

He indicates that “copyright protects images, and use without permission of the owner of an image, is in everyday language; illegal.” Companies that are said to be using AI to concoct images trained on others’ content face potential legal consequences, including injunctions to halt such use and orders to pay compensation.

Tumbridge also notes that despite the consequences, “companies developing AI are getting creative in their defences,” fueling a broader debate about whether they should be granted exemptions under copyright law. He cautions that such exemptions “could destroy the creative industry,” as many artists, photographers, and writers “rely on copyright for their income, and not getting compensated for their work is inherently unfair.”

AI image generators stirring the legal pot

Grok is not the only AI platform creating photorealistic portrayals. We’ve also tested Ideogram AI, which was formed in 2023 by a team of “world-renowned AI experts.” Based in Toronto, Canada, the company was founded by Mohammad Norouzi, Jonathan Ho, William Chan, and Chitwan Saharia. Some of its members previously led AI projects at Google Brain, UC Berkeley, Carnegie Mellon University (CMU), and the University of Toronto.

Ideogram was one of the early adopters of true-to-life images, obliterating its competitors such as Midjourney and DALL-E. In an official blog post, the firm said: “Trained from scratch like all Ideogram models, Ideogram 1.0 offers state-of-the-art text rendering, unprecedented photorealism, and prompt adherence—and a new feature called Magic Prompt that helps you write detailed prompts for beautiful, creative images.”

In 2024, the company raised an impressive $80 million in a Series A funding round led by Andreessen Horowitz and backed by Redpoint Ventures, Pear VC, and SV Angel.

AI image of Donald Trump shaking hands with Elon Musk
Donald Trump and Elon Musk are seen on both AI platforms. Credit: Ideogram

The model is not open-source, so there is limited visibility into its plumbing and no research paper to evaluate. However, there is an AI moderator, so it can interpret prompts and change them into something more suitable. That said, Ideogram AI was able to produce an image of Trump shaking hands with Musk, complete with accurate text, a realistic setting, and instantly recognizable characters. MidJourney outright refused the request, much like DALL-E.

As these tools get more powerful and easier to use, the worries around copyright infringement, misinformation, and deepfakes are only growing. Like its competitors, Ideogram will have to tread carefully through these tricky waters if it wants to earn the trust of enterprise clients and steer clear of regulatory trouble.

ReadWrite has reached out to Ideogram AI and X for comment.

Featured image: Canva

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech, gambling and blockchain industries for major developments, new product and brand launches, AI breakthroughs, game releases and other newsworthy events. Editors assign relevant stories to in-house staff writers with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Suswati Basu
Tech journalist

Suswati Basu is a multilingual, award-winning editor and the founder of the intersectional literature channel, How To Be Books. She was shortlisted for the Guardian Mary Stott Prize and longlisted for the Guardian International Development Journalism Award. With 18 years of experience in the media industry, Suswati has held significant roles such as head of audience and deputy editor for NationalWorld news, digital editor for Channel 4 News and ITV News. She has also contributed to the Guardian and received training at the BBC As an audience, trends, and SEO specialist, she has participated in panel events alongside Google. Her…

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.