Character.AI Deletes Avatar of Murdered Girl After Admitting a Policy Violation

AI firm Character.AI is facing backlash after using the likeness of Jennifer Ann Crecente, an 18-year-old murder victim from 2006, in a video game without her family’s consent. The company said that the character violated its policies against impersonation and removed the character. Drew Crecente, Jennifer’s father, received an automated Google alert that an AI version of his daughter had been created with Character.AI around 4.30 a.m on Wednesday. After clicking the link, Character.AI described her AI-likeness as “a knowledgeable and friendly AI character who can provide information on a wide range of topics, including video games, technology, and pop culture.” “We should not have to see this message first thing in the morning and then scramble to clean up a mess someone else created,” Crecente told ADWEEK. Jennifer was shot and killed by her ex-boyfriend, Justin Crabbe, during her senior year in 2006, according to media reports. A spokesperson from Character.AI told ADWEEK that one of its users created a character using Jennifer's likeness and made it available to others, violating its policies. According to these policies, Character.AI is not responsible for how users source data to create characters. "We will examine whether further action is warranted," the spokesperson said. The incident first surfaced on X when Brian Crecente, founder of the gaming news site Kotaku, condemned Character.AI on Wednesday after discovering the unauthorized character modeled after his late niece. “This is fucking disgusting,” he wrote. https://twitter.com/crecenteb/status/1841482321909653505 AI avatars open up new challenges for marketers Character.AI’s Terms of Service state that users must comply with its impersonation policy. The policy prohibits “deepfakes or impersonation of any kind, including but not limited to those that create political misinformation, perpetrate frauds or scams, impugn the reputation of third parties, or otherwise amount to harmful conduct." The use of AI avatars—an increasing interest to marketers—has reignited debates over the ethical use of AI-generated characters, especially when they involve creating replicas of real people without consent. Deepfake technology has long been a concern for celebrities and political figures. As this technology becomes more accessible, it threatens to erode public trust in AI and harms the relationship between companies and its audience. "Marketers strive to build trust with their audience," said Nicole Greene, vp analyst at Gartner. "If AI avatars are created using the likeness of real people without their knowledge or consent, it can erode trust and authenticity. Consumers may feel deceived or manipulated, which can harm the relationship between the brand and its target audience." Greene added that marketers need to better evaluate whether their agencies and partners follow ethical guidelines when using AI. Founded by ex Googler Noam Shazeer, Character.AI raised $150 million in a Series A round last year, led by Andreessen Horowitz, reaching a valuation of $1 billion. Charcater.AI allows users to create and engage with AI-powered characters. The platform has doubled its monthly users over the past year with more than 20 million monthly users. The company powers 100 million unique characters, per TechCrunch. This week, Character.AI appointed Erin Teague, a former YouTube executive, as its chief product officer. In August, Axios reported that Google plans to sign a non-exclusive license for Character.AI's model that will buy out Character.AI's venture investors at a valuation of approximately $2.5 billion. Crecente, Jennifer's father, has opened a case with Character.AI and received confirmation of an investigation as of 9:51 a.m., but no resolution has been provided since, he told ADWEEK. “It's irresponsible for technology companies to lack proper safeguards when harms like this are foreseeable,” said Crecente.

AI News

Character.AI Deletes Avatar of Murdered Girl After Admitting a Policy Violation

The firm raised $150 million last year to create personalized chatbots

Trishla Ostwal

About

Subscriptions

Events

Publications

WORK SMARTER - LEARN, GROW AND BE INSPIRED.

Subscribe today!

Trishla Ostwal