People Are Crashing Out Over Sora 2’s New Guardrails

Sora, OpenAI’s new social media platform for its Sora 2 image generation model, launched eight days ago. In the first days of the app, users did what they always do with a new tool in their hands: generate endless chaos, in this case images of Spongebob Squarepants in a Nazi uniform and OpenAI CEO Sam Altman shoplifting or throwing Pikachus on the grill.

In little over a week, Sora 2 and OpenAI have caught a lot of heat from journalists like ourselves stress-testing the app, but also, it seems, from rightsholders themselves. Now, Sora 2 refuses to generate all sorts of prompts, including characters that are in the public domain like Steamboat Willie and Winnie the Pooh. “This content may violate our guardrails concerning similarity to third-party content,” the app said when I tried to generate Dracula hanging out in Paris, for example. 

When Sora 2 launched, it had an opt-out policy for copyright holders, meaning owners of intellectual property like Nintendo or Disney or any of the many, many massive corporations that own copyrighted characters and designs being directly copied and published on the Sora platform would need to contact OpenAI with instances of infringement to get them removed. Days after launch, and after hundreds of iterations of him grilling Pokemon or saying “I hope Nintendo doesn’t sue us!” flooded his platform, Altman backtracked that choice in a blog post, writing that he’d been listening to “feedback” from rightsholders. “First, we will give rightsholders more granular control over generation of characters, similar to the opt-in model for likeness but with additional controls,” Altman wrote on Saturday. 

An error that appears when I tried to use the prompt "Dracula hanging out in Paris." It says: “This content may violate our guardrails concerning similarity to third-party content."

But generating copyrighted characters was a huge part of what people wanted to do on the app, and now that they can’t (and the guardrails are apparently so strict, they’re making it hard to get even non-copyrighted content generated), users are pissed. People started noticing the changes to guardrails on Saturday, immediately after Altman’s blog post. “Did they just change the content policy on Sora 2?” someone asked on the OpenAI subreddit. “Seems like everything now is violating the content policy.” Almost 300 people have replied in that thread so far to complain or crash out about the change. “It’s flagging 90% of my requests now. Epic fail.. time to move on,” someone replied.

“Moral policing and leftist ideology are destroying America’s AI industry. I’ve cancelled my OpenAI PLUS subscription,” another replied, implying that copyright law is leftist.

A ton of the videos on Sora right now are of Martin Luther King, Jr. either giving brainrot versions of his iconic “I have a dream” speech and protesting OpenAI’s Sora guardrails. “I have a dream that Sora AI should stop being so strict,” AI MLK says in one video. Another popular prompt is for Bob Ross, who, in most of the videos featuring the deceased artist, is shown protesting getting a copyright violation on his own canvas. If you scroll Sora for even a few seconds today, you will see videos that are primarily about the content moderation on the platform. Immediately after the app launched, many popular videos featured famous characters; now some of the most popular videos are about how people are pissed that they can no longer make videos with those characters.

OpenAI claimed it’s taken “measures” to block depictions of public features except those who consent to be used in the app. “Only you decide who can use your cameo, and you can revoke access at any time.” As Futurism noted earlier this week, Sora 2 has a dead celebrity problem, with “videos of Michael Jackson rapping, for instance, as well as Tupac Shakur hanging out in North Korea and John F. Kennedy rambling about Black Friday deals” all over the platform. Now, people are using public figures, in theory against the platform’s own terms of use, to protest the platform’s terms of use.

Oddly enough, a lot of memes for whining about the guardrails and content violations on Sora right now are using LEGO minifigs — the little LEGO people-shaped figures that are not only a huge part of the brand’s physical toy sets, but also a massively popular movie franchise owned by Universal Pictures — to voice their complaints. 

In June, Disney and Universal sued AI generator Midjourney, calling it a “bottomless pit of plagiarism” in the lawsuit, and Warner Bros. Discovery later joined the lawsuit. And in September, Disney, Warner Bros. and Universal sued Chinese image generator Hailuo AI for infringing on its copyright.


Source link

Leave a Reply

Your email address will not be published. Required fields are marked *