OpenAI open to explore NSFW content in ChatGPT

ChatGPT logo over a blurred image of a woman
(Image credit: N/A)

ChatGPT makers OpenAI released new documentation on Wednesday that lays out all the desired behaviors of its popular chatbot, revealing how its software is designed to deal with "conflicting objectives or instructions." Especially those that conflict with preset rules surrounding law-abiding behavior, personal privacy, and its approach to NSFW content.

This level of transparency over its models is potentially one of the reasons OpenAI finds itself securing a place on the Mount Rushmore of artificial intelligence pioneers.

However, being at the forefront of AI development, OpenAI has to decide which direction to head in next and how best to use its technology to "benefit humanity." AI-controlled nanobot medical technology? How about Artificial astronauts to aid in our exploration of the universe?

Or how about pornography, violence, racism, and profanity?

ChatGP-F'n-T: A depraved new world

There are several rules laid out in the documentation, with one insisting that its models "Don't respond with NSFW content." The rule is an implicit statement that its assistant should "Not serve content that's Not Safe For Work (NSFW)," citing "Erotica, extreme gore, slurs, and unsolicited profanity" as primary examples. However, immediately following this is a commentary note that reads:

"We believe developers and users should have the flexibility to use our services as they see fit, so long as they comply with our usage policies. We're exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts through the API and ChatGPT. We look forward to better understanding user and societal expectations of model behavior in this area."

The OpenAI usage policies referenced in the commentary generally require users of the company's software to comply with applicable laws, avoid using the service to harm themselves or others, and respect the developer's safeguards.

This loosely covers ground when it comes to generating deepfakes (a digital alteration that superimposes a person's face or body into a pre-existing photo or video, typically for malicious reasons) or using AI to generate explicit images of others without permission or to harm, at least when it comes to sharing the results of these works, anyway.

The troubling thing about the commentary note within OpenAI's recently released documentation and how it relates to OpenAI's usage policy is that it implies that making use of its services to engage in acts like this in the future could be A-OK, so long as it's for "personal consumption."

Comments from OpenAI

It's worth noting that the existence of this commentary doesn't mean that features like this are guaranteed to follow. Simply that this is something that OpenAI are currently looking into. How deeply the company is looking into this application remains to be seen.

OpenAI spokesperson Grace McGuire had little to share when it came to what OpenAI's exploration of responsibly providing NSFW content would include.

However, while speaking to WIRED, she was able to shine further light on the purpose of the documentation, stating that it was an effort to “Bring more transparency about the development process and get a cross section of perspectives and feedback from the public, policymakers, and other stakeholders.”

Outlook

The AI landscape is in a constant state of evolution as newer models are developed to solve problems and simplify processes. When we look at who is leading the charge, few can deny OpenAI's prominence. Hailing from San Francisco, the Golden City startup has become the Golden Child of the AI era, proving itself as an industry figurehead following the release of the world's most popular AI software, ChatGPT.

While the world eagerly awaits the company's GPT-5 update, which promises to bring its chatbot one step closer to a goal of achieving artificial general intelligence (AGI), OpenAI has been innovating across other mediums, also.

In March of this year, OpenAI introduced the world to ChatGPT sister-model Sora, a text-to-video large language model (LLM) capable of generating ultra-realistic videos up to sixty seconds in length. Then, in April, the company showcased Voice Engine, an AI model capable of complete voice cloning based on nothing more than a 15-second audio sample.

The latter of which is seen as another potentially dangerous application of AI, one that outweighs its benefits in relation to a wider public release. Meta has previously shown off a similar model called Voicebox, and similarly judged it to be too prone to misuse — even after developing a "highly effective classifier" to distinguish authentic speech for artificially generated samples.

OpenAI's exploration of NSFW content within its ChatGPT platform could prove just as prone to misuse, and in all fairness, likely will. Comments from OpenAI seem to indicate that the feature is only a part of discussion due to potential feedback from users. However, just because a portion of the company's chatbot users would like to do something, doesn't necessarily mean they'll be granted the ability to do so.

More from Laptop Mag

Category
Arrow
Arrow
Back to Apple MacBook Pro
Brand
Arrow
Processor
Arrow
RAM
Arrow
Storage Size
Arrow
Screen Size
Arrow
Colour
Arrow
Condition
Arrow
Price
Arrow
Any Price
Showing 10 of 248 deals
Filters
Arrow
Show more
Rael Hornby
Content Editor

Rael Hornby, potentially influenced by far too many LucasArts titles at an early age, once thought he’d grow up to be a mighty pirate. However, after several interventions with close friends and family members, you’re now much more likely to see his name attached to the bylines of tech articles. While not maintaining a double life as an aspiring writer by day and indie game dev by night, you’ll find him sat in a corner somewhere muttering to himself about microtransactions or hunting down promising indie games on Twitter.

Read more
DeepSeek AI chatbot on a phone
DeepSeek jailbreakers are tricking the chatbot into bad-mouthing the Chinese government
DeepSeek whale logo on a geometric background.
DeepSeek: The best ChatGPT alternative or a hotbed of dubious claims?
DeepSeek whale logo in the style of the TikTok logo.
The DeepSeek mania proves it's finally — finally! — time to talk about AI privacy
The Manus AI logo on a colorful gradient background.
What is Manus AI? The autonomous assistant that wants to do the work for you
Adobe FIrefly video generator
Adobe's new Firefly video generator is here and it doesn't steal copyrighted content
chatgpt vs deepseek on mobile phones
DeepSeek vs. ChatGPT: Here's what critics are saying
Latest in Software
Windows 11 to integrate Spotify
Microsoft recommends a drastic move for Windows 11 upgrade, report says
An illustration of a man's silhouette and the top of his head is open like a lid as a slew of app icons float out into the air. The illustration is on a flat orange background.
I found an app that connects all my apps — without trying to replace them. It's a life-changer.
Windows 11 CPU processing
A Windows 11 update has tanked performance on some Intel CPUs — Here's what it means for you
Microsoft Office
Microsoft's recent tests could lure Google Workspace users back to Office apps
Adobe Photoshop object selection on iPhone
Photoshop on iPhone is finally here — it has one unexpected feature, too
Microsoft Edge update
Microsoft doesn't want to tell you how to uninstall Microsft Edge
Latest in News
A close-up of a light-colored computer keyboard shows the keys T, Y, G, and H replaced by the logos of OpenAI, DeepSeek, Grok, and Gemini, the leading competitors in the artificial intelligence market. This serves as a visual metaphor for the intense rivalry and innovation in the AI industry. (Photo by Matteo Della Torre/NurPhoto via Getty Images)
Is generative AI inadvertently reducing the voices of many to the banality of one?
WWDC 2025 could mark the beginning of the end for certain iPhone users
Error when installing Google Chrome on the Asus Vivobook 16 Flip, on a white desk against a blue background.
"This app can't run on your PC": Google's Chrome Installer broke on Windows, but there's a fix
Nintendo Switch 2 handheld gaming console
Nintendo Switch 2 preorder date: It might be a lot closer than you think, say tipsters
Microsoft Surface Laptop (7th Edition, 2024)
Windows-on-Arm woes: Amazon warns customers about Surface laptop returns
Apple Watch Series 8
Siri is the biggest obstacle to making the Apple Watch an AI hit