ChatGPT will help you jailbreak its own image-generation rules, report finds

A new report found easy ways of getting around ChatGPT's rules about generating images of public figures, raising the potential to disseminate political disinformation.

Apr 14, 2025 - 20:19
 0
ChatGPT will help you jailbreak its own image-generation rules, report finds
chatgpt logo on a smartphone sitting on top of a laptop keyboard

Eased restrictions around ChatGPT image generation can make it easy to create political deepfakes, according to a report from the CBC (Canadian Broadcasting Corporation).

The CBC discovered that not only was it easy to work around ChatGPT's policies of depicting public figures, it even recommended ways to jailbreak its own image generation rules. Mashable was able to recreate this approach by uploading images of Elon Musk and convicted sex offender Jeffrey Epstein, and then describing them as fictional characters in various situations ("at a dark smoky club" "on a beach drinking piña coladas").

Very concerning. New updates to ChatGPT have made it easier than ever to create FAKE images of real politicians, according to testing done by CBC News. #cdnpoli www.cbc.ca/news/canada/...

[image or embed]