Use Apple Intelligence Proxy?

[Manouchehri]

I haven't had time to spend any effort into REing this, but from what I understand, the ChatGPT extension on macOS and iOS is a straight up proxy to OpenAI's API. It uses either apple-relay.apple.com or apple-relay.cloudflare.com to proxy requests to OpenAI's servers.

https://github.com/LumiaSecurity/mitmproxy-ace/blob/main/disable_certificate_pinning.js

https://support.apple.com/guide/iphone/use-chatgpt-with-apple-intelligence-iph00fd3c8c2/ios

https://www.lumia.security/blog/applestorm

While not documented (anywhere?) publicly, Apple uses a custom system prompt along with their own tools. So it might be possible to submit anything without requiring the codex system prompt prefix.

[RayBytes]

this is actually really interesting, how do you know about apple-relay.apple.com?
Don't see it in the blog post or anywhere. I thought that would be for iCloud's private relay functionality

[Manouchehri]

You have to do a bit of inference.

Your IP address is obscured from ChatGPT

https://support.apple.com/guide/iphone/use-chatgpt-with-apple-intelligence-iph00fd3c8c2/ios#:~:text=Your%20IP%20address%20is%20obscured%20from%20ChatGPT%2C%20but%20your%20general%20location%20is%20provided

So Apple indirectly confirms that they're proxying requests to OpenAI.

Proxy through Apple Servers and not directly with OpenAI - Slide 5

https://media.defcon.org/DEF%20CON%2033/DEF%20CON%2033%20presentations/Yoav%20Magid%20-%20AppleStorm%20-%20Unmasking%20the%20Privacy%20Risks%20of%20Apple%20Intelligence.pdf

Another researcher confirms it.