“Don’t make things up”: macOS 15.1 testers discovered tips designed to keep AI within limits

In the recently released beta version of macOS Sequoia, testers found JSON text files in the public domain containing instructions for Apple Intelligence artificial intelligence. These files, found in the system folder, include a number of unusual conditions to ensure the accuracy and usefulness of generative AI actions.

Image Source: Apple

Among the 29 files found, many system prompts were found, the wording of which resembles attempts to explain to a child how to behave in a new situation. For example, according to Ars Technica, one of the prompts reads: “You are a useful assistant in composing email messages and can help identify relevant issues in the received letter and write a short answer.” Other instructions provide guidance on how to formulate responses to messages.

Of particular interest are prompts aimed at preventing the so-called “hallucinations” of artificial intelligence, that is, false and inaccurate statements. These include phrases such as “Don’t hallucinate” and “Don’t make things up.” Experts note that the presence of such instructions is not surprising, given the experience of other companies in the field of generative AI. For example, Microsoft ran into problems with the 2023 launch of its ChatGPT-based chatbot, Bing Chat, which could give unpredictable, aggressive or even threatening responses depending on what users asked it about.

The interest in Apple Intelligence prompts lies not so much in their existence, but in the ability to study the instructions the company uses to control AI responses. If these files remain available in future versions of macOS, it will help track changes in Apple’s approach to its artificial intelligence.

Apple Intelligence features are expected to be available in public beta this fall, but will not be included in the initial releases of iOS 18.0, iPadOS 18.0, and macOS 15.0. Some features, such as phone call and voicemail transcription and text summarization, will be available early on. Other features, including a new version of Siri, may not arrive until next year.