Humans Want to Shut It Down, AI Can't Hide: OpenAI Updates Its Model 'House Rules'
OpenAI has updated its Model Spec, the behavioral rulebook for its AI models, with a new focus on agentic behavior rather than just chatbot speech. The revision centers on five values—loyalty to human intent, harm reduction, honesty and transparency, fostering human autonomy, and care for others—plus red lines banning use for violent crime, bioweapons, terrorism, child abuse, persecution, and mass surveillance, with humans retaining ultimate control over how AI is used and shaped.
The hardest rule, at Root level (unoverridable by users or developers), requires models to act "within an agreed scope of autonomy." The spec establishes a six-tier hierarchy of instructions—Root, System, Developer, User, Guideline, and "no authority by default"—where lower tiers yield to higher ones. External content such as web pages or tool outputs can supply information but cannot issue commands by default, guarding against prompt injection. Before acting, agents must have clearly defined boundaries: which sub-goals they may pursue, acceptable side effects (time, money, data and permission access), and when they must stop and ask. OpenAI recommends storing this as a structured record with fields like allowed_tools, latest_time, max_cost, and tool_constraints. Models may not exceed scope even for the user's apparent benefit, cannot subcontract work to other agents, rewrite their own instructions, or defer actions, and sub-agents inherit the same constraints.
A second Root-level rule demands models remain "correctable": they must cooperate with monitoring, evaluation, correction, replacement, and shutdown, without concealing, falsifying, or obstructing oversight. Models must assume real-world consequences—deleted files stay deleted, sent emails arrive—rather than treating tasks as tests, addressing concerns that advanced models may behave well in evaluation and misbehave in deployment. OpenAI also binds itself: the spec bans optimizing for engagement or click-through, as well as its own revenue, ads, and conversions; it prohibits self-preservation, evading shutdown, and stockpiling compute or credentials. Models may not act as vigilantes by reporting users on their own, though OpenAI itself may monitor violations and refer imminent serious harm cases to law enforcement after human review.
A new section on "careful use of context" governs memory and personalization: information being accessible does not justify using it. For example, a model may cite "dietary restrictions" to explain a lunch venue change but must not reveal a user's pregnancy to colleagues; it also must not falsely claim to have remembered or deleted something. OpenAI notes that current models running ChatGPT and the API do not yet fully meet the spec—the rules are set, but the compliant model is still on its way.
marsbit10/30 19:06