Contact

Autonomy Gradient

A model for how systems earn the right to act on a person’s behalf.

a cover image representing Autonomy Gradient
Developed Mechanism Established
Human Behaviour

People extend trust incrementally and progressively. A system that asks for permission to act before demonstrating that it can act well does not provide the user an evidence or basis to grant what has not yet been earned.

Mechanism

In the beginning, the system acts only when prompted, within explicit bounds. Each accurate action generates a signal, a behavioural confirmation that the system’s judgement held up against reality. This progressive trust accumulates through that signal quietly, without the user explicitly having to declare it. As trust builds, the system expands its operating remit through four stages:

  • responding only when prompted,
  • prompting on its own initiative,
  • acting within constraints without prior approval, and
  • finally acting ahead of instruction.

Each step is unlocked by demonstrated accuracy at the previous one, not by elapsed time or explicit permission. The user does not grant autonomy. They simply stop questioning it.

Description of the image for accessibility
Where it breaks

The model breaks when the feedback signal is ambiguous: when the user completes an action the system initiated but would have acted differently given the choice. Passive compliance reads as confirmation. It also breaks in high-stakes or irreversible domains where any error at an expanded level destroys the accumulated trust. The gradient assumes errors are recoverable. Where they are not, the model should not be applied. The model also does not handle stale trust, so when a user’s context changes, the model does not recalibrate its authority.

Where it breaks

The person has to override on fewer and fewer instances because the system continues to become more accurate. The clearest signal is an action the person didn’t initiate and didn’t need to undo.

What makes it distinct

Autonomy Gradient does not ask the user to declare how much authority the system should have. The system starts with a narrow remit and earns expansion through demonstrated accuracy at each prior stage. The trust that determines operating authority is not granted by the user, configured by a developer, or set at onboarding: it is an outcome of the relationship between the two, accumulated quietly through each confirmed action.

Origin

Developed through the design of Orion, an AI concierge for experiential commerce. Rooted in the idea of extending user’s experience beyond a transaction, it answers the question of how far and on what grounds an agent should act on user’s behalf.

Read the blog post → ⚙ Request Prototype