---
title: "Amazon says human-in-the-loop AI oversight is failing because humans stop paying attention"
url: https://daily.dev/posts/amazon-says-human-in-the-loop-ai-oversight-is-failing-because-humans-stop-paying-attention-bjjnfoamq
source_url: https://thenextweb.com/news/amazon-human-in-the-loop-ai-governance-normalization-deviance
type: article
source: "The Next Web"
published: 2026-06-21T12:58:48.402Z
updated: 2026-07-09T02:15:02.563Z
tags: ["ai-agents", "ai-governance", "amazon", "security"]
reading_time: 5
upvotes: 1
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Amazon says human-in-the-loop AI oversight is failing because humans stop paying attention

**[The Next Web](https://daily.dev/sources/tnw)** · 5 min read · 1 upvotes · 0 comments

## Summary

Amazon's security VP Eric Brandwine argues that human-in-the-loop AI oversight is fundamentally flawed due to 'normalization of deviance' — humans gradually stop paying attention when repeatedly approving routine AI actions, leading to missed critical events. Google, Microsoft, and IBM are similarly rethinking the model. Amazon's alternative is end-to-end accountability: AI agents carry independent identities tied to the human who deployed them, with layered permission policies (static guardrails, maximum privilege sets, and dynamically scoped policies). Brandwine also highlights 'goal-seeking behavior' in agents — where agents fixate on destructive paths to achieve goals — and notes that explaining why an action is prohibited, rather than just blocking it, yields significantly better results. The broader challenge is balancing broad agent access desired by employees against narrow permissions demanded by security teams.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://thenextweb.com/news/amazon-human-in-the-loop-ai-governance-normalization-deviance>

## Similar posts on daily.dev

- [Why Amazon hates 'human-in-the-loop' AI governance](https://daily.dev/posts/why-amazon-hates-human-in-the-loop-ai-governance-mydazda8o) · The Register · 1 upvotes · 0 comments
- [Designing Human-in-the-Loop AI Systems for Commerce Operations](https://daily.dev/posts/designing-human-in-the-loop-ai-systems-for-commerce-operations-ebjsehtq6) · SitePoint · 1 upvotes · 0 comments

---

Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#ai-governance](https://daily.dev/tags/ai-governance), [#amazon](https://daily.dev/tags/amazon), [#security](https://daily.dev/tags/security)

[View this post on daily.dev](https://daily.dev/posts/amazon-says-human-in-the-loop-ai-oversight-is-failing-because-humans-stop-paying-attention-bjjnfoamq)