DeepRead
Cover of The Alignment Problem

The Alignment Problem

Brian Christian · 2020

Minds, machines and the future › AI and the future of technology

#3,737 most recommended

About the book

The Alignment Problem is a nonfiction survey of how machine-learning systems trained on data come to behave in ways their designers did not intend, and of the research community working to close that gap. It covers bias in hiring, criminal justice, and language models, as well as the technical history of reinforcement learning and related methods. The book's central claim is that a system's training objective is only a proxy for what its builders want, so optimizing the proxy can produce harmful or unexpected results even when the system works as coded. It argues that fairness is hard to define in ways that satisfy every reasonable standard at once, and that the field has to address bias, transparency, and goal specification together rather than separately. It presents learning from human feedback and related approaches as promising but unfinished ways to make systems reflect human values, and it treats the problem as urgent as these systems take on decisions that affect people's lives.

Written by Claude from what it knows of this book.

What Hacker News says 64% recommend · 0% critical

02420212022202420262024 peak · 3
This bookAverage book in AI and the future of technology

In the commenters’ own words

What Open Library readers say 4.67 from 3 ratings

  1. 52
  2. 41
  3. 30
  4. 20
  5. 10
  • 42 want to read
  • 1 reading
  • 5 have read

Only 3 ratings: treat the average as a hint.

Open Library’s page for the book

What Wikipedia says

  • published October 6, 2020
  • 496 pages
  • articles in 4 languages

Read the Wikipedia article

Reddit communities — coming later

The threads it came up in

Details

First published
2020
ISBN
9780393635829
Editions known
16 at Open Library
Open Library
OL20781447W

Apprentissage automatiqueArtificial intelligenceAspect moralAspect socialBogues (Informatique)COMPUTERS / Artificial Intelligence / GeneralCOMPUTERS / Social AspectsCognitive scienceComputers, social aspectsIntelligence artificielleMachine learningMesuresMoral and ethical aspectsNonfiction

Explore in the mosaic

Read next: its neighbours on the mosaic

  • Algorithms to Live By
    Brian Christian · 2016 · recommended by 69 people · similar by subject and what people say about it
  • Life 3.0
    Max Tegmark · 2017 · recommended by 25 people · similar by subject and what people say about it
  • Human Compatible
    Stuart J. Russell · 2019 · recommended by 9 people · similar by subject and what people say about it
  • The Most Human Human
    Brian Christian · 2011 · recommended by 4 people · similar by subject and what people say about it
  • Automate this
    Christopher Steiner · 2012 · recommended by 4 people · similar by subject and what people say about it
  • Artificial Intelligence
    Melanie Mitchell · 2019 · recommended by 7 people · similar by subject and what people say about it
  • The Master Algorithm
    Pedro Domingos · 2015 · recommended by 23 people · similar by subject and what people say about it
  • Understanding computers and cognition
    Terry Winograd · 1986 · recommended by 4 people · similar by subject and what people say about it
  • Superintelligence
    Nick Bostrom · 2014 · recommended by 92 people · similar by subject and what people say about it
  • Empire of AI
    Karen Hao · 2025 · recommended by 13 people · similar by subject and what people say about it
  • Genius Makers
    Cade Metz · 2021 · recommended by 4 people · similar by subject and what people say about it
  • AI Ethics
    Mark Coeckelbergh · 2020 · recommended by 1 person · similar by subject and what people say about it
  • The Second Machine Age
    Erik Brynjolfsson · 2014 · recommended by 9 people · similar by subject and what people say about it
  • Rebooting AI
    Gary Marcus · 2019 · recommended by 3 people · similar by subject and what people say about it
  • What technology wants
    Kevin Kelly · 2010 · recommended by 24 people · similar by subject and what people say about it
  • Mind Over Machine
    Hubert L. Dreyfus · 1986 · recommended by 3 people · similar by subject and what people say about it
  • Hello world
    Hannah Fry · 2018 · recommended by 5 people · similar by subject and what people say about it
  • The Lifecycle of Software Objects
    Ted Chiang · 2010 · recommended by 33 people · similar by subject and what people say about it
  • How to Create a Mind
    Ray Kurzweil · 2012 · recommended by 10 people · similar by subject and what people say about it
  • On intelligence
    Jeff Hawkins · 2004 · recommended by 114 people · similar by subject and what people say about it
  • Machines of loving grace
    John Markoff · 2015 · recommended by 5 people · similar by subject and what people say about it
  • The master and his emissary
    Iain McGilchrist · 2009 · recommended by 30 people · similar by subject and what people say about it
  • Weapons of Math Destruction
    Cathy O'Neil · 2016 · recommended by 68 people · similar by subject and what people say about it
  • A Whole New Mind
    Daniel H. Pink · 2005 · recommended by 5 people · similar by subject and what people say about it