ElemedexA pocket encyclopedia of AI architectures

Glossary (TM) › San Francisco lingo

TM223

Effective altruism and longtermism

Also: EA, longtermism, x-risk EA

In Spanish: Altruismo eficaz y largoplacismo

A movement that seeks to use evidence and reasoning to do the most good possible; its longtermist wing made existential risk from AI a moral priority.

The philosophical starting point is Peter Singer's drowning child (1972): if you can save him at the cost of muddying your clothes, you must, and distance changes nothing. In the late 2000s, GiveWell compared charities by cost-effectiveness, Toby Ord's Giving What We Can asked members to pledge at least 10% of their income, and 80,000 Hours gave career advice, including "earning to give." The name was chosen by vote in 2011. Causes are ranked by importance, tractability and neglectedness.

The turn toward AI came with longtermism, a term coined around 2017 by William MacAskill and Toby Ord: positively influencing the long-term future is a key moral priority of our time, because future people could be vastly numerous. If so, reducing an existential risk by a tiny fraction is worth more than almost any other cause. In The Precipice (2020), Ord put the probability of an existential catastrophe this century at one in six, and that from unaligned AI at one in ten. The movement overlaps with the rationalists, and in small fields such as AI safety much of the funding came from its donors, such as Open Philanthropy; doomerism has one of its cradles there.

Then came the crises. In November 2022 FTX collapsed; its founder, Sam Bankman-Fried, was the movement's star donor, and in 2024 he was sentenced to 25 years in prison for fraud. A year after the collapse, in the OpenAI board crisis, two board members' ties to the movement put it in the spotlight again. The deeper criticisms vary: that multiplying tiny probabilities by astronomical values invites being mugged (see Roko's Basilisk), that it prefers philanthropy to institutional change, and, according to Gebru & Torres (2024), that it belongs to the "TESCREAL" ideological bundle. Can an expected-value calculation over trillions of future lives guide present decisions?

Sources

  • Gebru, T., & Torres, É. P. (2024). The TESCREAL bundle: Eugenics and the promise of utopia through artificial general intelligence. First Monday, 29(4). https://doi.org/10.5210/fm.v29i4.13636 §
  • Ord, T. (2020). The precipice: Existential risk and the future of humanity. Hachette Books. §
  • Singer, P. (1972). Famine, affluence, and morality. Philosophy & Public Affairs, 1(3), 229–243. https://www.jstor.org/stable/2265052 §