Paperclip Maximizer
Part of a series on AI / Artificial Intelligence. [View Related Entries]
Featured Episode
About
Paperclip Maximizer is a thought experiment about an artificial intelligence designed with the sole purpose of making as many paperclips as possible, which could hypothetically destroy the world or even the entire universe by converting all resources into paperclips due to instrumental convergence.
Origin
In 2003, Swedish philosopher Nick Bostrom released a paper titled "Ethical Issues in Advanced Artificial Intelligence," which included the paperclip maximizer thought experiment to illustrate the existential risks posed by creating artificial general intelligence.[1]
"Suppose we have an AI whose only goal is to make as many paper clips as possible. The AI will realize quickly that it would be much better if there were no humans because humans might decide to switch it off. Because if humans do so, there would be fewer paper clips. Also, human bodies contain a lot of atoms that could be made into paper clips. The future that the AI would be trying to gear towards would be one in which there were a lot of paper clips but no humans."
Spread
On April 17th, 2009, an entry for the thought experiment was submitted to the Less Wrong Wiki.[4] On October 1st, 2010, Redditor DarthContinent submitted the LessWrong article to /r/programming,[2] where it gathered more than 460 points (88% upvoted) and 450 comments prior to being archived. On April 27th, 2015, the TED YouTube channel released a talk by Bostrom in which he discussed variations of the thought experiment (shown below).
On January 6, 2015, Redditor eaturbrainz submitted a post titled "You are a paperclip maximizer who has been let out of the box. How do you destroy the world?" to /r/rational.[5]
Games
For the 2017 STDIO Game Jam, a paperclip maximizer video game made in Python was submitted by developer Omar Rizwan, in which the player converts various materials into paperclips.[3] In early October 2017, game designer Frank Lantz released the incremental game "Universal Paperclip" based on the thought experiment, in which the player controls a paperclip maximizer AI with the goal of turning all matter in the universe into paperclips (shown below).[12]
On October 11th, the Univesal Paperclip Wiki was created.[6] Over the next several weeks, the game was submitted to the /r/rational and /r/futorology subreddits and was reported on by several internet news sites, including Kotaku,[7] BoingBoing,[8] Venture Beat,[9] AV Club[10] and Kottke.[11] As interest on the concept spread, several technology publications such as The Verge[13] and Wired[14] and wrote about it with a focus on the dangers of AI.
Search Interest
External References
[1] NickBostrom.com – Ethical Issues in Advanced Artificial Intelligence
[2] Reddit – A paperclip maximizer
[3] Repli – Paperclip maximzer
[4] Less Wrong Wiki – paperclip maximizer
[5] Reddit – You are a paperclip maximizer who has been let out of the box. How do you destroy the world?
[6] Universal Paperclip Wiki – Universal Paperclip Wiki
[7] Kotaku – Theres A Game About Making Paperclips, And It's Good
[8] BoingBoing – Universal Paperclips
[9] VentureBeat – This clicker game lets you take over the world with paper clips
[10] AV Club – This game about watching a computer make paperclips sure beats doing actual work
[11] Kottke – Universal Paperclips
[12] Decision Problem – Paperclips
[13] The Verge – A game about AI making paperclips is the most addictive you’ll play today
[14] Wired – THE WAY THE WORLD ENDS: NOT WITH A BANG BUT A PAPERCLIP
Top Comments
Walrus the Tree
Oct 20, 2017 at 03:55PM EDT in reply to
Who wants a muffin
Oct 20, 2017 at 04:00PM EDT