The Nobel Prize in Physics 2024: They trained artificial neural networks using physics

The Royal Swedish Academy of Sciences has decided to award the Nobel Prize in Physics 2024 to
John J. Hopfield, Princeton University, NJ, USA and
Geoffrey E. Hinton, University of Toronto, Canada.

“for foundational discoveries and inventions that enable machine learning with artificial neural networks”

This year’s two Nobel Laureates in Physics have used tools from physics to develop methods that are the foundation of today’s powerful machine learning. John Hopfield created an associative memory that can store and reconstruct images and other types of patterns in data. Geoffrey Hinton invented a method that can autonomously find properties in data, and so perform tasks such as identifying specific elements in pictures.

When we talk about artificial intelligence, we often mean machine learning using artificial neural networks. This technology was originally inspired by the structure of the brain. In an artificial neural network, the brain’s neurons are represented by nodes that have different values. These nodes influence each other through connections that can be likened to synapses and which can be made stronger or weaker. The network is trained, for example by developing stronger connections between nodes with simultaneously high values. This year’s laureates have conducted important work with artificial neural networks from the 1980s onward.

John Hopfield invented a network that uses a method for saving and recreating patterns. We can imagine the nodes as pixels. The Hopfield network utilises physics that describes a material’s characteristics due to its atomic spin – a property that makes each atom a tiny magnet. The network as a whole is described in a manner equivalent to the energy in the spin system found in physics, and is trained by finding values for the connections between the nodes so that the saved images have low energy. When the Hopfield network is fed a distorted or incomplete image, it methodically works through the nodes and updates their values so the network’s energy falls. The network thus works stepwise to find the saved image that is most like the imperfect one it was fed with.

Geoffrey Hinton used the Hopfield network as the foundation for a new network that uses a different method: the Boltzmann machine. This can learn to recognise characteristic elements in a given type of data. Hinton used tools from statistical physics, the science of systems built from many similar components. The machine is trained by feeding it examples that are very likely to arise when the machine is run. The Boltzmann machine can be used to classify images or create new examples of the type of pattern on which it was trained. Hinton has built upon this work, helping initiate the current explosive development of machine learning.

“The laureates’ work has already been of the greatest benefit. In physics we use artificial neural networks in a vast range of areas, such as developing new materials with specific properties,” says Ellen Moons, Chair of the Nobel Committee for Physics.

Illustration: ©Johan Jarnestad/The Royal Swedish Academy of Sciences.

Laureates

John J. Hopfield, born 1933 in Chicago, IL, USA. PhD 1958 from Cornell University, Ithaca, NY, USA. Professor at Princeton University, NJ, USA.

John J. Hopfield, Princeton University

Geoffrey E. Hinton, born 1947 in London, UK. PhD 1978 from The University of Edinburgh, UK. Professor at University of Toronto, Canada.

Geoffrey E. Hinton, University of Toronto

Prize amount: 11 million Swedish kronor, to be shared equally between the laureates.

Documents

The illustrations are free to be used by media for news reporting about the Nobel Prizes and the Prize in Economic Sciences, individual teachers and educators for educational purposes, individual researchers for research purposes, or private individuals for personal, non-commercial use. No modifications are allowed, and “©Johan Jarnestad/The Royal Swedish Academy of Sciences” must be noted. Commercial use for advertising purposes is not permitted.

For other uses, permission from the Royal Swedish Academy of Sciences is required. To apply for permission, please use the Academy’s contact form

Contacts

Press contact

Eva Nevelius, Press Secretary, the Royal Swedish Academy of Sciences
+46 70 878 67 63, eva.nevelius@kva.se

Experts

Olle Eriksson, the Nobel Committee for Physics, The Royal Swedish Academy of Sciences
+46 18 471 36 25, olle.eriksson@physics.uu.se

Anders Irbäck, the Nobel Committee for Physics, The Royal Swedish Academy of Sciences
+46 46 222 34 93, anders.irback@cec.lu.se

Read more about the Nobel Prize

The official Nobel Prize website

 

The Royal Swedish Academy of Sciences, founded in 1739, is an independent organisation whose overall objective is to promote the sciences and strengthen their influence in society. The Academy takes special responsibility for the natural sciences and mathematics, but endeavours to promote the exchange of ideas between various disciplines.

Nobel Prize® and the Nobel Prize® medal design mark are registrated trademarks of the Nobel Foundation.