Skip to content
Description
By: David Lopez-Paz
How statistical invariances will help us build AI systems exhibiting human-like performance by following human-like strategies.
Current machine learning systems crumble when the distributions of training and testing examples differ in spurious correlations. This is a major roadblock toward the development of advanced machine intelligence, which demands not only human-like performance but the deployment of human-like strategies. The prevalent approach in AI, fixated on recklessly minimizing average training error, falls short in producing AI systems capable of authentic out-of-distribution generalization. This book introduces the Invariance Principle, a new epistemological tool to unearth correlations invariant across diverse collections of empirical data.
The Invariance Principle, encapsulated in the axiom “frame your problem so its answer matches across circumstances," will not only find its practical incarnation in the family of Invariant Risk Minimization algorithms, but also illuminate our understanding of causation. It will permeate topics such as environment discovery, large-language models, self-supervised learning, mixing data augmentation, uncertainty estimation, and fairness. The author argues that the Invariance Principle is a central inductive bias fueling advances across fields of knowledge, such as physics, metaphysics, and cognitive science.
The final chapter includes personal examples of how invariance has shaped the author’s understanding of his own subjective experience, as well as how he has interpreted both Eastern and Western philosophical traditions.
How statistical invariances will help us build AI systems exhibiting human-like performance by following human-like strategies.
Current machine learning systems crumble when the distributions of training and testing examples differ in spurious correlations. This is a major roadblock toward the development of advanced machine intelligence, which demands not only human-like performance but the deployment of human-like strategies. The prevalent approach in AI, fixated on recklessly minimizing average training error, falls short in producing AI systems capable of authentic out-of-distribution generalization. This book introduces the Invariance Principle, a new epistemological tool to unearth correlations invariant across diverse collections of empirical data.
The Invariance Principle, encapsulated in the axiom “frame your problem so its answer matches across circumstances," will not only find its practical incarnation in the family of Invariant Risk Minimization algorithms, but also illuminate our understanding of causation. It will permeate topics such as environment discovery, large-language models, self-supervised learning, mixing data augmentation, uncertainty estimation, and fairness. The author argues that the Invariance Principle is a central inductive bias fueling advances across fields of knowledge, such as physics, metaphysics, and cognitive science.
The final chapter includes personal examples of how invariance has shaped the author’s understanding of his own subjective experience, as well as how he has interpreted both Eastern and Western philosophical traditions.
You may also like
熱銷中 Top Trending
Dog Man 14: Dog Man: Big Jim Believes: A Graphic Novel (Dog Man #14)
Sale priceHK$85.00
Regular priceHK$150.00
In stock
Dragon Masters #30 Vortex of the Chaos Dragon (Branches) (Tracey West)
Sale priceHK$55.00
Regular priceHK$69.00
In stock
Dragon Masters #29 (正版) Magic of the Wizard Dragon (Branches) (Tracey West)
Sale priceHK$48.00
Regular priceHK$69.00
In stock
Dragon Masters #28 (正版) Night of the Dream Dragon (Branches) (Tracey West)
Sale priceHK$48.00
Regular priceHK$69.00
In stock
Beast Quest Ice and Fire (15 Books) (Adam Blade)
Sale priceHK$346.00
Regular priceHK$1,257.90
In stock
Magic Tree House Fact Tracker Graphic Novel: Space
Sale priceFrom HK$70.00
Regular priceHK$110.00
In stock
National Geographic Little Kids First Big Book of the World
Sale priceFrom HK$96.00
Regular priceHK$150.00
In stock