Learning the importance of training data under concept drift
15% accuracy gains. That's what Google Research achieved by reweighting training data for AI models facing concept drift across 39M photos.
Why it matters
As real-world data constantly evolves, Google Research shows that intelligently prioritizing training data by age and content—not treating all data equally—unlocks significant performance gains. This matters for any company deploying AI in nonstationary environments where yesterday's data may be irrelevant tomorrow.
The key facts
6 to know15% relative accuracy gains on large-scale nonstationary learning benchmark (39M photos over 10 years)
Tested across 7+ datasets spanning photos, satellite imagery, social media text, medical records, sensor data, and tabular data
Method separates instance-specific and age-related decay contributions using multiple fixed timescales
Outperforms offline training and standard continual learning approaches on photo categorization task
Reduces accuracy degradation in test period vs. baseline methods, addressing catastrophic forgetting problem
Published by Google Research, February 2024
Go to the source
Google Research Blogblog.research.google
Publisher excerpt: Posted by Nishant Jain, Pre-doctoral Researcher, and Pradeep Shenoy, Research Scientist, Google Research The constantly changing nature of the world around us poses a significant challenge for the development of AI models. Often, models are trained on longitudinal data with the hope that the…