Omar Abdelfattah AlshafaiHow Graph Neural Networks, Transformers, probabilistic AI, and hybrid physics-ML systems are changing...
How Graph Neural Networks, Transformers, probabilistic AI, and hybrid physics-ML systems are changing environmental intelligence.
Introduction
For decades, predicting the atmosphere has depended on one fundamental idea: represent the laws of physics mathematically and solve them using increasingly powerful computers.
Modern numerical weather prediction systems simulate atmospheric motion, temperature, pressure, moisture, radiation, and interactions between different components of the Earth system.
These models have transformed meteorology and climate science.
But there is a fundamental computational challenge.
The atmosphere is enormous, chaotic, and highly interconnected. Increasing the resolution of a simulation means representing more points in space, more variables, and more interactions. The computational cost can grow rapidly.
Machine learning introduces a different approach.
Instead of explicitly calculating every atmospheric evolution step using numerical equations, neural networks can learn patterns of atmospheric evolution from large collections of historical weather data.
That does not mean AI has simply replaced physics.
A more interesting transformation is happening.
Physics-based models, observations, data assimilation, and machine learning are increasingly being combined into new forecasting systems.
The result is a new generation of environmental intelligence.
Traditional numerical weather prediction begins with observations.
Satellites, weather stations, aircraft, radar, ocean systems, and other instruments continuously collect information about the Earth.
These observations are processed through data-assimilation systems to estimate the current state of the atmosphere.
A physics-based model then uses mathematical equations to calculate how that state is expected to evolve.
The overall process can be described as:
Observations → Data Assimilation → Physical Model → Forecast
This approach has been remarkably successful.
However, it is computationally expensive.
A global forecast requires the numerical model to repeatedly approximate atmospheric behavior across a large three-dimensional domain.
Machine learning offers another possibility.
A neural network can be trained on historical atmospheric states and learn relationships between one state and the next.
The conceptual process becomes:
Historical Weather Data → Neural Network Training → Learned Atmospheric Dynamics → Forecast
The important detail is that the neural network is not learning atmospheric physics from an empty space.
Its training data contain information produced by observations, analyses, and physical forecasting systems.
The model is learning patterns from the Earth-system data available to it.
This creates both an opportunity and a limitation.
If the future atmosphere resembles patterns represented in the training data, the model can potentially produce forecasts extremely efficiently.
But if it encounters conditions substantially different from its training distribution, its performance may become less predictable.
This is known as an out-of-distribution generalization problem.
One of the most important ideas in modern AI weather forecasting is the use of Graph Neural Networks, or GNNs.
A graph consists of nodes and relationships between those nodes.
For atmospheric applications, nodes can represent geographical locations or atmospheric regions, while connections represent relationships between them.
The neural network can then exchange information between connected regions.
This is useful because atmospheric systems are not isolated.
Weather patterns move across geographical regions.
Pressure systems influence surrounding areas.
Moisture is transported across large distances.
Storm systems develop and evolve across connected regions.
A graph-based representation provides a natural way to model these spatial relationships.
Instead of treating every location as completely independent, the model can learn how information propagates across the atmosphere.
This became particularly important with systems such as Google's GraphCast.
GraphCast demonstrated that a graph-based neural network could generate global weather forecasts with strong performance across many evaluated variables and lead times.
Its significance extends beyond the individual model.
GraphCast helped demonstrate that machine learning could learn useful representations of atmospheric evolution from large-scale weather datasets.
The broader idea is powerful:
A neural network can learn an approximation of how atmospheric states evolve rather than explicitly solving the complete numerical forecasting problem every time a forecast is generated.
Once the model has been trained, producing a new forecast can be extremely efficient.
This opens an important possibility.
Instead of spending large amounts of computational resources on every individual prediction, the expensive computation can be concentrated during training, while inference becomes comparatively fast.
That difference becomes especially valuable when forecasts need to be generated repeatedly or across many scenarios.
Graph Neural Networks are not the only architecture being used.
Transformers have also become important in scientific machine learning.
Transformers were originally popularized by natural language processing because they can learn relationships between different elements of a sequence.
The same general idea can be adapted to scientific datasets.
For weather forecasting, a Transformer can learn relationships between different spatial and temporal regions.
Instead of looking only at what is happening at one location, the model can learn which other regions may contain information relevant to predicting future atmospheric states.
Modern AI forecasting systems increasingly combine multiple neural-network architectures.
ECMWF's Artificial Intelligence Forecasting System, known as AIFS, is one example.
Its architecture combines graph-based and Transformer-based components to process large-scale atmospheric information.
This illustrates an important principle in scientific AI:
The goal is not necessarily to find one universal neural-network architecture.
The goal is to design architectures that match the structure of the scientific problem.
AI weather forecasting is no longer limited to research demonstrations.
The European Centre for Medium-Range Weather Forecasts has introduced its Artificial Intelligence Forecasting System into operational forecasting.
ECMWF currently operates AIFS as both a deterministic system and an ensemble system.
The current operational AIFS version is AIFS v2, introduced in May 2026.
The system operates alongside ECMWF's traditional physics-based Integrated Forecasting System.
This is an important development because it shows that AI forecasting is becoming part of real operational meteorology rather than existing only as an academic experiment.
The relationship between the two approaches is also important.
Traditional physics-based forecasting remains essential for many applications, including high-resolution forecasting and coupled Earth-system processes.
AI provides another forecasting pathway with different computational characteristics.
The future is therefore not necessarily about choosing one system and eliminating the other.
It may involve using both.
Weather forecasting is inherently uncertain.
The atmosphere is chaotic, meaning that small differences in the initial state can eventually produce substantially different outcomes.
This is why operational forecasting systems often use ensembles.
Instead of producing only one future, an ensemble generates multiple possible futures.
This provides information about uncertainty.
Google DeepMind's GenCast demonstrated how generative machine learning can be used for probabilistic weather forecasting.
Rather than producing a single deterministic atmospheric trajectory, GenCast generates multiple possible future states.
This changes the question from:
What will happen?
to:
What are the plausible things that could happen, and how does their likelihood vary?
That information can be extremely valuable.
A decision-maker dealing with a potential storm, flood, or heat event needs more than a single prediction.
Understanding uncertainty can be just as important as understanding the central forecast.
This distinction is essential.
Weather prediction and climate projection are related, but they are not the same problem.
Weather forecasting generally focuses on relatively short timescales.
For example:
What will the atmosphere look like tomorrow?
What could happen over the next week?
How might a storm develop over the next several days?
Climate science focuses on longer-term behavior.
Questions include:
How might average temperatures change?
How could precipitation patterns evolve?
How might extreme-event statistics change?
How could regional climate risks develop?
Therefore, a machine-learning system that performs extremely well at weather forecasting should not automatically be described as a complete climate model.
Short-term forecasting and long-term climate simulation have different scientific requirements.
This distinction becomes particularly important when discussing AI and climate change.
One of the biggest challenges facing purely data-driven models is the dependence on historical data.
Suppose a neural network learns atmospheric behavior from several decades of historical datasets.
It learns the statistical relationships represented in those examples.
But the climate system is changing.
Future atmospheric conditions may contain combinations of variables that are poorly represented in historical training data.
This creates an out-of-distribution problem.
A model can perform extremely well when operating within the statistical range represented by its training data while becoming less reliable when conditions change.
This is one reason why simply replacing physics-based models with neural networks is not straightforward.
Physical equations provide scientific constraints that do not depend entirely on whether a particular state appeared in a training dataset.
Machine learning does not automatically provide the same guarantees.
This leads to one of the most promising directions in the field.
Instead of asking whether AI should replace physics, researchers can ask:
Which parts of a physical model can machine learning improve, accelerate, or approximate?
This creates hybrid systems.
A hybrid environmental model can combine:
Physics + Machine Learning + Observations + Data Assimilation
Physics provides scientific structure.
Machine learning provides flexible approximations.
Observations provide information about the real world.
Data assimilation connects observations with model states.
This approach may be more useful than treating AI and physics as competing technologies.
Research systems such as NeuralGCM demonstrate this movement toward hybrid modeling.
Instead of asking a neural network to reproduce every aspect of atmospheric behavior independently, machine learning can be integrated into a framework that still incorporates physical modeling.
This changes the central question.
Instead of asking:
Can AI replace physics?
we can ask:
How can AI and physical models work together?
That question opens opportunities across many scientific fields.
The same philosophy can be applied to atmospheric science, ocean modeling, energy systems, environmental transport, and other areas where physical knowledge and large datasets are available.
Global forecasting systems operate at relatively large spatial scales.
But real-world decisions often happen at much smaller scales.
A city needs to understand heat exposure.
Farmers need information about agricultural conditions.
Coastal communities need information about flooding.
Infrastructure operators need to understand local environmental risks.
This creates the problem of downscaling.
Downscaling attempts to transform information from larger-scale models into higher-resolution local information.
Machine learning can help by learning relationships between large-scale atmospheric conditions and local environmental patterns.
This can potentially provide detailed local information without requiring every global simulation to operate at extremely high resolution.
AI-enabled downscaling is therefore becoming an important research direction for climate-risk analysis.
Extreme events are particularly difficult for machine learning.
Why?
Because they are rare.
A dataset can contain thousands of ordinary atmospheric situations but relatively few extremely severe events.
This creates a difficult learning problem.
A model may become highly accurate for common weather patterns while struggling with events that matter most from a societal perspective.
Examples include:
Extreme rainfall
Heat waves
Droughts
Tropical cyclones
Flooding
Wildfires
Compound weather events
This means that average forecast accuracy is not the only metric that matters.
Researchers also need to understand how models behave at the extremes of probability distributions.
The rarest events can be among the most consequential.
The impact of AI extends far beyond weather forecasting.
Machine learning can analyze satellite imagery, sensor measurements, environmental observations, and scientific datasets.
For wildfire monitoring, AI can identify patterns associated with fire development and environmental conditions.
For forests, computer vision can analyze satellite imagery to detect changes in vegetation and land cover.
For water systems, machine learning can analyze rainfall, temperature, water quality, and hydrological information.
For cities, AI can combine weather observations, satellite data, sensors, and infrastructure information to study environmental risks.
This creates a broader field that can be described as environmental intelligence.
Environmental intelligence combines:
Artificial Intelligence + Remote Sensing + Sensors + Scientific Models + Environmental Data
The objective is not simply to predict weather.
It is to understand the changing Earth system.
There is an important environmental question surrounding AI itself.
AI can make some scientific forecasting tasks dramatically more computationally efficient.
But training large neural networks also requires substantial computing resources.
Modern AI systems depend on GPUs, data centers, electricity, cooling infrastructure, and large datasets.
Therefore, evaluating AI's environmental impact requires looking at the complete lifecycle.
The relevant question is not simply:
Is the AI model faster?
It is:
How much energy was required to train it, how much energy is required to operate it, and how does that compare with the system it replaces or complements?
This is an increasingly important research question as AI becomes part of scientific computing.
Behind modern AI weather systems is an enormous amount of environmental data.
Reanalysis datasets such as ERA5 provide decades of information about the atmosphere.
These datasets contain variables such as temperature, pressure, wind, humidity, and many other atmospheric properties.
For machine learning, these datasets provide the examples from which models learn.
But data quality is critical.
Errors, missing observations, measurement biases, changes in observing systems, and limitations in historical coverage can all influence what a model learns.
A neural network cannot automatically correct every weakness in its training data.
This means that progress in environmental AI depends not only on better neural architectures.
It also depends on:
Better observations
Better datasets
Better data assimilation
Better validation
Better scientific understanding
Another major challenge is understanding why an AI model produced a particular prediction.
Traditional numerical models are based on explicitly defined physical equations.
Neural networks can contain millions or billions of learned parameters.
Even when their predictions are accurate, their internal behavior can be difficult to interpret.
This creates an important question for scientific applications:
Can scientists trust a prediction if they cannot understand the mechanisms behind it?
This is why researchers are investigating interpretability, uncertainty estimation, physical constraints, and scientific validation.
For environmental applications, accuracy alone is not enough.
A useful scientific system should also provide information about uncertainty and behave consistently with established scientific knowledge.
Another important question is long-term stability.
Many AI weather systems generate predictions step by step.
The output from one step becomes the input for the next.
If small errors accumulate over time, the model can eventually drift away from physically realistic states.
This matters particularly for climate applications.
A system that performs well for several days is not automatically suitable for simulations over much longer timescales.
Long-term climate analysis requires models to preserve meaningful statistical and physical behavior.
Therefore, future AI systems will need to be evaluated not only by short-term forecast accuracy, but also by their stability over extended simulations.
The next generation of environmental AI will probably not be defined by one neural-network architecture.
Instead, several technologies are converging.
Machine learning provides pattern recognition and computational efficiency.
Physics provides scientific structure.
Satellites provide global observations.
Ground sensors provide local measurements.
Data assimilation connects observations with models.
High-performance computing provides the infrastructure required for large-scale scientific workloads.
Together, these technologies form the foundation of a new generation of Earth-system intelligence.
The most useful systems may therefore be neither purely AI nor purely physics-based.
They may be integrated systems that use different computational approaches for different parts of the problem.
Several major questions remain open.
How well can AI models generalize to atmospheric conditions that differ from their training data?
Can machine learning reliably represent rare extreme events?
How can physical constraints be incorporated without removing the flexibility of neural networks?
How should uncertainty be represented?
How can AI forecasts be scientifically validated?
How much energy does the complete AI lifecycle require?
Can neural models remain stable during long simulations?
How should AI-generated climate information be communicated to decision-makers?
These questions demonstrate that the field is still developing.
The next major breakthroughs may not simply come from building larger models.
They may come from building models that are more physically consistent, interpretable, efficient, and scientifically reliable.
Conclusion
Artificial intelligence is changing the way researchers approach weather and environmental modeling.
Graph Neural Networks have demonstrated that atmospheric relationships can be learned from large-scale datasets.
Transformers have provided powerful mechanisms for modeling complex spatial and temporal relationships.
Systems such as GraphCast and GenCast have demonstrated the potential of machine learning for fast and probabilistic weather forecasting.
ECMWF's operational AIFS shows that AI forecasting is moving from research environments into real operational meteorology.
At the same time, hybrid approaches demonstrate that machine learning does not have to replace physical modeling.
The future may instead depend on combining the strengths of both.
Physics can provide structure.
Machine learning can provide flexible approximations.
Observations can provide information about the real world.
Data assimilation can connect observations with models.
Satellites and sensors can provide increasingly detailed environmental measurements.
Together, these technologies could make environmental prediction faster, more detailed, and more accessible.
The biggest opportunity is therefore not simply to build an AI system that predicts tomorrow's weather.
It is to develop intelligent scientific systems capable of helping humanity understand a rapidly changing planet.
AI may not replace the science of climate and weather.
It may become one of the most powerful tools available for extending it.
References and Further Reading
European Centre for Medium-Range Weather Forecasts — Artificial Intelligence Forecasting System
European Centre for Medium-Range Weather Forecasts — Integrated Forecasting System
GraphCast — Learning skillful medium-range global weather forecasting
GenCast — Diffusion-based ensemble forecasting for medium-range weather
ERA5 — ECMWF Reanalysis Dataset
NeuralGCM — Hybrid machine-learning and physics-based atmospheric modeling
NASA research on AI-enabled climate downscaling and Earth-system applications
AI Disclosure
This article was prepared with the assistance of generative AI. The technical content was reviewed and structured around published information from scientific and institutional sources. Readers should consult the original research and documentation for detailed methodology and results.