Jo Bovy

Rapid strides are currently being made in the field of artificial intelligence using transformer-based models like Large Language Models (LLMs). The potential of these methods for creating a single, large, versatile model in astronomy has not yet been explored. In this work, we propose a framework for data-driven astronomy that uses the same core techniques and architecture as used by LLMs. Using a variety of observations and labels of stars as an example, we build a transformer-based model and train it in a self-supervised manner with cross-survey data sets to perform a variety of inference tasks. In particular, we demonstrate that a single model can perform both discriminative and generative tasks even if the model was not trained or fine-tuned to do any specific task. For example, on the discriminative task of deriving stellar parameters from Gaia XP spectra, we achieve an accuracy of 47 K in Teff, 0.11 dex in log g, and 0.07 dex in [M/H], outperforming an expert XGBoost model in the same setting. But the same model can also generate XP spectra from stellar parameters, inpaint unobserved spectral regions, extract empirical stellar loci, and even determine the interstellar extinction curve. Our framework demonstrates that building and training a single foundation model without fine-tuning using data and parameters from multiple surveys to predict unmeasured observations and parameters is well within reach. Such ‘Large Astronomy Models’ trained on large quantities of observational data will play a large role in the analysis of current and future large surveys.

In the Milky Way, the distribution of stars in the [α/Fe] versus [Fe/H] and [Fe/H] versus age planes holds essential information about the history of star formation, accretion, and dynamical evolution of the Galactic disc. We investigate these planes by applying novel statistical methods called copulas and elicitable maps to the ages and abundances of red giants in the Apache Point Observatory Galactic Evolution Experiment survey. We find that the high- and low-α disc stars have a clean separation in copula space and use this to provide an automated separation of the α sequences using a purely statistical approach. This separation reveals that the high-α disc ends at the same [α/Fe] and age at high [Fe/H] as the low-[Fe/H] start of the low-α disc, thus supporting a sequential formation scenario for the high- and low-α discs. We then combine copulas with elicitable maps to precisely obtain the correlation between stellar age τ and metallicity [Fe/H] conditional on Galactocentric radius R and height z in the range 0 < R < 20 kpc and |z| < 2 kpc. The resulting trends in the age–metallicity correlation with radius, height, and [α/Fe] demonstrate a ≈0 correlation wherever kinematically cold orbits dominate, while the naively expected negative correlation is present where kinematically hot orbits dominate. This is consistent with the effects of spiral-driven radial migration, which must be strong enough to completely flatten the age–metallicity structure of the low-α disc.