-
Applying Information Theory to Design Optimal Filters for Photometric Redshifts
Authors:
J. Bryce Kalmbach,
Jacob T. VanderPlas,
Andrew J. Connolly
Abstract:
In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wav…
▽ More
In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wavelengths that optimize photometric redshifts for $z <= 2.3$ and $i < 25.3$. We create a simulated catalog for these optimal filters and use our filters with a photometric redshift estimation code to show that we can improve the standard deviation of the photometric redshift error by 7.1% overall and improve outliers 9.9% over the standard filters proposed for the Large Synoptic Survey Telescope (LSST). We compare features of our optimal filters to LSST and find that the LSST filters incorporate key features for optimal photometric redshift estimation. Finally, we describe how information theory can be applied to a range of optimization problems in astronomy.
△ Less
Submitted 5 January, 2020;
originally announced January 2020.
-
On The XUV Luminosity Evolution of TRAPPIST-1
Authors:
David P. Fleming,
Rory Barnes,
Rodrigo Luger,
Jacob T. VanderPlas
Abstract:
We model the long-term XUV luminosity of TRAPPIST-1 to constrain the evolving high-energy radiation environment experienced by its planetary system. Using Markov Chain Monte Carlo (MCMC), we derive probabilistic constraints for TRAPPIST-1's stellar and XUV evolution that account for observational uncertainties, degeneracies between model parameters, and empirical data of low-mass stars. We constra…
▽ More
We model the long-term XUV luminosity of TRAPPIST-1 to constrain the evolving high-energy radiation environment experienced by its planetary system. Using Markov Chain Monte Carlo (MCMC), we derive probabilistic constraints for TRAPPIST-1's stellar and XUV evolution that account for observational uncertainties, degeneracies between model parameters, and empirical data of low-mass stars. We constrain TRAPPIST-1's mass to $m_{\star} = 0.089 \pm{0.001}$ M$_{\odot}$ and find that its early XUV luminosity likely saturated at $\log_{10}(L_{XUV}/L_{bol}) = -3.03^{+0.23}_{-0.12}$. From the posterior distribution, we infer that there is a ${\sim}40\%$ chance that TRAPPIST-1 is still in the saturated phase today, suggesting that TRAPPIST-1 has maintained high activity and $L_{XUV}/L_{bol} \approx 10^{-3}$ for several Gyrs. TRAPPIST-1's planetary system therefore likely experienced a persistent and extreme XUV flux environment, potentially driving significant atmospheric erosion and volatile loss. The inner planets likely received XUV fluxes ${\sim}10^3 - 10^4\times$ that of the modern Earth during TRAPPIST-1's ${\sim}1$ Gyr-long pre-main sequence phase. Deriving these constraints via MCMC is computationally non-trivial, so scaling our methods to constrain the XUV evolution of a larger number of M dwarfs that harbor terrestrial exoplanets would incur significant computational expenses. We demonstrate that approxposterior, an open source Python machine learning package for approximate Bayesian inference using Gaussian processes, accurately and efficiently replicates our analysis using $980\times$ less computational time and $1330\times$ fewer simulations than MCMC sampling using emcee. We find that approxposterior derives constraints with mean errors on the best fit values and $1σ$ uncertainties of $0.61\%$ and $5.5\%$, respectively, relative to emcee.
△ Less
Submitted 17 February, 2020; v1 submitted 12 June, 2019;
originally announced June 2019.
-
The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
Authors:
The Astropy Collaboration,
A. M. Price-Whelan,
B. M. Sipőcz,
H. M. Günther,
P. L. Lim,
S. M. Crawford,
S. Conseil,
D. L. Shupe,
M. W. Craig,
N. Dencheva,
A. Ginsburg,
J. T. VanderPlas,
L. D. Bradley,
D. Pérez-Suárez,
M. de Val-Borro,
T. L. Aldcroft,
K. L. Cruz,
T. P. Robitaille,
E. J. Tollerud,
C. Ardelean,
T. Babej,
M. Bachetti,
A. V. Bakanov,
S. P. Bamford,
G. Barentsen
, et al. (112 additional authors not shown)
Abstract:
The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy p…
▽ More
The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.
△ Less
Submitted 16 January, 2018; v1 submitted 8 January, 2018;
originally announced January 2018.
-
Understanding the Lomb-Scargle Periodogram
Authors:
Jacob T. VanderPlas
Abstract:
The Lomb-Scargle periodogram is a well-known algorithm for detecting and characterizing periodic signals in unevenly-sampled data. This paper presents a conceptual introduction to the Lomb-Scargle periodogram and important practical considerations for its use. Rather than a rigorous mathematical treatment, the goal of this paper is to build intuition about what assumptions are implicit in the use…
▽ More
The Lomb-Scargle periodogram is a well-known algorithm for detecting and characterizing periodic signals in unevenly-sampled data. This paper presents a conceptual introduction to the Lomb-Scargle periodogram and important practical considerations for its use. Rather than a rigorous mathematical treatment, the goal of this paper is to build intuition about what assumptions are implicit in the use of the Lomb-Scargle periodogram and related estimators of periodicity, so as to motivate important practical considerations required in its proper application and interpretation.
△ Less
Submitted 28 March, 2017;
originally announced March 2017.
-
Periodograms for Multiband Astronomical Time Series
Authors:
Jacob T. VanderPlas,
Zeljko Ivezic
Abstract:
This paper introduces the multiband periodogram, a general extension of the well-known Lomb-Scargle approach for detecting periodic signals in time-domain data. In addition to advantages of the Lomb-Scargle method such as treatment of non-uniform sampling and heteroscedastic errors, the multiband periodogram significantly improves period finding for randomly sampled multiband light curves (e.g., P…
▽ More
This paper introduces the multiband periodogram, a general extension of the well-known Lomb-Scargle approach for detecting periodic signals in time-domain data. In addition to advantages of the Lomb-Scargle method such as treatment of non-uniform sampling and heteroscedastic errors, the multiband periodogram significantly improves period finding for randomly sampled multiband light curves (e.g., Pan-STARRS, DES and LSST). The light curves in each band are modeled as arbitrary truncated Fourier series, with the period and phase shared across all bands. The key aspect is the use of Tikhonov regularization which drives most of the variability into the so-called base model common to all bands, while fits for individual bands describe residuals relative to the base model and typically require lower-order Fourier series. This decrease in the effective model complexity is the main reason for improved performance. We use simulated light curves and randomly subsampled SDSS Stripe 82 data to demonstrate the superiority of this method compared to other methods from the literature, and find that this method will be able to efficiently determine the correct period in the majority of LSST's bright RR Lyrae stars with as little as six months of LSST data. A Python implementation of this method, along with code to fully reproduce the results reported here, is available on GitHub.
△ Less
Submitted 4 February, 2015;
originally announced February 2015.
-
Introduction to astroML: Machine Learning for Astrophysics
Authors:
Jacob T. VanderPlas,
Andrew J. Connolly,
Zeljko Ivezic,
Alex Gray
Abstract:
Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of terabytes of astronomical data for hundreds of millions of sources. Over the next decade, the data volume will enter the petabyte domain, and provide accurate…
▽ More
Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of terabytes of astronomical data for hundreds of millions of sources. Over the next decade, the data volume will enter the petabyte domain, and provide accurate measurements for billions of sources. Astronomy and physics students are not traditionally trained to handle such voluminous and complex data sets. In this paper we describe astroML; an initiative, based on Python and scikit-learn, to develop a compendium of machine learning tools designed to address the statistical needs of the next generation of students and astronomical surveys. We introduce astroML and present a number of example applications that are enabled by this package.
△ Less
Submitted 18 November, 2014;
originally announced November 2014.
-
Karhunen-Loeve Analysis for Weak Gravitational Lensing
Authors:
Jacob T Vanderplas
Abstract:
In the past decade, weak gravitational lensing has become an important tool in the study of the universe at the largest scale, giving insights into the distribution of dark matter, the expansion of the universe, and the nature of dark energy. This thesis research explores several applications of Karhunen-Loeve (KL) analysis to speed and improve the comparison of weak lensing shear catalogs to theo…
▽ More
In the past decade, weak gravitational lensing has become an important tool in the study of the universe at the largest scale, giving insights into the distribution of dark matter, the expansion of the universe, and the nature of dark energy. This thesis research explores several applications of Karhunen-Loeve (KL) analysis to speed and improve the comparison of weak lensing shear catalogs to theory in order to constrain cosmological parameters in current and future lensing surveys. After providing a brief introduction to cosmology and to KL analysis, this work addresses three related aspects of weak lensing analysis: (1) Three-dimensional tomographic mapping (based on work published in Vanderplas et al. 2011); (2) Shear peak statistics with incomplete/gappy data (based on work published in Vanderplas et al. 2012); and (3) two-point parameter estimation from gappy data using KL modes (previously unpublished)... [this abstract has been abbreviated; please see the thesis for the full abstract].
△ Less
Submitted 28 January, 2013;
originally announced January 2013.
-
First-year Sloan Digital Sky Survey-II (SDSS-II) supernova results: consistency and constraints with other intermediate-redshift datasets
Authors:
H. Lampeitl,
R. C. Nichol,
H. -J. Seo,
T. Giannantonio,
C. Shapiro,
B. Bassett,
W. J. Percival,
T. M. Davis,
B. Dilday,
J. Frieman,
P. Garnavich,
M. Sako,
M. Smith,
J. Sollerman,
A. C. Becker,
D. Cinabro,
A. V. Filippenko,
R. J. Foley,
C. J. Hogan,
J. A. Holtzman,
S. W. Jha,
K. Konishi,
J. Marriner,
M. W. Richmond,
A. G. Riess
, et al. (6 additional authors not shown)
Abstract:
We present an analysis of the luminosity distances of Type Ia Supernovae from the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey in conjunction with other intermediate redshift (z<0.4) cosmological measurements including redshift-space distortions from the Two-degree Field Galaxy Redshift Survey (2dFGRS), the Integrated Sachs-Wolfe (ISW) effect seen by the SDSS, and the latest Baryon Aco…
▽ More
We present an analysis of the luminosity distances of Type Ia Supernovae from the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey in conjunction with other intermediate redshift (z<0.4) cosmological measurements including redshift-space distortions from the Two-degree Field Galaxy Redshift Survey (2dFGRS), the Integrated Sachs-Wolfe (ISW) effect seen by the SDSS, and the latest Baryon Acoustic Oscillation (BAO) distance scale from both the SDSS and 2dFGRS. We have analysed the SDSS-II SN data alone using a variety of "model-independent" methods and find evidence for an accelerating universe at >97% level from this single dataset. We find good agreement between the supernova and BAO distance measurements, both consistent with a Lambda-dominated CDM cosmology, as demonstrated through an analysis of the distance duality relationship between the luminosity (d_L) and angular diameter (d_A) distance measures. We then use these data to estimate w within this restricted redshift range (z<0.4). Our most stringent result comes from the combination of all our intermediate-redshift data (SDSS-II SNe, BAO, ISW and redshift-space distortions), giving w = -0.81 +0.16 -0.18(stat) +/- 0.15(sys) and Omega_M=0.22 +0.09 -0.08 assuming a flat universe. This value of w, and associated errors, only change slightly if curvature is allowed to vary, consistent with constraints from the Cosmic Microwave Background. We also consider more limited combinations of the geometrical (SN, BAO) and dynamical (ISW, redshift-space distortions) probes.
△ Less
Submitted 12 October, 2009;
originally announced October 2009.
-
First-Year Sloan Digital Sky Survey-II (SDSS-II) Supernova Results: Constraints on Non-Standard Cosmological Models
Authors:
J. Sollerman,
E. Mörtsell,
T. M. Davis,
M. Blomqvist,
B. Bassett,
A. C. Becker,
D. Cinabro,
A. V. Filippenko,
R. J. Foley,
J. Frieman,
P. Garnavich,
H. Lampeitl,
J. Marriner,
R. Miquel,
R. C. Nichol,
M. W. Richmond,
M. Sako,
D. P. Schneider,
M. Smith,
J. T. Vanderplas,
J. C. Wheeler
Abstract:
We use the new SNe Ia discovered by the SDSS-II Supernova Survey together with additional supernova datasets as well as observations of the cosmic microwave background and baryon acoustic oscillations to constrain cosmological models. This complements the analysis presented by Kessler et al. in that we discuss and rank a number of the most popular non-standard cosmology scenarios. When this comb…
▽ More
We use the new SNe Ia discovered by the SDSS-II Supernova Survey together with additional supernova datasets as well as observations of the cosmic microwave background and baryon acoustic oscillations to constrain cosmological models. This complements the analysis presented by Kessler et al. in that we discuss and rank a number of the most popular non-standard cosmology scenarios. When this combined data-set is analyzed using the MLCS2k2 light-curve fitter, we find that more exotic models for cosmic acceleration provide a better fit to the data than the Lambda-CDM model. For example, the flat DGP model is ranked higher by our information criteria tests than the standard model. When the dataset is instead analyzed using the SALT-II light-curve fitter, the standard cosmological constant model fares best. Our investigation also includes inhomogeneous Lemaitre-Tolman-Bondi (LTB) models. While our LTB models can be made to fit the supernova data as well as any other model, the extra parameters they require are not supported by our information criteria analysis.
△ Less
Submitted 1 September, 2009; v1 submitted 28 August, 2009;
originally announced August 2009.
-
Reducing the Dimensionality of Data: Locally Linear Embedding of Sloan Galaxy Spectra
Authors:
J. T. VanderPlas,
A. J. Connolly
Abstract:
We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the context of computer perception. We compare the performance of LLE to well-known spectral classification techniques, e.g. principal component analysis and line-rat…
▽ More
We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the context of computer perception. We compare the performance of LLE to well-known spectral classification techniques, e.g. principal component analysis and line-ratio diagnostics. We find that LLE combines the strengths of both methods in a single, coherent technique, and leads to improved classification of emission-line spectra at a relatively small computational cost. We also present a data subsampling technique that preserves local information content, and proves effective for creating small, efficient training samples from a large, high-dimensional data sets. Software used in this LLE-based classification is made available.
△ Less
Submitted 14 July, 2009;
originally announced July 2009.
