Processing and compression of noise-dominated data: application to the cosmic microwave background data on board the Planck satellite

We address the problem of encoding and compressing data dominated by noise. Information is decomposed into 'reference' sequences plus arrays containing noisy differences susceptible to being described by a known probability distribution. One can then give reliable estimates of the optimal compression rates by estimating the corresponding Shannon entropy. As a working example, this idea is applied to an idealized model of the cosmic microwave background (CMB) data on board the Planck satellite. Data reduction is a critical issue in space missions because the total information that can be downloaded to Earth is sometimes limited by telemetry allocation. Similar limitations might arise in remotely operated ground based telescopes. This download-rate limitation could reduce the amount of diagnostics sent on the stability of the instruments and, as a consequence, curb the final sensitivity of the scientific signal. Our proposal for Planck consists of taking differences of consecutive circles at a given sky pointing. To a good approximation, these differences could be made independent of the external signal, so that they are dominated by thermal (white) instrumental noise, which is simpler to model than the sky signal. Similar approaches can be found in other individual applications. Generic simulations and analytical predictions show that high compression rates,     can be obtained with minor or zero loss of sensitivity. Possible effects of digital distortion are also analysed. The proposed scheme is flexible and reliable enough to be optimized in relation to other critical aspects of the corresponding application. For Planck , this study constitutes an important step towards a more realistic modelling of the final sensitivity of the CMB temperature anisotropy maps.     

The Sunyaev–Zel'dovich effect as a cosmological discriminator

We show how future measurements of the Sunyaev–Zel'dovich effect (SZE) can be used to constrain the cosmological parameters. We combine the SZ information expected from the Planck full-sky survey, N ( S ), where no redshift information is included, with the N ( z ) obtained from an optically identified SZ-selected survey covering less than 1 per cent of the sky. We demonstrate how with a small subsample (≈300 clusters) of the whole SZ catalogue observed optically it is possible to reduce the degeneracy among the cosmological parameters drastically. We have studied the requirements for performing the optical follow-up and we show the feasibility of such a project. Finally, we have compared the cluster expectations for Planck with those expected for Newton–XMM during their lifetimes. It is shown that, owing to its larger sky coverage, Planck will detect a factor of ∼5 times more clusters than Newton–XMM and also provide a larger redshift coverage.     

An update on Archeops: flights and data products

Archeops is a balloon-borne instrument dedicated to measuring cosmic microwave background (CMB) temperature anisotropies at high angular resolution (～ 8 arcminutes) over a large fraction (～ 30%) of the sky in the millimetre domain. The general design is based on Planck High Frequency Instrument (HFI) technology. Bolometers cooled to 0.1 K scan the sky in total power mode along large circles at constant elevation. Archeops is designed to observe a complete annulus on the sky covering all right ascensions between about 25 and 55 degrees during the course of a 24-hour Arctic-night balloon flight, in four frequency bands centered at 143, 217, 353 and 545 GHz. We describe the Archeops flights and the data products obtained during the three successful flights from Trapani (Sicily) to Spain in July 1999, and from Kiruna (Sweden) to Russia in January 2001 and February 2002. We discuss present Archeops results and the future use of Archeops data.     

Harmonic analysis of cosmic microwave background data – I. Ring reductions and point-source catalogue

We present a harmonic model for the data analysis of an all-sky cosmic microwave background survey, such as Planck , where the survey is obtained through ring-scans of the sky. In this model, resampling and pixelization of the data are avoided. The spherical transforms of the sky at each frequency, in total intensity and polarization, as well as the bright-point-source catalogue, are derived directly from the data reduced on to the rings. Formal errors and the most significant correlation coefficients for the spherical transforms of the frequency maps are preserved. A clean and transparent path from the original samplings in the time domain to the final scientific products is thus obtained. The data analysis is largely based on Fourier analysis of rings; the positional stability of the instrument's spin axis during these scans is a requirement for the data model and is investigated here for the Planck satellite. Brighter point sources are recognized and extracted as part of the ring reductions and, on the basis of accumulated data, used to build the bright-point-source catalogue. The analysis of the rings is performed in an iterative loop, involving a range of geometric and detector response calibrations. The geometric calibrations are used to reconstruct the paths of the detectors over the sky during a scan and the phase offsets between scans of different detectors; the response calibrations eliminate short- and long-term variations in detector response. Point-source information may allow the reconstruction of the beam profile. The reconstructed spherical transforms of the sky in each frequency channel form the input to the subsequent analysis stages. Although the methods in this paper were developed with the data processing for the Planck satellite in mind, there are many aspects which have wider implementation possibilities, including the construction of real-space pixelized maps.     

Observational constraints on the nature of very short gamma-ray bursts

We discuss a very peculiar subgroup of gamma-ray bursts among the BATSE sources. These bursts are very short (T₉₀ ? 0.1 s), hard, and came predominantly from a restricted direction of the sky (close to the Galactic anti-center). We analyze their arrival times and possible correlations, as well as the profiles of individual bursts. We find no peculiarities in the arrival times of Very Short Bursts (VSBs) despite their highly non-uniform spatial distribution. There is no dependence in the burst shapes on location. Bursts coming both from the burst-enhancement Galactic Anticenter region and from all other directions show considerable dispersion in their rise and fall times. Significant fraction of VSBs have multiple peaks despite their extremely short duration. Burst time properties are most likely to be consistent with two origin mechanisms: either with binary NS–NS mergers with low total masses passing through a phase of hypermassive neutron star, or with evaporation of the primordial black holes in the scenario of no photosphere formation.     

An extension of the Planck galaxy cluster catalogue

We present a catalogue of galaxy clusters detected in the Planck all-sky Compton parameter maps and identified using data from the WISE and SDSS surveys. The catalogue comprises about 3000 clusters in the SDSS fields. We expect the completeness of this catalogue to be high for clusters with masses larger than M ₅₀₀ ≈ 3 × 10¹⁴ M _⊙, located at redshifts z < 0.7. At redshifts above z ≈ 0.4, the catalogue contains approximately an order of magnitude more clusters than the 2nd Planck Catalogue of Sunyaev-Zeldovich sources in the same fields of the sky. This catalogue can be used for identification of massive galaxy clusters in future large cluster surveys, such as the SRG/eROSITA all-sky X-ray survey.     

Using a New Sky Brightness Monitor to Observe the Annular Solar Eclipse on 15 January 2010

For the future development of Chinese Giant Solar Telescope (CGST) in Western China, a new sky brightness monitor (SBM) has been produced for the site survey for CGST. To critically examine the performance and sensitivity of SBM, we used it in the observation of the annular solar eclipse in Dali City, Yunnan, on 15 January 2010. The observation met good weather conditions with an almost clear sky during the eclipse. The SBM measurement translates into the solar illuminance changes at a level of 2.4×10^?4 I?s^?1 during the eclipse. The time of the minimal sky brightness in the field of view (FOV) is found consistent with the time of maximum eclipse. Two local sky regions in the FOV are chosen to make a time series of the calibrated skylight profiles. The evolution of the sky brightness thus calibrated also shows good consistency with the eclipse, particularly between the second and the third contacts. The minimal sky brightness in each local sky region took place within half a minute from the corresponding predicted contact time. Such small time delays were mainly caused by occasional cirri. The minimal sky brightness measured during the eclipse is a few millionths of I _?? with standard deviation of 0.11 millionths of I _??. The observation supports that the single-scattering process (optically thin conditions) is the main contributor to the atmospheric scattering. We have demonstrated that many important aerosol optical parameters can be deduced from our data. We conclude that the new SBM is a sensitive sky photometer that can be used for our CGST and coronagraph site surveys.     

A comparison of anisotropic statistical properties of CMB maps based on the WMAP and planck space mission data

We compare the anisotropic properties of the cosmic microwave background (CMB) maps constructed based on the data of NASA’s WMAP (9th year of observations) and ESA’s Planck (2015 release) space missions. In our analysis, we use two two-dimensional estimators of the scatter of the signal on a sphere, which amount to algorithms of mapping the ratio of the scatter in the Northern and Southern hemispheres depending on the method of dividing (specifically, rotating and cutting) the sky into hemispheres. The scatter is computed either as a standard deviation σ, or as the difference between the minimum and maximum values on a given hemisphere. Applying both estimators to the CMB anisotropy datameasured by two spacemissions, Planck and WMAP, we compared the variations of the background at different angular scales.Maps with a resolution of l ≤ 100 show that the division into regions with different levels of statistical anisotropy lies close to the ecliptic plane, and after preliminary removal of the l ≤ 20 harmonics from the CMB data, the anisotropic signal related to the Galaxy begins to dominate.     

How well do we understand cosmological recombination?

The major theoretical limitation for extracting cosmological parameters from the cosmic microwave background (CMB) sky lies in the precision with which we can calculate the cosmological recombination process. Uncertainty in the details of hydrogen and helium recombination could effectively increase the errors or bias the values of the cosmological parameters derived from the Planck satellite, for example. Here, we modify the cosmological recombination code recfast by introducing one more parameter to reproduce the recent numerical results for the speed-up of the helium recombination. Together with the existing hydrogen fudge factor, we vary these two parameters to account for the remaining dominant uncertainties in cosmological recombination. By using the C osmo MC code with Planck forecast data, we find that we need to determine the parameters to better than 10 per cent for He  i and 1 per cent for H, in order to obtain negligible effects on the cosmological parameters. For helium recombination, if the existing studies have calculated the ionization fraction to the 0.1 per cent level by properly including the relevant physical processes, then we already have numerical calculations which are accurate enough for Planck . For hydrogen, setting the fudge factor to speed up low-redshift recombination by 14 per cent appears to be sufficient for Planck . However, more work still needs to be done to carry out comprehensive numerical calculations of all the relevant effects for hydrogen, as well as to check for effects which couple hydrogen and helium recombination through the radiation field.     

Maximum likelihood algorithm for parametric component separation in cosmic microwave background experiments

We discuss an approach to the component separation of microwave, multifrequency sky maps as those typically produced from cosmic microwave background (CMB) anisotropy data sets. The algorithm is based on the two-step, parametric, likelihood-based technique recently elaborated on by Eriksen et al., where the foreground spectral parameters are estimated prior to the actual separation of the components. In contrast with the previous approaches, we accomplish the former task with help of an analytically derived likelihood function for the spectral parameters, which, we show, yields estimates equal to the maximum likelihood values of the full multidimensional data problem. We then use these estimates to perform the second step via the standard, generalized-least-squares-like procedure. We demonstrate that the proposed approach is equivalent to a direct maximization of the full data likelihood, which is recast in a computationally tractable form. We use the corresponding curvature matrices to characterize statistical properties of the recovered parameters. We incorporate in the formalism some of the essential features of the CMB data sets, such as inhomogeneous pixel domain noise, unknown map offsets as well as calibration errors and study their consequences for the separation. We find that the calibration is likely to have a dominant effect on the precision of the spectral parameter determination for a realistic CMB experiment. We apply the algorithm to simulated data and discuss the results. Our focus is on partial sky, total intensity and polarization, CMB experiments such as planned balloon-borne and ground-based efforts, however, the techniques presented here should be also applicable to the full-sky data as for instance, those produced by the Wilkinson Microwave Anisotropy Probe ( WMAP ) satellite and anticipated from the Planck mission.     

The First Solar Seeing Profile Measurement with Two Apertures and Multiple Guide Regions

The sky brightness is a critical parameter for estimating the coronal observation conditions for a solar observatory. As part of a site-survey project in Western China, we measured the sky brightness continuously at the Lijiang Observatory in Yunnan province in 2011. A sky brightness monitor (SBM) was adopted to measure the sky brightness in a region extending from 4.5 to 7.0 apparent solar radii based on the experience of the Daniel K. Inouye Solar Telescope (DKIST) site survey. Every month, the data were collected manually for at least one week. We collected statistics of the sky brightness at four bandpasses located at 450, 530, 890, and 940 nm. The results indicate that aerosol scattering is of great importance for the diurnal variation of the sky brightness. For most of the year, the sky brightness remains under 20 millionths per airmass before local Noon. On average, the sky brightness is less than 20 millionths, which accounts for 40.41% of the total observing time on a clear day. The best observation time is from 9:00 to 13:00 (Beijing time). The Lijiang Observatory is therefore suitable for coronagraphs investigating the structures and dynamics of the corona.     

Gamma-ray bursts with peculiar temporal asymmetry

Based on Link & Epstein's study of temporal asymmetry of 631 gamma-ray bursts from the BATSE 3B catalogue, we identify the population of bursts with rising times that are longer than their decays, thus showing atypical profiles. We analyse their sky distribution, morphology, time–space clustering and other average properties and compare them with those associated with the bulk of the bursts. We show how most of the peculiar bursts analysed are consistent with recent fireball models, but a fraction of bursts (∼4 per cent of the total sample) appear to be inconsistent.     

Total ozone measurements derived from T.O.V.S. radiances

A new method of total ozone retrieval from i.r. satellite data(NOAA6) is presented. It uses ozone transmittance as a predictor of total ozone. Ozone transmittance at 9.6 μm(TR) is deduced from radiance at 9.6 μm(R9), surface temperature (TS) measured at 11 μm, and ozone mean temperature (TE) estimated from several channels (among them 9.6 μm) by the radiative transfer equation : R9 = B(TS) × TR + (1?TR) × B(TE) where B is the Planck function.A statistical analysis of the retrieved ozone field and a comparison with ground based measurements show that the S.E. is less than 5% for the considered data set.     

An Artificial Neural Network approach to classify SDSS stellar spectra

We present a combined method to classify stellar spectra of the seventh data release (DR7) of the SDSS via an Artificial Neural Network (ANN), derive radial velocities and to estimate distances from an isochrone fitting technique. In total, we used 29 182 spectra of stars falling in the effective temperature range between 10000 and 5500 K, including white dwarfs. The targets were selected on the basis of SDSS colours. We compare our results not only with the SEGUE Stellar Parameter Pipeline output, but also with already published values and find excellent agreement. With new and extensive data sets from all‐sky ground based as well as satellite missions, our approach will become very important and efficient to analyse these information (© 2011 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

Foreground removal from CMB temperature maps using an MLP neural network

One of the main obstacles for extracting the Cosmic Microwave Background (CMB) signal from observations in the mm-submm range is the foreground contamination by emission from Galactic components: mainly synchrotron, free-free and thermal dust emission. Due to the statistical nature of the intrinsic CMB signal it is essential to minimize the systematic errors in the CMB temperature determinations. Following the available knowledge of the spectral behavior of the Galactic foregrounds simple power law-like spectra have been assumed. The feasibility of using a simple neural network for extracting the CMB temperature signal from the combined signal CMB and the foregrounds has been investigated. As a specific example, we have analysed simulated data, as expected from the ESA Planck CMB mission. A simple multilayer perceptron neural network with 2 hidden layers can provide temperature estimates over more than 80 per cent of the sky that are to a high degree uncorrelated with the foreground signals. A single network will be able to cover the dynamic range of the Planck noise level over the entire sky.     

Validating Planck SZ2 clusters with optical counterparts

We perform an extensive analysis of optical counterparts of Planck PSZ2 clusters, considering matches with three recent catalogs built from Sloan Digital Sky Survey (SDSS) data: AMF DR9, redMaPPer (v6.3) and Wen et al (WHL). We significantly extend the number of optical counterparts of detected Planck clusters, and characterize the optical properties when multiple identifications in different catalogs exist. For Planck clusters which already possess an external validation, we analyze the redshift assignment from both optical and X–ray observations. We then analyze the Planck Cosmology Sample and comment on redshift and potential mass mis-determinations due to alignment issues. Finally, we inspect the reconstructed y-map from Planck and comment on the possibility of detecting further optical clusters. Overall, using the AMF DR9 main (extended) catalog, we find 485 (511) optical matches, with 45 (55) previously unmatched PSZ2 clusters, to be compared with the 374 optical matches already present in PSZ2. 29 of the 55 previously unmatched clusters do not yet have a follow-up observation in the literature. 18 of these are found in more than one SDSS catalog with consistent redshifts. We provide redshift and mass estimates for the newly matched clusters, and discuss the comparison with the follow-ups, when present. We find good agreement between the redMaPPer and AMF DR9 redshift determinations. AMF DR9 tends to predict lower redshifts for a few PSZ2 high–redshift clusters which were previously validated by an optical counterpart. From the Planck Cosmology Sample, optical matches are found for 204 of the 278 objects in the observed area. We find 14 clusters which merit further investigation and discuss possible alignment issues for 9 of them. After inspecting the y-map, we provide a list of 229 optical clusters not included in the Planck PSZ2 catalog, yet showing a prominent y signal. We have further investigated the clusters with the most prominent y signal using a proper MMF technique and we find 20 (12) clusters with a S/N  >  4.5 ( >  6) which are not included in the PSZ2 (cosmology sample) catalog. We discuss point source contamination for these objects.     

Cosmological science enabled by Planck

Planck will be the first mission to map the entire cosmic microwave background (CMB) sky with mJy sensitivity and resolution better than 10′. The science enabled by such a mission spans many areas of astrophysics and cosmology. In particular it will lead to a revolution in our understanding of primary and secondary CMB anisotropies, the constraints on many key cosmological parameters will be improved by almost an order of magnitude (to sub-percent levels) and the shape and amplitude of the mass power spectrum at high redshift will be tightly constrained.     

Uncertainty propagation in orbital mechanics via tensor decomposition

Uncertainty forecasting in orbital mechanics is an essential but difficult task, primarily because the underlying Fokker–Planck equation (FPE) is defined on a relatively high dimensional (6-D) state–space and is driven by the nonlinear perturbed Keplerian dynamics. In addition, an enormously large solution domain is required for numerical solution of this FPE (e.g. encompassing the entire orbit in the \(x-y-z\) subspace), of which the state probability density function (pdf) occupies a tiny fraction at any given time. This coupling of large size, high dimensionality and nonlinearity makes for a formidable computational task, and has caused the FPE for orbital uncertainty propagation to remain an unsolved problem. To the best of the authors’ knowledge, this paper presents the first successful direct solution of the FPE for perturbed Keplerian mechanics. To tackle the dimensionality issue, the time-varying state pdf is approximated in the CANDECOMP/PARAFAC decomposition tensor form where all the six spatial dimensions as well as the time dimension are separated from one other. The pdf approximation for all times is obtained simultaneously via the alternating least squares algorithm. Chebyshev spectral differentiation is employed for discretization on account of its spectral (“super-fast”) convergence rate. To facilitate the tensor decomposition and control the solution domain size, system dynamics is expressed using spherical coordinates in a noninertial reference frame. Numerical results obtained on a regular personal computer are compared with Monte Carlo simulations.     

Localization of the X-ray burster KS 1731-260 from Chandra data

We analyze Chandra observatory images of the field of the X-ray burster KS 1731-260. A factor of 10 to 15 improvement in the localization accuracy (up to ～0.6″) has allowed a possible candidate for counterparts of KS 1731-260 to be determined from infrared sky images (Barret et al. 1998). The possible counterpart (the sky position difference is ～1.46″, i.e., less than 2σ) is a 16th magnitude star in the J band. If this star is actually an infrared counterpart of KS 1731-260, then we can estimate its luminosity and the lower limit on the counterpart total luminosity, L>L _J,H ~10L _⊙. The sharp decline in the X-ray flux from KS 1731-260 in 2001 offers an additional test of whether the proposed candidate is actually a counterpart of KS 1731-260. If the optical and infrared luminosities of this counterpart are largely attributable to reradiation of the X-ray flux from the neutron star, as is the case in low-mass X-ray binaries, then the brightness of the counterpart star must decrease sharply in 2001, after the X-ray source is turned off.     

Cosmic microwave background power spectrum estimation with non-circular beam and incomplete sky coverage

Over the last decade, measurements of the cosmic microwave background (CMB) anisotropy have spearheaded the remarkable transition of cosmology into a precision science. However, addressing the systematic effects in the increasingly sensitive, high-resolution, 'full' sky measurements from different CMB experiments poses a stiff challenge. The analysis techniques must not only be computationally fast to contend with the huge size of the data, but the higher sensitivity also limits the simplifying assumptions which can then be invoked to achieve the desired speed without compromising the final precision goals. While maximum likelihood is desirable, the enormous computational cost makes the suboptimal method of power spectrum estimation using pseudo-C _l unavoidable for high-resolution data. The debiasing of the pseudo-C _l needs account for non-circular beams, together with non-uniform sky coverage. We provide a (semi)analytic framework to estimate bias in the power spectrum due to the effect of beam non-circularity and non-uniform sky coverage, including incomplete/masked sky maps and scan strategy. The approach is perturbative in the distortion of the beam from non-circularity, allowing for rapid computations when the beam is mildly non-circular. We advocate that it is computationally advantageous to employ 'soft' azimuthally apodized masks whose spherical harmonic transform die down fast with m . We numerically implement our method for non-rotating beams . We present preliminary estimates of the computational cost to evaluate the bias for the upcoming CMB anisotropy probes  ( l _max∼ 3000)  , with angular resolution comparable to the Planck surveyor mission. We further show that this implementation and estimate are applicable for rotating beams on equal declination scans, and can possibly be extended to simple approximations to other scan strategies.