The full suite of DECaPS2 data products are document in a datamodel that parallels the release file structure. Some of the main products are highlighted below.
DECaPS provides two types of catalogs: individual-image catalogs and band-merged catalogs. The individual catalogs are the outputs of crowdsource
and CloudCovErr.jl
on the individual DECam CCDs. The band-merged catalogs are derived from the individual-image catalogs, merged so that different detections of the same source are collected and averaged together in the same catalog entry. Most users will want the band-merged catalogs.
All catalogs are available for download. The raw and DECam Community Pipeline (CP) processed images are formally available through the NOIRLab Astro Data Archive, but since some images were processed by the CP multiple times, we also provide the exact set of images used to create the catalog here.
- image database
The image database contains the headers from all images composing the DECaPS survey. This is useful to see exactly which images contribute to different parts of the footprint, and their properties. Documentation on DECam header fields is available in the NOAO Data Handbook and in the ooi datamodel, which describes the image inputs to the DECaPS2 pipelines, which are the outputs of the DECam Community Pipeline.
- calibration file
The calibration file contains the zero points and flat fields from the photometric calibration, as well as some quality assurance information which is detailed in the datamodel. The absolute calibration is tied to Tonry et al. (2012), which may be off AB by up to 0.03 mag.
- individual epoch catalogs
The individual epoch catalogs are available for every DECaPS image. The tabulated fields are described below. Missing CCDs in the pipeline output files occur when no sources were detected in that CCD, which occasionally occurs during periods of thick cloud cover. The individual epoch catalog files include additional information such as background and PSF models, as described by their datamodel.
- band-merged catalogs
The band-merged catalogs have been sliced into 1-by-1 degree chunks for manageable downloading, and are described below.
The band-merged catalogs can also be accessed remotely using any TAP-aware client such as TOPCAT or astroquery via astropy. They are hosted by NOIRLab's AstroDataLab at the TAP address https://datalab.noirlab.edu/tap. This is not a default end-point for TOPCAT and needs to be added manually.
crowdsource
analyzes each DECaPS CCD individually to determine the position and fluxes of all sources in the image. CloudCovErr.jl
then processes the residuals to correct the flux and flux uncertainties in the presence of nebulosity by interpolating the unmodeled (sharp) background behind the star. The resulting output catalog has the following fields:
Name | Type | Unit | Description |
---|---|---|---|
X | float64 | pixels | x coordinate |
Y | float64 | pixels | y coordinate |
FLUX | float32 | ADU | raw flux |
PASSNO | float64 | iteration at which source was found | |
DX | float32 | pixels | x uncertainty |
DY | float32 | pixels | y uncertainty |
DFLUX | float32 | ADU | flux uncertainty (statistical only) |
QF | float32 | "quality factor" based on PSF-weighted fraction of pixels contributing to the detection. 0 < qf <1 ranges bad < qf < good | |
RCHI2 | float32 | average \(\chi^2\) per pixel, weighted by PSF | |
FRACFLUX | float32 | fraction of flux in this object's PSF that comes from this object | |
FLUXLBS | float32 | [DEFUNCT] flux with attempt at local background subtraction (Backwards compatability only) | |
DFLUXLBS | float32 | [DEFUNCT] fluxlbs uncertainty (Backwards compatability only) | |
FWHM | float32 | pixels | full-width at half-maximum of PSF |
SPREAD_MODEL | float32 | sextractor-like spread_model; positive means the source is broader than a PSF | |
DSPREAD_MODEL | float32 | uncertainty in sextractor spread_model | |
FLUXISO | float32 | ADU | flux derived from linear least squares fit to neighbor-subtracted image; significant difference from ordinary flux indicates a convergence issue |
XISO | float64 | pixels | x coordinate derived from linear least squares fit to neighbor-subtracted image; significant difference from ordinary x indicates a convergence issue |
YISO | float64 | pixels | y coordinate derived from linear least squares fit to neighbor-subtracted image; significant difference from ordinary y indicates a convergence issue |
FLAGS | int32 | DECam Community Pipeline flags at central pixel from upstream image processing | |
SKY | float32 | ADU | sky level at central pixel |
RA | float64 | degree | right ascension |
DEC | float64 | degree | declination |
DECAPSID | int64 | unique object id (internal to each data release) | |
GAIN | float32 | e-/ADU | emperical gain (counts times inverse variance) |
PRN | float32 | probability central pixel in "nebulosity" class | |
PRL | float32 | probability central pixel in "light nebulosity" class | |
PRR | float32 | probability central pixel in "regular" class | |
PRE | float32 | probability central pixel in "error" class | |
DCFLUX | float32 | ADU | [CloudCovErr] flux uncertainty (using full background covariance) |
DCFLUX_DIAG | float32 | ADU | [CloudCovErr] flux uncertainty (using diagonal covariance) |
CFLUX | float32 | ADU | [CloudCovErr] background-corrected flux |
FDB_RES | float32 | ADU | [CloudCovErr] bias offset from residuals |
FDB_PRED | float32 | ADU | [CloudCovErr] bias offset from predicted background |
CCHI2 | float32 | [CloudCovErr] \(\chi^2\) of predicted background evaluated for "good" pixels | |
KCOND0 | float32 | [CloudCovErr] initial number of "good" pixels (representative of true background) | |
KCOND | float32 | [CloudCovErr] final number of "good" pixels (representative of true background) | |
KPRED | float32 | [CloudCovErr] number of "hidden" pixels (background interpolation region) | |
DNT | float32 | [CloudCovErr] bitmask on corrected flux solution |
The DECaPS band-merged catalogs have undergone photometric calibration and tabulate a number of quantities for each source.
Name | Type | Unit | Description |
---|---|---|---|
RA | float64 | degree | right ascension |
DEC | float64 | degree | declination |
POSSTDEV | float32 | arcsec | standard deviation in position of object between different detections |
RA_OK | float64 | degree | right ascension |
DEC_OK | float64 | degree | declination |
POSSTDEV_OK | float32 | arcsec | standard deviation in position of object between different detections |
NDET | int16 | total number of detections associated with object | |
NDET_OK | int16 | total number of detections associated with object | |
NMAG | int16[6] | total number of detections associated with object per band | |
NMAG_OK | int16[6] | total number of detections associated with object per band | |
MEAN | float32[6] | Mgy | mean flux per band |
STDEV | float32[6] | Mgy | standard deviation of flux measurements per band (can be NaN if 1 detection) |
ERR | float32[6] | Mgy | average dflux (uncertainty) per band |
MEDIAN | float32[6] | Mgy | median flux per band |
Q25 | float32[6] | Mgy | 25th percentile flux |
Q75 | float32[6] | Mgy | 75th percentile flux |
NDET_CFLUX | int16 | total number of detections associated with object | |
NDET_CFLUX_OK | int16 | total number of detections associated with object | |
NMAG_CFLUX | int16[6] | total number of detections associated with object per band | |
NMAG_CFLUX_OK | int16[6] | total number of detections associated with object per band | |
MEAN_CFLUX | float32[6] | Mgy | mean cflux per band |
STDEV_CFLUX | float32[6] | Mgy | standard deviation of cflux measurements per band (can be NaN if 1 detection) |
ERR_CFLUX | float32[6] | Mgy | average dcflux (uncertainty) per band |
MEDIAN_CFLUX | float32[6] | Mgy | median cflux per band |
Q25_CFLUX | float32[6] | Mgy | 25th percentile cflux |
Q75_CFLUX | float32[6] | Mgy | 75th percentile cflux |
MAGLIMIT | float32[6] | AB Mag | very rough magnitude limit at which this detection would be only 5 sigma, -2.5 * log10(5 * dflux) + zeropoint |
EPOCHRANGE | float64 | day | MJD difference between earliest and latest detection |
EPOCHRANGE_OK | float64 | day | MJD difference between earliest and latest detection |
EPOCHMEAN | float64 | J2000 | Mean MJD |
EPOCHMEAN_OK | float64 | J2000 | Mean MJD |
DNT_ALL | int32[6] | bits from CloudCovErr solutoin thrown in all (ok) detections in a given band | |
DQFLAGS_ALL | int64[6] | bits from DECam Community pipeline/crowdsource solution thrown in all (ok) detections in a given band | |
FRACFLUX_AVG | float32[6] | average fraction of flux in this object's PSF that comes from this object | |
RCHI2_AVG | float32[6] | average \(\chi^2\) per pixel, weighted by PSF | |
QF_AVG | float32[6] | average "quality factor" based on PSF-weighted fraction of pixels contributing to the detection (0 < qf <1 ranges bad < qf < good) | |
PRN_AVG | float32[6] | average probability of nebulosity classification at the detection location per band | |
PRL_AVG | float32[6] | average probability of light nebulosity classification at the detection location per band | |
PRR_AVG | float32[6] | average probability of regular classification at the detection location per band | |
PRE_AVG | float32[6] | average probability of error mode classification at the detection location per band | |
CCHI2_AVG | float32[6] | average \(\chi^2\) of predicted background evaluated for "good" pixels | |
SNR_AVG | float32[6] | average flux/dflux | |
DNT_ANY | int32[6] | bits from CloudCovErr solutoin thrown in any (ok) detections in a given band | |
DQFLAGS_ANY | int64[6] | bits from DECam Community pipeline/crowdsource solution thrown in any (ok) detections in a given band | |
OBJ_ID | int64 | unique DECaPS2 object ID |
For quantities with an additional "_OK" field, the first is an average over all detections and the "_OK" field is limited to only "OK" detections. Detections are "OK" if no bad flag bits were set for the center pixel, the quality factor and RCHI2 pass a cut, and the flux uncertainty is nonzero. See the DECaPS2 release paper for these cuts and bad flag lists. The fields with a "_AVG", "_ANY", and "_ALL" were computed only over "OK" detections. The weights used for "_AVG" differ slightly from those used to compute the flux mean, using 0.1 instead of 0.0921 to regularize multiplicative errors.
Fields that are arrays of 6 elements in one dimension are "per band" with the band ordering ugrizY. However, no u-band observations were taken during DECaPS and thus the first element in that dimension should always be zero.
All fluxes are reported in "maggies" (Mgy) which are equivalent to 3631 Jy and are a convenient unit so that the AB magnitudes of the stars are given by \(-2.5\log_{10}\mathrm{flux}\). The absolute calibration is based on the Tonry et al. (2012) absolute calibration of PS1. Subsequent analyses (Scolnic et al., 2014, 2015) of the PS1 survey found offsets relative to AB. To shift the DECaPS magnitudes to the Scolnic et al. (2015) absolute calibration, offsets of 0.020, 0.033, 0.024, 0.028, and 0.011 mag must be added to the DECaPS grizY magnitudes, respectively.
The crowdsource
flags are combined with those from the DECam Community Pipeline into a single bitmask. Bits 0 - 8 are inherited from the CP, 20 - 24 indicate a special region on the CCD or sky, and 30 - 31 indicate a change in the crowdsource
source identification parameters.
Bit | Description | Exclude Catalog? | Exclude Injections? |
---|---|---|---|
0 | No problms | No | No |
1 | Bad pixel | Yes | Yes |
3 | Saturated | Yes | Yes |
4 | Bleed trail | Yes | Yes |
5 | Cosmic ray | Yes | Yes |
6 | Low weight | Yes | No |
7 | Difference detection | No | Yes |
8 | Long streak | Yes | No |
20 | Additional bad pixel | Yes | Yes |
21 | Nebulosity | No | No |
22 | S7 amplifier B | Yes | No |
23 | Near bright star | No | Yes |
24 | Near galaxy | No | Yes |
30 | No deblend | No | No |
31 | Sharp | No | No |
Excluded flags mean that detections with that flag set are not considered "ok" in the computation of the band-merged catalogs or for determining the distribution of sources to use in synthetic injection tests.
The flags from CloudCovErr.jl
are saved as a separate bitmask field known as dnt
.
Bit | Meaning |
---|---|
- | No problems |
0 | Few "good" pixels, used pixels beyond radial mask |
1 | Few "good" pixels, force outermost row/column of pixels "good" |
2 | [Not Used] |
3 | Any pixel in PSF model for a source is (even infinitesimally) negative |
4 | Min/Max PSF < -1e-3 |
5 | Min/Max PSF < -1e-1 |
6 | [Not Used] |
Bits beyond 1 should not appear in the band-merged catalog because we explicitly excluded cases with PSF models that had even infinitesimally negative pixels during the photometric calibration. Such cases are extrordinarily rare and occur when the PSF model cannot be well estimated because of clouds obscuring the image or unmasked saturated sources distorting the PSF. Only order 10 CCDs (out of 1.3 million) that were otherwise considered photoemtric were excluded as a result of sources with dnt
bits larger than 1.