This repository contains all the photometry produced for HELP using XID+.
XID+ is developed using a probabilistic Bayesian framework which provides a natural framework in which to include prior information, and uses the Bayesian inference tool Stan to obtain the full posterior probability distribution on flux estimates (see Hurley et al. 2017 for more details).
The XID+ data products for HELP, are created using the HPC design of the code, which splits the map into overlapping tiles, which are independently fit.
The repository is organised such that there is a folder per field and band. For example, for the ELAIS-N1 field, there are:
The final XID+ data products can be found on HeDaM at:
Each XID+ folder contains:
- a readme.md describing the commands used to run the field
- a
priornotebook, used to read in maps, psf and catalogues and used to create the prior files (Master_prior.pkl,Tiles.pkl) for XID+ - a
XID_plus_hier.shshell script to submit an HPC job which breaks down theMaster_prior.pklinto smaller hierarchical tiles used in the tiling scheme - a
XID_plus_tile.shshell script to submit an HPC job to run the XID+ fit on each tile - a
XIDp_run_script.pypython file, used byXID_plus_tile.sh, which fits the tiles - a
'make_combined_map.pypython file used to combine all the Bayesian P value maps and check for any failed tiles - a
final_processingnotebook to read in output catalogue, validate, assign level of detection and add flags to catalogue *.ymlfiles, documenting the input files used to produce the data products.
For each field and band, XID+ produces:
- a catalogue, containing fluxes and other useful measures
- a Bayesian P value map, which is a visualisation of a posterior predictive check. These can be thought of as more robust version of the standard residual maps.