JMMCSearchCalCDSCatalog2020 < Jmmc/Software

---+ Update the JSDC in 2020 (v2020 ?)

This page gathers notes on the overall process to obtain the updated JSDC catalog (v2020) based on Simbad SPTYPE + VJHK mags (tycho2+2MASS).


---++ SearchCal changes

The JSDC_BRIGHT scenario retrieves GAIA DR2 information


---+++ Meta-data of New columns:



---++ JMDC inputs
See the full procedure at /SCALIB/DEVELOPMENT/alx/config/JMDC/scriptHandleLastVersionOf_JMDC_dot_xls_ToProduceJMDC_dot_fits.sh

This script has the following dependencies: stilts + gdl (astro lib ie MRDFITS + gdl mpfit procedures).
    export GDL_PATH="/home/bourgesl/apps/astron/pro/:/home/bourgesl/dev/gdl/src/pro/:/home/bourgesl/dev/gdl/src/pro/CMprocedures/"

Inputs:
   * JMDC: get latest JMDC catalog from http://jmdc.jmmc.fr/ by clicking on the CSV button (top)
   * JSDC (input catalog) to compute LDD/UD using gdl script (all SearchCal columns needed)

Command:
    ./scriptHandleLastVersionOf_JMDC_dot_xls_ToProduceJMDC_dot_fits.sh JMDC_full_20200730.csv



 gdl -e "make_jsdc_script_simple,\"JMDC_full_20200730_final_lddUpdated.fits\",verbose=1,nocatalog=1"

 gdl -e "make_jsdc_script_simple,\"JMDC_full_20200730_final_lddUpdated.fits\",\"catalog2020.fits\",verbose=1"


---++ JSDC input catalog
See procedure at /vobs/config/prepare_candidates/proc.sh

This script generates the 2 input files in the vobs/config folder for the JSDC_BRIGHT (vobsascc_simbad_sptype.cfg) / JSDC_FAINT (vobsascc_simbad_no_sptype.cfg) input catalogs (candidates) used to run SearchCal scenarios and obtain the JSDC full databases (data + computations).

---+++ How to update the input catalogs ?

Run proc.sh 

Overall description:
- get both ASCC & SIMBAD full catalogs via cdsxmatch.u-strasbg.fr/QueryCat queries (vot)
- crossmatch catalogs using radius = 2 as (all from 1) on J2000 coords (corrected by PM) + compute group size at 5 as in both catalogs (GROUP_SIZE)
- produce input catalogs in SearchCal vobsCatalog format (ascii):
   * RAJ2000/DEJ2000, pmRA, pmDE (ASCC)
   * MAIN_ID, SP_TYPE, OTYPES (Simbad at 2as)
   * GROUP_SIZE (max GroupSize in both catalogs at 5as)
- split the full ASCC in 2 lists (!NULL_SP_TYPE / NULL_SP_TYPE) (2017-04-14)
   * vobsascc_simbad_sptype.cfg: 494401 rows 
   * vobsascc_simbad_no_sptype.cfg: 2006912 rows

Comments:
   * ASCC is a catalog compilation (TYCHO2 + others) that contains many duplicates with 2as (tycho2 components or other known binaries ...)
   * Simbad coordinates (used by crossmatch) now use Gaia DR2 ones for 3M objects where SIMBAD retrieved the 'unique' GAIA object

NOTE: these files were produced at 2017-04-14, not updated in 2020 as a cds-healpix-java bug make procedure to fail (simbad 11M objects):
{{{
processing @ date: mardi 15 septembre 2020, 09:59:32 (UTC+0000)
Params: Max Error(Number)/arcsec=5.0
Tuning: HEALPix k(Integer)=11
Binning rows for table 2.............................................
Error: Hash value 13421764095 must be in [0, 12884901888[
}}}



---+++ How to run SearchCal scenarios ?

* Server side (~bourgesl)

* Publish results at

* Run filter.sh


---++ JSDC 2020 generation




---++ 


-- %USERSIG{LaurentBourges - 2020-09-15}%
This topic: Jmmc/Software > WebHome > SearchCal > JMMCSearchCalCDSCatalog > JMMCSearchCalCDSCatalog2020
Topic revision: r2 - 2020-09-15 - LaurentBourges