pipeline.hifa.cli.hifa_restoredata

hifa_restoredata(vis=None, session=None, products_dir=None, copytoraw=None, rawdata_dir=None, lazy=None, bdfflags=None, ocorr_mode=None, asis=None) → Results[source]

Restore flagged and calibration interferometry data from a pipeline run.

The hifa_restoredata task restores flagged and calibrated MeasurementSets from archived ASDMs and pipeline flagging and calibration data products.

hifa_restoredata assumes that the ASDMs to be restored are present in the directory specified by the rawdata_dir (default: '../rawdata').

By default (copytoraw = True), hifa_restoredata assumes that for each ASDM in the input list, the corresponding pipeline flagging and calibration data products (in the format produced by the hifa_exportdata task) are present in the directory specified by products_dir (default: '../products'). At the start of the task, these products are copied from the products_dir to the rawdata_dir.

If copytoraw = False, hifa_restoredata assumes that these products are to be found in rawdata_dir along with the ASDMs.

The expected flagging and calibration products (for each ASDM) include:

  • a compressed tar file of the final flagversions file, e.g. uid___A002_X30a93d_X43e.ms.flagversions.tar.gz

  • a text file containing the applycal instructions, e.g. uid___A002_X30a93d_X43e.ms.calapply.txt

  • a compressed tar file containing the caltables for the parent session, e.g. uid___A001_X74_X29.session_3.caltables.tar.gz

hifa_restoredata performs the following operations:

  • imports the ASDM(s)

  • removes the default MS.flagversions directory created by the filler

  • restores the final MS.flagversions directory stored by the pipeline

  • restores the final set of pipeline flags to the MS

  • restores the final calibration state of the MS

  • restores the final calibration tables for each MS

  • applies the calibration tables to each MS

When importing the ASDM and converting it to a MeasurementSet (MS), if the output MS already exists in the output directory, then the importasdm conversion step is skipped, and instead the existing MS will be imported.

Parameters:

  • vis --

    List of raw visibility data files to be restored. Assumed to be in the directory specified by rawdata_dir.

    Example: vis=['uid___A002_X30a93d_X43e']

  • session --

    List of sessions one per visibility file.

    Example: session=['session_3']

  • products_dir --

    Name of the data products directory to copy calibration products from. Default: '../products' The parameter is effective only when copytoraw = True. When copytoraw = False, calibration products in rawdata_dir will be used.

    Example: products_dir='myproductspath'

  • copytoraw --

    Copy calibration and flagging tables from products_dir to rawdata_dir directory.

    Default: True.

    Example: copytoraw=False

  • rawdata_dir --

    Name of the raw data directory.

    Default: '../rawdata'.

    Example: rawdata_dir='myrawdatapath'

  • lazy --

    Use the lazy filler option.

    Default: False.

    Example: lazy=True

  • bdfflags --

    Set the BDF flags.

    Default: True.

    Example: bdfflags=False

  • ocorr_mode --

    Set ocorr_mode.

    Default: 'ca'.

    Example: ocorr_mode='ca'

  • asis --

    Creates verbatim copies of the ASDM tables in the output MS. The value given to this option must be a string containing a list of table names separated by whitespace characters.

    Default: 'SBSummary ExecBlock Antenna Annotation Station Receiver Source CalAtmosphere CalWVR CalPointing'.

    Example: asis='Source Receiver'

Returns:

The results object for the pipeline task is returned.

Examples

  1. Restore the pipeline results for a single ASDM in a single session:

>>> hifa_restoredata(vis=['uid___A002_X30a93d_X43e'], session=['session_1'], ocorr_mode='ca')