Contents
Kaulia Release Notes
These are the Kaulia release notes containing changes since the Namaka Starlink release.
General
- Kapview display supports the linplot MODE parameter for specifying line type.
ACSIS
- The REDUCE_SCIENCE_ recipes can now process large time-series cubes without pipeline timeouts. If the time series is larger than a configurable size (default 5GB), a new primitive _CHUNK_AND_MOSAIC_CUBE_ divides the data into manageable chunks for MAKECUBE. The resultant spectral-cube tiles are then combined as if MAKECUBE had processed the full dataset.
SCUBA-2
- Fast-ramp flatfield data are processed by all pipelines running at the telescope and are stored in the calibration system for retrieval as science data are obtained.
- The REDUCE_SCAN_FAKEMAP recipe can now add a specified gaussian to the raw time series before processing, without creating a map first.
The Quicklook data monitoring task has been re-written to be more robust. The task qlgather is responsible for monitoring the DRAMA tasks and writes a flag file for the pipeline to monitor.
- The results of fits to sources when calculating flux conversion factors are now displayed graphically as X- and Y-slices through the source and fit.
- Responsivity maps are mosaicked to display the responsivity across the focal plane.
- Arbitrary resistor config files may now be given to the pipeline.
PICARD
- New recipe, SCUBA2_DISPLAY_PCA, to carry out and display results of principal components analysis on raw SCUBA-2 data.
Namaka Release Notes
These are the Namaka release notes containing changes since the Hawaiki Starlink release.
General
Added the -log h option to write HTML log files instead of text files containing ANSI color codes.
ACSIS
- Added a new recipe for Frequency Switch observations.
- Modified the format of the QA log file to make it easier to parse. It's mostly in the form "Parameter Value" now.
SCUBA-2
- Added a document (SUN/264) for SCUBA-2 processing.
- Batch-mode creation of a Group coadd is delayed until all members have been processed.
- Pointing observations have a matched-filter applied to improve signal-to-noise before fitting the source position.
- Pointing drifts are removed before coadding calibrator observations.
- Fake data from existing images may be added to the raw timeseries, with optional intensity scaling and translation (REDUCE_SCAN_FAKEMAP).
- Some engineering data can now be processed with the pipeline (new recipe ENG_NEP).
- Automatically search for a reprocessed flatfield solution for data prior to 20100223.
- Observations of blank fields may be processed with the REDUCE_SCAN_FAINT_POINT_SOURCES recipe which uses an optimized configuration file for the map-maker and applies a matched filter to enhance point sources.
IRIS-2
- Integrate patches from AAO.
WFCAM
- Support 4 position focus mode with parabola fit.
PICARD
- Added an introductory document for PICARD (SUN/265).
- Instrument-specific classes and primitives are accessible if all data are from same instrument.
- MOSAIC_JCMT_IMAGES now supports CCDPACK makemos for combining images.
- SCUBA-2 flux conversion factors may be calculated for non-standard sources by providing 850/450 um flux densities.
- New recipes added:
- SCUBA2_REGISTER_IMAGES: register SCUBA-2 images to a common position by fitting to a source.
- SCUBA2_MATCHED_FILTER: process SCUBA-2 images with a point-source enhancing filter.
- CROP_JCMT_IMAGES: trim SCUBA-2/ACSIS data to a specified map size.
- UNCALIBRATE_SCUBA2_DATA: undo default SCUBA-2 calibration.
Hawaiki Release Notes
These are the Hawaiki release notes containing changes since the Nanahope Starlink release.
General
ORAC-DR initialisation scripts now support -honour and -cwd to control how $ORAC_DATA_OUT is determined.
If all except the UT date part of the directory is present in $ORAC_DATA_OUT that directory is now created.
Added support for Growl notifications on OS X. There are notifications for data detection, pipeline initialisation, frame processing completion and pipeline completion. Use the growl preferences pane to disable or enable specific notifications.
- No longer allow the pipeline to run if ORAC_DATA_OUT is an NFS mounted disk. Set the ORAC_NFS_OK environment variable to 1 to ignore this.
- Always run in batch mode when the reduction date is no the current date.
- gzipped raw data can now be read by ORAC-DR.
Recipe parameters are now available for various instruments.
Internals
- Reorganized the Calibration classes to use hierarchy and code generators
Rewrote the bulk of the shell initialisation code (oracdr_xxx scripts) using perl to remove logic duplication between cshell, bash and perl sections.
ACSIS
- _CREATE_MOMENTS_MAPS_THROUGH_SMOOTHING_ now supports a separate RMS threshold for each requested moment.
_ITERATIVE_GROUP_PRODUCTION_ now supports rebinning. Add a REBIN=0.1 (e.g. for a 0.1-km/s rebinned resolution) parameter.
Running the oracdr_acsis initialization script has been split into three different scripts for three different purposes:
oracdr_acsis now runs the advanced processing recipes by default. These recipes used to have the _ADV suffix; now the default e.g. REDUCE_SCIENCE_GRADIENT recipes run advanced processing. You no longer need to add -recsuffix ADV to the command-line to run the advanced processing recipes.
oracdr_acsis_summit now runs summit-specific recipes that are designed for speed, yet still deliver adequate products. No individual observation products are created; only group coadded cubes and related products are created.
oracdr_acsis_ql will run quick-look recipes. These recipes will only create a cube from the raw data for grid and jiggle observations; scan observations will be skipped entirely.
- Reduced cubes now have the tile border set to bad.
- REDUCE_SCIENCE_GRADIENT and REDUCE_SCIENCE_NARROWLINE now support the following recipe parameters:
BASELINE_ORDER: the polynomial order to use when baselining cubes.
CUBE_WCS: The coordinate system to regrid cubes to.
FLATFIELD: Whether or not to perform flat-fielding.
MOMENTS: Which moments maps to create.
MOMENTS_LOWER_VELOCITY & MOMENTS_UPPER_VELOCITY: Define a velocity range from which the moments maps will be created.
PIXEL_SCALE: Pixel scale, in arcseconds, of cubes.
REBIN: List of velocity resolutions to rebin the final cube to.
RESTRICT_LOWER_VELOCITY: Trim all data to this lower velocity.
RESTRICT_UPPER_VELOCITY: Trim all data to this upper velocity.
SPREAD_METHOD: The method to use when spreading each input pixel out between a group of neighbouring output pixels when regridding cubes.
SPREAD_WIDTH: The number of arcseconds on either side of the output position which are to receive contributions from the input pixel.
SPREAD_FWHM_OR_ZERO: Depending on the spreading method, this parameter controls the number of arcseconds at which the envelope of the spreading function goes to zero, or the full-width at half-maximum for the Gaussian envelope.
SCUBA-2
This is the first release of the SCUBA-2 pipeline.
The SCUBA-2 pipeline has initialization scripts for each wavelength: oracdr_scuba2_850 and oracdr_scuba2_450.
- As with ACSIS, the initialization script is split into three different scripts for three different purposes (the XXX denotes the wavelength, either 850 or 450):
oracdr_scuba2_XXX is the primary offline pipeline.
oracdr_scuba2_XXX_summit is for use at the summit and runs recipes that are designed for speed, yet still deliver adequate products. Processing is delayed until either 90% of the observation is complete, or the scan pattern has been completed.
oracdr_scuba2_XXX_ql is only for use at the summit and will run quick-look recipes which process each new group of files as they are detected by the pipeline. The output is likely only useful for observations of bright compact sources.
- The primary recipe for processing raw science SCAN data is REDUCE_SCAN.
- The main processing primitive is _MAKEMAP_FRAME_ which uses the iterative map-maker in SMURF makemap.
A single recipe parameter is supported: MAKEMAP_CONFIG can be used to specify an alternative configuration file for SMURF makemap.
Example makemap configuration files are located in $STARLINK_DIR/share/smurf.
- Additional PICARD recipes are available for processing SCUBA-2 images.
CROP_IMAGES: Trim one or more images to the size given in the FITS header.
MOSAIC_IMAGES: Combine multiple SCUBA-2 images, taking account of the EXP_TIME component (exposure time map).
CALC_SCUBA2_NEFD: Calculate an NEFD from calibrated SCUBA-2 images.