[Go-essp-tech] QC2 exception list

[Frank Toussaint]

Hi Jeff, Kevin, Mark, & all:

we put the list of possible exceptions thrown by the qc2 tool on
   http://www.leuchtturm-atlas.de/SCR/qc2list.html
and ordered by theme on
   http://www.leuchtturm-atlas.de/SCR/qc2lisG.html
and made various changes during the recent days. Especially, comments on the exceptions were added.

We grouped the exceptions by severity into 5 groups:
   Fatals: immediate action neccessary,
   errors: data not acceptable,
   warnings: data possibly not ok,
   informatory: fine - just for info,
   unclear: title lines or open issues,

...as well as by theme into 7 groups:
   ACCEss errors,
   GENEral checks,
   METAdata and file name checks,
   TABL: inconsistencies in comparison to meta data tables,
   TIMEaxis checks,
   VARIables' checks.
   obsolete messages (not used for CMIP5 project).

Everybody is welcome to give comments, especially about both classifications.

In addition, we propose procedures to handle data with thrown qc2 exceptions on
   https://redmine.dkrz.de/collaboration/projects/cmip5-qc/wiki/Qcl2_criteria
Here, too, please give us feedback whether this approach is fine for you.

In general we propose:
A) As fatals block or make doubtful further checks of this part of the data, they must not occur. In case they do,
- we have to reject the data if it is the reason,
- or a programme bug has occurred that first has to be corrected,
- or a wrong setup has been taken for this run of the tool.
B) In case of errors a sensible decision has to be taken whether or not the data may pass. Consultation between data provider and data node is neccessary.
C) In case of warnings, the data provider should be informed.

Besides on the severity, a sensible decision also will depend on the quantity of errors, which we did not account for here.

If only a part of the data is faulty, the clean rest may be ESG-published again as a new version and regarded as having passed the qc2 check.


Best regards... frank  & Martina


-- 
/** Dr. Frank Toussaint   * Deutsches Klimarechenzentrum DKRZ
  * Friedensallee 369      * M&D / World Data Center - Climate
  * 22761 Hamburg              * Bundesstr.45a * 20146 Hamburg
  * priv.Tel.: 040-3861 9285 * office phone: +49-40-460094-123
  * www.Leuchtturm-Atlas.de        * e-mail: Toussaint at dkrz.de */