[Met_help] [rt.rap.ucar.edu #73213] History for pointstat help (somewhat urgent)
John Halley Gotway via RT
met_help at ucar.edu
Tue Sep 1 10:42:37 MDT 2015
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi John et al.,
I am hoping that I can still make some figures for a presentation on Tuesday afternoon using MET and am naively counting on your help.
I produced observation files for fine aerosols which figure as PMTF in grib table 129 with id 157 and converted them with ascii2nc
with the header that looks like
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pointstat help (somewhat urgent)
From: Julie Prestopnik
Time: Mon Aug 31 08:48:59 2015
Hi Mariusz.
In your configuration file, please try replacing:
model = wrf;
with:
model = "WRF";
I believe that will get you past the error you are receiving.
Please let us know if you have any other questions or encounter any
other
problems.
Thanks,
Julie
On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT
<met_help at ucar.edu
> wrote:
>
> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> Queue: met_help
> Subject: pointstat help (somewhat urgent)
> Owner: Nobody
> Requestors: Mariusz.Pagowski at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>
>
> Hi John et al.,
>
> I am hoping that I can still make some figures for a presentation on
> Tuesday afternoon using MET and am naively counting on your help.
>
> I produced observation files for fine aerosols which figure as PMTF
in
> grib table 129 with id 157 and converted them with ascii2nc
> with the header that looks like
>
>
>
>
> (on Zeus at
> /scratch1/portfolios/BMC/chem-var/pagowski/codes/outdata/pmsfc_4met/
> pmsfc_4met_2013061000.nc)
>
>
> I also converted wrf subsetted files to grib that look like this
>
> %wgrib -V pmsfc.t12z.25pm00
> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0 levels=(0,0)
> grid=255 sfc anl:
> PMTF=Particulate matter (fine) [ug/m^3]
> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
> missing 0
> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov -97.000000
> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000 LonSP
> 0.000000
> North Pole (440 x 284) Dx 12.000000 Dy 12.000000
scan
> 64 mode 136
> min/max data 0.13464 0.210263 num bits 13
BDS_Ref
> 0.13464 DecScale 0 BinScale -16
>
> (On Zeus at
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
>
> I know there is something wrong at least with my config file
>
>
>
>
> The error from poinstat is
>
> ERROR :
> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
> ERROR :
>
> and I am not sure how to tell the code that this a grib file.
>
> Can you help in diagnosing the problem?
>
> Thanks,
> Mariusz
>
>
>
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #73213] pointstat help (somewhat urgent)
From: Mariusz Pagowski
Time: Mon Aug 31 10:20:20 2015
Julie,
I am getting the same error,
Mariusz
ERROR :
ERROR : do_assign_id() -> identifier "WRF" not defined in this scope!
ERROR :
> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT
<met_help at ucar.edu> wrote:
>
> Hi Mariusz.
>
> In your configuration file, please try replacing:
>
> model = wrf;
>
> with:
>
> model = "WRF";
>
> I believe that will get you past the error you are receiving.
>
> Please let us know if you have any other questions or encounter any
other
> problems.
>
> Thanks,
> Julie
>
> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT
<met_help at ucar.edu
>> wrote:
>
>>
>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>> Queue: met_help
>> Subject: pointstat help (somewhat urgent)
>> Owner: Nobody
>> Requestors: Mariusz.Pagowski at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>
>>
>> Hi John et al.,
>>
>> I am hoping that I can still make some figures for a presentation
on
>> Tuesday afternoon using MET and am naively counting on your help.
>>
>> I produced observation files for fine aerosols which figure as PMTF
in
>> grib table 129 with id 157 and converted them with ascii2nc
>> with the header that looks like
>>
>>
>>
>>
>> (on Zeus at
>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
>> pmsfc_4met_2013061000.nc)
>>
>>
>> I also converted wrf subsetted files to grib that look like this
>>
>> %wgrib -V pmsfc.t12z.25pm00
>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0 levels=(0,0)
>> grid=255 sfc anl:
>> PMTF=Particulate matter (fine) [ug/m^3]
>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
>> missing 0
>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov -97.000000
>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000 LonSP
>> 0.000000
>> North Pole (440 x 284) Dx 12.000000 Dy 12.000000
scan
>> 64 mode 136
>> min/max data 0.13464 0.210263 num bits 13
BDS_Ref
>> 0.13464 DecScale 0 BinScale -16
>>
>> (On Zeus at
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
>>
>> I know there is something wrong at least with my config file
>>
>>
>>
>>
>> The error from poinstat is
>>
>> ERROR :
>> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
>> ERROR :
>>
>> and I am not sure how to tell the code that this a grib file.
>>
>> Can you help in diagnosing the problem?
>>
>> Thanks,
>> Mariusz
>>
>>
>>
>>
>>
>>
>>
>>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
------------------------------------------------
Subject: pointstat help (somewhat urgent)
From: Julie Prestopnik
Time: Mon Aug 31 10:28:13 2015
Hi Mariusz.
The model value needs to be a string, so it needs to be set with
double
quotation marks. I was able to reproduce your error with
model = WRF;
Please reset it to
model = "WRF";
and that should resolve this error.
Please let us know if you have any other questions or encounter any
other
problems.
Thanks,
Julie
On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT
<met_help at ucar.edu
> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>
> Julie,
> I am getting the same error,
> Mariusz
>
> ERROR :
> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
> ERROR :
>
>
>
> > On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
> >
> > Hi Mariusz.
> >
> > In your configuration file, please try replacing:
> >
> > model = wrf;
> >
> > with:
> >
> > model = "WRF";
> >
> > I believe that will get you past the error you are receiving.
> >
> > Please let us know if you have any other questions or encounter
any other
> > problems.
> >
> > Thanks,
> > Julie
> >
> > On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
> met_help at ucar.edu
> >> wrote:
> >
> >>
> >> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
> >> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> >> Queue: met_help
> >> Subject: pointstat help (somewhat urgent)
> >> Owner: Nobody
> >> Requestors: Mariusz.Pagowski at noaa.gov
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
> >>
> >>
> >> Hi John et al.,
> >>
> >> I am hoping that I can still make some figures for a presentation
on
> >> Tuesday afternoon using MET and am naively counting on your help.
> >>
> >> I produced observation files for fine aerosols which figure as
PMTF in
> >> grib table 129 with id 157 and converted them with ascii2nc
> >> with the header that looks like
> >>
> >>
> >>
> >>
> >> (on Zeus at
> >> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
> >> pmsfc_4met_2013061000.nc)
> >>
> >>
> >> I also converted wrf subsetted files to grib that look like this
> >>
> >> %wgrib -V pmsfc.t12z.25pm00
> >> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
> >> grid=255 sfc anl:
> >> PMTF=Particulate matter (fine) [ug/m^3]
> >> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
> >> missing 0
> >> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
> >> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
> >> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
> >> 0.000000
> >> North Pole (440 x 284) Dx 12.000000 Dy
12.000000 scan
> >> 64 mode 136
> >> min/max data 0.13464 0.210263 num bits 13
BDS_Ref
> >> 0.13464 DecScale 0 BinScale -16
> >>
> >> (On Zeus at
> >>
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
> >>
> >> I know there is something wrong at least with my config file
> >>
> >>
> >>
> >>
> >> The error from poinstat is
> >>
> >> ERROR :
> >> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
> >> ERROR :
> >>
> >> and I am not sure how to tell the code that this a grib file.
> >>
> >> Can you help in diagnosing the problem?
> >>
> >> Thanks,
> >> Mariusz
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: pointstat help (somewhat urgent)
From: Mariusz Pagowski
Time: Mon Aug 31 15:51:33 2015
Julie,
I am traveling but I settled in the hotel now so hope we can solve
this problem.
I included the “’s and the program went through the first step.
The error is now
ERROR :
ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation 'PMTF' for table version 2
ERROR :
but PMTF exists as entry 157 in version 129 of table 2
http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
<http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html>
Mariusz
> On Aug 31, 2015, at 10:28 AM, Julie Prestopnik via RT
<met_help at ucar.edu> wrote:
>
> Hi Mariusz.
>
> The model value needs to be a string, so it needs to be set with
double
> quotation marks. I was able to reproduce your error with
>
> model = WRF;
>
> Please reset it to
>
> model = "WRF";
>
> and that should resolve this error.
>
> Please let us know if you have any other questions or encounter any
other
> problems.
>
> Thanks,
> Julie
>
> On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT
<met_help at ucar.edu
>> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>
>> Julie,
>> I am getting the same error,
>> Mariusz
>>
>> ERROR :
>> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
>> ERROR :
>>
>>
>>
>>> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Mariusz.
>>>
>>> In your configuration file, please try replacing:
>>>
>>> model = wrf;
>>>
>>> with:
>>>
>>> model = "WRF";
>>>
>>> I believe that will get you past the error you are receiving.
>>>
>>> Please let us know if you have any other questions or encounter
any other
>>> problems.
>>>
>>> Thanks,
>>> Julie
>>>
>>> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
>> met_help at ucar.edu
>>>> wrote:
>>>
>>>>
>>>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>> Queue: met_help
>>>> Subject: pointstat help (somewhat urgent)
>>>> Owner: Nobody
>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>>>
>>>>
>>>> Hi John et al.,
>>>>
>>>> I am hoping that I can still make some figures for a presentation
on
>>>> Tuesday afternoon using MET and am naively counting on your help.
>>>>
>>>> I produced observation files for fine aerosols which figure as
PMTF in
>>>> grib table 129 with id 157 and converted them with ascii2nc
>>>> with the header that looks like
>>>>
>>>>
>>>>
>>>>
>>>> (on Zeus at
>>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
>>>> pmsfc_4met_2013061000.nc)
>>>>
>>>>
>>>> I also converted wrf subsetted files to grib that look like this
>>>>
>>>> %wgrib -V pmsfc.t12z.25pm00
>>>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
>>>> grid=255 sfc anl:
>>>> PMTF=Particulate matter (fine) [ug/m^3]
>>>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
>>>> missing 0
>>>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
>>>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
>>>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
>>>> 0.000000
>>>> North Pole (440 x 284) Dx 12.000000 Dy
12.000000 scan
>>>> 64 mode 136
>>>> min/max data 0.13464 0.210263 num bits 13
BDS_Ref
>>>> 0.13464 DecScale 0 BinScale -16
>>>>
>>>> (On Zeus at
>>>>
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
>>>>
>>>> I know there is something wrong at least with my config file
>>>>
>>>>
>>>>
>>>>
>>>> The error from poinstat is
>>>>
>>>> ERROR :
>>>> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
>>>> ERROR :
>>>>
>>>> and I am not sure how to tell the code that this a grib file.
>>>>
>>>> Can you help in diagnosing the problem?
>>>>
>>>> Thanks,
>>>> Mariusz
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Julie Prestopnik
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>
>>
>>
>>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
------------------------------------------------
Subject: pointstat help (somewhat urgent)
From: John Halley Gotway
Time: Mon Aug 31 17:10:42 2015
Mariusz,
I was able to get MET to run on your data by modifying the Point-Stat
configuration file slightly.
You are passing Point-Stat a forecast GRIB file and a NetCDF point
observation file, but you had the config file set as if the forecast
was a
gridded NetCDF file. Please try the following settings instead:
++++++++++++++++++++++
GRIB1_ptv = 129;
fcst = {
field = [
{
name = "PMTF";
level = "Z0";
cat_thresh = [ < 500.0 ];
}
];
};
obs = {
message_type = [ "ANYSFC" ];
field = [
{
name = "PMTF";
level = "Z2";
}
];
}
+++++++++++++++++++++++
Notice that I defined GRIB1_ptv outside of "fcst" and "obs" so it'll
apply
to both. This runs but doesn't produce any matched pairs because the
valid
times don't line up:
DEBUG 2: Processing PMTF/Z0 versus PMTF/Z2, for observation type
ANYSFC,
over region FULL, for interpolation method DW_MEAN(4), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 2793
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 2793
Your point observations are valid from 20130610_003000 to
20130610_033000.
(ncdump -v hdr_vld
/scratch1/portfolios/BMC/chem-var/pagowski/codes/outdata/pmsfc_4met/
pmsfc_4met_2013061000.nc)
I tried dumping the time from your GRIB file, but I think it's encoded
incorrectly:
wgrib -V
/scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
The output says "date 0213061012" but it should say "date 2013061012".
Take a look at your GRIB PDS Octet 25:
wgrib -PDS10
/scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
You have it set to a value of 3 which says this data is from the 3rd
century! It should be set to 21. Here's the relevant GRIB table:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
Hope that helps.
Thanks,
John
On Mon, Aug 31, 2015 at 3:51 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>
> Julie,
> I am traveling but I settled in the hotel now so hope we can solve
this
> problem.
>
> I included the “’s and the program went through the first step.
>
> The error is now
> ERROR :
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
> 'PMTF' for table version 2
> ERROR :
>
> but PMTF exists as entry 157 in version 129 of table 2
>
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html <
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html>
>
> Mariusz
>
>
> > On Aug 31, 2015, at 10:28 AM, Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
> >
> > Hi Mariusz.
> >
> > The model value needs to be a string, so it needs to be set with
double
> > quotation marks. I was able to reproduce your error with
> >
> > model = WRF;
> >
> > Please reset it to
> >
> > model = "WRF";
> >
> > and that should resolve this error.
> >
> > Please let us know if you have any other questions or encounter
any other
> > problems.
> >
> > Thanks,
> > Julie
> >
> > On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT <
> met_help at ucar.edu
> >> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
> >>
> >> Julie,
> >> I am getting the same error,
> >> Mariusz
> >>
> >> ERROR :
> >> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
> >> ERROR :
> >>
> >>
> >>
> >>> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT <
> met_help at ucar.edu>
> >> wrote:
> >>>
> >>> Hi Mariusz.
> >>>
> >>> In your configuration file, please try replacing:
> >>>
> >>> model = wrf;
> >>>
> >>> with:
> >>>
> >>> model = "WRF";
> >>>
> >>> I believe that will get you past the error you are receiving.
> >>>
> >>> Please let us know if you have any other questions or encounter
any
> other
> >>> problems.
> >>>
> >>> Thanks,
> >>> Julie
> >>>
> >>> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
> >> met_help at ucar.edu
> >>>> wrote:
> >>>
> >>>>
> >>>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
> >>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> >>>> Queue: met_help
> >>>> Subject: pointstat help (somewhat urgent)
> >>>> Owner: Nobody
> >>>> Requestors: Mariusz.Pagowski at noaa.gov
> >>>> Status: new
> >>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213
> >
> >>>>
> >>>>
> >>>> Hi John et al.,
> >>>>
> >>>> I am hoping that I can still make some figures for a
presentation on
> >>>> Tuesday afternoon using MET and am naively counting on your
help.
> >>>>
> >>>> I produced observation files for fine aerosols which figure as
PMTF in
> >>>> grib table 129 with id 157 and converted them with ascii2nc
> >>>> with the header that looks like
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> (on Zeus at
> >>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
> >>>> pmsfc_4met_2013061000.nc)
> >>>>
> >>>>
> >>>> I also converted wrf subsetted files to grib that look like
this
> >>>>
> >>>> %wgrib -V pmsfc.t12z.25pm00
> >>>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
> >>>> grid=255 sfc anl:
> >>>> PMTF=Particulate matter (fine) [ug/m^3]
> >>>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
> >>>> missing 0
> >>>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
> >>>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
> >>>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
> >>>> 0.000000
> >>>> North Pole (440 x 284) Dx 12.000000 Dy
12.000000
> scan
> >>>> 64 mode 136
> >>>> min/max data 0.13464 0.210263 num bits 13
> BDS_Ref
> >>>> 0.13464 DecScale 0 BinScale -16
> >>>>
> >>>> (On Zeus at
> >>>>
> >>
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
> >>>>
> >>>> I know there is something wrong at least with my config file
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> The error from poinstat is
> >>>>
> >>>> ERROR :
> >>>> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
> >>>> ERROR :
> >>>>
> >>>> and I am not sure how to tell the code that this a grib file.
> >>>>
> >>>> Can you help in diagnosing the problem?
> >>>>
> >>>> Thanks,
> >>>> Mariusz
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> Julie Prestopnik
> >>> National Center for Atmospheric Research
> >>> Research Applications Laboratory
> >>> Phone: 303.497.8399
> >>> Email: jpresto at ucar.edu
> >>>
> >>
> >>
> >>
> >>
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #73213] pointstat help (somewhat urgent)
From: Mariusz Pagowski
Time: Mon Aug 31 18:37:12 2015
John,
thanks for spotting the bug in the date and with the config. The code
works perfectly. I very much appreciate your help after hours,
Mariusz
> On Aug 31, 2015, at 5:10 PM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Mariusz,
>
> I was able to get MET to run on your data by modifying the Point-
Stat
> configuration file slightly.
>
> You are passing Point-Stat a forecast GRIB file and a NetCDF point
> observation file, but you had the config file set as if the forecast
was a
> gridded NetCDF file. Please try the following settings instead:
>
> ++++++++++++++++++++++
>
> GRIB1_ptv = 129;
>
> fcst = {
> field = [
> {
> name = "PMTF";
> level = "Z0";
> cat_thresh = [ < 500.0 ];
> }
> ];
> };
>
>
> obs = {
>
> message_type = [ "ANYSFC" ];
>
> field = [
> {
> name = "PMTF";
> level = "Z2";
> }
> ];
> }
>
> +++++++++++++++++++++++
>
> Notice that I defined GRIB1_ptv outside of "fcst" and "obs" so it'll
apply
> to both. This runs but doesn't produce any matched pairs because
the valid
> times don't line up:
>
> DEBUG 2: Processing PMTF/Z0 versus PMTF/Z2, for observation type
ANYSFC,
> over region FULL, for interpolation method DW_MEAN(4), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 2793
> DEBUG 3: Rejected: GRIB code = 0
> DEBUG 3: Rejected: valid time = 2793
>
> Your point observations are valid from 20130610_003000 to
20130610_033000.
> (ncdump -v hdr_vld
> /scratch1/portfolios/BMC/chem-var/pagowski/codes/outdata/pmsfc_4met/
> pmsfc_4met_2013061000.nc)
>
> I tried dumping the time from your GRIB file, but I think it's
encoded
> incorrectly:
>
> wgrib -V
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
>
> The output says "date 0213061012" but it should say "date
2013061012".
>
> Take a look at your GRIB PDS Octet 25:
> wgrib -PDS10
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
>
> You have it set to a value of 3 which says this data is from the 3rd
> century! It should be set to 21. Here's the relevant GRIB table:
>
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>
> Hope that helps.
>
> Thanks,
> John
>
>
> On Mon, Aug 31, 2015 at 3:51 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>
>> Julie,
>> I am traveling but I settled in the hotel now so hope we can solve
this
>> problem.
>>
>> I included the “’s and the program went through the first step.
>>
>> The error is now
>> ERROR :
>> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
>> 'PMTF' for table version 2
>> ERROR :
>>
>> but PMTF exists as entry 157 in version 129 of table 2
>>
>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html <
>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html>
>>
>> Mariusz
>>
>>
>>> On Aug 31, 2015, at 10:28 AM, Julie Prestopnik via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Mariusz.
>>>
>>> The model value needs to be a string, so it needs to be set with
double
>>> quotation marks. I was able to reproduce your error with
>>>
>>> model = WRF;
>>>
>>> Please reset it to
>>>
>>> model = "WRF";
>>>
>>> and that should resolve this error.
>>>
>>> Please let us know if you have any other questions or encounter
any other
>>> problems.
>>>
>>> Thanks,
>>> Julie
>>>
>>> On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT <
>> met_help at ucar.edu
>>>> wrote:
>>>
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>>>
>>>> Julie,
>>>> I am getting the same error,
>>>> Mariusz
>>>>
>>>> ERROR :
>>>> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
>>>> ERROR :
>>>>
>>>>
>>>>
>>>>> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT <
>> met_help at ucar.edu>
>>>> wrote:
>>>>>
>>>>> Hi Mariusz.
>>>>>
>>>>> In your configuration file, please try replacing:
>>>>>
>>>>> model = wrf;
>>>>>
>>>>> with:
>>>>>
>>>>> model = "WRF";
>>>>>
>>>>> I believe that will get you past the error you are receiving.
>>>>>
>>>>> Please let us know if you have any other questions or encounter
any
>> other
>>>>> problems.
>>>>>
>>>>> Thanks,
>>>>> Julie
>>>>>
>>>>> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
>>>> met_help at ucar.edu
>>>>>> wrote:
>>>>>
>>>>>>
>>>>>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>> Queue: met_help
>>>>>> Subject: pointstat help (somewhat urgent)
>>>>>> Owner: Nobody
>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>> Status: new
>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213
>>>
>>>>>>
>>>>>>
>>>>>> Hi John et al.,
>>>>>>
>>>>>> I am hoping that I can still make some figures for a
presentation on
>>>>>> Tuesday afternoon using MET and am naively counting on your
help.
>>>>>>
>>>>>> I produced observation files for fine aerosols which figure as
PMTF in
>>>>>> grib table 129 with id 157 and converted them with ascii2nc
>>>>>> with the header that looks like
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> (on Zeus at
>>>>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
>>>>>> pmsfc_4met_2013061000.nc)
>>>>>>
>>>>>>
>>>>>> I also converted wrf subsetted files to grib that look like
this
>>>>>>
>>>>>> %wgrib -V pmsfc.t12z.25pm00
>>>>>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
>>>>>> grid=255 sfc anl:
>>>>>> PMTF=Particulate matter (fine) [ug/m^3]
>>>>>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
>>>>>> missing 0
>>>>>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
>>>>>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
>>>>>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
>>>>>> 0.000000
>>>>>> North Pole (440 x 284) Dx 12.000000 Dy
12.000000
>> scan
>>>>>> 64 mode 136
>>>>>> min/max data 0.13464 0.210263 num bits 13
>> BDS_Ref
>>>>>> 0.13464 DecScale 0 BinScale -16
>>>>>>
>>>>>> (On Zeus at
>>>>>>
>>>>
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
>>>>>>
>>>>>> I know there is something wrong at least with my config file
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> The error from poinstat is
>>>>>>
>>>>>> ERROR :
>>>>>> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
>>>>>> ERROR :
>>>>>>
>>>>>> and I am not sure how to tell the code that this a grib file.
>>>>>>
>>>>>> Can you help in diagnosing the problem?
>>>>>>
>>>>>> Thanks,
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Julie Prestopnik
>>>>> National Center for Atmospheric Research
>>>>> Research Applications Laboratory
>>>>> Phone: 303.497.8399
>>>>> Email: jpresto at ucar.edu
>>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Julie Prestopnik
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #73213] pointstat help (somewhat urgent)
From: Mariusz Pagowski
Time: Mon Aug 31 18:49:32 2015
One thing that raises some concern:
both observations and model are assumed to be on the same level so I
set for both Z0
Why is it that a message appears
...
DEBUG 3: Rejected: level mismatch = 1333
…
It looks like this check does not really reject any obs/model pairs
since the number of obs that I would expect to be matching is right -
just to make sure
I am not missing something.
Mariusz
> On Aug 31, 2015, at 5:10 PM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Mariusz,
>
> I was able to get MET to run on your data by modifying the Point-
Stat
> configuration file slightly.
>
> You are passing Point-Stat a forecast GRIB file and a NetCDF point
> observation file, but you had the config file set as if the forecast
was a
> gridded NetCDF file. Please try the following settings instead:
>
> ++++++++++++++++++++++
>
> GRIB1_ptv = 129;
>
> fcst = {
> field = [
> {
> name = "PMTF";
> level = "Z0";
> cat_thresh = [ < 500.0 ];
> }
> ];
> };
>
>
> obs = {
>
> message_type = [ "ANYSFC" ];
>
> field = [
> {
> name = "PMTF";
> level = "Z2";
> }
> ];
> }
>
> +++++++++++++++++++++++
>
> Notice that I defined GRIB1_ptv outside of "fcst" and "obs" so it'll
apply
> to both. This runs but doesn't produce any matched pairs because
the valid
> times don't line up:
>
> DEBUG 2: Processing PMTF/Z0 versus PMTF/Z2, for observation type
ANYSFC,
> over region FULL, for interpolation method DW_MEAN(4), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 2793
> DEBUG 3: Rejected: GRIB code = 0
> DEBUG 3: Rejected: valid time = 2793
>
> Your point observations are valid from 20130610_003000 to
20130610_033000.
> (ncdump -v hdr_vld
> /scratch1/portfolios/BMC/chem-var/pagowski/codes/outdata/pmsfc_4met/
> pmsfc_4met_2013061000.nc)
>
> I tried dumping the time from your GRIB file, but I think it's
encoded
> incorrectly:
>
> wgrib -V
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
>
> The output says "date 0213061012" but it should say "date
2013061012".
>
> Take a look at your GRIB PDS Octet 25:
> wgrib -PDS10
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
>
> You have it set to a value of 3 which says this data is from the 3rd
> century! It should be set to 21. Here's the relevant GRIB table:
>
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>
> Hope that helps.
>
> Thanks,
> John
>
>
> On Mon, Aug 31, 2015 at 3:51 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>
>> Julie,
>> I am traveling but I settled in the hotel now so hope we can solve
this
>> problem.
>>
>> I included the “’s and the program went through the first step.
>>
>> The error is now
>> ERROR :
>> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
>> 'PMTF' for table version 2
>> ERROR :
>>
>> but PMTF exists as entry 157 in version 129 of table 2
>>
>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html <
>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html>
>>
>> Mariusz
>>
>>
>>> On Aug 31, 2015, at 10:28 AM, Julie Prestopnik via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Mariusz.
>>>
>>> The model value needs to be a string, so it needs to be set with
double
>>> quotation marks. I was able to reproduce your error with
>>>
>>> model = WRF;
>>>
>>> Please reset it to
>>>
>>> model = "WRF";
>>>
>>> and that should resolve this error.
>>>
>>> Please let us know if you have any other questions or encounter
any other
>>> problems.
>>>
>>> Thanks,
>>> Julie
>>>
>>> On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT <
>> met_help at ucar.edu
>>>> wrote:
>>>
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>>>
>>>> Julie,
>>>> I am getting the same error,
>>>> Mariusz
>>>>
>>>> ERROR :
>>>> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
>>>> ERROR :
>>>>
>>>>
>>>>
>>>>> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT <
>> met_help at ucar.edu>
>>>> wrote:
>>>>>
>>>>> Hi Mariusz.
>>>>>
>>>>> In your configuration file, please try replacing:
>>>>>
>>>>> model = wrf;
>>>>>
>>>>> with:
>>>>>
>>>>> model = "WRF";
>>>>>
>>>>> I believe that will get you past the error you are receiving.
>>>>>
>>>>> Please let us know if you have any other questions or encounter
any
>> other
>>>>> problems.
>>>>>
>>>>> Thanks,
>>>>> Julie
>>>>>
>>>>> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
>>>> met_help at ucar.edu
>>>>>> wrote:
>>>>>
>>>>>>
>>>>>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>> Queue: met_help
>>>>>> Subject: pointstat help (somewhat urgent)
>>>>>> Owner: Nobody
>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>> Status: new
>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213
>>>
>>>>>>
>>>>>>
>>>>>> Hi John et al.,
>>>>>>
>>>>>> I am hoping that I can still make some figures for a
presentation on
>>>>>> Tuesday afternoon using MET and am naively counting on your
help.
>>>>>>
>>>>>> I produced observation files for fine aerosols which figure as
PMTF in
>>>>>> grib table 129 with id 157 and converted them with ascii2nc
>>>>>> with the header that looks like
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> (on Zeus at
>>>>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
>>>>>> pmsfc_4met_2013061000.nc)
>>>>>>
>>>>>>
>>>>>> I also converted wrf subsetted files to grib that look like
this
>>>>>>
>>>>>> %wgrib -V pmsfc.t12z.25pm00
>>>>>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
>>>>>> grid=255 sfc anl:
>>>>>> PMTF=Particulate matter (fine) [ug/m^3]
>>>>>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave 0
>>>>>> missing 0
>>>>>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
winds(grid)
>>>>>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
>>>>>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
>>>>>> 0.000000
>>>>>> North Pole (440 x 284) Dx 12.000000 Dy
12.000000
>> scan
>>>>>> 64 mode 136
>>>>>> min/max data 0.13464 0.210263 num bits 13
>> BDS_Ref
>>>>>> 0.13464 DecScale 0 BinScale -16
>>>>>>
>>>>>> (On Zeus at
>>>>>>
>>>>
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
>>>>>>
>>>>>> I know there is something wrong at least with my config file
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> The error from poinstat is
>>>>>>
>>>>>> ERROR :
>>>>>> ERROR : do_assign_id() -> identifier "wrf" not defined in this
scope!
>>>>>> ERROR :
>>>>>>
>>>>>> and I am not sure how to tell the code that this a grib file.
>>>>>>
>>>>>> Can you help in diagnosing the problem?
>>>>>>
>>>>>> Thanks,
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Julie Prestopnik
>>>>> National Center for Atmospheric Research
>>>>> Research Applications Laboratory
>>>>> Phone: 303.497.8399
>>>>> Email: jpresto at ucar.edu
>>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Julie Prestopnik
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>
>>
>>
>
------------------------------------------------
Subject: pointstat help (somewhat urgent)
From: John Halley Gotway
Time: Tue Sep 01 09:58:20 2015
Mariusz,
I took a closer look at your data on theia this morning and think the
issue
is how you've encoded the observation message type. You've set it to
PMTF,
as seen here:
ncdump -v hdr_typ
/scratch1/portfolios/BMC/chem-var/pagowski/codes/outdata/pmsfc_4met/
pmsfc_4met_2013061000.nc
There is logic within Point-Stat to do verification at the surface but
it's
keyed off the message type string. This logic is inherited from the
NCEP
verfication software on which MET is based. I'd suggest that you set
the
observation message type to "ADPSFC", as I've done in this version of
that
file:
ncdump -v hdr_typ
/home/John.H.Gotway/MET_Help/pagowski_data_20150831/pmsfc_4met_2013061000_ADPSFC.nc
In your Point-Stat configuration file, set:
message_type = [ "ADPSFC" ];
And then you'll get plenty of matched pairs, as I did:
DEBUG 2: Processing PMTF/Z0 versus PMTF/Z0, for observation type
ADPSFC,
over region FULL, for interpolation method DW_MEAN(4), using 2683
pairs.
DEBUG 3: Number of matched pairs = 2683
DEBUG 3: Observations processed = 2793
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 110
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
Hope that helps.
Thanks,
John
On Mon, Aug 31, 2015 at 6:49 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>
> One thing that raises some concern:
> both observations and model are assumed to be on the same level so
I set
> for both Z0
>
> Why is it that a message appears
>
> ...
> DEBUG 3: Rejected: level mismatch = 1333
> …
>
> It looks like this check does not really reject any obs/model pairs
since
> the number of obs that I would expect to be matching is right - just
to
> make sure
> I am not missing something.
>
> Mariusz
>
> > On Aug 31, 2015, at 5:10 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
> >
> > Mariusz,
> >
> > I was able to get MET to run on your data by modifying the Point-
Stat
> > configuration file slightly.
> >
> > You are passing Point-Stat a forecast GRIB file and a NetCDF point
> > observation file, but you had the config file set as if the
forecast was
> a
> > gridded NetCDF file. Please try the following settings instead:
> >
> > ++++++++++++++++++++++
> >
> > GRIB1_ptv = 129;
> >
> > fcst = {
> > field = [
> > {
> > name = "PMTF";
> > level = "Z0";
> > cat_thresh = [ < 500.0 ];
> > }
> > ];
> > };
> >
> >
> > obs = {
> >
> > message_type = [ "ANYSFC" ];
> >
> > field = [
> > {
> > name = "PMTF";
> > level = "Z2";
> > }
> > ];
> > }
> >
> > +++++++++++++++++++++++
> >
> > Notice that I defined GRIB1_ptv outside of "fcst" and "obs" so
it'll
> apply
> > to both. This runs but doesn't produce any matched pairs because
the
> valid
> > times don't line up:
> >
> > DEBUG 2: Processing PMTF/Z0 versus PMTF/Z2, for observation type
ANYSFC,
> > over region FULL, for interpolation method DW_MEAN(4), using 0
pairs.
> > DEBUG 3: Number of matched pairs = 0
> > DEBUG 3: Observations processed = 2793
> > DEBUG 3: Rejected: GRIB code = 0
> > DEBUG 3: Rejected: valid time = 2793
> >
> > Your point observations are valid from 20130610_003000 to
> 20130610_033000.
> > (ncdump -v hdr_vld
> > /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
> > pmsfc_4met_2013061000.nc)
> >
> > I tried dumping the time from your GRIB file, but I think it's
encoded
> > incorrectly:
> >
> > wgrib -V
> >
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
> >
> > The output says "date 0213061012" but it should say "date
2013061012".
> >
> > Take a look at your GRIB PDS Octet 25:
> > wgrib -PDS10
> >
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
> >
> > You have it set to a value of 3 which says this data is from the
3rd
> > century! It should be set to 21. Here's the relevant GRIB table:
> >
> > http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> >
> > On Mon, Aug 31, 2015 at 3:51 PM, Mariusz Pagowski via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
> >>
> >> Julie,
> >> I am traveling but I settled in the hotel now so hope we can
solve this
> >> problem.
> >>
> >> I included the “’s and the program went through the first step.
> >>
> >> The error is now
> >> ERROR :
> >> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
> >> 'PMTF' for table version 2
> >> ERROR :
> >>
> >> but PMTF exists as entry 157 in version 129 of table 2
> >>
> >> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html <
> >> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html>
> >>
> >> Mariusz
> >>
> >>
> >>> On Aug 31, 2015, at 10:28 AM, Julie Prestopnik via RT <
> met_help at ucar.edu>
> >> wrote:
> >>>
> >>> Hi Mariusz.
> >>>
> >>> The model value needs to be a string, so it needs to be set with
double
> >>> quotation marks. I was able to reproduce your error with
> >>>
> >>> model = WRF;
> >>>
> >>> Please reset it to
> >>>
> >>> model = "WRF";
> >>>
> >>> and that should resolve this error.
> >>>
> >>> Please let us know if you have any other questions or encounter
any
> other
> >>> problems.
> >>>
> >>> Thanks,
> >>> Julie
> >>>
> >>> On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT <
> >> met_help at ucar.edu
> >>>> wrote:
> >>>
> >>>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
> >>>>
> >>>> Julie,
> >>>> I am getting the same error,
> >>>> Mariusz
> >>>>
> >>>> ERROR :
> >>>> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
> >>>> ERROR :
> >>>>
> >>>>
> >>>>
> >>>>> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT <
> >> met_help at ucar.edu>
> >>>> wrote:
> >>>>>
> >>>>> Hi Mariusz.
> >>>>>
> >>>>> In your configuration file, please try replacing:
> >>>>>
> >>>>> model = wrf;
> >>>>>
> >>>>> with:
> >>>>>
> >>>>> model = "WRF";
> >>>>>
> >>>>> I believe that will get you past the error you are receiving.
> >>>>>
> >>>>> Please let us know if you have any other questions or
encounter any
> >> other
> >>>>> problems.
> >>>>>
> >>>>> Thanks,
> >>>>> Julie
> >>>>>
> >>>>> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
> >>>> met_help at ucar.edu
> >>>>>> wrote:
> >>>>>
> >>>>>>
> >>>>>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
> >>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> >>>>>> Queue: met_help
> >>>>>> Subject: pointstat help (somewhat urgent)
> >>>>>> Owner: Nobody
> >>>>>> Requestors: Mariusz.Pagowski at noaa.gov
> >>>>>> Status: new
> >>>>>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213
> >>>
> >>>>>>
> >>>>>>
> >>>>>> Hi John et al.,
> >>>>>>
> >>>>>> I am hoping that I can still make some figures for a
presentation on
> >>>>>> Tuesday afternoon using MET and am naively counting on your
help.
> >>>>>>
> >>>>>> I produced observation files for fine aerosols which figure
as PMTF
> in
> >>>>>> grib table 129 with id 157 and converted them with ascii2nc
> >>>>>> with the header that looks like
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> (on Zeus at
> >>>>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
> >>>>>> pmsfc_4met_2013061000.nc)
> >>>>>>
> >>>>>>
> >>>>>> I also converted wrf subsetted files to grib that look like
this
> >>>>>>
> >>>>>> %wgrib -V pmsfc.t12z.25pm00
> >>>>>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
> >>>>>> grid=255 sfc anl:
> >>>>>> PMTF=Particulate matter (fine) [ug/m^3]
> >>>>>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave
> 0
> >>>>>> missing 0
> >>>>>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
> winds(grid)
> >>>>>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
> >>>>>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
> >>>>>> 0.000000
> >>>>>> North Pole (440 x 284) Dx 12.000000 Dy
12.000000
> >> scan
> >>>>>> 64 mode 136
> >>>>>> min/max data 0.13464 0.210263 num bits 13
> >> BDS_Ref
> >>>>>> 0.13464 DecScale 0 BinScale -16
> >>>>>>
> >>>>>> (On Zeus at
> >>>>>>
> >>>>
> >>
> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
> >>>>>>
> >>>>>> I know there is something wrong at least with my config file
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> The error from poinstat is
> >>>>>>
> >>>>>> ERROR :
> >>>>>> ERROR : do_assign_id() -> identifier "wrf" not defined in
this
> scope!
> >>>>>> ERROR :
> >>>>>>
> >>>>>> and I am not sure how to tell the code that this a grib file.
> >>>>>>
> >>>>>> Can you help in diagnosing the problem?
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Mariusz
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> Julie Prestopnik
> >>>>> National Center for Atmospheric Research
> >>>>> Research Applications Laboratory
> >>>>> Phone: 303.497.8399
> >>>>> Email: jpresto at ucar.edu
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>> --
> >>> Julie Prestopnik
> >>> National Center for Atmospheric Research
> >>> Research Applications Laboratory
> >>> Phone: 303.497.8399
> >>> Email: jpresto at ucar.edu
> >>>
> >>
> >>
> >>
> >
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #73213] pointstat help (somewhat urgent)
From: Mariusz Pagowski
Time: Tue Sep 01 10:34:15 2015
John,
thanks again. You saved me in the last moment from misrepresenting
results to a group of people,
Mariusz
> On Sep 1, 2015, at 9:58 AM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Mariusz,
>
> I took a closer look at your data on theia this morning and think
the issue
> is how you've encoded the observation message type. You've set it
to PMTF,
> as seen here:
>
> ncdump -v hdr_typ
> /scratch1/portfolios/BMC/chem-var/pagowski/codes/outdata/pmsfc_4met/
> pmsfc_4met_2013061000.nc
>
> There is logic within Point-Stat to do verification at the surface
but it's
> keyed off the message type string. This logic is inherited from the
NCEP
> verfication software on which MET is based. I'd suggest that you
set the
> observation message type to "ADPSFC", as I've done in this version
of that
> file:
>
> ncdump -v hdr_typ
>
/home/John.H.Gotway/MET_Help/pagowski_data_20150831/pmsfc_4met_2013061000_ADPSFC.nc
>
> In your Point-Stat configuration file, set:
> message_type = [ "ADPSFC" ];
>
> And then you'll get plenty of matched pairs, as I did:
>
> DEBUG 2: Processing PMTF/Z0 versus PMTF/Z0, for observation type
ADPSFC,
> over region FULL, for interpolation method DW_MEAN(4), using 2683
pairs.
> DEBUG 3: Number of matched pairs = 2683
> DEBUG 3: Observations processed = 2793
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: GRIB code = 0
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 110
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
>
>
> Hope that helps.
>
> Thanks,
> John
>
>
>
> On Mon, Aug 31, 2015 at 6:49 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>
>> One thing that raises some concern:
>> both observations and model are assumed to be on the same level so
I set
>> for both Z0
>>
>> Why is it that a message appears
>>
>> ...
>> DEBUG 3: Rejected: level mismatch = 1333
>> …
>>
>> It looks like this check does not really reject any obs/model pairs
since
>> the number of obs that I would expect to be matching is right -
just to
>> make sure
>> I am not missing something.
>>
>> Mariusz
>>
>>> On Aug 31, 2015, at 5:10 PM, John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>>
>>> Mariusz,
>>>
>>> I was able to get MET to run on your data by modifying the Point-
Stat
>>> configuration file slightly.
>>>
>>> You are passing Point-Stat a forecast GRIB file and a NetCDF point
>>> observation file, but you had the config file set as if the
forecast was
>> a
>>> gridded NetCDF file. Please try the following settings instead:
>>>
>>> ++++++++++++++++++++++
>>>
>>> GRIB1_ptv = 129;
>>>
>>> fcst = {
>>> field = [
>>> {
>>> name = "PMTF";
>>> level = "Z0";
>>> cat_thresh = [ < 500.0 ];
>>> }
>>> ];
>>> };
>>>
>>>
>>> obs = {
>>>
>>> message_type = [ "ANYSFC" ];
>>>
>>> field = [
>>> {
>>> name = "PMTF";
>>> level = "Z2";
>>> }
>>> ];
>>> }
>>>
>>> +++++++++++++++++++++++
>>>
>>> Notice that I defined GRIB1_ptv outside of "fcst" and "obs" so
it'll
>> apply
>>> to both. This runs but doesn't produce any matched pairs because
the
>> valid
>>> times don't line up:
>>>
>>> DEBUG 2: Processing PMTF/Z0 versus PMTF/Z2, for observation type
ANYSFC,
>>> over region FULL, for interpolation method DW_MEAN(4), using 0
pairs.
>>> DEBUG 3: Number of matched pairs = 0
>>> DEBUG 3: Observations processed = 2793
>>> DEBUG 3: Rejected: GRIB code = 0
>>> DEBUG 3: Rejected: valid time = 2793
>>>
>>> Your point observations are valid from 20130610_003000 to
>> 20130610_033000.
>>> (ncdump -v hdr_vld
>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
>>> pmsfc_4met_2013061000.nc)
>>>
>>> I tried dumping the time from your GRIB file, but I think it's
encoded
>>> incorrectly:
>>>
>>> wgrib -V
>>>
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
>>>
>>> The output says "date 0213061012" but it should say "date
2013061012".
>>>
>>> Take a look at your GRIB PDS Octet 25:
>>> wgrib -PDS10
>>>
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12/pmsfc.t12z.25pm00
>>>
>>> You have it set to a value of 3 which says this data is from the
3rd
>>> century! It should be set to 21. Here's the relevant GRIB table:
>>>
>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/section1.html
>>>
>>> Hope that helps.
>>>
>>> Thanks,
>>> John
>>>
>>>
>>> On Mon, Aug 31, 2015 at 3:51 PM, Mariusz Pagowski via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>>>
>>>> Julie,
>>>> I am traveling but I settled in the hotel now so hope we can
solve this
>>>> problem.
>>>>
>>>> I included the “’s and the program went through the first step.
>>>>
>>>> The error is now
>>>> ERROR :
>>>> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
>>>> 'PMTF' for table version 2
>>>> ERROR :
>>>>
>>>> but PMTF exists as entry 157 in version 129 of table 2
>>>>
>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html <
>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html>
>>>>
>>>> Mariusz
>>>>
>>>>
>>>>> On Aug 31, 2015, at 10:28 AM, Julie Prestopnik via RT <
>> met_help at ucar.edu>
>>>> wrote:
>>>>>
>>>>> Hi Mariusz.
>>>>>
>>>>> The model value needs to be a string, so it needs to be set with
double
>>>>> quotation marks. I was able to reproduce your error with
>>>>>
>>>>> model = WRF;
>>>>>
>>>>> Please reset it to
>>>>>
>>>>> model = "WRF";
>>>>>
>>>>> and that should resolve this error.
>>>>>
>>>>> Please let us know if you have any other questions or encounter
any
>> other
>>>>> problems.
>>>>>
>>>>> Thanks,
>>>>> Julie
>>>>>
>>>>> On Mon, Aug 31, 2015 at 10:20 AM, Mariusz Pagowski via RT <
>>>> met_help at ucar.edu
>>>>>> wrote:
>>>>>
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213 >
>>>>>>
>>>>>> Julie,
>>>>>> I am getting the same error,
>>>>>> Mariusz
>>>>>>
>>>>>> ERROR :
>>>>>> ERROR : do_assign_id() -> identifier "WRF" not defined in this
scope!
>>>>>> ERROR :
>>>>>>
>>>>>>
>>>>>>
>>>>>>> On Aug 31, 2015, at 8:48 AM, Julie Prestopnik via RT <
>>>> met_help at ucar.edu>
>>>>>> wrote:
>>>>>>>
>>>>>>> Hi Mariusz.
>>>>>>>
>>>>>>> In your configuration file, please try replacing:
>>>>>>>
>>>>>>> model = wrf;
>>>>>>>
>>>>>>> with:
>>>>>>>
>>>>>>> model = "WRF";
>>>>>>>
>>>>>>> I believe that will get you past the error you are receiving.
>>>>>>>
>>>>>>> Please let us know if you have any other questions or
encounter any
>>>> other
>>>>>>> problems.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Julie
>>>>>>>
>>>>>>> On Sun, Aug 30, 2015 at 10:29 PM, Mariusz Pagowski via RT <
>>>>>> met_help at ucar.edu
>>>>>>>> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>> Sun Aug 30 22:29:40 2015: Request 73213 was acted upon.
>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>> Queue: met_help
>>>>>>>> Subject: pointstat help (somewhat urgent)
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73213
>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi John et al.,
>>>>>>>>
>>>>>>>> I am hoping that I can still make some figures for a
presentation on
>>>>>>>> Tuesday afternoon using MET and am naively counting on your
help.
>>>>>>>>
>>>>>>>> I produced observation files for fine aerosols which figure
as PMTF
>> in
>>>>>>>> grib table 129 with id 157 and converted them with ascii2nc
>>>>>>>> with the header that looks like
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> (on Zeus at
>>>>>>>> /scratch1/portfolios/BMC/chem-
var/pagowski/codes/outdata/pmsfc_4met/
>>>>>>>> pmsfc_4met_2013061000.nc)
>>>>>>>>
>>>>>>>>
>>>>>>>> I also converted wrf subsetted files to grib that look like
this
>>>>>>>>
>>>>>>>> %wgrib -V pmsfc.t12z.25pm00
>>>>>>>> rec 1:0:date 0213061012 PMTF kpds5=157 kpds6=1 kpds7=0
levels=(0,0)
>>>>>>>> grid=255 sfc anl:
>>>>>>>> PMTF=Particulate matter (fine) [ug/m^3]
>>>>>>>> timerange 0 P1 0 P2 0 TimeU 1 nx 440 ny 284 GDS grid 3
num_in_ave
>> 0
>>>>>>>> missing 0
>>>>>>>> center 7 subcenter 0 process 211 Table 129 scan: WE:SN
>> winds(grid)
>>>>>>>> Lambert Conf: Lat1 21.123000 Lon1 -122.321000 Lov
-97.000000
>>>>>>>> Latin1 45.000000 Latin2 33.000000 LatSP 0.000000
LonSP
>>>>>>>> 0.000000
>>>>>>>> North Pole (440 x 284) Dx 12.000000 Dy
12.000000
>>>> scan
>>>>>>>> 64 mode 136
>>>>>>>> min/max data 0.13464 0.210263 num bits 13
>>>> BDS_Ref
>>>>>>>> 0.13464 DecScale 0 BinScale -16
>>>>>>>>
>>>>>>>> (On Zeus at
>>>>>>>>
>>>>>>
>>>>
>> /scratch1/portfolios/BMC/chem-
var/pagowski/enkf_runs/wrf_run_gfs_all/pmsfc_test_211/2013_06_10_12)
>>>>>>>>
>>>>>>>> I know there is something wrong at least with my config file
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> The error from poinstat is
>>>>>>>>
>>>>>>>> ERROR :
>>>>>>>> ERROR : do_assign_id() -> identifier "wrf" not defined in
this
>> scope!
>>>>>>>> ERROR :
>>>>>>>>
>>>>>>>> and I am not sure how to tell the code that this a grib file.
>>>>>>>>
>>>>>>>> Can you help in diagnosing the problem?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Mariusz
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Julie Prestopnik
>>>>>>> National Center for Atmospheric Research
>>>>>>> Research Applications Laboratory
>>>>>>> Phone: 303.497.8399
>>>>>>> Email: jpresto at ucar.edu
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Julie Prestopnik
>>>>> National Center for Atmospheric Research
>>>>> Research Applications Laboratory
>>>>> Phone: 303.497.8399
>>>>> Email: jpresto at ucar.edu
>>>>>
>>>>
>>>>
>>>>
>>>
>>
>>
>>
>>
>
------------------------------------------------
More information about the Met_help
mailing list