[Met_help] [rt.rap.ucar.edu #75594] History for Grib2 Fields
John Halley Gotway via RT
met_help at ucar.edu
Fri Apr 1 12:58:32 MDT 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John, I am degribbing UM dust forecasts for Point Stat. The degribbed
header for the file is listed below:
[1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307] dg2 -V
GALWEM_20160307_CY00_FH24.GR2
1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0 center=57
local_table=1 parmcat=19 parm=211:
ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
grid_template=0:winds(N/S):
lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output WE:SN res
48
lat -89.921875 to 89.921875 by 0.156250
lon 0.117187 to 359.886650 by 0.234378 #points=1769472
2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0 center=57
local_table=1 parmcat=13 parm=192:
ndata=1769472:undef=0:mean=520.351:min=0:max=44701
grid_template=0:winds(N/S):
lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output WE:SN res
48
lat -89.921875 to 89.921875 by 0.156250
lon 0.117187 to 359.886650 by 0.234378 #points=1769472
My configuration file is attached. In the table_files directory, I looked
in the grib2_vars_flat.txt file. What are the three columns in this file?
How would I add parm 211 to it so MET will recognize it?
Thanks
Bob
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Grib2 Fields
From: Julie Prestopnik
Time: Mon Mar 21 10:09:54 2016
Hi Bob. John is out of the office today. I'll do what I can to help.
I believe that the three columns in the grib2_vars_flat.txt file are
the
GRIB2:
discipline
category
number
and MET uses the tables at these locations to map the GRIB2 codes to
the
forecast variables specified by users in the config file.
You should be able to modify the data/table_files/grib2_vars_flat.txt
file
and copy that file into the "share/met/table_files" directory...
either
manually or by running "make install".
In your degribbed file header I saw discipline=0 and parmcat=19.
Looking
here:
http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-19.shtml
I see that 211 is:
211 Visible, Black Sky Albedo
%
SBSALB
Is that what you're looking at?
If so, I believe you would add:
0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
Please give that a try, and let us know how it works out. I hope that
helps.
Julie
On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Grib2 Fields
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
>
> John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> header for the file is listed below:
>
> [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307] dg2
-V
> GALWEM_20160307_CY00_FH24.GR2
> 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
center=57
> local_table=1 parmcat=19 parm=211:
> ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
center=57
> local_table=1 parmcat=13 parm=192:
> ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> My configuration file is attached. In the table_files directory, I
looked
> in the grib2_vars_flat.txt file. What are the three columns in this
file?
> How would I add parm 211 to it so MET will recognize it?
>
> Thanks
> Bob
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Mon Mar 21 10:26:24 2016
Thanks for the information Julie. I added the GRIB2 fields to the
forecast field and also added to the grib2_vars_flat.txt as you
suggested. That got me past the fcst field errors to the obs field.
The obs file I am using only has field 211 which is 2m visibility. I
get the following error when I run now:
DEBUG 1: Default Config File: /h/WXQC/met-
5.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR :
ERROR : PointStatConfInfo::process_config() -> The number of
verification tasks in "obs.field" must be non-zero and match the
number in "fcst.field".
ERROR :
[1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
This is my first time using point stat, hence the questions.
Thanks
Bob
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 21, 2016 11:10 AM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Hi Bob. John is out of the office today. I'll do what I can to help.
I believe that the three columns in the grib2_vars_flat.txt file are
the
GRIB2:
discipline
category
number
and MET uses the tables at these locations to map the GRIB2 codes to
the forecast variables specified by users in the config file.
You should be able to modify the data/table_files/grib2_vars_flat.txt
file and copy that file into the "share/met/table_files" directory...
either manually or by running "make install".
In your degribbed file header I saw discipline=0 and parmcat=19.
Looking
here:
http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-19.shtml
I see that 211 is:
211 Visible, Black Sky Albedo
%
SBSALB
Is that what you're looking at?
If so, I believe you would add:
0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
Please give that a try, and let us know how it works out. I hope that
helps.
Julie
On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Grib2 Fields
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> >
>
>
> John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> header for the file is listed below:
>
> [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307] dg2
> -V
> GALWEM_20160307_CY00_FH24.GR2
> 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> center=57
> local_table=1 parmcat=19 parm=211:
> ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> center=57
> local_table=1 parmcat=13 parm=192:
> ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> My configuration file is attached. In the table_files directory, I
> looked in the grib2_vars_flat.txt file. What are the three columns
in this file?
> How would I add parm 211 to it so MET will recognize it?
>
> Thanks
> Bob
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Grib2 Fields
From: Julie Prestopnik
Time: Mon Mar 21 10:52:36 2016
Hi Bob. I'm not sure that this suggestion is going to fix your
problem,
but I did notice that the config file you sent after your modification
says
"ob = {" instead of "obs = {". Note the missing "s" in "obs". I
don't
know that changing that will fix your current problem, but it should
be
changed, none-the-less.
If changing that doesn't fix your problem, could you please post your
fcst_file, obs_file, and config_file to our anonymous ftp site
following
these directions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
and email to me the exact command that you are running, so that I can
try
to reproduce the problem you are having?
Thanks!
Julie
On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Thanks for the information Julie. I added the GRIB2 fields to the
> forecast field and also added to the grib2_vars_flat.txt as you
suggested.
> That got me past the fcst field errors to the obs field. The obs
file I am
> using only has field 211 which is 2m visibility. I get the
following error
> when I run now:
>
> DEBUG 1: Default Config File:
> /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: data/config/PointStatConfig_dust
> ERROR :
> ERROR : PointStatConfInfo::process_config() -> The number of
verification
> tasks in "obs.field" must be non-zero and match the number in
"fcst.field".
> ERROR :
> [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
>
> This is my first time using point stat, hence the questions.
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 11:10 AM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Hi Bob. John is out of the office today. I'll do what I can to
help.
>
> I believe that the three columns in the grib2_vars_flat.txt file are
the
> GRIB2:
>
> discipline
> category
> number
>
> and MET uses the tables at these locations to map the GRIB2 codes to
the
> forecast variables specified by users in the config file.
>
> You should be able to modify the
data/table_files/grib2_vars_flat.txt file
> and copy that file into the "share/met/table_files" directory...
either
> manually or by running "make install".
>
> In your degribbed file header I saw discipline=0 and parmcat=19.
Looking
> here:
>
> http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.shtml
>
> I see that 211 is:
>
> 211 Visible, Black Sky Albedo
> %
> SBSALB
> Is that what you're looking at?
>
> If so, I believe you would add:
>
> 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
>
> Please give that a try, and let us know how it works out. I hope
that
> helps.
>
> Julie
>
>
> On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Grib2 Fields
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > >
> >
> >
> > John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> > header for the file is listed below:
> >
> > [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307]
dg2
> > -V
> > GALWEM_20160307_CY00_FH24.GR2
> > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=19 parm=211:
> > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=13 parm=192:
> > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > My configuration file is attached. In the table_files directory,
I
> > looked in the grib2_vars_flat.txt file. What are the three
columns in
> this file?
> > How would I add parm 211 to it so MET will recognize it?
> >
> > Thanks
> > Bob
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Mon Mar 21 12:57:38 2016
Julie, The obs versus ob did fix one error - thanks for catching. I
placed the model file, ob file, and config file in the directory, I
think. I got a warning message on each transfer. The command line is
below.
bin/point_stat
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
/h/data/global/WXQC/data/met/nc_obs/nc_2016030800
data/config/PointStatConfig_dust -v 5
If you don't see the data, I will try a different method of transfer.
Thanks
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 21, 2016 11:53 AM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Hi Bob. I'm not sure that this suggestion is going to fix your
problem,
but I did notice that the config file you sent after your modification
says
"ob = {" instead of "obs = {". Note the missing "s" in "obs". I
don't
know that changing that will fix your current problem, but it should
be changed, none-the-less.
If changing that doesn't fix your problem, could you please post your
fcst_file, obs_file, and config_file to our anonymous ftp site
following these directions:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
and email to me the exact command that you are running, so that I can
try to reproduce the problem you are having?
Thanks!
Julie
On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Thanks for the information Julie. I added the GRIB2 fields to the
> forecast field and also added to the grib2_vars_flat.txt as you
suggested.
> That got me past the fcst field errors to the obs field. The obs
file
> I am using only has field 211 which is 2m visibility. I get the
> following error when I run now:
>
> DEBUG 1: Default Config File:
> /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: data/config/PointStatConfig_dust ERROR :
> ERROR : PointStatConfInfo::process_config() -> The number of
> verification tasks in "obs.field" must be non-zero and match the
number in "fcst.field".
> ERROR :
> [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
>
> This is my first time using point stat, hence the questions.
>
> Thanks
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 11:10 AM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Hi Bob. John is out of the office today. I'll do what I can to
help.
>
> I believe that the three columns in the grib2_vars_flat.txt file are
> the
> GRIB2:
>
> discipline
> category
> number
>
> and MET uses the tables at these locations to map the GRIB2 codes to
> the forecast variables specified by users in the config file.
>
> You should be able to modify the
data/table_files/grib2_vars_flat.txt
> file and copy that file into the "share/met/table_files"
directory...
> either manually or by running "make install".
>
> In your degribbed file header I saw discipline=0 and parmcat=19.
> Looking
> here:
>
> http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.shtml
>
> I see that 211 is:
>
> 211 Visible, Black Sky Albedo
> %
> SBSALB
> Is that what you're looking at?
>
> If so, I believe you would add:
>
> 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
>
> Please give that a try, and let us know how it works out. I hope
that
> helps.
>
> Julie
>
>
> On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Grib2 Fields
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > >
> >
> >
> > John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> > header for the file is listed below:
> >
> > [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307]
dg2
> > -V
> > GALWEM_20160307_CY00_FH24.GR2
> > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=19 parm=211:
> > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=13 parm=192:
> > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > My configuration file is attached. In the table_files directory,
I
> > looked in the grib2_vars_flat.txt file. What are the three
columns
> > in
> this file?
> > How would I add parm 211 to it so MET will recognize it?
> >
> > Thanks
> > Bob
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Grib2 Fields
From: Julie Prestopnik
Time: Mon Mar 21 13:13:28 2016
Hi Bob. Unfortunately, I do not see any directory or data at
incoming/irap/met_help/craig_data.
You mentioned that changing "ob" to "obs" did fix one error. What
error
are you currently receiving?
Thanks,
Julie
On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Julie, The obs versus ob did fix one error - thanks for catching. I
> placed the model file, ob file, and config file in the directory, I
think.
> I got a warning message on each transfer. The command line is
below.
>
> bin/point_stat
> /home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
> /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> data/config/PointStatConfig_dust -v 5
>
> If you don't see the data, I will try a different method of
transfer.
>
> Thanks
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 11:53 AM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Hi Bob. I'm not sure that this suggestion is going to fix your
problem,
> but I did notice that the config file you sent after your
modification says
> "ob = {" instead of "obs = {". Note the missing "s" in "obs". I
don't
> know that changing that will fix your current problem, but it should
be
> changed, none-the-less.
>
> If changing that doesn't fix your problem, could you please post
your
> fcst_file, obs_file, and config_file to our anonymous ftp site
following
> these directions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> and email to me the exact command that you are running, so that I
can try
> to reproduce the problem you are having?
>
> Thanks!
>
> Julie
>
> On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Thanks for the information Julie. I added the GRIB2 fields to the
> > forecast field and also added to the grib2_vars_flat.txt as you
> suggested.
> > That got me past the fcst field errors to the obs field. The obs
file
> > I am using only has field 211 which is 2m visibility. I get the
> > following error when I run now:
> >
> > DEBUG 1: Default Config File:
> > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > DEBUG 1: User Config File: data/config/PointStatConfig_dust ERROR
:
> > ERROR : PointStatConfInfo::process_config() -> The number of
> > verification tasks in "obs.field" must be non-zero and match the
number
> in "fcst.field".
> > ERROR :
> > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> >
> > This is my first time using point stat, hence the questions.
> >
> > Thanks
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 21, 2016 11:10 AM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> >
> > Hi Bob. John is out of the office today. I'll do what I can to
help.
> >
> > I believe that the three columns in the grib2_vars_flat.txt file
are
> > the
> > GRIB2:
> >
> > discipline
> > category
> > number
> >
> > and MET uses the tables at these locations to map the GRIB2 codes
to
> > the forecast variables specified by users in the config file.
> >
> > You should be able to modify the
data/table_files/grib2_vars_flat.txt
> > file and copy that file into the "share/met/table_files"
directory...
> > either manually or by running "make install".
> >
> > In your degribbed file header I saw discipline=0 and parmcat=19.
> > Looking
> > here:
> >
> > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.shtml
> >
> > I see that 211 is:
> >
> > 211 Visible, Black Sky Albedo
> > %
> > SBSALB
> > Is that what you're looking at?
> >
> > If so, I believe you would add:
> >
> > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> >
> > Please give that a try, and let us know how it works out. I hope
that
> > helps.
> >
> > Julie
> >
> >
> > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > Queue: met_help
> > > Subject: Grib2 Fields
> > > Owner: Nobody
> > > Requestors: robert.craig.2 at us.af.mil
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > >
> > >
> > >
> > > John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> > > header for the file is listed below:
> > >
> > > [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307]
dg2
> > > -V
> > > GALWEM_20160307_CY00_FH24.GR2
> > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> > > center=57
> > > local_table=1 parmcat=19 parm=211:
> > > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > grid_template=0:winds(N/S):
> > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > WE:SN res
> > > 48
> > > lat -89.921875 to 89.921875 by 0.156250
> > > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> > >
> > > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > > center=57
> > > local_table=1 parmcat=13 parm=192:
> > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > grid_template=0:winds(N/S):
> > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > WE:SN res
> > > 48
> > > lat -89.921875 to 89.921875 by 0.156250
> > > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> > >
> > > My configuration file is attached. In the table_files
directory, I
> > > looked in the grib2_vars_flat.txt file. What are the three
columns
> > > in
> > this file?
> > > How would I add parm 211 to it so MET will recognize it?
> > >
> > > Thanks
> > > Bob
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Mon Mar 21 13:41:34 2016
See the bottom of the listing - I did verbose #5 to hopefully help
locate the issue. Bob
1064 bin/point_stat
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
/h/data/global/WXQC/data/met/nc_obs/nc_2016030800
data/config/PointStatConfig_dust -v 5 > /home/qcteam/list_file
1065 history
[1066 qcteam hpc9-lsn-01d /home/qcteam] cd /h/WXQC/met-5.1
[1067 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
data/global/WXQC/data/met/nc_obs/nc_2016030800
data/config/PointStatConfig_dust -v 5
<
DEBUG 1: Default Config File: /h/WXQC/met-
5.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: data/config/PointStatConfig_dust
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_Gb2".
DEBUG 4: Switching the GRIB2 radius of the earth value of 6371.23 km
to 6371.2 km for internal consistency.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: -89.9219
DEBUG 4: lon_ll: -0.117187
DEBUG 4: delta_lat: 0.15625
DEBUG 4: delta_lon: 0.234378
DEBUG 4: Nlat: 1152
DEBUG 4: Nlon: 1536
DEBUG 4:
Filename ...
| Nelements = 3
| Nalloc = 50
| MaxLength = 56
| IgnoreCase = 0
| | Element # 0 = "/h/WXQC/met-
5.1/share/met/config/ConfigConstants"
| | Element # 1 = "/h/WXQC/met-
5.1/share/met/config/PointStatConfig_default"
| | Element # 2 = "data/config/PointStatConfig_dust"
Debug = false
Config File Entries ...
| Nentries = 71
| Address = 0x7f3558
| Parent = 0
| IsArray = false
| Dictionary Entry[0] ...
| | Name = exit_on_warning
| | Type = BooleanType
| | Boolean Value = false
| Dictionary Entry[1] ...
| | Name = output_precision
| | Type = IntegerType
| | Integer Value = 5
| Dictionary Entry[2] ...
| | Name = GRIB1
| | Type = IntegerType
| | Integer Value = 1
| Dictionary Entry[3] ...
| | Name = GRIB2
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[4] ...
| | Name = NETCDF_MET
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[5] ...
| | Name = NETCDF_PINT
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[6] ...
| | Name = NETCDF_NCCF
| | Type = IntegerType
| | Integer Value = 5
| Dictionary Entry[7] ...
| | Name = NONE
| | Type = IntegerType
| | Integer Value = 1
| Dictionary Entry[8] ...
| | Name = UNION
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[9] ...
| | Name = INTERSECTION
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[10] ...
| | Name = SYMDIFF
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[11] ...
| | Name = MIN
| | Type = IntegerType
| | Integer Value = 1
| Dictionary Entry[12] ...
| | Name = MAX
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[13] ...
| | Name = MEDIAN
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[14] ...
| | Name = UW_MEAN
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[15] ...
| | Name = DW_MEAN
| | Type = IntegerType
| | Integer Value = 5
| Dictionary Entry[16] ...
| | Name = LS_FIT
| | Type = IntegerType
| | Integer Value = 6
| Dictionary Entry[17] ...
| | Name = BILIN
| | Type = IntegerType
| | Integer Value = 7
| Dictionary Entry[18] ...
| | Name = NBRHD
| | Type = IntegerType
| | Integer Value = 8
| Dictionary Entry[19] ...
| | Name = NEAREST
| | Type = IntegerType
| | Integer Value = 9
| Dictionary Entry[20] ...
| | Name = BUDGET
| | Type = IntegerType
| | Integer Value = 10
| Dictionary Entry[21] ...
| | Name = BOTH
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[22] ...
| | Name = FCST
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[23] ...
| | Name = OBS
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[24] ...
| | Name = ADECK
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[25] ...
| | Name = BDECK
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[26] ...
| | Name = FILL
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[27] ...
| | Name = REPLACE
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[28] ...
| | Name = STAT
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[29] ...
| | Name = PCTILE
| | Type = IntegerType
| | Integer Value = 1
| Dictionary Entry[30] ...
| | Name = BCA
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[31] ...
| | Name = UNIQUE
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[32] ...
| | Name = SINGLE
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[33] ...
| | Name = AUTO
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[34] ...
| | Name = TILE
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[35] ...
| | Name = PAD
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[36] ...
| | Name = HAAR
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[37] ...
| | Name = HAAR_CNTR
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[38] ...
| | Name = DAUB
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[39] ...
| | Name = DAUB_CNTR
| | Type = IntegerType
| | Integer Value = 5
| Dictionary Entry[40] ...
| | Name = BSPLINE
| | Type = IntegerType
| | Integer Value = 6
| Dictionary Entry[41] ...
| | Name = BSPLINE_CNTR
| | Type = IntegerType
| | Integer Value = 7
| Dictionary Entry[42] ...
| | Name = THRESH
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[43] ...
| | Name = ENGINE
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[44] ...
| | Name = MERGE_BOTH
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[45] ...
| | Name = MERGE_FCST
| | Type = IntegerType
| | Integer Value = 3
| Dictionary Entry[46] ...
| | Name = NO_MERGE
| | Type = IntegerType
| | Integer Value = 4
| Dictionary Entry[47] ...
| | Name = TOP
| | Type = BooleanType
| | Boolean Value = true
| Dictionary Entry[48] ...
| | Name = BOTTOM
| | Type = BooleanType
| | Boolean Value = false
| Dictionary Entry[49] ...
| | Name = model
| | Type = StringType
| | String Value = "WRF"
| Dictionary Entry[50] ...
| | Name = regrid
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 4
| | | Address = 0x2305270
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = to_grid
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[1] ...
| | | | Name = vld_thresh
| | | | Type = FloatType
| | | | Float Value = 0.5
| | | Dictionary Entry[2] ...
| | | | Name = method
| | | | Type = IntegerType
| | | | Integer Value = 9
| | | Dictionary Entry[3] ...
| | | | Name = width
| | | | Type = IntegerType
| | | | Integer Value = 1
| Dictionary Entry[51] ...
| | Name = cat_thresh
| | Type = ArrayType
| | Dict/Array Value =
| | | Nentries = 1
| | | Address = 0x2305e50
| | | Parent = 0x7f3558
| | | IsArray = true
| | | Dictionary Entry[0] ...
| | | | Name = (nul)
| | | | Type = ThresholdType
| | | | Thresh Value =
| | | | | type = 0 (NA)
| | | | | value = -9999
| Dictionary Entry[52] ...
| | Name = cnt_thresh
| | Type = ArrayType
| | Dict/Array Value =
| | | Nentries = 1
| | | Address = 0x2260720
| | | Parent = 0x7f3558
| | | IsArray = true
| | | Dictionary Entry[0] ...
| | | | Name = (nul)
| | | | Type = ThresholdType
| | | | Thresh Value =
| | | | | type = 0 (NA)
| | | | | value = -9999
| Dictionary Entry[53] ...
| | Name = cnt_logic
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[54] ...
| | Name = wind_thresh
| | Type = ArrayType
| | Dict/Array Value =
| | | Nentries = 1
| | | Address = 0x217f370
| | | Parent = 0x7f3558
| | | IsArray = true
| | | Dictionary Entry[0] ...
| | | | Name = (nul)
| | | | Type = ThresholdType
| | | | Thresh Value =
| | | | | type = 0 (NA)
| | | | | value = -9999
| Dictionary Entry[55] ...
| | Name = wind_logic
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[56] ...
| | Name = fcst
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 3
| | | Address = 0x23425c0
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = message_type
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 1
| | | | | Address = 0x2350910
| | | | | Parent = 0x23425c0
| | | | | IsArray = true
| | | | | Dictionary Entry[0] ...
| | | | | | Name = (nul)
| | | | | | Type = StringType
| | | | | | String Value = (nul)
| | | Dictionary Entry[1] ...
| | | | Name = sid_exc
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 0
| | | | | Address = 0x2350e80
| | | | | Parent = 0x23425c0
| | | | | IsArray = true
| | | Dictionary Entry[2] ...
| | | | Name = field
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 1
| | | | | Address = 0x2350fc0
| | | | | Parent = 0x23425c0
| | | | | IsArray = true
| | | | | Dictionary Entry[0] ...
| | | | | | Name = (nul)
| | | | | | Type = DictionaryType
| | | | | | Dict/Array Value =
| | | | | | | Nentries = 5
| | | | | | | Address = 0x2357380
| | | | | | | Parent = 0x2350fc0
| | | | | | | IsArray = false
| | | | | | | Dictionary Entry[0] ...
| | | | | | | | Name = GRIB2_disc
| | | | | | | | Type = StringType
| | | | | | | | String Value = "0"
| | | | | | | Dictionary Entry[1] ...
| | | | | | | | Name = GRIB2_parm_cat
| | | | | | | | Type = StringType
| | | | | | | | String Value = "13"
| | | | | | | Dictionary Entry[2] ...
| | | | | | | | Name = GRIB2_parm
| | | | | | | | Type = StringType
| | | | | | | | String Value = "211"
| | | | | | | Dictionary Entry[3] ...
| | | | | | | | Name = level
| | | | | | | | Type = ArrayType
| | | | | | | | Dict/Array Value =
| | | | | | | | | Nentries = 1
| | | | | | | | | Address = 0x217e390
| | | | | | | | | Parent = 0x2357380
| | | | | | | | | IsArray = true
| | | | | | | | | Dictionary Entry[0] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type = StringType
| | | | | | | | | | String Value = "Z2"
| | | | | | | Dictionary Entry[4] ...
| | | | | | | | Name = cat_thresh
| | | | | | | | Type = ArrayType
| | | | | | | | Dict/Array Value =
| | | | | | | | | Nentries = 3
| | | | | | | | | Address = 0x23548b0
| | | | | | | | | Parent = 0x2357380
| | | | | | | | | IsArray = true
| | | | | | | | | Dictionary Entry[0] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type =
ThresholdType
| | | | | | | | | | Thresh Value =
| | | | | | | | | | | type = 1
(<1609)
| | | | | | | | | | | value = 1609
| | | | | | | | | Dictionary Entry[1] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type =
ThresholdType
| | | | | | | | | | Thresh Value =
| | | | | | | | | | | type = 1
(<3218)
| | | | | | | | | | | value = 3218
| | | | | | | | | Dictionary Entry[2] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type =
ThresholdType
| | | | | | | | | | Thresh Value =
| | | | | | | | | | | type = 1
(<4828)
| | | | | | | | | | | value = 4828
| Dictionary Entry[57] ...
| | Name = obs
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 3
| | | Address = 0x23450f0
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = message_type
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 1
| | | | | Address = 0x234a550
| | | | | Parent = 0x23450f0
| | | | | IsArray = true
| | | | | Dictionary Entry[0] ...
| | | | | | Name = (nul)
| | | | | | Type = StringType
| | | | | | String Value = "ADPSFC"
| | | Dictionary Entry[1] ...
| | | | Name = sid_exc
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 0
| | | | | Address = 0x234bf10
| | | | | Parent = 0x23450f0
| | | | | IsArray = true
| | | Dictionary Entry[2] ...
| | | | Name = field
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 1
| | | | | Address = 0x217fa60
| | | | | Parent = 0x23450f0
| | | | | IsArray = true
| | | | | Dictionary Entry[0] ...
| | | | | | Name = (nul)
| | | | | | Type = DictionaryType
| | | | | | Dict/Array Value =
| | | | | | | Nentries = 3
| | | | | | | Address = 0x2258c40
| | | | | | | Parent = 0x217fa60
| | | | | | | IsArray = false
| | | | | | | Dictionary Entry[0] ...
| | | | | | | | Name = name
| | | | | | | | Type = StringType
| | | | | | | | String Value = "211"
| | | | | | | Dictionary Entry[1] ...
| | | | | | | | Name = level
| | | | | | | | Type = ArrayType
| | | | | | | | Dict/Array Value =
| | | | | | | | | Nentries = 1
| | | | | | | | | Address = 0x234b5b0
| | | | | | | | | Parent = 0x2258c40
| | | | | | | | | IsArray = true
| | | | | | | | | Dictionary Entry[0] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type = StringType
| | | | | | | | | | String Value = "Z2"
| | | | | | | Dictionary Entry[2] ...
| | | | | | | | Name = cat_thresh
| | | | | | | | Type = ArrayType
| | | | | | | | Dict/Array Value =
| | | | | | | | | Nentries = 3
| | | | | | | | | Address = 0x234b930
| | | | | | | | | Parent = 0x2258c40
| | | | | | | | | IsArray = true
| | | | | | | | | Dictionary Entry[0] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type =
ThresholdType
| | | | | | | | | | Thresh Value =
| | | | | | | | | | | type = 1
(<1609)
| | | | | | | | | | | value = 1609
| | | | | | | | | Dictionary Entry[1] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type =
ThresholdType
| | | | | | | | | | Thresh Value =
| | | | | | | | | | | type = 1
(<3218)
| | | | | | | | | | | value = 3218
| | | | | | | | | Dictionary Entry[2] ...
| | | | | | | | | | Name = (nul)
| | | | | | | | | | Type =
ThresholdType
| | | | | | | | | | Thresh Value =
| | | | | | | | | | | type = 1
(<4828)
| | | | | | | | | | | value = 4828
| Dictionary Entry[58] ...
| | Name = climo_mean
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 6
| | | Address = 0x2349de0
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = file_name
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 0
| | | | | Address = 0x2349840
| | | | | Parent = 0x2349de0
| | | | | IsArray = true
| | | Dictionary Entry[1] ...
| | | | Name = field
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 0
| | | | | Address = 0x2348aa0
| | | | | Parent = 0x2349de0
| | | | | IsArray = true
| | | Dictionary Entry[2] ...
| | | | Name = regrid
| | | | Type = DictionaryType
| | | | Dict/Array Value =
| | | | | Nentries = 3
| | | | | Address = 0x2348500
| | | | | Parent = 0x2349de0
| | | | | IsArray = false
| | | | | Dictionary Entry[0] ...
| | | | | | Name = vld_thresh
| | | | | | Type = FloatType
| | | | | | Float Value = 0.5
| | | | | Dictionary Entry[1] ...
| | | | | | Name = method
| | | | | | Type = IntegerType
| | | | | | Integer Value = 9
| | | | | Dictionary Entry[2] ...
| | | | | | Name = width
| | | | | | Type = IntegerType
| | | | | | Integer Value = 1
| | | Dictionary Entry[3] ...
| | | | Name = time_interp_method
| | | | Type = IntegerType
| | | | Integer Value = 5
| | | Dictionary Entry[4] ...
| | | | Name = match_day
| | | | Type = BooleanType
| | | | Boolean Value = false
| | | Dictionary Entry[5] ...
| | | | Name = time_step
| | | | Type = IntegerType
| | | | Integer Value = 21600
| Dictionary Entry[59] ...
| | Name = obs_window
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 2
| | | Address = 0x234fe10
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = beg
| | | | Type = IntegerType
| | | | Integer Value = -7200
| | | Dictionary Entry[1] ...
| | | | Name = end
| | | | Type = IntegerType
| | | | Integer Value = 7200
| Dictionary Entry[60] ...
| | Name = mask
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 3
| | | Address = 0x2350310
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = grid
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 1
| | | | | Address = 0x234a2e0
| | | | | Parent = 0x2350310
| | | | | IsArray = true
| | | | | Dictionary Entry[0] ...
| | | | | | Name = (nul)
| | | | | | Type = StringType
| | | | | | String Value = "FULL"
| | | Dictionary Entry[1] ...
| | | | Name = poly
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 0
| | | | | Address = 0x23424f0
| | | | | Parent = 0x2350310
| | | | | IsArray = true
| | | Dictionary Entry[2] ...
| | | | Name = sid
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 0
| | | | | Address = 0x2344a20
| | | | | Parent = 0x2350310
| | | | | IsArray = true
| Dictionary Entry[61] ...
| | Name = ci_alpha
| | Type = ArrayType
| | Dict/Array Value =
| | | Nentries = 1
| | | Address = 0x234b120
| | | Parent = 0x7f3558
| | | IsArray = true
| | | Dictionary Entry[0] ...
| | | | Name = (nul)
| | | | Type = FloatType
| | | | Float Value = 0.05
| Dictionary Entry[62] ...
| | Name = boot
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 5
| | | Address = 0x2305570
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = interval
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[1] ...
| | | | Name = rep_prop
| | | | Type = FloatType
| | | | Float Value = 1
| | | Dictionary Entry[2] ...
| | | | Name = n_rep
| | | | Type = IntegerType
| | | | Integer Value = 1000
| | | Dictionary Entry[3] ...
| | | | Name = rng
| | | | Type = StringType
| | | | String Value = "mt19937"
| | | Dictionary Entry[4] ...
| | | | Name = seed
| | | | Type = StringType
| | | | String Value = (nul)
| Dictionary Entry[63] ...
| | Name = interp
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 2
| | | Address = 0x23554f0
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = vld_thresh
| | | | Type = FloatType
| | | | Float Value = 1
| | | Dictionary Entry[1] ...
| | | | Name = type
| | | | Type = ArrayType
| | | | Dict/Array Value =
| | | | | Nentries = 1
| | | | | Address = 0x23504a0
| | | | | Parent = 0x23554f0
| | | | | IsArray = true
| | | | | Dictionary Entry[0] ...
| | | | | | Name = (nul)
| | | | | | Type = DictionaryType
| | | | | | Dict/Array Value =
| | | | | | | Nentries = 2
| | | | | | | Address = 0x2355b90
| | | | | | | Parent = 0x23504a0
| | | | | | | IsArray = false
| | | | | | | Dictionary Entry[0] ...
| | | | | | | | Name = method
| | | | | | | | Type = IntegerType
| | | | | | | | Integer Value = 9
| | | | | | | Dictionary Entry[1] ...
| | | | | | | | Name = width
| | | | | | | | Type = IntegerType
| | | | | | | | Integer Value = 1
| Dictionary Entry[64] ...
| | Name = output_flag
| | Type = DictionaryType
| | Dict/Array Value =
| | | Nentries = 15
| | | Address = 0x234cc30
| | | Parent = 0x7f3558
| | | IsArray = false
| | | Dictionary Entry[0] ...
| | | | Name = fho
| | | | Type = IntegerType
| | | | Integer Value = 2
| | | Dictionary Entry[1] ...
| | | | Name = ctc
| | | | Type = IntegerType
| | | | Integer Value = 2
| | | Dictionary Entry[2] ...
| | | | Name = cts
| | | | Type = IntegerType
| | | | Integer Value = 2
| | | Dictionary Entry[3] ...
| | | | Name = mctc
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[4] ...
| | | | Name = mcts
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[5] ...
| | | | Name = cnt
| | | | Type = IntegerType
| | | | Integer Value = 2
| | | Dictionary Entry[6] ...
| | | | Name = sl1l2
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[7] ...
| | | | Name = sal1l2
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[8] ...
| | | | Name = vl1l2
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[9] ...
| | | | Name = val1l2
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[10] ...
| | | | Name = pct
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[11] ...
| | | | Name = pstd
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[12] ...
| | | | Name = pjc
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[13] ...
| | | | Name = prc
| | | | Type = IntegerType
| | | | Integer Value = 1
| | | Dictionary Entry[14] ...
| | | | Name = mpr
| | | | Type = IntegerType
| | | | Integer Value = 2
| Dictionary Entry[65] ...
| | Name = obs_quality
| | Type = ArrayType
| | Dict/Array Value =
| | | Nentries = 0
| | | Address = 0x2346bf0
| | | Parent = 0x7f3558
| | | IsArray = true
| Dictionary Entry[66] ...
| | Name = duplicate_flag
| | Type = IntegerType
| | Integer Value = 2
| Dictionary Entry[67] ...
| | Name = rank_corr_flag
| | Type = BooleanType
| | Boolean Value = true
| Dictionary Entry[68] ...
| | Name = tmp_dir
| | Type = StringType
| | String Value = "/tmp"
| Dictionary Entry[69] ...
| | Name = output_prefix
| | Type = StringType
| | String Value = (nul)
| Dictionary Entry[70] ...
| | Name = version
| | Type = StringType
| | String Value = "V5.1"
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object
of type "FileType_Gb2".
DEBUG 4: parse_conf_sid_exc() -> Station ID exclusion list contains 0
entries.
ERROR :
ERROR : VarInfoGrib2::set_dict() - either name or GRIB2_disc,
GRIB2_parm_cat and GRIB2_parm must be specified in field information
ERROR :
[1068 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Mon Mar 21 14:12:16 2016
Julie, I was finally able to push files to your server - no errors
this time.
Bob
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 21, 2016 2:13 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Hi Bob. Unfortunately, I do not see any directory or data at
incoming/irap/met_help/craig_data.
You mentioned that changing "ob" to "obs" did fix one error. What
error are you currently receiving?
Thanks,
Julie
On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Julie, The obs versus ob did fix one error - thanks for catching. I
> placed the model file, ob file, and config file in the directory, I
think.
> I got a warning message on each transfer. The command line is
below.
>
> bin/point_stat
> /home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
> /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> data/config/PointStatConfig_dust -v 5
>
> If you don't see the data, I will try a different method of
transfer.
>
> Thanks
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 11:53 AM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Hi Bob. I'm not sure that this suggestion is going to fix your
problem,
> but I did notice that the config file you sent after your
modification says
> "ob = {" instead of "obs = {". Note the missing "s" in "obs". I
don't
> know that changing that will fix your current problem, but it should
> be changed, none-the-less.
>
> If changing that doesn't fix your problem, could you please post
your
> fcst_file, obs_file, and config_file to our anonymous ftp site
> following these directions:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> and email to me the exact command that you are running, so that I
can
> try to reproduce the problem you are having?
>
> Thanks!
>
> Julie
>
> On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Thanks for the information Julie. I added the GRIB2 fields to the
> > forecast field and also added to the grib2_vars_flat.txt as you
> suggested.
> > That got me past the fcst field errors to the obs field. The obs
> > file I am using only has field 211 which is 2m visibility. I get
> > the following error when I run now:
> >
> > DEBUG 1: Default Config File:
> > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > DEBUG 1: User Config File: data/config/PointStatConfig_dust ERROR
:
> > ERROR : PointStatConfInfo::process_config() -> The number of
> > verification tasks in "obs.field" must be non-zero and match the
> > number
> in "fcst.field".
> > ERROR :
> > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> >
> > This is my first time using point stat, hence the questions.
> >
> > Thanks
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 21, 2016 11:10 AM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> >
> > Hi Bob. John is out of the office today. I'll do what I can to
help.
> >
> > I believe that the three columns in the grib2_vars_flat.txt file
are
> > the
> > GRIB2:
> >
> > discipline
> > category
> > number
> >
> > and MET uses the tables at these locations to map the GRIB2 codes
to
> > the forecast variables specified by users in the config file.
> >
> > You should be able to modify the
> > data/table_files/grib2_vars_flat.txt
> > file and copy that file into the "share/met/table_files"
directory...
> > either manually or by running "make install".
> >
> > In your degribbed file header I saw discipline=0 and parmcat=19.
> > Looking
> > here:
> >
> > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.shtm
> > l
> >
> > I see that 211 is:
> >
> > 211 Visible, Black Sky Albedo
> > %
> > SBSALB
> > Is that what you're looking at?
> >
> > If so, I believe you would add:
> >
> > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> >
> > Please give that a try, and let us know how it works out. I hope
> > that helps.
> >
> > Julie
> >
> >
> > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > Queue: met_help
> > > Subject: Grib2 Fields
> > > Owner: Nobody
> > > Requestors: robert.craig.2 at us.af.mil
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > >
> > >
> > >
> > > John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> > > header for the file is listed below:
> > >
> > > [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307]
> > > dg2 -V
> > > GALWEM_20160307_CY00_FH24.GR2
> > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> > > center=57
> > > local_table=1 parmcat=19 parm=211:
> > > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > grid_template=0:winds(N/S):
> > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > WE:SN res
> > > 48
> > > lat -89.921875 to 89.921875 by 0.156250
> > > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> > >
> > > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > > center=57
> > > local_table=1 parmcat=13 parm=192:
> > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > grid_template=0:winds(N/S):
> > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > WE:SN res
> > > 48
> > > lat -89.921875 to 89.921875 by 0.156250
> > > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> > >
> > > My configuration file is attached. In the table_files
directory,
> > > I looked in the grib2_vars_flat.txt file. What are the three
> > > columns in
> > this file?
> > > How would I add parm 211 to it so MET will recognize it?
> > >
> > > Thanks
> > > Bob
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research Research Applications
Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Grib2 Fields
From: Julie Prestopnik
Time: Mon Mar 21 16:22:35 2016
Hi Bob. I was able to see and get your files, and I am able to
reproduce
your the problem you are experiencing, but unfortunately, I am unable
to
help you. I will talk with John about this when he is back in the
office,
and one of us will get back with you. Thank you for your patience on
this
issue.
Julie
On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Julie, I was finally able to push files to your server - no errors
this
> time.
>
> Bob
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 2:13 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Hi Bob. Unfortunately, I do not see any directory or data at
> incoming/irap/met_help/craig_data.
>
> You mentioned that changing "ob" to "obs" did fix one error. What
error
> are you currently receiving?
>
> Thanks,
> Julie
>
> On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Julie, The obs versus ob did fix one error - thanks for catching.
I
> > placed the model file, ob file, and config file in the directory,
I
> think.
> > I got a warning message on each transfer. The command line is
below.
> >
> > bin/point_stat
> >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
> > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> > data/config/PointStatConfig_dust -v 5
> >
> > If you don't see the data, I will try a different method of
transfer.
> >
> > Thanks
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 21, 2016 11:53 AM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> >
> > Hi Bob. I'm not sure that this suggestion is going to fix your
problem,
> > but I did notice that the config file you sent after your
modification
> says
> > "ob = {" instead of "obs = {". Note the missing "s" in "obs". I
don't
> > know that changing that will fix your current problem, but it
should
> > be changed, none-the-less.
> >
> > If changing that doesn't fix your problem, could you please post
your
> > fcst_file, obs_file, and config_file to our anonymous ftp site
> > following these directions:
> > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >
> > and email to me the exact command that you are running, so that I
can
> > try to reproduce the problem you are having?
> >
> > Thanks!
> >
> > Julie
> >
> > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> > >
> > > Thanks for the information Julie. I added the GRIB2 fields to
the
> > > forecast field and also added to the grib2_vars_flat.txt as you
> > suggested.
> > > That got me past the fcst field errors to the obs field. The
obs
> > > file I am using only has field 211 which is 2m visibility. I
get
> > > the following error when I run now:
> > >
> > > DEBUG 1: Default Config File:
> > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR :
> > > ERROR : PointStatConfInfo::process_config() -> The number of
> > > verification tasks in "obs.field" must be non-zero and match the
> > > number
> > in "fcst.field".
> > > ERROR :
> > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> > >
> > > This is my first time using point stat, hence the questions.
> > >
> > > Thanks
> > > Bob
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 21, 2016 11:10 AM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > >
> > > Hi Bob. John is out of the office today. I'll do what I can to
help.
> > >
> > > I believe that the three columns in the grib2_vars_flat.txt file
are
> > > the
> > > GRIB2:
> > >
> > > discipline
> > > category
> > > number
> > >
> > > and MET uses the tables at these locations to map the GRIB2
codes to
> > > the forecast variables specified by users in the config file.
> > >
> > > You should be able to modify the
> > > data/table_files/grib2_vars_flat.txt
> > > file and copy that file into the "share/met/table_files"
directory...
> > > either manually or by running "make install".
> > >
> > > In your degribbed file header I saw discipline=0 and parmcat=19.
> > > Looking
> > > here:
> > >
> > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.shtm
> > > l
> > >
> > > I see that 211 is:
> > >
> > > 211 Visible, Black Sky Albedo
> > > %
> > > SBSALB
> > > Is that what you're looking at?
> > >
> > > If so, I believe you would add:
> > >
> > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> > >
> > > Please give that a try, and let us know how it works out. I
hope
> > > that helps.
> > >
> > > Julie
> > >
> > >
> > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT
<
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > Queue: met_help
> > > > Subject: Grib2 Fields
> > > > Owner: Nobody
> > > > Requestors: robert.craig.2 at us.af.mil
> > > > Status: new
> > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > >
> > > >
> > > >
> > > > John, I am degribbing UM dust forecasts for Point Stat. The
> degribbed
> > > > header for the file is listed below:
> > > >
> > > > [1102 qcteam hpc9-lsn-01d
/home/stronghs/dust_study/GALWEM/0307]
> > > > dg2 -V
> > > > GALWEM_20160307_CY00_FH24.GR2
> > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
discipline=0
> > > > center=57
> > > > local_table=1 parmcat=19 parm=211:
> > > > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > > grid_template=0:winds(N/S):
> > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > > WE:SN res
> > > > 48
> > > > lat -89.921875 to 89.921875 by 0.156250
> > > > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> > > >
> > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > > > center=57
> > > > local_table=1 parmcat=13 parm=192:
> > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > > grid_template=0:winds(N/S):
> > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > > WE:SN res
> > > > 48
> > > > lat -89.921875 to 89.921875 by 0.156250
> > > > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> > > >
> > > > My configuration file is attached. In the table_files
directory,
> > > > I looked in the grib2_vars_flat.txt file. What are the three
> > > > columns in
> > > this file?
> > > > How would I add parm 211 to it so MET will recognize it?
> > > >
> > > > Thanks
> > > > Bob
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Grib2 Fields
From: John Halley Gotway
Time: Mon Mar 21 16:58:34 2016
Hi Bob,
When I run with the config file you sent, I'm able to replicate your
error
message.
Using wgrib2, I suspect you actually meant to use 0, 19, 211:
wgrib2 GALWEM_20160307_CY00_FH24.GR2
1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
parm=211:2 m above ground:24 hour fcst:
MET is expecting those "GRIB2_..." config file settings to be
integers. So
I modified the config file like this (i.e. no quotes):
GRIB2_disc = 0;
GRIB2_parm_cat = 19;
GRIB2_parm = 211;
The next error comes from the obs.field setting:
ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
'211' for table version 2
I assume you want to use observations with GRIB code 211. Looking in
nceptab_flat.txt, I see 211 is defined as follows:
211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
So I used name = "USWRF"; in the obs.field section.
And that gets it to run, but we get 0 matched pairs:
DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
ADPSFC,
over region FULL, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 17086
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 150
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 8
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 16928
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
Looking closely in your observations, I see the following message type
in
use: ADPSFC_MIN_030000
So I switched to that in the config file and got 16530 matched pairs.
Seems like a lot!
The updated config file is attached.
Also, Tatiana Burek is currently working on the Air Force cloud
project
with the mission of making it easier to use GALWEM and ECMWF GRIB data
in
MET. Hopefully, we can make this whole process smoother for you. I'm
guessing those abbreviations MET is writing out don't match the actual
data
types you're comparing!
Thanks,
John
On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Hi Bob. I was able to see and get your files, and I am able to
reproduce
> your the problem you are experiencing, but unfortunately, I am
unable to
> help you. I will talk with John about this when he is back in the
office,
> and one of us will get back with you. Thank you for your patience
on this
> issue.
>
> Julie
>
> On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Julie, I was finally able to push files to your server - no errors
this
> > time.
> >
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 21, 2016 2:13 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> >
> > Hi Bob. Unfortunately, I do not see any directory or data at
> > incoming/irap/met_help/craig_data.
> >
> > You mentioned that changing "ob" to "obs" did fix one error. What
error
> > are you currently receiving?
> >
> > Thanks,
> > Julie
> >
> > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> > >
> > > Julie, The obs versus ob did fix one error - thanks for
catching. I
> > > placed the model file, ob file, and config file in the
directory, I
> > think.
> > > I got a warning message on each transfer. The command line is
below.
> > >
> > > bin/point_stat
> > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
> > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> > > data/config/PointStatConfig_dust -v 5
> > >
> > > If you don't see the data, I will try a different method of
transfer.
> > >
> > > Thanks
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 21, 2016 11:53 AM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > >
> > > Hi Bob. I'm not sure that this suggestion is going to fix your
> problem,
> > > but I did notice that the config file you sent after your
modification
> > says
> > > "ob = {" instead of "obs = {". Note the missing "s" in "obs".
I
> don't
> > > know that changing that will fix your current problem, but it
should
> > > be changed, none-the-less.
> > >
> > > If changing that doesn't fix your problem, could you please post
your
> > > fcst_file, obs_file, and config_file to our anonymous ftp site
> > > following these directions:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > and email to me the exact command that you are running, so that
I can
> > > try to reproduce the problem you are having?
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > >
> > > > Thanks for the information Julie. I added the GRIB2 fields to
the
> > > > forecast field and also added to the grib2_vars_flat.txt as
you
> > > suggested.
> > > > That got me past the fcst field errors to the obs field. The
obs
> > > > file I am using only has field 211 which is 2m visibility. I
get
> > > > the following error when I run now:
> > > >
> > > > DEBUG 1: Default Config File:
> > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR :
> > > > ERROR : PointStatConfInfo::process_config() -> The number of
> > > > verification tasks in "obs.field" must be non-zero and match
the
> > > > number
> > > in "fcst.field".
> > > > ERROR :
> > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> > > >
> > > > This is my first time using point stat, hence the questions.
> > > >
> > > > Thanks
> > > > Bob
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 21, 2016 11:10 AM
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > > >
> > > > Hi Bob. John is out of the office today. I'll do what I can
to
> help.
> > > >
> > > > I believe that the three columns in the grib2_vars_flat.txt
file are
> > > > the
> > > > GRIB2:
> > > >
> > > > discipline
> > > > category
> > > > number
> > > >
> > > > and MET uses the tables at these locations to map the GRIB2
codes to
> > > > the forecast variables specified by users in the config file.
> > > >
> > > > You should be able to modify the
> > > > data/table_files/grib2_vars_flat.txt
> > > > file and copy that file into the "share/met/table_files"
directory...
> > > > either manually or by running "make install".
> > > >
> > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
> > > > Looking
> > > > here:
> > > >
> > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.shtm
> > > > l
> > > >
> > > > I see that 211 is:
> > > >
> > > > 211 Visible, Black Sky Albedo
> > > > %
> > > > SBSALB
> > > > Is that what you're looking at?
> > > >
> > > > If so, I believe you would add:
> > > >
> > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> > > >
> > > > Please give that a try, and let us know how it works out. I
hope
> > > > that helps.
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via
RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > > Queue: met_help
> > > > > Subject: Grib2 Fields
> > > > > Owner: Nobody
> > > > > Requestors: robert.craig.2 at us.af.mil
> > > > > Status: new
> > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > > >
> > > > >
> > > > >
> > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
> > degribbed
> > > > > header for the file is listed below:
> > > > >
> > > > > [1102 qcteam hpc9-lsn-01d
/home/stronghs/dust_study/GALWEM/0307]
> > > > > dg2 -V
> > > > > GALWEM_20160307_CY00_FH24.GR2
> > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
discipline=0
> > > > > center=57
> > > > > local_table=1 parmcat=19 parm=211:
> > > > >
ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > > > grid_template=0:winds(N/S):
> > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > > > WE:SN res
> > > > > 48
> > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > >
> > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
discipline=0
> > > > > center=57
> > > > > local_table=1 parmcat=13 parm=192:
> > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > > > grid_template=0:winds(N/S):
> > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
output
> > > > > WE:SN res
> > > > > 48
> > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > >
> > > > > My configuration file is attached. In the table_files
directory,
> > > > > I looked in the grib2_vars_flat.txt file. What are the
three
> > > > > columns in
> > > > this file?
> > > > > How would I add parm 211 to it so MET will recognize it?
> > > > >
> > > > > Thanks
> > > > > Bob
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
------------------------------------------------
Subject: Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Tue Mar 22 08:20:13 2016
Thanks John, the grib code 211 is visibility due to dust. The
GRIB2_param_cat should be 13 instead of 19. So the intent is to
compare to visibility in observations. I used the ascii2nc converter
to take our visibility observations due to dust and convert them to nc
format for MET. I added visibility to the grib2_vars_flat.txt, see
below:
0 13 0 "AEROT" "Aerosol Type" "-"
0 13 192 "PMTC" "Particulatematter (coarse)" "mcg/m^3"
0 13 193 "PMTF" "Particulatematter (fine)" "mcg/m^3"
0 13 194 "LPMTF" "Particulatematter (fine)" "log10 (mcg/m^3)"
0 13 195 "LIPMF" "Integratedcolumn particulate matter (fine)" "log10
(mcg/m^3)"
0 13 211 "VIS" "Dust visibility" "m"
0 14 0 "TOZNE" "Total Ozone" "DU"
This file is in the share/met/table_files directory – the manual
implied I should change the file in this location instead of
/data/table_files. I will try your changes.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 21, 2016 5:59 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Hi Bob,
When I run with the config file you sent, I'm able to replicate your
error message.
Using wgrib2, I suspect you actually meant to use 0, 19, 211:
wgrib2 GALWEM_20160307_CY00_FH24.GR2
1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
parm=211:2 m above ground:24 hour fcst:
MET is expecting those "GRIB2_..." config file settings to be
integers. So I modified the config file like this (i.e. no quotes):
GRIB2_disc = 0;
GRIB2_parm_cat = 19;
GRIB2_parm = 211;
The next error comes from the obs.field setting:
ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation '211' for table version 2
I assume you want to use observations with GRIB code 211. Looking in
nceptab_flat.txt, I see 211 is defined as follows:
211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
So I used name = "USWRF"; in the obs.field section.
And that gets it to run, but we get 0 matched pairs:
DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
ADPSFC, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 17086
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 150
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 8
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 16928
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
Looking closely in your observations, I see the following message type
in
use: ADPSFC_MIN_030000
So I switched to that in the config file and got 16530 matched pairs.
Seems like a lot!
The updated config file is attached.
Also, Tatiana Burek is currently working on the Air Force cloud
project with the mission of making it easier to use GALWEM and ECMWF
GRIB data in MET. Hopefully, we can make this whole process smoother
for you. I'm guessing those abbreviations MET is writing out don't
match the actual data types you're comparing!
Thanks,
John
On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Hi Bob. I was able to see and get your files, and I am able to
> reproduce your the problem you are experiencing, but unfortunately,
I
> am unable to help you. I will talk with John about this when he is
> back in the office, and one of us will get back with you. Thank you
> for your patience on this issue.
>
> Julie
>
> On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Julie, I was finally able to push files to your server - no errors
> > this time.
> >
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 21, 2016 2:13 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> >
> > Hi Bob. Unfortunately, I do not see any directory or data at
> > incoming/irap/met_help/craig_data.
> >
> > You mentioned that changing "ob" to "obs" did fix one error. What
> > error are you currently receiving?
> >
> > Thanks,
> > Julie
> >
> > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> > >
> > > Julie, The obs versus ob did fix one error - thanks for
catching.
> > > I placed the model file, ob file, and config file in the
> > > directory, I
> > think.
> > > I got a warning message on each transfer. The command line is
below.
> > >
> > > bin/point_stat
> > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR
> > > 2
> > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> > > data/config/PointStatConfig_dust -v 5
> > >
> > > If you don't see the data, I will try a different method of
transfer.
> > >
> > > Thanks
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 21, 2016 11:53 AM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > >
> > > Hi Bob. I'm not sure that this suggestion is going to fix your
> problem,
> > > but I did notice that the config file you sent after your
> > > modification
> > says
> > > "ob = {" instead of "obs = {". Note the missing "s" in "obs".
I
> don't
> > > know that changing that will fix your current problem, but it
> > > should be changed, none-the-less.
> > >
> > > If changing that doesn't fix your problem, could you please post
> > > your fcst_file, obs_file, and config_file to our anonymous ftp
> > > site following these directions:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > and email to me the exact command that you are running, so that
I
> > > can try to reproduce the problem you are having?
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
RT
> > > < met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > >
> > > > Thanks for the information Julie. I added the GRIB2 fields to
> > > > the forecast field and also added to the grib2_vars_flat.txt
as
> > > > you
> > > suggested.
> > > > That got me past the fcst field errors to the obs field. The
> > > > obs file I am using only has field 211 which is 2m visibility.
> > > > I get the following error when I run now:
> > > >
> > > > DEBUG 1: Default Config File:
> > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR :
> > > > ERROR : PointStatConfInfo::process_config() -> The number of
> > > > verification tasks in "obs.field" must be non-zero and match
the
> > > > number
> > > in "fcst.field".
> > > > ERROR :
> > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> > > >
> > > > This is my first time using point stat, hence the questions.
> > > >
> > > > Thanks
> > > > Bob
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 21, 2016 11:10 AM
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > > >
> > > > Hi Bob. John is out of the office today. I'll do what I can
to
> help.
> > > >
> > > > I believe that the three columns in the grib2_vars_flat.txt
file
> > > > are the
> > > > GRIB2:
> > > >
> > > > discipline
> > > > category
> > > > number
> > > >
> > > > and MET uses the tables at these locations to map the GRIB2
> > > > codes to the forecast variables specified by users in the
config file.
> > > >
> > > > You should be able to modify the
> > > > data/table_files/grib2_vars_flat.txt
> > > > file and copy that file into the "share/met/table_files"
directory...
> > > > either manually or by running "make install".
> > > >
> > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
> > > > Looking
> > > > here:
> > > >
> > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.
> > > > shtm
> > > > l
> > > >
> > > > I see that 211 is:
> > > >
> > > > 211 Visible, Black Sky Albedo
> > > > %
> > > > SBSALB
> > > > Is that what you're looking at?
> > > >
> > > > If so, I believe you would add:
> > > >
> > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> > > >
> > > > Please give that a try, and let us know how it works out. I
> > > > hope that helps.
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via
RT
> > > > < met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > > Queue: met_help
> > > > > Subject: Grib2 Fields
> > > > > Owner: Nobody
> > > > > Requestors: robert.craig.2 at us.af.mil
> > > > > Status: new
> > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > > >
> > > > >
> > > > >
> > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
> > degribbed
> > > > > header for the file is listed below:
> > > > >
> > > > > [1102 qcteam hpc9-lsn-01d
> > > > > /home/stronghs/dust_study/GALWEM/0307]
> > > > > dg2 -V
> > > > > GALWEM_20160307_CY00_FH24.GR2
> > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
> > > > > discipline=0
> > > > > center=57
> > > > > local_table=1 parmcat=19 parm=211:
> > > > >
ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > > > grid_template=0:winds(N/S):
> > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
> > > > > output WE:SN res
> > > > > 48
> > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > >
> > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
discipline=0
> > > > > center=57
> > > > > local_table=1 parmcat=13 parm=192:
> > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > > > grid_template=0:winds(N/S):
> > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
> > > > > output WE:SN res
> > > > > 48
> > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > >
> > > > > My configuration file is attached. In the table_files
> > > > > directory, I looked in the grib2_vars_flat.txt file. What
are
> > > > > the three columns in
> > > > this file?
> > > > > How would I add parm 211 to it so MET will recognize it?
> > > > >
> > > > > Thanks
> > > > > Bob
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
------------------------------------------------
Subject: Grib2 Fields
From: John Halley Gotway
Time: Tue Mar 22 11:27:38 2016
Bob,
Sounds good. Just let us know what other issues arise.
I mentioned earlier that Tatiana is reworking the logic for defining
GRIB
tables. Currently MET only has NCEP GRIB usage defined in it's
tables...
one file for GRIB1 and another for GRIB2.
Her first task is...
- Adding center and subcenter ID's to the list of numbers that define
each
field.
- Breaking the single GRIB1 and GRIB2 table files out into multiple
table
files following some naming convention in that same directory. I'm
thinking we'll have one file for each center. We'll add in ECMWF and
UKMET
Office usage, using the tables defined in the wgrib/wgrib2 source
code.
And we'll add another for Air Force using the tables you guys sent us.
- This should make adding new tables or editing existing ones a little
easier.
After she's done with that, the next task will be looking at the
config
file entries and filtering logic to see how we can make the selection
of
fields easier and more intuitive.
Is there any specific functionality you'd like us to keep in mind as
we
work on this?
Thanks,
John
On Tue, Mar 22, 2016 at 8:20 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Thanks John, the grib code 211 is visibility due to dust. The
> GRIB2_param_cat should be 13 instead of 19. So the intent is to
compare
> to visibility in observations. I used the ascii2nc converter to
take our
> visibility observations due to dust and convert them to nc format
for MET.
> I added visibility to the grib2_vars_flat.txt, see below:
>
>
>
> 0 13 0 "AEROT" "Aerosol Type" "-"
>
> 0 13 192 "PMTC" "Particulatematter (coarse)" "mcg/m^3"
>
> 0 13 193 "PMTF" "Particulatematter (fine)" "mcg/m^3"
>
> 0 13 194 "LPMTF" "Particulatematter (fine)" "log10 (mcg/m^3)"
>
> 0 13 195 "LIPMF" "Integratedcolumn particulate matter (fine)"
"log10
> (mcg/m^3)"
>
> 0 13 211 "VIS" "Dust visibility" "m"
>
> 0 14 0 "TOZNE" "Total Ozone" "DU"
>
>
>
> This file is in the share/met/table_files directory – the manual
implied I
> should change the file in this location instead of
/data/table_files. I
> will try your changes.
>
>
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 5:59 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
>
>
> Hi Bob,
>
>
>
> When I run with the config file you sent, I'm able to replicate your
error
> message.
>
>
>
> Using wgrib2, I suspect you actually meant to use 0, 19, 211:
>
>
>
> wgrib2 GALWEM_20160307_CY00_FH24.GR2
>
>
>
> 1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
>
> parm=211:2 m above ground:24 hour fcst:
>
> MET is expecting those "GRIB2_..." config file settings to be
integers.
> So I modified the config file like this (i.e. no quotes):
>
> GRIB2_disc = 0;
>
> GRIB2_parm_cat = 19;
>
> GRIB2_parm = 211;
>
>
>
> The next error comes from the obs.field setting:
>
>
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
> '211' for table version 2
>
>
>
> I assume you want to use observations with GRIB code 211. Looking
in
> nceptab_flat.txt, I see 211 is defined as follows:
>
>
>
> 211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
>
>
>
> So I used name = "USWRF"; in the obs.field section.
>
>
>
> And that gets it to run, but we get 0 matched pairs:
>
>
>
> DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
> ADPSFC, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
>
>
>
> DEBUG 3: Number of matched pairs = 0
>
>
>
> DEBUG 3: Observations processed = 17086
>
>
>
> DEBUG 3: Rejected: SID exclusion = 0
>
>
>
> DEBUG 3: Rejected: GRIB code = 0
>
>
>
> DEBUG 3: Rejected: valid time = 150
>
>
>
> DEBUG 3: Rejected: bad obs value = 0
>
>
>
> DEBUG 3: Rejected: off the grid = 8
>
>
>
> DEBUG 3: Rejected: level mismatch = 0
>
>
>
> DEBUG 3: Rejected: quality marker = 0
>
>
>
> DEBUG 3: Rejected: message type = 16928
>
>
>
> DEBUG 3: Rejected: masking region = 0
>
>
>
> DEBUG 3: Rejected: bad fcst value = 0
>
>
>
> DEBUG 3: Rejected: duplicates = 0
>
>
>
> Looking closely in your observations, I see the following message
type in
>
> use: ADPSFC_MIN_030000
>
>
>
> So I switched to that in the config file and got 16530 matched
pairs.
>
>
>
> Seems like a lot!
>
>
>
> The updated config file is attached.
>
>
>
> Also, Tatiana Burek is currently working on the Air Force cloud
project
> with the mission of making it easier to use GALWEM and ECMWF GRIB
data in
> MET. Hopefully, we can make this whole process smoother for you.
I'm
> guessing those abbreviations MET is writing out don't match the
actual data
> types you're comparing!
>
>
>
> Thanks,
>
> John
>
>
>
>
>
> On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT <
> met_help at ucar.edu>
>
> wrote:
>
>
>
> >
>
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> >
>
> > Hi Bob. I was able to see and get your files, and I am able to
>
> > reproduce your the problem you are experiencing, but
unfortunately, I
>
> > am unable to help you. I will talk with John about this when he
is
>
> > back in the office, and one of us will get back with you. Thank
you
>
> > for your patience on this issue.
>
> >
>
> > Julie
>
> >
>
> > On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
>
> > met_help at ucar.edu> wrote:
>
> >
>
> > >
>
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> > >
>
> > > Julie, I was finally able to push files to your server - no
errors
>
> > > this time.
>
> > >
>
> > > Bob
>
> > >
>
> > > -----Original Message-----
>
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > Sent: Monday, March 21, 2016 2:13 PM
>
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > >
>
> > > Hi Bob. Unfortunately, I do not see any directory or data at
>
> > > incoming/irap/met_help/craig_data.
>
> > >
>
> > > You mentioned that changing "ob" to "obs" did fix one error.
What
>
> > > error are you currently receiving?
>
> > >
>
> > > Thanks,
>
> > > Julie
>
> > >
>
> > > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via
RT <
>
> > > met_help at ucar.edu> wrote:
>
> > >
>
> > > >
>
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
>
> > > >
>
> > > > Julie, The obs versus ob did fix one error - thanks for
catching.
>
> > > > I placed the model file, ob file, and config file in the
>
> > > > directory, I
>
> > > think.
>
> > > > I got a warning message on each transfer. The command line is
below.
>
> > > >
>
> > > > bin/point_stat
>
> > > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR
>
> > > > 2
>
> > > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
>
> > > > data/config/PointStatConfig_dust -v 5
>
> > > >
>
> > > > If you don't see the data, I will try a different method of
transfer.
>
> > > >
>
> > > > Thanks
>
> > > >
>
> > > > -----Original Message-----
>
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > > Sent: Monday, March 21, 2016 11:53 AM
>
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > > >
>
> > > > Hi Bob. I'm not sure that this suggestion is going to fix
your
>
> > problem,
>
> > > > but I did notice that the config file you sent after your
>
> > > > modification
>
> > > says
>
> > > > "ob = {" instead of "obs = {". Note the missing "s" in
"obs". I
>
> > don't
>
> > > > know that changing that will fix your current problem, but it
>
> > > > should be changed, none-the-less.
>
> > > >
>
> > > > If changing that doesn't fix your problem, could you please
post
>
> > > > your fcst_file, obs_file, and config_file to our anonymous ftp
>
> > > > site following these directions:
>
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> > > >
>
> > > > and email to me the exact command that you are running, so
that I
>
> > > > can try to reproduce the problem you are having?
>
> > > >
>
> > > > Thanks!
>
> > > >
>
> > > > Julie
>
> > > >
>
> > > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
RT
>
> > > > < met_help at ucar.edu> wrote:
>
> > > >
>
> > > > >
>
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> > > > >
>
> > > > > Thanks for the information Julie. I added the GRIB2 fields
to
>
> > > > > the forecast field and also added to the grib2_vars_flat.txt
as
>
> > > > > you
>
> > > > suggested.
>
> > > > > That got me past the fcst field errors to the obs field.
The
>
> > > > > obs file I am using only has field 211 which is 2m
visibility.
>
> > > > > I get the following error when I run now:
>
> > > > >
>
> > > > > DEBUG 1: Default Config File:
>
> > > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
>
> > > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR
> :
>
> > > > > ERROR : PointStatConfInfo::process_config() -> The number
of
>
> > > > > verification tasks in "obs.field" must be non-zero and match
the
>
> > > > > number
>
> > > > in "fcst.field".
>
> > > > > ERROR :
>
> > > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
>
> > > > >
>
> > > > > This is my first time using point stat, hence the questions.
>
> > > > >
>
> > > > > Thanks
>
> > > > > Bob
>
> > > > >
>
> > > > > -----Original Message-----
>
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > > > Sent: Monday, March 21, 2016 11:10 AM
>
> > > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > > > >
>
> > > > > Hi Bob. John is out of the office today. I'll do what I
can to
>
> > help.
>
> > > > >
>
> > > > > I believe that the three columns in the grib2_vars_flat.txt
file
>
> > > > > are the
>
> > > > > GRIB2:
>
> > > > >
>
> > > > > discipline
>
> > > > > category
>
> > > > > number
>
> > > > >
>
> > > > > and MET uses the tables at these locations to map the GRIB2
>
> > > > > codes to the forecast variables specified by users in the
config
> file.
>
> > > > >
>
> > > > > You should be able to modify the
>
> > > > > data/table_files/grib2_vars_flat.txt
>
> > > > > file and copy that file into the "share/met/table_files"
> directory...
>
> > > > > either manually or by running "make install".
>
> > > > >
>
> > > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
>
> > > > > Looking
>
> > > > > here:
>
> > > > >
>
> > > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-
0-19.
>
> > > > > shtm
>
> > > > > l
>
> > > > >
>
> > > > > I see that 211 is:
>
> > > > >
>
> > > > > 211 Visible, Black Sky Albedo
>
> > > > > %
>
> > > > > SBSALB
>
> > > > > Is that what you're looking at?
>
> > > > >
>
> > > > > If so, I believe you would add:
>
> > > > >
>
> > > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
>
> > > > >
>
> > > > > Please give that a try, and let us know how it works out. I
>
> > > > > hope that helps.
>
> > > > >
>
> > > > > Julie
>
> > > > >
>
> > > > >
>
> > > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil
via RT
>
> > > > > < met_help at ucar.edu> wrote:
>
> > > > >
>
> > > > > >
>
> > > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
>
> > > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
>
> > > > > > Queue: met_help
>
> > > > > > Subject: Grib2 Fields
>
> > > > > > Owner: Nobody
>
> > > > > > Requestors: robert.craig.2 at us.af.mil
>
> > > > > > Status: new
>
> > > > > > Ticket <URL:
>
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > > > > >
>
> > > > > >
>
> > > > > >
>
> > > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
>
> > > degribbed
>
> > > > > > header for the file is listed below:
>
> > > > > >
>
> > > > > > [1102 qcteam hpc9-lsn-01d
>
> > > > > > /home/stronghs/dust_study/GALWEM/0307]
>
> > > > > > dg2 -V
>
> > > > > > GALWEM_20160307_CY00_FH24.GR2
>
> > > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
>
> > > > > > discipline=0
>
> > > > > > center=57
>
> > > > > > local_table=1 parmcat=19 parm=211:
>
> > > > > >
ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
>
> > > > > > grid_template=0:winds(N/S):
>
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
>
> > > > > > output WE:SN res
>
> > > > > > 48
>
> > > > > > lat -89.921875 to 89.921875 by 0.156250
>
> > > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
>
> > > > > >
>
> > > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
discipline=0
>
> > > > > > center=57
>
> > > > > > local_table=1 parmcat=13 parm=192:
>
> > > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
>
> > > > > > grid_template=0:winds(N/S):
>
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
>
> > > > > > output WE:SN res
>
> > > > > > 48
>
> > > > > > lat -89.921875 to 89.921875 by 0.156250
>
> > > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
>
> > > > > >
>
> > > > > > My configuration file is attached. In the table_files
>
> > > > > > directory, I looked in the grib2_vars_flat.txt file. What
are
>
> > > > > > the three columns in
>
> > > > > this file?
>
> > > > > > How would I add parm 211 to it so MET will recognize it?
>
> > > > > >
>
> > > > > > Thanks
>
> > > > > > Bob
>
> > > > > >
>
> > > > > >
>
> > > > >
>
> > > > >
>
> > > > > --
>
> > > > > Julie Prestopnik
>
> > > > > National Center for Atmospheric Research Research
Applications
>
> > > > > Laboratory
>
> > > > > Phone: 303.497.8399
>
> > > > > Email: jpresto at ucar.edu
>
> > > > >
>
> > > > >
>
> > > > >
>
> > > > >
>
> > > >
>
> > > >
>
> > > > --
>
> > > > Julie Prestopnik
>
> > > > National Center for Atmospheric Research Research Applications
>
> > > > Laboratory
>
> > > > Phone: 303.497.8399
>
> > > > Email: jpresto at ucar.edu
>
> > > >
>
> > > >
>
> > > >
>
> > > >
>
> > >
>
> > >
>
> > > --
>
> > > Julie Prestopnik
>
> > > National Center for Atmospheric Research Research Applications
>
> > > Laboratory
>
> > > Phone: 303.497.8399
>
> > > Email: jpresto at ucar.edu
>
> > >
>
> > >
>
> > >
>
> > >
>
> >
>
> >
>
> > --
>
> > Julie Prestopnik
>
> > National Center for Atmospheric Research Research Applications
>
> > Laboratory
>
> > Phone: 303.497.8399
>
> > Email: jpresto at ucar.edu
>
> >
>
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Tue Mar 22 11:43:43 2016
Hi john, I added VISD to the ncep_flat files in data/data_files and
share/met/data_files. A am still getting the following:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object
of type "FileType_Gb2".
DEBUG 4: parse_conf_sid_exc() -> Station ID exclusion list contains 0
entries.
DEBUG 5: Parsed forecast field number 1:
VarInfoGrib2::dump():
Record = -1
Discipline = 0
MTable = -9999
LTable = -9999
Tmpl = -9999
ParmCat = 13
Parm = 211
Process = -9999
EnsType = -9999
DerType = -9999
DEBUG 5: Parsed observation field number 1:
VarInfoGrib::dump():
PTV = 2
Code = 211
LvlType = -9999
PCode = -9999
DEBUG 5: Parsed threshold settings for field number 1...
DEBUG 5: Forecast categorical thresholds: <1609,<3218,<4828
DEBUG 5: Observed categorical thresholds: <1609,<3218,<4828
DEBUG 5: Forecast continuous thresholds: NA
DEBUG 5: Observed continuous thresholds: NA
DEBUG 5: Continuous threshold logic: UNION
DEBUG 5: Forecast wind speed thresholds: NA
DEBUG 5: Observed wind speed thresholds: NA
DEBUG 5: Wind speed threshold logic: UNION
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=18446744072694722902
DEBUG 1: Forecast File:
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
DEBUG 1: Observation File:
/h/data/global/WXQC/data/met/nc_obs/nc_2016030800
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for VISD/Z2.
WARNING:
WARNING: MetGrib2DataFile::data_plane_array() - No matching records
found for 'VISD/Z2'
WARNING:
WARNING:
WARNING: process_fcst_climo_files() -> no fields matching VISD/Z2
found in file:
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR2
WARNING:
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 17086 observations from 17086 messages.
DEBUG 2:
DEBUG 2:
--------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V.stat
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_fho.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_ctc.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_cts.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_cnt.txt
DEBUG 1: Output file: ./point_stat_-02-46-39L_19700101_000000V_mpr.txt
I also changed 0 13 211 to be VISD in the grib2_vars_flat.txt file but
still have a mismatch. Is 211 hardcoded in the code somewhere to a
certain value? Below is exert from grib2 file.
0 13 0 "AEROT" "Aerosol Type" "-"
0 13 192 "PMTC" "Particulatematter (coarse)" "mcg/m^3"
0 13 193 "PMTF" "Particulatematter (fine)" "mcg/m^3"
0 13 194 "LPMTF" "Particulatematter (fine)" "log10 (mcg/m^3)"
0 13 195 "LIPMF" "Integratedcolumn particulate matter (fine)" "log10
(mcg/m^3)"
0 13 211 "VISD" "Dust visibility" "m"
0 14 0 "TOZNE" "Total Ozone" "DU"
Thanks
BOb
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 22, 2016 12:28 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Bob,
Sounds good. Just let us know what other issues arise.
I mentioned earlier that Tatiana is reworking the logic for defining
GRIB tables. Currently MET only has NCEP GRIB usage defined in it's
tables...
one file for GRIB1 and another for GRIB2.
Her first task is...
- Adding center and subcenter ID's to the list of numbers that define
each field.
- Breaking the single GRIB1 and GRIB2 table files out into multiple
table files following some naming convention in that same directory.
I'm thinking we'll have one file for each center. We'll add in ECMWF
and UKMET Office usage, using the tables defined in the wgrib/wgrib2
source code.
And we'll add another for Air Force using the tables you guys sent us.
- This should make adding new tables or editing existing ones a little
easier.
After she's done with that, the next task will be looking at the
config file entries and filtering logic to see how we can make the
selection of fields easier and more intuitive.
Is there any specific functionality you'd like us to keep in mind as
we work on this?
Thanks,
John
On Tue, Mar 22, 2016 at 8:20 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Thanks John, the grib code 211 is visibility due to dust. The
> GRIB2_param_cat should be 13 instead of 19. So the intent is to
compare
> to visibility in observations. I used the ascii2nc converter to
take
> our visibility observations due to dust and convert them to nc
format for MET.
> I added visibility to the grib2_vars_flat.txt, see below:
>
>
>
> 0 13 0 "AEROT" "Aerosol Type" "-"
>
> 0 13 192 "PMTC" "Particulatematter (coarse)" "mcg/m^3"
>
> 0 13 193 "PMTF" "Particulatematter (fine)" "mcg/m^3"
>
> 0 13 194 "LPMTF" "Particulatematter (fine)" "log10 (mcg/m^3)"
>
> 0 13 195 "LIPMF" "Integratedcolumn particulate matter (fine)"
"log10
> (mcg/m^3)"
>
> 0 13 211 "VIS" "Dust visibility" "m"
>
> 0 14 0 "TOZNE" "Total Ozone" "DU"
>
>
>
> This file is in the share/met/table_files directory – the manual
implied I
> should change the file in this location instead of
/data/table_files. I
> will try your changes.
>
>
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 5:59 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
>
>
> Hi Bob,
>
>
>
> When I run with the config file you sent, I'm able to replicate your
> error message.
>
>
>
> Using wgrib2, I suspect you actually meant to use 0, 19, 211:
>
>
>
> wgrib2 GALWEM_20160307_CY00_FH24.GR2
>
>
>
> 1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
>
> parm=211:2 m above ground:24 hour fcst:
>
> MET is expecting those "GRIB2_..." config file settings to be
integers.
> So I modified the config file like this (i.e. no quotes):
>
> GRIB2_disc = 0;
>
> GRIB2_parm_cat = 19;
>
> GRIB2_parm = 211;
>
>
>
> The next error comes from the obs.field setting:
>
>
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> abbreviation '211' for table version 2
>
>
>
> I assume you want to use observations with GRIB code 211. Looking
in
> nceptab_flat.txt, I see 211 is defined as follows:
>
>
>
> 211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
>
>
>
> So I used name = "USWRF"; in the obs.field section.
>
>
>
> And that gets it to run, but we get 0 matched pairs:
>
>
>
> DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
> ADPSFC, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
>
>
>
> DEBUG 3: Number of matched pairs = 0
>
>
>
> DEBUG 3: Observations processed = 17086
>
>
>
> DEBUG 3: Rejected: SID exclusion = 0
>
>
>
> DEBUG 3: Rejected: GRIB code = 0
>
>
>
> DEBUG 3: Rejected: valid time = 150
>
>
>
> DEBUG 3: Rejected: bad obs value = 0
>
>
>
> DEBUG 3: Rejected: off the grid = 8
>
>
>
> DEBUG 3: Rejected: level mismatch = 0
>
>
>
> DEBUG 3: Rejected: quality marker = 0
>
>
>
> DEBUG 3: Rejected: message type = 16928
>
>
>
> DEBUG 3: Rejected: masking region = 0
>
>
>
> DEBUG 3: Rejected: bad fcst value = 0
>
>
>
> DEBUG 3: Rejected: duplicates = 0
>
>
>
> Looking closely in your observations, I see the following message
type
> in
>
> use: ADPSFC_MIN_030000
>
>
>
> So I switched to that in the config file and got 16530 matched
pairs.
>
>
>
> Seems like a lot!
>
>
>
> The updated config file is attached.
>
>
>
> Also, Tatiana Burek is currently working on the Air Force cloud
> project with the mission of making it easier to use GALWEM and ECMWF
> GRIB data in MET. Hopefully, we can make this whole process
smoother
> for you. I'm guessing those abbreviations MET is writing out don't
> match the actual data types you're comparing!
>
>
>
> Thanks,
>
> John
>
>
>
>
>
> On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT <
> met_help at ucar.edu>
>
> wrote:
>
>
>
> >
>
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> >
>
> > Hi Bob. I was able to see and get your files, and I am able to
>
> > reproduce your the problem you are experiencing, but
unfortunately,
> > I
>
> > am unable to help you. I will talk with John about this when he
is
>
> > back in the office, and one of us will get back with you. Thank
you
>
> > for your patience on this issue.
>
> >
>
> > Julie
>
> >
>
> > On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
>
> > met_help at ucar.edu> wrote:
>
> >
>
> > >
>
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> > >
>
> > > Julie, I was finally able to push files to your server - no
errors
>
> > > this time.
>
> > >
>
> > > Bob
>
> > >
>
> > > -----Original Message-----
>
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > Sent: Monday, March 21, 2016 2:13 PM
>
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > >
>
> > > Hi Bob. Unfortunately, I do not see any directory or data at
>
> > > incoming/irap/met_help/craig_data.
>
> > >
>
> > > You mentioned that changing "ob" to "obs" did fix one error.
What
>
> > > error are you currently receiving?
>
> > >
>
> > > Thanks,
>
> > > Julie
>
> > >
>
> > > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via
RT
> > > <
>
> > > met_help at ucar.edu> wrote:
>
> > >
>
> > > >
>
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
>
> > > >
>
> > > > Julie, The obs versus ob did fix one error - thanks for
catching.
>
> > > > I placed the model file, ob file, and config file in the
>
> > > > directory, I
>
> > > think.
>
> > > > I got a warning message on each transfer. The command line is
below.
>
> > > >
>
> > > > bin/point_stat
>
> > > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.
> > > > GR
>
> > > > 2
>
> > > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
>
> > > > data/config/PointStatConfig_dust -v 5
>
> > > >
>
> > > > If you don't see the data, I will try a different method of
transfer.
>
> > > >
>
> > > > Thanks
>
> > > >
>
> > > > -----Original Message-----
>
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > > Sent: Monday, March 21, 2016 11:53 AM
>
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > > >
>
> > > > Hi Bob. I'm not sure that this suggestion is going to fix
your
>
> > problem,
>
> > > > but I did notice that the config file you sent after your
>
> > > > modification
>
> > > says
>
> > > > "ob = {" instead of "obs = {". Note the missing "s" in
"obs". I
>
> > don't
>
> > > > know that changing that will fix your current problem, but it
>
> > > > should be changed, none-the-less.
>
> > > >
>
> > > > If changing that doesn't fix your problem, could you please
post
>
> > > > your fcst_file, obs_file, and config_file to our anonymous ftp
>
> > > > site following these directions:
>
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> > > >
>
> > > > and email to me the exact command that you are running, so
that
> > > > I
>
> > > > can try to reproduce the problem you are having?
>
> > > >
>
> > > > Thanks!
>
> > > >
>
> > > > Julie
>
> > > >
>
> > > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
> > > > RT
>
> > > > < met_help at ucar.edu> wrote:
>
> > > >
>
> > > > >
>
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > > >
>
> > > > >
>
> > > > > Thanks for the information Julie. I added the GRIB2 fields
to
>
> > > > > the forecast field and also added to the grib2_vars_flat.txt
> > > > > as
>
> > > > > you
>
> > > > suggested.
>
> > > > > That got me past the fcst field errors to the obs field.
The
>
> > > > > obs file I am using only has field 211 which is 2m
visibility.
>
> > > > > I get the following error when I run now:
>
> > > > >
>
> > > > > DEBUG 1: Default Config File:
>
> > > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
>
> > > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
> > > > > ERROR
> :
>
> > > > > ERROR : PointStatConfInfo::process_config() -> The number
of
>
> > > > > verification tasks in "obs.field" must be non-zero and match
> > > > > the
>
> > > > > number
>
> > > > in "fcst.field".
>
> > > > > ERROR :
>
> > > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
>
> > > > >
>
> > > > > This is my first time using point stat, hence the questions.
>
> > > > >
>
> > > > > Thanks
>
> > > > > Bob
>
> > > > >
>
> > > > > -----Original Message-----
>
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > > > Sent: Monday, March 21, 2016 11:10 AM
>
> > > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > > > >
>
> > > > > Hi Bob. John is out of the office today. I'll do what I
can
> > > > > to
>
> > help.
>
> > > > >
>
> > > > > I believe that the three columns in the grib2_vars_flat.txt
> > > > > file
>
> > > > > are the
>
> > > > > GRIB2:
>
> > > > >
>
> > > > > discipline
>
> > > > > category
>
> > > > > number
>
> > > > >
>
> > > > > and MET uses the tables at these locations to map the GRIB2
>
> > > > > codes to the forecast variables specified by users in the
> > > > > config
> file.
>
> > > > >
>
> > > > > You should be able to modify the
>
> > > > > data/table_files/grib2_vars_flat.txt
>
> > > > > file and copy that file into the "share/met/table_files"
> directory...
>
> > > > > either manually or by running "make install".
>
> > > > >
>
> > > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
>
> > > > > Looking
>
> > > > > here:
>
> > > > >
>
> > > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-
0-19.
>
> > > > > shtm
>
> > > > > l
>
> > > > >
>
> > > > > I see that 211 is:
>
> > > > >
>
> > > > > 211 Visible, Black Sky Albedo
>
> > > > > %
>
> > > > > SBSALB
>
> > > > > Is that what you're looking at?
>
> > > > >
>
> > > > > If so, I believe you would add:
>
> > > > >
>
> > > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
>
> > > > >
>
> > > > > Please give that a try, and let us know how it works out. I
>
> > > > > hope that helps.
>
> > > > >
>
> > > > > Julie
>
> > > > >
>
> > > > >
>
> > > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil
via
> > > > > RT
>
> > > > > < met_help at ucar.edu> wrote:
>
> > > > >
>
> > > > > >
>
> > > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
>
> > > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
>
> > > > > > Queue: met_help
>
> > > > > > Subject: Grib2 Fields
>
> > > > > > Owner: Nobody
>
> > > > > > Requestors: robert.craig.2 at us.af.mil
>
> > > > > > Status: new
>
> > > > > > Ticket <URL:
>
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > > > > >
>
> > > > > >
>
> > > > > >
>
> > > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
>
> > > degribbed
>
> > > > > > header for the file is listed below:
>
> > > > > >
>
> > > > > > [1102 qcteam hpc9-lsn-01d
>
> > > > > > /home/stronghs/dust_study/GALWEM/0307]
>
> > > > > > dg2 -V
>
> > > > > > GALWEM_20160307_CY00_FH24.GR2
>
> > > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
>
> > > > > > discipline=0
>
> > > > > > center=57
>
> > > > > > local_table=1 parmcat=19 parm=211:
>
> > > > > >
> > > > > > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
>
> > > > > > grid_template=0:winds(N/S):
>
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
>
> > > > > > output WE:SN res
>
> > > > > > 48
>
> > > > > > lat -89.921875 to 89.921875 by 0.156250
>
> > > > > > lon 0.117187 to 359.886650 by 0.234378
> > > > > > #points=1769472
>
> > > > > >
>
> > > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
> > > > > > discipline=0
>
> > > > > > center=57
>
> > > > > > local_table=1 parmcat=13 parm=192:
>
> > > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
>
> > > > > > grid_template=0:winds(N/S):
>
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
>
> > > > > > output WE:SN res
>
> > > > > > 48
>
> > > > > > lat -89.921875 to 89.921875 by 0.156250
>
> > > > > > lon 0.117187 to 359.886650 by 0.234378
> > > > > > #points=1769472
>
> > > > > >
>
> > > > > > My configuration file is attached. In the table_files
>
> > > > > > directory, I looked in the grib2_vars_flat.txt file. What
> > > > > > are
>
> > > > > > the three columns in
>
> > > > > this file?
>
> > > > > > How would I add parm 211 to it so MET will recognize it?
>
> > > > > >
>
> > > > > > Thanks
>
> > > > > > Bob
>
> > > > > >
>
> > > > > >
>
> > > > >
>
> > > > >
>
> > > > > --
>
> > > > > Julie Prestopnik
>
> > > > > National Center for Atmospheric Research Research
Applications
>
> > > > > Laboratory
>
> > > > > Phone: 303.497.8399
>
> > > > > Email: jpresto at ucar.edu
>
> > > > >
>
> > > > >
>
> > > > >
>
> > > > >
>
> > > >
>
> > > >
>
> > > > --
>
> > > > Julie Prestopnik
>
> > > > National Center for Atmospheric Research Research Applications
>
> > > > Laboratory
>
> > > > Phone: 303.497.8399
>
> > > > Email: jpresto at ucar.edu
>
> > > >
>
> > > >
>
> > > >
>
> > > >
>
> > >
>
> > >
>
> > > --
>
> > > Julie Prestopnik
>
> > > National Center for Atmospheric Research Research Applications
>
> > > Laboratory
>
> > > Phone: 303.497.8399
>
> > > Email: jpresto at ucar.edu
>
> > >
>
> > >
>
> > >
>
> > >
>
> >
>
> >
>
> > --
>
> > Julie Prestopnik
>
> > National Center for Atmospheric Research Research Applications
>
> > Laboratory
>
> > Phone: 303.497.8399
>
> > Email: jpresto at ucar.edu
>
> >
>
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Tue Mar 22 12:20:45 2016
John, I decided to try it the way you did in you last email settings.
Since we are kludging the system with wrong data types, I want to make
sure MET won't try to convert units before running since I am running
data for visibility in meters and using a field (USWRF) which has
units in W/m^2.
Bob
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 22, 2016 12:28 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Bob,
Sounds good. Just let us know what other issues arise.
I mentioned earlier that Tatiana is reworking the logic for defining
GRIB tables. Currently MET only has NCEP GRIB usage defined in it's
tables...
one file for GRIB1 and another for GRIB2.
Her first task is...
- Adding center and subcenter ID's to the list of numbers that define
each field.
- Breaking the single GRIB1 and GRIB2 table files out into multiple
table files following some naming convention in that same directory.
I'm thinking we'll have one file for each center. We'll add in ECMWF
and UKMET Office usage, using the tables defined in the wgrib/wgrib2
source code.
And we'll add another for Air Force using the tables you guys sent us.
- This should make adding new tables or editing existing ones a little
easier.
After she's done with that, the next task will be looking at the
config file entries and filtering logic to see how we can make the
selection of fields easier and more intuitive.
Is there any specific functionality you'd like us to keep in mind as
we work on this?
Thanks,
John
On Tue, Mar 22, 2016 at 8:20 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Thanks John, the grib code 211 is visibility due to dust. The
> GRIB2_param_cat should be 13 instead of 19. So the intent is to
compare
> to visibility in observations. I used the ascii2nc converter to
take
> our visibility observations due to dust and convert them to nc
format for MET.
> I added visibility to the grib2_vars_flat.txt, see below:
>
>
>
> 0 13 0 "AEROT" "Aerosol Type" "-"
>
> 0 13 192 "PMTC" "Particulatematter (coarse)" "mcg/m^3"
>
> 0 13 193 "PMTF" "Particulatematter (fine)" "mcg/m^3"
>
> 0 13 194 "LPMTF" "Particulatematter (fine)" "log10 (mcg/m^3)"
>
> 0 13 195 "LIPMF" "Integratedcolumn particulate matter (fine)"
"log10
> (mcg/m^3)"
>
> 0 13 211 "VIS" "Dust visibility" "m"
>
> 0 14 0 "TOZNE" "Total Ozone" "DU"
>
>
>
> This file is in the share/met/table_files directory – the manual
implied I
> should change the file in this location instead of
/data/table_files. I
> will try your changes.
>
>
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 5:59 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
>
>
> Hi Bob,
>
>
>
> When I run with the config file you sent, I'm able to replicate your
> error message.
>
>
>
> Using wgrib2, I suspect you actually meant to use 0, 19, 211:
>
>
>
> wgrib2 GALWEM_20160307_CY00_FH24.GR2
>
>
>
> 1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
>
> parm=211:2 m above ground:24 hour fcst:
>
> MET is expecting those "GRIB2_..." config file settings to be
integers.
> So I modified the config file like this (i.e. no quotes):
>
> GRIB2_disc = 0;
>
> GRIB2_parm_cat = 19;
>
> GRIB2_parm = 211;
>
>
>
> The next error comes from the obs.field setting:
>
>
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
> abbreviation '211' for table version 2
>
>
>
> I assume you want to use observations with GRIB code 211. Looking
in
> nceptab_flat.txt, I see 211 is defined as follows:
>
>
>
> 211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
>
>
>
> So I used name = "USWRF"; in the obs.field section.
>
>
>
> And that gets it to run, but we get 0 matched pairs:
>
>
>
> DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
> ADPSFC, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
>
>
>
> DEBUG 3: Number of matched pairs = 0
>
>
>
> DEBUG 3: Observations processed = 17086
>
>
>
> DEBUG 3: Rejected: SID exclusion = 0
>
>
>
> DEBUG 3: Rejected: GRIB code = 0
>
>
>
> DEBUG 3: Rejected: valid time = 150
>
>
>
> DEBUG 3: Rejected: bad obs value = 0
>
>
>
> DEBUG 3: Rejected: off the grid = 8
>
>
>
> DEBUG 3: Rejected: level mismatch = 0
>
>
>
> DEBUG 3: Rejected: quality marker = 0
>
>
>
> DEBUG 3: Rejected: message type = 16928
>
>
>
> DEBUG 3: Rejected: masking region = 0
>
>
>
> DEBUG 3: Rejected: bad fcst value = 0
>
>
>
> DEBUG 3: Rejected: duplicates = 0
>
>
>
> Looking closely in your observations, I see the following message
type
> in
>
> use: ADPSFC_MIN_030000
>
>
>
> So I switched to that in the config file and got 16530 matched
pairs.
>
>
>
> Seems like a lot!
>
>
>
> The updated config file is attached.
>
>
>
> Also, Tatiana Burek is currently working on the Air Force cloud
> project with the mission of making it easier to use GALWEM and ECMWF
> GRIB data in MET. Hopefully, we can make this whole process
smoother
> for you. I'm guessing those abbreviations MET is writing out don't
> match the actual data types you're comparing!
>
>
>
> Thanks,
>
> John
>
>
>
>
>
> On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT <
> met_help at ucar.edu>
>
> wrote:
>
>
>
> >
>
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> >
>
> > Hi Bob. I was able to see and get your files, and I am able to
>
> > reproduce your the problem you are experiencing, but
unfortunately,
> > I
>
> > am unable to help you. I will talk with John about this when he
is
>
> > back in the office, and one of us will get back with you. Thank
you
>
> > for your patience on this issue.
>
> >
>
> > Julie
>
> >
>
> > On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
>
> > met_help at ucar.edu> wrote:
>
> >
>
> > >
>
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> > >
>
> > > Julie, I was finally able to push files to your server - no
errors
>
> > > this time.
>
> > >
>
> > > Bob
>
> > >
>
> > > -----Original Message-----
>
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > Sent: Monday, March 21, 2016 2:13 PM
>
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > >
>
> > > Hi Bob. Unfortunately, I do not see any directory or data at
>
> > > incoming/irap/met_help/craig_data.
>
> > >
>
> > > You mentioned that changing "ob" to "obs" did fix one error.
What
>
> > > error are you currently receiving?
>
> > >
>
> > > Thanks,
>
> > > Julie
>
> > >
>
> > > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via
RT
> > > <
>
> > > met_help at ucar.edu> wrote:
>
> > >
>
> > > >
>
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
>
> > > >
>
> > > > Julie, The obs versus ob did fix one error - thanks for
catching.
>
> > > > I placed the model file, ob file, and config file in the
>
> > > > directory, I
>
> > > think.
>
> > > > I got a warning message on each transfer. The command line is
below.
>
> > > >
>
> > > > bin/point_stat
>
> > > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.
> > > > GR
>
> > > > 2
>
> > > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
>
> > > > data/config/PointStatConfig_dust -v 5
>
> > > >
>
> > > > If you don't see the data, I will try a different method of
transfer.
>
> > > >
>
> > > > Thanks
>
> > > >
>
> > > > -----Original Message-----
>
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > > Sent: Monday, March 21, 2016 11:53 AM
>
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > > >
>
> > > > Hi Bob. I'm not sure that this suggestion is going to fix
your
>
> > problem,
>
> > > > but I did notice that the config file you sent after your
>
> > > > modification
>
> > > says
>
> > > > "ob = {" instead of "obs = {". Note the missing "s" in
"obs". I
>
> > don't
>
> > > > know that changing that will fix your current problem, but it
>
> > > > should be changed, none-the-less.
>
> > > >
>
> > > > If changing that doesn't fix your problem, could you please
post
>
> > > > your fcst_file, obs_file, and config_file to our anonymous ftp
>
> > > > site following these directions:
>
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> > > >
>
> > > > and email to me the exact command that you are running, so
that
> > > > I
>
> > > > can try to reproduce the problem you are having?
>
> > > >
>
> > > > Thanks!
>
> > > >
>
> > > > Julie
>
> > > >
>
> > > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
> > > > RT
>
> > > > < met_help at ucar.edu> wrote:
>
> > > >
>
> > > > >
>
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > > >
>
> > > > >
>
> > > > > Thanks for the information Julie. I added the GRIB2 fields
to
>
> > > > > the forecast field and also added to the grib2_vars_flat.txt
> > > > > as
>
> > > > > you
>
> > > > suggested.
>
> > > > > That got me past the fcst field errors to the obs field.
The
>
> > > > > obs file I am using only has field 211 which is 2m
visibility.
>
> > > > > I get the following error when I run now:
>
> > > > >
>
> > > > > DEBUG 1: Default Config File:
>
> > > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
>
> > > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
> > > > > ERROR
> :
>
> > > > > ERROR : PointStatConfInfo::process_config() -> The number
of
>
> > > > > verification tasks in "obs.field" must be non-zero and match
> > > > > the
>
> > > > > number
>
> > > > in "fcst.field".
>
> > > > > ERROR :
>
> > > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
>
> > > > >
>
> > > > > This is my first time using point stat, hence the questions.
>
> > > > >
>
> > > > > Thanks
>
> > > > > Bob
>
> > > > >
>
> > > > > -----Original Message-----
>
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
>
> > > > > Sent: Monday, March 21, 2016 11:10 AM
>
> > > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
>
> > > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> > > > >
>
> > > > > Hi Bob. John is out of the office today. I'll do what I
can
> > > > > to
>
> > help.
>
> > > > >
>
> > > > > I believe that the three columns in the grib2_vars_flat.txt
> > > > > file
>
> > > > > are the
>
> > > > > GRIB2:
>
> > > > >
>
> > > > > discipline
>
> > > > > category
>
> > > > > number
>
> > > > >
>
> > > > > and MET uses the tables at these locations to map the GRIB2
>
> > > > > codes to the forecast variables specified by users in the
> > > > > config
> file.
>
> > > > >
>
> > > > > You should be able to modify the
>
> > > > > data/table_files/grib2_vars_flat.txt
>
> > > > > file and copy that file into the "share/met/table_files"
> directory...
>
> > > > > either manually or by running "make install".
>
> > > > >
>
> > > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
>
> > > > > Looking
>
> > > > > here:
>
> > > > >
>
> > > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-
0-19.
>
> > > > > shtm
>
> > > > > l
>
> > > > >
>
> > > > > I see that 211 is:
>
> > > > >
>
> > > > > 211 Visible, Black Sky Albedo
>
> > > > > %
>
> > > > > SBSALB
>
> > > > > Is that what you're looking at?
>
> > > > >
>
> > > > > If so, I believe you would add:
>
> > > > >
>
> > > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
>
> > > > >
>
> > > > > Please give that a try, and let us know how it works out. I
>
> > > > > hope that helps.
>
> > > > >
>
> > > > > Julie
>
> > > > >
>
> > > > >
>
> > > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil
via
> > > > > RT
>
> > > > > < met_help at ucar.edu> wrote:
>
> > > > >
>
> > > > > >
>
> > > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
>
> > > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
>
> > > > > > Queue: met_help
>
> > > > > > Subject: Grib2 Fields
>
> > > > > > Owner: Nobody
>
> > > > > > Requestors: robert.craig.2 at us.af.mil
>
> > > > > > Status: new
>
> > > > > > Ticket <URL:
>
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > > > > >
>
> > > > > >
>
> > > > > >
>
> > > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
>
> > > degribbed
>
> > > > > > header for the file is listed below:
>
> > > > > >
>
> > > > > > [1102 qcteam hpc9-lsn-01d
>
> > > > > > /home/stronghs/dust_study/GALWEM/0307]
>
> > > > > > dg2 -V
>
> > > > > > GALWEM_20160307_CY00_FH24.GR2
>
> > > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
>
> > > > > > discipline=0
>
> > > > > > center=57
>
> > > > > > local_table=1 parmcat=19 parm=211:
>
> > > > > >
> > > > > > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
>
> > > > > > grid_template=0:winds(N/S):
>
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
>
> > > > > > output WE:SN res
>
> > > > > > 48
>
> > > > > > lat -89.921875 to 89.921875 by 0.156250
>
> > > > > > lon 0.117187 to 359.886650 by 0.234378
> > > > > > #points=1769472
>
> > > > > >
>
> > > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
> > > > > > discipline=0
>
> > > > > > center=57
>
> > > > > > local_table=1 parmcat=13 parm=192:
>
> > > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
>
> > > > > > grid_template=0:winds(N/S):
>
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
>
> > > > > > output WE:SN res
>
> > > > > > 48
>
> > > > > > lat -89.921875 to 89.921875 by 0.156250
>
> > > > > > lon 0.117187 to 359.886650 by 0.234378
> > > > > > #points=1769472
>
> > > > > >
>
> > > > > > My configuration file is attached. In the table_files
>
> > > > > > directory, I looked in the grib2_vars_flat.txt file. What
> > > > > > are
>
> > > > > > the three columns in
>
> > > > > this file?
>
> > > > > > How would I add parm 211 to it so MET will recognize it?
>
> > > > > >
>
> > > > > > Thanks
>
> > > > > > Bob
>
> > > > > >
>
> > > > > >
>
> > > > >
>
> > > > >
>
> > > > > --
>
> > > > > Julie Prestopnik
>
> > > > > National Center for Atmospheric Research Research
Applications
>
> > > > > Laboratory
>
> > > > > Phone: 303.497.8399
>
> > > > > Email: jpresto at ucar.edu
>
> > > > >
>
> > > > >
>
> > > > >
>
> > > > >
>
> > > >
>
> > > >
>
> > > > --
>
> > > > Julie Prestopnik
>
> > > > National Center for Atmospheric Research Research Applications
>
> > > > Laboratory
>
> > > > Phone: 303.497.8399
>
> > > > Email: jpresto at ucar.edu
>
> > > >
>
> > > >
>
> > > >
>
> > > >
>
> > >
>
> > >
>
> > > --
>
> > > Julie Prestopnik
>
> > > National Center for Atmospheric Research Research Applications
>
> > > Laboratory
>
> > > Phone: 303.497.8399
>
> > > Email: jpresto at ucar.edu
>
> > >
>
> > >
>
> > >
>
> > >
>
> >
>
> >
>
> > --
>
> > Julie Prestopnik
>
> > National Center for Atmospheric Research Research Applications
>
> > Laboratory
>
> > Phone: 303.497.8399
>
> > Email: jpresto at ucar.edu
>
> >
>
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Tue Mar 22 13:24:19 2016
John, I updated the nceptab_flat.txt to include VISD in 211 2 line. I
also changed the same file in the share directory. I updated the
config file for obs to pull VISD. I am getting the following error:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object
of type "FileType_Gb2".
DEBUG 4: parse_conf_sid_exc() -> Station ID exclusion list contains 0
entries.
ERROR :
ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation 'VISD' for table version 2
ERROR :
Did I update the right files?
Thanks
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, March 21, 2016 5:59 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Hi Bob,
When I run with the config file you sent, I'm able to replicate your
error message.
Using wgrib2, I suspect you actually meant to use 0, 19, 211:
wgrib2 GALWEM_20160307_CY00_FH24.GR2
1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
parm=211:2 m above ground:24 hour fcst:
MET is expecting those "GRIB2_..." config file settings to be
integers. So I modified the config file like this (i.e. no quotes):
GRIB2_disc = 0;
GRIB2_parm_cat = 19;
GRIB2_parm = 211;
The next error comes from the obs.field setting:
ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation '211' for table version 2
I assume you want to use observations with GRIB code 211. Looking in
nceptab_flat.txt, I see 211 is defined as follows:
211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
So I used name = "USWRF"; in the obs.field section.
And that gets it to run, but we get 0 matched pairs:
DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
ADPSFC, over region FULL, for interpolation method NEAREST(1), using 0
pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 17086
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 150
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 8
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 16928
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
Looking closely in your observations, I see the following message type
in
use: ADPSFC_MIN_030000
So I switched to that in the config file and got 16530 matched pairs.
Seems like a lot!
The updated config file is attached.
Also, Tatiana Burek is currently working on the Air Force cloud
project with the mission of making it easier to use GALWEM and ECMWF
GRIB data in MET. Hopefully, we can make this whole process smoother
for you. I'm guessing those abbreviations MET is writing out don't
match the actual data types you're comparing!
Thanks,
John
On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> Hi Bob. I was able to see and get your files, and I am able to
> reproduce your the problem you are experiencing, but unfortunately,
I
> am unable to help you. I will talk with John about this when he is
> back in the office, and one of us will get back with you. Thank you
> for your patience on this issue.
>
> Julie
>
> On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Julie, I was finally able to push files to your server - no errors
> > this time.
> >
> > Bob
> >
> > -----Original Message-----
> > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > Sent: Monday, March 21, 2016 2:13 PM
> > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> >
> > Hi Bob. Unfortunately, I do not see any directory or data at
> > incoming/irap/met_help/craig_data.
> >
> > You mentioned that changing "ob" to "obs" did fix one error. What
> > error are you currently receiving?
> >
> > Thanks,
> > Julie
> >
> > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> > >
> > > Julie, The obs versus ob did fix one error - thanks for
catching.
> > > I placed the model file, ob file, and config file in the
> > > directory, I
> > think.
> > > I got a warning message on each transfer. The command line is
below.
> > >
> > > bin/point_stat
> > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR
> > > 2
> > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> > > data/config/PointStatConfig_dust -v 5
> > >
> > > If you don't see the data, I will try a different method of
transfer.
> > >
> > > Thanks
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 21, 2016 11:53 AM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > >
> > > Hi Bob. I'm not sure that this suggestion is going to fix your
> problem,
> > > but I did notice that the config file you sent after your
> > > modification
> > says
> > > "ob = {" instead of "obs = {". Note the missing "s" in "obs".
I
> don't
> > > know that changing that will fix your current problem, but it
> > > should be changed, none-the-less.
> > >
> > > If changing that doesn't fix your problem, could you please post
> > > your fcst_file, obs_file, and config_file to our anonymous ftp
> > > site following these directions:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > and email to me the exact command that you are running, so that
I
> > > can try to reproduce the problem you are having?
> > >
> > > Thanks!
> > >
> > > Julie
> > >
> > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
RT
> > > < met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > >
> > > > Thanks for the information Julie. I added the GRIB2 fields to
> > > > the forecast field and also added to the grib2_vars_flat.txt
as
> > > > you
> > > suggested.
> > > > That got me past the fcst field errors to the obs field. The
> > > > obs file I am using only has field 211 which is 2m visibility.
> > > > I get the following error when I run now:
> > > >
> > > > DEBUG 1: Default Config File:
> > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR :
> > > > ERROR : PointStatConfInfo::process_config() -> The number of
> > > > verification tasks in "obs.field" must be non-zero and match
the
> > > > number
> > > in "fcst.field".
> > > > ERROR :
> > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> > > >
> > > > This is my first time using point stat, hence the questions.
> > > >
> > > > Thanks
> > > > Bob
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 21, 2016 11:10 AM
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > > >
> > > > Hi Bob. John is out of the office today. I'll do what I can
to
> help.
> > > >
> > > > I believe that the three columns in the grib2_vars_flat.txt
file
> > > > are the
> > > > GRIB2:
> > > >
> > > > discipline
> > > > category
> > > > number
> > > >
> > > > and MET uses the tables at these locations to map the GRIB2
> > > > codes to the forecast variables specified by users in the
config file.
> > > >
> > > > You should be able to modify the
> > > > data/table_files/grib2_vars_flat.txt
> > > > file and copy that file into the "share/met/table_files"
directory...
> > > > either manually or by running "make install".
> > > >
> > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
> > > > Looking
> > > > here:
> > > >
> > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-0-
19.
> > > > shtm
> > > > l
> > > >
> > > > I see that 211 is:
> > > >
> > > > 211 Visible, Black Sky Albedo
> > > > %
> > > > SBSALB
> > > > Is that what you're looking at?
> > > >
> > > > If so, I believe you would add:
> > > >
> > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> > > >
> > > > Please give that a try, and let us know how it works out. I
> > > > hope that helps.
> > > >
> > > > Julie
> > > >
> > > >
> > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via
RT
> > > > < met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > > Queue: met_help
> > > > > Subject: Grib2 Fields
> > > > > Owner: Nobody
> > > > > Requestors: robert.craig.2 at us.af.mil
> > > > > Status: new
> > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > > >
> > > > >
> > > > >
> > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
> > degribbed
> > > > > header for the file is listed below:
> > > > >
> > > > > [1102 qcteam hpc9-lsn-01d
> > > > > /home/stronghs/dust_study/GALWEM/0307]
> > > > > dg2 -V
> > > > > GALWEM_20160307_CY00_FH24.GR2
> > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
> > > > > discipline=0
> > > > > center=57
> > > > > local_table=1 parmcat=19 parm=211:
> > > > >
ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > > > grid_template=0:winds(N/S):
> > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
> > > > > output WE:SN res
> > > > > 48
> > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > >
> > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
discipline=0
> > > > > center=57
> > > > > local_table=1 parmcat=13 parm=192:
> > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > > > grid_template=0:winds(N/S):
> > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
> > > > > output WE:SN res
> > > > > 48
> > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > >
> > > > > My configuration file is attached. In the table_files
> > > > > directory, I looked in the grib2_vars_flat.txt file. What
are
> > > > > the three columns in
> > > > this file?
> > > > > How would I add parm 211 to it so MET will recognize it?
> > > > >
> > > > > Thanks
> > > > > Bob
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
> >
> >
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research Research Applications
> Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>
------------------------------------------------
Subject: Grib2 Fields
From: John Halley Gotway
Time: Tue Mar 22 13:36:34 2016
Bob,
It sounds like you updated the correct table file. Not sure why it
didn't
work. Did you try USWRF as well, the original setting for "211 2"?
John
On Tue, Mar 22, 2016 at 1:24 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> John, I updated the nceptab_flat.txt to include VISD in 211 2 line.
I
> also changed the same file in the share directory. I updated the
config
> file for obs to pull VISD. I am getting the following error:
>
> DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo
object of
> type "FileType_Gb2".
> DEBUG 4: parse_conf_sid_exc() -> Station ID exclusion list contains
0
> entries.
> ERROR :
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
> 'VISD' for table version 2
> ERROR :
>
> Did I update the right files?
>
> Thanks
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, March 21, 2016 5:59 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Hi Bob,
>
> When I run with the config file you sent, I'm able to replicate your
error
> message.
>
> Using wgrib2, I suspect you actually meant to use 0, 19, 211:
>
> wgrib2 GALWEM_20160307_CY00_FH24.GR2
>
> 1:0:d=2016030700:var discipline=0 center=57 local_table=1 parmcat=19
> parm=211:2 m above ground:24 hour fcst:
> MET is expecting those "GRIB2_..." config file settings to be
integers.
> So I modified the config file like this (i.e. no quotes):
> GRIB2_disc = 0;
> GRIB2_parm_cat = 19;
> GRIB2_parm = 211;
>
> The next error comes from the obs.field setting:
>
> ERROR : VarInfoGrib::set_dict() - unrecognized GRIB1 field
abbreviation
> '211' for table version 2
>
> I assume you want to use observations with GRIB code 211. Looking
in
> nceptab_flat.txt, I see 211 is defined as follows:
>
> 211 2 "USWRF" "upward short wave rad. flux" "W/m^2"
>
> So I used name = "USWRF"; in the obs.field section.
>
> And that gets it to run, but we get 0 matched pairs:
>
> DEBUG 2: Processing SBSALB/Z2 versus USWRF/Z2, for observation type
> ADPSFC, over region FULL, for interpolation method NEAREST(1), using
0
> pairs.
>
> DEBUG 3: Number of matched pairs = 0
>
> DEBUG 3: Observations processed = 17086
>
> DEBUG 3: Rejected: SID exclusion = 0
>
> DEBUG 3: Rejected: GRIB code = 0
>
> DEBUG 3: Rejected: valid time = 150
>
> DEBUG 3: Rejected: bad obs value = 0
>
> DEBUG 3: Rejected: off the grid = 8
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type = 16928
>
> DEBUG 3: Rejected: masking region = 0
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates = 0
>
> Looking closely in your observations, I see the following message
type in
> use: ADPSFC_MIN_030000
>
> So I switched to that in the config file and got 16530 matched
pairs.
>
> Seems like a lot!
>
> The updated config file is attached.
>
> Also, Tatiana Burek is currently working on the Air Force cloud
project
> with the mission of making it easier to use GALWEM and ECMWF GRIB
data in
> MET. Hopefully, we can make this whole process smoother for you.
I'm
> guessing those abbreviations MET is writing out don't match the
actual data
> types you're comparing!
>
> Thanks,
> John
>
>
> On Mon, Mar 21, 2016 at 4:22 PM, Julie Prestopnik via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> >
> > Hi Bob. I was able to see and get your files, and I am able to
> > reproduce your the problem you are experiencing, but
unfortunately, I
> > am unable to help you. I will talk with John about this when he
is
> > back in the office, and one of us will get back with you. Thank
you
> > for your patience on this issue.
> >
> > Julie
> >
> > On Mon, Mar 21, 2016 at 2:12 PM, robert.craig.2 at us.af.mil via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> > >
> > > Julie, I was finally able to push files to your server - no
errors
> > > this time.
> > >
> > > Bob
> > >
> > > -----Original Message-----
> > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > Sent: Monday, March 21, 2016 2:13 PM
> > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > >
> > > Hi Bob. Unfortunately, I do not see any directory or data at
> > > incoming/irap/met_help/craig_data.
> > >
> > > You mentioned that changing "ob" to "obs" did fix one error.
What
> > > error are you currently receiving?
> > >
> > > Thanks,
> > > Julie
> > >
> > > On Mon, Mar 21, 2016 at 12:57 PM, robert.craig.2 at us.af.mil via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
>
> > > >
> > > > Julie, The obs versus ob did fix one error - thanks for
catching.
> > > > I placed the model file, ob file, and config file in the
> > > > directory, I
> > > think.
> > > > I got a warning message on each transfer. The command line is
below.
> > > >
> > > > bin/point_stat
> > > >
/home/stronghs/dust_study/GALWEM/0307/GALWEM_20160307_CY00_FH24.GR
> > > > 2
> > > > /h/data/global/WXQC/data/met/nc_obs/nc_2016030800
> > > > data/config/PointStatConfig_dust -v 5
> > > >
> > > > If you don't see the data, I will try a different method of
transfer.
> > > >
> > > > Thanks
> > > >
> > > > -----Original Message-----
> > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > Sent: Monday, March 21, 2016 11:53 AM
> > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > > >
> > > > Hi Bob. I'm not sure that this suggestion is going to fix
your
> > problem,
> > > > but I did notice that the config file you sent after your
> > > > modification
> > > says
> > > > "ob = {" instead of "obs = {". Note the missing "s" in
"obs". I
> > don't
> > > > know that changing that will fix your current problem, but it
> > > > should be changed, none-the-less.
> > > >
> > > > If changing that doesn't fix your problem, could you please
post
> > > > your fcst_file, obs_file, and config_file to our anonymous ftp
> > > > site following these directions:
> > > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > > >
> > > > and email to me the exact command that you are running, so
that I
> > > > can try to reproduce the problem you are having?
> > > >
> > > > Thanks!
> > > >
> > > > Julie
> > > >
> > > > On Mon, Mar 21, 2016 at 10:26 AM, robert.craig.2 at us.af.mil via
RT
> > > > < met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
> > > > >
> > > > > Thanks for the information Julie. I added the GRIB2 fields
to
> > > > > the forecast field and also added to the grib2_vars_flat.txt
as
> > > > > you
> > > > suggested.
> > > > > That got me past the fcst field errors to the obs field.
The
> > > > > obs file I am using only has field 211 which is 2m
visibility.
> > > > > I get the following error when I run now:
> > > > >
> > > > > DEBUG 1: Default Config File:
> > > > > /h/WXQC/met-5.1/share/met/config/PointStatConfig_default
> > > > > DEBUG 1: User Config File: data/config/PointStatConfig_dust
ERROR
> :
> > > > > ERROR : PointStatConfInfo::process_config() -> The number
of
> > > > > verification tasks in "obs.field" must be non-zero and match
the
> > > > > number
> > > > in "fcst.field".
> > > > > ERROR :
> > > > > [1231 qcteam hpc9-lsn-01d /h/WXQC/met-5.1]
> > > > >
> > > > > This is my first time using point stat, hence the questions.
> > > > >
> > > > > Thanks
> > > > > Bob
> > > > >
> > > > > -----Original Message-----
> > > > > From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> > > > > Sent: Monday, March 21, 2016 11:10 AM
> > > > > To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> > > > > Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
> > > > >
> > > > > Hi Bob. John is out of the office today. I'll do what I
can to
> > help.
> > > > >
> > > > > I believe that the three columns in the grib2_vars_flat.txt
file
> > > > > are the
> > > > > GRIB2:
> > > > >
> > > > > discipline
> > > > > category
> > > > > number
> > > > >
> > > > > and MET uses the tables at these locations to map the GRIB2
> > > > > codes to the forecast variables specified by users in the
config
> file.
> > > > >
> > > > > You should be able to modify the
> > > > > data/table_files/grib2_vars_flat.txt
> > > > > file and copy that file into the "share/met/table_files"
> directory...
> > > > > either manually or by running "make install".
> > > > >
> > > > > In your degribbed file header I saw discipline=0 and
parmcat=19.
> > > > > Looking
> > > > > here:
> > > > >
> > > > > http://www.nco.ncep.noaa.gov/pmb/docs/grib2/grib2_table4-2-
0-19.
> > > > > shtm
> > > > > l
> > > > >
> > > > > I see that 211 is:
> > > > >
> > > > > 211 Visible, Black Sky Albedo
> > > > > %
> > > > > SBSALB
> > > > > Is that what you're looking at?
> > > > >
> > > > > If so, I believe you would add:
> > > > >
> > > > > 0 19 211 "SBSALB" "Visible, Black Sky Albedo" "%"
> > > > >
> > > > > Please give that a try, and let us know how it works out. I
> > > > > hope that helps.
> > > > >
> > > > > Julie
> > > > >
> > > > >
> > > > > On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil
via RT
> > > > > < met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > > > > > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > > > > > Queue: met_help
> > > > > > Subject: Grib2 Fields
> > > > > > Owner: Nobody
> > > > > > Requestors: robert.craig.2 at us.af.mil
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > > > > > >
> > > > > >
> > > > > >
> > > > > > John, I am degribbing UM dust forecasts for Point Stat.
The
> > > degribbed
> > > > > > header for the file is listed below:
> > > > > >
> > > > > > [1102 qcteam hpc9-lsn-01d
> > > > > > /home/stronghs/dust_study/GALWEM/0307]
> > > > > > dg2 -V
> > > > > > GALWEM_20160307_CY00_FH24.GR2
> > > > > > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var
> > > > > > discipline=0
> > > > > > center=57
> > > > > > local_table=1 parmcat=19 parm=211:
> > > > > >
ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > > > > > grid_template=0:winds(N/S):
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
> > > > > > output WE:SN res
> > > > > > 48
> > > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > > >
> > > > > > 2:3539123:vt=2016030800:surface:24 hour fcst:var
discipline=0
> > > > > > center=57
> > > > > > local_table=1 parmcat=13 parm=192:
> > > > > > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > > > > > grid_template=0:winds(N/S):
> > > > > > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN
> > > > > > output WE:SN res
> > > > > > 48
> > > > > > lat -89.921875 to 89.921875 by 0.156250
> > > > > > lon 0.117187 to 359.886650 by 0.234378
#points=1769472
> > > > > >
> > > > > > My configuration file is attached. In the table_files
> > > > > > directory, I looked in the grib2_vars_flat.txt file. What
are
> > > > > > the three columns in
> > > > > this file?
> > > > > > How would I add parm 211 to it so MET will recognize it?
> > > > > >
> > > > > > Thanks
> > > > > > Bob
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik
> > > > > National Center for Atmospheric Research Research
Applications
> > > > > Laboratory
> > > > > Phone: 303.497.8399
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > National Center for Atmospheric Research Research Applications
> > > > Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Julie Prestopnik
> > > National Center for Atmospheric Research Research Applications
> > > Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Julie Prestopnik
> > National Center for Atmospheric Research Research Applications
> > Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> >
>
>
>
>
------------------------------------------------
Subject: Grib2 Fields
From: John Halley Gotway
Time: Thu Mar 31 11:51:48 2016
Bob,
Looks like this email never was never processed through the met-help
ticketing system. Hopefully we didn't drop the ball on this one.
I just wanted to check in with you to see if you still have issues
regarding this ticket.
Thanks,
John
On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Grib2 Fields
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
>
> John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> header for the file is listed below:
>
> [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307] dg2
-V
> GALWEM_20160307_CY00_FH24.GR2
> 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
center=57
> local_table=1 parmcat=19 parm=211:
> ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
center=57
> local_table=1 parmcat=13 parm=192:
> ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> My configuration file is attached. In the table_files directory, I
looked
> in the grib2_vars_flat.txt file. What are the three columns in this
file?
> How would I add parm 211 to it so MET will recognize it?
>
> Thanks
> Bob
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Thu Mar 31 12:25:27 2016
I do have one problem. When I take my binary grid file (float array)
and convert to NetCDF, all seems to go well but when I do an ncdump of
the NetCDF file, the file seems to be empty. The first part of the
dump is listed below:
netcdf MEPS20KM_20160301_CY00_FH12 {
dimensions:
lat = 210 ;
lon = 620 ;
variables:
double USWRF(lat, lon) ;
USWRF:name = "USWRF" ;
USWRF:long_name = "USWRF" ;
USWRF:level = "Z0" ;
USWRF:units = "m" ;
USWRF:_FillValue = -9999. ;
USWRF:init_time = "20160301_000000" ;
USWRF:init_time_ut = 1456790400 ;
USWRF:valid_time = "20160301_120000" ;
USWRF:valid_time_ut = 1456833600 ;
USWRF:accum_time = "000000" ;
USWRF:accum_time_sec = 0 ;
// global attributes:
:FileOrigins = "Model visibility" ;
:MET_version = "V5.1" ;
:MET_tool = "pcp_combine" ;
:RunCommand = "Median: 12 files" ;
:Projection = "LatLon" ;
:lat_ll = "-0.857 degrees_north" ;
:lon_ll = "-31.064 degrees_east" ;
:delta_lat = "0.17 degrees" ;
:delta_lon = "0.18 degrees" ;
:Nlat = "210 grid_points" ;
:Nlon = "620 grid_points" ;
data:
USWRF =
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
_, _,
_, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _, _,
The data array has data into it but this listing will be blank if I
continue to the EOF. I also used MET to display the file and the grid
comes up blank, no data, but it is located in the proper location.
The code that writes the NetCDF file is below:
cmdstr=['rm','-f',paths['metdata']+'nc_mdl/'+d[4:8]+'/'+filename]
print cmdstr
call(cmdstr)
nc =
nio.open_file(paths['metdata']+'nc_mdl/'+d[4:8]+'/'+filename, 'w',
format='nc')
print xgrid,ygrid
nc.create_dimension('lat', ygrid)
nc.create_dimension('lon', xgrid)
nc.FileOrigins = "Model visibility"
nc.MET_version = "V5.1"
nc.MET_tool = "pcp_combine"
nc.RunCommand = "Median: 12 files"
nc.Projection = "LatLon"
nc.lat_ll = np.str(lat1)+ " degrees_north"
nc.lon_ll = np.str(lon1)+ " degrees_east"
nc.delta_lat = np.str(lat_x)+ " degrees"
nc.delta_lon = np.str(lon_x)+ " degrees"
nc.Nlat = np.str(210) + " grid_points"
nc.Nlon = np.str(620) + " grid_points"
ncvisibility =
nc.create_variable('USWRF','d',('lat','lon'))
nc.variables['USWRF'].name = "USWRF"
nc.variables['USWRF'].long_name = "USWRF"
nc.variables['USWRF'].level = "Z0"
nc.variables['USWRF'].units = "m"
nc.variables['USWRF']._FillValue = -9999.0
nc.variables['USWRF'].init_time =
np.str(rundate.strftime('%Y%m%d_%H%M%S'))
nc.variables['USWRF'].init_time_ut = np.int(ut_init[0])
nc.variables['USWRF'].valid_time =
np.str(validdate.strftime('%Y%m%d_%H%M%S'))
nc.variables['USWRF'].valid_time_ut = np.int(ut_valid[0])
nc.variables['USWRF'].accum_time = "000000"
nc.variables['USWRF'].accum_time_sec = 0
nc.variables['USWRF'].assign_value(median_array)
nc.close()
I dump out median_array above here and it definitely has data. Now,
one is that might or might not be related. When you look at the
lon_ll in the NetCDF header, the value is -31.064 degrees east. When
I run this through MET and look at verbosity of 4, this number is
positive in MET. Should I be concerned about that.
Thanks
Bob
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 31, 2016 12:52 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Bob,
Looks like this email never was never processed through the met-help
ticketing system. Hopefully we didn't drop the ball on this one.
I just wanted to check in with you to see if you still have issues
regarding this ticket.
Thanks,
John
On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Grib2 Fields
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> >
>
>
> John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> header for the file is listed below:
>
> [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307] dg2
> -V
> GALWEM_20160307_CY00_FH24.GR2
> 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> center=57
> local_table=1 parmcat=19 parm=211:
> ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> center=57
> local_table=1 parmcat=13 parm=192:
> ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> My configuration file is attached. In the table_files directory, I
> looked in the grib2_vars_flat.txt file. What are the three columns
in this file?
> How would I add parm 211 to it so MET will recognize it?
>
> Thanks
> Bob
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Thu Mar 31 13:03:59 2016
John, you can ignore the first part of my question, I figured out why
the NETCDF file was empty (a mismatch between array dimensions). The
lon_ll I would still like to know about.
Thanks
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 31, 2016 12:52 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Bob,
Looks like this email never was never processed through the met-help
ticketing system. Hopefully we didn't drop the ball on this one.
I just wanted to check in with you to see if you still have issues
regarding this ticket.
Thanks,
John
On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Grib2 Fields
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> >
>
>
> John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> header for the file is listed below:
>
> [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307] dg2
> -V
> GALWEM_20160307_CY00_FH24.GR2
> 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> center=57
> local_table=1 parmcat=19 parm=211:
> ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> center=57
> local_table=1 parmcat=13 parm=192:
> ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> grid_template=0:winds(N/S):
> lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> WE:SN res
> 48
> lat -89.921875 to 89.921875 by 0.156250
> lon 0.117187 to 359.886650 by 0.234378 #points=1769472
>
> My configuration file is attached. In the table_files directory, I
> looked in the grib2_vars_flat.txt file. What are the three columns
in this file?
> How would I add parm 211 to it so MET will recognize it?
>
> Thanks
> Bob
>
>
------------------------------------------------
Subject: Grib2 Fields
From: John Halley Gotway
Time: Fri Apr 01 12:30:19 2016
Bob,
In regards to your question about longitudes, the answer is no, you
should
not be concerned. The MET library code which handles projection
information assumes longitudes to be degrees west (i.e. positive
longitudes
over the US). We realize that this assumption is non-standard so we
advise
that all the longitude values that MET reads and writes should be in
degrees east. Practically speaking that means we're multiplying
longitudes
values by -1 all over the place converting back/forth between degrees
east
and west... which sometimes makes me pull my hair out!
Hopefully our next round of software cleanup will include changing the
internal MET longitudes from degrees east to west and getting rid of
all
those -1's!
But that explains why you're seeing a positive longitude value when
you
expect it to be negative.
Thanks,
John
On Thu, Mar 31, 2016 at 1:03 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> John, you can ignore the first part of my question, I figured out
why the
> NETCDF file was empty (a mismatch between array dimensions). The
lon_ll I
> would still like to know about.
>
> Thanks
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 31, 2016 12:52 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Bob,
>
> Looks like this email never was never processed through the met-help
> ticketing system. Hopefully we didn't drop the ball on this one.
>
> I just wanted to check in with you to see if you still have issues
> regarding this ticket.
>
> Thanks,
> John
>
> On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Grib2 Fields
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > >
> >
> >
> > John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> > header for the file is listed below:
> >
> > [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307]
dg2
> > -V
> > GALWEM_20160307_CY00_FH24.GR2
> > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=19 parm=211:
> > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=13 parm=192:
> > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > My configuration file is attached. In the table_files directory,
I
> > looked in the grib2_vars_flat.txt file. What are the three
columns in
> this file?
> > How would I add parm 211 to it so MET will recognize it?
> >
> > Thanks
> > Bob
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #75594] Grib2 Fields
From: robert.craig.2 at us.af.mil
Time: Fri Apr 01 12:57:37 2016
Thanks John, you can close the ticket. Have a good weekend.
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Friday, April 01, 2016 1:30 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
Bob,
In regards to your question about longitudes, the answer is no, you
should not be concerned. The MET library code which handles
projection information assumes longitudes to be degrees west (i.e.
positive longitudes over the US). We realize that this assumption is
non-standard so we advise that all the longitude values that MET reads
and writes should be in degrees east. Practically speaking that means
we're multiplying longitudes values by -1 all over the place
converting back/forth between degrees east and west... which sometimes
makes me pull my hair out!
Hopefully our next round of software cleanup will include changing the
internal MET longitudes from degrees east to west and getting rid of
all those -1's!
But that explains why you're seeing a positive longitude value when
you expect it to be negative.
Thanks,
John
On Thu, Mar 31, 2016 at 1:03 PM, robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594 >
>
> John, you can ignore the first part of my question, I figured out
why
> the NETCDF file was empty (a mismatch between array dimensions).
The
> lon_ll I would still like to know about.
>
> Thanks
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 31, 2016 12:52 PM
> To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #75594] Grib2 Fields
>
> Bob,
>
> Looks like this email never was never processed through the met-help
> ticketing system. Hopefully we didn't drop the ball on this one.
>
> I just wanted to check in with you to see if you still have issues
> regarding this ticket.
>
> Thanks,
> John
>
> On Mon, Mar 21, 2016 at 9:40 AM, robert.craig.2 at us.af.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Mar 21 09:40:30 2016: Request 75594 was acted upon.
> > Transaction: Ticket created by robert.craig.2 at us.af.mil
> > Queue: met_help
> > Subject: Grib2 Fields
> > Owner: Nobody
> > Requestors: robert.craig.2 at us.af.mil
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=75594
> > >
> >
> >
> > John, I am degribbing UM dust forecasts for Point Stat. The
degribbed
> > header for the file is listed below:
> >
> > [1102 qcteam hpc9-lsn-01d /home/stronghs/dust_study/GALWEM/0307]
dg2
> > -V
> > GALWEM_20160307_CY00_FH24.GR2
> > 1:0:vt=2016030800:2 m above ground:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=19 parm=211:
> > ndata=1769472:undef=0:mean=86660.9:min=2366.86:max=100001
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > 2:3539123:vt=2016030800:surface:24 hour fcst:var discipline=0
> > center=57
> > local_table=1 parmcat=13 parm=192:
> > ndata=1769472:undef=0:mean=520.351:min=0:max=44701
> > grid_template=0:winds(N/S):
> > lat-lon grid:(1536 x 1152) units 1e-06 input WE:SN output
> > WE:SN res
> > 48
> > lat -89.921875 to 89.921875 by 0.156250
> > lon 0.117187 to 359.886650 by 0.234378 #points=1769472
> >
> > My configuration file is attached. In the table_files directory,
I
> > looked in the grib2_vars_flat.txt file. What are the three
columns
> > in
> this file?
> > How would I add parm 211 to it so MET will recognize it?
> >
> > Thanks
> > Bob
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list