[Met_help] [rt.rap.ucar.edu #84299] History for running MET with netcdf data
John Halley Gotway via RT
met_help at ucar.edu
Tue Mar 6 11:13:33 MST 2018
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good Morning,
I am having trouble running MET on NETCDF data. I have down loaded my
files to your ftp server.
They are on /incoming/irap/met_help/sfredrick.
The command that I use is
grid_stat PGB.F000.nc erai_20020112.grib grid_stat_config
The error that I get is :
DEBUG 1: Default Config File:
/scratch4/BMC/dtc/MET/met-6.0/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: grid_stat_config
ERROR :
ERROR : Trouble reading forecast file "PGB.F000.nc"
ERROR :
I have not tried using MET to run with NETCDF data before. My forecast
file is netcdf and my era-interim observation
data is grib.
Any help you can provide would be much appreciated.
Thanks,
Sherrie
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: running MET with netcdf data
From: John Halley Gotway
Time: Mon Mar 05 14:17:00 2018
Hi Sherrie,
Sorry for the delay in responding. I saw your ticket from last
Thursday
but we've been scrambling to finish up work on the met-7.0 release.
I see that you're having trouble reading a NetCDF file in MET. Thanks
for
sending a sample data file. I took a look and see that it doesn't
*exactly* follow any of the flavors of NetCDF supported by MET.
However,
since it's just on a regular lat/lon grid and is close enough the CF
convention, that'll do the trick.
The following a global attribute tells MET to interpret the data file
as
being CF-complaint:
:conventions = "CF..."; (where ... is some version number)
Since your file lacks that conventions global attribute, we need to
explicitly tell MET how to handle it by setting the "file_type" config
option. Here's a plot_data_plane command for plotting 2-m temperature
from
this file:
met-6.1/bin/plot_data_plane PGB.F000.nc tmp2m.ps 'name="tmp2m";
level="(*,*)"; file_type=NETCDF_NCCF;'
Note the "file_type" setting that I used. And I've attached a PNG of
the
resulting image.
I also used ncview to look at the other fields of data and found that
the
following variables all seem to be "empty": slp, pmaskv2, pwat,
pressfc,
prate_ave
Just wanted to alert you in case you weren't aware.
But ultimately, you want to run grid_stat to compare your PGB forecast
to
ERAI analysis. I modified the Grid-Stat config file you sent me and
attached an updated version named "grid_stat_config_JHG". You'll
notice
some differences:
(1) In "fcst", I added "file_type = NETCDF_NCCF;" to tell MET how to
read
that file.
(2) The way you specify levels for NetCDF is a bit cumbersome. You
list
(0-based) indexes into the dimensions to define the slice of data you
want
to use.
(3) Rather then relisting "level" for each entry in the field array, I
just
set it once at a higher level of context.
(4) In climo_mean, just copy over the obs settings with "climo_mean =
obs;". That way we don't have to relist the "field" array.
(5) In "mask", I got rid of the polyline masks since I don't have
those.
(6) In output flag, I requested only output for sl1l2, sal1l2, and
cnt.
You haven't defined any categorical thresholds (cat_thresh) for an
event-based contingency table evaluation.
(7) I switched the version from "V6.0" to "V6.1" since that's what I
used
for testing (and I added output_flag entries for eclv and grad that
were
added in met-6.1).
Here's the command line I ran:
/usr/local/met-6.1/bin/grid_stat PGB.F000.nc erai_20020112.grib
grid_stat_config_JHG -outdir out -log run_gs.log
And I attached the log file that was created.
Thanks,
John
On Mon, Mar 5, 2018 at 9:22 AM, Sherrie Fredrick - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> Mon Mar 05 09:22:50 2018: Request 84299 was acted upon.
> Transaction: Ticket created by sherrie.fredrick at noaa.gov
> Queue: met_help
> Subject: running MET with netcdf data
> Owner: Nobody
> Requestors: sherrie.fredrick at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
>
>
> Good Morning,
>
> I am having trouble running MET on NETCDF data. I have down
loaded my
> files to your ftp server.
> They are on /incoming/irap/met_help/sfredrick.
>
> The command that I use is
> grid_stat PGB.F000.nc erai_20020112.grib grid_stat_config
>
> The error that I get is :
> DEBUG 1: Default Config File:
> /scratch4/BMC/dtc/MET/met-
6.0/share/met/config/GridStatConfig_default
> DEBUG 1: User Config File: grid_stat_config
> ERROR :
> ERROR : Trouble reading forecast file "PGB.F000.nc"
> ERROR :
>
>
> I have not tried using MET to run with NETCDF data before. My
forecast
> file is netcdf and my era-interim observation
> data is grib.
>
> Any help you can provide would be much appreciated.
> Thanks,
> Sherrie
>
>
------------------------------------------------
Subject: running MET with netcdf data
From: Sherrie Fredrick - NOAA Affiliate
Time: Tue Mar 06 08:39:34 2018
Good Morning John,
Thank you very much for your help. I am able to get MET output
now.
I have a couple of questions, at your convenience.
1. I am not getting any anomaly correlations out. The errors are
DEBUG 2: Processing h_plev(9,*,*) versus Z/P500, for interpolation
method
NEAREST(1), over region FULL, using 65160 pairs.
DEBUG 2: Computing Continuous Statistics.
DEBUG 2: Computing Scalar Partial Sums.
DEBUG 3: Reading forecast data for h_plev(6,*,*).
DEBUG 3: Reading observation data for Z/P250.
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found exact match for
VarInfo "Z/P250" in GRIB record 21 of GRIB file "erai_20020112.grib".
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB records
matching VarInfo "Z/P250" in GRIB file "erai_20020112.grib".
DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 0 GRIB records
matching VarInfo "Z/P250" in GRIB file
"/lustre/f1/unswept/Sherrie.Fredrick/climate/cmean_1d.19590112".
DEBUG 3: Found 0 climatology fields.
DEBUG 3: Found 0 climatology mean and 0 climatology standard deviation
field(s) for forecast h_plev(6,*,*).
These messages come out for all fields not just the height(Z)
2. I also need to output stats for the surface fields. Their names
are
urgd10m,vgrd10m and tmp2m. Do I use
name = "ugrd10m";
level = ["Z10"]
Again many thanks for helping.
Sherrie
On Mon, Mar 5, 2018 at 2:17 PM, John Halley Gotway via RT
<met_help at ucar.edu
> wrote:
> Hi Sherrie,
>
> Sorry for the delay in responding. I saw your ticket from last
Thursday
> but we've been scrambling to finish up work on the met-7.0 release.
>
> I see that you're having trouble reading a NetCDF file in MET.
Thanks for
> sending a sample data file. I took a look and see that it doesn't
> *exactly* follow any of the flavors of NetCDF supported by MET.
However,
> since it's just on a regular lat/lon grid and is close enough the CF
> convention, that'll do the trick.
>
> The following a global attribute tells MET to interpret the data
file as
> being CF-complaint:
> :conventions = "CF..."; (where ... is some version number)
>
> Since your file lacks that conventions global attribute, we need to
> explicitly tell MET how to handle it by setting the "file_type"
config
> option. Here's a plot_data_plane command for plotting 2-m
temperature from
> this file:
>
> met-6.1/bin/plot_data_plane PGB.F000.nc tmp2m.ps 'name="tmp2m";
> level="(*,*)"; file_type=NETCDF_NCCF;'
>
> Note the "file_type" setting that I used. And I've attached a PNG
of the
> resulting image.
>
> I also used ncview to look at the other fields of data and found
that the
> following variables all seem to be "empty": slp, pmaskv2, pwat,
pressfc,
> prate_ave
> Just wanted to alert you in case you weren't aware.
>
> But ultimately, you want to run grid_stat to compare your PGB
forecast to
> ERAI analysis. I modified the Grid-Stat config file you sent me and
> attached an updated version named "grid_stat_config_JHG". You'll
notice
> some differences:
>
> (1) In "fcst", I added "file_type = NETCDF_NCCF;" to tell MET how to
read
> that file.
> (2) The way you specify levels for NetCDF is a bit cumbersome. You
list
> (0-based) indexes into the dimensions to define the slice of data
you want
> to use.
> (3) Rather then relisting "level" for each entry in the field array,
I just
> set it once at a higher level of context.
> (4) In climo_mean, just copy over the obs settings with "climo_mean
=
> obs;". That way we don't have to relist the "field" array.
> (5) In "mask", I got rid of the polyline masks since I don't have
those.
> (6) In output flag, I requested only output for sl1l2, sal1l2, and
cnt.
> You haven't defined any categorical thresholds (cat_thresh) for an
> event-based contingency table evaluation.
> (7) I switched the version from "V6.0" to "V6.1" since that's what I
used
> for testing (and I added output_flag entries for eclv and grad that
were
> added in met-6.1).
>
> Here's the command line I ran:
> /usr/local/met-6.1/bin/grid_stat PGB.F000.nc erai_20020112.grib
> grid_stat_config_JHG -outdir out -log run_gs.log
>
> And I attached the log file that was created.
>
> Thanks,
> John
>
>
> On Mon, Mar 5, 2018 at 9:22 AM, Sherrie Fredrick - NOAA Affiliate
via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Mar 05 09:22:50 2018: Request 84299 was acted upon.
> > Transaction: Ticket created by sherrie.fredrick at noaa.gov
> > Queue: met_help
> > Subject: running MET with netcdf data
> > Owner: Nobody
> > Requestors: sherrie.fredrick at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
> >
> >
> > Good Morning,
> >
> > I am having trouble running MET on NETCDF data. I have down
loaded
> my
> > files to your ftp server.
> > They are on /incoming/irap/met_help/sfredrick.
> >
> > The command that I use is
> > grid_stat PGB.F000.nc erai_20020112.grib grid_stat_config
> >
> > The error that I get is :
> > DEBUG 1: Default Config File:
> > /scratch4/BMC/dtc/MET/met-
6.0/share/met/config/GridStatConfig_default
> > DEBUG 1: User Config File: grid_stat_config
> > ERROR :
> > ERROR : Trouble reading forecast file "PGB.F000.nc"
> > ERROR :
> >
> >
> > I have not tried using MET to run with NETCDF data before. My
forecast
> > file is netcdf and my era-interim observation
> > data is grib.
> >
> > Any help you can provide would be much appreciated.
> > Thanks,
> > Sherrie
> >
> >
>
>
------------------------------------------------
Subject: running MET with netcdf data
From: John Halley Gotway
Time: Tue Mar 06 09:16:17 2018
Sherrie,
Sorry, I should have looked closer at the output generated by Grid-
Stat.
Setting "climo_mean = obs;" does not work well because these GRIB
records
are encoded using different tables... the erai data uses U, V, T, and
Z
while the climo data uses UGRD, VGRD, TMP, and HGT.
In summary, your data is...
NetCDF Forecast: u_plev, v_plev, t_plev, h_plev
GRIB Observation: U, V, T, Z
GRIB Climo: UGRD, VGRD, TMP, HGT
When I reran, I found that for U, V, and T, you have climo data for
850,
500, and 250. And for Z, you have climo data for 1000, 500, and 250.
For
the 28 fields (variable/level combos) you're verifying, you'll get
anomaly
correlation for 12 of them.
Just edit your Grid-Stat config file by removing "climo_mean = obs"
and
adding the following to the climo_mean dictionary:
level = [ "P1000", "P850", "P500", "P250",
"P100", "P50", "P10"];
field = [
{ name = "UGRD"; },
{ name = "VGRD"; },
{ name = "TMP"; },
{ name = "HGT"; }
];
Hope that helps.
Thanks,
John
On Tue, Mar 6, 2018 at 8:39 AM, Sherrie Fredrick - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
>
> Good Morning John,
>
> Thank you very much for your help. I am able to get MET output
now.
> I have a couple of questions, at your convenience.
>
> 1. I am not getting any anomaly correlations out. The errors are
> DEBUG 2: Processing h_plev(9,*,*) versus Z/P500, for interpolation
method
> NEAREST(1), over region FULL, using 65160 pairs.
> DEBUG 2: Computing Continuous Statistics.
> DEBUG 2: Computing Scalar Partial Sums.
> DEBUG 3: Reading forecast data for h_plev(6,*,*).
> DEBUG 3: Reading observation data for Z/P250.
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found exact match
for
> VarInfo "Z/P250" in GRIB record 21 of GRIB file
"erai_20020112.grib".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> matching VarInfo "Z/P250" in GRIB file "erai_20020112.grib".
> DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 0 GRIB
records
> matching VarInfo "Z/P250" in GRIB file
> "/lustre/f1/unswept/Sherrie.Fredrick/climate/cmean_1d.19590112".
> DEBUG 3: Found 0 climatology fields.
> DEBUG 3: Found 0 climatology mean and 0 climatology standard
deviation
> field(s) for forecast h_plev(6,*,*).
>
> These messages come out for all fields not just the height(Z)
>
> 2. I also need to output stats for the surface fields. Their names
are
> urgd10m,vgrd10m and tmp2m. Do I use
> name = "ugrd10m";
> level = ["Z10"]
>
> Again many thanks for helping.
> Sherrie
>
> On Mon, Mar 5, 2018 at 2:17 PM, John Halley Gotway via RT <
> met_help at ucar.edu
> > wrote:
>
> > Hi Sherrie,
> >
> > Sorry for the delay in responding. I saw your ticket from last
Thursday
> > but we've been scrambling to finish up work on the met-7.0
release.
> >
> > I see that you're having trouble reading a NetCDF file in MET.
Thanks
> for
> > sending a sample data file. I took a look and see that it doesn't
> > *exactly* follow any of the flavors of NetCDF supported by MET.
However,
> > since it's just on a regular lat/lon grid and is close enough the
CF
> > convention, that'll do the trick.
> >
> > The following a global attribute tells MET to interpret the data
file as
> > being CF-complaint:
> > :conventions = "CF..."; (where ... is some version number)
> >
> > Since your file lacks that conventions global attribute, we need
to
> > explicitly tell MET how to handle it by setting the "file_type"
config
> > option. Here's a plot_data_plane command for plotting 2-m
temperature
> from
> > this file:
> >
> > met-6.1/bin/plot_data_plane PGB.F000.nc tmp2m.ps 'name="tmp2m";
> > level="(*,*)"; file_type=NETCDF_NCCF;'
> >
> > Note the "file_type" setting that I used. And I've attached a PNG
of the
> > resulting image.
> >
> > I also used ncview to look at the other fields of data and found
that the
> > following variables all seem to be "empty": slp, pmaskv2, pwat,
pressfc,
> > prate_ave
> > Just wanted to alert you in case you weren't aware.
> >
> > But ultimately, you want to run grid_stat to compare your PGB
forecast to
> > ERAI analysis. I modified the Grid-Stat config file you sent me
and
> > attached an updated version named "grid_stat_config_JHG". You'll
notice
> > some differences:
> >
> > (1) In "fcst", I added "file_type = NETCDF_NCCF;" to tell MET how
to read
> > that file.
> > (2) The way you specify levels for NetCDF is a bit cumbersome.
You list
> > (0-based) indexes into the dimensions to define the slice of data
you
> want
> > to use.
> > (3) Rather then relisting "level" for each entry in the field
array, I
> just
> > set it once at a higher level of context.
> > (4) In climo_mean, just copy over the obs settings with
"climo_mean =
> > obs;". That way we don't have to relist the "field" array.
> > (5) In "mask", I got rid of the polyline masks since I don't have
those.
> > (6) In output flag, I requested only output for sl1l2, sal1l2, and
cnt.
> > You haven't defined any categorical thresholds (cat_thresh) for an
> > event-based contingency table evaluation.
> > (7) I switched the version from "V6.0" to "V6.1" since that's what
I used
> > for testing (and I added output_flag entries for eclv and grad
that were
> > added in met-6.1).
> >
> > Here's the command line I ran:
> > /usr/local/met-6.1/bin/grid_stat PGB.F000.nc erai_20020112.grib
> > grid_stat_config_JHG -outdir out -log run_gs.log
> >
> > And I attached the log file that was created.
> >
> > Thanks,
> > John
> >
> >
> > On Mon, Mar 5, 2018 at 9:22 AM, Sherrie Fredrick - NOAA Affiliate
via RT
> <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Mar 05 09:22:50 2018: Request 84299 was acted upon.
> > > Transaction: Ticket created by sherrie.fredrick at noaa.gov
> > > Queue: met_help
> > > Subject: running MET with netcdf data
> > > Owner: Nobody
> > > Requestors: sherrie.fredrick at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299
> >
> > >
> > >
> > > Good Morning,
> > >
> > > I am having trouble running MET on NETCDF data. I have
down
> loaded
> > my
> > > files to your ftp server.
> > > They are on /incoming/irap/met_help/sfredrick.
> > >
> > > The command that I use is
> > > grid_stat PGB.F000.nc erai_20020112.grib grid_stat_config
> > >
> > > The error that I get is :
> > > DEBUG 1: Default Config File:
> > > /scratch4/BMC/dtc/MET/met-
6.0/share/met/config/GridStatConfig_default
> > > DEBUG 1: User Config File: grid_stat_config
> > > ERROR :
> > > ERROR : Trouble reading forecast file "PGB.F000.nc"
> > > ERROR :
> > >
> > >
> > > I have not tried using MET to run with NETCDF data before. My
> forecast
> > > file is netcdf and my era-interim observation
> > > data is grib.
> > >
> > > Any help you can provide would be much appreciated.
> > > Thanks,
> > > Sherrie
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: running MET with netcdf data
From: Sherrie Fredrick - NOAA Affiliate
Time: Tue Mar 06 10:26:12 2018
Hi John,
Thanks I now have anomaly correlations for my pressure fields.
One last thing. I need to add the surface fields. In the netcdf file
the names are ugrd10m,vgrd10 and tmp2m.
I am not sure of how to change the new grid_stat file to also
calculate the surface field stats.
Thanks,
Sherrie
In the old grid_stat file I had the following:
// Forecast and observation fields to be verified
//
fcst = {
field = [
{
name = "UGRD";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "VGRD";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "TMP";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "HGT";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "UGRD";
level = ["Z10"];
},
{
name = "VGRD";
level = ["Z10"];
},
{
name = "TMP";
level = ["Z2"];
}
];
}
///////////////////////////////////////////////////////////////
obs = {
field = [
{
name = "U";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "V";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "T";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "Z";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "10U";
level = ["R79"];
},
{
name = "10V";
level = ["R80"];
},
{
name = "2T";
level = ["R81"];
}
];
}
////////////////////////////////////////////////////////////////////////////////
//
// Climatology mean data
//
climo_mean = {
file_name =
["/scratch4/BMC/refcst2/Sherrie.Fredrick/gfs/run/wcoss/era_interum/1999/_SDATE_"];
field = [
{
name = "UGRD";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "VGRD";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "TMP";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "HGT";
level =
["P1000","P850","P500","P250","P100","P50","P10"];
},
{
name = "UGRD";
level = ["Z10"];
},
{
name = "VGRD";
level = ["Z10"];
},
{
name = "TMP";
level = ["Z2"];
}
On Tue, Mar 6, 2018 at 9:16 AM, John Halley Gotway via RT
<met_help at ucar.edu
> wrote:
> Sherrie,
>
> Sorry, I should have looked closer at the output generated by Grid-
Stat.
> Setting "climo_mean = obs;" does not work well because these GRIB
records
> are encoded using different tables... the erai data uses U, V, T,
and Z
> while the climo data uses UGRD, VGRD, TMP, and HGT.
>
> In summary, your data is...
> NetCDF Forecast: u_plev, v_plev, t_plev, h_plev
> GRIB Observation: U, V, T, Z
> GRIB Climo: UGRD, VGRD, TMP, HGT
>
> When I reran, I found that for U, V, and T, you have climo data for
850,
> 500, and 250. And for Z, you have climo data for 1000, 500, and
250. For
> the 28 fields (variable/level combos) you're verifying, you'll get
anomaly
> correlation for 12 of them.
>
> Just edit your Grid-Stat config file by removing "climo_mean = obs"
and
> adding the following to the climo_mean dictionary:
>
> level = [ "P1000", "P850", "P500", "P250",
> "P100", "P50", "P10"];
>
> field = [
> { name = "UGRD"; },
> { name = "VGRD"; },
> { name = "TMP"; },
> { name = "HGT"; }
> ];
>
>
> Hope that helps.
>
> Thanks,
> John
>
> On Tue, Mar 6, 2018 at 8:39 AM, Sherrie Fredrick - NOAA Affiliate
via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
> >
> > Good Morning John,
> >
> > Thank you very much for your help. I am able to get MET
output now.
> > I have a couple of questions, at your convenience.
> >
> > 1. I am not getting any anomaly correlations out. The errors are
> > DEBUG 2: Processing h_plev(9,*,*) versus Z/P500, for interpolation
method
> > NEAREST(1), over region FULL, using 65160 pairs.
> > DEBUG 2: Computing Continuous Statistics.
> > DEBUG 2: Computing Scalar Partial Sums.
> > DEBUG 3: Reading forecast data for h_plev(6,*,*).
> > DEBUG 3: Reading observation data for Z/P250.
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found exact match
for
> > VarInfo "Z/P250" in GRIB record 21 of GRIB file
"erai_20020112.grib".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > matching VarInfo "Z/P250" in GRIB file "erai_20020112.grib".
> > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 0 GRIB
records
> > matching VarInfo "Z/P250" in GRIB file
> > "/lustre/f1/unswept/Sherrie.Fredrick/climate/cmean_1d.19590112".
> > DEBUG 3: Found 0 climatology fields.
> > DEBUG 3: Found 0 climatology mean and 0 climatology standard
deviation
> > field(s) for forecast h_plev(6,*,*).
> >
> > These messages come out for all fields not just the height(Z)
> >
> > 2. I also need to output stats for the surface fields. Their
names are
> > urgd10m,vgrd10m and tmp2m. Do I use
> > name = "ugrd10m";
> > level = ["Z10"]
> >
> > Again many thanks for helping.
> > Sherrie
> >
> > On Mon, Mar 5, 2018 at 2:17 PM, John Halley Gotway via RT <
> > met_help at ucar.edu
> > > wrote:
> >
> > > Hi Sherrie,
> > >
> > > Sorry for the delay in responding. I saw your ticket from last
> Thursday
> > > but we've been scrambling to finish up work on the met-7.0
release.
> > >
> > > I see that you're having trouble reading a NetCDF file in MET.
Thanks
> > for
> > > sending a sample data file. I took a look and see that it
doesn't
> > > *exactly* follow any of the flavors of NetCDF supported by MET.
> However,
> > > since it's just on a regular lat/lon grid and is close enough
the CF
> > > convention, that'll do the trick.
> > >
> > > The following a global attribute tells MET to interpret the data
file
> as
> > > being CF-complaint:
> > > :conventions = "CF..."; (where ... is some version number)
> > >
> > > Since your file lacks that conventions global attribute, we need
to
> > > explicitly tell MET how to handle it by setting the "file_type"
config
> > > option. Here's a plot_data_plane command for plotting 2-m
temperature
> > from
> > > this file:
> > >
> > > met-6.1/bin/plot_data_plane PGB.F000.nc tmp2m.ps
'name="tmp2m";
> > > level="(*,*)"; file_type=NETCDF_NCCF;'
> > >
> > > Note the "file_type" setting that I used. And I've attached a
PNG of
> the
> > > resulting image.
> > >
> > > I also used ncview to look at the other fields of data and found
that
> the
> > > following variables all seem to be "empty": slp, pmaskv2, pwat,
> pressfc,
> > > prate_ave
> > > Just wanted to alert you in case you weren't aware.
> > >
> > > But ultimately, you want to run grid_stat to compare your PGB
forecast
> to
> > > ERAI analysis. I modified the Grid-Stat config file you sent me
and
> > > attached an updated version named "grid_stat_config_JHG".
You'll
> notice
> > > some differences:
> > >
> > > (1) In "fcst", I added "file_type = NETCDF_NCCF;" to tell MET
how to
> read
> > > that file.
> > > (2) The way you specify levels for NetCDF is a bit cumbersome.
You
> list
> > > (0-based) indexes into the dimensions to define the slice of
data you
> > want
> > > to use.
> > > (3) Rather then relisting "level" for each entry in the field
array, I
> > just
> > > set it once at a higher level of context.
> > > (4) In climo_mean, just copy over the obs settings with
"climo_mean =
> > > obs;". That way we don't have to relist the "field" array.
> > > (5) In "mask", I got rid of the polyline masks since I don't
have
> those.
> > > (6) In output flag, I requested only output for sl1l2, sal1l2,
and cnt.
> > > You haven't defined any categorical thresholds (cat_thresh) for
an
> > > event-based contingency table evaluation.
> > > (7) I switched the version from "V6.0" to "V6.1" since that's
what I
> used
> > > for testing (and I added output_flag entries for eclv and grad
that
> were
> > > added in met-6.1).
> > >
> > > Here's the command line I ran:
> > > /usr/local/met-6.1/bin/grid_stat PGB.F000.nc
erai_20020112.grib
> > > grid_stat_config_JHG -outdir out -log run_gs.log
> > >
> > > And I attached the log file that was created.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Mon, Mar 5, 2018 at 9:22 AM, Sherrie Fredrick - NOAA
Affiliate via
> RT
> > <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Mon Mar 05 09:22:50 2018: Request 84299 was acted upon.
> > > > Transaction: Ticket created by sherrie.fredrick at noaa.gov
> > > > Queue: met_help
> > > > Subject: running MET with netcdf data
> > > > Owner: Nobody
> > > > Requestors: sherrie.fredrick at noaa.gov
> > > > Status: new
> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=84299
> > >
> > > >
> > > >
> > > > Good Morning,
> > > >
> > > > I am having trouble running MET on NETCDF data. I have
down
> > loaded
> > > my
> > > > files to your ftp server.
> > > > They are on /incoming/irap/met_help/sfredrick.
> > > >
> > > > The command that I use is
> > > > grid_stat PGB.F000.nc erai_20020112.grib grid_stat_config
> > > >
> > > > The error that I get is :
> > > > DEBUG 1: Default Config File:
> > > > /scratch4/BMC/dtc/MET/met-6.0/share/met/config/
> GridStatConfig_default
> > > > DEBUG 1: User Config File: grid_stat_config
> > > > ERROR :
> > > > ERROR : Trouble reading forecast file "PGB.F000.nc"
> > > > ERROR :
> > > >
> > > >
> > > > I have not tried using MET to run with NETCDF data before.
My
> > forecast
> > > > file is netcdf and my era-interim observation
> > > > data is grib.
> > > >
> > > > Any help you can provide would be much appreciated.
> > > > Thanks,
> > > > Sherrie
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: running MET with netcdf data
From: John Halley Gotway
Time: Tue Mar 06 10:47:14 2018
Sherrie,
Looks to me like you're pretty close:
ERAI: name = 10U, 10V, 2T ... and level = "Z0". Do not list the
record
number, R79, R80, and R81. There's not guarantee that the records
will
stay in the same order.
PGB: name = ugrd10m, vgrd10m, tmp2m ... and level = "(*,*)"
CMEAN: name = UGRD, VGRD, TMP and level = "Z10", "Z10", and "Z2"
respectively.
fcst = {
file_type = NETCDF_NCCF;
//
// PLEV values from PGB.F000.nc:
// 10, 20, 50, 100, 150, 200, 250, 300, 400, 500, 700, 850, 925,
1000
// MET dimension indices are 0-based.
//
level = [ "(13,*,*)", "(11,*,*)", "(9,*,*)", "(6,*,*)",
"(3,*,*)", "(2,*,*)", "(0,*,*)" ];
field = [
{ name = "u_plev"; },
{ name = "v_plev"; },
{ name = "t_plev"; },
{ name = "h_plev"; },
{ name = "ugrd10m"; level = "(*,*)"; },
{ name = "vgrd10m"; level = "(*,*)"; },
{ name = "tmp2m"; level = "(*,*)"; }
];
}
obs = {
level = [ "P1000", "P850", "P500", "P250",
"P100", "P50", "P10"];
field = [
{ name = "U"; },
{ name = "V"; },
{ name = "T"; },
{ name = "Z"; },
{ name = "10U"; level = "Z0"; },
{ name = "10V"; level = "Z0"; },
{ name = "2T"; level = "Z0"; }
];
}
climo_mean = {
level = [ "P1000", "P850", "P500", "P250",
"P100", "P50", "P10"];
field = [
{ name = "UGRD"; },
{ name = "VGRD"; },
{ name = "TMP"; },
{ name = "HGT"; },
{ name = "UGRD"; level = "Z10"; },
{ name = "VGRD"; level = "Z10"; },
{ name = "TMP"; level = "Z2"; }
];
file_name =
["/d1/johnhg/MET/MET_Help/fredrick_data_20180305/cmean_1d.19590112"];
regrid = {
method = NEAREST;
width = 1;
vld_thresh = 0.5;
}
time_interp_method = DW_MEAN;
match_day = TRUE;
time_step = 3600;
}
On Tue, Mar 6, 2018 at 10:26 AM, Sherrie Fredrick - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
>
> Hi John,
>
> Thanks I now have anomaly correlations for my pressure fields.
> One last thing. I need to add the surface fields. In the netcdf
file
> the names are ugrd10m,vgrd10 and tmp2m.
> I am not sure of how to change the new grid_stat file to also
> calculate the surface field stats.
>
> Thanks,
> Sherrie
>
> In the old grid_stat file I had the following:
> // Forecast and observation fields to be verified
> //
> fcst = {
>
> field = [
> {
> name = "UGRD";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "VGRD";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "TMP";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "HGT";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "UGRD";
> level = ["Z10"];
> },
> {
> name = "VGRD";
> level = ["Z10"];
> },
> {
> name = "TMP";
> level = ["Z2"];
> }
> ];
> }
> ///////////////////////////////////////////////////////////////
> obs = {
>
> field = [
> {
> name = "U";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "V";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "T";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "Z";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "10U";
> level = ["R79"];
> },
> {
> name = "10V";
> level = ["R80"];
> },
> {
> name = "2T";
> level = ["R81"];
> }
>
> ];
>
> }
> ////////////////////////////////////////////////////////////
> ////////////////////
>
> //
> // Climatology mean data
> //
> climo_mean = {
>
> file_name =
> ["/scratch4/BMC/refcst2/Sherrie.Fredrick/gfs/run/
> wcoss/era_interum/1999/_SDATE_"];
>
> field = [
> {
> name = "UGRD";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "VGRD";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "TMP";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "HGT";
> level =
["P1000","P850","P500","P250","P100","P50","P10"];
> },
> {
> name = "UGRD";
> level = ["Z10"];
> },
> {
> name = "VGRD";
> level = ["Z10"];
> },
> {
> name = "TMP";
> level = ["Z2"];
> }
>
> On Tue, Mar 6, 2018 at 9:16 AM, John Halley Gotway via RT <
> met_help at ucar.edu
> > wrote:
>
> > Sherrie,
> >
> > Sorry, I should have looked closer at the output generated by
Grid-Stat.
> > Setting "climo_mean = obs;" does not work well because these GRIB
records
> > are encoded using different tables... the erai data uses U, V, T,
and Z
> > while the climo data uses UGRD, VGRD, TMP, and HGT.
> >
> > In summary, your data is...
> > NetCDF Forecast: u_plev, v_plev, t_plev, h_plev
> > GRIB Observation: U, V, T, Z
> > GRIB Climo: UGRD, VGRD, TMP, HGT
> >
> > When I reran, I found that for U, V, and T, you have climo data
for 850,
> > 500, and 250. And for Z, you have climo data for 1000, 500, and
250.
> For
> > the 28 fields (variable/level combos) you're verifying, you'll get
> anomaly
> > correlation for 12 of them.
> >
> > Just edit your Grid-Stat config file by removing "climo_mean =
obs" and
> > adding the following to the climo_mean dictionary:
> >
> > level = [ "P1000", "P850", "P500", "P250",
> > "P100", "P50", "P10"];
> >
> > field = [
> > { name = "UGRD"; },
> > { name = "VGRD"; },
> > { name = "TMP"; },
> > { name = "HGT"; }
> > ];
> >
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> > On Tue, Mar 6, 2018 at 8:39 AM, Sherrie Fredrick - NOAA Affiliate
via RT
> <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
> > >
> > > Good Morning John,
> > >
> > > Thank you very much for your help. I am able to get MET
output
> now.
> > > I have a couple of questions, at your convenience.
> > >
> > > 1. I am not getting any anomaly correlations out. The errors
are
> > > DEBUG 2: Processing h_plev(9,*,*) versus Z/P500, for
interpolation
> method
> > > NEAREST(1), over region FULL, using 65160 pairs.
> > > DEBUG 2: Computing Continuous Statistics.
> > > DEBUG 2: Computing Scalar Partial Sums.
> > > DEBUG 3: Reading forecast data for h_plev(6,*,*).
> > > DEBUG 3: Reading observation data for Z/P250.
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found exact
match for
> > > VarInfo "Z/P250" in GRIB record 21 of GRIB file
"erai_20020112.grib".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
records
> > > matching VarInfo "Z/P250" in GRIB file "erai_20020112.grib".
> > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 0 GRIB
records
> > > matching VarInfo "Z/P250" in GRIB file
> > > "/lustre/f1/unswept/Sherrie.Fredrick/climate/cmean_1d.19590112".
> > > DEBUG 3: Found 0 climatology fields.
> > > DEBUG 3: Found 0 climatology mean and 0 climatology standard
deviation
> > > field(s) for forecast h_plev(6,*,*).
> > >
> > > These messages come out for all fields not just the height(Z)
> > >
> > > 2. I also need to output stats for the surface fields. Their
names are
> > > urgd10m,vgrd10m and tmp2m. Do I use
> > > name = "ugrd10m";
> > > level = ["Z10"]
> > >
> > > Again many thanks for helping.
> > > Sherrie
> > >
> > > On Mon, Mar 5, 2018 at 2:17 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu
> > > > wrote:
> > >
> > > > Hi Sherrie,
> > > >
> > > > Sorry for the delay in responding. I saw your ticket from
last
> > Thursday
> > > > but we've been scrambling to finish up work on the met-7.0
release.
> > > >
> > > > I see that you're having trouble reading a NetCDF file in MET.
> Thanks
> > > for
> > > > sending a sample data file. I took a look and see that it
doesn't
> > > > *exactly* follow any of the flavors of NetCDF supported by
MET.
> > However,
> > > > since it's just on a regular lat/lon grid and is close enough
the CF
> > > > convention, that'll do the trick.
> > > >
> > > > The following a global attribute tells MET to interpret the
data file
> > as
> > > > being CF-complaint:
> > > > :conventions = "CF..."; (where ... is some version number)
> > > >
> > > > Since your file lacks that conventions global attribute, we
need to
> > > > explicitly tell MET how to handle it by setting the
"file_type"
> config
> > > > option. Here's a plot_data_plane command for plotting 2-m
> temperature
> > > from
> > > > this file:
> > > >
> > > > met-6.1/bin/plot_data_plane PGB.F000.nc tmp2m.ps
'name="tmp2m";
> > > > level="(*,*)"; file_type=NETCDF_NCCF;'
> > > >
> > > > Note the "file_type" setting that I used. And I've attached a
PNG of
> > the
> > > > resulting image.
> > > >
> > > > I also used ncview to look at the other fields of data and
found that
> > the
> > > > following variables all seem to be "empty": slp, pmaskv2,
pwat,
> > pressfc,
> > > > prate_ave
> > > > Just wanted to alert you in case you weren't aware.
> > > >
> > > > But ultimately, you want to run grid_stat to compare your PGB
> forecast
> > to
> > > > ERAI analysis. I modified the Grid-Stat config file you sent
me and
> > > > attached an updated version named "grid_stat_config_JHG".
You'll
> > notice
> > > > some differences:
> > > >
> > > > (1) In "fcst", I added "file_type = NETCDF_NCCF;" to tell MET
how to
> > read
> > > > that file.
> > > > (2) The way you specify levels for NetCDF is a bit cumbersome.
You
> > list
> > > > (0-based) indexes into the dimensions to define the slice of
data you
> > > want
> > > > to use.
> > > > (3) Rather then relisting "level" for each entry in the field
array,
> I
> > > just
> > > > set it once at a higher level of context.
> > > > (4) In climo_mean, just copy over the obs settings with
"climo_mean =
> > > > obs;". That way we don't have to relist the "field" array.
> > > > (5) In "mask", I got rid of the polyline masks since I don't
have
> > those.
> > > > (6) In output flag, I requested only output for sl1l2, sal1l2,
and
> cnt.
> > > > You haven't defined any categorical thresholds (cat_thresh)
for an
> > > > event-based contingency table evaluation.
> > > > (7) I switched the version from "V6.0" to "V6.1" since that's
what I
> > used
> > > > for testing (and I added output_flag entries for eclv and grad
that
> > were
> > > > added in met-6.1).
> > > >
> > > > Here's the command line I ran:
> > > > /usr/local/met-6.1/bin/grid_stat PGB.F000.nc
erai_20020112.grib
> > > > grid_stat_config_JHG -outdir out -log run_gs.log
> > > >
> > > > And I attached the log file that was created.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > > On Mon, Mar 5, 2018 at 9:22 AM, Sherrie Fredrick - NOAA
Affiliate via
> > RT
> > > <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Mar 05 09:22:50 2018: Request 84299 was acted upon.
> > > > > Transaction: Ticket created by sherrie.fredrick at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: running MET with netcdf data
> > > > > Owner: Nobody
> > > > > Requestors: sherrie.fredrick at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=84299
> > > >
> > > > >
> > > > >
> > > > > Good Morning,
> > > > >
> > > > > I am having trouble running MET on NETCDF data. I have
down
> > > loaded
> > > > my
> > > > > files to your ftp server.
> > > > > They are on /incoming/irap/met_help/sfredrick.
> > > > >
> > > > > The command that I use is
> > > > > grid_stat PGB.F000.nc erai_20020112.grib
grid_stat_config
> > > > >
> > > > > The error that I get is :
> > > > > DEBUG 1: Default Config File:
> > > > > /scratch4/BMC/dtc/MET/met-6.0/share/met/config/
> > GridStatConfig_default
> > > > > DEBUG 1: User Config File: grid_stat_config
> > > > > ERROR :
> > > > > ERROR : Trouble reading forecast file "PGB.F000.nc"
> > > > > ERROR :
> > > > >
> > > > >
> > > > > I have not tried using MET to run with NETCDF data before.
My
> > > forecast
> > > > > file is netcdf and my era-interim observation
> > > > > data is grib.
> > > > >
> > > > > Any help you can provide would be much appreciated.
> > > > > Thanks,
> > > > > Sherrie
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: running MET with netcdf data
From: Sherrie Fredrick - NOAA Affiliate
Time: Tue Mar 06 11:07:46 2018
Hi John,
That did it. I now how all the stats and anomaly correlations,
etc
that I
could ever want.
Thanks you sooo much.
Sherrie
On Tue, Mar 6, 2018 at 10:47 AM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Sherrie,
>
> Looks to me like you're pretty close:
>
> ERAI: name = 10U, 10V, 2T ... and level = "Z0". Do not list the
record
> number, R79, R80, and R81. There's not guarantee that the records
will
> stay in the same order.
> PGB: name = ugrd10m, vgrd10m, tmp2m ... and level = "(*,*)"
> CMEAN: name = UGRD, VGRD, TMP and level = "Z10", "Z10", and "Z2"
> respectively.
>
> fcst = {
>
> file_type = NETCDF_NCCF;
>
> //
> // PLEV values from PGB.F000.nc:
> // 10, 20, 50, 100, 150, 200, 250, 300, 400, 500, 700, 850,
925, 1000
> // MET dimension indices are 0-based.
> //
> level = [ "(13,*,*)", "(11,*,*)", "(9,*,*)", "(6,*,*)",
> "(3,*,*)", "(2,*,*)", "(0,*,*)" ];
>
> field = [
> { name = "u_plev"; },
> { name = "v_plev"; },
> { name = "t_plev"; },
> { name = "h_plev"; },
> { name = "ugrd10m"; level = "(*,*)"; },
> { name = "vgrd10m"; level = "(*,*)"; },
> { name = "tmp2m"; level = "(*,*)"; }
> ];
> }
>
> obs = {
>
> level = [ "P1000", "P850", "P500", "P250",
> "P100", "P50", "P10"];
>
> field = [
> { name = "U"; },
> { name = "V"; },
> { name = "T"; },
> { name = "Z"; },
> { name = "10U"; level = "Z0"; },
> { name = "10V"; level = "Z0"; },
> { name = "2T"; level = "Z0"; }
> ];
>
> }
>
> climo_mean = {
>
> level = [ "P1000", "P850", "P500", "P250",
> "P100", "P50", "P10"];
>
> field = [
> { name = "UGRD"; },
> { name = "VGRD"; },
> { name = "TMP"; },
> { name = "HGT"; },
> { name = "UGRD"; level = "Z10"; },
> { name = "VGRD"; level = "Z10"; },
> { name = "TMP"; level = "Z2"; }
> ];
>
> file_name =
>
["/d1/johnhg/MET/MET_Help/fredrick_data_20180305/cmean_1d.19590112"];
>
> regrid = {
> method = NEAREST;
> width = 1;
> vld_thresh = 0.5;
> }
>
> time_interp_method = DW_MEAN;
> match_day = TRUE;
> time_step = 3600;
> }
>
>
> On Tue, Mar 6, 2018 at 10:26 AM, Sherrie Fredrick - NOAA Affiliate
via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299 >
> >
> > Hi John,
> >
> > Thanks I now have anomaly correlations for my pressure
fields.
> > One last thing. I need to add the surface fields. In the netcdf
file
> > the names are ugrd10m,vgrd10 and tmp2m.
> > I am not sure of how to change the new grid_stat file to also
> > calculate the surface field stats.
> >
> > Thanks,
> > Sherrie
> >
> > In the old grid_stat file I had the following:
> > // Forecast and observation fields to be verified
> > //
> > fcst = {
> >
> > field = [
> > {
> > name = "UGRD";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "VGRD";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "TMP";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "HGT";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "UGRD";
> > level = ["Z10"];
> > },
> > {
> > name = "VGRD";
> > level = ["Z10"];
> > },
> > {
> > name = "TMP";
> > level = ["Z2"];
> > }
> > ];
> > }
> > ///////////////////////////////////////////////////////////////
> > obs = {
> >
> > field = [
> > {
> > name = "U";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "V";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "T";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "Z";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "10U";
> > level = ["R79"];
> > },
> > {
> > name = "10V";
> > level = ["R80"];
> > },
> > {
> > name = "2T";
> > level = ["R81"];
> > }
> >
> > ];
> >
> > }
> > ////////////////////////////////////////////////////////////
> > ////////////////////
> >
> > //
> > // Climatology mean data
> > //
> > climo_mean = {
> >
> > file_name =
> > ["/scratch4/BMC/refcst2/Sherrie.Fredrick/gfs/run/
> > wcoss/era_interum/1999/_SDATE_"];
> >
> > field = [
> > {
> > name = "UGRD";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "VGRD";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "TMP";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "HGT";
> > level =
["P1000","P850","P500","P250","P100","P50","P10"];
> > },
> > {
> > name = "UGRD";
> > level = ["Z10"];
> > },
> > {
> > name = "VGRD";
> > level = ["Z10"];
> > },
> > {
> > name = "TMP";
> > level = ["Z2"];
> > }
> >
> > On Tue, Mar 6, 2018 at 9:16 AM, John Halley Gotway via RT <
> > met_help at ucar.edu
> > > wrote:
> >
> > > Sherrie,
> > >
> > > Sorry, I should have looked closer at the output generated by
> Grid-Stat.
> > > Setting "climo_mean = obs;" does not work well because these
GRIB
> records
> > > are encoded using different tables... the erai data uses U, V,
T, and Z
> > > while the climo data uses UGRD, VGRD, TMP, and HGT.
> > >
> > > In summary, your data is...
> > > NetCDF Forecast: u_plev, v_plev, t_plev, h_plev
> > > GRIB Observation: U, V, T, Z
> > > GRIB Climo: UGRD, VGRD, TMP, HGT
> > >
> > > When I reran, I found that for U, V, and T, you have climo data
for
> 850,
> > > 500, and 250. And for Z, you have climo data for 1000, 500, and
250.
> > For
> > > the 28 fields (variable/level combos) you're verifying, you'll
get
> > anomaly
> > > correlation for 12 of them.
> > >
> > > Just edit your Grid-Stat config file by removing "climo_mean =
obs" and
> > > adding the following to the climo_mean dictionary:
> > >
> > > level = [ "P1000", "P850", "P500", "P250",
> > > "P100", "P50", "P10"];
> > >
> > > field = [
> > > { name = "UGRD"; },
> > > { name = "VGRD"; },
> > > { name = "TMP"; },
> > > { name = "HGT"; }
> > > ];
> > >
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John
> > >
> > > On Tue, Mar 6, 2018 at 8:39 AM, Sherrie Fredrick - NOAA
Affiliate via
> RT
> > <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84299
>
> > > >
> > > > Good Morning John,
> > > >
> > > > Thank you very much for your help. I am able to get MET
output
> > now.
> > > > I have a couple of questions, at your convenience.
> > > >
> > > > 1. I am not getting any anomaly correlations out. The errors
are
> > > > DEBUG 2: Processing h_plev(9,*,*) versus Z/P500, for
interpolation
> > method
> > > > NEAREST(1), over region FULL, using 65160 pairs.
> > > > DEBUG 2: Computing Continuous Statistics.
> > > > DEBUG 2: Computing Scalar Partial Sums.
> > > > DEBUG 3: Reading forecast data for h_plev(6,*,*).
> > > > DEBUG 3: Reading observation data for Z/P250.
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found exact
match
> for
> > > > VarInfo "Z/P250" in GRIB record 21 of GRIB file
"erai_20020112.grib".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 1 GRIB
> records
> > > > matching VarInfo "Z/P250" in GRIB file "erai_20020112.grib".
> > > > DEBUG 3: MetGrib1DataFile::data_plane_array() -> Found 0 GRIB
> records
> > > > matching VarInfo "Z/P250" in GRIB file
> > > >
"/lustre/f1/unswept/Sherrie.Fredrick/climate/cmean_1d.19590112".
> > > > DEBUG 3: Found 0 climatology fields.
> > > > DEBUG 3: Found 0 climatology mean and 0 climatology standard
> deviation
> > > > field(s) for forecast h_plev(6,*,*).
> > > >
> > > > These messages come out for all fields not just the height(Z)
> > > >
> > > > 2. I also need to output stats for the surface fields. Their
names
> are
> > > > urgd10m,vgrd10m and tmp2m. Do I use
> > > > name = "ugrd10m";
> > > > level = ["Z10"]
> > > >
> > > > Again many thanks for helping.
> > > > Sherrie
> > > >
> > > > On Mon, Mar 5, 2018 at 2:17 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu
> > > > > wrote:
> > > >
> > > > > Hi Sherrie,
> > > > >
> > > > > Sorry for the delay in responding. I saw your ticket from
last
> > > Thursday
> > > > > but we've been scrambling to finish up work on the met-7.0
release.
> > > > >
> > > > > I see that you're having trouble reading a NetCDF file in
MET.
> > Thanks
> > > > for
> > > > > sending a sample data file. I took a look and see that it
doesn't
> > > > > *exactly* follow any of the flavors of NetCDF supported by
MET.
> > > However,
> > > > > since it's just on a regular lat/lon grid and is close
enough the
> CF
> > > > > convention, that'll do the trick.
> > > > >
> > > > > The following a global attribute tells MET to interpret the
data
> file
> > > as
> > > > > being CF-complaint:
> > > > > :conventions = "CF..."; (where ... is some version
number)
> > > > >
> > > > > Since your file lacks that conventions global attribute, we
need to
> > > > > explicitly tell MET how to handle it by setting the
"file_type"
> > config
> > > > > option. Here's a plot_data_plane command for plotting 2-m
> > temperature
> > > > from
> > > > > this file:
> > > > >
> > > > > met-6.1/bin/plot_data_plane PGB.F000.nc tmp2m.ps
'name="tmp2m";
> > > > > level="(*,*)"; file_type=NETCDF_NCCF;'
> > > > >
> > > > > Note the "file_type" setting that I used. And I've attached
a PNG
> of
> > > the
> > > > > resulting image.
> > > > >
> > > > > I also used ncview to look at the other fields of data and
found
> that
> > > the
> > > > > following variables all seem to be "empty": slp, pmaskv2,
pwat,
> > > pressfc,
> > > > > prate_ave
> > > > > Just wanted to alert you in case you weren't aware.
> > > > >
> > > > > But ultimately, you want to run grid_stat to compare your
PGB
> > forecast
> > > to
> > > > > ERAI analysis. I modified the Grid-Stat config file you
sent me
> and
> > > > > attached an updated version named "grid_stat_config_JHG".
You'll
> > > notice
> > > > > some differences:
> > > > >
> > > > > (1) In "fcst", I added "file_type = NETCDF_NCCF;" to tell
MET how
> to
> > > read
> > > > > that file.
> > > > > (2) The way you specify levels for NetCDF is a bit
cumbersome. You
> > > list
> > > > > (0-based) indexes into the dimensions to define the slice of
data
> you
> > > > want
> > > > > to use.
> > > > > (3) Rather then relisting "level" for each entry in the
field
> array,
> > I
> > > > just
> > > > > set it once at a higher level of context.
> > > > > (4) In climo_mean, just copy over the obs settings with
> "climo_mean =
> > > > > obs;". That way we don't have to relist the "field" array.
> > > > > (5) In "mask", I got rid of the polyline masks since I don't
have
> > > those.
> > > > > (6) In output flag, I requested only output for sl1l2,
sal1l2, and
> > cnt.
> > > > > You haven't defined any categorical thresholds (cat_thresh)
for an
> > > > > event-based contingency table evaluation.
> > > > > (7) I switched the version from "V6.0" to "V6.1" since
that's what
> I
> > > used
> > > > > for testing (and I added output_flag entries for eclv and
grad that
> > > were
> > > > > added in met-6.1).
> > > > >
> > > > > Here's the command line I ran:
> > > > > /usr/local/met-6.1/bin/grid_stat PGB.F000.nc
erai_20020112.grib
> > > > > grid_stat_config_JHG -outdir out -log run_gs.log
> > > > >
> > > > > And I attached the log file that was created.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > >
> > > > > On Mon, Mar 5, 2018 at 9:22 AM, Sherrie Fredrick - NOAA
Affiliate
> via
> > > RT
> > > > <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Mon Mar 05 09:22:50 2018: Request 84299 was acted upon.
> > > > > > Transaction: Ticket created by sherrie.fredrick at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: running MET with netcdf data
> > > > > > Owner: Nobody
> > > > > > Requestors: sherrie.fredrick at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=84299
> > > > >
> > > > > >
> > > > > >
> > > > > > Good Morning,
> > > > > >
> > > > > > I am having trouble running MET on NETCDF data. I
have down
> > > > loaded
> > > > > my
> > > > > > files to your ftp server.
> > > > > > They are on /incoming/irap/met_help/sfredrick.
> > > > > >
> > > > > > The command that I use is
> > > > > > grid_stat PGB.F000.nc erai_20020112.grib
grid_stat_config
> > > > > >
> > > > > > The error that I get is :
> > > > > > DEBUG 1: Default Config File:
> > > > > > /scratch4/BMC/dtc/MET/met-6.0/share/met/config/
> > > GridStatConfig_default
> > > > > > DEBUG 1: User Config File: grid_stat_config
> > > > > > ERROR :
> > > > > > ERROR : Trouble reading forecast file "PGB.F000.nc"
> > > > > > ERROR :
> > > > > >
> > > > > >
> > > > > > I have not tried using MET to run with NETCDF data
before. My
> > > > forecast
> > > > > > file is netcdf and my era-interim observation
> > > > > > data is grib.
> > > > > >
> > > > > > Any help you can provide would be much appreciated.
> > > > > > Thanks,
> > > > > > Sherrie
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list