[Met_help] [rt.rap.ucar.edu #93980] History for Request assist with MET V5.2 Grid-Stat

Tue Feb 4 16:22:34 MST 2020

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

I tried to run Grid-Stat using a single post-processed WRF output file and a NetCDF gridded observation file which I generated using Unidata IDV. The error dialog from the log file seems to indicate a problem wit the obs file, but I'm not sure how to resolve the issue. Could you take a look at the attached files to see if you can see wha tthe problem is?

Attached "IDV_test" file contains the run commands I used and the log output.
Also attached are the NetCDF obs file and the config file.

Thanks.

R/
John

Mr John W. Raby, Meteorologist

U.S. Army Research Laboratory

White Sands Missile Range, NM 88002

(575) 678-2004 DSN 258-2004

FAX (575) 678-1230 DSN 258-1230

Email: john.w.raby2.civ at mail.mil<mailto:john.raby at us.army.mil>

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Request assist with MET V5.2 Grid-Stat
From: Minna Win
Time: Thu Jan 30 09:29:52 2020

Hello John,

It looks like you are attempting to run Grid-stat using MET v5.2.  If
that
is the case, you should update to the latest version of MET, which is
currently MET v8.1.1.  I hope that resolves your issue.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401

On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
>        Queue: met_help
>      Subject: Request assist with MET V5.2 Grid-Stat
>        Owner: Nobody
>   Requestors: john.w.raby2.civ at mail.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
>
> I tried to run Grid-Stat using a single post-processed WRF output
file and
> a NetCDF gridded observation file which I generated using Unidata
IDV. The
> error dialog from the log file seems to indicate a problem wit the
obs
> file, but I'm not sure how to resolve the issue. Could you take a
look at
> the attached files to see if you can see wha tthe problem is?
>
> Attached "IDV_test" file contains the run commands I used and the
log
> output.
> Also attached are the NetCDF obs file and the config file.
>
> Thanks.
>
> R/
> John
>
>
>
>
> Mr John W. Raby, Meteorologist
>
> U.S. Army Research Laboratory
>
> White Sands Missile Range, NM 88002
>
> (575) 678-2004 DSN 258-2004
>
> FAX (575) 678-1230 DSN 258-1230
>
> Email: john.w.raby2.civ at mail.mil<mailto:john.raby at us.army.mil>
>
>

------------------------------------------------
Subject: Request assist with MET V5.2 Grid-Stat
From: Raby, John W USA CIV
Time: Thu Jan 30 09:53:50 2020

CLASSIFICATION: UNCLASSIFIED

Minna -

Thanks for your reply. I will try with MET V8.1.1 and let you know the
result.

R/
John

-----Original Message-----
From: Minna Win via RT [mailto:met_help at ucar.edu]
Sent: Thursday, January 30, 2020 9:30 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist
with MET
V5.2 Grid-Stat

All active links contained in this email were disabled.  Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.

----

Hello John,

It looks like you are attempting to run Grid-stat using MET v5.2.  If
that is
the case, you should update to the latest version of MET, which is
currently
MET v8.1.1.  I hope that resolves your issue.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401

On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
>        Queue: met_help
>      Subject: Request assist with MET V5.2 Grid-Stat
>        Owner: Nobody
>   Requestors: john.w.raby2.civ at mail.mil
>       Status: new
>  Ticket <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
>
> I tried to run Grid-Stat using a single post-processed WRF output
file
> and a NetCDF gridded observation file which I generated using
Unidata
> IDV. The error dialog from the log file seems to indicate a problem
> wit the obs file, but I'm not sure how to resolve the issue. Could
you
> take a look at the attached files to see if you can see wha tthe
problem is?
>
> Attached "IDV_test" file contains the run commands I used and the
log
> output.
> Also attached are the NetCDF obs file and the config file.
>
> Thanks.
>
> R/
> John
>
>
>
>
> Mr John W. Raby, Meteorologist
>
> U.S. Army Research Laboratory
>
> White Sands Missile Range, NM 88002
>
> (575) 678-2004 DSN 258-2004
>
> FAX (575) 678-1230 DSN 258-1230
>
> Email: john.w.raby2.civ at mail.mil<Caution-
mailto:john.raby at us.army.mil>
>
>

CLASSIFICATION: UNCLASSIFIED

------------------------------------------------
Subject: Request assist with MET V5.2 Grid-Stat
From: John Halley Gotway
Time: Thu Jan 30 11:31:54 2020

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#latitude-coordinate
http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu Jan 30 11:58:12 2020

John -

Thanks for conducting the testing on my gridded obs file. I used IDV
to perform a Barnes objective analysis on some point observations and
then output the NetCDF file containing the analysis field (gridded
obs) at appx 1km grid spacing. I'm not familiar with the ncatted
command. What sw uses that command? Can the output "NEW" NetCDF file
you created using ncatted be input into V8.1.1 Grid-Stat or will this
capability come as part of V9.0?

R/
John

________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 11:31 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<Caution-http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
Caution-https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: Request assist with MET V5.2 Grid-Stat
From: John Halley Gotway
Time: Thu Jan 30 13:53:23 2020

John,

ncatted is one of the NCO (http://nco.sourceforge.net/) tools.  I use
that
one sometimes, as well as, ncrename.  And ncks (kitchen sink) is
pretty
powerful as well.
But you can modify the NetCDF file with whatever method you'd like.

You can also run:
ncdump 1km_grid_obs_test_29JAN2020.nc >
km_grid_obs_test_29JAN2020.ncdump
# Edit that ascii NetCDF file by changing attributes, variable names,
whatever
ncgen km_grid_obs_test_29JAN2020.ncdump
-o 1km_grid_obs_test_29JAN2020_MET.nc

That modified NetCDF file will work with met-8.1 and it may also work
with
met-5.2.  I wasn't able to test that because my met-5.2 compilation is
very
old and needs to be redone.

John

On Thu, Jan 30, 2020 at 11:58 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> John -
>
> Thanks for conducting the testing on my gridded obs file. I used IDV
to
> perform a Barnes objective analysis on some point observations and
then
> output the NetCDF file containing the analysis field (gridded obs)
at appx
> 1km grid spacing. I'm not familiar with the ncatted command. What sw
uses
> that command? Can the output "NEW" NetCDF file you created using
ncatted be
> input into V8.1.1 Grid-Stat or will this capability come as part of
V9.0?
>
> R/
> John
>
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 11:31 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John,
>
> I did take a look at the file you sent with MET version 8.1.2.  I
tried
> running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and
got the
> same error messages you did.
>
> Running the following ncatted command makes MET happy with this
file.
> Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".
>
> *ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000
UTC" -a
> units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
> 1km_grid_obs_test_29JAN2020.nc -o
1km_grid_obs_test_29JAN2020_NEW.nc*
>
> *plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
> 1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*
>
> The resulting image is attached.
>
> While looking into this I found that MET is not parsing all the
supported
> variants of time units listed here:
> Caution-
> http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#time-coordinate
>
> "The acceptable units for time are listed in the udunits.dat
> <Caution-http://www.unidata.ucar.edu/software/udunits/> file. The
most
> commonly
> used of these strings (and their abbreviations) includes *day (d)*,
*hour
> (hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are
also
> acceptable."
>
> Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".
> I
> created this GitHub issue to update met-9.0 to handle all the other
> variants:
> Caution-https://github.com/NCAR/MET/issues/1245
>
> The latitude and longitude dimensions really do need to have the
expected
> units (degrees_north and degrees_east, resp):
> Caution-
> http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#latitude-coordinate
>
> Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate
> <http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#latitude-coordinateCaution-
http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html%23longitude-coordinate>
>
> Thanks,
> John
>
> On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url: Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Minna -
> >
> > Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> > result.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, January 30, 2020 9:30 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> > with MET
> > V5.2 Grid-Stat
> >
> > All active links contained in this email were disabled.  Please
verify
> the
> > identity of the sender, and confirm the authenticity of all links
> > contained
> > within the message prior to copying and pasting the address to a
Web
> > browser.
> >
> >
> >
> >
> > ----
> >
> > Hello John,
> >
> > It looks like you are attempting to run Grid-stat using MET v5.2.
If
> that
> > is
> > the case, you should update to the latest version of MET, which is
> > currently
> > MET v8.1.1.  I hope that resolves your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> >
> >
> >
> > On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > >        Queue: met_help
> > >      Subject: Request assist with MET V5.2 Grid-Stat
> > >        Owner: Nobody
> > >   Requestors: john.w.raby2.civ at mail.mil
> > >       Status: new
> > >  Ticket <Caution-Caution-url:
> > > Caution-Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> > >
> > >
> > > I tried to run Grid-Stat using a single post-processed WRF
output file
> > > and a NetCDF gridded observation file which I generated using
Unidata
> > > IDV. The error dialog from the log file seems to indicate a
problem
> > > wit the obs file, but I'm not sure how to resolve the issue.
Could you
> > > take a look at the attached files to see if you can see wha tthe
> problem
> > is?
> > >
> > > Attached "IDV_test" file contains the run commands I used and
the log
> > > output.
> > > Also attached are the NetCDF obs file and the config file.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > >
> > >
> > >
> > > Mr John W. Raby, Meteorologist
> > >
> > > U.S. Army Research Laboratory
> > >
> > > White Sands Missile Range, NM 88002
> > >
> > > (575) 678-2004 DSN 258-2004
> > >
> > > FAX (575) 678-1230 DSN 258-1230
> > >
> > > Email: john.w.raby2.civ at mail.mil<Caution-Caution-mailto:
> john.raby at us.army.mil>
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu Jan 30 14:11:11 2020

John -

Thanks for the info on ncatted. I learned from a colleague that you
can load the NCO module on the HPC and I tried it and appears that
ncatted works. At least I see the usage displayed on entering the
command which is more than I can do on my local workstation which
apparently doesn't have the module to load. I plan to copy the .nc
file there and repeat the commands you provided to see how it works. I
have MET V8.1.1 running on the HPC, so no need for MET V5.2. I just
used MET V5.2 for a quick test. I'm realizing that it's probably not a
good idea anymore to use V5.2 due to the its age and the new
capabilities of the later versions.

I wasn't aware of the ability to merely edit the ascii output of
ncdump either. I'll try that method also.

R/
John

________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 1:53 PM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

ncatted is one of the NCO (Caution-http://nco.sourceforge.net/) tools.
I use that
one sometimes, as well as, ncrename.  And ncks (kitchen sink) is
pretty
powerful as well.
But you can modify the NetCDF file with whatever method you'd like.

You can also run:
ncdump 1km_grid_obs_test_29JAN2020.nc >
km_grid_obs_test_29JAN2020.ncdump
# Edit that ascii NetCDF file by changing attributes, variable names,
whatever
ncgen km_grid_obs_test_29JAN2020.ncdump
-o 1km_grid_obs_test_29JAN2020_MET.nc

That modified NetCDF file will work with met-8.1 and it may also work
with
met-5.2.  I wasn't able to test that because my met-5.2 compilation is
very
old and needs to be redone.

John

On Thu, Jan 30, 2020 at 11:58 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> John -
>
> Thanks for conducting the testing on my gridded obs file. I used IDV
to
> perform a Barnes objective analysis on some point observations and
then
> output the NetCDF file containing the analysis field (gridded obs)
at appx
> 1km grid spacing. I'm not familiar with the ncatted command. What sw
uses
> that command? Can the output "NEW" NetCDF file you created using
ncatted be
> input into V8.1.1 Grid-Stat or will this capability come as part of
V9.0?
>
> R/
> John
>
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 11:31 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John,
>
> I did take a look at the file you sent with MET version 8.1.2.  I
tried
> running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and
got the
> same error messages you did.
>
> Running the following ncatted command makes MET happy with this
file.
> Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".
>
> *ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000
UTC" -a
> units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
> 1km_grid_obs_test_29JAN2020.nc -o
1km_grid_obs_test_29JAN2020_NEW.nc*
>
> *plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
> 1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*
>
> The resulting image is attached.
>
> While looking into this I found that MET is not parsing all the
supported
> variants of time units listed here:
> Caution-
> Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate
>
> "The acceptable units for time are listed in the udunits.dat
> <Caution-Caution-http://www.unidata.ucar.edu/software/udunits/>
file. The most
> commonly
> used of these strings (and their abbreviations) includes *day (d)*,
*hour
> (hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are
also
> acceptable."
>
> Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".
> I
> created this GitHub issue to update met-9.0 to handle all the other
> variants:
> Caution-Caution-https://github.com/NCAR/MET/issues/1245
>
> The latitude and longitude dimensions really do need to have the
expected
> units (degrees_north and degrees_east, resp):
> Caution-
> Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
>
> Caution-Caution-http://cfconventions.org/Data/cf-conventions/cf-
conventions-1.7/cf-conventions.html#longitude-coordinate
> <Caution-http://cfconventions.org/Data/cf-conventions/cf-
conventions-1.7/cf-conventions.html#latitude-coordinateCaution-
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html%23longitude-coordinate>
>
> Thanks,
> John
>
> On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-Caution-url: Caution-
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Minna -
> >
> > Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> > result.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: Minna Win via RT [Caution-Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, January 30, 2020 9:30 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> > with MET
> > V5.2 Grid-Stat
> >
> > All active links contained in this email were disabled.  Please
verify
> the
> > identity of the sender, and confirm the authenticity of all links
> > contained
> > within the message prior to copying and pasting the address to a
Web
> > browser.
> >
> >
> >
> >
> > ----
> >
> > Hello John,
> >
> > It looks like you are attempting to run Grid-stat using MET v5.2.
If
> that
> > is
> > the case, you should update to the latest version of MET, which is
> > currently
> > MET v8.1.1.  I hope that resolves your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> >
> >
> >
> > On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > >        Queue: met_help
> > >      Subject: Request assist with MET V5.2 Grid-Stat
> > >        Owner: Nobody
> > >   Requestors: john.w.raby2.civ at mail.mil
> > >       Status: new
> > >  Ticket <Caution-Caution-Caution-url:
> > > Caution-Caution-
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> > >
> > >
> > > I tried to run Grid-Stat using a single post-processed WRF
output file
> > > and a NetCDF gridded observation file which I generated using
Unidata
> > > IDV. The error dialog from the log file seems to indicate a
problem
> > > wit the obs file, but I'm not sure how to resolve the issue.
Could you
> > > take a look at the attached files to see if you can see wha tthe
> problem
> > is?
> > >
> > > Attached "IDV_test" file contains the run commands I used and
the log
> > > output.
> > > Also attached are the NetCDF obs file and the config file.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > >
> > >
> > >
> > > Mr John W. Raby, Meteorologist
> > >
> > > U.S. Army Research Laboratory
> > >
> > > White Sands Missile Range, NM 88002
> > >
> > > (575) 678-2004 DSN 258-2004
> > >
> > > FAX (575) 678-1230 DSN 258-1230
> > >
> > > Email: john.w.raby2.civ at mail.mil<Caution-Caution-Caution-mailto:
> john.raby at us.army.mil>
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu Jan 30 14:44:27 2020

John -

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Thanks.

R/
John
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 11:31 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<Caution-http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
Caution-https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Feb 03 13:20:19 2020

John -

Just an update to let you know that I was able to load a module on the
HPC which enables the use of the NCO tools including ncatted. I used
the command you provided to edit the attributes of my NetCDF file and
it ran successfully. I was able to use your plot_data_plan command
from MET V8.1.1 to plot the output file and it did so successfully.
The plot was identical to yours.

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Next step: Run MET Grid-Stat using the edited NetCDF file (obs file)
and a WRF output file (fcst file) valid at the same time to see if I
can get some verification results.

Thanks for providing the work around to make the file compatible with
MET.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Thursday, January 30, 2020 2:43 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Thanks.

R/
John
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 11:31 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<Caution-http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
Caution-https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Feb 03 14:32:25 2020

John -

I just ran MET V8.1.1 using a WRF output file and the NetCDF gridded
obs file and it ran with one warning:

WARNING:
WARNING: process_scores() -> Forecast and observation valid times do
not match 20120207_180000 != 20200129_211537 for TMP/Z2 versus
TEMP_15(0,*,*).
WARNING:

I know that the valid time of the observations is the same as the
fcst, but something is inserting the current date/time in the file.
Can I use ncatted to edit the valid time?

Grid-Stat produced the expected output which included the pairs.nc
file. When I try to plot the pairs.nc file, IDV has an error "no
gridded data found". I'll try plotting it using plot_data_plane.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, February 03, 2020 1:05 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Just an update to let you know that I was able to load a module on the
HPC which enables the use of the NCO tools including ncatted. I used
the command you provided to edit the attributes of my NetCDF file and
it ran successfully. I was able to use your plot_data_plan command
from MET V8.1.1 to plot the output file and it did so successfully.
The plot was identical to yours.

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Next step: Run MET Grid-Stat using the edited NetCDF file (obs file)
and a WRF output file (fcst file) valid at the same time to see if I
can get some verification results.

Thanks for providing the work around to make the file compatible with
MET.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Thursday, January 30, 2020 2:43 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Thanks.

R/
John
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 11:31 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<Caution-http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
Caution-https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: Request assist with MET V5.2 Grid-Stat
From: Raby, John W USA CIV
Time: Mon Feb 03 14:49:12 2020

I forgot to attached the pairs.nc file on mt previous email, so it's
attached on this one.

R/
John
________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, February 03, 2020 2:32 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

I just ran MET V8.1.1 using a WRF output file and the NetCDF gridded
obs file and it ran with one warning:

WARNING:
WARNING: process_scores() -> Forecast and observation valid times do
not match 20120207_180000 != 20200129_211537 for TMP/Z2 versus
TEMP_15(0,*,*).
WARNING:

I know that the valid time of the observations is the same as the
fcst, but something is inserting the current date/time in the file.
Can I use ncatted to edit the valid time?

Grid-Stat produced the expected output which included the pairs.nc
file. When I try to plot the pairs.nc file, IDV has an error "no
gridded data found". I'll try plotting it using plot_data_plane.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, February 03, 2020 1:05 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Just an update to let you know that I was able to load a module on the
HPC which enables the use of the NCO tools including ncatted. I used
the command you provided to edit the attributes of my NetCDF file and
it ran successfully. I was able to use your plot_data_plan command
from MET V8.1.1 to plot the output file and it did so successfully.
The plot was identical to yours.

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Next step: Run MET Grid-Stat using the edited NetCDF file (obs file)
and a WRF output file (fcst file) valid at the same time to see if I
can get some verification results.

Thanks for providing the work around to make the file compatible with
MET.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Thursday, January 30, 2020 2:43 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Thanks.

R/
John
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 11:31 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<Caution-http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
Caution-https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Feb 03 15:33:40 2020

I successfully used MET V8.1.1 plot_data_plane to plot the pair.nc
output of Grid-Stat. Seems like IDV has an issue with the pairs.nc
file.

R/
John
________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, February 03, 2020 2:34 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

I forgot to attached the pairs.nc file on mt previous email, so it's
attached on this one.

R/
John
________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, February 03, 2020 2:32 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

I just ran MET V8.1.1 using a WRF output file and the NetCDF gridded
obs file and it ran with one warning:

WARNING:
WARNING: process_scores() -> Forecast and observation valid times do
not match 20120207_180000 != 20200129_211537 for TMP/Z2 versus
TEMP_15(0,*,*).
WARNING:

I know that the valid time of the observations is the same as the
fcst, but something is inserting the current date/time in the file.
Can I use ncatted to edit the valid time?

Grid-Stat produced the expected output which included the pairs.nc
file. When I try to plot the pairs.nc file, IDV has an error "no
gridded data found". I'll try plotting it using plot_data_plane.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, February 03, 2020 1:05 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Just an update to let you know that I was able to load a module on the
HPC which enables the use of the NCO tools including ncatted. I used
the command you provided to edit the attributes of my NetCDF file and
it ran successfully. I was able to use your plot_data_plan command
from MET V8.1.1 to plot the output file and it did so successfully.
The plot was identical to yours.

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Next step: Run MET Grid-Stat using the edited NetCDF file (obs file)
and a WRF output file (fcst file) valid at the same time to see if I
can get some verification results.

Thanks for providing the work around to make the file compatible with
MET.

R/
John

________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Thursday, January 30, 2020 2:43 PM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

John -

Quick question. Why do you use "degrees_east" when the location of the
data is west longitude?

Thanks.

R/
John
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, January 30, 2020 11:31 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.

----

John,

I did take a look at the file you sent with MET version 8.1.2.  I
tried
running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and got
the
same error messages you did.

Running the following ncatted command makes MET happy with this file.
Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".

*ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000 UTC"
-a
units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
1km_grid_obs_test_29JAN2020.nc -o 1km_grid_obs_test_29JAN2020_NEW.nc*

*plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*

The resulting image is attached.

While looking into this I found that MET is not parsing all the
supported
variants of time units listed here:
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#time-coordinate

"The acceptable units for time are listed in the udunits.dat
<Caution-http://www.unidata.ucar.edu/software/udunits/> file. The most
commonly
used of these strings (and their abbreviations) includes *day (d)*,
*hour
(hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are also
acceptable."

Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".  I
created this GitHub issue to update met-9.0 to handle all the other
variants:
Caution-https://github.com/NCAR/MET/issues/1245

The latitude and longitude dimensions really do need to have the
expected
units (degrees_north and degrees_east, resp):
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#latitude-coordinate
Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate

Thanks,
John

On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Minna -
>
> Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> result.
>
> R/
> John
>
> -----Original Message-----
> From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 9:30 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET
> V5.2 Grid-Stat
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> It looks like you are attempting to run Grid-stat using MET v5.2.
If that
> is
> the case, you should update to the latest version of MET, which is
> currently
> MET v8.1.1.  I hope that resolves your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
>
>
>
> On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: Request assist with MET V5.2 Grid-Stat
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> >
> > I tried to run Grid-Stat using a single post-processed WRF output
file
> > and a NetCDF gridded observation file which I generated using
Unidata
> > IDV. The error dialog from the log file seems to indicate a
problem
> > wit the obs file, but I'm not sure how to resolve the issue. Could
you
> > take a look at the attached files to see if you can see wha tthe
problem
> is?
> >
> > Attached "IDV_test" file contains the run commands I used and the
log
> > output.
> > Also attached are the NetCDF obs file and the config file.
> >
> > Thanks.
> >
> > R/
> > John
> >
> >
> >
> >
> > Mr John W. Raby, Meteorologist
> >
> > U.S. Army Research Laboratory
> >
> > White Sands Missile Range, NM 88002
> >
> > (575) 678-2004 DSN 258-2004
> >
> > FAX (575) 678-1230 DSN 258-1230
> >
> > Email: john.w.raby2.civ at mail.mil<Caution-Caution-
mailto:john.raby at us.army.mil>
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: Request assist with MET V5.2 Grid-Stat
From: John Halley Gotway
Time: Tue Feb 04 13:10:28 2020

John,

I ran the following command to dump the longitude values from your
file:

 ncdump -v Longitude 1km_grid_obs_test_29JAN2020.nc
...
Longitude = -117.46, -117.4493, -117.4386, -117.4279, -117.4172,
-117.4064,
...

I assume your data is over the CONUS.  The prime meridian (through
Greenwich, England) has longitude 0.  Relative to the prime meridian,
you
can either define positive longitude values in the east direction
(i.e.
degrees_east) or the west direction (i.e. degrees_west).  The very
widely
used convention for this is degrees_east, meaning longitudes over
Europe
are positive and longitudes over the CONUS are negative.

Make sense?

Thanks,
John

On Mon, Feb 3, 2020 at 3:34 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> I successfully used MET V8.1.1 plot_data_plane to plot the pair.nc
output
> of Grid-Stat. Seems like IDV has an issue with the pairs.nc file.
>
> R/
> John
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, February 03, 2020 2:34 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> I forgot to attached the pairs.nc file on mt previous email, so it's
> attached on this one.
>
> R/
> John
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, February 03, 2020 2:32 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> John -
>
> I just ran MET V8.1.1 using a WRF output file and the NetCDF gridded
obs
> file and it ran with one warning:
>
> WARNING:
> WARNING: process_scores() -> Forecast and observation valid times do
not
> match 20120207_180000 != 20200129_211537 for TMP/Z2 versus
TEMP_15(0,*,*).
> WARNING:
>
> I know that the valid time of the observations is the same as the
fcst,
> but something is inserting the current date/time in the file. Can I
use
> ncatted to edit the valid time?
>
> Grid-Stat produced the expected output which included the pairs.nc
file.
> When I try to plot the pairs.nc file, IDV has an error "no gridded
data
> found". I'll try plotting it using plot_data_plane.
>
> R/
> John
>
>
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, February 03, 2020 1:05 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> John -
>
> Just an update to let you know that I was able to load a module on
the HPC
> which enables the use of the NCO tools including ncatted. I used the
> command you provided to edit the attributes of my NetCDF file and it
ran
> successfully. I was able to use your plot_data_plan command from MET
V8.1.1
> to plot the output file and it did so successfully. The plot was
identical
> to yours.
>
> Quick question. Why do you use "degrees_east" when the location of
the
> data is west longitude?
>
> Next step: Run MET Grid-Stat using the edited NetCDF file (obs file)
and a
> WRF output file (fcst file) valid at the same time to see if I can
get some
> verification results.
>
> Thanks for providing the work around to make the file compatible
with MET.
>
> R/
> John
>
>
>
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Thursday, January 30, 2020 2:43 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> John -
>
> Quick question. Why do you use "degrees_east" when the location of
the
> data is west longitude?
>
> Thanks.
>
> R/
> John
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 11:31 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John,
>
> I did take a look at the file you sent with MET version 8.1.2.  I
tried
> running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc) and
got the
> same error messages you did.
>
> Running the following ncatted command makes MET happy with this
file.
> Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".
>
> *ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000
UTC" -a
> units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
> 1km_grid_obs_test_29JAN2020.nc -o
1km_grid_obs_test_29JAN2020_NEW.nc*
>
> *plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
> 1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*
>
> The resulting image is attached.
>
> While looking into this I found that MET is not parsing all the
supported
> variants of time units listed here:
> Caution-
> http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#time-coordinate
>
> "The acceptable units for time are listed in the udunits.dat
> <Caution-http://www.unidata.ucar.edu/software/udunits/> file. The
most
> commonly
> used of these strings (and their abbreviations) includes *day (d)*,
*hour
> (hr, h)*, *minute (min)* and *second (sec, s)*. Plural forms are
also
> acceptable."
>
> Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".
> I
> created this GitHub issue to update met-9.0 to handle all the other
> variants:
> Caution-https://github.com/NCAR/MET/issues/1245
>
> The latitude and longitude dimensions really do need to have the
expected
> units (degrees_north and degrees_east, resp):
> Caution-
> http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#latitude-coordinate
>
> Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.7/cf-conventions.html#longitude-coordinate
> <http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html#latitude-coordinateCaution-
http://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.html%23longitude-coordinate>
>
> Thanks,
> John
>
> On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url: Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Minna -
> >
> > Thanks for your reply. I will try with MET V8.1.1 and let you know
the
> > result.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: Minna Win via RT [Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, January 30, 2020 9:30 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist
> > with MET
> > V5.2 Grid-Stat
> >
> > All active links contained in this email were disabled.  Please
verify
> the
> > identity of the sender, and confirm the authenticity of all links
> > contained
> > within the message prior to copying and pasting the address to a
Web
> > browser.
> >
> >
> >
> >
> > ----
> >
> > Hello John,
> >
> > It looks like you are attempting to run Grid-stat using MET v5.2.
If
> that
> > is
> > the case, you should update to the latest version of MET, which is
> > currently
> > MET v8.1.1.  I hope that resolves your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> >
> >
> >
> > On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > >        Queue: met_help
> > >      Subject: Request assist with MET V5.2 Grid-Stat
> > >        Owner: Nobody
> > >   Requestors: john.w.raby2.civ at mail.mil
> > >       Status: new
> > >  Ticket <Caution-Caution-url:
> > > Caution-Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> > >
> > >
> > > I tried to run Grid-Stat using a single post-processed WRF
output file
> > > and a NetCDF gridded observation file which I generated using
Unidata
> > > IDV. The error dialog from the log file seems to indicate a
problem
> > > wit the obs file, but I'm not sure how to resolve the issue.
Could you
> > > take a look at the attached files to see if you can see wha tthe
> problem
> > is?
> > >
> > > Attached "IDV_test" file contains the run commands I used and
the log
> > > output.
> > > Also attached are the NetCDF obs file and the config file.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > >
> > >
> > >
> > > Mr John W. Raby, Meteorologist
> > >
> > > U.S. Army Research Laboratory
> > >
> > > White Sands Missile Range, NM 88002
> > >
> > > (575) 678-2004 DSN 258-2004
> > >
> > > FAX (575) 678-1230 DSN 258-1230
> > >
> > > Email: john.w.raby2.civ at mail.mil<Caution-Caution-mailto:
> john.raby at us.army.mil>
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
>
>
>

------------------------------------------------
Subject: Request assist with MET V5.2 Grid-Stat
From: Raby, John W USA CIV
Time: Tue Feb 04 16:21:34 2020

CLASSIFICATION: UNCLASSIFIED

John -

Yes, my data was over the S. California area. Understand about the
degrees_east convention now. I'm already familiar with the fact that
western
longitudes are always negative. I just had not come across the
degrees_east
nomenclature before.
R/
John

-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, February 4, 2020 1:10 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
assist with
MET V5.2 Grid-Stat (UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.

----

John,

I ran the following command to dump the longitude values from your
file:

 ncdump -v Longitude 1km_grid_obs_test_29JAN2020.nc ...
Longitude = -117.46, -117.4493, -117.4386, -117.4279, -117.4172,
-117.4064,
...

I assume your data is over the CONUS.  The prime meridian (through
Greenwich,
England) has longitude 0.  Relative to the prime meridian, you can
either
define positive longitude values in the east direction (i.e.
degrees_east) or the west direction (i.e. degrees_west).  The very
widely used
convention for this is degrees_east, meaning longitudes over Europe
are
positive and longitudes over the CONUS are negative.

Make sense?

Thanks,
John

On Mon, Feb 3, 2020 at 3:34 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
>
> I successfully used MET V8.1.1 plot_data_plane to plot the pair.nc
> output of Grid-Stat. Seems like IDV has an issue with the pairs.nc
file.
>
> R/
> John
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, February 03, 2020 2:34 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
> assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> I forgot to attached the pairs.nc file on mt previous email, so it's
> attached on this one.
>
> R/
> John
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, February 03, 2020 2:32 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
> assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> John -
>
> I just ran MET V8.1.1 using a WRF output file and the NetCDF gridded
> obs file and it ran with one warning:
>
> WARNING:
> WARNING: process_scores() -> Forecast and observation valid times do
> not match 20120207_180000 != 20200129_211537 for TMP/Z2 versus
> TEMP_15(0,*,*).
> WARNING:
>
> I know that the valid time of the observations is the same as the
> fcst, but something is inserting the current date/time in the file.
> Can I use ncatted to edit the valid time?
>
> Grid-Stat produced the expected output which included the pairs.nc
file.
> When I try to plot the pairs.nc file, IDV has an error "no gridded
> data found". I'll try plotting it using plot_data_plane.
>
> R/
> John
>
>
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, February 03, 2020 1:05 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
> assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> John -
>
> Just an update to let you know that I was able to load a module on
the
> HPC which enables the use of the NCO tools including ncatted. I used
> the command you provided to edit the attributes of my NetCDF file
and
> it ran successfully. I was able to use your plot_data_plan command
> from MET V8.1.1 to plot the output file and it did so successfully.
> The plot was identical to yours.
>
> Quick question. Why do you use "degrees_east" when the location of
the
> data is west longitude?
>
> Next step: Run MET Grid-Stat using the edited NetCDF file (obs file)
> and a WRF output file (fcst file) valid at the same time to see if I
> can get some verification results.
>
> Thanks for providing the work around to make the file compatible
with MET.
>
> R/
> John
>
>
>
> ________________________________________
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Thursday, January 30, 2020 2:43 PM
> To: met_help at ucar.edu
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
> assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> John -
>
> Quick question. Why do you use "degrees_east" when the location of
the
> data is west longitude?
>
> Thanks.
>
> R/
> John
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, January 30, 2020 11:31 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
> assist with MET V5.2 Grid-Stat (UNCLASSIFIED)
>
> All active links contained in this email were disabled.  Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> John,
>
> I did take a look at the file you sent with MET version 8.1.2.  I
> tried running plot_data_plane on it (1km_grid_obs_test_29JAN2020.nc)
> and got the same error messages you did.
>
> Running the following ncatted command makes MET happy with this
file.
> Changing "s" to "seconds" and "deg" to "degrees_north" and
"degrees_east".
>
> *ncatted -a units,time,o,c,"seconds since 1970-01-01 00:00:00.000
UTC"
> -a units,Latitude,o,c,"degrees_north" -a
units,Longitude,o,c,"degrees_east"
> 1km_grid_obs_test_29JAN2020.nc -o
1km_grid_obs_test_29JAN2020_NEW.nc*
>
> *plot_data_plane 1km_grid_obs_test_29JAN2020_NEW.nc
> 1km_grid_obs_test_29JAN2020.ps 'name ="TEMP_15"; level="(0,*,*)";'*
>
> The resulting image is attached.
>
> While looking into this I found that MET is not parsing all the
> supported variants of time units listed here:
> Caution-
> Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.
> 7/cf-conventions.html#time-coordinate
>
> "The acceptable units for time are listed in the udunits.dat
> <Caution-Caution-http://www.unidata.ucar.edu/software/udunits/>
file.
> The most commonly used of these strings (and their abbreviations)
> includes *day (d)*, *hour (hr, h)*, *minute (min)* and *second (sec,
> s)*. Plural forms are also acceptable."
>
> Currently, MET is only parsing "seconds", "minutes", "hours", and
"days".
> I
> created this GitHub issue to update met-9.0 to handle all the other
> variants:
> Caution-Caution-https://github.com/NCAR/MET/issues/1245
>
> The latitude and longitude dimensions really do need to have the
> expected units (degrees_north and degrees_east, resp):
> Caution-
> Caution-http://cfconventions.org/Data/cf-conventions/cf-conventions-
1.
> 7/cf-conventions.html#latitude-coordinate
>
> Caution-Caution-http://cfconventions.org/Data/cf-conventions/cf-
conven
> tions-1.7/cf-conventions.html#longitude-coordinate
> <Caution-http://cfconventions.org/Data/cf-conventions/cf-
conventions-1
> .7/cf-conventions.html#latitude-coordinateCaution-Caution-
http://cfcon
> ventions.org/Data/cf-conventions/cf-conventions-1.7/cf-
conventions.htm
> l%23longitude-coordinate>
>
> Thanks,
> John
>
> On Thu, Jan 30, 2020 at 9:54 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-Caution-url: Caution-
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Minna -
> >
> > Thanks for your reply. I will try with MET V8.1.1 and let you know
> > the result.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: Minna Win via RT [Caution-Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, January 30, 2020 9:30 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #93980] Request
> > assist with MET
> > V5.2 Grid-Stat
> >
> > All active links contained in this email were disabled.  Please
> > verify
> the
> > identity of the sender, and confirm the authenticity of all links
> > contained within the message prior to copying and pasting the
> > address to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Hello John,
> >
> > It looks like you are attempting to run Grid-stat using MET v5.2.
> > If
> that
> > is
> > the case, you should update to the latest version of MET, which is
> > currently MET v8.1.1.  I hope that resolves your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> >
> >
> >
> > On Wed, Jan 29, 2020 at 4:35 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed Jan 29 16:34:33 2020: Request 93980 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > >        Queue: met_help
> > >      Subject: Request assist with MET V5.2 Grid-Stat
> > >        Owner: Nobody
> > >   Requestors: john.w.raby2.civ at mail.mil
> > >       Status: new
> > >  Ticket <Caution-Caution-Caution-url:
> > > Caution-Caution-
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93980 >
> > >
> > >
> > > I tried to run Grid-Stat using a single post-processed WRF
output
> > > file and a NetCDF gridded observation file which I generated
using
> > > Unidata IDV. The error dialog from the log file seems to
indicate
> > > a problem wit the obs file, but I'm not sure how to resolve the
> > > issue. Could you take a look at the attached files to see if you
> > > can see wha tthe
> problem
> > is?
> > >
> > > Attached "IDV_test" file contains the run commands I used and
the
> > > log output.
> > > Also attached are the NetCDF obs file and the config file.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > >
> > >
> > >
> > > Mr John W. Raby, Meteorologist
> > >
> > > U.S. Army Research Laboratory
> > >
> > > White Sands Missile Range, NM 88002
> > >
> > > (575) 678-2004 DSN 258-2004
> > >
> > > FAX (575) 678-1230 DSN 258-1230
> > >
> > > Email: john.w.raby2.civ at mail.mil<Caution-Caution-Caution-mailto:
> john.raby at us.army.mil>
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
>
>
>

CLASSIFICATION: UNCLASSIFIED

------------------------------------------------