[Met_help] [rt.rap.ucar.edu #96104] History for trouble reading NetCDF observation (UNCLASSIFIED)
John Halley Gotway via RT
met_help at ucar.edu
Fri Aug 21 14:45:15 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
CLASSIFICATION: UNCLASSIFIED
I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a gridded
radar observation in NetCDF format. The variable I'm trying to verify is the
column max reflectivity which is a 2-D variable named "CM". The attached log
file shows that an error occurs due to inability to figure out the
projection from the info in the file. Could you take a look to see what the
issue is and why it can't get the projection info? I tried to attach the
observation file, but it's too big. I can provide the fila via a download
link sent to your email address.
Thanks.
R/
John
Mr. John W. Raby
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
Office:(575) 678-2004 DSN 258-2004
Teleworking: Contact Admin Specialist at (410) 278-6974
FAX (575) 678-1230 DSN 258-1230
Email: john.w.raby2.civ at mail.mil
CLASSIFICATION: UNCLASSIFIED
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: John Halley Gotway
Time: Mon Aug 03 13:24:15 2020
Hello John,
Yes, I'd need to take a look at your NetCDF file. If you're able to
ftp it,
you could post it here:
https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
Otherwise, posting it somewhere else is fine.
John
On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
> Queue: met_help
> Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> Owner: Nobody
> Requestors: john.w.raby2.civ at mail.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
>
> CLASSIFICATION: UNCLASSIFIED
>
> I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
gridded
> radar observation in NetCDF format. The variable I'm trying to
verify is
> the
> column max reflectivity which is a 2-D variable named "CM". The
attached
> log
> file shows that an error occurs due to inability to figure out the
> projection from the info in the file. Could you take a look to see
what the
> issue is and why it can't get the projection info? I tried to
attach the
> observation file, but it's too big. I can provide the fila via a
download
> link sent to your email address.
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon Aug 03 13:27:37 2020
CLASSIFICATION: UNCLASSIFIED
Hi John -
Thanks. I'll send you a link to download the file.
R/
John
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, August 3, 2020 1:24 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble reading
NetCDF
observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
Hello John,
Yes, I'd need to take a look at your NetCDF file. If you're able to
ftp it,
you could post it here:
Caution-https://dtcenter.org/community-code/model-evaluation-tools-
met/met-help-desk#ftp
Otherwise, posting it somewhere else is fine.
John
On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
> Queue: met_help
> Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> Owner: Nobody
> Requestors: john.w.raby2.civ at mail.mil
> Status: new
> Ticket <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
>
> CLASSIFICATION: UNCLASSIFIED
>
> I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> gridded radar observation in NetCDF format. The variable I'm trying
to
> verify is the column max reflectivity which is a 2-D variable named
> "CM". The attached log file shows that an error occurs due to
> inability to figure out the projection from the info in the file.
> Could you take a look to see what the issue is and why it can't get
> the projection info? I tried to attach the observation file, but
it's
> too big. I can provide the fila via a download link sent to your
email
> address.
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: John Halley Gotway
Time: Wed Aug 05 10:21:06 2020
John,
Sorry for the delay on this. I ran into some bad luck, having my dog
chew
up a charging cable. I'm back up and running today and am downloading
your
sample file over my very slow internet. I'll let you know what I find.
John HG
On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi John -
>
> Thanks. I'll send you a link to download the file.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, August 3, 2020 1:24 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF
> observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hello John,
>
> Yes, I'd need to take a look at your NetCDF file. If you're able to
ftp
> it,
> you could post it here:
> Caution-
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>
> Otherwise, posting it somewhere else is fine.
>
> John
>
> On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > Queue: met_help
> > Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> > Owner: Nobody
> > Requestors: john.w.raby2.civ at mail.mil
> > Status: new
> > Ticket <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> > gridded radar observation in NetCDF format. The variable I'm
trying to
> > verify is the column max reflectivity which is a 2-D variable
named
> > "CM". The attached log file shows that an error occurs due to
> > inability to figure out the projection from the info in the file.
> > Could you take a look to see what the issue is and why it can't
get
> > the projection info? I tried to attach the observation file, but
it's
> > too big. I can provide the fila via a download link sent to your
email
> > address.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Wed Aug 05 10:43:25 2020
CLASSIFICATION: UNCLASSIFIED
John -
Thanks for the update. Sorry to hear about your bad luck with the
charging
cable.
R/
John
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Wednesday, August 5, 2020 10:21 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
John,
Sorry for the delay on this. I ran into some bad luck, having my dog
chew up a
charging cable. I'm back up and running today and am downloading your
sample
file over my very slow internet. I'll let you know what I find.
John HG
On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi John -
>
> Thanks. I'll send you a link to download the file.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, August 3, 2020 1:24 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hello John,
>
> Yes, I'd need to take a look at your NetCDF file. If you're able to
> ftp it, you could post it here:
> Caution-
> Caution-https://dtcenter.org/community-code/model-evaluation-tools-
met
> /met-help-desk#ftp
>
> Otherwise, posting it somewhere else is fine.
>
> John
>
> On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > Queue: met_help
> > Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> > Owner: Nobody
> > Requestors: john.w.raby2.civ at mail.mil
> > Status: new
> > Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > 104 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> > gridded radar observation in NetCDF format. The variable I'm
trying
> > to verify is the column max reflectivity which is a 2-D variable
> > named "CM". The attached log file shows that an error occurs due
to
> > inability to figure out the projection from the info in the file.
> > Could you take a look to see what the issue is and why it can't
get
> > the projection info? I tried to attach the observation file, but
> > it's too big. I can provide the fila via a download link sent to
> > your email address.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: huaqing.cai.civ at mail.mil
Time: Tue Aug 11 11:06:59 2020
Hi, John HG,
Hope this email finds you well. I am sorry for your dog. He/she must
be bored
for stay-at-home so long as well.
I should have mentioned to you earlier that the radar netcdf file was
created
by the latest NCAR radx software (Mike Dixon and his team wrote it).
For
netcdf output file types, we selected the classic options, which is
the option
that worked before. There are several other output netcdf options
available.
You might want to talk to Mike in case you have any questions.
Thanks so much for your help. Take care and stay safe.
Best,
Huaqing
********************************
Dr. Huaqing Cai
Research Meteorologist
US Army Research Laboratory
White Sands Missile Range, NM 88002
Phone: 575 678-1524 (O)
575 621-7949 (C)
********************************
-----Original Message-----
From: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
Sent: Tuesday, August 11, 2020 9:39 AM
To: Cai, Huaqing CIV USARMY CCDC ARL (USA) <huaqing.cai.civ at mail.mil>
Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
CLASSIFICATION: UNCLASSIFIED
Hi Huaqing -
You mentioned the possibility of contacting John about the issue with
MET
Grid-Stat reading the new RADX output. The email bellow is the last
email I
received from John. I think you can just reply with [rt.rap.ucar.edu
#96104]
in the subj and it will continue the thread for this ticket.
R/
John
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Wednesday, August 5, 2020 10:21 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
John,
Sorry for the delay on this. I ran into some bad luck, having my dog
chew up a
charging cable. I'm back up and running today and am downloading your
sample
file over my very slow internet. I'll let you know what I find.
John HG
On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi John -
>
> Thanks. I'll send you a link to download the file.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, August 3, 2020 1:24 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hello John,
>
> Yes, I'd need to take a look at your NetCDF file. If you're able to
> ftp it, you could post it here:
> Caution-
> Caution-https://dtcenter.org/community-code/model-evaluation-tools-
met
> /met-help-desk#ftp
>
> Otherwise, posting it somewhere else is fine.
>
> John
>
> On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > Queue: met_help
> > Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> > Owner: Nobody
> > Requestors: john.w.raby2.civ at mail.mil
> > Status: new
> > Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > 104 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> > gridded radar observation in NetCDF format. The variable I'm
trying
> > to verify is the column max reflectivity which is a 2-D variable
> > named "CM". The attached log file shows that an error occurs due
to
> > inability to figure out the projection from the info in the file.
> > Could you take a look to see what the issue is and why it can't
get
> > the projection info? I tried to attach the observation file, but
> > it's too big. I can provide the fila via a download link sent to
> > your email address.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: huaqing.cai.civ at mail.mil
Time: Wed Aug 12 08:39:13 2020
Hi, John HG,
I realized that the info about the netcdf files we provided to you are
not
100% accurate. Those files were originally created by RADX, then read
by
matlab to calculate and add composite reflectivity to the file, then
output as
netcdf by matlab.
Basically we just add one more field to the original netcdf file. It
seems MET
had trouble read this file. On the other hand, the original netcdf
created by
RADX CAN be read by MET.
If you want, I can email you the matlab script I used to create those
netcdf
files.
Thanks
Huaqing
********************************
Dr. Huaqing Cai
Research Meteorologist
US Army Research Laboratory
White Sands Missile Range, NM 88002
Phone: 575 678-1524 (O)
575 621-7949 (C)
********************************
-----Original Message-----
From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
Sent: Tuesday, August 11, 2020 11:05 AM
To: 'met_help at ucar.edu' <met_help at ucar.edu>
Cc: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
Hi, John HG,
Hope this email finds you well. I am sorry for your dog. He/she must
be bored
for stay-at-home so long as well.
I should have mentioned to you earlier that the radar netcdf file was
created
by the latest NCAR radx software (Mike Dixon and his team wrote it).
For
netcdf output file types, we selected the classic options, which is
the option
that worked before. There are several other output netcdf options
available.
You might want to talk to Mike in case you have any questions.
Thanks so much for your help. Take care and stay safe.
Best,
Huaqing
********************************
Dr. Huaqing Cai
Research Meteorologist
US Army Research Laboratory
White Sands Missile Range, NM 88002
Phone: 575 678-1524 (O)
575 621-7949 (C)
********************************
-----Original Message-----
From: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
Sent: Tuesday, August 11, 2020 9:39 AM
To: Cai, Huaqing CIV USARMY CCDC ARL (USA) <huaqing.cai.civ at mail.mil>
Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
CLASSIFICATION: UNCLASSIFIED
Hi Huaqing -
You mentioned the possibility of contacting John about the issue with
MET
Grid-Stat reading the new RADX output. The email bellow is the last
email I
received from John. I think you can just reply with [rt.rap.ucar.edu
#96104]
in the subj and it will continue the thread for this ticket.
R/
John
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Wednesday, August 5, 2020 10:21 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
John,
Sorry for the delay on this. I ran into some bad luck, having my dog
chew up a
charging cable. I'm back up and running today and am downloading your
sample
file over my very slow internet. I'll let you know what I find.
John HG
On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi John -
>
> Thanks. I'll send you a link to download the file.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, August 3, 2020 1:24 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hello John,
>
> Yes, I'd need to take a look at your NetCDF file. If you're able to
> ftp it, you could post it here:
> Caution-
> Caution-https://dtcenter.org/community-code/model-evaluation-tools-
met
> /met-help-desk#ftp
>
> Otherwise, posting it somewhere else is fine.
>
> John
>
> On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > Queue: met_help
> > Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> > Owner: Nobody
> > Requestors: john.w.raby2.civ at mail.mil
> > Status: new
> > Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > 104 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> > gridded radar observation in NetCDF format. The variable I'm
trying
> > to verify is the column max reflectivity which is a 2-D variable
> > named "CM". The attached log file shows that an error occurs due
to
> > inability to figure out the projection from the info in the file.
> > Could you take a look to see what the issue is and why it can't
get
> > the projection info? I tried to attach the observation file, but
> > it's too big. I can provide the fila via a download link sent to
> > your email address.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: John Halley Gotway
Time: Thu Aug 13 11:54:43 2020
John and Huaqing,
Thanks for sending this data. Unfortunately, I didn't get a chance to
dig
into the details before heading out of town. But I'll be back from PTO
on
Monday.
Thanks,
John
On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> Hi, John HG,
>
> I realized that the info about the netcdf files we provided to you
are not
> 100% accurate. Those files were originally created by RADX, then
read by
> matlab to calculate and add composite reflectivity to the file, then
> output as
> netcdf by matlab.
> Basically we just add one more field to the original netcdf file. It
seems
> MET
> had trouble read this file. On the other hand, the original netcdf
created
> by
> RADX CAN be read by MET.
>
> If you want, I can email you the matlab script I used to create
those
> netcdf
> files.
>
> Thanks
>
> Huaqing
>
>
> ********************************
> Dr. Huaqing Cai
> Research Meteorologist
> US Army Research Laboratory
> White Sands Missile Range, NM 88002
> Phone: 575 678-1524 (O)
> 575 621-7949 (C)
> ********************************
>
>
> -----Original Message-----
> From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> Sent: Tuesday, August 11, 2020 11:05 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Cc: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading
> NetCDF observation (UNCLASSIFIED)
>
> Hi, John HG,
>
> Hope this email finds you well. I am sorry for your dog. He/she must
be
> bored
> for stay-at-home so long as well.
>
> I should have mentioned to you earlier that the radar netcdf file
was
> created
> by the latest NCAR radx software (Mike Dixon and his team wrote it).
For
> netcdf output file types, we selected the classic options, which is
the
> option
> that worked before. There are several other output netcdf options
> available.
> You might want to talk to Mike in case you have any questions.
>
> Thanks so much for your help. Take care and stay safe.
>
> Best,
>
> Huaqing
>
>
> ********************************
> Dr. Huaqing Cai
> Research Meteorologist
> US Army Research Laboratory
> White Sands Missile Range, NM 88002
> Phone: 575 678-1524 (O)
> 575 621-7949 (C)
> ********************************
>
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Sent: Tuesday, August 11, 2020 9:39 AM
> To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
<huaqing.cai.civ at mail.mil>
> Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi Huaqing -
>
> You mentioned the possibility of contacting John about the issue
with MET
> Grid-Stat reading the new RADX output. The email bellow is the last
email I
> received from John. I think you can just reply with [rt.rap.ucar.edu
> #96104]
> in the subj and it will continue the thread for this ticket.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Wednesday, August 5, 2020 10:21 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John,
>
> Sorry for the delay on this. I ran into some bad luck, having my dog
chew
> up a
> charging cable. I'm back up and running today and am downloading
your
> sample
> file over my very slow internet. I'll let you know what I find.
>
> John HG
>
> On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Hi John -
> >
> > Thanks. I'll send you a link to download the file.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Monday, August 3, 2020 1:24 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> > NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
verify
> > the identity of the sender, and confirm the authenticity of all
links
> > contained within the message prior to copying and pasting the
address
> > to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Hello John,
> >
> > Yes, I'd need to take a look at your NetCDF file. If you're able
to
> > ftp it, you could post it here:
> > Caution-
> > Caution-https://dtcenter.org/community-code/model-evaluation-
tools-met
> > /met-help-desk#ftp
> >
> > Otherwise, posting it somewhere else is fine.
> >
> > John
> >
> > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > Queue: met_help
> > > Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> > > Owner: Nobody
> > > Requestors: john.w.raby2.civ at mail.mil
> > > Status: new
> > > Ticket <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > > 104 >
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> > > gridded radar observation in NetCDF format. The variable I'm
trying
> > > to verify is the column max reflectivity which is a 2-D variable
> > > named "CM". The attached log file shows that an error occurs due
to
> > > inability to figure out the projection from the info in the
file.
> > > Could you take a look to see what the issue is and why it can't
get
> > > the projection info? I tried to attach the observation file,
but
> > > it's too big. I can provide the fila via a download link sent to
> > > your email address.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Tue Aug 18 08:53:04 2020
CLASSIFICATION: UNCLASSIFIED
John -
Just wanted to touch base on any findings on the problem with the
radar obs
which is preventing Grid-Stat from getting the projection info.
Thanks.
R/
John
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Thursday, August 13, 2020 11:55 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
John and Huaqing,
Thanks for sending this data. Unfortunately, I didn't get a chance to
dig into
the details before heading out of town. But I'll be back from PTO on
Monday.
Thanks,
John
On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT <
met_help at ucar.edu> wrote:
>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> Hi, John HG,
>
> I realized that the info about the netcdf files we provided to you
are
> not 100% accurate. Those files were originally created by RADX, then
> read by matlab to calculate and add composite reflectivity to the
> file, then output as netcdf by matlab.
> Basically we just add one more field to the original netcdf file. It
> seems MET had trouble read this file. On the other hand, the
original
> netcdf created by RADX CAN be read by MET.
>
> If you want, I can email you the matlab script I used to create
those
> netcdf files.
>
> Thanks
>
> Huaqing
>
>
> ********************************
> Dr. Huaqing Cai
> Research Meteorologist
> US Army Research Laboratory
> White Sands Missile Range, NM 88002
> Phone: 575 678-1524 (O)
> 575 621-7949 (C)
> ********************************
>
>
> -----Original Message-----
> From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> Sent: Tuesday, August 11, 2020 11:05 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Cc: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading NetCDF observation (UNCLASSIFIED)
>
> Hi, John HG,
>
> Hope this email finds you well. I am sorry for your dog. He/she must
> be bored for stay-at-home so long as well.
>
> I should have mentioned to you earlier that the radar netcdf file
was
> created by the latest NCAR radx software (Mike Dixon and his team
> wrote it). For netcdf output file types, we selected the classic
> options, which is the option that worked before. There are several
> other output netcdf options available.
> You might want to talk to Mike in case you have any questions.
>
> Thanks so much for your help. Take care and stay safe.
>
> Best,
>
> Huaqing
>
>
> ********************************
> Dr. Huaqing Cai
> Research Meteorologist
> US Army Research Laboratory
> White Sands Missile Range, NM 88002
> Phone: 575 678-1524 (O)
> 575 621-7949 (C)
> ********************************
>
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> <john.w.raby2.civ at mail.mil>
> Sent: Tuesday, August 11, 2020 9:39 AM
> To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
<huaqing.cai.civ at mail.mil>
> Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading NetCDF observation (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi Huaqing -
>
> You mentioned the possibility of contacting John about the issue
with
> MET Grid-Stat reading the new RADX output. The email bellow is the
> last email I received from John. I think you can just reply with
> [rt.rap.ucar.edu #96104] in the subj and it will continue the thread
> for this ticket.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Wednesday, August 5, 2020 10:21 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> John,
>
> Sorry for the delay on this. I ran into some bad luck, having my dog
> chew up a charging cable. I'm back up and running today and am
> downloading your sample file over my very slow internet. I'll let
you
> know what I find.
>
> John HG
>
> On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > 104 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Hi John -
> >
> > Thanks. I'll send you a link to download the file.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Monday, August 3, 2020 1:24 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify the identity of the sender, and confirm the authenticity of
> > all links contained within the message prior to copying and
pasting
> > the address to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Hello John,
> >
> > Yes, I'd need to take a look at your NetCDF file. If you're able
to
> > ftp it, you could post it here:
> > Caution-
> > Caution-Caution-https://dtcenter.org/community-code/model-
evaluation
> > -tools-met
> > /met-help-desk#ftp
> >
> > Otherwise, posting it somewhere else is fine.
> >
> > John
> >
> > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > Queue: met_help
> > > Subject: trouble reading NetCDF observation (UNCLASSIFIED)
> > > Owner: Nobody
> > > Requestors: john.w.raby2.civ at mail.mil
> > > Status: new
> > > Ticket <Caution-Caution-Caution-url:
> > > Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > html?id=96
> > > 104 >
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and a
> > > gridded radar observation in NetCDF format. The variable I'm
> > > trying to verify is the column max reflectivity which is a 2-D
> > > variable named "CM". The attached log file shows that an error
> > > occurs due to inability to figure out the projection from the
info in
> > > the file.
> > > Could you take a look to see what the issue is and why it can't
> > > get the projection info? I tried to attach the observation
file,
> > > but it's too big. I can provide the fila via a download link
sent
> > > to your email address.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: John Halley Gotway
Time: Thu Aug 20 13:59:39 2020
John,
I can confirm that I am able to replicate this behavior:
*> plot_data_plane ncf_20200315_055801.nc
<http://ncf_20200315_055801.nc>
ZZ.ps 'name="ZZ"; level="(0,0,*,*)";' -v 10*
*ERROR : NcCfFile::read_netcdf_grid() -> Couldn't figure out
projection
from information in netCDF file.*
I apologize for the very long delay in diagnosing this. I'm not able
to get
my debugger to work from home and that has slowed me down a lot.
Adding some print statements, I find that the "CM" variable is causing
the
problem. When I delete that variable, or simple add in the
"grid_mapping"
attribute, then MET is able to read this data just fine:
float CM(y0, x0) ;
CM:_FillValue = -9999.f ;
CM:long_name = "CZ column maximum" ;
CM:units = "unknown" ;
* CM:grid_mapping = "grid_mapping_0" ;*
I'm actually a bit surprised about this. It appears the library code
inventories all the variables, and tries to parse the projection
information for any variable that uses the 2 gridded dimensions.
Hopefully this will be any easy change.
plot_data_plane ncf_20200315_055801_MOD.nc ZZ.ps 'name="ZZ";
level="(0,0,*,*)";'
And here's the output for that:
[image: ZZ.png]
I was curious where this data lives on earth, so I regridded it to a
global
domain and plotted the result:
regrid_data_plane ncf_20200315_055801_MOD.nc G003 regrid.nc -field
'name="ZZ"; level="(0,0,*,*)";'
plot_data_plane regrid.nc regrid.ps 'name="ZZ";level="(*,*)";'
And the resulting image shows this data in the Pacific roughly between
Hawaii and Australia. Is that the correct location?
[image: regrid.png]
Thanks,
John
On Tue, Aug 18, 2020 at 8:53 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> John -
>
> Just wanted to touch base on any findings on the problem with the
radar
> obs
> which is preventing Grid-Stat from getting the projection info.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Thursday, August 13, 2020 11:55 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John and Huaqing,
>
> Thanks for sending this data. Unfortunately, I didn't get a chance
to dig
> into
> the details before heading out of town. But I'll be back from PTO on
> Monday.
>
> Thanks,
> John
>
> On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> >
> > Hi, John HG,
> >
> > I realized that the info about the netcdf files we provided to you
are
> > not 100% accurate. Those files were originally created by RADX,
then
> > read by matlab to calculate and add composite reflectivity to the
> > file, then output as netcdf by matlab.
> > Basically we just add one more field to the original netcdf file.
It
> > seems MET had trouble read this file. On the other hand, the
original
> > netcdf created by RADX CAN be read by MET.
> >
> > If you want, I can email you the matlab script I used to create
those
> > netcdf files.
> >
> > Thanks
> >
> > Huaqing
> >
> >
> > ********************************
> > Dr. Huaqing Cai
> > Research Meteorologist
> > US Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Phone: 575 678-1524 (O)
> > 575 621-7949 (C)
> > ********************************
> >
> >
> > -----Original Message-----
> > From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > Sent: Tuesday, August 11, 2020 11:05 AM
> > To: 'met_help at ucar.edu' <met_help at ucar.edu>
> > Cc: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > Hi, John HG,
> >
> > Hope this email finds you well. I am sorry for your dog. He/she
must
> > be bored for stay-at-home so long as well.
> >
> > I should have mentioned to you earlier that the radar netcdf file
was
> > created by the latest NCAR radx software (Mike Dixon and his team
> > wrote it). For netcdf output file types, we selected the classic
> > options, which is the option that worked before. There are several
> > other output netcdf options available.
> > You might want to talk to Mike in case you have any questions.
> >
> > Thanks so much for your help. Take care and stay safe.
> >
> > Best,
> >
> > Huaqing
> >
> >
> > ********************************
> > Dr. Huaqing Cai
> > Research Meteorologist
> > US Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Phone: 575 678-1524 (O)
> > 575 621-7949 (C)
> > ********************************
> >
> >
> > -----Original Message-----
> > From: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Sent: Tuesday, August 11, 2020 9:39 AM
> > To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
<huaqing.cai.civ at mail.mil>
> > Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Hi Huaqing -
> >
> > You mentioned the possibility of contacting John about the issue
with
> > MET Grid-Stat reading the new RADX output. The email bellow is the
> > last email I received from John. I think you can just reply with
> > [rt.rap.ucar.edu #96104] in the subj and it will continue the
thread
> > for this ticket.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Wednesday, August 5, 2020 10:21 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
verify
> > the identity of the sender, and confirm the authenticity of all
links
> > contained within the message prior to copying and pasting the
address
> > to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > John,
> >
> > Sorry for the delay on this. I ran into some bad luck, having my
dog
> > chew up a charging cable. I'm back up and running today and am
> > downloading your sample file over my very slow internet. I'll let
you
> > know what I find.
> >
> > John HG
> >
> > On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > > 104 >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > Hi John -
> > >
> > > Thanks. I'll send you a link to download the file.
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Monday, August 3, 2020 1:24 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
pasting
> > > the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Hello John,
> > >
> > > Yes, I'd need to take a look at your NetCDF file. If you're able
to
> > > ftp it, you could post it here:
> > > Caution-
> > > Caution-Caution-https://dtcenter.org/community-code/model-
evaluation
> > > -tools-met
> > > /met-help-desk#ftp
> > >
> > > Otherwise, posting it somewhere else is fine.
> > >
> > > John
> > >
> > > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > Queue: met_help
> > > > Subject: trouble reading NetCDF observation
(UNCLASSIFIED)
> > > > Owner: Nobody
> > > > Requestors: john.w.raby2.civ at mail.mil
> > > > Status: new
> > > > Ticket <Caution-Caution-Caution-url:
> > > > Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > html?id=96
> > > > 104 >
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and
a
> > > > gridded radar observation in NetCDF format. The variable I'm
> > > > trying to verify is the column max reflectivity which is a 2-D
> > > > variable named "CM". The attached log file shows that an error
> > > > occurs due to inability to figure out the projection from the
info
> in
> > > > the file.
> > > > Could you take a look to see what the issue is and why it
can't
> > > > get the projection info? I tried to attach the observation
file,
> > > > but it's too big. I can provide the fila via a download link
sent
> > > > to your email address.
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > > 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: huaqing.cai.civ at mail.mil
Time: Thu Aug 20 15:10:01 2020
HI, John HW,
Thanks for your help on this issue.
Here is some background info regarding this netcdf data: 1) Yes, it is
radar
data from Kwajalein atoll. Good detective work! you found it as shown
in the
figure, and 2) This file is created by matlab.
As you said, the CM field is the issue. What I did was, read in the
netcdf
files from radx, find the column max dbz(CM) and add one additional
field
named "CM" to the original netcdf files, and write them out. All these
were
done in Matlab. I don't know how Matlab handle this in detail. You
mentioned
I need to add the map attribute to this "CM" field. I am not clear on
how to
do it. Could you help me out on actually how to add this attribute to
this
"CM" field? Should it be done in Matlab? Or by some other software? We
need
this field and cannot just delete it from the netcdf files.
The interesting thing is, software such as IDV was able to read this
file and
display the CM field correctly with no issues.
Thanks and looking forward to hearing from you.
Take care and stay safe
Huaqing
********************************
Dr. Huaqing Cai
Research Meteorologist
US Army Research Laboratory
White Sands Missile Range, NM 88002
Phone: 575 678-1524 (O)
575 621-7949 (C)
********************************
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Thursday, August 20, 2020 2:00 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
NetCDF observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
John,
I can confirm that I am able to replicate this behavior:
*> plot_data_plane ncf_20200315_055801.nc
<Caution-http://ncf_20200315_055801.nc>
ZZ.ps 'name="ZZ"; level="(0,0,*,*)";' -v 10*
*ERROR : NcCfFile::read_netcdf_grid() -> Couldn't figure out
projection from
information in netCDF file.*
I apologize for the very long delay in diagnosing this. I'm not able
to get my
debugger to work from home and that has slowed me down a lot.
Adding some print statements, I find that the "CM" variable is causing
the
problem. When I delete that variable, or simple add in the
"grid_mapping"
attribute, then MET is able to read this data just fine:
float CM(y0, x0) ;
CM:_FillValue = -9999.f ;
CM:long_name = "CZ column maximum" ;
CM:units = "unknown" ;
* CM:grid_mapping = "grid_mapping_0" ;*
I'm actually a bit surprised about this. It appears the library code
inventories all the variables, and tries to parse the projection
information
for any variable that uses the 2 gridded dimensions.
Hopefully this will be any easy change.
plot_data_plane ncf_20200315_055801_MOD.nc ZZ.ps 'name="ZZ";
level="(0,0,*,*)";'
And here's the output for that:
[image: ZZ.png]
I was curious where this data lives on earth, so I regridded it to a
global
domain and plotted the result:
regrid_data_plane ncf_20200315_055801_MOD.nc G003 regrid.nc -field
'name="ZZ"; level="(0,0,*,*)";'
plot_data_plane regrid.nc regrid.ps 'name="ZZ";level="(*,*)";'
And the resulting image shows this data in the Pacific roughly between
Hawaii
and Australia. Is that the correct location?
[image: regrid.png]
Thanks,
John
On Tue, Aug 18, 2020 at 8:53 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> John -
>
> Just wanted to touch base on any findings on the problem with the
> radar obs which is preventing Grid-Stat from getting the projection
> info.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Thursday, August 13, 2020 11:55 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> John and Huaqing,
>
> Thanks for sending this data. Unfortunately, I didn't get a chance
to
> dig into the details before heading out of town. But I'll be back
from
> PTO on Monday.
>
> Thanks,
> John
>
> On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > 104 >
> >
> > Hi, John HG,
> >
> > I realized that the info about the netcdf files we provided to you
> > are not 100% accurate. Those files were originally created by
RADX,
> > then read by matlab to calculate and add composite reflectivity to
> > the file, then output as netcdf by matlab.
> > Basically we just add one more field to the original netcdf file.
It
> > seems MET had trouble read this file. On the other hand, the
> > original netcdf created by RADX CAN be read by MET.
> >
> > If you want, I can email you the matlab script I used to create
> > those netcdf files.
> >
> > Thanks
> >
> > Huaqing
> >
> >
> > ********************************
> > Dr. Huaqing Cai
> > Research Meteorologist
> > US Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Phone: 575 678-1524 (O)
> > 575 621-7949 (C)
> > ********************************
> >
> >
> > -----Original Message-----
> > From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > Sent: Tuesday, August 11, 2020 11:05 AM
> > To: 'met_help at ucar.edu' <met_help at ucar.edu>
> > Cc: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > Hi, John HG,
> >
> > Hope this email finds you well. I am sorry for your dog. He/she
must
> > be bored for stay-at-home so long as well.
> >
> > I should have mentioned to you earlier that the radar netcdf file
> > was created by the latest NCAR radx software (Mike Dixon and his
> > team wrote it). For netcdf output file types, we selected the
> > classic options, which is the option that worked before. There are
> > several other output netcdf options available.
> > You might want to talk to Mike in case you have any questions.
> >
> > Thanks so much for your help. Take care and stay safe.
> >
> > Best,
> >
> > Huaqing
> >
> >
> > ********************************
> > Dr. Huaqing Cai
> > Research Meteorologist
> > US Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Phone: 575 678-1524 (O)
> > 575 621-7949 (C)
> > ********************************
> >
> >
> > -----Original Message-----
> > From: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Sent: Tuesday, August 11, 2020 9:39 AM
> > To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > <huaqing.cai.civ at mail.mil>
> > Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > Hi Huaqing -
> >
> > You mentioned the possibility of contacting John about the issue
> > with MET Grid-Stat reading the new RADX output. The email bellow
is
> > the last email I received from John. I think you can just reply
with
> > [rt.rap.ucar.edu #96104] in the subj and it will continue the
thread
> > for this ticket.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Wednesday, August 5, 2020 10:21 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify the identity of the sender, and confirm the authenticity of
> > all links contained within the message prior to copying and
pasting
> > the address to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > John,
> >
> > Sorry for the delay on this. I ran into some bad luck, having my
dog
> > chew up a charging cable. I'm back up and running today and am
> > downloading your sample file over my very slow internet. I'll let
> > you know what I find.
> >
> > John HG
> >
> > On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-Caution-url:
> > > Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > html?id=96
> > > 104 >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > Hi John -
> > >
> > > Thanks. I'll send you a link to download the file.
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Monday, August 3, 2020 1:24 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
> > > pasting the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Hello John,
> > >
> > > Yes, I'd need to take a look at your NetCDF file. If you're able
> > > to ftp it, you could post it here:
> > > Caution-
> > > Caution-Caution-Caution-https://dtcenter.org/community-
code/model-
> > > evaluation
> > > -tools-met
> > > /met-help-desk#ftp
> > >
> > > Otherwise, posting it somewhere else is fine.
> > >
> > > John
> > >
> > > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > Queue: met_help
> > > > Subject: trouble reading NetCDF observation
(UNCLASSIFIED)
> > > > Owner: Nobody
> > > > Requestors: john.w.raby2.civ at mail.mil
> > > > Status: new
> > > > Ticket <Caution-Caution-Caution-Caution-url:
> > > > Caution-Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > html?id=96
> > > > 104 >
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output and
a
> > > > gridded radar observation in NetCDF format. The variable I'm
> > > > trying to verify is the column max reflectivity which is a 2-D
> > > > variable named "CM". The attached log file shows that an error
> > > > occurs due to inability to figure out the projection from the
> > > > info
> in
> > > > the file.
> > > > Could you take a look to see what the issue is and why it
can't
> > > > get the projection info? I tried to attach the observation
> > > > file, but it's too big. I can provide the fila via a download
> > > > link sent to your email address.
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
> > > > (575)
> > > > 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: John Halley Gotway
Time: Thu Aug 20 17:04:25 2020
Huaqing,
I would presume that there's some way of modifying the NetCDF
attributes
written by Matlab, but I really don't know.
There is an nco (NetCDF Operators) utility named ncatted that can be
run to
modify NetCDF attributes. Perhaps that'd be useful?
ncatted -a grid_mapping,CM,a,c,"grid_mapping_0" ncf_20200315_055801.nc
ncdump -h ncf_20200315_055801.nc
float CM(y0, x0) ;
CM:_FillValue = -9999.f ;
CM:long_name = "CZ column maximum" ;
CM:units = "unknown" ;
CM:grid_mapping = "grid_mapping_0" ;
So that adds the grid_mapping attribute to the CM variable, as you'd
need.
However, there's an additional issue here. The CF-compliant way of
defining timing information for a variable is using the time
dimension,
just like the other variables do. The CM variable should really also
include the time dimension:
float CM(time, y0, x0) ;
Otherwise, MET probably won't extract the correct timing information.
But I
don't know of an NCO utility to add a new dimension to an existing
variable.
I'd recommend that you figure out how to do that in Matlab.
Thanks,
John
On Thu, Aug 20, 2020 at 3:10 PM huaqing.cai.civ at mail.mil via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> HI, John HW,
>
> Thanks for your help on this issue.
>
> Here is some background info regarding this netcdf data: 1) Yes, it
is
> radar
> data from Kwajalein atoll. Good detective work! you found it as
shown in
> the
> figure, and 2) This file is created by matlab.
>
> As you said, the CM field is the issue. What I did was, read in the
netcdf
> files from radx, find the column max dbz(CM) and add one additional
field
> named "CM" to the original netcdf files, and write them out. All
these
> were
> done in Matlab. I don't know how Matlab handle this in detail. You
> mentioned
> I need to add the map attribute to this "CM" field. I am not clear
on how
> to
> do it. Could you help me out on actually how to add this attribute
to this
> "CM" field? Should it be done in Matlab? Or by some other software?
We
> need
> this field and cannot just delete it from the netcdf files.
>
> The interesting thing is, software such as IDV was able to read this
file
> and
> display the CM field correctly with no issues.
>
> Thanks and looking forward to hearing from you.
>
> Take care and stay safe
>
> Huaqing
>
>
>
>
>
>
> ********************************
> Dr. Huaqing Cai
> Research Meteorologist
> US Army Research Laboratory
> White Sands Missile Range, NM 88002
> Phone: 575 678-1524 (O)
> 575 621-7949 (C)
> ********************************
>
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Thursday, August 20, 2020 2:00 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John,
>
> I can confirm that I am able to replicate this behavior:
>
>
> *> plot_data_plane ncf_20200315_055801.nc
> <Caution-http://ncf_20200315_055801.nc>
> ZZ.ps 'name="ZZ"; level="(0,0,*,*)";' -v 10*
>
> *ERROR : NcCfFile::read_netcdf_grid() -> Couldn't figure out
projection
> from
> information in netCDF file.*
>
>
> I apologize for the very long delay in diagnosing this. I'm not able
to
> get my
> debugger to work from home and that has slowed me down a lot.
>
>
> Adding some print statements, I find that the "CM" variable is
causing the
> problem. When I delete that variable, or simple add in the
"grid_mapping"
> attribute, then MET is able to read this data just fine:
>
>
> float CM(y0, x0) ;
>
> CM:_FillValue = -9999.f ;
>
> CM:long_name = "CZ column maximum" ;
>
> CM:units = "unknown" ;
>
> * CM:grid_mapping = "grid_mapping_0" ;*
>
>
>
> I'm actually a bit surprised about this. It appears the library code
> inventories all the variables, and tries to parse the projection
> information
> for any variable that uses the 2 gridded dimensions.
>
>
> Hopefully this will be any easy change.
>
>
> plot_data_plane ncf_20200315_055801_MOD.nc ZZ.ps 'name="ZZ";
> level="(0,0,*,*)";'
>
>
> And here's the output for that:
> [image: ZZ.png]
>
>
> I was curious where this data lives on earth, so I regridded it to a
global
> domain and plotted the result:
>
>
> regrid_data_plane ncf_20200315_055801_MOD.nc G003 regrid.nc -field
> 'name="ZZ"; level="(0,0,*,*)";'
>
> plot_data_plane regrid.nc regrid.ps 'name="ZZ";level="(*,*)";'
>
>
> And the resulting image shows this data in the Pacific roughly
between
> Hawaii
> and Australia. Is that the correct location?
>
>
> [image: regrid.png]
>
>
> Thanks,
>
> John
>
> On Tue, Aug 18, 2020 at 8:53 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > John -
> >
> > Just wanted to touch base on any findings on the problem with the
> > radar obs which is preventing Grid-Stat from getting the
projection
> > info.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Thursday, August 13, 2020 11:55 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
verify
> > the identity of the sender, and confirm the authenticity of all
links
> > contained within the message prior to copying and pasting the
address
> > to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > John and Huaqing,
> >
> > Thanks for sending this data. Unfortunately, I didn't get a chance
to
> > dig into the details before heading out of town. But I'll be back
from
> > PTO on Monday.
> >
> > Thanks,
> > John
> >
> > On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > > 104 >
> > >
> > > Hi, John HG,
> > >
> > > I realized that the info about the netcdf files we provided to
you
> > > are not 100% accurate. Those files were originally created by
RADX,
> > > then read by matlab to calculate and add composite reflectivity
to
> > > the file, then output as netcdf by matlab.
> > > Basically we just add one more field to the original netcdf
file. It
> > > seems MET had trouble read this file. On the other hand, the
> > > original netcdf created by RADX CAN be read by MET.
> > >
> > > If you want, I can email you the matlab script I used to create
> > > those netcdf files.
> > >
> > > Thanks
> > >
> > > Huaqing
> > >
> > >
> > > ********************************
> > > Dr. Huaqing Cai
> > > Research Meteorologist
> > > US Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Phone: 575 678-1524 (O)
> > > 575 621-7949 (C)
> > > ********************************
> > >
> > >
> > > -----Original Message-----
> > > From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > > Sent: Tuesday, August 11, 2020 11:05 AM
> > > To: 'met_help at ucar.edu' <met_help at ucar.edu>
> > > Cc: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > Hi, John HG,
> > >
> > > Hope this email finds you well. I am sorry for your dog. He/she
must
> > > be bored for stay-at-home so long as well.
> > >
> > > I should have mentioned to you earlier that the radar netcdf
file
> > > was created by the latest NCAR radx software (Mike Dixon and his
> > > team wrote it). For netcdf output file types, we selected the
> > > classic options, which is the option that worked before. There
are
> > > several other output netcdf options available.
> > > You might want to talk to Mike in case you have any questions.
> > >
> > > Thanks so much for your help. Take care and stay safe.
> > >
> > > Best,
> > >
> > > Huaqing
> > >
> > >
> > > ********************************
> > > Dr. Huaqing Cai
> > > Research Meteorologist
> > > US Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Phone: 575 678-1524 (O)
> > > 575 621-7949 (C)
> > > ********************************
> > >
> > >
> > > -----Original Message-----
> > > From: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Sent: Tuesday, August 11, 2020 9:39 AM
> > > To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > > <huaqing.cai.civ at mail.mil>
> > > Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > Hi Huaqing -
> > >
> > > You mentioned the possibility of contacting John about the issue
> > > with MET Grid-Stat reading the new RADX output. The email bellow
is
> > > the last email I received from John. I think you can just reply
with
> > > [rt.rap.ucar.edu #96104] in the subj and it will continue the
thread
> > > for this ticket.
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Wednesday, August 5, 2020 10:21 AM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
pasting
> > > the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > John,
> > >
> > > Sorry for the delay on this. I ran into some bad luck, having my
dog
> > > chew up a charging cable. I'm back up and running today and am
> > > downloading your sample file over my very slow internet. I'll
let
> > > you know what I find.
> > >
> > > John HG
> > >
> > > On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <Caution-Caution-Caution-url:
> > > > Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > html?id=96
> > > > 104 >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > Hi John -
> > > >
> > > > Thanks. I'll send you a link to download the file.
> > > >
> > > > R/
> > > > John
> > > >
> > > > -----Original Message-----
> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > Sent: Monday, August 3, 2020 1:24 PM
> > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > <john.w.raby2.civ at mail.mil>
> > > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > > > reading NetCDF observation (UNCLASSIFIED)
> > > >
> > > > All active links contained in this email were disabled.
Please
> > > > verify the identity of the sender, and confirm the
authenticity of
> > > > all links contained within the message prior to copying and
> > > > pasting the address to a Web browser.
> > > >
> > > >
> > > >
> > > >
> > > > ----
> > > >
> > > > Hello John,
> > > >
> > > > Yes, I'd need to take a look at your NetCDF file. If you're
able
> > > > to ftp it, you could post it here:
> > > > Caution-
> > > > Caution-Caution-Caution-https://dtcenter.org/community-
code/model-
> > > > evaluation
> > > > -tools-met
> > > > /met-help-desk#ftp
> > > >
> > > > Otherwise, posting it somewhere else is fine.
> > > >
> > > > John
> > > >
> > > > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > > Queue: met_help
> > > > > Subject: trouble reading NetCDF observation
(UNCLASSIFIED)
> > > > > Owner: Nobody
> > > > > Requestors: john.w.raby2.civ at mail.mil
> > > > > Status: new
> > > > > Ticket <Caution-Caution-Caution-Caution-url:
> > > > > Caution-Caution-Caution-Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > > html?id=96
> > > > > 104 >
> > > > >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output
and a
> > > > > gridded radar observation in NetCDF format. The variable I'm
> > > > > trying to verify is the column max reflectivity which is a
2-D
> > > > > variable named "CM". The attached log file shows that an
error
> > > > > occurs due to inability to figure out the projection from
the
> > > > > info
> > in
> > > > > the file.
> > > > > Could you take a look to see what the issue is and why it
can't
> > > > > get the projection info? I tried to attach the observation
> > > > > file, but it's too big. I can provide the fila via a
download
> > > > > link sent to your email address.
> > > > >
> > > > > Thanks.
> > > > >
> > > > > R/
> > > > > John
> > > > >
> > > > > Mr. John W. Raby
> > > > > U.S. Army Research Laboratory
> > > > > White Sands Missile Range, NM 88002
> > > > > Office:(575) 678-2004 DSN 258-2004
> > > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
> > > > > (575)
> > > > > 678-1230 DSN 258-1230
> > > > > Email: john.w.raby2.civ at mail.mil
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble reading NetCDF observation (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu Aug 20 18:36:52 2020
Huaqing -
I recall that John showed me how to use nco/ncatted to modify the
attributes of a netcdf file which was output by IDV in order to get
MET G-S to read it. If you can't get matlab to modify the grid_mapping
attribute we have that as a alternative method for the grid_mapping. I
have nco on Centennial. I am not sure how to overcome the time
dimension issue. Figuring out how to do both modifications with matlab
would be convenient if it's possible.
R/
John
________________________________________
From: John Halley Gotway via RT [met_help at ucar.edu]
Sent: Thursday, August 20, 2020 5:04 PM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading NetCDF observation (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.
----
Huaqing,
I would presume that there's some way of modifying the NetCDF
attributes
written by Matlab, but I really don't know.
There is an nco (NetCDF Operators) utility named ncatted that can be
run to
modify NetCDF attributes. Perhaps that'd be useful?
ncatted -a grid_mapping,CM,a,c,"grid_mapping_0" ncf_20200315_055801.nc
ncdump -h ncf_20200315_055801.nc
float CM(y0, x0) ;
CM:_FillValue = -9999.f ;
CM:long_name = "CZ column maximum" ;
CM:units = "unknown" ;
CM:grid_mapping = "grid_mapping_0" ;
So that adds the grid_mapping attribute to the CM variable, as you'd
need.
However, there's an additional issue here. The CF-compliant way of
defining timing information for a variable is using the time
dimension,
just like the other variables do. The CM variable should really also
include the time dimension:
float CM(time, y0, x0) ;
Otherwise, MET probably won't extract the correct timing information.
But I
don't know of an NCO utility to add a new dimension to an existing
variable.
I'd recommend that you figure out how to do that in Matlab.
Thanks,
John
On Thu, Aug 20, 2020 at 3:10 PM huaqing.cai.civ at mail.mil via RT <
met_help at ucar.edu> wrote:
>
> <Caution-url: Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> HI, John HW,
>
> Thanks for your help on this issue.
>
> Here is some background info regarding this netcdf data: 1) Yes, it
is
> radar
> data from Kwajalein atoll. Good detective work! you found it as
shown in
> the
> figure, and 2) This file is created by matlab.
>
> As you said, the CM field is the issue. What I did was, read in the
netcdf
> files from radx, find the column max dbz(CM) and add one additional
field
> named "CM" to the original netcdf files, and write them out. All
these
> were
> done in Matlab. I don't know how Matlab handle this in detail. You
> mentioned
> I need to add the map attribute to this "CM" field. I am not clear
on how
> to
> do it. Could you help me out on actually how to add this attribute
to this
> "CM" field? Should it be done in Matlab? Or by some other software?
We
> need
> this field and cannot just delete it from the netcdf files.
>
> The interesting thing is, software such as IDV was able to read this
file
> and
> display the CM field correctly with no issues.
>
> Thanks and looking forward to hearing from you.
>
> Take care and stay safe
>
> Huaqing
>
>
>
>
>
>
> ********************************
> Dr. Huaqing Cai
> Research Meteorologist
> US Army Research Laboratory
> White Sands Missile Range, NM 88002
> Phone: 575 678-1524 (O)
> 575 621-7949 (C)
> ********************************
>
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Thursday, August 20, 2020 2:00 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
reading
> NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> John,
>
> I can confirm that I am able to replicate this behavior:
>
>
> *> plot_data_plane ncf_20200315_055801.nc
> <Caution-Caution-http://ncf_20200315_055801.nc>
> ZZ.ps 'name="ZZ"; level="(0,0,*,*)";' -v 10*
>
> *ERROR : NcCfFile::read_netcdf_grid() -> Couldn't figure out
projection
> from
> information in netCDF file.*
>
>
> I apologize for the very long delay in diagnosing this. I'm not able
to
> get my
> debugger to work from home and that has slowed me down a lot.
>
>
> Adding some print statements, I find that the "CM" variable is
causing the
> problem. When I delete that variable, or simple add in the
"grid_mapping"
> attribute, then MET is able to read this data just fine:
>
>
> float CM(y0, x0) ;
>
> CM:_FillValue = -9999.f ;
>
> CM:long_name = "CZ column maximum" ;
>
> CM:units = "unknown" ;
>
> * CM:grid_mapping = "grid_mapping_0" ;*
>
>
>
> I'm actually a bit surprised about this. It appears the library code
> inventories all the variables, and tries to parse the projection
> information
> for any variable that uses the 2 gridded dimensions.
>
>
> Hopefully this will be any easy change.
>
>
> plot_data_plane ncf_20200315_055801_MOD.nc ZZ.ps 'name="ZZ";
> level="(0,0,*,*)";'
>
>
> And here's the output for that:
> [image: ZZ.png]
>
>
> I was curious where this data lives on earth, so I regridded it to a
global
> domain and plotted the result:
>
>
> regrid_data_plane ncf_20200315_055801_MOD.nc G003 regrid.nc -field
> 'name="ZZ"; level="(0,0,*,*)";'
>
> plot_data_plane regrid.nc regrid.ps 'name="ZZ";level="(*,*)";'
>
>
> And the resulting image shows this data in the Pacific roughly
between
> Hawaii
> and Australia. Is that the correct location?
>
>
> [image: regrid.png]
>
>
> Thanks,
>
> John
>
> On Tue, Aug 18, 2020 at 8:53 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > John -
> >
> > Just wanted to touch base on any findings on the problem with the
> > radar obs which is preventing Grid-Stat from getting the
projection
> > info.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Thursday, August 13, 2020 11:55 AM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > reading NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
verify
> > the identity of the sender, and confirm the authenticity of all
links
> > contained within the message prior to copying and pasting the
address
> > to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > John and Huaqing,
> >
> > Thanks for sending this data. Unfortunately, I didn't get a chance
to
> > dig into the details before heading out of town. But I'll be back
from
> > PTO on Monday.
> >
> > Thanks,
> > John
> >
> > On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-Caution-url:
> > > Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > > 104 >
> > >
> > > Hi, John HG,
> > >
> > > I realized that the info about the netcdf files we provided to
you
> > > are not 100% accurate. Those files were originally created by
RADX,
> > > then read by matlab to calculate and add composite reflectivity
to
> > > the file, then output as netcdf by matlab.
> > > Basically we just add one more field to the original netcdf
file. It
> > > seems MET had trouble read this file. On the other hand, the
> > > original netcdf created by RADX CAN be read by MET.
> > >
> > > If you want, I can email you the matlab script I used to create
> > > those netcdf files.
> > >
> > > Thanks
> > >
> > > Huaqing
> > >
> > >
> > > ********************************
> > > Dr. Huaqing Cai
> > > Research Meteorologist
> > > US Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Phone: 575 678-1524 (O)
> > > 575 621-7949 (C)
> > > ********************************
> > >
> > >
> > > -----Original Message-----
> > > From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > > Sent: Tuesday, August 11, 2020 11:05 AM
> > > To: 'met_help at ucar.edu' <met_help at ucar.edu>
> > > Cc: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > Hi, John HG,
> > >
> > > Hope this email finds you well. I am sorry for your dog. He/she
must
> > > be bored for stay-at-home so long as well.
> > >
> > > I should have mentioned to you earlier that the radar netcdf
file
> > > was created by the latest NCAR radx software (Mike Dixon and his
> > > team wrote it). For netcdf output file types, we selected the
> > > classic options, which is the option that worked before. There
are
> > > several other output netcdf options available.
> > > You might want to talk to Mike in case you have any questions.
> > >
> > > Thanks so much for your help. Take care and stay safe.
> > >
> > > Best,
> > >
> > > Huaqing
> > >
> > >
> > > ********************************
> > > Dr. Huaqing Cai
> > > Research Meteorologist
> > > US Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Phone: 575 678-1524 (O)
> > > 575 621-7949 (C)
> > > ********************************
> > >
> > >
> > > -----Original Message-----
> > > From: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Sent: Tuesday, August 11, 2020 9:39 AM
> > > To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > > <huaqing.cai.civ at mail.mil>
> > > Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > Hi Huaqing -
> > >
> > > You mentioned the possibility of contacting John about the issue
> > > with MET Grid-Stat reading the new RADX output. The email bellow
is
> > > the last email I received from John. I think you can just reply
with
> > > [rt.rap.ucar.edu #96104] in the subj and it will continue the
thread
> > > for this ticket.
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Wednesday, August 5, 2020 10:21 AM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
pasting
> > > the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > John,
> > >
> > > Sorry for the delay on this. I ran into some bad luck, having my
dog
> > > chew up a charging cable. I'm back up and running today and am
> > > downloading your sample file over my very slow internet. I'll
let
> > > you know what I find.
> > >
> > > John HG
> > >
> > > On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <Caution-Caution-Caution-Caution-url:
> > > > Caution-Caution-Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > html?id=96
> > > > 104 >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > Hi John -
> > > >
> > > > Thanks. I'll send you a link to download the file.
> > > >
> > > > R/
> > > > John
> > > >
> > > > -----Original Message-----
> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > Sent: Monday, August 3, 2020 1:24 PM
> > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > <john.w.raby2.civ at mail.mil>
> > > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> > > > reading NetCDF observation (UNCLASSIFIED)
> > > >
> > > > All active links contained in this email were disabled.
Please
> > > > verify the identity of the sender, and confirm the
authenticity of
> > > > all links contained within the message prior to copying and
> > > > pasting the address to a Web browser.
> > > >
> > > >
> > > >
> > > >
> > > > ----
> > > >
> > > > Hello John,
> > > >
> > > > Yes, I'd need to take a look at your NetCDF file. If you're
able
> > > > to ftp it, you could post it here:
> > > > Caution-
> > > > Caution-Caution-Caution-Caution-
https://dtcenter.org/community-code/model-
> > > > evaluation
> > > > -tools-met
> > > > /met-help-desk#ftp
> > > >
> > > > Otherwise, posting it somewhere else is fine.
> > > >
> > > > John
> > > >
> > > > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > > Queue: met_help
> > > > > Subject: trouble reading NetCDF observation
(UNCLASSIFIED)
> > > > > Owner: Nobody
> > > > > Requestors: john.w.raby2.civ at mail.mil
> > > > > Status: new
> > > > > Ticket <Caution-Caution-Caution-Caution-Caution-url:
> > > > > Caution-Caution-Caution-Caution-
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > > html?id=96
> > > > > 104 >
> > > > >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output
and a
> > > > > gridded radar observation in NetCDF format. The variable I'm
> > > > > trying to verify is the column max reflectivity which is a
2-D
> > > > > variable named "CM". The attached log file shows that an
error
> > > > > occurs due to inability to figure out the projection from
the
> > > > > info
> > in
> > > > > the file.
> > > > > Could you take a look to see what the issue is and why it
can't
> > > > > get the projection info? I tried to attach the observation
> > > > > file, but it's too big. I can provide the fila via a
download
> > > > > link sent to your email address.
> > > > >
> > > > > Thanks.
> > > > >
> > > > > R/
> > > > > John
> > > > >
> > > > > Mr. John W. Raby
> > > > > U.S. Army Research Laboratory
> > > > > White Sands Missile Range, NM 88002
> > > > > Office:(575) 678-2004 DSN 258-2004
> > > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
> > > > > (575)
> > > > > 678-1230 DSN 258-1230
> > > > > Email: john.w.raby2.civ at mail.mil
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: trouble reading NetCDF observation (UNCLASSIFIED)
From: John Halley Gotway
Time: Fri Aug 21 10:44:47 2020
John and Huaqing,
I think I've addressed what I can here with regards to the MET
software.
I'll go ahead and resolve this ticket, and let you two figure out the
file
formatting issues.
If more issues or questions about MET come up, just let us know.
Thanks,
John
On Thu, Aug 20, 2020 at 6:37 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
>
> Huaqing -
>
> I recall that John showed me how to use nco/ncatted to modify the
> attributes of a netcdf file which was output by IDV in order to get
MET G-S
> to read it. If you can't get matlab to modify the grid_mapping
attribute we
> have that as a alternative method for the grid_mapping. I have nco
on
> Centennial. I am not sure how to overcome the time dimension issue.
> Figuring out how to do both modifications with matlab would be
convenient
> if it's possible.
>
> R/
> John
>
>
> ________________________________________
> From: John Halley Gotway via RT [met_help at ucar.edu]
> Sent: Thursday, August 20, 2020 5:04 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading NetCDF observation (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Huaqing,
>
> I would presume that there's some way of modifying the NetCDF
attributes
> written by Matlab, but I really don't know.
>
> There is an nco (NetCDF Operators) utility named ncatted that can be
run to
> modify NetCDF attributes. Perhaps that'd be useful?
>
> ncatted -a grid_mapping,CM,a,c,"grid_mapping_0"
ncf_20200315_055801.nc
> ncdump -h ncf_20200315_055801.nc
>
>
> float CM(y0, x0) ;
>
> CM:_FillValue = -9999.f ;
>
> CM:long_name = "CZ column maximum" ;
>
> CM:units = "unknown" ;
>
> CM:grid_mapping = "grid_mapping_0" ;
>
>
> So that adds the grid_mapping attribute to the CM variable, as you'd
need.
> However, there's an additional issue here. The CF-compliant way of
> defining timing information for a variable is using the time
dimension,
> just like the other variables do. The CM variable should really also
> include the time dimension:
>
>
> float CM(time, y0, x0) ;
>
>
> Otherwise, MET probably won't extract the correct timing
information. But I
> don't know of an NCO utility to add a new dimension to an existing
> variable.
>
>
> I'd recommend that you figure out how to do that in Matlab.
>
>
> Thanks,
> John
>
> On Thu, Aug 20, 2020 at 3:10 PM huaqing.cai.civ at mail.mil via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url: Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> >
> > HI, John HW,
> >
> > Thanks for your help on this issue.
> >
> > Here is some background info regarding this netcdf data: 1) Yes,
it is
> > radar
> > data from Kwajalein atoll. Good detective work! you found it as
shown in
> > the
> > figure, and 2) This file is created by matlab.
> >
> > As you said, the CM field is the issue. What I did was, read in
the
> netcdf
> > files from radx, find the column max dbz(CM) and add one
additional field
> > named "CM" to the original netcdf files, and write them out. All
these
> > were
> > done in Matlab. I don't know how Matlab handle this in detail.
You
> > mentioned
> > I need to add the map attribute to this "CM" field. I am not clear
on how
> > to
> > do it. Could you help me out on actually how to add this attribute
to
> this
> > "CM" field? Should it be done in Matlab? Or by some other
software? We
> > need
> > this field and cannot just delete it from the netcdf files.
> >
> > The interesting thing is, software such as IDV was able to read
this file
> > and
> > display the CM field correctly with no issues.
> >
> > Thanks and looking forward to hearing from you.
> >
> > Take care and stay safe
> >
> > Huaqing
> >
> >
> >
> >
> >
> >
> > ********************************
> > Dr. Huaqing Cai
> > Research Meteorologist
> > US Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Phone: 575 678-1524 (O)
> > 575 621-7949 (C)
> > ********************************
> >
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Thursday, August 20, 2020 2:00 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104] trouble
> reading
> > NetCDF observation (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
verify
> the
> > identity of the sender, and confirm the authenticity of all links
> contained
> > within the message prior to copying and pasting the address to a
Web
> > browser.
> >
> >
> >
> >
> > ----
> >
> > John,
> >
> > I can confirm that I am able to replicate this behavior:
> >
> >
> > *> plot_data_plane ncf_20200315_055801.nc
> > <Caution-Caution-http://ncf_20200315_055801.nc>
> > ZZ.ps 'name="ZZ"; level="(0,0,*,*)";' -v 10*
> >
> > *ERROR : NcCfFile::read_netcdf_grid() -> Couldn't figure out
projection
> > from
> > information in netCDF file.*
> >
> >
> > I apologize for the very long delay in diagnosing this. I'm not
able to
> > get my
> > debugger to work from home and that has slowed me down a lot.
> >
> >
> > Adding some print statements, I find that the "CM" variable is
causing
> the
> > problem. When I delete that variable, or simple add in the
"grid_mapping"
> > attribute, then MET is able to read this data just fine:
> >
> >
> > float CM(y0, x0) ;
> >
> > CM:_FillValue = -9999.f ;
> >
> > CM:long_name = "CZ column maximum" ;
> >
> > CM:units = "unknown" ;
> >
> > * CM:grid_mapping = "grid_mapping_0" ;*
> >
> >
> >
> > I'm actually a bit surprised about this. It appears the library
code
> > inventories all the variables, and tries to parse the projection
> > information
> > for any variable that uses the 2 gridded dimensions.
> >
> >
> > Hopefully this will be any easy change.
> >
> >
> > plot_data_plane ncf_20200315_055801_MOD.nc ZZ.ps 'name="ZZ";
> > level="(0,0,*,*)";'
> >
> >
> > And here's the output for that:
> > [image: ZZ.png]
> >
> >
> > I was curious where this data lives on earth, so I regridded it to
a
> global
> > domain and plotted the result:
> >
> >
> > regrid_data_plane ncf_20200315_055801_MOD.nc G003 regrid.nc
-field
> > 'name="ZZ"; level="(0,0,*,*)";'
> >
> > plot_data_plane regrid.nc regrid.ps 'name="ZZ";level="(*,*)";'
> >
> >
> > And the resulting image shows this data in the Pacific roughly
between
> > Hawaii
> > and Australia. Is that the correct location?
> >
> >
> > [image: regrid.png]
> >
> >
> > Thanks,
> >
> > John
> >
> > On Tue, Aug 18, 2020 at 8:53 AM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-url:
> > > Caution-Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96104 >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > John -
> > >
> > > Just wanted to touch base on any findings on the problem with
the
> > > radar obs which is preventing Grid-Stat from getting the
projection
> > > info.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Thursday, August 13, 2020 11:55 AM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > reading NetCDF observation (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
verify
> > > the identity of the sender, and confirm the authenticity of all
links
> > > contained within the message prior to copying and pasting the
address
> > > to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > John and Huaqing,
> > >
> > > Thanks for sending this data. Unfortunately, I didn't get a
chance to
> > > dig into the details before heading out of town. But I'll be
back from
> > > PTO on Monday.
> > >
> > > Thanks,
> > > John
> > >
> > > On Wed, Aug 12, 2020 at 8:39 AM huaqing.cai.civ at mail.mil via RT
<
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <Caution-Caution-Caution-url:
> > > > Caution-Caution-Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96
> > > > 104 >
> > > >
> > > > Hi, John HG,
> > > >
> > > > I realized that the info about the netcdf files we provided to
you
> > > > are not 100% accurate. Those files were originally created by
RADX,
> > > > then read by matlab to calculate and add composite
reflectivity to
> > > > the file, then output as netcdf by matlab.
> > > > Basically we just add one more field to the original netcdf
file. It
> > > > seems MET had trouble read this file. On the other hand, the
> > > > original netcdf created by RADX CAN be read by MET.
> > > >
> > > > If you want, I can email you the matlab script I used to
create
> > > > those netcdf files.
> > > >
> > > > Thanks
> > > >
> > > > Huaqing
> > > >
> > > >
> > > > ********************************
> > > > Dr. Huaqing Cai
> > > > Research Meteorologist
> > > > US Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Phone: 575 678-1524 (O)
> > > > 575 621-7949 (C)
> > > > ********************************
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > > > Sent: Tuesday, August 11, 2020 11:05 AM
> > > > To: 'met_help at ucar.edu' <met_help at ucar.edu>
> > > > Cc: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > <john.w.raby2.civ at mail.mil>
> > > > Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > > reading NetCDF observation (UNCLASSIFIED)
> > > >
> > > > Hi, John HG,
> > > >
> > > > Hope this email finds you well. I am sorry for your dog.
He/she must
> > > > be bored for stay-at-home so long as well.
> > > >
> > > > I should have mentioned to you earlier that the radar netcdf
file
> > > > was created by the latest NCAR radx software (Mike Dixon and
his
> > > > team wrote it). For netcdf output file types, we selected the
> > > > classic options, which is the option that worked before. There
are
> > > > several other output netcdf options available.
> > > > You might want to talk to Mike in case you have any questions.
> > > >
> > > > Thanks so much for your help. Take care and stay safe.
> > > >
> > > > Best,
> > > >
> > > > Huaqing
> > > >
> > > >
> > > > ********************************
> > > > Dr. Huaqing Cai
> > > > Research Meteorologist
> > > > US Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Phone: 575 678-1524 (O)
> > > > 575 621-7949 (C)
> > > > ********************************
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > <john.w.raby2.civ at mail.mil>
> > > > Sent: Tuesday, August 11, 2020 9:39 AM
> > > > To: Cai, Huaqing CIV USARMY CCDC ARL (USA)
> > > > <huaqing.cai.civ at mail.mil>
> > > > Subject: FW: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > > reading NetCDF observation (UNCLASSIFIED)
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > Hi Huaqing -
> > > >
> > > > You mentioned the possibility of contacting John about the
issue
> > > > with MET Grid-Stat reading the new RADX output. The email
bellow is
> > > > the last email I received from John. I think you can just
reply with
> > > > [rt.rap.ucar.edu #96104] in the subj and it will continue the
thread
> > > > for this ticket.
> > > >
> > > > R/
> > > > John
> > > >
> > > > -----Original Message-----
> > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > Sent: Wednesday, August 5, 2020 10:21 AM
> > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > <john.w.raby2.civ at mail.mil>
> > > > Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > > reading NetCDF observation (UNCLASSIFIED)
> > > >
> > > > All active links contained in this email were disabled.
Please
> > > > verify the identity of the sender, and confirm the
authenticity of
> > > > all links contained within the message prior to copying and
pasting
> > > > the address to a Web browser.
> > > >
> > > >
> > > >
> > > >
> > > > ----
> > > >
> > > > John,
> > > >
> > > > Sorry for the delay on this. I ran into some bad luck, having
my dog
> > > > chew up a charging cable. I'm back up and running today and am
> > > > downloading your sample file over my very slow internet. I'll
let
> > > > you know what I find.
> > > >
> > > > John HG
> > > >
> > > > On Mon, Aug 3, 2020 at 1:28 PM Raby, John W USA CIV via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <Caution-Caution-Caution-Caution-url:
> > > > > Caution-Caution-Caution-Caution-
> https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > > html?id=96
> > > > > 104 >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > > Hi John -
> > > > >
> > > > > Thanks. I'll send you a link to download the file.
> > > > >
> > > > > R/
> > > > > John
> > > > >
> > > > > -----Original Message-----
> > > > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > > > Sent: Monday, August 3, 2020 1:24 PM
> > > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > > <john.w.raby2.civ at mail.mil>
> > > > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #96104]
trouble
> > > > > reading NetCDF observation (UNCLASSIFIED)
> > > > >
> > > > > All active links contained in this email were disabled.
Please
> > > > > verify the identity of the sender, and confirm the
authenticity of
> > > > > all links contained within the message prior to copying and
> > > > > pasting the address to a Web browser.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > ----
> > > > >
> > > > > Hello John,
> > > > >
> > > > > Yes, I'd need to take a look at your NetCDF file. If you're
able
> > > > > to ftp it, you could post it here:
> > > > > Caution-
> > > > > Caution-Caution-Caution-Caution-
> https://dtcenter.org/community-code/model-
> > > > > evaluation
> > > > > -tools-met
> > > > > /met-help-desk#ftp
> > > > >
> > > > > Otherwise, posting it somewhere else is fine.
> > > > >
> > > > > John
> > > > >
> > > > > On Mon, Aug 3, 2020 at 1:07 PM Raby, John W USA CIV via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Mon Aug 03 13:03:15 2020: Request 96104 was acted upon.
> > > > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > > > Queue: met_help
> > > > > > Subject: trouble reading NetCDF observation
(UNCLASSIFIED)
> > > > > > Owner: Nobody
> > > > > > Requestors: john.w.raby2.civ at mail.mil
> > > > > > Status: new
> > > > > > Ticket <Caution-Caution-Caution-Caution-Caution-url:
> > > > > > Caution-Caution-Caution-Caution-
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.
> > > > > > html?id=96
> > > > > > 104 >
> > > > > >
> > > > > >
> > > > > > CLASSIFICATION: UNCLASSIFIED
> > > > > >
> > > > > > I'm trying to run MET V9.0 Grid-Stat using WRF fcst output
and a
> > > > > > gridded radar observation in NetCDF format. The variable
I'm
> > > > > > trying to verify is the column max reflectivity which is a
2-D
> > > > > > variable named "CM". The attached log file shows that an
error
> > > > > > occurs due to inability to figure out the projection from
the
> > > > > > info
> > > in
> > > > > > the file.
> > > > > > Could you take a look to see what the issue is and why it
can't
> > > > > > get the projection info? I tried to attach the
observation
> > > > > > file, but it's too big. I can provide the fila via a
download
> > > > > > link sent to your email address.
> > > > > >
> > > > > > Thanks.
> > > > > >
> > > > > > R/
> > > > > > John
> > > > > >
> > > > > > Mr. John W. Raby
> > > > > > U.S. Army Research Laboratory
> > > > > > White Sands Missile Range, NM 88002
> > > > > > Office:(575) 678-2004 DSN 258-2004
> > > > > > Teleworking: Contact Admin Specialist at (410) 278-6974
FAX
> > > > > > (575)
> > > > > > 678-1230 DSN 258-1230
> > > > > > Email: john.w.raby2.civ at mail.mil
> > > > > >
> > > > > > CLASSIFICATION: UNCLASSIFIED
> > > > > >
> > > > > >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list