[Met_help] [rt.rap.ucar.edu #95858] History for MET V9.0 Point2Grid (UNCLASSIFIED)
John Halley Gotway via RT
met_help at ucar.edu
Tue Oct 13 10:04:57 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
CLASSIFICATION: UNCLASSIFIED
I'm having trouble with specifying the name/level of the TMP/Z2 variable
present in my output observation file generated by MET ASCII2NC. I tried the
following:
-field 'name="TMP"; level="(*,*)";'
But the following error is reported:
DEBUG 1: Reading data file:
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
elative.d01.2016-11-11_12:00:00.0000.nc
DEBUG 3: process_point_file() -> valid_time from input data:
20161111_123000
DEBUG 4: process_point_file() -> var: TMP, index: 0.
WARNING: get_grid_mapping() no valid point observation data
ERROR : process_point_file() -> No matching variable [TMP:0]
I've tried a few variations of the specification, but I can't get it to
work. What is the correct specification?
Thanks.
R/
John
Mr. John W. Raby
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
Office:(575) 678-2004 DSN 258-2004
Teleworking: Contact Admin Specialist at (410) 278-6974
FAX (575) 678-1230 DSN 258-1230
Email: john.w.raby2.civ at mail.mil
CLASSIFICATION: UNCLASSIFIED
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: MET V9.0 Point2Grid (UNCLASSIFIED)
From: Howard Soh
Time: Wed Jul 08 18:10:18 2020
The warning means no TMP data was mapped to the TO_GRID. The most
common case is that the spatial domain did not match between the point
observation data and TO_GRID. If you upload the output of ascii2nc to
our FTP server and inform us the target grid (name or file), we will
investigate the cause.
Meanwhile, you can check the existence of TMP data with re-gridding to
the global grid. For example G229 (global lat/lon grid with 1 degree
DX/DY).
./point2grid
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
level="(*,*)";'
And check the output with plot_data_plane:
./plot_data_plane my_output.nc my_test.ps 'name="TMP"; level="(*,*)";'
Cheers,
Howard
On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> I'm having trouble with specifying the name/level of the TMP/Z2
variable
> present in my output observation file generated by MET ASCII2NC. I
tried the
> following:
>
> -field 'name="TMP"; level="(*,*)";'
>
> But the following error is reported:
>
> DEBUG 1: Reading data file:
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> elative.d01.2016-11-11_12:00:00.0000.nc
> DEBUG 3: process_point_file() -> valid_time from input data:
> 20161111_123000
> DEBUG 4: process_point_file() -> var: TMP, index: 0.
> WARNING: get_grid_mapping() no valid point observation data
> ERROR : process_point_file() -> No matching variable [TMP:0]
>
> I've tried a few variations of the specification, but I can't get it
to
> work. What is the correct specification?
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
> CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Wed Jul 08 19:53:30 2020
Thanks for your diagnosis, Howard. So the source domain and the target
domains must be spatially the same. Assuming that my obs file does
contain the TMP vrbl, Could I rerun ascii2nc on the original obs text
file which produced NetCDF I was working with
(qc_obs_used_earth_relative.d01.2016-11-11_12:00:00.0000.nc) using the
optional argument -mask_poly to filter obs down to the same size area
as the grid I specified in TO_GRID?
R/
John
________________________________________
From: Howard Soh via RT [met_help at ucar.edu]
Sent: Wednesday, July 08, 2020 6:10 PM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid
(UNCLASSIFIED)
The warning means no TMP data was mapped to the TO_GRID. The most
common case is that the spatial domain did not match between the point
observation data and TO_GRID. If you upload the output of ascii2nc to
our FTP server and inform us the target grid (name or file), we will
investigate the cause.
Meanwhile, you can check the existence of TMP data with re-gridding to
the global grid. For example G229 (global lat/lon grid with 1 degree
DX/DY).
./point2grid
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
level="(*,*)";'
And check the output with plot_data_plane:
./plot_data_plane my_output.nc my_test.ps 'name="TMP"; level="(*,*)";'
Cheers,
Howard
On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> I'm having trouble with specifying the name/level of the TMP/Z2
variable
> present in my output observation file generated by MET ASCII2NC. I
tried the
> following:
>
> -field 'name="TMP"; level="(*,*)";'
>
> But the following error is reported:
>
> DEBUG 1: Reading data file:
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> elative.d01.2016-11-11_12:00:00.0000.nc
> DEBUG 3: process_point_file() -> valid_time from input data:
> 20161111_123000
> DEBUG 4: process_point_file() -> var: TMP, index: 0.
> WARNING: get_grid_mapping() no valid point observation data
> ERROR : process_point_file() -> No matching variable [TMP:0]
>
> I've tried a few variations of the specification, but I can't get it
to
> work. What is the correct specification?
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
> CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu Jul 09 14:33:29 2020
Howard -
I re-ran ascii2nc using the original text file containing the point
obs I want to use as input. I used the optional argument -mask_grid
string to specify a post-processed grib file produced by WRF
(WRFPRS_d03.03) with 1km grid spacing for the spatial domain I want.
The output file is qc_obs_used_earth_relative.d03.2016-11-
11_12_00_00.0000.nc. I then ran Point2Grid using the
command:
/usr/local/bin/point2grid
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
11-11_12:00:00.0000.nc
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
-field 'name="TMP"; level="(*,*)";' -log
/p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test -v 5
I received the same error as yesterday. There was an output file
generated and I plotted it using plot_data_plane, but the field was
all 0s over the WRF domain.
So I tried using the G229 grid per your suggestion:
/usr/local/bin/point2grid
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
11-11_12:00:00.0000.nc G229
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
-field 'name="TMP"; level="(*,*)";' -log
/p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test -v 5
I received the same error as before. There was an output file
generated and I plotted it using plot_data_plane, but the field was
all 0s over a global map.
If you could take a look at my data to see if you can figure out the
issue I would appreciate it. I can't use the ftp site because I'm on a
military network which blocks it. I do have access to a file exchange
service which has worked in the past when I've sent files to John
Halley Gotway. In these cases I use his ucar.edu email address. If you
could provide me with yours, I will send the data that way. You will
receive a link to download the files from the service (DoD SAFE).
Let me know if you need additional files besides the ones you
mentioned.
R/
John
________________________________________
From: Howard Soh via RT [met_help at ucar.edu]
Sent: Wednesday, July 08, 2020 6:10 PM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid
(UNCLASSIFIED)
The warning means no TMP data was mapped to the TO_GRID. The most
common case is that the spatial domain did not match between the point
observation data and TO_GRID. If you upload the output of ascii2nc to
our FTP server and inform us the target grid (name or file), we will
investigate the cause.
Meanwhile, you can check the existence of TMP data with re-gridding to
the global grid. For example G229 (global lat/lon grid with 1 degree
DX/DY).
./point2grid
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
level="(*,*)";'
And check the output with plot_data_plane:
./plot_data_plane my_output.nc my_test.ps 'name="TMP"; level="(*,*)";'
Cheers,
Howard
On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> I'm having trouble with specifying the name/level of the TMP/Z2
variable
> present in my output observation file generated by MET ASCII2NC. I
tried the
> following:
>
> -field 'name="TMP"; level="(*,*)";'
>
> But the following error is reported:
>
> DEBUG 1: Reading data file:
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> elative.d01.2016-11-11_12:00:00.0000.nc
> DEBUG 3: process_point_file() -> valid_time from input data:
> 20161111_123000
> DEBUG 4: process_point_file() -> var: TMP, index: 0.
> WARNING: get_grid_mapping() no valid point observation data
> ERROR : process_point_file() -> No matching variable [TMP:0]
>
> I've tried a few variations of the specification, but I can't get it
to
> work. What is the correct specification?
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
> CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: MET V9.0 Point2Grid (UNCLASSIFIED)
From: Howard Soh
Time: Thu Jul 09 14:57:26 2020
Would you upload the input and the output file of ascii2nc, and the
output of point2grid to our FTP server?
The instruction to upload file is available at the bottom of
https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk
Cheers,
Hoarwd
On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> Howard -
>
> I re-ran ascii2nc using the original text file containing the point
> obs I want to use as input. I used the optional argument -mask_grid
> string to specify a post-processed grib file produced by WRF
> (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I want.
> The output file is qc_obs_used_earth_relative.d03.2016-11-
> 11_12_00_00.0000.nc. I then ran Point2Grid using the
> command:
> /usr/local/bin/point2grid
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> 11-11_12:00:00.0000.nc
>
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
>
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> -field 'name="TMP"; level="(*,*)";' -log
> /p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test -v
5
>
> I received the same error as yesterday. There was an output file
> generated and I plotted it using plot_data_plane, but the field was
> all 0s over the WRF domain.
>
> So I tried using the G229 grid per your suggestion:
> /usr/local/bin/point2grid
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> 11-11_12:00:00.0000.nc G229
>
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> -field 'name="TMP"; level="(*,*)";' -log
> /p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test -v
5
>
> I received the same error as before. There was an output file
> generated and I plotted it using plot_data_plane, but the field was
> all 0s over a global map.
>
> If you could take a look at my data to see if you can figure out the
> issue I would appreciate it. I can't use the ftp site because I'm on
a
> military network which blocks it. I do have access to a file
exchange
> service which has worked in the past when I've sent files to John
> Halley Gotway. In these cases I use his ucar.edu email address. If
you
> could provide me with yours, I will send the data that way. You will
> receive a link to download the files from the service (DoD SAFE).
>
> Let me know if you need additional files besides the ones you
> mentioned.
>
> R/
> John
>
> ________________________________________
> From: Howard Soh via RT [met_help at ucar.edu]
> Sent: Wednesday, July 08, 2020 6:10 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid
> (UNCLASSIFIED)
>
> The warning means no TMP data was mapped to the TO_GRID. The most
> common case is that the spatial domain did not match between the
point
> observation data and TO_GRID. If you upload the output of ascii2nc
to
> our FTP server and inform us the target grid (name or file), we will
> investigate the cause.
>
> Meanwhile, you can check the existence of TMP data with re-gridding
to
> the global grid. For example G229 (global lat/lon grid with 1 degree
> DX/DY).
>
> ./point2grid
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> level="(*,*)";'
>
> And check the output with plot_data_plane:
>
> ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
level="(*,*)";'
>
> Cheers,
> Howard
>
> On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm having trouble with specifying the name/level of the TMP/Z2
> > variable
> > present in my output observation file generated by MET ASCII2NC. I
> > tried the
> > following:
> >
> > -field 'name="TMP"; level="(*,*)";'
> >
> > But the following error is reported:
> >
> > DEBUG 1: Reading data file:
> >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > elative.d01.2016-11-11_12:00:00.0000.nc
> > DEBUG 3: process_point_file() -> valid_time from input data:
> > 20161111_123000
> > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > WARNING: get_grid_mapping() no valid point observation data
> > ERROR : process_point_file() -> No matching variable [TMP:0]
> >
> > I've tried a few variations of the specification, but I can't get
it
> > to
> > work. What is the correct specification?
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974
> > FAX (575) 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu Jul 09 15:47:28 2020
Howard -
We are not allowed to use ftp since we are on a military network
(VPN). Can only use sftp or scp. Can I send you a link to download
them from the DoD Secure Access File Exchange?
R/
John
________________________________________
From: Howard Soh via RT [met_help at ucar.edu]
Sent: Thursday, July 09, 2020 2:57 PM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid
(UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.
----
Would you upload the input and the output file of ascii2nc, and the
output of point2grid to our FTP server?
The instruction to upload file is available at the bottom of Caution-
https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk
Cheers,
Hoarwd
On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> Howard -
>
> I re-ran ascii2nc using the original text file containing the point
> obs I want to use as input. I used the optional argument -mask_grid
> string to specify a post-processed grib file produced by WRF
> (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I want.
> The output file is qc_obs_used_earth_relative.d03.2016-11-
> 11_12_00_00.0000.nc. I then ran Point2Grid using the
> command:
> /usr/local/bin/point2grid
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> 11-11_12:00:00.0000.nc
>
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
>
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> -field 'name="TMP"; level="(*,*)";' -log
> /p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test -v
5
>
> I received the same error as yesterday. There was an output file
> generated and I plotted it using plot_data_plane, but the field was
> all 0s over the WRF domain.
>
> So I tried using the G229 grid per your suggestion:
> /usr/local/bin/point2grid
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> 11-11_12:00:00.0000.nc G229
>
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> -field 'name="TMP"; level="(*,*)";' -log
> /p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test -v
5
>
> I received the same error as before. There was an output file
> generated and I plotted it using plot_data_plane, but the field was
> all 0s over a global map.
>
> If you could take a look at my data to see if you can figure out the
> issue I would appreciate it. I can't use the ftp site because I'm on
a
> military network which blocks it. I do have access to a file
exchange
> service which has worked in the past when I've sent files to John
> Halley Gotway. In these cases I use his ucar.edu email address. If
you
> could provide me with yours, I will send the data that way. You will
> receive a link to download the files from the service (DoD SAFE).
>
> Let me know if you need additional files besides the ones you
> mentioned.
>
> R/
> John
>
> ________________________________________
> From: Howard Soh via RT [met_help at ucar.edu]
> Sent: Wednesday, July 08, 2020 6:10 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid
> (UNCLASSIFIED)
>
> The warning means no TMP data was mapped to the TO_GRID. The most
> common case is that the spatial domain did not match between the
point
> observation data and TO_GRID. If you upload the output of ascii2nc
to
> our FTP server and inform us the target grid (name or file), we will
> investigate the cause.
>
> Meanwhile, you can check the existence of TMP data with re-gridding
to
> the global grid. For example G229 (global lat/lon grid with 1 degree
> DX/DY).
>
> ./point2grid
>
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> level="(*,*)";'
>
> And check the output with plot_data_plane:
>
> ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
level="(*,*)";'
>
> Cheers,
> Howard
>
> On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm having trouble with specifying the name/level of the TMP/Z2
> > variable
> > present in my output observation file generated by MET ASCII2NC. I
> > tried the
> > following:
> >
> > -field 'name="TMP"; level="(*,*)";'
> >
> > But the following error is reported:
> >
> > DEBUG 1: Reading data file:
> >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > elative.d01.2016-11-11_12:00:00.0000.nc
> > DEBUG 3: process_point_file() -> valid_time from input data:
> > 20161111_123000
> > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > WARNING: get_grid_mapping() no valid point observation data
> > ERROR : process_point_file() -> No matching variable [TMP:0]
> >
> > I've tried a few variations of the specification, but I can't get
it
> > to
> > work. What is the correct specification?
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974
> > FAX (575) 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: MET V9.0 Point2Grid (UNCLASSIFIED)
From: Howard Soh
Time: Fri Jul 10 09:58:33 2020
Thank you for the files.
I can not reproduce the problem (value 0).
Would you run it again with "-v 9" and send me the log file (or attach
on this ticket)?
Commands and result by running point2grid and plot_data_plane.
./point2grid qc_obs_used_earth_relative.d03.2016-11-
11_12_00_00.0000.nc WRFPRS_d03.03 output_TMP_9.0.nc -field 'name="11";
level="*";' -v 9 > RT-95858.log
./plot_data_plane output_TMP_9.0.nc plot_TMP.ps 'name="TMP";
level="(*,*)";'
My run shows 179 out of 180 (99%) from the input belong to the target
grid cells (WRFPRS_d03.03) and mapped to 97 cells.
Cheers,
Howard
On Thu Jul 09 15:47:28 2020, john.w.raby2.civ at mail.mil wrote:
> Howard -
>
> We are not allowed to use ftp since we are on a military network
> (VPN). Can only use sftp or scp. Can I send you a link to download
> them from the DoD Secure Access File Exchange?
>
> R/
> John
> ________________________________________
> From: Howard Soh via RT [met_help at ucar.edu]
> Sent: Thursday, July 09, 2020 2:57 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid
> (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Would you upload the input and the output file of ascii2nc, and the
> output of point2grid to our FTP server?
>
> The instruction to upload file is available at the bottom of
Caution-
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
> help-desk
>
> Cheers,
> Hoarwd
>
> On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> > Howard -
> >
> > I re-ran ascii2nc using the original text file containing the
point
> > obs I want to use as input. I used the optional argument
-mask_grid
> > string to specify a post-processed grib file produced by WRF
> > (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I
want.
> > The output file is qc_obs_used_earth_relative.d03.2016-11-
> > 11_12_00_00.0000.nc. I then ran Point2Grid using the
> > command:
> > /usr/local/bin/point2grid
> >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > 11-11_12:00:00.0000.nc
> >
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
> >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> > -field 'name="TMP"; level="(*,*)";' -log
> > /p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test
-v 5
> >
> > I received the same error as yesterday. There was an output file
> > generated and I plotted it using plot_data_plane, but the field
was
> > all 0s over the WRF domain.
> >
> > So I tried using the G229 grid per your suggestion:
> > /usr/local/bin/point2grid
> >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > 11-11_12:00:00.0000.nc G229
> >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> > -field 'name="TMP"; level="(*,*)";' -log
> > /p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test
-v
> > 5
> >
> > I received the same error as before. There was an output file
> > generated and I plotted it using plot_data_plane, but the field
was
> > all 0s over a global map.
> >
> > If you could take a look at my data to see if you can figure out
the
> > issue I would appreciate it. I can't use the ftp site because I'm
on
> > a
> > military network which blocks it. I do have access to a file
exchange
> > service which has worked in the past when I've sent files to John
> > Halley Gotway. In these cases I use his ucar.edu email address. If
> > you
> > could provide me with yours, I will send the data that way. You
will
> > receive a link to download the files from the service (DoD SAFE).
> >
> > Let me know if you need additional files besides the ones you
> > mentioned.
> >
> > R/
> > John
> >
> > ________________________________________
> > From: Howard Soh via RT [met_help at ucar.edu]
> > Sent: Wednesday, July 08, 2020 6:10 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > Point2Grid
> > (UNCLASSIFIED)
> >
> > The warning means no TMP data was mapped to the TO_GRID. The most
> > common case is that the spatial domain did not match between the
> > point
> > observation data and TO_GRID. If you upload the output of ascii2nc
to
> > our FTP server and inform us the target grid (name or file), we
will
> > investigate the cause.
> >
> > Meanwhile, you can check the existence of TMP data with re-
gridding
> > to
> > the global grid. For example G229 (global lat/lon grid with 1
degree
> > DX/DY).
> >
> > ./point2grid
> >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> > 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> > level="(*,*)";'
> >
> > And check the output with plot_data_plane:
> >
> > ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
> > level="(*,*)";'
> >
> > Cheers,
> > Howard
> >
> > On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > I'm having trouble with specifying the name/level of the TMP/Z2
> > > variable
> > > present in my output observation file generated by MET ASCII2NC.
I
> > > tried the
> > > following:
> > >
> > > -field 'name="TMP"; level="(*,*)";'
> > >
> > > But the following error is reported:
> > >
> > > DEBUG 1: Reading data file:
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > > elative.d01.2016-11-11_12:00:00.0000.nc
> > > DEBUG 3: process_point_file() -> valid_time from input data:
> > > 20161111_123000
> > > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > > WARNING: get_grid_mapping() no valid point observation data
> > > ERROR : process_point_file() -> No matching variable [TMP:0]
> > >
> > > I've tried a few variations of the specification, but I can't
get
> > > it
> > > to
> > > work. What is the correct specification?
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974
> > > FAX (575) 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: MET V9.0 Point2Grid (UNCLASSIFIED)
From: Howard Soh
Time: Fri Jul 10 10:18:03 2020
The temperature variable (from little R format input) was saved with
the grib code "11" at the output of ascii2nc. point2grid was not able
to find the "TMP" variable.
The variable name can be used only if the output of ascii2nc has the
global attribute, use_var_id = "true". Otherwise, the grib code should
be used for point2grid. The available grib codes can be found at the
"obs_gc" variable. Please use the grib code instead of the variable
name.
Cheers,
Howard
On Fri Jul 10 09:58:33 2020, hsoh wrote:
> Thank you for the files.
>
> I can not reproduce the problem (value 0).
>
> Would you run it again with "-v 9" and send me the log file (or
attach
> on this ticket)?
>
> Commands and result by running point2grid and plot_data_plane.
>
> ./point2grid qc_obs_used_earth_relative.d03.2016-11-
> 11_12_00_00.0000.nc WRFPRS_d03.03 output_TMP_9.0.nc -field
'name="11";
> level="*";' -v 9 > RT-95858.log
> ./plot_data_plane output_TMP_9.0.nc plot_TMP.ps 'name="TMP";
> level="(*,*)";'
>
> My run shows 179 out of 180 (99%) from the input belong to the
target
> grid cells (WRFPRS_d03.03) and mapped to 97 cells.
>
> Cheers,
> Howard
>
> On Thu Jul 09 15:47:28 2020, john.w.raby2.civ at mail.mil wrote:
> > Howard -
> >
> > We are not allowed to use ftp since we are on a military network
> > (VPN). Can only use sftp or scp. Can I send you a link to download
> > them from the DoD Secure Access File Exchange?
> >
> > R/
> > John
> > ________________________________________
> > From: Howard Soh via RT [met_help at ucar.edu]
> > Sent: Thursday, July 09, 2020 2:57 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > Point2Grid
> > (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify
> > the identity of the sender, and confirm the authenticity of all
links
> > contained within the message prior to copying and pasting the
address
> > to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Would you upload the input and the output file of ascii2nc, and
the
> > output of point2grid to our FTP server?
> >
> > The instruction to upload file is available at the bottom of
Caution-
> > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-
> > help-desk
> >
> > Cheers,
> > Hoarwd
> >
> > On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> > > Howard -
> > >
> > > I re-ran ascii2nc using the original text file containing the
point
> > > obs I want to use as input. I used the optional argument
-mask_grid
> > > string to specify a post-processed grib file produced by WRF
> > > (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I
> > > want.
> > > The output file is qc_obs_used_earth_relative.d03.2016-11-
> > > 11_12_00_00.0000.nc. I then ran Point2Grid using the
> > > command:
> > > /usr/local/bin/point2grid
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > 11-11_12:00:00.0000.nc
> > >
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
> > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> > > -field 'name="TMP"; level="(*,*)";' -log
> > > /p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test
-v
> > > 5
> > >
> > > I received the same error as yesterday. There was an output file
> > > generated and I plotted it using plot_data_plane, but the field
was
> > > all 0s over the WRF domain.
> > >
> > > So I tried using the G229 grid per your suggestion:
> > > /usr/local/bin/point2grid
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > 11-11_12:00:00.0000.nc G229
> > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> > > -field 'name="TMP"; level="(*,*)";' -log
> > >
/p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test
> > > -v
> > > 5
> > >
> > > I received the same error as before. There was an output file
> > > generated and I plotted it using plot_data_plane, but the field
was
> > > all 0s over a global map.
> > >
> > > If you could take a look at my data to see if you can figure out
> > > the
> > > issue I would appreciate it. I can't use the ftp site because
I'm
> > > on
> > > a
> > > military network which blocks it. I do have access to a file
> > > exchange
> > > service which has worked in the past when I've sent files to
John
> > > Halley Gotway. In these cases I use his ucar.edu email address.
If
> > > you
> > > could provide me with yours, I will send the data that way. You
> > > will
> > > receive a link to download the files from the service (DoD
SAFE).
> > >
> > > Let me know if you need additional files besides the ones you
> > > mentioned.
> > >
> > > R/
> > > John
> > >
> > > ________________________________________
> > > From: Howard Soh via RT [met_help at ucar.edu]
> > > Sent: Wednesday, July 08, 2020 6:10 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > Point2Grid
> > > (UNCLASSIFIED)
> > >
> > > The warning means no TMP data was mapped to the TO_GRID. The
most
> > > common case is that the spatial domain did not match between the
> > > point
> > > observation data and TO_GRID. If you upload the output of
ascii2nc
> > > to
> > > our FTP server and inform us the target grid (name or file), we
> > > will
> > > investigate the cause.
> > >
> > > Meanwhile, you can check the existence of TMP data with re-
gridding
> > > to
> > > the global grid. For example G229 (global lat/lon grid with 1
> > > degree
> > > DX/DY).
> > >
> > > ./point2grid
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> > > 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> > > level="(*,*)";'
> > >
> > > And check the output with plot_data_plane:
> > >
> > > ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
> > > level="(*,*)";'
> > >
> > > Cheers,
> > > Howard
> > >
> > > On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > I'm having trouble with specifying the name/level of the
TMP/Z2
> > > > variable
> > > > present in my output observation file generated by MET
ASCII2NC.
> > > > I
> > > > tried the
> > > > following:
> > > >
> > > > -field 'name="TMP"; level="(*,*)";'
> > > >
> > > > But the following error is reported:
> > > >
> > > > DEBUG 1: Reading data file:
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > > > elative.d01.2016-11-11_12:00:00.0000.nc
> > > > DEBUG 3: process_point_file() -> valid_time from input data:
> > > > 20161111_123000
> > > > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > > > WARNING: get_grid_mapping() no valid point observation data
> > > > ERROR : process_point_file() -> No matching variable [TMP:0]
> > > >
> > > > I've tried a few variations of the specification, but I can't
get
> > > > it
> > > > to
> > > > work. What is the correct specification?
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974
> > > > FAX (575) 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri Jul 10 10:57:33 2020
Howard -
Glad you were able to use my data to successfully run Point2Grid and
for continuing the troubleshooting to identify the issue of the
variable ID. Thanks for pointing out how to get ascii2nc to output
"TMP" vice "11" (var_id = "true") and providing the option to use "11"
instead of "TMP" in point2grid. My experience with using the little_r
obs as input to ascii2nc has been good up until now with this issue.
For example, when I run point-stat using the little_r obs run through
ascii2nc, I use "TMP" for the config file setting with no problem, so
I guess I was used to just going with that format. I'll continue
testing with the 9 verbosity to see if I can get it running.
R/
John
________________________________________
From: Howard Soh via RT [met_help at ucar.edu]
Sent: Friday, July 10, 2020 10:18 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid
(UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.
----
The temperature variable (from little R format input) was saved with
the grib code "11" at the output of ascii2nc. point2grid was not able
to find the "TMP" variable.
The variable name can be used only if the output of ascii2nc has the
global attribute, use_var_id = "true". Otherwise, the grib code should
be used for point2grid. The available grib codes can be found at the
"obs_gc" variable. Please use the grib code instead of the variable
name.
Cheers,
Howard
On Fri Jul 10 09:58:33 2020, hsoh wrote:
> Thank you for the files.
>
> I can not reproduce the problem (value 0).
>
> Would you run it again with "-v 9" and send me the log file (or
attach
> on this ticket)?
>
> Commands and result by running point2grid and plot_data_plane.
>
> ./point2grid qc_obs_used_earth_relative.d03.2016-11-
> 11_12_00_00.0000.nc WRFPRS_d03.03 output_TMP_9.0.nc -field
'name="11";
> level="*";' -v 9 > RT-95858.log
> ./plot_data_plane output_TMP_9.0.nc plot_TMP.ps 'name="TMP";
> level="(*,*)";'
>
> My run shows 179 out of 180 (99%) from the input belong to the
target
> grid cells (WRFPRS_d03.03) and mapped to 97 cells.
>
> Cheers,
> Howard
>
> On Thu Jul 09 15:47:28 2020, john.w.raby2.civ at mail.mil wrote:
> > Howard -
> >
> > We are not allowed to use ftp since we are on a military network
> > (VPN). Can only use sftp or scp. Can I send you a link to download
> > them from the DoD Secure Access File Exchange?
> >
> > R/
> > John
> > ________________________________________
> > From: Howard Soh via RT [met_help at ucar.edu]
> > Sent: Thursday, July 09, 2020 2:57 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > Point2Grid
> > (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify
> > the identity of the sender, and confirm the authenticity of all
links
> > contained within the message prior to copying and pasting the
address
> > to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Would you upload the input and the output file of ascii2nc, and
the
> > output of point2grid to our FTP server?
> >
> > The instruction to upload file is available at the bottom of
Caution-
> > Caution-https://dtcenter.org/community-code/model-evaluation-
tools-met/met-
> > help-desk
> >
> > Cheers,
> > Hoarwd
> >
> > On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> > > Howard -
> > >
> > > I re-ran ascii2nc using the original text file containing the
point
> > > obs I want to use as input. I used the optional argument
-mask_grid
> > > string to specify a post-processed grib file produced by WRF
> > > (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I
> > > want.
> > > The output file is qc_obs_used_earth_relative.d03.2016-11-
> > > 11_12_00_00.0000.nc. I then ran Point2Grid using the
> > > command:
> > > /usr/local/bin/point2grid
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > 11-11_12:00:00.0000.nc
> > >
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
> > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> > > -field 'name="TMP"; level="(*,*)";' -log
> > > /p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test
-v
> > > 5
> > >
> > > I received the same error as yesterday. There was an output file
> > > generated and I plotted it using plot_data_plane, but the field
was
> > > all 0s over the WRF domain.
> > >
> > > So I tried using the G229 grid per your suggestion:
> > > /usr/local/bin/point2grid
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > 11-11_12:00:00.0000.nc G229
> > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> > > -field 'name="TMP"; level="(*,*)";' -log
> > >
/p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test
> > > -v
> > > 5
> > >
> > > I received the same error as before. There was an output file
> > > generated and I plotted it using plot_data_plane, but the field
was
> > > all 0s over a global map.
> > >
> > > If you could take a look at my data to see if you can figure out
> > > the
> > > issue I would appreciate it. I can't use the ftp site because
I'm
> > > on
> > > a
> > > military network which blocks it. I do have access to a file
> > > exchange
> > > service which has worked in the past when I've sent files to
John
> > > Halley Gotway. In these cases I use his ucar.edu email address.
If
> > > you
> > > could provide me with yours, I will send the data that way. You
> > > will
> > > receive a link to download the files from the service (DoD
SAFE).
> > >
> > > Let me know if you need additional files besides the ones you
> > > mentioned.
> > >
> > > R/
> > > John
> > >
> > > ________________________________________
> > > From: Howard Soh via RT [met_help at ucar.edu]
> > > Sent: Wednesday, July 08, 2020 6:10 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > Point2Grid
> > > (UNCLASSIFIED)
> > >
> > > The warning means no TMP data was mapped to the TO_GRID. The
most
> > > common case is that the spatial domain did not match between the
> > > point
> > > observation data and TO_GRID. If you upload the output of
ascii2nc
> > > to
> > > our FTP server and inform us the target grid (name or file), we
> > > will
> > > investigate the cause.
> > >
> > > Meanwhile, you can check the existence of TMP data with re-
gridding
> > > to
> > > the global grid. For example G229 (global lat/lon grid with 1
> > > degree
> > > DX/DY).
> > >
> > > ./point2grid
> > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> > > 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> > > level="(*,*)";'
> > >
> > > And check the output with plot_data_plane:
> > >
> > > ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
> > > level="(*,*)";'
> > >
> > > Cheers,
> > > Howard
> > >
> > > On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > I'm having trouble with specifying the name/level of the
TMP/Z2
> > > > variable
> > > > present in my output observation file generated by MET
ASCII2NC.
> > > > I
> > > > tried the
> > > > following:
> > > >
> > > > -field 'name="TMP"; level="(*,*)";'
> > > >
> > > > But the following error is reported:
> > > >
> > > > DEBUG 1: Reading data file:
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > > > elative.d01.2016-11-11_12:00:00.0000.nc
> > > > DEBUG 3: process_point_file() -> valid_time from input data:
> > > > 20161111_123000
> > > > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > > > WARNING: get_grid_mapping() no valid point observation data
> > > > ERROR : process_point_file() -> No matching variable [TMP:0]
> > > >
> > > > I've tried a few variations of the specification, but I can't
get
> > > > it
> > > > to
> > > > work. What is the correct specification?
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974
> > > > FAX (575) 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: MET V9.0 Point2Grid (UNCLASSIFIED)
From: Howard Soh
Time: Fri Jul 10 11:36:42 2020
The point2grid might be executed slowly with "-v 9". I recommend to
verbosity level 7 to 9 only if the point2grid does not work. Otherwise
3 or 4 will be enough.
It's convenient to use the variable name than the grib code. The
github issues was created (https://github.com/NCAR/MET/issues/1408).
I would like to close this ticket if there is no other issues.
Cheers,
Howard
On Fri Jul 10 10:57:33 2020, john.w.raby2.civ at mail.mil wrote:
> Howard -
>
> Glad you were able to use my data to successfully run Point2Grid and
> for continuing the troubleshooting to identify the issue of the
> variable ID. Thanks for pointing out how to get ascii2nc to output
> "TMP" vice "11" (var_id = "true") and providing the option to use
"11"
> instead of "TMP" in point2grid. My experience with using the
little_r
> obs as input to ascii2nc has been good up until now with this issue.
> For example, when I run point-stat using the little_r obs run
through
> ascii2nc, I use "TMP" for the config file setting with no problem,
so
> I guess I was used to just going with that format. I'll continue
> testing with the 9 verbosity to see if I can get it running.
>
> R/
> John
> ________________________________________
> From: Howard Soh via RT [met_help at ucar.edu]
> Sent: Friday, July 10, 2020 10:18 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid
> (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
> ----
>
> The temperature variable (from little R format input) was saved with
> the grib code "11" at the output of ascii2nc. point2grid was not
able
> to find the "TMP" variable.
>
> The variable name can be used only if the output of ascii2nc has the
> global attribute, use_var_id = "true". Otherwise, the grib code
should
> be used for point2grid. The available grib codes can be found at the
> "obs_gc" variable. Please use the grib code instead of the variable
> name.
>
> Cheers,
> Howard
>
> On Fri Jul 10 09:58:33 2020, hsoh wrote:
> > Thank you for the files.
> >
> > I can not reproduce the problem (value 0).
> >
> > Would you run it again with "-v 9" and send me the log file (or
> > attach
> > on this ticket)?
> >
> > Commands and result by running point2grid and plot_data_plane.
> >
> > ./point2grid qc_obs_used_earth_relative.d03.2016-11-
> > 11_12_00_00.0000.nc WRFPRS_d03.03 output_TMP_9.0.nc -field
> > 'name="11";
> > level="*";' -v 9 > RT-95858.log
> > ./plot_data_plane output_TMP_9.0.nc plot_TMP.ps 'name="TMP";
> > level="(*,*)";'
> >
> > My run shows 179 out of 180 (99%) from the input belong to the
target
> > grid cells (WRFPRS_d03.03) and mapped to 97 cells.
> >
> > Cheers,
> > Howard
> >
> > On Thu Jul 09 15:47:28 2020, john.w.raby2.civ at mail.mil wrote:
> > > Howard -
> > >
> > > We are not allowed to use ftp since we are on a military network
> > > (VPN). Can only use sftp or scp. Can I send you a link to
download
> > > them from the DoD Secure Access File Exchange?
> > >
> > > R/
> > > John
> > > ________________________________________
> > > From: Howard Soh via RT [met_help at ucar.edu]
> > > Sent: Thursday, July 09, 2020 2:57 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > Point2Grid
> > > (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify
> > > the identity of the sender, and confirm the authenticity of all
> > > links
> > > contained within the message prior to copying and pasting the
> > > address
> > > to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Would you upload the input and the output file of ascii2nc, and
the
> > > output of point2grid to our FTP server?
> > >
> > > The instruction to upload file is available at the bottom of
> > > Caution-
> > > Caution-https://dtcenter.org/community-code/model-evaluation-
tools-
> > > met/met-
> > > help-desk
> > >
> > > Cheers,
> > > Hoarwd
> > >
> > > On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> > > > Howard -
> > > >
> > > > I re-ran ascii2nc using the original text file containing the
> > > > point
> > > > obs I want to use as input. I used the optional argument
> > > > -mask_grid
> > > > string to specify a post-processed grib file produced by WRF
> > > > (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I
> > > > want.
> > > > The output file is qc_obs_used_earth_relative.d03.2016-11-
> > > > 11_12_00_00.0000.nc. I then ran Point2Grid using the
> > > > command:
> > > > /usr/local/bin/point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > > 11-11_12:00:00.0000.nc
> > > >
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
> > > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> > > > -field 'name="TMP"; level="(*,*)";' -log
> > > >
/p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test
> > > > -v
> > > > 5
> > > >
> > > > I received the same error as yesterday. There was an output
file
> > > > generated and I plotted it using plot_data_plane, but the
field
> > > > was
> > > > all 0s over the WRF domain.
> > > >
> > > > So I tried using the G229 grid per your suggestion:
> > > > /usr/local/bin/point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > > 11-11_12:00:00.0000.nc G229
> > > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> > > > -field 'name="TMP"; level="(*,*)";' -log
> > > >
/p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test
> > > > -v
> > > > 5
> > > >
> > > > I received the same error as before. There was an output file
> > > > generated and I plotted it using plot_data_plane, but the
field
> > > > was
> > > > all 0s over a global map.
> > > >
> > > > If you could take a look at my data to see if you can figure
out
> > > > the
> > > > issue I would appreciate it. I can't use the ftp site because
I'm
> > > > on
> > > > a
> > > > military network which blocks it. I do have access to a file
> > > > exchange
> > > > service which has worked in the past when I've sent files to
John
> > > > Halley Gotway. In these cases I use his ucar.edu email
address.
> > > > If
> > > > you
> > > > could provide me with yours, I will send the data that way.
You
> > > > will
> > > > receive a link to download the files from the service (DoD
SAFE).
> > > >
> > > > Let me know if you need additional files besides the ones you
> > > > mentioned.
> > > >
> > > > R/
> > > > John
> > > >
> > > > ________________________________________
> > > > From: Howard Soh via RT [met_help at ucar.edu]
> > > > Sent: Wednesday, July 08, 2020 6:10 PM
> > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > > Point2Grid
> > > > (UNCLASSIFIED)
> > > >
> > > > The warning means no TMP data was mapped to the TO_GRID. The
most
> > > > common case is that the spatial domain did not match between
the
> > > > point
> > > > observation data and TO_GRID. If you upload the output of
> > > > ascii2nc
> > > > to
> > > > our FTP server and inform us the target grid (name or file),
we
> > > > will
> > > > investigate the cause.
> > > >
> > > > Meanwhile, you can check the existence of TMP data with re-
> > > > gridding
> > > > to
> > > > the global grid. For example G229 (global lat/lon grid with 1
> > > > degree
> > > > DX/DY).
> > > >
> > > > ./point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> > > > 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> > > > level="(*,*)";'
> > > >
> > > > And check the output with plot_data_plane:
> > > >
> > > > ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
> > > > level="(*,*)";'
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > > I'm having trouble with specifying the name/level of the
TMP/Z2
> > > > > variable
> > > > > present in my output observation file generated by MET
> > > > > ASCII2NC.
> > > > > I
> > > > > tried the
> > > > > following:
> > > > >
> > > > > -field 'name="TMP"; level="(*,*)";'
> > > > >
> > > > > But the following error is reported:
> > > > >
> > > > > DEBUG 1: Reading data file:
> > > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > > > > elative.d01.2016-11-11_12:00:00.0000.nc
> > > > > DEBUG 3: process_point_file() -> valid_time from input
data:
> > > > > 20161111_123000
> > > > > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > > > > WARNING: get_grid_mapping() no valid point observation data
> > > > > ERROR : process_point_file() -> No matching variable
[TMP:0]
> > > > >
> > > > > I've tried a few variations of the specification, but I
can't
> > > > > get
> > > > > it
> > > > > to
> > > > > work. What is the correct specification?
> > > > >
> > > > > Thanks.
> > > > >
> > > > > R/
> > > > > John
> > > > >
> > > > > Mr. John W. Raby
> > > > > U.S. Army Research Laboratory
> > > > > White Sands Missile Range, NM 88002
> > > > > Office:(575) 678-2004 DSN 258-2004
> > > > > Teleworking: Contact Admin Specialist at (410) 278-6974
> > > > > FAX (575) 678-1230 DSN 258-1230
> > > > > Email: john.w.raby2.civ at mail.mil
> > > > >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri Jul 10 11:45:42 2020
Howard -
Thanks for the guidance on the verbosity. I was wondering what the
limit was and had never used 9 before. Based on your diagnosis with
suggestions for the fix, I concur that you can close this ticket. I'll
have a chance to do more testing over the weekend and if there is an
issue I can't resolveI can always start a new one.
Take care and thanks for all your help on this.
R/
John
________________________________________
From: Howard Soh via RT [met_help at ucar.edu]
Sent: Friday, July 10, 2020 11:36 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid
(UNCLASSIFIED)
The point2grid might be executed slowly with "-v 9". I recommend to
verbosity level 7 to 9 only if the point2grid does not work. Otherwise
3 or 4 will be enough.
It's convenient to use the variable name than the grib code. The
github issues was created (https://github.com/NCAR/MET/issues/1408).
I would like to close this ticket if there is no other issues.
Cheers,
Howard
On Fri Jul 10 10:57:33 2020, john.w.raby2.civ at mail.mil wrote:
> Howard -
>
> Glad you were able to use my data to successfully run Point2Grid and
> for continuing the troubleshooting to identify the issue of the
> variable ID. Thanks for pointing out how to get ascii2nc to output
> "TMP" vice "11" (var_id = "true") and providing the option to use
"11"
> instead of "TMP" in point2grid. My experience with using the
little_r
> obs as input to ascii2nc has been good up until now with this issue.
> For example, when I run point-stat using the little_r obs run
through
> ascii2nc, I use "TMP" for the config file setting with no problem,
so
> I guess I was used to just going with that format. I'll continue
> testing with the 9 verbosity to see if I can get it running.
>
> R/
> John
> ________________________________________
> From: Howard Soh via RT [met_help at ucar.edu]
> Sent: Friday, July 10, 2020 10:18 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid
> (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
> ----
>
> The temperature variable (from little R format input) was saved with
> the grib code "11" at the output of ascii2nc. point2grid was not
able
> to find the "TMP" variable.
>
> The variable name can be used only if the output of ascii2nc has the
> global attribute, use_var_id = "true". Otherwise, the grib code
should
> be used for point2grid. The available grib codes can be found at the
> "obs_gc" variable. Please use the grib code instead of the variable
> name.
>
> Cheers,
> Howard
>
> On Fri Jul 10 09:58:33 2020, hsoh wrote:
> > Thank you for the files.
> >
> > I can not reproduce the problem (value 0).
> >
> > Would you run it again with "-v 9" and send me the log file (or
> > attach
> > on this ticket)?
> >
> > Commands and result by running point2grid and plot_data_plane.
> >
> > ./point2grid qc_obs_used_earth_relative.d03.2016-11-
> > 11_12_00_00.0000.nc WRFPRS_d03.03 output_TMP_9.0.nc -field
> > 'name="11";
> > level="*";' -v 9 > RT-95858.log
> > ./plot_data_plane output_TMP_9.0.nc plot_TMP.ps 'name="TMP";
> > level="(*,*)";'
> >
> > My run shows 179 out of 180 (99%) from the input belong to the
target
> > grid cells (WRFPRS_d03.03) and mapped to 97 cells.
> >
> > Cheers,
> > Howard
> >
> > On Thu Jul 09 15:47:28 2020, john.w.raby2.civ at mail.mil wrote:
> > > Howard -
> > >
> > > We are not allowed to use ftp since we are on a military network
> > > (VPN). Can only use sftp or scp. Can I send you a link to
download
> > > them from the DoD Secure Access File Exchange?
> > >
> > > R/
> > > John
> > > ________________________________________
> > > From: Howard Soh via RT [met_help at ucar.edu]
> > > Sent: Thursday, July 09, 2020 2:57 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > Point2Grid
> > > (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify
> > > the identity of the sender, and confirm the authenticity of all
> > > links
> > > contained within the message prior to copying and pasting the
> > > address
> > > to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Would you upload the input and the output file of ascii2nc, and
the
> > > output of point2grid to our FTP server?
> > >
> > > The instruction to upload file is available at the bottom of
> > > Caution-
> > > Caution-https://dtcenter.org/community-code/model-evaluation-
tools-
> > > met/met-
> > > help-desk
> > >
> > > Cheers,
> > > Hoarwd
> > >
> > > On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> > > > Howard -
> > > >
> > > > I re-ran ascii2nc using the original text file containing the
> > > > point
> > > > obs I want to use as input. I used the optional argument
> > > > -mask_grid
> > > > string to specify a post-processed grib file produced by WRF
> > > > (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I
> > > > want.
> > > > The output file is qc_obs_used_earth_relative.d03.2016-11-
> > > > 11_12_00_00.0000.nc. I then ran Point2Grid using the
> > > > command:
> > > > /usr/local/bin/point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > > 11-11_12:00:00.0000.nc
> > > >
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
> > > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> > > > -field 'name="TMP"; level="(*,*)";' -log
> > > >
/p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test
> > > > -v
> > > > 5
> > > >
> > > > I received the same error as yesterday. There was an output
file
> > > > generated and I plotted it using plot_data_plane, but the
field
> > > > was
> > > > all 0s over the WRF domain.
> > > >
> > > > So I tried using the G229 grid per your suggestion:
> > > > /usr/local/bin/point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > > 11-11_12:00:00.0000.nc G229
> > > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> > > > -field 'name="TMP"; level="(*,*)";' -log
> > > >
/p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test
> > > > -v
> > > > 5
> > > >
> > > > I received the same error as before. There was an output file
> > > > generated and I plotted it using plot_data_plane, but the
field
> > > > was
> > > > all 0s over a global map.
> > > >
> > > > If you could take a look at my data to see if you can figure
out
> > > > the
> > > > issue I would appreciate it. I can't use the ftp site because
I'm
> > > > on
> > > > a
> > > > military network which blocks it. I do have access to a file
> > > > exchange
> > > > service which has worked in the past when I've sent files to
John
> > > > Halley Gotway. In these cases I use his ucar.edu email
address.
> > > > If
> > > > you
> > > > could provide me with yours, I will send the data that way.
You
> > > > will
> > > > receive a link to download the files from the service (DoD
SAFE).
> > > >
> > > > Let me know if you need additional files besides the ones you
> > > > mentioned.
> > > >
> > > > R/
> > > > John
> > > >
> > > > ________________________________________
> > > > From: Howard Soh via RT [met_help at ucar.edu]
> > > > Sent: Wednesday, July 08, 2020 6:10 PM
> > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > > Point2Grid
> > > > (UNCLASSIFIED)
> > > >
> > > > The warning means no TMP data was mapped to the TO_GRID. The
most
> > > > common case is that the spatial domain did not match between
the
> > > > point
> > > > observation data and TO_GRID. If you upload the output of
> > > > ascii2nc
> > > > to
> > > > our FTP server and inform us the target grid (name or file),
we
> > > > will
> > > > investigate the cause.
> > > >
> > > > Meanwhile, you can check the existence of TMP data with re-
> > > > gridding
> > > > to
> > > > the global grid. For example G229 (global lat/lon grid with 1
> > > > degree
> > > > DX/DY).
> > > >
> > > > ./point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> > > > 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> > > > level="(*,*)";'
> > > >
> > > > And check the output with plot_data_plane:
> > > >
> > > > ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
> > > > level="(*,*)";'
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > > I'm having trouble with specifying the name/level of the
TMP/Z2
> > > > > variable
> > > > > present in my output observation file generated by MET
> > > > > ASCII2NC.
> > > > > I
> > > > > tried the
> > > > > following:
> > > > >
> > > > > -field 'name="TMP"; level="(*,*)";'
> > > > >
> > > > > But the following error is reported:
> > > > >
> > > > > DEBUG 1: Reading data file:
> > > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > > > > elative.d01.2016-11-11_12:00:00.0000.nc
> > > > > DEBUG 3: process_point_file() -> valid_time from input
data:
> > > > > 20161111_123000
> > > > > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > > > > WARNING: get_grid_mapping() no valid point observation data
> > > > > ERROR : process_point_file() -> No matching variable
[TMP:0]
> > > > >
> > > > > I've tried a few variations of the specification, but I
can't
> > > > > get
> > > > > it
> > > > > to
> > > > > work. What is the correct specification?
> > > > >
> > > > > Thanks.
> > > > >
> > > > > R/
> > > > > John
> > > > >
> > > > > Mr. John W. Raby
> > > > > U.S. Army Research Laboratory
> > > > > White Sands Missile Range, NM 88002
> > > > > Office:(575) 678-2004 DSN 258-2004
> > > > > Teleworking: Contact Admin Specialist at (410) 278-6974
> > > > > FAX (575) 678-1230 DSN 258-1230
> > > > > Email: john.w.raby2.civ at mail.mil
> > > > >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri Jul 10 21:03:34 2020
Howard -
I just ran point2grid successfully using "11" vice "TMP". The to_grid
was the WRF fcst file.
Thanks for your help.
R/
John
________________________________________
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Friday, July 10, 2020 11:45 AM
To: met_help at ucar.edu
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid (UNCLASSIFIED)
Howard -
Thanks for the guidance on the verbosity. I was wondering what the
limit was and had never used 9 before. Based on your diagnosis with
suggestions for the fix, I concur that you can close this ticket. I'll
have a chance to do more testing over the weekend and if there is an
issue I can't resolveI can always start a new one.
Take care and thanks for all your help on this.
R/
John
________________________________________
From: Howard Soh via RT [met_help at ucar.edu]
Sent: Friday, July 10, 2020 11:36 AM
To: Raby, John W CIV USARMY CCDC ARL (USA)
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0 Point2Grid
(UNCLASSIFIED)
The point2grid might be executed slowly with "-v 9". I recommend to
verbosity level 7 to 9 only if the point2grid does not work. Otherwise
3 or 4 will be enough.
It's convenient to use the variable name than the grib code. The
github issues was created (https://github.com/NCAR/MET/issues/1408).
I would like to close this ticket if there is no other issues.
Cheers,
Howard
On Fri Jul 10 10:57:33 2020, john.w.raby2.civ at mail.mil wrote:
> Howard -
>
> Glad you were able to use my data to successfully run Point2Grid and
> for continuing the troubleshooting to identify the issue of the
> variable ID. Thanks for pointing out how to get ascii2nc to output
> "TMP" vice "11" (var_id = "true") and providing the option to use
"11"
> instead of "TMP" in point2grid. My experience with using the
little_r
> obs as input to ascii2nc has been good up until now with this issue.
> For example, when I run point-stat using the little_r obs run
through
> ascii2nc, I use "TMP" for the config file setting with no problem,
so
> I guess I was used to just going with that format. I'll continue
> testing with the 9 verbosity to see if I can get it running.
>
> R/
> John
> ________________________________________
> From: Howard Soh via RT [met_help at ucar.edu]
> Sent: Friday, July 10, 2020 10:18 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
Point2Grid
> (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
> ----
>
> The temperature variable (from little R format input) was saved with
> the grib code "11" at the output of ascii2nc. point2grid was not
able
> to find the "TMP" variable.
>
> The variable name can be used only if the output of ascii2nc has the
> global attribute, use_var_id = "true". Otherwise, the grib code
should
> be used for point2grid. The available grib codes can be found at the
> "obs_gc" variable. Please use the grib code instead of the variable
> name.
>
> Cheers,
> Howard
>
> On Fri Jul 10 09:58:33 2020, hsoh wrote:
> > Thank you for the files.
> >
> > I can not reproduce the problem (value 0).
> >
> > Would you run it again with "-v 9" and send me the log file (or
> > attach
> > on this ticket)?
> >
> > Commands and result by running point2grid and plot_data_plane.
> >
> > ./point2grid qc_obs_used_earth_relative.d03.2016-11-
> > 11_12_00_00.0000.nc WRFPRS_d03.03 output_TMP_9.0.nc -field
> > 'name="11";
> > level="*";' -v 9 > RT-95858.log
> > ./plot_data_plane output_TMP_9.0.nc plot_TMP.ps 'name="TMP";
> > level="(*,*)";'
> >
> > My run shows 179 out of 180 (99%) from the input belong to the
target
> > grid cells (WRFPRS_d03.03) and mapped to 97 cells.
> >
> > Cheers,
> > Howard
> >
> > On Thu Jul 09 15:47:28 2020, john.w.raby2.civ at mail.mil wrote:
> > > Howard -
> > >
> > > We are not allowed to use ftp since we are on a military network
> > > (VPN). Can only use sftp or scp. Can I send you a link to
download
> > > them from the DoD Secure Access File Exchange?
> > >
> > > R/
> > > John
> > > ________________________________________
> > > From: Howard Soh via RT [met_help at ucar.edu]
> > > Sent: Thursday, July 09, 2020 2:57 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > Point2Grid
> > > (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify
> > > the identity of the sender, and confirm the authenticity of all
> > > links
> > > contained within the message prior to copying and pasting the
> > > address
> > > to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Would you upload the input and the output file of ascii2nc, and
the
> > > output of point2grid to our FTP server?
> > >
> > > The instruction to upload file is available at the bottom of
> > > Caution-
> > > Caution-https://dtcenter.org/community-code/model-evaluation-
tools-
> > > met/met-
> > > help-desk
> > >
> > > Cheers,
> > > Hoarwd
> > >
> > > On Thu Jul 09 14:33:29 2020, john.w.raby2.civ at mail.mil wrote:
> > > > Howard -
> > > >
> > > > I re-ran ascii2nc using the original text file containing the
> > > > point
> > > > obs I want to use as input. I used the optional argument
> > > > -mask_grid
> > > > string to specify a post-processed grib file produced by WRF
> > > > (WRFPRS_d03.03) with 1km grid spacing for the spatial domain I
> > > > want.
> > > > The output file is qc_obs_used_earth_relative.d03.2016-11-
> > > > 11_12_00_00.0000.nc. I then ran Point2Grid using the
> > > > command:
> > > > /usr/local/bin/point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > > 11-11_12:00:00.0000.nc
> > > >
/p/home/jraby/MET_WRFpostprd/20161111_MSAregion_Reen/20161111/WRFPRS_d03.03
> > > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/1km_TMP_1200UTC_11NOV2016
> > > > -field 'name="TMP"; level="(*,*)";' -log
> > > >
/p/home/jraby/MET/MET_Point2Grid/logs/1km_TMP_12Z_11NOV2016_test
> > > > -v
> > > > 5
> > > >
> > > > I received the same error as yesterday. There was an output
file
> > > > generated and I plotted it using plot_data_plane, but the
field
> > > > was
> > > > all 0s over the WRF domain.
> > > >
> > > > So I tried using the G229 grid per your suggestion:
> > > > /usr/local/bin/point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/TXT_files/qc_obs_used_earth_relative.d03.2016-
> > > > 11-11_12:00:00.0000.nc G229
> > > >
/p/home/jraby/MET/MET_Point2Grid/results_P2G_test/G229_TMP_1200UTC_11NOV2016.nc
> > > > -field 'name="TMP"; level="(*,*)";' -log
> > > >
/p/home/jraby/MET/MET_Point2Grid/logs/G229_TMP_12Z_11NOV2016_test
> > > > -v
> > > > 5
> > > >
> > > > I received the same error as before. There was an output file
> > > > generated and I plotted it using plot_data_plane, but the
field
> > > > was
> > > > all 0s over a global map.
> > > >
> > > > If you could take a look at my data to see if you can figure
out
> > > > the
> > > > issue I would appreciate it. I can't use the ftp site because
I'm
> > > > on
> > > > a
> > > > military network which blocks it. I do have access to a file
> > > > exchange
> > > > service which has worked in the past when I've sent files to
John
> > > > Halley Gotway. In these cases I use his ucar.edu email
address.
> > > > If
> > > > you
> > > > could provide me with yours, I will send the data that way.
You
> > > > will
> > > > receive a link to download the files from the service (DoD
SAFE).
> > > >
> > > > Let me know if you need additional files besides the ones you
> > > > mentioned.
> > > >
> > > > R/
> > > > John
> > > >
> > > > ________________________________________
> > > > From: Howard Soh via RT [met_help at ucar.edu]
> > > > Sent: Wednesday, July 08, 2020 6:10 PM
> > > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > > Subject: [Non-DoD Source] [rt.rap.ucar.edu #95858] MET V9.0
> > > > Point2Grid
> > > > (UNCLASSIFIED)
> > > >
> > > > The warning means no TMP data was mapped to the TO_GRID. The
most
> > > > common case is that the spatial domain did not match between
the
> > > > point
> > > > observation data and TO_GRID. If you upload the output of
> > > > ascii2nc
> > > > to
> > > > our FTP server and inform us the target grid (name or file),
we
> > > > will
> > > > investigate the cause.
> > > >
> > > > Meanwhile, you can check the existence of TMP data with re-
> > > > gridding
> > > > to
> > > > the global grid. For example G229 (global lat/lon grid with 1
> > > > degree
> > > > DX/DY).
> > > >
> > > > ./point2grid
> > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_relative.d01.2016-
> > > > 11-11_12:00:00.0000.nc G229 my_output.nc -field 'name="TMP";
> > > > level="(*,*)";'
> > > >
> > > > And check the output with plot_data_plane:
> > > >
> > > > ./plot_data_plane my_output.nc my_test.ps 'name="TMP";
> > > > level="(*,*)";'
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Wed Jul 08 16:54:27 2020, john.w.raby2.civ at mail.mil wrote:
> > > > > CLASSIFICATION: UNCLASSIFIED
> > > > >
> > > > > I'm having trouble with specifying the name/level of the
TMP/Z2
> > > > > variable
> > > > > present in my output observation file generated by MET
> > > > > ASCII2NC.
> > > > > I
> > > > > tried the
> > > > > following:
> > > > >
> > > > > -field 'name="TMP"; level="(*,*)";'
> > > > >
> > > > > But the following error is reported:
> > > > >
> > > > > DEBUG 1: Reading data file:
> > > > >
/p/home/jraby/MET_obs/little_r/20161111_MSAregion_winter/qc_obs_used_earth_r
> > > > > elative.d01.2016-11-11_12:00:00.0000.nc
> > > > > DEBUG 3: process_point_file() -> valid_time from input
data:
> > > > > 20161111_123000
> > > > > DEBUG 4: process_point_file() -> var: TMP, index: 0.
> > > > > WARNING: get_grid_mapping() no valid point observation data
> > > > > ERROR : process_point_file() -> No matching variable
[TMP:0]
> > > > >
> > > > > I've tried a few variations of the specification, but I
can't
> > > > > get
> > > > > it
> > > > > to
> > > > > work. What is the correct specification?
> > > > >
> > > > > Thanks.
> > > > >
> > > > > R/
> > > > > John
> > > > >
> > > > > Mr. John W. Raby
> > > > > U.S. Army Research Laboratory
> > > > > White Sands Missile Range, NM 88002
> > > > > Office:(575) 678-2004 DSN 258-2004
> > > > > Teleworking: Contact Admin Specialist at (410) 278-6974
> > > > > FAX (575) 678-1230 DSN 258-1230
> > > > > Email: john.w.raby2.civ at mail.mil
> > > > >
> > > > >
> > > > > CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
More information about the Met_help
mailing list