[Met_help] [rt.rap.ucar.edu #87661] History for Error Using NetCDF File as Mask in MODE Config File
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:07:17 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi Met Help,
I am trying to use a NetCDF file as a mask in my MODE config file and am
having issues getting MODE to run. I successfully ran MODE using a .poly
mask file, however I used gen_vs_mask to create a clipped version of the
custom mask I am using. Within the config file, this mask works correctly:
mask = {
grid = "";
grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
poly =
"/export/hpc-lw-hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/CONUS.poly";
poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
}
When changed to use a NetCDF file in this syntax, it does not work:
mask = {
grid = "";
grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
poly =
["/export/hpc-lw-hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_2p5km.nc
{name = \"GRL\"; level = \"R0\";}>=1.0"];
poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
}
DEBUG 1: Default Config File:
/opt/MET6/met6.0/share/met/config/MODEConfig_default
DEBUG 1: Match Config File:
/export/hpc-lw-hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
DEBUG 1: Merge Config File:
/export/hpc-lw-hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
WARNING:
WARNING: MetGrib2DataFile::read_grib2_grid() -> MET does not currently
support Lambert Conformal grids where dx (5.07941) != dy (5.0794) and may
produce unexpected results!
WARNING:
ERROR :
ERROR : Dictionary::lookup_string() -> lookup failed for name "mask.poly"
ERROR :
I'm using Met6.0. I've attached the following:
1. Config file
2. Forecast grib2 file
3. Analysis grib2 file
4. .poly mask that works
5. NetCDF file mask that I want to use
Other colleagues have used NetCDF files as masks for other MET applications
but not MODE specifically like this. Please let me know if you need any
other information or files. Any help or ideas would be appreciated, thanks!
Ben
GRL_2p5km.nc
<https://drive.google.com/a/noaa.gov/file/d/1a1q-VyxbBB8LHW9diyXM5TjBYF6swsvU/view?usp=drive_web>
--
Benjamin Albright, Phd.
Meteorological Developer
Systems Research Group, Inc.
NOAA/NWS/Weather Prediction Center
Work email: benjamin.albright at noaa.gov
Work phone: 301-683-1474
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Error Using NetCDF File as Mask in MODE Config File
From: John Halley Gotway
Time: Mon Nov 05 14:27:43 2018
Ben,
I see you're having trouble defining a NetCDF masking region for MODE.
Good news, this one is easy to solve. The problem is that you've
defined
"mask.poly" as an array of length 1:
poly =
["/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_
2p5km.nc
{name = \"GRL\"; level = \"R0\";}>=1.0"];
Those square brackets indicate that the value is an array. Unlike
Grid-Stat and Point-Stat which process multiple masking regions in a
single
run, MODE only processes one. So you should configure it without the
square brackets. Additionally, you shouldn't need to specify the
"name"
and "level". It should be smart enough to read the output of
gen_vx_mask
directly.
Please try using the following setting:
* poly = "/export/hpc-lw-
hmtdev2/balbr**ight/Desktop/met/qpf_verif/**grid_stat/masks/GRL_2p5km.nc
<http://2p5km.nc>";*
Does that behave better?
Thanks,
John
On Mon, Nov 5, 2018 at 1:20 PM Benjamin Albright - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> Mon Nov 05 13:20:41 2018: Request 87661 was acted upon.
> Transaction: Ticket created by benjamin.albright at noaa.gov
> Queue: met_help
> Subject: Error Using NetCDF File as Mask in MODE Config File
> Owner: Nobody
> Requestors: benjamin.albright at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87661 >
>
>
> Hi Met Help,
>
> I am trying to use a NetCDF file as a mask in my MODE config file
and am
> having issues getting MODE to run. I successfully ran MODE using a
.poly
> mask file, however I used gen_vs_mask to create a clipped version of
the
> custom mask I am using. Within the config file, this mask works
correctly:
>
> mask = {
> grid = "";
> grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
> poly =
>
> "/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/CONUS.poly";
> poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
> }
>
> When changed to use a NetCDF file in this syntax, it does not work:
>
> mask = {
> grid = "";
> grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
> poly =
>
> ["/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_
> 2p5km.nc
> {name = \"GRL\"; level = \"R0\";}>=1.0"];
> poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
> }
>
> DEBUG 1: Default Config File:
> /opt/MET6/met6.0/share/met/config/MODEConfig_default
> DEBUG 1: Match Config File:
>
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> DEBUG 1: Merge Config File:
>
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> WARNING:
> WARNING: MetGrib2DataFile::read_grib2_grid() -> MET does not
currently
> support Lambert Conformal grids where dx (5.07941) != dy (5.0794)
and may
> produce unexpected results!
> WARNING:
> ERROR :
> ERROR : Dictionary::lookup_string() -> lookup failed for name
"mask.poly"
> ERROR :
>
> I'm using Met6.0. I've attached the following:
> 1. Config file
> 2. Forecast grib2 file
> 3. Analysis grib2 file
> 4. .poly mask that works
> 5. NetCDF file mask that I want to use
>
> Other colleagues have used NetCDF files as masks for other MET
applications
> but not MODE specifically like this. Please let me know if you need
any
> other information or files. Any help or ideas would be appreciated,
> thanks!
>
> Ben
> GRL_2p5km.nc
> <
> https://drive.google.com/a/noaa.gov/file/d/1a1q-
VyxbBB8LHW9diyXM5TjBYF6swsvU/view?usp=drive_web
> >
>
> --
> Benjamin Albright, Phd.
> Meteorological Developer
> Systems Research Group, Inc.
> NOAA/NWS/Weather Prediction Center
> Work email: benjamin.albright at noaa.gov
> Work phone: 301-683-1474
>
>
------------------------------------------------
Subject: Error Using NetCDF File as Mask in MODE Config File
From: Benjamin Albright - NOAA Affiliate
Time: Tue Nov 06 05:34:17 2018
Hi John,
Thank you, that did work better. I think I have an error with my
actual
mask though since when I run it I get the following message:
DEBUG 1: Default Config File:
/opt/MET6/met6.0/share/met/config/MODEConfig_default
DEBUG 1: Match Config File:
/export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
DEBUG 1: Merge Config File:
/export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
WARNING:
WARNING: MetGrib2DataFile::read_grib2_grid() -> MET does not currently
support Lambert Conformal grids where dx (5.07941) != dy (5.0794) and
may
produce unexpected results!
WARNING:
DEBUG 1: Forecast File:
/export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/data/wpc/hpcop_pwpf24_2018102712f024.grib2
DEBUG 1: Observation File:
/export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/data/nohrscv2/nohrsc_2018102812.grib2
DEBUG 1: Regridding forecast SNOD/R1 to the verification grid.
DEBUG 1: Regridding observation SNOD/R1 to the verification grid.
DEBUG 1: Forecast Field: SNOD at R1
DEBUG 1: Observation Field: SNOD at R1
DEBUG 2: Processing masking regions.
ERROR :
ERROR : parse_poly_mask() -> The masking and verification grids do
not
match:
ERROR : Projection: Lambert Conformal Nx: 2145 Ny: 1377 Lat_LL:
20.192
Lon_LL: 121.554 Lon_orient: 95.000 Alpha: 6509.082 Cone: 0.423 Bx:
1088.0030 By: 5483.6617 !=
ERROR : Projection: Lat/Lon Nx: 1182 Ny: 502 lat_ll: 24.500 lon_ll:
-234.500 delta_lat: 0.050 delta_lon: 0.050
ERROR :
Is this telling me my custom mask does not match the verification data
grid?
Thanks,
Ben
On Mon, Nov 5, 2018 at 9:27 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Ben,
>
> I see you're having trouble defining a NetCDF masking region for
MODE.
>
> Good news, this one is easy to solve. The problem is that you've
defined
> "mask.poly" as an array of length 1:
> poly =
>
> ["/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_
> 2p5km.nc
> {name = \"GRL\"; level = \"R0\";}>=1.0"];
>
> Those square brackets indicate that the value is an array. Unlike
> Grid-Stat and Point-Stat which process multiple masking regions in a
single
> run, MODE only processes one. So you should configure it without
the
> square brackets. Additionally, you shouldn't need to specify the
"name"
> and "level". It should be smart enough to read the output of
gen_vx_mask
> directly.
>
> Please try using the following setting:
>
> * poly =
> "/export/hpc-lw-
hmtdev2/balbr**ight/Desktop/met/qpf_verif/**grid_stat/masks/GRL_2p5km.nc
> <http://2p5km.nc>";*
>
> Does that behave better?
>
> Thanks,
> John
>
>
> On Mon, Nov 5, 2018 at 1:20 PM Benjamin Albright - NOAA Affiliate
via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon Nov 05 13:20:41 2018: Request 87661 was acted upon.
> > Transaction: Ticket created by benjamin.albright at noaa.gov
> > Queue: met_help
> > Subject: Error Using NetCDF File as Mask in MODE Config File
> > Owner: Nobody
> > Requestors: benjamin.albright at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87661 >
> >
> >
> > Hi Met Help,
> >
> > I am trying to use a NetCDF file as a mask in my MODE config file
and am
> > having issues getting MODE to run. I successfully ran MODE using
a .poly
> > mask file, however I used gen_vs_mask to create a clipped version
of the
> > custom mask I am using. Within the config file, this mask works
> correctly:
> >
> > mask = {
> > grid = "";
> > grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
> > poly =
> >
> >
> "/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/CONUS.poly";
> > poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
> > }
> >
> > When changed to use a NetCDF file in this syntax, it does not
work:
> >
> > mask = {
> > grid = "";
> > grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
> > poly =
> >
> >
> ["/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_
> > 2p5km.nc
> > {name = \"GRL\"; level = \"R0\";}>=1.0"];
> > poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
> > }
> >
> > DEBUG 1: Default Config File:
> > /opt/MET6/met6.0/share/met/config/MODEConfig_default
> > DEBUG 1: Match Config File:
> >
> >
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> > DEBUG 1: Merge Config File:
> >
> >
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> > WARNING:
> > WARNING: MetGrib2DataFile::read_grib2_grid() -> MET does not
currently
> > support Lambert Conformal grids where dx (5.07941) != dy (5.0794)
and may
> > produce unexpected results!
> > WARNING:
> > ERROR :
> > ERROR : Dictionary::lookup_string() -> lookup failed for name
> "mask.poly"
> > ERROR :
> >
> > I'm using Met6.0. I've attached the following:
> > 1. Config file
> > 2. Forecast grib2 file
> > 3. Analysis grib2 file
> > 4. .poly mask that works
> > 5. NetCDF file mask that I want to use
> >
> > Other colleagues have used NetCDF files as masks for other MET
> applications
> > but not MODE specifically like this. Please let me know if you
need any
> > other information or files. Any help or ideas would be
appreciated,
> > thanks!
> >
> > Ben
> > GRL_2p5km.nc
> > <
> >
> https://drive.google.com/a/noaa.gov/file/d/1a1q-
VyxbBB8LHW9diyXM5TjBYF6swsvU/view?usp=drive_web
> > >
> >
> > --
> > Benjamin Albright, Phd.
> > Meteorological Developer
> > Systems Research Group, Inc.
> > NOAA/NWS/Weather Prediction Center
> > Work email: benjamin.albright at noaa.gov
> > Work phone: 301-683-1474
> >
> >
>
>
--
Benjamin Albright, Phd.
Meteorological Developer
Systems Research Group, Inc.
NOAA/NWS/Weather Prediction Center
Work email: benjamin.albright at noaa.gov
Work phone: 301-683-1474
------------------------------------------------
Subject: Error Using NetCDF File as Mask in MODE Config File
From: John Halley Gotway
Time: Tue Nov 06 14:26:59 2018
Ben,
Yes, that's exactly correct. It's telling you that the grid in the
masking
region doesn't match the verification grid. You're running met-6.0...
and
that version errors out in that case.
It was in met-6.1 (
https://dtcenter.org/met/users/support/release_notes/METv6.1_updates.pdf)
where we added the automated regridding of masks to the vx domain
using
nearest neighbor interpolation.
So you wouldn't see this error when using met-6.1 or later. However,
I
would definitely recommend defining the mask directly on the desired
vx
domain whenever possible. Just go back to your gen_vx_mask command
and
rerun using the vx domain as the target grid.
Thanks,
John
On Tue, Nov 6, 2018 at 5:34 AM Benjamin Albright - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87661 >
>
> Hi John,
>
> Thank you, that did work better. I think I have an error with my
actual
> mask though since when I run it I get the following message:
>
> DEBUG 1: Default Config File:
> /opt/MET6/met6.0/share/met/config/MODEConfig_default
> DEBUG 1: Match Config File:
>
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> DEBUG 1: Merge Config File:
>
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> WARNING:
> WARNING: MetGrib2DataFile::read_grib2_grid() -> MET does not
currently
> support Lambert Conformal grids where dx (5.07941) != dy (5.0794)
and may
> produce unexpected results!
> WARNING:
> DEBUG 1: Forecast File:
>
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/data/wpc/hpcop_pwpf24_2018102712f024.grib2
> DEBUG 1: Observation File:
>
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/data/nohrscv2/nohrsc_2018102812.grib2
> DEBUG 1: Regridding forecast SNOD/R1 to the verification grid.
> DEBUG 1: Regridding observation SNOD/R1 to the verification grid.
> DEBUG 1: Forecast Field: SNOD at R1
> DEBUG 1: Observation Field: SNOD at R1
> DEBUG 2: Processing masking regions.
> ERROR :
> ERROR : parse_poly_mask() -> The masking and verification grids do
not
> match:
> ERROR : Projection: Lambert Conformal Nx: 2145 Ny: 1377 Lat_LL:
20.192
> Lon_LL: 121.554 Lon_orient: 95.000 Alpha: 6509.082 Cone: 0.423 Bx:
> 1088.0030 By: 5483.6617 !=
> ERROR : Projection: Lat/Lon Nx: 1182 Ny: 502 lat_ll: 24.500 lon_ll:
> -234.500 delta_lat: 0.050 delta_lon: 0.050
> ERROR :
>
> Is this telling me my custom mask does not match the verification
data
> grid?
>
> Thanks,
> Ben
>
> On Mon, Nov 5, 2018 at 9:27 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Ben,
> >
> > I see you're having trouble defining a NetCDF masking region for
MODE.
> >
> > Good news, this one is easy to solve. The problem is that you've
defined
> > "mask.poly" as an array of length 1:
> > poly =
> >
> >
> ["/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_
> > 2p5km.nc
> > {name = \"GRL\"; level = \"R0\";}>=1.0"];
> >
> > Those square brackets indicate that the value is an array. Unlike
> > Grid-Stat and Point-Stat which process multiple masking regions in
a
> single
> > run, MODE only processes one. So you should configure it without
the
> > square brackets. Additionally, you shouldn't need to specify the
"name"
> > and "level". It should be smart enough to read the output of
gen_vx_mask
> > directly.
> >
> > Please try using the following setting:
> >
> > * poly =
> >
> "/export/hpc-lw-
hmtdev2/balbr**ight/Desktop/met/qpf_verif/**grid_stat/masks/GRL_2p5km.nc
> > <http://2p5km.nc>";*
> >
> > Does that behave better?
> >
> > Thanks,
> > John
> >
> >
> > On Mon, Nov 5, 2018 at 1:20 PM Benjamin Albright - NOAA Affiliate
via RT
> <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon Nov 05 13:20:41 2018: Request 87661 was acted upon.
> > > Transaction: Ticket created by benjamin.albright at noaa.gov
> > > Queue: met_help
> > > Subject: Error Using NetCDF File as Mask in MODE Config
File
> > > Owner: Nobody
> > > Requestors: benjamin.albright at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87661
> >
> > >
> > >
> > > Hi Met Help,
> > >
> > > I am trying to use a NetCDF file as a mask in my MODE config
file and
> am
> > > having issues getting MODE to run. I successfully ran MODE
using a
> .poly
> > > mask file, however I used gen_vs_mask to create a clipped
version of
> the
> > > custom mask I am using. Within the config file, this mask works
> > correctly:
> > >
> > > mask = {
> > > grid = "";
> > > grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
> > > poly =
> > >
> > >
> >
> "/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/CONUS.poly";
> > > poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
> > > }
> > >
> > > When changed to use a NetCDF file in this syntax, it does not
work:
> > >
> > > mask = {
> > > grid = "";
> > > grid_flag = NONE; // Apply to NONE, FCST, OBS, or BOTH
> > > poly =
> > >
> > >
> >
> ["/export/hpc-lw-
hmtdev2/balbright/Desktop/met/qpf_verif/grid_stat/masks/GRL_
> > > 2p5km.nc
> > > {name = \"GRL\"; level = \"R0\";}>=1.0"];
> > > poly_flag = BOTH; // Apply to NONE, FCST, OBS, or BOTH
> > > }
> > >
> > > DEBUG 1: Default Config File:
> > > /opt/MET6/met6.0/share/met/config/MODEConfig_default
> > > DEBUG 1: Match Config File:
> > >
> > >
> >
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> > > DEBUG 1: Merge Config File:
> > >
> > >
> >
> /export/hpc-lw-
hmtdev2/balbright/Desktop/python/mode/config/20181028/hpcop_pwpf24_2018102712f024_R1_1_in
> > > WARNING:
> > > WARNING: MetGrib2DataFile::read_grib2_grid() -> MET does not
currently
> > > support Lambert Conformal grids where dx (5.07941) != dy
(5.0794) and
> may
> > > produce unexpected results!
> > > WARNING:
> > > ERROR :
> > > ERROR : Dictionary::lookup_string() -> lookup failed for name
> > "mask.poly"
> > > ERROR :
> > >
> > > I'm using Met6.0. I've attached the following:
> > > 1. Config file
> > > 2. Forecast grib2 file
> > > 3. Analysis grib2 file
> > > 4. .poly mask that works
> > > 5. NetCDF file mask that I want to use
> > >
> > > Other colleagues have used NetCDF files as masks for other MET
> > applications
> > > but not MODE specifically like this. Please let me know if you
need
> any
> > > other information or files. Any help or ideas would be
appreciated,
> > > thanks!
> > >
> > > Ben
> > > GRL_2p5km.nc
> > > <
> > >
> >
> https://drive.google.com/a/noaa.gov/file/d/1a1q-
VyxbBB8LHW9diyXM5TjBYF6swsvU/view?usp=drive_web
> > > >
> > >
> > > --
> > > Benjamin Albright, Phd.
> > > Meteorological Developer
> > > Systems Research Group, Inc.
> > > NOAA/NWS/Weather Prediction Center
> > > Work email: benjamin.albright at noaa.gov
> > > Work phone: 301-683-1474
> > >
> > >
> >
> >
>
> --
> Benjamin Albright, Phd.
> Meteorological Developer
> Systems Research Group, Inc.
> NOAA/NWS/Weather Prediction Center
> Work email: benjamin.albright at noaa.gov
> Work phone: 301-683-1474
>
>
------------------------------------------------
More information about the Met_help
mailing list