[Met_help] [rt.rap.ucar.edu #99943] History for question about input file
John Halley Gotway via RT
met_help at ucar.edu
Mon Jul 12 11:41:55 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Help Desk,
I intend to verify global MPAS simulations using MET.
MPAS output has been remapped to global regular lat-lon grids with
resolution of 0.25 degree, similar to GFS quarter degree data.
However, when I try to run plot_data_plane and gen_vx_mask, both
program failed with the error message:
file "latlon_history.2018-04-15_00.00.00.nc" not a valid data file
My data and a simple run_mask.ksh file are saved at
/glade/scratch/chenming/MET/
Would you please help me take a look? Thanks!
Ming
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: question about input file
From: Minna Win
Time: Thu May 20 08:33:26 2021
Hi Ming,
I was able to reproduce your errors on 'cheyenne', thank you for
providing
that information. I took a look at your netCDF file and don't see
anything
amiss. I'm running it through a CF-compliant checker to see if it
finds
anything- it will take a while.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
> Transaction: Ticket created by chenming at ucar.edu
> Queue: met_help
> Subject: question about input file
> Owner: Nobody
> Requestors: chenming at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>
>
> Dear Help Desk,
>
> I intend to verify global MPAS simulations using MET.
>
> MPAS output has been remapped to global regular lat-lon grids with
> resolution of 0.25 degree, similar to GFS quarter degree data.
>
> However, when I try to run plot_data_plane and gen_vx_mask, both
> program failed with the error message:
>
> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data file
>
> My data and a simple run_mask.ksh file are saved at
> /glade/scratch/chenming/MET/
>
> Would you please help me take a look? Thanks!
>
> Ming
>
>
>
------------------------------------------------
Subject: question about input file
From: John Halley Gotway
Time: Thu May 20 12:36:21 2021
Minna,
I'd recommend trying to run this file through MET's plot_data_plane
tool to see if it can read it. Assuming you already found that it
doesn't, try adding:
file_type = NETCDF_NCCF;
To see if explicitly telling it to interpret the data as being CF-
compliant yields any better results.
Also, writing a python embedding script to serve up data from that
file is always a fallback option. You wouldn't be expected to the that
as part of met-help support... it's just an option for the user.
John
------------------------------------------------
Subject: question about input file
From: Minna Win
Time: Thu May 20 14:39:28 2021
Hi Ming,
Your input file was too large to run on the CF compliant checker, but
fortunately, someone showed me that you can set the file_type to force
MET
to treat the input file as CF-compliant:
./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
This will generate a lot of warnings, but does produce the veg.ps
plot.
Can you try running the above command and verify that this output is
consistent with your expectations?
I still cannot get the gen_vx_mask tool to work, I keep getting the
*can't
open input file "latlon_history.2018-04-15_00.00.00.nc
<http://latlon_history.2018-04-15_00.00.00.nc> *error message. One
workaround for this is to employ python embedding:
https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
since it looks like MET is having difficulty reading in the netCDF
file.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
> Transaction: Ticket created by chenming at ucar.edu
> Queue: met_help
> Subject: question about input file
> Owner: Nobody
> Requestors: chenming at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>
>
> Dear Help Desk,
>
> I intend to verify global MPAS simulations using MET.
>
> MPAS output has been remapped to global regular lat-lon grids with
> resolution of 0.25 degree, similar to GFS quarter degree data.
>
> However, when I try to run plot_data_plane and gen_vx_mask, both
> program failed with the error message:
>
> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data file
>
> My data and a simple run_mask.ksh file are saved at
> /glade/scratch/chenming/MET/
>
> Would you please help me take a look? Thanks!
>
> Ming
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #99943] question about input file
From: chenming at ucar.edu
Time: Thu May 20 17:20:51 2021
Hi Minna,
Thanks for your kind help. I have several follow-up questions:
(1) What map projections are accepted by MET? Would you please tell me
the exact names used in MET (e.g., lambert or lambert_conformal, etc.)
Specifically, does MET accept data on regular lat-lon grids?
(2) If I want to verify global MPAS simulation on 0.25 x0.25 degree
grids, say I am only interested in the tropics (20S-20N), how to
create
a mask ?
(3) Do you have any instruction how to create a poly for a specific
region?
I am sorry for so many questions. Many thanks for your help!
Ming
On 5/20/21 2:39 PM, Minna Win via RT wrote:
> Hi Ming,
>
> Your input file was too large to run on the CF compliant checker,
but
> fortunately, someone showed me that you can set the file_type to
force MET
> to treat the input file as CF-compliant:
>
> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
>
> This will generate a lot of warnings, but does produce the veg.ps
plot.
> Can you try running the above command and verify that this output is
> consistent with your expectations?
>
> I still cannot get the gen_vx_mask tool to work, I keep getting the
*can't
> open input file "latlon_history.2018-04-15_00.00.00.nc
> <http://latlon_history.2018-04-15_00.00.00.nc> *error message. One
> workaround for this is to employ python embedding:
>
>
> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
>
> since it looks like MET is having difficulty reading in the netCDF
file.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
> wrote:
>
>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
>> Transaction: Ticket created by chenming at ucar.edu
>> Queue: met_help
>> Subject: question about input file
>> Owner: Nobody
>> Requestors: chenming at ucar.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>
>>
>> Dear Help Desk,
>>
>> I intend to verify global MPAS simulations using MET.
>>
>> MPAS output has been remapped to global regular lat-lon grids with
>> resolution of 0.25 degree, similar to GFS quarter degree data.
>>
>> However, when I try to run plot_data_plane and gen_vx_mask, both
>> program failed with the error message:
>>
>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data file
>>
>> My data and a simple run_mask.ksh file are saved at
>> /glade/scratch/chenming/MET/
>>
>> Would you please help me take a look? Thanks!
>>
>> Ming
>>
>>
>>
------------------------------------------------
Subject: question about input file
From: Minna Win
Time: Fri May 21 11:17:28 2021
Hello Ming,
1) Here is a link to the information about the supported map
projections:
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
2) There are nine ways you can define a masking region:
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
If you already have an ESRI shapefile of the tropics, that would
probably
be the easiest.
3) You can create your own poly line file, you only need to specify a
header name and the lons and lats, here's a snippet of the EAST poly
file
provided by MET:
EAST
47.21184 -98.23244
47.11518 -97.12586
46.36584 -97.27562
45.62014 -97.41983
45.51431 -96.35903
44.77478 -96.51689
44.03891 -96.66912
43.30675 -96.81602
42.57834 -96.95787
41.85373 -97.09491
41.13296 -97.22739
40.41606 -97.35553
39.70307 -97.47953
39.60352 -96.55741
38.89662 -96.69180
38.19363 -96.82202
I hope this helps.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>
> Hi Minna,
>
> Thanks for your kind help. I have several follow-up questions:
>
> (1) What map projections are accepted by MET? Would you please tell
me
> the exact names used in MET (e.g., lambert or lambert_conformal,
etc.)
>
> Specifically, does MET accept data on regular lat-lon grids?
>
> (2) If I want to verify global MPAS simulation on 0.25 x0.25 degree
> grids, say I am only interested in the tropics (20S-20N), how to
create
> a mask ?
>
> (3) Do you have any instruction how to create a poly for a specific
> region?
>
> I am sorry for so many questions. Many thanks for your help!
>
> Ming
>
> On 5/20/21 2:39 PM, Minna Win via RT wrote:
> > Hi Ming,
> >
> > Your input file was too large to run on the CF compliant checker,
but
> > fortunately, someone showed me that you can set the file_type to
force
> MET
> > to treat the input file as CF-compliant:
> >
> > ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
> > 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
> >
> > This will generate a lot of warnings, but does produce the veg.ps
plot.
> > Can you try running the above command and verify that this output
is
> > consistent with your expectations?
> >
> > I still cannot get the gen_vx_mask tool to work, I keep getting
the
> *can't
> > open input file "latlon_history.2018-04-15_00.00.00.nc
> > <http://latlon_history.2018-04-15_00.00.00.nc> *error message.
One
> > workaround for this is to employ python embedding:
> >
> >
> > https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
> >
> > since it looks like MET is having difficulty reading in the netCDF
file.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
> >> Transaction: Ticket created by chenming at ucar.edu
> >> Queue: met_help
> >> Subject: question about input file
> >> Owner: Nobody
> >> Requestors: chenming at ucar.edu
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
> >
> >>
> >>
> >> Dear Help Desk,
> >>
> >> I intend to verify global MPAS simulations using MET.
> >>
> >> MPAS output has been remapped to global regular lat-lon grids
with
> >> resolution of 0.25 degree, similar to GFS quarter degree data.
> >>
> >> However, when I try to run plot_data_plane and gen_vx_mask, both
> >> program failed with the error message:
> >>
> >> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data
file
> >>
> >> My data and a simple run_mask.ksh file are saved at
> >> /glade/scratch/chenming/MET/
> >>
> >> Would you please help me take a look? Thanks!
> >>
> >> Ming
> >>
> >>
> >>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #99943] question about input file
From: chenming at ucar.edu
Time: Fri May 21 16:04:01 2021
Minna,
I have read through the two websites you posted and specify correct
map_projection in my data. I follow the steps described to run
gen_vx_mask. However, my case still doesn't work.
Would you please provide me a sample netCDF file in regular lat-lon
grids and can be read by plot_data_plane and gen_vx_mask?
Thanks.
Ming
On 5/21/21 11:17 AM, Minna Win via RT wrote:
> Hello Ming,
>
> 1) Here is a link to the information about the supported map
projections:
>
>
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
>
>
> 2) There are nine ways you can define a masking region:
>
>
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
>
> If you already have an ESRI shapefile of the tropics, that would
probably
> be the easiest.
>
> 3) You can create your own poly line file, you only need to specify
a
> header name and the lons and lats, here's a snippet of the EAST poly
file
> provided by MET:
>
> EAST
> 47.21184 -98.23244
> 47.11518 -97.12586
> 46.36584 -97.27562
> 45.62014 -97.41983
> 45.51431 -96.35903
> 44.77478 -96.51689
> 44.03891 -96.66912
> 43.30675 -96.81602
> 42.57834 -96.95787
> 41.85373 -97.09491
> 41.13296 -97.22739
> 40.41606 -97.35553
> 39.70307 -97.47953
> 39.60352 -96.55741
> 38.89662 -96.69180
> 38.19363 -96.82202
>
>
> I hope this helps.
>
> Regards,
> Minna
>
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>
>> Hi Minna,
>>
>> Thanks for your kind help. I have several follow-up questions:
>>
>> (1) What map projections are accepted by MET? Would you please tell
me
>> the exact names used in MET (e.g., lambert or lambert_conformal,
etc.)
>>
>> Specifically, does MET accept data on regular lat-lon grids?
>>
>> (2) If I want to verify global MPAS simulation on 0.25 x0.25 degree
>> grids, say I am only interested in the tropics (20S-20N), how to
create
>> a mask ?
>>
>> (3) Do you have any instruction how to create a poly for a
specific
>> region?
>>
>> I am sorry for so many questions. Many thanks for your help!
>>
>> Ming
>>
>> On 5/20/21 2:39 PM, Minna Win via RT wrote:
>>> Hi Ming,
>>>
>>> Your input file was too large to run on the CF compliant checker,
but
>>> fortunately, someone showed me that you can set the file_type to
force
>> MET
>>> to treat the input file as CF-compliant:
>>>
>>> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
>>> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
>>>
>>> This will generate a lot of warnings, but does produce the veg.ps
plot.
>>> Can you try running the above command and verify that this output
is
>>> consistent with your expectations?
>>>
>>> I still cannot get the gen_vx_mask tool to work, I keep getting
the
>> *can't
>>> open input file "latlon_history.2018-04-15_00.00.00.nc
>>> <http://latlon_history.2018-04-15_00.00.00.nc> *error message.
One
>>> workaround for this is to employ python embedding:
>>>
>>>
>>> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
>>>
>>> since it looks like MET is having difficulty reading in the netCDF
file.
>>>
>>> Regards,
>>> Minna
>>> ---------------
>>> Minna Win
>>> National Center for Atmospheric Research
>>> Developmental Testbed Center
>>> Phone: 303-497-8423
>>> Fax: 303-497-8401
>>> ---------------
>>> Pronouns: she/her
>>>
>>>
>>> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
>>>> Transaction: Ticket created by chenming at ucar.edu
>>>> Queue: met_help
>>>> Subject: question about input file
>>>> Owner: Nobody
>>>> Requestors: chenming at ucar.edu
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
>>>>
>>>> Dear Help Desk,
>>>>
>>>> I intend to verify global MPAS simulations using MET.
>>>>
>>>> MPAS output has been remapped to global regular lat-lon grids
with
>>>> resolution of 0.25 degree, similar to GFS quarter degree data.
>>>>
>>>> However, when I try to run plot_data_plane and gen_vx_mask, both
>>>> program failed with the error message:
>>>>
>>>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data
file
>>>>
>>>> My data and a simple run_mask.ksh file are saved at
>>>> /glade/scratch/chenming/MET/
>>>>
>>>> Would you please help me take a look? Thanks!
>>>>
>>>> Ming
>>>>
>>>>
>>>>
>>
------------------------------------------------
Subject: question about input file
From: Minna Win
Time: Fri May 21 17:03:10 2021
Hi Ming,
You might want to consider using Python embedding to read in your data
into
plot_data_plane and gen_vx_mask. Here is an example of a Python
script
created for python embedding in plot_data_plane:
https://metplus.readthedocs.io/en/latest/generated/model_applications/marine_and_coastal/PlotDataPlane_obsHYCOM_coordTripolar.html#sphx-
glr-generated-model-applications-marine-and-coastal-plotdataplane-
obshycom-coordtripolar-py
scroll down to the section: Python Embedding to see what you need to
do to
define your data. Then, run the tool following the instructions in
the MET
documentation for python embedding:
https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Fri, May 21, 2021 at 4:04 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>
> Minna,
>
> I have read through the two websites you posted and specify correct
> map_projection in my data. I follow the steps described to run
> gen_vx_mask. However, my case still doesn't work.
>
> Would you please provide me a sample netCDF file in regular lat-lon
> grids and can be read by plot_data_plane and gen_vx_mask?
>
> Thanks.
>
> Ming
>
>
> On 5/21/21 11:17 AM, Minna Win via RT wrote:
> > Hello Ming,
> >
> > 1) Here is a link to the information about the supported map
projections:
> >
> >
>
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
> >
> >
> > 2) There are nine ways you can define a masking region:
> >
> >
>
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
> >
> > If you already have an ESRI shapefile of the tropics, that would
probably
> > be the easiest.
> >
> > 3) You can create your own poly line file, you only need to
specify a
> > header name and the lons and lats, here's a snippet of the EAST
poly file
> > provided by MET:
> >
> > EAST
> > 47.21184 -98.23244
> > 47.11518 -97.12586
> > 46.36584 -97.27562
> > 45.62014 -97.41983
> > 45.51431 -96.35903
> > 44.77478 -96.51689
> > 44.03891 -96.66912
> > 43.30675 -96.81602
> > 42.57834 -96.95787
> > 41.85373 -97.09491
> > 41.13296 -97.22739
> > 40.41606 -97.35553
> > 39.70307 -97.47953
> > 39.60352 -96.55741
> > 38.89662 -96.69180
> > 38.19363 -96.82202
> >
> >
> > I hope this helps.
> >
> > Regards,
> > Minna
> >
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
> >>
> >> Hi Minna,
> >>
> >> Thanks for your kind help. I have several follow-up questions:
> >>
> >> (1) What map projections are accepted by MET? Would you please
tell me
> >> the exact names used in MET (e.g., lambert or lambert_conformal,
etc.)
> >>
> >> Specifically, does MET accept data on regular lat-lon
grids?
> >>
> >> (2) If I want to verify global MPAS simulation on 0.25 x0.25
degree
> >> grids, say I am only interested in the tropics (20S-20N), how to
create
> >> a mask ?
> >>
> >> (3) Do you have any instruction how to create a poly for a
specific
> >> region?
> >>
> >> I am sorry for so many questions. Many thanks for your help!
> >>
> >> Ming
> >>
> >> On 5/20/21 2:39 PM, Minna Win via RT wrote:
> >>> Hi Ming,
> >>>
> >>> Your input file was too large to run on the CF compliant
checker, but
> >>> fortunately, someone showed me that you can set the file_type to
force
> >> MET
> >>> to treat the input file as CF-compliant:
> >>>
> >>> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
> >>> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
> >>>
> >>> This will generate a lot of warnings, but does produce the
veg.ps
> plot.
> >>> Can you try running the above command and verify that this
output is
> >>> consistent with your expectations?
> >>>
> >>> I still cannot get the gen_vx_mask tool to work, I keep getting
the
> >> *can't
> >>> open input file "latlon_history.2018-04-15_00.00.00.nc
> >>> <http://latlon_history.2018-04-15_00.00.00.nc> *error message.
One
> >>> workaround for this is to employ python embedding:
> >>>
> >>>
> >>> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
> >>>
> >>> since it looks like MET is having difficulty reading in the
netCDF
> file.
> >>>
> >>> Regards,
> >>> Minna
> >>> ---------------
> >>> Minna Win
> >>> National Center for Atmospheric Research
> >>> Developmental Testbed Center
> >>> Phone: 303-497-8423
> >>> Fax: 303-497-8401
> >>> ---------------
> >>> Pronouns: she/her
> >>>
> >>>
> >>> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
> >> met_help at ucar.edu>
> >>> wrote:
> >>>
> >>>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
> >>>> Transaction: Ticket created by chenming at ucar.edu
> >>>> Queue: met_help
> >>>> Subject: question about input file
> >>>> Owner: Nobody
> >>>> Requestors: chenming at ucar.edu
> >>>> Status: new
> >>>> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
> >>>>
> >>>> Dear Help Desk,
> >>>>
> >>>> I intend to verify global MPAS simulations using MET.
> >>>>
> >>>> MPAS output has been remapped to global regular lat-lon grids
with
> >>>> resolution of 0.25 degree, similar to GFS quarter degree data.
> >>>>
> >>>> However, when I try to run plot_data_plane and gen_vx_mask,
both
> >>>> program failed with the error message:
> >>>>
> >>>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data
file
> >>>>
> >>>> My data and a simple run_mask.ksh file are saved at
> >>>> /glade/scratch/chenming/MET/
> >>>>
> >>>> Would you please help me take a look? Thanks!
> >>>>
> >>>> Ming
> >>>>
> >>>>
> >>>>
> >>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #99943] question about input file
From: chenming at ucar.edu
Time: Fri May 21 18:03:31 2021
Minna,
I am learning python and at present I am not quite comfortable to use
it. This is why I stay with the traditional way to handle MET.
There are some tricks I need to know to make MET work, including what
information must be included in a datafile so that MET can read.
Ming
On 5/21/21 5:03 PM, Minna Win via RT wrote:
> Hi Ming,
>
> You might want to consider using Python embedding to read in your
data into
> plot_data_plane and gen_vx_mask. Here is an example of a Python
script
> created for python embedding in plot_data_plane:
>
>
https://metplus.readthedocs.io/en/latest/generated/model_applications/marine_and_coastal/PlotDataPlane_obsHYCOM_coordTripolar.html#sphx-
glr-generated-model-applications-marine-and-coastal-plotdataplane-
obshycom-coordtripolar-py
>
> scroll down to the section: Python Embedding to see what you need to
do to
> define your data. Then, run the tool following the instructions in
the MET
> documentation for python embedding:
>
> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, May 21, 2021 at 4:04 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>
>> Minna,
>>
>> I have read through the two websites you posted and specify correct
>> map_projection in my data. I follow the steps described to run
>> gen_vx_mask. However, my case still doesn't work.
>>
>> Would you please provide me a sample netCDF file in regular lat-lon
>> grids and can be read by plot_data_plane and gen_vx_mask?
>>
>> Thanks.
>>
>> Ming
>>
>>
>> On 5/21/21 11:17 AM, Minna Win via RT wrote:
>>> Hello Ming,
>>>
>>> 1) Here is a link to the information about the supported map
projections:
>>>
>>>
>>
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
>>>
>>> 2) There are nine ways you can define a masking region:
>>>
>>>
>>
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
>>> If you already have an ESRI shapefile of the tropics, that would
probably
>>> be the easiest.
>>>
>>> 3) You can create your own poly line file, you only need to
specify a
>>> header name and the lons and lats, here's a snippet of the EAST
poly file
>>> provided by MET:
>>>
>>> EAST
>>> 47.21184 -98.23244
>>> 47.11518 -97.12586
>>> 46.36584 -97.27562
>>> 45.62014 -97.41983
>>> 45.51431 -96.35903
>>> 44.77478 -96.51689
>>> 44.03891 -96.66912
>>> 43.30675 -96.81602
>>> 42.57834 -96.95787
>>> 41.85373 -97.09491
>>> 41.13296 -97.22739
>>> 40.41606 -97.35553
>>> 39.70307 -97.47953
>>> 39.60352 -96.55741
>>> 38.89662 -96.69180
>>> 38.19363 -96.82202
>>>
>>>
>>> I hope this helps.
>>>
>>> Regards,
>>> Minna
>>>
>>>
>>>
>>>
>>> ---------------
>>> Minna Win
>>> National Center for Atmospheric Research
>>> Developmental Testbed Center
>>> Phone: 303-497-8423
>>> Fax: 303-497-8401
>>> ---------------
>>> Pronouns: she/her
>>>
>>>
>>> On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>>>
>>>> Hi Minna,
>>>>
>>>> Thanks for your kind help. I have several follow-up questions:
>>>>
>>>> (1) What map projections are accepted by MET? Would you please
tell me
>>>> the exact names used in MET (e.g., lambert or lambert_conformal,
etc.)
>>>>
>>>> Specifically, does MET accept data on regular lat-lon
grids?
>>>>
>>>> (2) If I want to verify global MPAS simulation on 0.25 x0.25
degree
>>>> grids, say I am only interested in the tropics (20S-20N), how to
create
>>>> a mask ?
>>>>
>>>> (3) Do you have any instruction how to create a poly for a
specific
>>>> region?
>>>>
>>>> I am sorry for so many questions. Many thanks for your help!
>>>>
>>>> Ming
>>>>
>>>> On 5/20/21 2:39 PM, Minna Win via RT wrote:
>>>>> Hi Ming,
>>>>>
>>>>> Your input file was too large to run on the CF compliant
checker, but
>>>>> fortunately, someone showed me that you can set the file_type to
force
>>>> MET
>>>>> to treat the input file as CF-compliant:
>>>>>
>>>>> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
>>>>> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
>>>>>
>>>>> This will generate a lot of warnings, but does produce the
veg.ps
>> plot.
>>>>> Can you try running the above command and verify that this
output is
>>>>> consistent with your expectations?
>>>>>
>>>>> I still cannot get the gen_vx_mask tool to work, I keep getting
the
>>>> *can't
>>>>> open input file "latlon_history.2018-04-15_00.00.00.nc
>>>>> <http://latlon_history.2018-04-15_00.00.00.nc> *error message.
One
>>>>> workaround for this is to employ python embedding:
>>>>>
>>>>>
>>>>> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
>>>>>
>>>>> since it looks like MET is having difficulty reading in the
netCDF
>> file.
>>>>> Regards,
>>>>> Minna
>>>>> ---------------
>>>>> Minna Win
>>>>> National Center for Atmospheric Research
>>>>> Developmental Testbed Center
>>>>> Phone: 303-497-8423
>>>>> Fax: 303-497-8401
>>>>> ---------------
>>>>> Pronouns: she/her
>>>>>
>>>>>
>>>>> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
>>>> met_help at ucar.edu>
>>>>> wrote:
>>>>>
>>>>>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
>>>>>> Transaction: Ticket created by chenming at ucar.edu
>>>>>> Queue: met_help
>>>>>> Subject: question about input file
>>>>>> Owner: Nobody
>>>>>> Requestors: chenming at ucar.edu
>>>>>> Status: new
>>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
>>>>>> Dear Help Desk,
>>>>>>
>>>>>> I intend to verify global MPAS simulations using MET.
>>>>>>
>>>>>> MPAS output has been remapped to global regular lat-lon grids
with
>>>>>> resolution of 0.25 degree, similar to GFS quarter degree data.
>>>>>>
>>>>>> However, when I try to run plot_data_plane and gen_vx_mask,
both
>>>>>> program failed with the error message:
>>>>>>
>>>>>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data
file
>>>>>>
>>>>>> My data and a simple run_mask.ksh file are saved at
>>>>>> /glade/scratch/chenming/MET/
>>>>>>
>>>>>> Would you please help me take a look? Thanks!
>>>>>>
>>>>>> Ming
>>>>>>
>>>>>>
>>>>>>
>>
------------------------------------------------
Subject: question about input file
From: John Halley Gotway
Time: Sat May 22 07:43:13 2021
Hi Ming,
This is John. I work with Minna on providing met-help support. I see
you’re
working on Cheyenne. Can you I know you sent the path in your original
email, but can you please send the actual gen-vx-mask command that
you’re
running which isn’t working? I’d like to run it myself to recreate the
problem.
I’m on helpdesk on Mondays and can log into Cheyenne, take a closer
look,
and let you know what I find.
Thanks,
John
On Fri, May 21, 2021 at 6:04 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>
> Minna,
>
> I am learning python and at present I am not quite comfortable to
use
> it. This is why I stay with the traditional way to handle MET.
>
> There are some tricks I need to know to make MET work, including
what
> information must be included in a datafile so that MET can read.
>
> Ming
>
> On 5/21/21 5:03 PM, Minna Win via RT wrote:
> > Hi Ming,
> >
> > You might want to consider using Python embedding to read in your
data
> into
> > plot_data_plane and gen_vx_mask. Here is an example of a Python
script
> > created for python embedding in plot_data_plane:
> >
> >
>
https://metplus.readthedocs.io/en/latest/generated/model_applications/marine_and_coastal/PlotDataPlane_obsHYCOM_coordTripolar.html#sphx-
glr-generated-model-applications-marine-and-coastal-plotdataplane-
obshycom-coordtripolar-py
> >
> > scroll down to the section: Python Embedding to see what you need
to do
> to
> > define your data. Then, run the tool following the instructions
in the
> MET
> > documentation for python embedding:
> >
> > https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, May 21, 2021 at 4:04 PM chenming at ucar.edu via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
> >>
> >> Minna,
> >>
> >> I have read through the two websites you posted and specify
correct
> >> map_projection in my data. I follow the steps described to run
> >> gen_vx_mask. However, my case still doesn't work.
> >>
> >> Would you please provide me a sample netCDF file in regular lat-
lon
> >> grids and can be read by plot_data_plane and gen_vx_mask?
> >>
> >> Thanks.
> >>
> >> Ming
> >>
> >>
> >> On 5/21/21 11:17 AM, Minna Win via RT wrote:
> >>> Hello Ming,
> >>>
> >>> 1) Here is a link to the information about the supported map
> projections:
> >>>
> >>>
> >>
>
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
> >>>
> >>> 2) There are nine ways you can define a masking region:
> >>>
> >>>
> >>
>
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
> >>> If you already have an ESRI shapefile of the tropics, that would
> probably
> >>> be the easiest.
> >>>
> >>> 3) You can create your own poly line file, you only need to
specify a
> >>> header name and the lons and lats, here's a snippet of the EAST
poly
> file
> >>> provided by MET:
> >>>
> >>> EAST
> >>> 47.21184 -98.23244
> >>> 47.11518 -97.12586
> >>> 46.36584 -97.27562
> >>> 45.62014 -97.41983
> >>> 45.51431 -96.35903
> >>> 44.77478 -96.51689
> >>> 44.03891 -96.66912
> >>> 43.30675 -96.81602
> >>> 42.57834 -96.95787
> >>> 41.85373 -97.09491
> >>> 41.13296 -97.22739
> >>> 40.41606 -97.35553
> >>> 39.70307 -97.47953
> >>> 39.60352 -96.55741
> >>> 38.89662 -96.69180
> >>> 38.19363 -96.82202
> >>>
> >>>
> >>> I hope this helps.
> >>>
> >>> Regards,
> >>> Minna
> >>>
> >>>
> >>>
> >>>
> >>> ---------------
> >>> Minna Win
> >>> National Center for Atmospheric Research
> >>> Developmental Testbed Center
> >>> Phone: 303-497-8423
> >>> Fax: 303-497-8401
> >>> ---------------
> >>> Pronouns: she/her
> >>>
> >>>
> >>> On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT <
> >> met_help at ucar.edu>
> >>> wrote:
> >>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
> >>>>
> >>>> Hi Minna,
> >>>>
> >>>> Thanks for your kind help. I have several follow-up questions:
> >>>>
> >>>> (1) What map projections are accepted by MET? Would you please
tell me
> >>>> the exact names used in MET (e.g., lambert or
lambert_conformal, etc.)
> >>>>
> >>>> Specifically, does MET accept data on regular lat-lon
grids?
> >>>>
> >>>> (2) If I want to verify global MPAS simulation on 0.25 x0.25
degree
> >>>> grids, say I am only interested in the tropics (20S-20N), how
to
> create
> >>>> a mask ?
> >>>>
> >>>> (3) Do you have any instruction how to create a poly for a
specific
> >>>> region?
> >>>>
> >>>> I am sorry for so many questions. Many thanks for your help!
> >>>>
> >>>> Ming
> >>>>
> >>>> On 5/20/21 2:39 PM, Minna Win via RT wrote:
> >>>>> Hi Ming,
> >>>>>
> >>>>> Your input file was too large to run on the CF compliant
checker, but
> >>>>> fortunately, someone showed me that you can set the file_type
to
> force
> >>>> MET
> >>>>> to treat the input file as CF-compliant:
> >>>>>
> >>>>> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
> >>>>> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
> >>>>>
> >>>>> This will generate a lot of warnings, but does produce the
veg.ps
> >> plot.
> >>>>> Can you try running the above command and verify that this
output is
> >>>>> consistent with your expectations?
> >>>>>
> >>>>> I still cannot get the gen_vx_mask tool to work, I keep
getting the
> >>>> *can't
> >>>>> open input file "latlon_history.2018-04-15_00.00.00.nc
> >>>>> <http://latlon_history.2018-04-15_00.00.00.nc> *error message.
One
> >>>>> workaround for this is to employ python embedding:
> >>>>>
> >>>>>
> >>>>>
https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
> >>>>>
> >>>>> since it looks like MET is having difficulty reading in the
netCDF
> >> file.
> >>>>> Regards,
> >>>>> Minna
> >>>>> ---------------
> >>>>> Minna Win
> >>>>> National Center for Atmospheric Research
> >>>>> Developmental Testbed Center
> >>>>> Phone: 303-497-8423
> >>>>> Fax: 303-497-8401
> >>>>> ---------------
> >>>>> Pronouns: she/her
> >>>>>
> >>>>>
> >>>>> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
> >>>> met_help at ucar.edu>
> >>>>> wrote:
> >>>>>
> >>>>>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
> >>>>>> Transaction: Ticket created by chenming at ucar.edu
> >>>>>> Queue: met_help
> >>>>>> Subject: question about input file
> >>>>>> Owner: Nobody
> >>>>>> Requestors: chenming at ucar.edu
> >>>>>> Status: new
> >>>>>> Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
> >>>>>> Dear Help Desk,
> >>>>>>
> >>>>>> I intend to verify global MPAS simulations using MET.
> >>>>>>
> >>>>>> MPAS output has been remapped to global regular lat-lon grids
with
> >>>>>> resolution of 0.25 degree, similar to GFS quarter degree
data.
> >>>>>>
> >>>>>> However, when I try to run plot_data_plane and gen_vx_mask,
both
> >>>>>> program failed with the error message:
> >>>>>>
> >>>>>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data
file
> >>>>>>
> >>>>>> My data and a simple run_mask.ksh file are saved at
> >>>>>> /glade/scratch/chenming/MET/
> >>>>>>
> >>>>>> Would you please help me take a look? Thanks!
> >>>>>>
> >>>>>> Ming
> >>>>>>
> >>>>>>
> >>>>>>
> >>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #99943] question about input file
From: chenming at ucar.edu
Time: Sun May 23 22:17:13 2021
Hi John,
Many thanks for your help. I have some global MPAS simulations, which
I
want to verify against observations using MET.
MPAS outputs have been remapped to global regular lat-lon grids and I
would like to look at its performance in the mid-latitudes (20N-60N).
The data are saved at /glade/scratch/chenming/MET
(mpas_2018-04-15_00.00.00.nc and mpas_2018-04-15_06.00.00.nc)
The commands I used are saved in test.csh for your convenience to
take
a look.
Thank you!
Ming
On 5/22/21 7:43 AM, John Halley Gotway via RT wrote:
> Hi Ming,
>
> This is John. I work with Minna on providing met-help support. I see
you’re
> working on Cheyenne. Can you I know you sent the path in your
original
> email, but can you please send the actual gen-vx-mask command that
you’re
> running which isn’t working? I’d like to run it myself to recreate
the
> problem.
>
> I’m on helpdesk on Mondays and can log into Cheyenne, take a closer
look,
> and let you know what I find.
>
> Thanks,
> John
>
> On Fri, May 21, 2021 at 6:04 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
> wrote:
>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>
>> Minna,
>>
>> I am learning python and at present I am not quite comfortable to
use
>> it. This is why I stay with the traditional way to handle MET.
>>
>> There are some tricks I need to know to make MET work, including
what
>> information must be included in a datafile so that MET can read.
>>
>> Ming
>>
>> On 5/21/21 5:03 PM, Minna Win via RT wrote:
>>> Hi Ming,
>>>
>>> You might want to consider using Python embedding to read in your
data
>> into
>>> plot_data_plane and gen_vx_mask. Here is an example of a Python
script
>>> created for python embedding in plot_data_plane:
>>>
>>>
>>
https://metplus.readthedocs.io/en/latest/generated/model_applications/marine_and_coastal/PlotDataPlane_obsHYCOM_coordTripolar.html#sphx-
glr-generated-model-applications-marine-and-coastal-plotdataplane-
obshycom-coordtripolar-py
>>> scroll down to the section: Python Embedding to see what you need
to do
>> to
>>> define your data. Then, run the tool following the instructions
in the
>> MET
>>> documentation for python embedding:
>>>
>>> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
>>>
>>> Regards,
>>> Minna
>>> ---------------
>>> Minna Win
>>> National Center for Atmospheric Research
>>> Developmental Testbed Center
>>> Phone: 303-497-8423
>>> Fax: 303-497-8401
>>> ---------------
>>> Pronouns: she/her
>>>
>>>
>>> On Fri, May 21, 2021 at 4:04 PM chenming at ucar.edu via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>>>
>>>> Minna,
>>>>
>>>> I have read through the two websites you posted and specify
correct
>>>> map_projection in my data. I follow the steps described to run
>>>> gen_vx_mask. However, my case still doesn't work.
>>>>
>>>> Would you please provide me a sample netCDF file in regular lat-
lon
>>>> grids and can be read by plot_data_plane and gen_vx_mask?
>>>>
>>>> Thanks.
>>>>
>>>> Ming
>>>>
>>>>
>>>> On 5/21/21 11:17 AM, Minna Win via RT wrote:
>>>>> Hello Ming,
>>>>>
>>>>> 1) Here is a link to the information about the supported map
>> projections:
>>>>>
>>
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
>>>>> 2) There are nine ways you can define a masking region:
>>>>>
>>>>>
>>
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
>>>>> If you already have an ESRI shapefile of the tropics, that would
>> probably
>>>>> be the easiest.
>>>>>
>>>>> 3) You can create your own poly line file, you only need to
specify a
>>>>> header name and the lons and lats, here's a snippet of the EAST
poly
>> file
>>>>> provided by MET:
>>>>>
>>>>> EAST
>>>>> 47.21184 -98.23244
>>>>> 47.11518 -97.12586
>>>>> 46.36584 -97.27562
>>>>> 45.62014 -97.41983
>>>>> 45.51431 -96.35903
>>>>> 44.77478 -96.51689
>>>>> 44.03891 -96.66912
>>>>> 43.30675 -96.81602
>>>>> 42.57834 -96.95787
>>>>> 41.85373 -97.09491
>>>>> 41.13296 -97.22739
>>>>> 40.41606 -97.35553
>>>>> 39.70307 -97.47953
>>>>> 39.60352 -96.55741
>>>>> 38.89662 -96.69180
>>>>> 38.19363 -96.82202
>>>>>
>>>>>
>>>>> I hope this helps.
>>>>>
>>>>> Regards,
>>>>> Minna
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ---------------
>>>>> Minna Win
>>>>> National Center for Atmospheric Research
>>>>> Developmental Testbed Center
>>>>> Phone: 303-497-8423
>>>>> Fax: 303-497-8401
>>>>> ---------------
>>>>> Pronouns: she/her
>>>>>
>>>>>
>>>>> On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT <
>>>> met_help at ucar.edu>
>>>>> wrote:
>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>>>>>>
>>>>>> Hi Minna,
>>>>>>
>>>>>> Thanks for your kind help. I have several follow-up questions:
>>>>>>
>>>>>> (1) What map projections are accepted by MET? Would you please
tell me
>>>>>> the exact names used in MET (e.g., lambert or
lambert_conformal, etc.)
>>>>>>
>>>>>> Specifically, does MET accept data on regular lat-lon
grids?
>>>>>>
>>>>>> (2) If I want to verify global MPAS simulation on 0.25 x0.25
degree
>>>>>> grids, say I am only interested in the tropics (20S-20N), how
to
>> create
>>>>>> a mask ?
>>>>>>
>>>>>> (3) Do you have any instruction how to create a poly for a
specific
>>>>>> region?
>>>>>>
>>>>>> I am sorry for so many questions. Many thanks for your help!
>>>>>>
>>>>>> Ming
>>>>>>
>>>>>> On 5/20/21 2:39 PM, Minna Win via RT wrote:
>>>>>>> Hi Ming,
>>>>>>>
>>>>>>> Your input file was too large to run on the CF compliant
checker, but
>>>>>>> fortunately, someone showed me that you can set the file_type
to
>> force
>>>>>> MET
>>>>>>> to treat the input file as CF-compliant:
>>>>>>>
>>>>>>> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc veg.ps
>>>>>>> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
>>>>>>>
>>>>>>> This will generate a lot of warnings, but does produce the
veg.ps
>>>> plot.
>>>>>>> Can you try running the above command and verify that this
output is
>>>>>>> consistent with your expectations?
>>>>>>>
>>>>>>> I still cannot get the gen_vx_mask tool to work, I keep
getting the
>>>>>> *can't
>>>>>>> open input file "latlon_history.2018-04-15_00.00.00.nc
>>>>>>> <http://latlon_history.2018-04-15_00.00.00.nc> *error message.
One
>>>>>>> workaround for this is to employ python embedding:
>>>>>>>
>>>>>>>
>>>>>>>
https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
>>>>>>>
>>>>>>> since it looks like MET is having difficulty reading in the
netCDF
>>>> file.
>>>>>>> Regards,
>>>>>>> Minna
>>>>>>> ---------------
>>>>>>> Minna Win
>>>>>>> National Center for Atmospheric Research
>>>>>>> Developmental Testbed Center
>>>>>>> Phone: 303-497-8423
>>>>>>> Fax: 303-497-8401
>>>>>>> ---------------
>>>>>>> Pronouns: she/her
>>>>>>>
>>>>>>>
>>>>>>> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
>>>>>> met_help at ucar.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
>>>>>>>> Transaction: Ticket created by chenming at ucar.edu
>>>>>>>> Queue: met_help
>>>>>>>> Subject: question about input file
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: chenming at ucar.edu
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
>>>>>>>> Dear Help Desk,
>>>>>>>>
>>>>>>>> I intend to verify global MPAS simulations using MET.
>>>>>>>>
>>>>>>>> MPAS output has been remapped to global regular lat-lon grids
with
>>>>>>>> resolution of 0.25 degree, similar to GFS quarter degree
data.
>>>>>>>>
>>>>>>>> However, when I try to run plot_data_plane and gen_vx_mask,
both
>>>>>>>> program failed with the error message:
>>>>>>>>
>>>>>>>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid data
file
>>>>>>>>
>>>>>>>> My data and a simple run_mask.ksh file are saved at
>>>>>>>> /glade/scratch/chenming/MET/
>>>>>>>>
>>>>>>>> Would you please help me take a look? Thanks!
>>>>>>>>
>>>>>>>> Ming
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>
------------------------------------------------
Subject: question about input file
From: John Halley Gotway
Time: Mon May 24 10:16:33 2021
Ming,
I just logged on to take a look. The first thing I notice is that
you're
using MET version 9.0:
(NPL) chenming/MET> ls -lah
/glade/scratch/chenming/MET/plot_data_plane
lrwxrwxrwx 1 chenming ncar 50 May 19 20:42
/glade/scratch/chenming/MET/plot_data_plane ->
/glade/u/home/chenming/METv9.0/bin/plot_data_plane
We recently released MET version 10.0. Information about accessing it
on
cheyenne can be found on this page:
https://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
This command errors out:
/glade/u/home/chenming/METv9.0/bin/plot_data_plane
/glade/scratch/chenming/MET/mpas_2018-04-15_00.00.00.nc ~/veg.ps
'name="vegfra"; level="(0,*,*)";'
ERROR : plot_data_plane -> file "/glade/scratch/chenming/MET/
mpas_2018-04-15_00.00.00.nc" not a valid data file
But when I follow Minna's suggestion of adding "file_type =
NETCDF_NCCF;",
it works:
/glade/u/home/chenming/METv9.0/bin/plot_data_plane
/glade/scratch/chenming/MET/mpas_2018-04-15_00.00.00.nc ~/veg.ps
'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
It prints a lot of warnings, but this is the one that matters the
most. MET
isn't extracting the valid time.
WARNING: NcCfFile::open() -> could not determine the valid time, using
0.
But your immediate question is about running gen_vx_mask. You're using
the
"-type lat" option. But since MET doesn't know how to read this data
file
WITHOUT the "file_type = NETCDF_NCCF;" option, then you're stuck.
Here's a
workaround... run pcp_combine first to make a data file that MET can
read
and then run gen_vx_mask second. Like this:
/glade/u/home/chenming/METv9.0/bin/pcp_combine -add
/glade/scratch/chenming/MET/mpas_2018-04-15_00.00.00.nc
'name="vegfra";
level="(0,*,*)"; file_type=NETCDF_NCCF;' ~/my_grid.nc
/glade/u/home/chenming/METv9.0/bin/gen_vx_mask ~/my_grid.nc
~/my_grid.nc
~/NH.nc -type lat -thresh 'ge20&&le60' -name "NH"
Note that I'm just writing stuff to my home directory (~/) since I
don't
have write permission in your run directory. So this technically
works...
but life would be much easier if MET could just read your NetCDF files
directly.
I'd encourage you to actually follow the NetCDF Climate-Forecast
conventions when creating this NetCDF file.
https://cfconventions.org/Data/cf-conventions/cf-conventions-1.8/cf-
conventions.html
I'm not a reliable cf-conventions checker myself, but some obvious
needed
changes are:
- A global attribute for: Conventions = "CF-1.8";
- A forecast_reference_time variable defining the model initialization
time.
- While you have a dimension for time (I'd recommend changing capital
Time
to lowercase time), you're missing a variable which actually defines
the
time:
time(time)
Hope that points you in the right direction.
John
On Sun, May 23, 2021 at 10:17 PM chenming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
>
> Hi John,
>
> Many thanks for your help. I have some global MPAS simulations,
which I
> want to verify against observations using MET.
>
> MPAS outputs have been remapped to global regular lat-lon grids and
I
> would like to look at its performance in the mid-latitudes (20N-
60N).
>
> The data are saved at /glade/scratch/chenming/MET
> (mpas_2018-04-15_00.00.00.nc and mpas_2018-04-15_06.00.00.nc)
>
> The commands I used are saved in test.csh for your convenience to
take
> a look.
>
> Thank you!
>
> Ming
>
> On 5/22/21 7:43 AM, John Halley Gotway via RT wrote:
> > Hi Ming,
> >
> > This is John. I work with Minna on providing met-help support. I
see
> you’re
> > working on Cheyenne. Can you I know you sent the path in your
original
> > email, but can you please send the actual gen-vx-mask command that
you’re
> > running which isn’t working? I’d like to run it myself to recreate
the
> > problem.
> >
> > I’m on helpdesk on Mondays and can log into Cheyenne, take a
closer look,
> > and let you know what I find.
> >
> > Thanks,
> > John
> >
> > On Fri, May 21, 2021 at 6:04 PM chenming at ucar.edu via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
> >>
> >> Minna,
> >>
> >> I am learning python and at present I am not quite comfortable to
use
> >> it. This is why I stay with the traditional way to handle MET.
> >>
> >> There are some tricks I need to know to make MET work, including
what
> >> information must be included in a datafile so that MET can read.
> >>
> >> Ming
> >>
> >> On 5/21/21 5:03 PM, Minna Win via RT wrote:
> >>> Hi Ming,
> >>>
> >>> You might want to consider using Python embedding to read in
your data
> >> into
> >>> plot_data_plane and gen_vx_mask. Here is an example of a Python
script
> >>> created for python embedding in plot_data_plane:
> >>>
> >>>
> >>
>
https://metplus.readthedocs.io/en/latest/generated/model_applications/marine_and_coastal/PlotDataPlane_obsHYCOM_coordTripolar.html#sphx-
glr-generated-model-applications-marine-and-coastal-plotdataplane-
obshycom-coordtripolar-py
> >>> scroll down to the section: Python Embedding to see what you
need to do
> >> to
> >>> define your data. Then, run the tool following the instructions
in the
> >> MET
> >>> documentation for python embedding:
> >>>
> >>> https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
> >>>
> >>> Regards,
> >>> Minna
> >>> ---------------
> >>> Minna Win
> >>> National Center for Atmospheric Research
> >>> Developmental Testbed Center
> >>> Phone: 303-497-8423
> >>> Fax: 303-497-8401
> >>> ---------------
> >>> Pronouns: she/her
> >>>
> >>>
> >>> On Fri, May 21, 2021 at 4:04 PM chenming at ucar.edu via RT <
> >> met_help at ucar.edu>
> >>> wrote:
> >>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943 >
> >>>>
> >>>> Minna,
> >>>>
> >>>> I have read through the two websites you posted and specify
correct
> >>>> map_projection in my data. I follow the steps described to run
> >>>> gen_vx_mask. However, my case still doesn't work.
> >>>>
> >>>> Would you please provide me a sample netCDF file in regular
lat-lon
> >>>> grids and can be read by plot_data_plane and gen_vx_mask?
> >>>>
> >>>> Thanks.
> >>>>
> >>>> Ming
> >>>>
> >>>>
> >>>> On 5/21/21 11:17 AM, Minna Win via RT wrote:
> >>>>> Hello Ming,
> >>>>>
> >>>>> 1) Here is a link to the information about the supported map
> >> projections:
> >>>>>
> >>
>
https://met.readthedocs.io/en/latest/Users_Guide/appendixB.html?highlight=lambert
> >>>>> 2) There are nine ways you can define a masking region:
> >>>>>
> >>>>>
> >>
>
https://met.readthedocs.io/en/latest/Users_Guide/masking.html?highlight=masking
> >>>>> If you already have an ESRI shapefile of the tropics, that
would
> >> probably
> >>>>> be the easiest.
> >>>>>
> >>>>> 3) You can create your own poly line file, you only need to
specify a
> >>>>> header name and the lons and lats, here's a snippet of the
EAST poly
> >> file
> >>>>> provided by MET:
> >>>>>
> >>>>> EAST
> >>>>> 47.21184 -98.23244
> >>>>> 47.11518 -97.12586
> >>>>> 46.36584 -97.27562
> >>>>> 45.62014 -97.41983
> >>>>> 45.51431 -96.35903
> >>>>> 44.77478 -96.51689
> >>>>> 44.03891 -96.66912
> >>>>> 43.30675 -96.81602
> >>>>> 42.57834 -96.95787
> >>>>> 41.85373 -97.09491
> >>>>> 41.13296 -97.22739
> >>>>> 40.41606 -97.35553
> >>>>> 39.70307 -97.47953
> >>>>> 39.60352 -96.55741
> >>>>> 38.89662 -96.69180
> >>>>> 38.19363 -96.82202
> >>>>>
> >>>>>
> >>>>> I hope this helps.
> >>>>>
> >>>>> Regards,
> >>>>> Minna
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ---------------
> >>>>> Minna Win
> >>>>> National Center for Atmospheric Research
> >>>>> Developmental Testbed Center
> >>>>> Phone: 303-497-8423
> >>>>> Fax: 303-497-8401
> >>>>> ---------------
> >>>>> Pronouns: she/her
> >>>>>
> >>>>>
> >>>>> On Thu, May 20, 2021 at 5:20 PM chenming at ucar.edu via RT <
> >>>> met_help at ucar.edu>
> >>>>> wrote:
> >>>>>
> >>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
>
> >>>>>>
> >>>>>> Hi Minna,
> >>>>>>
> >>>>>> Thanks for your kind help. I have several follow-up
questions:
> >>>>>>
> >>>>>> (1) What map projections are accepted by MET? Would you
please tell
> me
> >>>>>> the exact names used in MET (e.g., lambert or
lambert_conformal,
> etc.)
> >>>>>>
> >>>>>> Specifically, does MET accept data on regular lat-
lon
> grids?
> >>>>>>
> >>>>>> (2) If I want to verify global MPAS simulation on 0.25 x0.25
degree
> >>>>>> grids, say I am only interested in the tropics (20S-20N), how
to
> >> create
> >>>>>> a mask ?
> >>>>>>
> >>>>>> (3) Do you have any instruction how to create a poly for a
specific
> >>>>>> region?
> >>>>>>
> >>>>>> I am sorry for so many questions. Many thanks for your help!
> >>>>>>
> >>>>>> Ming
> >>>>>>
> >>>>>> On 5/20/21 2:39 PM, Minna Win via RT wrote:
> >>>>>>> Hi Ming,
> >>>>>>>
> >>>>>>> Your input file was too large to run on the CF compliant
checker,
> but
> >>>>>>> fortunately, someone showed me that you can set the
file_type to
> >> force
> >>>>>> MET
> >>>>>>> to treat the input file as CF-compliant:
> >>>>>>>
> >>>>>>> ./plot_data_plane latlon_history.2018-04-15_00.00.00.nc
veg.ps
> >>>>>>> 'name="vegfra"; level="(0,*,*)"; file_type=NETCDF_NCCF;'
> >>>>>>>
> >>>>>>> This will generate a lot of warnings, but does produce the
veg.ps
> >>>> plot.
> >>>>>>> Can you try running the above command and verify that this
output
> is
> >>>>>>> consistent with your expectations?
> >>>>>>>
> >>>>>>> I still cannot get the gen_vx_mask tool to work, I keep
getting the
> >>>>>> *can't
> >>>>>>> open input file "latlon_history.2018-04-15_00.00.00.nc
> >>>>>>> <http://latlon_history.2018-04-15_00.00.00.nc> *error
message.
> One
> >>>>>>> workaround for this is to employ python embedding:
> >>>>>>>
> >>>>>>>
> >>>>>>>
https://met.readthedocs.io/en/latest/Users_Guide/appendixF.html
> >>>>>>>
> >>>>>>> since it looks like MET is having difficulty reading in the
netCDF
> >>>> file.
> >>>>>>> Regards,
> >>>>>>> Minna
> >>>>>>> ---------------
> >>>>>>> Minna Win
> >>>>>>> National Center for Atmospheric Research
> >>>>>>> Developmental Testbed Center
> >>>>>>> Phone: 303-497-8423
> >>>>>>> Fax: 303-497-8401
> >>>>>>> ---------------
> >>>>>>> Pronouns: she/her
> >>>>>>>
> >>>>>>>
> >>>>>>> On Wed, May 19, 2021 at 8:59 PM chenming at ucar.edu via RT <
> >>>>>> met_help at ucar.edu>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> Wed May 19 20:59:27 2021: Request 99943 was acted upon.
> >>>>>>>> Transaction: Ticket created by chenming at ucar.edu
> >>>>>>>> Queue: met_help
> >>>>>>>> Subject: question about input file
> >>>>>>>> Owner: Nobody
> >>>>>>>> Requestors: chenming at ucar.edu
> >>>>>>>> Status: new
> >>>>>>>> Ticket <URL:
> >>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99943
> >>>>>>>> Dear Help Desk,
> >>>>>>>>
> >>>>>>>> I intend to verify global MPAS simulations using MET.
> >>>>>>>>
> >>>>>>>> MPAS output has been remapped to global regular lat-lon
grids with
> >>>>>>>> resolution of 0.25 degree, similar to GFS quarter degree
data.
> >>>>>>>>
> >>>>>>>> However, when I try to run plot_data_plane and
gen_vx_mask, both
> >>>>>>>> program failed with the error message:
> >>>>>>>>
> >>>>>>>> file "latlon_history.2018-04-15_00.00.00.nc" not a valid
data
> file
> >>>>>>>>
> >>>>>>>> My data and a simple run_mask.ksh file are saved at
> >>>>>>>> /glade/scratch/chenming/MET/
> >>>>>>>>
> >>>>>>>> Would you please help me take a look? Thanks!
> >>>>>>>>
> >>>>>>>> Ming
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>
>
>
------------------------------------------------
More information about the Met_help
mailing list