[Met_help] [rt.rap.ucar.edu #96425] History for why grid_stat tool can not find variable APCPA03 in splitted CMORPH products?
John Halley Gotway via RT
met_help at ucar.edu
Wed Aug 26 12:25:16 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
| |
辛渝
|
|
邮箱：learnerxy at 163.com
|
签名由 网易邮箱大师 定制
--------- Forwarded mail ---------
From: Yu Xin
Date: 08/21/2020 20:36
To: met_help at ucar.edu
Cc:
Subject: why grid_stat tool can not find variable APCPA03 in splitted CMORPH products?
Hello,John Halley Gotway
Thank you for your quick response for ticket 96175 first. Last week, I sent you a new issue below, but failed to receive a new corresponding reply up to now, so I am sending it again today. Hope it can work for me.
What a pity that I failed again though following your configging method in the config file. It reminds me of missing APCPA03 variable in the observation file whatever renaming cmorph_precip as APCPA03 by ncrename tool or splitting it to a single examinated data. What should I do next? The attachment could be found please with the case of renaming variable and splitting observation data. I hope it can help us find other solution. I split the data like this ,ncrename -v cmorph_precip,APCPA03 CMORPH_FILENAME
With my best wishes.
Yu Xin
At 2020-08-12 06:05:56, "John Halley Gotway via RT" <met_help at ucar.edu> wrote:
>Yu Xin,
>
>I see you have a question about using CMORPH data in MET. I pulled this
>sample file:
>
>https://rda.ucar.edu/data/ds502.1/cmorph_v0.x/0.25deg_3hly/netcdf/2020/CMORPH_V0.x_0.25deg-3HLY_20200809.nc
>
>Running ncdump, I see that this file follows the NetCDF Climate Forecast
>(CF) convention. And MET should support NetCDF files following that
>convention.
>
>*ncdump -h CMORPH_V0.x_0.25deg-3HLY_20200807.nc
><http://CMORPH_V0.x_0.25deg-3HLY_20200807.nc> | grep Conventions*
>
>* :Conventions = "CF-1.5" ;*
>
>
>So you're running Grid-Stat to compare Lambert Conformal UPP output to
>global Lat/Lon CMORPH data. This is actually very easy to fix. I'd
>recommend modifying the Grid-Stat configuration file like this:
>
>
>*regrid = {*
>
>* to_grid = FCST;*
>
>* method = BUDGET;*
>
>* width = 2;*
>
>* vld_thresh = 1.0;*
>
>* shape = SQUARE;*
>
>*}*
>
>
>This will automatically regrid the CMORPH data to your model domain using
>budget interpolation, which is appropriate for precip data.
>
>
>Please give that a shot and let me know how it goes.
>
>
>Thanks,
>John Halley Gotway
>
>On Mon, Aug 10, 2020 at 1:36 AM Yu Xin via RT <met_help at ucar.edu> wrote:
>
>>
>> Mon Aug 10 01:36:15 2020: Request 96175 was acted upon.
>> Transaction: Ticket created by learnerxy at 163.com
>> Queue: met_help
>> Subject: Can CMORPH products of NETCDF format be applied in MET?
>> Owner: Nobody
>> Requestors: learnerxy at 163.com
>> Status: new
>> Ticket <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96175 >
>>
>>
>> To whom that could be concerned,
>> These days I have been trying FSS examination on MET-8.1.2 platform by
>> employing CMORPH data downloaded from
>> https://rda.ucar.edu/datasets/ds502.1/#!description, but little advances
>> left behind me. The issues are as follows:
>> 1. Can this kind of netcdf format data be used directly in MET? Is it
>> necessary to re-edit the variable name? Such as, cmorph_precip in NETCDF
>> structure should be renamed APCP or other else? I can not find any clues
>> from the observation datasets description,
>> https://dtcenter.org/community-code/model-evaluation-tools-met/input-data.
>> It seems to me that the MET can not read CMORPH precipitation products
>> directly from the website, but I do not know how to covert it to meet the
>> requirements. Please let me know it.
>> 2. Should the data be re-organized by a single time? The raw datasets I
>> download are organized by 8 observation frequency in a single file.
>> 3. When I execute the grid_stat command using the NETCDF format file as
>> observation data directly, it always pops up the following text:
>> DEBUG 1: Default Config File:
>> /public/soft/met-8.1.1/share/met/config/GridStatConfig_default
>> DEBUG 1: User Config File:
>> /public/soft/met-8.1.1/share/met/config/GridStatConfig_default
>> ERROR :
>> ERROR : parse_vx_grid() -> The forecast and observation grids do not
>> match:
>> ERROR : Projection: Lambert Conformal Nx: 711 Ny: 531 Lat_LL: 17.122
>> Lon_LL: -59.428 Lon_orient: -87.850 Alpha: 1269.303 Cone: 0.716 Bx:r
>> 355.0641 By: 957.9183 !=
>> ERROR : Projection: Lat/Lon Nx: 1440 Ny: 480 lat_ll: -59.875 lon_ll:
>> -0.125 delta_lat: 0.250 delta_lon: 0.250
>> ERROR : Specify regridding logic in the config file "regrid" section.
>> ERROR :
>> The Lambert Conformal data is from the UPP processing of WRFOUT, and the
>> Lat/Lon projection data is CMORPH precipitation product. From the reminder,
>> I do not know how to fix the regrid section in the configuration file
>> whatever setting to_grid to "NONE", "OBS" or "FCST". How to remap the
>> projection of two kind of source data? Should I have to cut the coverage as
>> regional model domain first? I feel the projection is the key issue from
>> the above text, but I do not know how to make them consistent. Please let
>> me know if my guess is right.
>> Thank you.
>> I am looking forward to your news.
>>
>>
>> With my best regards,
>>
>>
>> Yu Xin
>>
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: why grid_stat tool can not find variable APCPA03 in splitted CMORPH products?
From: John Halley Gotway
Time: Mon Aug 24 15:33:27 2020
Yu,
Thanks for sending your sample data. Please try running the following
plot_data_plane command to confirm that MET is able to read this data:
*plot_data_plane CMORPH_V0.x_0.25deg-3HLY_2016061603.nc
<http://CMORPH_V0.x_0.25deg-3HLY_2016061603.nc> plot.ps
<http://plot.ps>
'name="APCPA03"; level="(0,*,*)";'*
That should produce an image like the one I've attached. Once you've
confirmed that this works, use the exact same settings in your Grid-
Stat
configuration file, setting:
name = "APCPA03";
level = "(0,*,*)";
Thanks,
John
[image: plot.png]
On Mon, Aug 24, 2020 at 10:39 AM Yu Xin via RT <met_help at ucar.edu>
wrote:
>
> Mon Aug 24 10:39:16 2020: Request 96425 was acted upon.
> Transaction: Ticket created by learnerxy at 163.com
> Queue: met_help
> Subject: why grid_stat tool can not find variable APCPA03 in
splitted
> CMORPH products?
> Owner: Nobody
> Requestors: learnerxy at 163.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96425 >
>
>
>
>
>
>
>
> | |
> 辛渝
> |
> |
> 邮箱：learnerxy at 163.com
> |
>
> 签名由 网易邮箱大师 定制
>
> --------- Forwarded mail ---------
>
> From: Yu Xin
> Date: 08/21/2020 20:36
> To: met_help at ucar.edu
> Cc:
> Subject: why grid_stat tool can not find variable APCPA03 in
splitted
> CMORPH products?
> Hello,John Halley Gotway
> Thank you for your quick response for ticket 96175 first. Last week,
I
> sent you a new issue below, but failed to receive a new
corresponding reply
> up to now, so I am sending it again today. Hope it can work for me.
> What a pity that I failed again though following your configging
method in
> the config file. It reminds me of missing APCPA03 variable in the
> observation file whatever renaming cmorph_precip as APCPA03 by
ncrename
> tool or splitting it to a single examinated data. What should I do
next?
> The attachment could be found please with the case of renaming
variable and
> splitting observation data. I hope it can help us find other
solution. I
> split the data like this ,ncrename -v cmorph_precip,APCPA03
CMORPH_FILENAME
> With my best wishes.
> Yu Xin
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> At 2020-08-12 06:05:56, "John Halley Gotway via RT"
<met_help at ucar.edu>
> wrote:
> >Yu Xin,
> >
> >I see you have a question about using CMORPH data in MET. I pulled
this
> >sample file:
> >
> >
>
https://rda.ucar.edu/data/ds502.1/cmorph_v0.x/0.25deg_3hly/netcdf/2020/CMORPH_V0.x_0.25deg-
3HLY_20200809.nc
> >
> >Running ncdump, I see that this file follows the NetCDF Climate
Forecast
> >(CF) convention. And MET should support NetCDF files following that
> >convention.
> >
> >*ncdump -h CMORPH_V0.x_0.25deg-3HLY_20200807.nc
> ><http://CMORPH_V0.x_0.25deg-3HLY_20200807.nc> | grep Conventions*
> >
> >* :Conventions = "CF-1.5" ;*
> >
> >
> >So you're running Grid-Stat to compare Lambert Conformal UPP output
to
> >global Lat/Lon CMORPH data. This is actually very easy to fix. I'd
> >recommend modifying the Grid-Stat configuration file like this:
> >
> >
> >*regrid = {*
> >
> >* to_grid = FCST;*
> >
> >* method = BUDGET;*
> >
> >* width = 2;*
> >
> >* vld_thresh = 1.0;*
> >
> >* shape = SQUARE;*
> >
> >*}*
> >
> >
> >This will automatically regrid the CMORPH data to your model domain
using
> >budget interpolation, which is appropriate for precip data.
> >
> >
> >Please give that a shot and let me know how it goes.
> >
> >
> >Thanks,
> >John Halley Gotway
> >
> >On Mon, Aug 10, 2020 at 1:36 AM Yu Xin via RT <met_help at ucar.edu>
wrote:
> >
> >>
> >> Mon Aug 10 01:36:15 2020: Request 96175 was acted upon.
> >> Transaction: Ticket created by learnerxy at 163.com
> >> Queue: met_help
> >> Subject: Can CMORPH products of NETCDF format be applied in
MET?
> >> Owner: Nobody
> >> Requestors: learnerxy at 163.com
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96175 >
> >>
> >>
> >> To whom that could be concerned,
> >> These days I have been trying FSS examination on MET-8.1.2
platform by
> >> employing CMORPH data downloaded from
> >> https://rda.ucar.edu/datasets/ds502.1/#!description, but little
> advances
> >> left behind me. The issues are as follows:
> >> 1. Can this kind of netcdf format data be used directly in MET?
Is it
> >> necessary to re-edit the variable name? Such as, cmorph_precip in
NETCDF
> >> structure should be renamed APCP or other else? I can not find
any clues
> >> from the observation datasets description,
> >>
> https://dtcenter.org/community-code/model-evaluation-tools-
met/input-data.
> >> It seems to me that the MET can not read CMORPH precipitation
products
> >> directly from the website, but I do not know how to covert it to
meet
> the
> >> requirements. Please let me know it.
> >> 2. Should the data be re-organized by a single time? The raw
datasets I
> >> download are organized by 8 observation frequency in a single
file.
> >> 3. When I execute the grid_stat command using the NETCDF format
file as
> >> observation data directly, it always pops up the following text:
> >> DEBUG 1: Default Config File:
> >> /public/soft/met-8.1.1/share/met/config/GridStatConfig_default
> >> DEBUG 1: User Config File:
> >> /public/soft/met-8.1.1/share/met/config/GridStatConfig_default
> >> ERROR :
> >> ERROR : parse_vx_grid() -> The forecast and observation grids do
not
> >> match:
> >> ERROR : Projection: Lambert Conformal Nx: 711 Ny: 531 Lat_LL:
17.122
> >> Lon_LL: -59.428 Lon_orient: -87.850 Alpha: 1269.303 Cone: 0.716
Bx:r
> >> 355.0641 By: 957.9183 !=
> >> ERROR : Projection: Lat/Lon Nx: 1440 Ny: 480 lat_ll: -59.875
lon_ll:
> >> -0.125 delta_lat: 0.250 delta_lon: 0.250
> >> ERROR : Specify regridding logic in the config file "regrid"
section.
> >> ERROR :
> >> The Lambert Conformal data is from the UPP processing of WRFOUT,
and the
> >> Lat/Lon projection data is CMORPH precipitation product. From the
> reminder,
> >> I do not know how to fix the regrid section in the configuration
file
> >> whatever setting to_grid to "NONE", "OBS" or "FCST". How to remap
the
> >> projection of two kind of source data? Should I have to cut the
> coverage as
> >> regional model domain first? I feel the projection is the key
issue from
> >> the above text, but I do not know how to make them consistent.
Please
> let
> >> me know if my guess is right.
> >> Thank you.
> >> I am looking forward to your news.
> >>
> >>
> >> With my best regards,
> >>
> >>
> >> Yu Xin
> >>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
------------------------------------------------
Subject: why grid_stat tool can not find variable APCPA03 in splitted CMORPH products?
From: Yu Xin
Time: Wed Aug 26 12:00:32 2020
Hello John,
Thank you so much that you gave me a solution to this kind of
issue. It's beyond me that the plot_data_plane tool can help find the
way. It's so amazing.
Now everything about evaluation of against CMORPH goes well. The
ticket would be closed. See you later.
Best wishes,
Yu
At 2020-08-25 05:33:28, "John Halley Gotway via RT"
<met_help at ucar.edu> wrote:
>Yu,
>
>Thanks for sending your sample data. Please try running the following
>plot_data_plane command to confirm that MET is able to read this
data:
>
>
>*plot_data_plane CMORPH_V0.x_0.25deg-3HLY_2016061603.nc
><http://CMORPH_V0.x_0.25deg-3HLY_2016061603.nc> plot.ps
<http://plot.ps>
>'name="APCPA03"; level="(0,*,*)";'*
>
>
>That should produce an image like the one I've attached. Once you've
>confirmed that this works, use the exact same settings in your Grid-
Stat
>configuration file, setting:
>
> name = "APCPA03";
>
> level = "(0,*,*)";
>
>
>Thanks,
>John
>[image: plot.png]
>
>
>
>
>
>On Mon, Aug 24, 2020 at 10:39 AM Yu Xin via RT <met_help at ucar.edu>
wrote:
>
>>
>> Mon Aug 24 10:39:16 2020: Request 96425 was acted upon.
>> Transaction: Ticket created by learnerxy at 163.com
>> Queue: met_help
>> Subject: why grid_stat tool can not find variable APCPA03 in
splitted
>> CMORPH products?
>> Owner: Nobody
>> Requestors: learnerxy at 163.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96425 >
>>
>>
>>
>>
>>
>>
>>
>> | |
>> 辛渝
>> |
>> |
>> 邮箱：learnerxy at 163.com
>> |
>>
>> 签名由 网易邮箱大师 定制
>>
>> --------- Forwarded mail ---------
>>
>> From: Yu Xin
>> Date: 08/21/2020 20:36
>> To: met_help at ucar.edu
>> Cc:
>> Subject: why grid_stat tool can not find variable APCPA03 in
splitted
>> CMORPH products?
>> Hello,John Halley Gotway
>> Thank you for your quick response for ticket 96175 first. Last
week, I
>> sent you a new issue below, but failed to receive a new
corresponding reply
>> up to now, so I am sending it again today. Hope it can work for me.
>> What a pity that I failed again though following your configging
method in
>> the config file. It reminds me of missing APCPA03 variable in the
>> observation file whatever renaming cmorph_precip as APCPA03 by
ncrename
>> tool or splitting it to a single examinated data. What should I do
next?
>> The attachment could be found please with the case of renaming
variable and
>> splitting observation data. I hope it can help us find other
solution. I
>> split the data like this ,ncrename -v cmorph_precip,APCPA03
CMORPH_FILENAME
>> With my best wishes.
>> Yu Xin
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> At 2020-08-12 06:05:56, "John Halley Gotway via RT"
<met_help at ucar.edu>
>> wrote:
>> >Yu Xin,
>> >
>> >I see you have a question about using CMORPH data in MET. I pulled
this
>> >sample file:
>> >
>> >
>>
https://rda.ucar.edu/data/ds502.1/cmorph_v0.x/0.25deg_3hly/netcdf/2020/CMORPH_V0.x_0.25deg-
3HLY_20200809.nc
>> >
>> >Running ncdump, I see that this file follows the NetCDF Climate
Forecast
>> >(CF) convention. And MET should support NetCDF files following
that
>> >convention.
>> >
>> >*ncdump -h CMORPH_V0.x_0.25deg-3HLY_20200807.nc
>> ><http://CMORPH_V0.x_0.25deg-3HLY_20200807.nc> | grep Conventions*
>> >
>> >* :Conventions = "CF-1.5" ;*
>> >
>> >
>> >So you're running Grid-Stat to compare Lambert Conformal UPP
output to
>> >global Lat/Lon CMORPH data. This is actually very easy to fix. I'd
>> >recommend modifying the Grid-Stat configuration file like this:
>> >
>> >
>> >*regrid = {*
>> >
>> >* to_grid = FCST;*
>> >
>> >* method = BUDGET;*
>> >
>> >* width = 2;*
>> >
>> >* vld_thresh = 1.0;*
>> >
>> >* shape = SQUARE;*
>> >
>> >*}*
>> >
>> >
>> >This will automatically regrid the CMORPH data to your model
domain using
>> >budget interpolation, which is appropriate for precip data.
>> >
>> >
>> >Please give that a shot and let me know how it goes.
>> >
>> >
>> >Thanks,
>> >John Halley Gotway
>> >
>> >On Mon, Aug 10, 2020 at 1:36 AM Yu Xin via RT <met_help at ucar.edu>
wrote:
>> >
>> >>
>> >> Mon Aug 10 01:36:15 2020: Request 96175 was acted upon.
>> >> Transaction: Ticket created by learnerxy at 163.com
>> >> Queue: met_help
>> >> Subject: Can CMORPH products of NETCDF format be applied in
MET?
>> >> Owner: Nobody
>> >> Requestors: learnerxy at 163.com
>> >> Status: new
>> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96175 >
>> >>
>> >>
>> >> To whom that could be concerned,
>> >> These days I have been trying FSS examination on MET-8.1.2
platform by
>> >> employing CMORPH data downloaded from
>> >> https://rda.ucar.edu/datasets/ds502.1/#!description, but little
>> advances
>> >> left behind me. The issues are as follows:
>> >> 1. Can this kind of netcdf format data be used directly in MET?
Is it
>> >> necessary to re-edit the variable name? Such as, cmorph_precip
in NETCDF
>> >> structure should be renamed APCP or other else? I can not find
any clues
>> >> from the observation datasets description,
>> >>
>> https://dtcenter.org/community-code/model-evaluation-tools-
met/input-data.
>> >> It seems to me that the MET can not read CMORPH precipitation
products
>> >> directly from the website, but I do not know how to covert it to
meet
>> the
>> >> requirements. Please let me know it.
>> >> 2. Should the data be re-organized by a single time? The raw
datasets I
>> >> download are organized by 8 observation frequency in a single
file.
>> >> 3. When I execute the grid_stat command using the NETCDF format
file as
>> >> observation data directly, it always pops up the following text:
>> >> DEBUG 1: Default Config File:
>> >> /public/soft/met-8.1.1/share/met/config/GridStatConfig_default
>> >> DEBUG 1: User Config File:
>> >> /public/soft/met-8.1.1/share/met/config/GridStatConfig_default
>> >> ERROR :
>> >> ERROR : parse_vx_grid() -> The forecast and observation grids
do not
>> >> match:
>> >> ERROR : Projection: Lambert Conformal Nx: 711 Ny: 531 Lat_LL:
17.122
>> >> Lon_LL: -59.428 Lon_orient: -87.850 Alpha: 1269.303 Cone: 0.716
Bx:r
>> >> 355.0641 By: 957.9183 !=
>> >> ERROR : Projection: Lat/Lon Nx: 1440 Ny: 480 lat_ll: -59.875
lon_ll:
>> >> -0.125 delta_lat: 0.250 delta_lon: 0.250
>> >> ERROR : Specify regridding logic in the config file "regrid"
section.
>> >> ERROR :
>> >> The Lambert Conformal data is from the UPP processing of WRFOUT,
and the
>> >> Lat/Lon projection data is CMORPH precipitation product. From
the
>> reminder,
>> >> I do not know how to fix the regrid section in the configuration
file
>> >> whatever setting to_grid to "NONE", "OBS" or "FCST". How to
remap the
>> >> projection of two kind of source data? Should I have to cut the
>> coverage as
>> >> regional model domain first? I feel the projection is the key
issue from
>> >> the above text, but I do not know how to make them consistent.
Please
>> let
>> >> me know if my guess is right.
>> >> Thank you.
>> >> I am looking forward to your news.
>> >>
>> >>
>> >> With my best regards,
>> >>
>> >>
>> >> Yu Xin
>> >>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
>
------------------------------------------------
More information about the Met_help
mailing list