[Met_help] [rt.rap.ucar.edu #77614] History for Question on supported data format
John Halley Gotway via RT
met_help at ucar.edu
Thu Aug 25 11:40:50 MDT 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello
I would like to run grid-stat tool using WRF model forecasts and TRMM
observations.
I converted original HDF-format TRMM observation to NetCDF-format, and I
also interpolated original lat/lon grid to WRF Lambert conformal grid using
NCL.
And I tried to run pcp_combine before running grid-stat tool to make
accumulated precipitation.
However, I got errors like
"get_field() -> can't open data file ***.nc"
Could you give me some advices on this problem?
And... Actually, I selected TRMM observations to verify WRF forecasts over
South Korea, where stage-4 analysis is not available.
Could you recommend other gridded precipitation observations over Southeast
Asia other than TRMM?
Thank you for your kindness.
Best regards
Yonghan Choi
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Question on supported data format
From: John Halley Gotway
Time: Fri Aug 19 16:40:20 2016
Yongchan,
I see that you're having trouble using gridded TRMM data in MET. I
read
that you've done some pre-processing of the TRMM data using NCL prior
to
passing it to the MET tools.
Can you please post a sample NetCDF file that you're passing to
pcp_combine
to our anonymous FTP site, following the instructions listed here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Please write once you've posted a sample file. I'll grab it and run
it
through the debugger to identify what's happening.
Thanks,
John Halley Gotway
On Thu, Aug 18, 2016 at 4:11 PM, Yonghan Choi via RT
<met_help at ucar.edu>
wrote:
>
> Thu Aug 18 16:11:55 2016: Request 77614 was acted upon.
> Transaction: Ticket created by cyh082 at gmail.com
> Queue: met_help
> Subject: Question on supported data format
> Owner: Nobody
> Requestors: cyh082 at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614 >
>
>
> Hello
>
> I would like to run grid-stat tool using WRF model forecasts and
TRMM
> observations.
>
> I converted original HDF-format TRMM observation to NetCDF-format,
and I
> also interpolated original lat/lon grid to WRF Lambert conformal
grid using
> NCL.
>
> And I tried to run pcp_combine before running grid-stat tool to make
> accumulated precipitation.
>
> However, I got errors like
> "get_field() -> can't open data file ***.nc"
>
> Could you give me some advices on this problem?
>
> And... Actually, I selected TRMM observations to verify WRF
forecasts over
> South Korea, where stage-4 analysis is not available.
> Could you recommend other gridded precipitation observations over
Southeast
> Asia other than TRMM?
>
> Thank you for your kindness.
>
> Best regards
> Yonghan Choi
>
>
------------------------------------------------
Subject: Question on supported data format
From: Yonghan Choi
Time: Sun Aug 21 00:08:58 2016
Dear John Halley Gotway:
I uploaded my NetCDF-formatted TRMM data to your ftp server.
Actually, I interpolated (to WRF grids) and made accumulation using
original TRMM data, and I converted HDF-formatted original TRMM data
to
NetCDF format.
Thank you for your kindness.
Best regards
Yonghan Choi
On Fri, Aug 19, 2016 at 4:40 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Yongchan,
>
> I see that you're having trouble using gridded TRMM data in MET. I
read
> that you've done some pre-processing of the TRMM data using NCL
prior to
> passing it to the MET tools.
>
> Can you please post a sample NetCDF file that you're passing to
pcp_combine
> to our anonymous FTP site, following the instructions listed here:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Please write once you've posted a sample file. I'll grab it and run
it
> through the debugger to identify what's happening.
>
> Thanks,
> John Halley Gotway
>
> On Thu, Aug 18, 2016 at 4:11 PM, Yonghan Choi via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Thu Aug 18 16:11:55 2016: Request 77614 was acted upon.
> > Transaction: Ticket created by cyh082 at gmail.com
> > Queue: met_help
> > Subject: Question on supported data format
> > Owner: Nobody
> > Requestors: cyh082 at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614 >
> >
> >
> > Hello
> >
> > I would like to run grid-stat tool using WRF model forecasts and
TRMM
> > observations.
> >
> > I converted original HDF-format TRMM observation to NetCDF-format,
and I
> > also interpolated original lat/lon grid to WRF Lambert conformal
grid
> using
> > NCL.
> >
> > And I tried to run pcp_combine before running grid-stat tool to
make
> > accumulated precipitation.
> >
> > However, I got errors like
> > "get_field() -> can't open data file ***.nc"
> >
> > Could you give me some advices on this problem?
> >
> > And... Actually, I selected TRMM observations to verify WRF
forecasts
> over
> > South Korea, where stage-4 analysis is not available.
> > Could you recommend other gridded precipitation observations over
> Southeast
> > Asia other than TRMM?
> >
> > Thank you for your kindness.
> >
> > Best regards
> > Yonghan Choi
> >
> >
>
>
------------------------------------------------
Subject: Question on supported data format
From: John Halley Gotway
Time: Tue Aug 23 16:38:36 2016
Yonghan,
Thanks for sending that sample data file. Yes, it is definitely a
flavor
of NetCDF that the MET software is not expecting. Here's an option
for
accessing that same TRMM data, following links from the MET website:
http://www.dtcenter.org/met/users/downloads/observation_data.php
# Pull binary 3-hourly TRMM data file
wget
ftp://disc2.nascom.nasa.gov/data/TRMM/Gridded/3B42_V7/201009/3B42.100921.00z.7.precipitation.bin
# Pull Rscript from MET website
wget http://www.dtcenter.org/met/users/downloads/Rscripts/trmmbin2nc.R
# Edit that Rscript by setting
out_lat_ll = -50
out_lon_ll = 0
out_lat_ur = 50
out_lon_ur = 359.75
# Run the Rscript
Rscript trmmbin2nc.R 3B42.100921.00z.7.precipitation.bin
3B42.100921.00z.7.precipitation.nc
# Plot the result
met-5.2/bin/plot_data_plane 3B42.100921.00z.7.precipitation.nc
3B42.100921.00z.7.precipitation.ps 'name="APCP_03"; level="(*,*)";'
I've attached a PNG version of resulting image.
I see that the domain of your data is much smaller. You have two
choices
here...
(1) In that Rscript, you can choose different boundaries (i.e.
out_lat/lon_ll/ur) to specify the tile of data to be selected.
(2) As of version 5.1, MET includes support for regridding the data it
reads. You could keep TRMM on it's native domain and use the MET
tools to
do the regridding. For example, the "regrid_data_plane" tool reads a
NetCDF file, regrids the data, and writes a NetCDF file.
Alternatively,
the "regrid" section of the configuration files for the MET tools may
be
used to do the regridding on the fly. For example, you could run
Grid-Stat
to compare your model output to TRMM and say "regrid = { field = FCST;
...}". That tells Grid-Stat to automatically regrid the TRMM
observations
to your model domain.
Hope that helps. Do this sounds like a workable path for you?
Thanks,
John
On Sun, Aug 21, 2016 at 12:08 AM, Yonghan Choi via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614 >
>
> Dear John Halley Gotway:
>
> I uploaded my NetCDF-formatted TRMM data to your ftp server.
>
> Actually, I interpolated (to WRF grids) and made accumulation using
> original TRMM data, and I converted HDF-formatted original TRMM data
to
> NetCDF format.
>
> Thank you for your kindness.
>
> Best regards
> Yonghan Choi
>
> On Fri, Aug 19, 2016 at 4:40 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Yongchan,
> >
> > I see that you're having trouble using gridded TRMM data in MET.
I read
> > that you've done some pre-processing of the TRMM data using NCL
prior to
> > passing it to the MET tools.
> >
> > Can you please post a sample NetCDF file that you're passing to
> pcp_combine
> > to our anonymous FTP site, following the instructions listed here:
> > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> >
> > Please write once you've posted a sample file. I'll grab it and
run it
> > through the debugger to identify what's happening.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Thu, Aug 18, 2016 at 4:11 PM, Yonghan Choi via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Thu Aug 18 16:11:55 2016: Request 77614 was acted upon.
> > > Transaction: Ticket created by cyh082 at gmail.com
> > > Queue: met_help
> > > Subject: Question on supported data format
> > > Owner: Nobody
> > > Requestors: cyh082 at gmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614
> >
> > >
> > >
> > > Hello
> > >
> > > I would like to run grid-stat tool using WRF model forecasts and
TRMM
> > > observations.
> > >
> > > I converted original HDF-format TRMM observation to NetCDF-
format, and
> I
> > > also interpolated original lat/lon grid to WRF Lambert conformal
grid
> > using
> > > NCL.
> > >
> > > And I tried to run pcp_combine before running grid-stat tool to
make
> > > accumulated precipitation.
> > >
> > > However, I got errors like
> > > "get_field() -> can't open data file ***.nc"
> > >
> > > Could you give me some advices on this problem?
> > >
> > > And... Actually, I selected TRMM observations to verify WRF
forecasts
> > over
> > > South Korea, where stage-4 analysis is not available.
> > > Could you recommend other gridded precipitation observations
over
> > Southeast
> > > Asia other than TRMM?
> > >
> > > Thank you for your kindness.
> > >
> > > Best regards
> > > Yonghan Choi
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Question on supported data format
From: John Halley Gotway
Time: Tue Aug 23 16:39:12 2016
Oops, looks like I sent you two versions of that PNG file. I intended
it
to be only that global version.
John
On Tue, Aug 23, 2016 at 4:38 PM, John Halley Gotway <johnhg at ucar.edu>
wrote:
> Yonghan,
>
> Thanks for sending that sample data file. Yes, it is definitely a
flavor
> of NetCDF that the MET software is not expecting. Here's an option
for
> accessing that same TRMM data, following links from the MET website:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> # Pull binary 3-hourly TRMM data file
> wget ftp://disc2.nascom.nasa.gov/data/TRMM/Gridded/3B42_V7/
> 201009/3B42.100921.00z.7.precipitation.bin
>
> # Pull Rscript from MET website
> wget
http://www.dtcenter.org/met/users/downloads/Rscripts/trmmbin2nc.R
>
> # Edit that Rscript by setting
> out_lat_ll = -50
> out_lon_ll = 0
> out_lat_ur = 50
> out_lon_ur = 359.75
>
> # Run the Rscript
> Rscript trmmbin2nc.R 3B42.100921.00z.7.precipitation.bin
> 3B42.100921.00z.7.precipitation.nc
>
> # Plot the result
> met-5.2/bin/plot_data_plane 3B42.100921.00z.7.precipitation.nc
> 3B42.100921.00z.7.precipitation.ps 'name="APCP_03"; level="(*,*)";'
>
> I've attached a PNG version of resulting image.
>
> I see that the domain of your data is much smaller. You have two
choices
> here...
> (1) In that Rscript, you can choose different boundaries (i.e.
> out_lat/lon_ll/ur) to specify the tile of data to be selected.
> (2) As of version 5.1, MET includes support for regridding the data
it
> reads. You could keep TRMM on it's native domain and use the MET
tools to
> do the regridding. For example, the "regrid_data_plane" tool reads
a
> NetCDF file, regrids the data, and writes a NetCDF file.
Alternatively,
> the "regrid" section of the configuration files for the MET tools
may be
> used to do the regridding on the fly. For example, you could run
Grid-Stat
> to compare your model output to TRMM and say "regrid = { field =
FCST;
> ...}". That tells Grid-Stat to automatically regrid the TRMM
observations
> to your model domain.
>
> Hope that helps. Do this sounds like a workable path for you?
>
> Thanks,
> John
>
>
> On Sun, Aug 21, 2016 at 12:08 AM, Yonghan Choi via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614 >
>>
>> Dear John Halley Gotway:
>>
>> I uploaded my NetCDF-formatted TRMM data to your ftp server.
>>
>> Actually, I interpolated (to WRF grids) and made accumulation using
>> original TRMM data, and I converted HDF-formatted original TRMM
data to
>> NetCDF format.
>>
>> Thank you for your kindness.
>>
>> Best regards
>> Yonghan Choi
>>
>> On Fri, Aug 19, 2016 at 4:40 PM, John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>> > Yongchan,
>> >
>> > I see that you're having trouble using gridded TRMM data in MET.
I read
>> > that you've done some pre-processing of the TRMM data using NCL
prior to
>> > passing it to the MET tools.
>> >
>> > Can you please post a sample NetCDF file that you're passing to
>> pcp_combine
>> > to our anonymous FTP site, following the instructions listed
here:
>> > http://www.dtcenter.org/met/users/support/met_help.php#ftp
>> >
>> > Please write once you've posted a sample file. I'll grab it and
run it
>> > through the debugger to identify what's happening.
>> >
>> > Thanks,
>> > John Halley Gotway
>> >
>> > On Thu, Aug 18, 2016 at 4:11 PM, Yonghan Choi via RT
<met_help at ucar.edu
>> >
>> > wrote:
>> >
>> > >
>> > > Thu Aug 18 16:11:55 2016: Request 77614 was acted upon.
>> > > Transaction: Ticket created by cyh082 at gmail.com
>> > > Queue: met_help
>> > > Subject: Question on supported data format
>> > > Owner: Nobody
>> > > Requestors: cyh082 at gmail.com
>> > > Status: new
>> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614
>> >
>> > >
>> > >
>> > > Hello
>> > >
>> > > I would like to run grid-stat tool using WRF model forecasts
and TRMM
>> > > observations.
>> > >
>> > > I converted original HDF-format TRMM observation to NetCDF-
format,
>> and I
>> > > also interpolated original lat/lon grid to WRF Lambert
conformal grid
>> > using
>> > > NCL.
>> > >
>> > > And I tried to run pcp_combine before running grid-stat tool to
make
>> > > accumulated precipitation.
>> > >
>> > > However, I got errors like
>> > > "get_field() -> can't open data file ***.nc"
>> > >
>> > > Could you give me some advices on this problem?
>> > >
>> > > And... Actually, I selected TRMM observations to verify WRF
forecasts
>> > over
>> > > South Korea, where stage-4 analysis is not available.
>> > > Could you recommend other gridded precipitation observations
over
>> > Southeast
>> > > Asia other than TRMM?
>> > >
>> > > Thank you for your kindness.
>> > >
>> > > Best regards
>> > > Yonghan Choi
>> > >
>> > >
>> >
>> >
>>
>>
>
------------------------------------------------
Subject: Question on supported data format
From: Yonghan Choi
Time: Tue Aug 23 20:19:20 2016
Dear John Halley Gotway:
Yes, I can try the method you suggested after Yellowstone becomes
available.
I think your advices will be helpful to me.
Thank you very much.
Best regards
Yonghan Choi
On Tue, Aug 23, 2016 at 4:38 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Yonghan,
>
> Thanks for sending that sample data file. Yes, it is definitely a
flavor
> of NetCDF that the MET software is not expecting. Here's an option
for
> accessing that same TRMM data, following links from the MET website:
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> # Pull binary 3-hourly TRMM data file
> wget
> ftp://disc2.nascom.nasa.gov/data/TRMM/Gridded/3B42_V7/
> 201009/3B42.100921.00z.7.precipitation.bin
>
> # Pull Rscript from MET website
> wget
http://www.dtcenter.org/met/users/downloads/Rscripts/trmmbin2nc.R
>
> # Edit that Rscript by setting
> out_lat_ll = -50
> out_lon_ll = 0
> out_lat_ur = 50
> out_lon_ur = 359.75
>
> # Run the Rscript
> Rscript trmmbin2nc.R 3B42.100921.00z.7.precipitation.bin
> 3B42.100921.00z.7.precipitation.nc
>
> # Plot the result
> met-5.2/bin/plot_data_plane 3B42.100921.00z.7.precipitation.nc
> 3B42.100921.00z.7.precipitation.ps 'name="APCP_03"; level="(*,*)";'
>
> I've attached a PNG version of resulting image.
>
> I see that the domain of your data is much smaller. You have two
choices
> here...
> (1) In that Rscript, you can choose different boundaries (i.e.
> out_lat/lon_ll/ur) to specify the tile of data to be selected.
> (2) As of version 5.1, MET includes support for regridding the data
it
> reads. You could keep TRMM on it's native domain and use the MET
tools to
> do the regridding. For example, the "regrid_data_plane" tool reads
a
> NetCDF file, regrids the data, and writes a NetCDF file.
Alternatively,
> the "regrid" section of the configuration files for the MET tools
may be
> used to do the regridding on the fly. For example, you could run
Grid-Stat
> to compare your model output to TRMM and say "regrid = { field =
FCST;
> ...}". That tells Grid-Stat to automatically regrid the TRMM
observations
> to your model domain.
>
> Hope that helps. Do this sounds like a workable path for you?
>
> Thanks,
> John
>
>
> On Sun, Aug 21, 2016 at 12:08 AM, Yonghan Choi via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77614 >
> >
> > Dear John Halley Gotway:
> >
> > I uploaded my NetCDF-formatted TRMM data to your ftp server.
> >
> > Actually, I interpolated (to WRF grids) and made accumulation
using
> > original TRMM data, and I converted HDF-formatted original TRMM
data to
> > NetCDF format.
> >
> > Thank you for your kindness.
> >
> > Best regards
> > Yonghan Choi
> >
> > On Fri, Aug 19, 2016 at 4:40 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Yongchan,
> > >
> > > I see that you're having trouble using gridded TRMM data in MET.
I
> read
> > > that you've done some pre-processing of the TRMM data using NCL
prior
> to
> > > passing it to the MET tools.
> > >
> > > Can you please post a sample NetCDF file that you're passing to
> > pcp_combine
> > > to our anonymous FTP site, following the instructions listed
here:
> > > http://www.dtcenter.org/met/users/support/met_help.php#ftp
> > >
> > > Please write once you've posted a sample file. I'll grab it and
run it
> > > through the debugger to identify what's happening.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > > On Thu, Aug 18, 2016 at 4:11 PM, Yonghan Choi via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > Thu Aug 18 16:11:55 2016: Request 77614 was acted upon.
> > > > Transaction: Ticket created by cyh082 at gmail.com
> > > > Queue: met_help
> > > > Subject: Question on supported data format
> > > > Owner: Nobody
> > > > Requestors: cyh082 at gmail.com
> > > > Status: new
> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=77614
> > >
> > > >
> > > >
> > > > Hello
> > > >
> > > > I would like to run grid-stat tool using WRF model forecasts
and TRMM
> > > > observations.
> > > >
> > > > I converted original HDF-format TRMM observation to NetCDF-
format,
> and
> > I
> > > > also interpolated original lat/lon grid to WRF Lambert
conformal grid
> > > using
> > > > NCL.
> > > >
> > > > And I tried to run pcp_combine before running grid-stat tool
to make
> > > > accumulated precipitation.
> > > >
> > > > However, I got errors like
> > > > "get_field() -> can't open data file ***.nc"
> > > >
> > > > Could you give me some advices on this problem?
> > > >
> > > > And... Actually, I selected TRMM observations to verify WRF
forecasts
> > > over
> > > > South Korea, where stage-4 analysis is not available.
> > > > Could you recommend other gridded precipitation observations
over
> > > Southeast
> > > > Asia other than TRMM?
> > > >
> > > > Thank you for your kindness.
> > > >
> > > > Best regards
> > > > Yonghan Choi
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list