[Met_help] [rt.rap.ucar.edu #77890] History for Ingesting wrfout netcdf in ensemble_stat
John Halley Gotway via RT
met_help at ucar.edu
Wed Sep 14 09:57:11 MDT 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I’m using met V5.1 from the /ral directory on yellowstone with the bug patches.
I’m attempting to use Ensemble_stat on wrfouts, as I understand it can now ingest gridded data in netcdf format, but i get an error with reading the file. I’ve tried with and without the .nc extension. I couldn’t find anything in the archived emails, but i’m guessing this is a simple fix or it simply can’t handle the netcdf version of the raw wrfouts?
Thanks,
Brock
+ bin/ensemble_stat ens_file_list EnsembleStatConfig_TTU_RAOB_D1 -point_obs prepbufr.gdas.20150506.00z_raob.nc -outdir ./ -v 2
DEBUG 1: Default Config File: /glade/p/ral/jnt/MET/MET_releases/met-5.1/share/met/config/EnsembleStatConfig_default
DEBUG 1: User Config File: EnsembleStatConfig_TTU_RAOB_D1
ERROR :
ERROR : process_command_line() -> Trouble reading ensemble file "/glade/scratch/brockb/output/2015050600/DART/advance_temp1/D1/wrfout_d01_2015-05-06_00:00:00.nc"
ERROR :
Brock Burghardt
Atmospheric Science PhD Candidate
Dept. of Geosciences
Texas Tech University
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Ingesting wrfout netcdf in ensemble_stat
From: Julie Prestopnik
Time: Tue Sep 13 13:15:51 2016
Hi Brock. Unfortunately, MET doesn't read the NetCDF output of WRF
directly. Instead, we encourage folks to post process WRF output
using the
Unified Post Processor (UPP). Its output is in GRIB format which can
easily be regridded using the copygb utility, whereas there is no easy
way
of regridding netcdf data, in general.
Here is a link to our tutorial page on copygb which you may find
useful:
http://www.dtcenter.org/met/users/support/online_tutorial/ME
Tv5.0/copygb/index.php
and a link to UPP:
http://www.dtcenter.org/upp/users/
EnsembleStat can read either GRIB files or the NetCDF output of
PCP-Combine, but not NetCDF in general. Also, I should mention that
one
major enhancement for the next version of MET (version 6.0) will be
switching to reading/writing the enhanced data model in NetCDF4. But
MET
version 5.2 and all previous versions only support 3.
I hope this helps.
Julie
On Tue, Sep 13, 2016 at 12:11 PM, Burghardt, Brock via RT
<met_help at ucar.edu
> wrote:
>
> Tue Sep 13 12:11:15 2016: Request 77890 was acted upon.
> Transaction: Ticket created by brock.burghardt at ttu.edu
> Queue: met_help
> Subject: Ingesting wrfout netcdf in ensemble_stat
> Owner: Nobody
> Requestors: brock.burghardt at ttu.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77890 >
>
>
> Hello,
>
> I’m using met V5.1 from the /ral directory on yellowstone with the
bug
> patches.
>
> I’m attempting to use Ensemble_stat on wrfouts, as I understand it
can now
> ingest gridded data in netcdf format, but i get an error with
reading the
> file. I’ve tried with and without the .nc extension. I couldn’t find
> anything in the archived emails, but i’m guessing this is a simple
fix or
> it simply can’t handle the netcdf version of the raw wrfouts?
>
> Thanks,
> Brock
>
>
>
> + bin/ensemble_stat ens_file_list EnsembleStatConfig_TTU_RAOB_D1
> -point_obs prepbufr.gdas.20150506.00z_raob.nc -outdir ./ -v 2
> DEBUG 1: Default Config File: /glade/p/ral/jnt/MET/MET_relea
> ses/met-5.1/share/met/config/EnsembleStatConfig_default
> DEBUG 1: User Config File: EnsembleStatConfig_TTU_RAOB_D1
> ERROR :
> ERROR : process_command_line() -> Trouble reading ensemble file
> "/glade/scratch/brockb/output/2015050600/DART/advance_temp1/
> D1/wrfout_d01_2015-05-06_00:00:00.nc"
> ERROR :
>
> Brock Burghardt
> Atmospheric Science PhD Candidate
> Dept. of Geosciences
> Texas Tech University
>
>
>
>
>
--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
------------------------------------------------
Subject: Ingesting wrfout netcdf in ensemble_stat
From: John Halley Gotway
Time: Tue Sep 13 14:32:47 2016
Hi Brock,
I see that you're trying to use the raw NetCDF wrfout files directly
in
MET. This does not work.
MET has the ability to read 3 different flavors of NetCDF...
- The format used to write intermediate files in MET (i.e. the output
of
pcp_combine)
- NetCDF files following the Climate Forecast conventions (i.e.
CF-compliant NetCDF)
- The output of the pinterp or wrf_interp utility
Raw WRF output files are not included in that list. The challenge is
not
the file format but that the data is still in native model levels and
is
defined on a staggered grid.
You have two options...
- Post-process using the Unified PostProcessor which creates GRIB
output
files.
- Post-process using the wrf_interp utility which writes a NetCDF
file
that MET reads.
The downside to wrf_interp is that it does not actually destagger the
grid
and doesn't derive any additional output fields. Practically speaking
that
means you're limited to the raw WRF output variables, and MET can't
read
winds which use the staggered dimension.
Hope that helps clarify.
Thanks,
John
On Tue, Sep 13, 2016 at 12:11 PM, Burghardt, Brock via RT
<met_help at ucar.edu
> wrote:
>
> Tue Sep 13 12:11:15 2016: Request 77890 was acted upon.
> Transaction: Ticket created by brock.burghardt at ttu.edu
> Queue: met_help
> Subject: Ingesting wrfout netcdf in ensemble_stat
> Owner: Nobody
> Requestors: brock.burghardt at ttu.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77890 >
>
>
> Hello,
>
> I’m using met V5.1 from the /ral directory on yellowstone with the
bug
> patches.
>
> I’m attempting to use Ensemble_stat on wrfouts, as I understand it
can now
> ingest gridded data in netcdf format, but i get an error with
reading the
> file. I’ve tried with and without the .nc extension. I couldn’t find
> anything in the archived emails, but i’m guessing this is a simple
fix or
> it simply can’t handle the netcdf version of the raw wrfouts?
>
> Thanks,
> Brock
>
>
>
> + bin/ensemble_stat ens_file_list EnsembleStatConfig_TTU_RAOB_D1
> -point_obs prepbufr.gdas.20150506.00z_raob.nc -outdir ./ -v 2
> DEBUG 1: Default Config File: /glade/p/ral/jnt/MET/MET_relea
> ses/met-5.1/share/met/config/EnsembleStatConfig_default
> DEBUG 1: User Config File: EnsembleStatConfig_TTU_RAOB_D1
> ERROR :
> ERROR : process_command_line() -> Trouble reading ensemble file
> "/glade/scratch/brockb/output/2015050600/DART/advance_temp1/
> D1/wrfout_d01_2015-05-06_00:00:00.nc"
> ERROR :
>
> Brock Burghardt
> Atmospheric Science PhD Candidate
> Dept. of Geosciences
> Texas Tech University
>
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77890] Ingesting wrfout netcdf in ensemble_stat
From: Burghardt, Brock
Time: Tue Sep 13 15:12:34 2016
OK, thanks John and Julie,
I got excited when I saw the netcdf support and assumed it could
handle netcdf4. I have scripts to run UPP over the ensemble set and
cases.
When do you expect to release V6.0?
Thanks again,
Brock
> On Sep 13, 2016, at 3:32 PM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Hi Brock,
>
> I see that you're trying to use the raw NetCDF wrfout files directly
in
> MET. This does not work.
>
> MET has the ability to read 3 different flavors of NetCDF...
> - The format used to write intermediate files in MET (i.e. the
output of
> pcp_combine)
> - NetCDF files following the Climate Forecast conventions (i.e.
> CF-compliant NetCDF)
> - The output of the pinterp or wrf_interp utility
>
> Raw WRF output files are not included in that list. The challenge
is not
> the file format but that the data is still in native model levels
and is
> defined on a staggered grid.
>
> You have two options...
> - Post-process using the Unified PostProcessor which creates GRIB
output
> files.
> - Post-process using the wrf_interp utility which writes a NetCDF
file
> that MET reads.
>
> The downside to wrf_interp is that it does not actually destagger
the grid
> and doesn't derive any additional output fields. Practically
speaking that
> means you're limited to the raw WRF output variables, and MET can't
read
> winds which use the staggered dimension.
>
> Hope that helps clarify.
>
> Thanks,
> John
>
> On Tue, Sep 13, 2016 at 12:11 PM, Burghardt, Brock via RT
<met_help at ucar.edu
>> wrote:
>
>>
>> Tue Sep 13 12:11:15 2016: Request 77890 was acted upon.
>> Transaction: Ticket created by brock.burghardt at ttu.edu
>> Queue: met_help
>> Subject: Ingesting wrfout netcdf in ensemble_stat
>> Owner: Nobody
>> Requestors: brock.burghardt at ttu.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77890 >
>>
>>
>> Hello,
>>
>> I’m using met V5.1 from the /ral directory on yellowstone with the
bug
>> patches.
>>
>> I’m attempting to use Ensemble_stat on wrfouts, as I understand it
can now
>> ingest gridded data in netcdf format, but i get an error with
reading the
>> file. I’ve tried with and without the .nc extension. I couldn’t
find
>> anything in the archived emails, but i’m guessing this is a simple
fix or
>> it simply can’t handle the netcdf version of the raw wrfouts?
>>
>> Thanks,
>> Brock
>>
>>
>>
>> + bin/ensemble_stat ens_file_list EnsembleStatConfig_TTU_RAOB_D1
>> -point_obs prepbufr.gdas.20150506.00z_raob.nc -outdir ./ -v 2
>> DEBUG 1: Default Config File: /glade/p/ral/jnt/MET/MET_relea
>> ses/met-5.1/share/met/config/EnsembleStatConfig_default
>> DEBUG 1: User Config File: EnsembleStatConfig_TTU_RAOB_D1
>> ERROR :
>> ERROR : process_command_line() -> Trouble reading ensemble file
>> "/glade/scratch/brockb/output/2015050600/DART/advance_temp1/
>> D1/wrfout_d01_2015-05-06_00:00:00.nc"
>> ERROR :
>>
>> Brock Burghardt
>> Atmospheric Science PhD Candidate
>> Dept. of Geosciences
>> Texas Tech University
>>
>>
>>
>>
>>
>
------------------------------------------------
Subject: Ingesting wrfout netcdf in ensemble_stat
From: John Halley Gotway
Time: Tue Sep 13 16:18:55 2016
Brock,
We're still in the early stages of development. Our target is the
Dec/Jan
time frame.
John
On Tue, Sep 13, 2016 at 3:12 PM, Burghardt, Brock via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77890 >
>
> OK, thanks John and Julie,
>
> I got excited when I saw the netcdf support and assumed it could
handle
> netcdf4. I have scripts to run UPP over the ensemble set and cases.
>
> When do you expect to release V6.0?
>
> Thanks again,
> Brock
>
> > On Sep 13, 2016, at 3:32 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
> >
> > Hi Brock,
> >
> > I see that you're trying to use the raw NetCDF wrfout files
directly in
> > MET. This does not work.
> >
> > MET has the ability to read 3 different flavors of NetCDF...
> > - The format used to write intermediate files in MET (i.e. the
output of
> > pcp_combine)
> > - NetCDF files following the Climate Forecast conventions (i.e.
> > CF-compliant NetCDF)
> > - The output of the pinterp or wrf_interp utility
> >
> > Raw WRF output files are not included in that list. The challenge
is not
> > the file format but that the data is still in native model levels
and is
> > defined on a staggered grid.
> >
> > You have two options...
> > - Post-process using the Unified PostProcessor which creates GRIB
output
> > files.
> > - Post-process using the wrf_interp utility which writes a NetCDF
file
> > that MET reads.
> >
> > The downside to wrf_interp is that it does not actually destagger
the
> grid
> > and doesn't derive any additional output fields. Practically
speaking
> that
> > means you're limited to the raw WRF output variables, and MET
can't read
> > winds which use the staggered dimension.
> >
> > Hope that helps clarify.
> >
> > Thanks,
> > John
> >
> > On Tue, Sep 13, 2016 at 12:11 PM, Burghardt, Brock via RT <
> met_help at ucar.edu
> >> wrote:
> >
> >>
> >> Tue Sep 13 12:11:15 2016: Request 77890 was acted upon.
> >> Transaction: Ticket created by brock.burghardt at ttu.edu
> >> Queue: met_help
> >> Subject: Ingesting wrfout netcdf in ensemble_stat
> >> Owner: Nobody
> >> Requestors: brock.burghardt at ttu.edu
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77890 >
> >>
> >>
> >> Hello,
> >>
> >> I’m using met V5.1 from the /ral directory on yellowstone with
the bug
> >> patches.
> >>
> >> I’m attempting to use Ensemble_stat on wrfouts, as I understand
it can
> now
> >> ingest gridded data in netcdf format, but i get an error with
reading
> the
> >> file. I’ve tried with and without the .nc extension. I couldn’t
find
> >> anything in the archived emails, but i’m guessing this is a
simple fix
> or
> >> it simply can’t handle the netcdf version of the raw wrfouts?
> >>
> >> Thanks,
> >> Brock
> >>
> >>
> >>
> >> + bin/ensemble_stat ens_file_list EnsembleStatConfig_TTU_RAOB_D1
> >> -point_obs prepbufr.gdas.20150506.00z_raob.nc -outdir ./ -v 2
> >> DEBUG 1: Default Config File: /glade/p/ral/jnt/MET/MET_relea
> >> ses/met-5.1/share/met/config/EnsembleStatConfig_default
> >> DEBUG 1: User Config File: EnsembleStatConfig_TTU_RAOB_D1
> >> ERROR :
> >> ERROR : process_command_line() -> Trouble reading ensemble file
> >> "/glade/scratch/brockb/output/2015050600/DART/advance_temp1/
> >> D1/wrfout_d01_2015-05-06_00:00:00.nc"
> >> ERROR :
> >>
> >> Brock Burghardt
> >> Atmospheric Science PhD Candidate
> >> Dept. of Geosciences
> >> Texas Tech University
> >>
> >>
> >>
> >>
> >>
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list