[Met_help] [rt.rap.ucar.edu #83228] History for pcp_combine and using WRF OUT files
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:04:00 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello MET Help folks, you have been great with your support!! Thank you! I have another question for you:
What format does pcp_combine expect to use?
I am using HWRF wrfout files, with the naming convention:
wrfout_d03_2014-10-15_00_00_00
In my docker container, when running the tutorial version, with the command:
>docker run -it -v /c/Users/scd30365/container-dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial /bin/bash
>pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000 12 out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir out/Gonzalo_data/GONZALO/CNTRL
I get errors regarding: (1) the "timestring-to-unix" "Can't parse timestring." (2) The format of the wrf files.
I have tried using grib files, but they are at individual pressure levels. I have tried renaming the wrf files, but they are not in a readable format by pcp_combine.
Can you tell me what HWRF output files pcp_combine is expecting and in what format?
Thanks,
Suzanna
Suzanna C. Diener, Ph.D.
Sr. Scientist/Engineer
The Aerospace Corporation
Space-Based Sensing Division
Boulder, CO 80301
(W) 303-718-0274
Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: pcp_combine and using WRF OUT files
From: John Halley Gotway
Time: Thu Dec 07 09:28:21 2017
Suzanna,
The MET tools do not read the raw NetCDF output from WRF directly.
Instead, MET expects them to be post-processed using either the
Unified
PostProcessor (UPP) or the wrf_interp utility. We recommend using UPP
since it's output is GRIB 1/2 which MET supports well.
You mentioned that you already tried using GRIB files, and that should
work
fine. So let's try to figure out those details.
In general, pcp_combine is used to adjust the accumulation interval of
precipitation data. It can be run in 3 modes, -add, -subtract, and
-sum.
Of the three, the -sum option is probably the most confusing command
line
arguments. The important question is what are you trying to use
pcp_combine to accomplish?
Since you're running HWRF, here's one possibility...
- You HWRF output contains a runtime accumulation of accumulated
precipitation.
- The QPE data you'd like to compare against contains 6-hourly or
24-hour
accumulations.
- So you'd like to use pcp_combine to put your HWRF runtime
accumulations
into the same intervals as the QPE.
- If this is the situation, then you'd run the pcp_combine -subtract
command to generate the smaller accumulation intervals.
For example,
pcp_combine -subtract hwrf_f72.grib 72 hwrf_f48.grb 48
hwrf_APCP_24_f48_to_f72.nc
In this example, pcp_combine looks for precip accumulated over 72
hours
from the first file (hwrf_f72.grib) and precip accumulated over 48
hours
from the second file (hwrf_f48.grib), computes their difference, and
writes
the output file (hwrf_APCP_24_f48_to_f72.nc). Of course, you can name
the
output file whatever you'd like.
Thanks,
John
On Thu, Dec 7, 2017 at 9:02 AM, Suzanna C Diener via RT
<met_help at ucar.edu>
wrote:
>
> Thu Dec 07 09:02:38 2017: Request 83228 was acted upon.
> Transaction: Ticket created by suzanna.c.diener at aero.org
> Queue: met_help
> Subject: pcp_combine and using WRF OUT files
> Owner: Nobody
> Requestors: suzanna.c.diener at aero.org
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
>
>
> Hello MET Help folks, you have been great with your support!!
Thank
> you! I have another question for you:
>
> What format does pcp_combine expect to use?
>
> I am using HWRF wrfout files, with the naming convention:
>
> wrfout_d03_2014-10-15_00_00_00
>
> In my docker container, when running the tutorial version, with the
> command:
>
> >docker run -it -v /c/Users/scd30365/container-
> dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial
/bin/bash
> >pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000
12
> out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
> out/Gonzalo_data/GONZALO/CNTRL
>
> I get errors regarding: (1) the "timestring-to-unix" "Can't parse
> timestring." (2) The format of the wrf files.
>
> I have tried using grib files, but they are at individual pressure
> levels. I have tried renaming the wrf files, but they are not in a
> readable format by pcp_combine.
>
> Can you tell me what HWRF output files pcp_combine is expecting and
in
> what format?
>
> Thanks,
>
> Suzanna
> Suzanna C. Diener, Ph.D.
> Sr. Scientist/Engineer
> The Aerospace Corporation
> Space-Based Sensing Division
> Boulder, CO 80301
>
> (W) 303-718-0274
> Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT files
From: Suzanna C Diener
Time: Tue Dec 19 13:11:20 2017
Dear John,
When I run pcp_combine, it has trouble with the grb format.... I've
tried a few different files, but I keep getting errors. Could you
tell me which grb files work with the command you are using, below?
Thanks, -Suzanna
There are several different types of grb files, including:
*.*.hwrfprs.d1.0p20.f***.grb
*.*.hwrfprs.d123.0p06.f***.grb
*.*.hwrfprs.d123.0p25.f***.grb
*.*.hwrfprs.d2.0p06.f**.grb
*.*.hwrfprs.d23.0p02.f***.grb
*.*.hwrfprs.d3.0p02.f***.grb
*.*.hwrfsat.d123.0p25.f***.grb
*.*.hwrfsat.d1.0p20.f**.grb
.
.
.
*.*.hwrftrk.d1.grbf00
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, December 07, 2017 9:28 AM
To: Suzanna C Diener <suzanna.c.diener at aero.org>
Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
files
Suzanna,
The MET tools do not read the raw NetCDF output from WRF directly.
Instead, MET expects them to be post-processed using either the
Unified PostProcessor (UPP) or the wrf_interp utility. We recommend
using UPP since it's output is GRIB 1/2 which MET supports well.
You mentioned that you already tried using GRIB files, and that should
work fine. So let's try to figure out those details.
In general, pcp_combine is used to adjust the accumulation interval of
precipitation data. It can be run in 3 modes, -add, -subtract, and
-sum.
Of the three, the -sum option is probably the most confusing command
line arguments. The important question is what are you trying to use
pcp_combine to accomplish?
Since you're running HWRF, here's one possibility...
- You HWRF output contains a runtime accumulation of accumulated
precipitation.
- The QPE data you'd like to compare against contains 6-hourly or
24-hour accumulations.
- So you'd like to use pcp_combine to put your HWRF runtime
accumulations into the same intervals as the QPE.
- If this is the situation, then you'd run the pcp_combine -subtract
command to generate the smaller accumulation intervals.
For example,
pcp_combine -subtract hwrf_f72.grib 72 hwrf_f48.grb 48
hwrf_APCP_24_f48_to_f72.nc
In this example, pcp_combine looks for precip accumulated over 72
hours from the first file (hwrf_f72.grib) and precip accumulated over
48 hours from the second file (hwrf_f48.grib), computes their
difference, and writes the output file (hwrf_APCP_24_f48_to_f72.nc).
Of course, you can name the output file whatever you'd like.
Thanks,
John
On Thu, Dec 7, 2017 at 9:02 AM, Suzanna C Diener via RT
<met_help at ucar.edu>
wrote:
>
> Thu Dec 07 09:02:38 2017: Request 83228 was acted upon.
> Transaction: Ticket created by suzanna.c.diener at aero.org
> Queue: met_help
> Subject: pcp_combine and using WRF OUT files
> Owner: Nobody
> Requestors: suzanna.c.diener at aero.org
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228
> >
>
>
> Hello MET Help folks, you have been great with your support!!
Thank
> you! I have another question for you:
>
> What format does pcp_combine expect to use?
>
> I am using HWRF wrfout files, with the naming convention:
>
> wrfout_d03_2014-10-15_00_00_00
>
> In my docker container, when running the tutorial version, with the
> command:
>
> >docker run -it -v /c/Users/scd30365/container-
> dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial
> /bin/bash
> >pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000
12
> out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
> out/Gonzalo_data/GONZALO/CNTRL
>
> I get errors regarding: (1) the "timestring-to-unix" "Can't parse
> timestring." (2) The format of the wrf files.
>
> I have tried using grib files, but they are at individual pressure
> levels. I have tried renaming the wrf files, but they are not in a
> readable format by pcp_combine.
>
> Can you tell me what HWRF output files pcp_combine is expecting and
in
> what format?
>
> Thanks,
>
> Suzanna
> Suzanna C. Diener, Ph.D.
> Sr. Scientist/Engineer
> The Aerospace Corporation
> Space-Based Sensing Division
> Boulder, CO 80301
>
> (W) 303-718-0274
> Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
>
>
>
------------------------------------------------
Subject: pcp_combine and using WRF OUT files
From: Julie Prestopnik
Time: Tue Dec 19 13:53:52 2017
Hi Suzanna.
Unfortunately, most of our met_help staff is out this week and next,
so
our response time will be delayed. I am only in the office today and
won't return until January. John is currently out as well.
I don't believe there is a specific filename format that will or won't
work
with MET. Maybe it would be best to look at a specific case. We
could
start off with specific files and you can tell us what you have tried
to
run and what the problem was. You could upload the files to our ftp
site
using the following instructions and let us know once you have done
that so
that we can get the file and take a look.
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Unfortunately, if no one is around to grab the files, they may age off
and
we may ask you to upload them again. Thank you for your patience with
us
during this holiday season.
Julie
On Tue, Dec 19, 2017 at 1:11 PM, Suzanna C Diener via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
>
> Dear John,
>
> When I run pcp_combine, it has trouble with the grb format.... I've
tried
> a few different files, but I keep getting errors. Could you tell me
which
> grb files work with the command you are using, below? Thanks,
-Suzanna
>
> There are several different types of grb files, including:
>
> *.*.hwrfprs.d1.0p20.f***.grb
> *.*.hwrfprs.d123.0p06.f***.grb
> *.*.hwrfprs.d123.0p25.f***.grb
> *.*.hwrfprs.d2.0p06.f**.grb
> *.*.hwrfprs.d23.0p02.f***.grb
> *.*.hwrfprs.d3.0p02.f***.grb
>
> *.*.hwrfsat.d123.0p25.f***.grb
> *.*.hwrfsat.d1.0p20.f**.grb
> .
> .
> .
>
> *.*.hwrftrk.d1.grbf00
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, December 07, 2017 9:28 AM
> To: Suzanna C Diener <suzanna.c.diener at aero.org>
> Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
files
>
> Suzanna,
>
> The MET tools do not read the raw NetCDF output from WRF directly.
> Instead, MET expects them to be post-processed using either the
Unified
> PostProcessor (UPP) or the wrf_interp utility. We recommend using
UPP
> since it's output is GRIB 1/2 which MET supports well.
>
> You mentioned that you already tried using GRIB files, and that
should
> work fine. So let's try to figure out those details.
>
> In general, pcp_combine is used to adjust the accumulation interval
of
> precipitation data. It can be run in 3 modes, -add, -subtract, and
-sum.
> Of the three, the -sum option is probably the most confusing command
line
> arguments. The important question is what are you trying to use
> pcp_combine to accomplish?
>
> Since you're running HWRF, here's one possibility...
> - You HWRF output contains a runtime accumulation of accumulated
> precipitation.
> - The QPE data you'd like to compare against contains 6-hourly or
> 24-hour accumulations.
> - So you'd like to use pcp_combine to put your HWRF runtime
> accumulations into the same intervals as the QPE.
> - If this is the situation, then you'd run the pcp_combine
-subtract
> command to generate the smaller accumulation intervals.
>
> For example,
> pcp_combine -subtract hwrf_f72.grib 72 hwrf_f48.grb 48
> hwrf_APCP_24_f48_to_f72.nc
>
> In this example, pcp_combine looks for precip accumulated over 72
hours
> from the first file (hwrf_f72.grib) and precip accumulated over 48
hours
> from the second file (hwrf_f48.grib), computes their difference, and
writes
> the output file (hwrf_APCP_24_f48_to_f72.nc). Of course, you can
name the
> output file whatever you'd like.
>
> Thanks,
> John
>
> On Thu, Dec 7, 2017 at 9:02 AM, Suzanna C Diener via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Thu Dec 07 09:02:38 2017: Request 83228 was acted upon.
> > Transaction: Ticket created by suzanna.c.diener at aero.org
> > Queue: met_help
> > Subject: pcp_combine and using WRF OUT files
> > Owner: Nobody
> > Requestors: suzanna.c.diener at aero.org
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228
> > >
> >
> >
> > Hello MET Help folks, you have been great with your support!!
Thank
> > you! I have another question for you:
> >
> > What format does pcp_combine expect to use?
> >
> > I am using HWRF wrfout files, with the naming convention:
> >
> > wrfout_d03_2014-10-15_00_00_00
> >
> > In my docker container, when running the tutorial version, with
the
> > command:
> >
> > >docker run -it -v /c/Users/scd30365/container-
> > dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial
> > /bin/bash
> > >pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000
12
> > out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
> > out/Gonzalo_data/GONZALO/CNTRL
> >
> > I get errors regarding: (1) the "timestring-to-unix" "Can't parse
> > timestring." (2) The format of the wrf files.
> >
> > I have tried using grib files, but they are at individual pressure
> > levels. I have tried renaming the wrf files, but they are not in
a
> > readable format by pcp_combine.
> >
> > Can you tell me what HWRF output files pcp_combine is expecting
and in
> > what format?
> >
> > Thanks,
> >
> > Suzanna
> > Suzanna C. Diener, Ph.D.
> > Sr. Scientist/Engineer
> > The Aerospace Corporation
> > Space-Based Sensing Division
> > Boulder, CO 80301
> >
> > (W) 303-718-0274 <(303)%20718-0274>
> > Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT files
From: Suzanna C Diener
Time: Tue Dec 19 13:57:07 2017
Thanks, Julie. I'll just experiment around on my own, and wait until
the new year.
Suzanna
-----Original Message-----
From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, December 19, 2017 1:54 PM
To: Suzanna C Diener <suzanna.c.diener at aero.org>
Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
files
Hi Suzanna.
Unfortunately, most of our met_help staff is out this week and next,
so
our response time will be delayed. I am only in the office today and
won't return until January. John is currently out as well.
I don't believe there is a specific filename format that will or won't
work with MET. Maybe it would be best to look at a specific case. We
could start off with specific files and you can tell us what you have
tried to run and what the problem was. You could upload the files to
our ftp site using the following instructions and let us know once you
have done that so that we can get the file and take a look.
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Unfortunately, if no one is around to grab the files, they may age off
and we may ask you to upload them again. Thank you for your patience
with us during this holiday season.
Julie
On Tue, Dec 19, 2017 at 1:11 PM, Suzanna C Diener via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
>
> Dear John,
>
> When I run pcp_combine, it has trouble with the grb format.... I've
> tried a few different files, but I keep getting errors. Could you
> tell me which grb files work with the command you are using, below?
> Thanks, -Suzanna
>
> There are several different types of grb files, including:
>
> *.*.hwrfprs.d1.0p20.f***.grb
> *.*.hwrfprs.d123.0p06.f***.grb
> *.*.hwrfprs.d123.0p25.f***.grb
> *.*.hwrfprs.d2.0p06.f**.grb
> *.*.hwrfprs.d23.0p02.f***.grb
> *.*.hwrfprs.d3.0p02.f***.grb
>
> *.*.hwrfsat.d123.0p25.f***.grb
> *.*.hwrfsat.d1.0p20.f**.grb
> .
> .
> .
>
> *.*.hwrftrk.d1.grbf00
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, December 07, 2017 9:28 AM
> To: Suzanna C Diener <suzanna.c.diener at aero.org>
> Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
> files
>
> Suzanna,
>
> The MET tools do not read the raw NetCDF output from WRF directly.
> Instead, MET expects them to be post-processed using either the
> Unified PostProcessor (UPP) or the wrf_interp utility. We recommend
> using UPP since it's output is GRIB 1/2 which MET supports well.
>
> You mentioned that you already tried using GRIB files, and that
should
> work fine. So let's try to figure out those details.
>
> In general, pcp_combine is used to adjust the accumulation interval
of
> precipitation data. It can be run in 3 modes, -add, -subtract, and
-sum.
> Of the three, the -sum option is probably the most confusing command
> line arguments. The important question is what are you trying to
use
> pcp_combine to accomplish?
>
> Since you're running HWRF, here's one possibility...
> - You HWRF output contains a runtime accumulation of accumulated
> precipitation.
> - The QPE data you'd like to compare against contains 6-hourly or
> 24-hour accumulations.
> - So you'd like to use pcp_combine to put your HWRF runtime
> accumulations into the same intervals as the QPE.
> - If this is the situation, then you'd run the pcp_combine
-subtract
> command to generate the smaller accumulation intervals.
>
> For example,
> pcp_combine -subtract hwrf_f72.grib 72 hwrf_f48.grb 48
> hwrf_APCP_24_f48_to_f72.nc
>
> In this example, pcp_combine looks for precip accumulated over 72
> hours from the first file (hwrf_f72.grib) and precip accumulated
over
> 48 hours from the second file (hwrf_f48.grib), computes their
> difference, and writes the output file (hwrf_APCP_24_f48_to_f72.nc).
> Of course, you can name the output file whatever you'd like.
>
> Thanks,
> John
>
> On Thu, Dec 7, 2017 at 9:02 AM, Suzanna C Diener via RT
> <met_help at ucar.edu
> >
> wrote:
>
> >
> > Thu Dec 07 09:02:38 2017: Request 83228 was acted upon.
> > Transaction: Ticket created by suzanna.c.diener at aero.org
> > Queue: met_help
> > Subject: pcp_combine and using WRF OUT files
> > Owner: Nobody
> > Requestors: suzanna.c.diener at aero.org
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228
> > >
> >
> >
> > Hello MET Help folks, you have been great with your support!!
> > Thank you! I have another question for you:
> >
> > What format does pcp_combine expect to use?
> >
> > I am using HWRF wrfout files, with the naming convention:
> >
> > wrfout_d03_2014-10-15_00_00_00
> >
> > In my docker container, when running the tutorial version, with
the
> > command:
> >
> > >docker run -it -v /c/Users/scd30365/container-
> > dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial
> > /bin/bash
> > >pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000
> > >12
> > out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
> > out/Gonzalo_data/GONZALO/CNTRL
> >
> > I get errors regarding: (1) the "timestring-to-unix" "Can't parse
> > timestring." (2) The format of the wrf files.
> >
> > I have tried using grib files, but they are at individual pressure
> > levels. I have tried renaming the wrf files, but they are not in
a
> > readable format by pcp_combine.
> >
> > Can you tell me what HWRF output files pcp_combine is expecting
and
> > in what format?
> >
> > Thanks,
> >
> > Suzanna
> > Suzanna C. Diener, Ph.D.
> > Sr. Scientist/Engineer
> > The Aerospace Corporation
> > Space-Based Sensing Division
> > Boulder, CO 80301
> >
> > (W) 303-718-0274 <(303)%20718-0274>
> > Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: pcp_combine and using WRF OUT files
From: John Halley Gotway
Time: Tue Dec 19 16:17:36 2017
Hi Suzanna,
Based on the example you sent, it looks like you're trying to process
the
NetCDF output of WRF directly. The MET tools require that raw WRFOUT
files
first be post-processed using either the Unified Post Processor (UPP)
or
the wrf_interp utility. Forgive me if we've already covered this in a
previous email. I can't remember.
We strongly recommend running UPP since it's output is GRIB 1 or 2,
file
formats which MET handles well. But for your specific error message,
here's the command you ran:
pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000 12
out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
out/Gonzalo_data/GONZALO/CNTRL
Two things to note...
First, the sum command only works on GRIB1 or GRIB2 output files, not
the
NetCDF output of wrf_interp.
Second, take a look at this example of the sum command from the online
tutorial:
https://dtcenter.org/met/users/support/online_tutorial/METv6.1/tutorial.php?name=pcp_combine&category=run
The first argument should be a timestring in YYYYMMDD_HHMMSS format
indicating the forecast initialization time. You've listed a wrfout
filename in the first spot. I suspect that's the source of the
parsing
error.
If you're running WRF, your output likely contains a runtime
accumulation
of precipitation. When you run runtime accumulation data through
pcp_combine, you'll want to use the "-subtract" option. You can read
about
the details in chapter 5 of the MET User's Guide:
https://dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.1.pdf
Hope that helps get you going.
Thanks,
John
On Tue, Dec 19, 2017 at 1:57 PM, Suzanna C Diener via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
>
> Thanks, Julie. I'll just experiment around on my own, and wait
until the
> new year.
>
> Suzanna
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, December 19, 2017 1:54 PM
> To: Suzanna C Diener <suzanna.c.diener at aero.org>
> Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
files
>
> Hi Suzanna.
>
> Unfortunately, most of our met_help staff is out this week and next,
so
> our response time will be delayed. I am only in the office today
and
> won't return until January. John is currently out as well.
>
> I don't believe there is a specific filename format that will or
won't
> work with MET. Maybe it would be best to look at a specific case.
We
> could start off with specific files and you can tell us what you
have tried
> to run and what the problem was. You could upload the files to our
ftp
> site using the following instructions and let us know once you have
done
> that so that we can get the file and take a look.
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Unfortunately, if no one is around to grab the files, they may age
off and
> we may ask you to upload them again. Thank you for your patience
with us
> during this holiday season.
>
> Julie
>
>
> On Tue, Dec 19, 2017 at 1:11 PM, Suzanna C Diener via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
> >
> > Dear John,
> >
> > When I run pcp_combine, it has trouble with the grb format....
I've
> > tried a few different files, but I keep getting errors. Could you
> > tell me which grb files work with the command you are using,
below?
> > Thanks, -Suzanna
> >
> > There are several different types of grb files, including:
> >
> > *.*.hwrfprs.d1.0p20.f***.grb
> > *.*.hwrfprs.d123.0p06.f***.grb
> > *.*.hwrfprs.d123.0p25.f***.grb
> > *.*.hwrfprs.d2.0p06.f**.grb
> > *.*.hwrfprs.d23.0p02.f***.grb
> > *.*.hwrfprs.d3.0p02.f***.grb
> >
> > *.*.hwrfsat.d123.0p25.f***.grb
> > *.*.hwrfsat.d1.0p20.f**.grb
> > .
> > .
> > .
> >
> > *.*.hwrftrk.d1.grbf00
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, December 07, 2017 9:28 AM
> > To: Suzanna C Diener <suzanna.c.diener at aero.org>
> > Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF
OUT
> > files
> >
> > Suzanna,
> >
> > The MET tools do not read the raw NetCDF output from WRF directly.
> > Instead, MET expects them to be post-processed using either the
> > Unified PostProcessor (UPP) or the wrf_interp utility. We
recommend
> > using UPP since it's output is GRIB 1/2 which MET supports well.
> >
> > You mentioned that you already tried using GRIB files, and that
should
> > work fine. So let's try to figure out those details.
> >
> > In general, pcp_combine is used to adjust the accumulation
interval of
> > precipitation data. It can be run in 3 modes, -add, -subtract,
and -sum.
> > Of the three, the -sum option is probably the most confusing
command
> > line arguments. The important question is what are you trying to
use
> > pcp_combine to accomplish?
> >
> > Since you're running HWRF, here's one possibility...
> > - You HWRF output contains a runtime accumulation of accumulated
> > precipitation.
> > - The QPE data you'd like to compare against contains 6-hourly
or
> > 24-hour accumulations.
> > - So you'd like to use pcp_combine to put your HWRF runtime
> > accumulations into the same intervals as the QPE.
> > - If this is the situation, then you'd run the pcp_combine
-subtract
> > command to generate the smaller accumulation intervals.
> >
> > For example,
> > pcp_combine -subtract hwrf_f72.grib 72 hwrf_f48.grb 48
> > hwrf_APCP_24_f48_to_f72.nc
> >
> > In this example, pcp_combine looks for precip accumulated over 72
> > hours from the first file (hwrf_f72.grib) and precip accumulated
over
> > 48 hours from the second file (hwrf_f48.grib), computes their
> > difference, and writes the output file
(hwrf_APCP_24_f48_to_f72.nc).
> > Of course, you can name the output file whatever you'd like.
> >
> > Thanks,
> > John
> >
> > On Thu, Dec 7, 2017 at 9:02 AM, Suzanna C Diener via RT
> > <met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > Thu Dec 07 09:02:38 2017: Request 83228 was acted upon.
> > > Transaction: Ticket created by suzanna.c.diener at aero.org
> > > Queue: met_help
> > > Subject: pcp_combine and using WRF OUT files
> > > Owner: Nobody
> > > Requestors: suzanna.c.diener at aero.org
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228
> > > >
> > >
> > >
> > > Hello MET Help folks, you have been great with your support!!
> > > Thank you! I have another question for you:
> > >
> > > What format does pcp_combine expect to use?
> > >
> > > I am using HWRF wrfout files, with the naming convention:
> > >
> > > wrfout_d03_2014-10-15_00_00_00
> > >
> > > In my docker container, when running the tutorial version, with
the
> > > command:
> > >
> > > >docker run -it -v /c/Users/scd30365/container-
> > > dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial
> > > /bin/bash
> > > >pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3
20141015_000000
> > > >12
> > > out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
> > > out/Gonzalo_data/GONZALO/CNTRL
> > >
> > > I get errors regarding: (1) the "timestring-to-unix" "Can't
parse
> > > timestring." (2) The format of the wrf files.
> > >
> > > I have tried using grib files, but they are at individual
pressure
> > > levels. I have tried renaming the wrf files, but they are not
in a
> > > readable format by pcp_combine.
> > >
> > > Can you tell me what HWRF output files pcp_combine is expecting
and
> > > in what format?
> > >
> > > Thanks,
> > >
> > > Suzanna
> > > Suzanna C. Diener, Ph.D.
> > > Sr. Scientist/Engineer
> > > The Aerospace Corporation
> > > Space-Based Sensing Division
> > > Boulder, CO 80301
> > >
> > > (W) 303-718-0274 <(303)%20718-0274>
> > > Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT files
From: Suzanna C Diener
Time: Tue Dec 19 16:24:51 2017
Hi John,
This is very helpful. You did previously mention the need to use grib
files, I have both wrfout files and files ending in a *.grb** so
thought they were in GRIB format, but perhaps they are intended to be
ingested by UPP for GRIB re-formatting.... I was under the impression
that my colleague had done this already, and will need to check with
him, tomorrow morning. (He's in Nebraska)
Thanks so much for your help!
Suzanna
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, December 19, 2017 4:18 PM
To: Suzanna C Diener <suzanna.c.diener at aero.org>
Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
files
Hi Suzanna,
Based on the example you sent, it looks like you're trying to process
the NetCDF output of WRF directly. The MET tools require that raw
WRFOUT files first be post-processed using either the Unified Post
Processor (UPP) or the wrf_interp utility. Forgive me if we've
already covered this in a previous email. I can't remember.
We strongly recommend running UPP since it's output is GRIB 1 or 2,
file formats which MET handles well. But for your specific error
message, here's the command you ran:
pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3 20141015_000000 12
out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
out/Gonzalo_data/GONZALO/CNTRL
Two things to note...
First, the sum command only works on GRIB1 or GRIB2 output files, not
the NetCDF output of wrf_interp.
Second, take a look at this example of the sum command from the online
tutorial:
https://dtcenter.org/met/users/support/online_tutorial/METv6.1/tutorial.php?name=pcp_combine&category=run
The first argument should be a timestring in YYYYMMDD_HHMMSS format
indicating the forecast initialization time. You've listed a wrfout
filename in the first spot. I suspect that's the source of the
parsing error.
If you're running WRF, your output likely contains a runtime
accumulation of precipitation. When you run runtime accumulation data
through pcp_combine, you'll want to use the "-subtract" option. You
can read about the details in chapter 5 of the MET User's Guide:
https://dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.1.pdf
Hope that helps get you going.
Thanks,
John
On Tue, Dec 19, 2017 at 1:57 PM, Suzanna C Diener via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
>
> Thanks, Julie. I'll just experiment around on my own, and wait
until
> the new year.
>
> Suzanna
>
> -----Original Message-----
> From: Julie Prestopnik via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, December 19, 2017 1:54 PM
> To: Suzanna C Diener <suzanna.c.diener at aero.org>
> Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF OUT
> files
>
> Hi Suzanna.
>
> Unfortunately, most of our met_help staff is out this week and next,
so
> our response time will be delayed. I am only in the office today
and
> won't return until January. John is currently out as well.
>
> I don't believe there is a specific filename format that will or
won't
> work with MET. Maybe it would be best to look at a specific case.
We
> could start off with specific files and you can tell us what you
have
> tried to run and what the problem was. You could upload the files
to
> our ftp site using the following instructions and let us know once
you
> have done that so that we can get the file and take a look.
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Unfortunately, if no one is around to grab the files, they may age
off
> and we may ask you to upload them again. Thank you for your
patience
> with us during this holiday season.
>
> Julie
>
>
> On Tue, Dec 19, 2017 at 1:11 PM, Suzanna C Diener via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228 >
> >
> > Dear John,
> >
> > When I run pcp_combine, it has trouble with the grb format....
I've
> > tried a few different files, but I keep getting errors. Could you
> > tell me which grb files work with the command you are using,
below?
> > Thanks, -Suzanna
> >
> > There are several different types of grb files, including:
> >
> > *.*.hwrfprs.d1.0p20.f***.grb
> > *.*.hwrfprs.d123.0p06.f***.grb
> > *.*.hwrfprs.d123.0p25.f***.grb
> > *.*.hwrfprs.d2.0p06.f**.grb
> > *.*.hwrfprs.d23.0p02.f***.grb
> > *.*.hwrfprs.d3.0p02.f***.grb
> >
> > *.*.hwrfsat.d123.0p25.f***.grb
> > *.*.hwrfsat.d1.0p20.f**.grb
> > .
> > .
> > .
> >
> > *.*.hwrftrk.d1.grbf00
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, December 07, 2017 9:28 AM
> > To: Suzanna C Diener <suzanna.c.diener at aero.org>
> > Subject: Re: [rt.rap.ucar.edu #83228] pcp_combine and using WRF
OUT
> > files
> >
> > Suzanna,
> >
> > The MET tools do not read the raw NetCDF output from WRF directly.
> > Instead, MET expects them to be post-processed using either the
> > Unified PostProcessor (UPP) or the wrf_interp utility. We
recommend
> > using UPP since it's output is GRIB 1/2 which MET supports well.
> >
> > You mentioned that you already tried using GRIB files, and that
> > should work fine. So let's try to figure out those details.
> >
> > In general, pcp_combine is used to adjust the accumulation
interval
> > of precipitation data. It can be run in 3 modes, -add, -subtract,
and -sum.
> > Of the three, the -sum option is probably the most confusing
command
> > line arguments. The important question is what are you trying to
> > use pcp_combine to accomplish?
> >
> > Since you're running HWRF, here's one possibility...
> > - You HWRF output contains a runtime accumulation of accumulated
> > precipitation.
> > - The QPE data you'd like to compare against contains 6-hourly
or
> > 24-hour accumulations.
> > - So you'd like to use pcp_combine to put your HWRF runtime
> > accumulations into the same intervals as the QPE.
> > - If this is the situation, then you'd run the pcp_combine
> > -subtract command to generate the smaller accumulation intervals.
> >
> > For example,
> > pcp_combine -subtract hwrf_f72.grib 72 hwrf_f48.grb 48
> > hwrf_APCP_24_f48_to_f72.nc
> >
> > In this example, pcp_combine looks for precip accumulated over 72
> > hours from the first file (hwrf_f72.grib) and precip accumulated
> > over
> > 48 hours from the second file (hwrf_f48.grib), computes their
> > difference, and writes the output file
(hwrf_APCP_24_f48_to_f72.nc).
> > Of course, you can name the output file whatever you'd like.
> >
> > Thanks,
> > John
> >
> > On Thu, Dec 7, 2017 at 9:02 AM, Suzanna C Diener via RT
> > <met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > Thu Dec 07 09:02:38 2017: Request 83228 was acted upon.
> > > Transaction: Ticket created by suzanna.c.diener at aero.org
> > > Queue: met_help
> > > Subject: pcp_combine and using WRF OUT files
> > > Owner: Nobody
> > > Requestors: suzanna.c.diener at aero.org
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=83228
> > > >
> > >
> > >
> > > Hello MET Help folks, you have been great with your support!!
> > > Thank you! I have another question for you:
> > >
> > > What format does pcp_combine expect to use?
> > >
> > > I am using HWRF wrfout files, with the naming convention:
> > >
> > > wrfout_d03_2014-10-15_00_00_00
> > >
> > > In my docker container, when running the tutorial version, with
> > > the
> > > command:
> > >
> > > >docker run -it -v /c/Users/scd30365/container-
> > > dtc-met/met/met-6.0/tutorial:/met/met-6.0/out met-6.0-tutorial
> > > /bin/bash
> > > >pcp_combine -sum wrfout_d03_2014-10-15_00_00_00 3
20141015_000000
> > > >12
> > > out/pcp_combine/gonzalo_fcst_24L_2014101500V_12A.nc -pcpdir
> > > out/Gonzalo_data/GONZALO/CNTRL
> > >
> > > I get errors regarding: (1) the "timestring-to-unix" "Can't
parse
> > > timestring." (2) The format of the wrf files.
> > >
> > > I have tried using grib files, but they are at individual
pressure
> > > levels. I have tried renaming the wrf files, but they are not
in
> > > a readable format by pcp_combine.
> > >
> > > Can you tell me what HWRF output files pcp_combine is expecting
> > > and in what format?
> > >
> > > Thanks,
> > >
> > > Suzanna
> > > Suzanna C. Diener, Ph.D.
> > > Sr. Scientist/Engineer
> > > The Aerospace Corporation
> > > Space-Based Sensing Division
> > > Boulder, CO 80301
> > >
> > > (W) 303-718-0274 <(303)%20718-0274>
> > > Suzanna.C.Diener at aero.org<mailto:Suzanna.C.Diener at aero.org>
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list