[Met_help] [rt.rap.ucar.edu #78971] History for using pcp combine on GFS grib files
John Halley Gotway via RT
met_help at ucar.edu
Thu Feb 2 11:05:15 MST 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear MET help,
I am trying to use pcp_combine on GFS output files, with file naming
convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the forecast hour. The
GFS output is 6-hr accumulation, but I would like to generate a netcdf file
with 24 hour accumulations for each gfs run, where YYYYMMDDHH specifies the
initialization date of the GFS.
As for observations, I have 24 hour accumulated precipitation in this file
format, already processed from NCAR.
ST4.YYYYMMDDHH.24h
I've looked up the syntax of pcp_combine but its hard to depict how to do
it. Would anyone be able to help me? My end goal is to then run this
through MET MODE to look at equitable threat scores for various precip
thresholds per 24 hours to see the forecast impact of two GFS experiments.
Thank you so much,
--
Andrew Kren, PhD
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Thu Dec 22 13:53:33 2016
Hello Andrew,
I apologize for the delay in answering your question. Many of our
staff
are out of the office over the holidays.
I see that you have questions about running GFS data through the
pcp_combine tool. You'd like to use pcp_combine to put GFS into 24-
hour
intervals for comparison against 24-hourly StageIV precipitation.
However, be aware that the 24-hour StageIV data is defined as an
accumulation from 12Z on one day to 12Z on the next day:
http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
Therefore, you can only use the 24-hour StageIV data to evaluate 12Z
to 12Z
accumulations from your model. Alternatively, you could use the 6-
hour
StageIV accumulations to evaluate any 24 hour accumulation from your
model. For the latter, you'd just need to run the 6-hour StageIV
files
through pcp_combine to generate your desired 24-hour accumulation.
Let me go through an example. Run pcp_combine to compute 24-hour
accumulations for GFS. Let's suppose I'm processing the 20150220 00Z
initialization of GFS.
met-5.2/bin/pcp_combine \
-sum 20150220_00 06 20150221_00 24 \
gfs_APCP_24_20150220_00_F00_F24.nc \
-pcprx "gfs_4_20150220_00.*grb2" \
-pcpdir /d1/SBU/GFS/model_data/20150220
Here I'm telling pcp_combine to look in the
/d1/SBU/GFS/model_data/20150220
directory at files which match this regular expression
"gfs_4_20150220_00.*grb2". That directory contains data for 00, 06,
12,
and 18 hour initializations, but the "-pcprx" option narrows the
search
down to the 00 hour initialization which makes it run faster. It
inspects
all the matching files, looking for 6-hour APCP data to sum up to a
24-hour
accumulation valid at 20150221_00. This results in a 24-hour
accumulation
between forecast hours 0 and 24.
The following command will compute the 24-hour accumulation between
forecast hours 12 and 36:
met-5.2/bin/pcp_combine \
-sum 20150220_00 06 20150221_12 24 \
gfs_APCP_24_20150220_00_F12_F36.nc \
-pcprx "gfs_4_20150220_00.*grb2" \
-pcpdir /d1/SBU/GFS/model_data/20150220
The "-sum" command is meant to make things easier by searching your
directory for you. But instead of using "-sum", you could use the "-
add"
command and just explicitly list the 4 files from which you'd like to
extract 6-hour APCP and add them up to 24. In my directory structure,
the
previous "-sum" job could be rewritten with "-add" like this:
cd /d1/SBU/GFS/model_data/20150220
met-5.2/bin/pcp_combine -add \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2 06 \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2 06 \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2 06 \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2 06 \
gfs_APCP_24_20150220_00_F12_F36_add_option.nc
Here I'm explicitly telling pcp_combine which files to read and what
accumulation interval (6 hours) to extract from them. The resulting
output
should be identical to the output of the "-sum" command.
Hope that helps get you going.
Just let me know what other issues or questions arise.
Thanks,
John Halley Gotway
On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> Transaction: Ticket created by andrew.kren at noaa.gov
> Queue: met_help
> Subject: using pcp combine on GFS grib files
> Owner: Nobody
> Requestors: andrew.kren at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
>
> Dear MET help,
>
> I am trying to use pcp_combine on GFS output files, with file naming
> convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the forecast
hour. The
> GFS output is 6-hr accumulation, but I would like to generate a
netcdf file
> with 24 hour accumulations for each gfs run, where YYYYMMDDHH
specifies the
> initialization date of the GFS.
>
> As for observations, I have 24 hour accumulated precipitation in
this file
> format, already processed from NCAR.
>
> ST4.YYYYMMDDHH.24h
>
> I've looked up the syntax of pcp_combine but its hard to depict how
to do
> it. Would anyone be able to help me? My end goal is to then run this
> through MET MODE to look at equitable threat scores for various
precip
> thresholds per 24 hours to see the forecast impact of two GFS
experiments.
>
> Thank you so much,
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: Andrew Kren - NOAA Affiliate
Time: Thu Dec 22 15:15:48 2016
Could you show me an example for accumulating the 6hr stage 4 data? Or
would it be the same? Thanks so much!
Andrew Kren
From: John Halley Gotway via RT
Sent: Thursday, December 22, 2016 1:53 PM
To: andrew.kren at noaa.gov
Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on GFS grib
files
Hello Andrew,
I apologize for the delay in answering your question. Many of our
staff
are out of the office over the holidays.
I see that you have questions about running GFS data through the
pcp_combine tool. You'd like to use pcp_combine to put GFS into 24-
hour
intervals for comparison against 24-hourly StageIV precipitation.
However, be aware that the 24-hour StageIV data is defined as an
accumulation from 12Z on one day to 12Z on the next day:
http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
Therefore, you can only use the 24-hour StageIV data to evaluate 12Z
to 12Z
accumulations from your model. Alternatively, you could use the 6-
hour
StageIV accumulations to evaluate any 24 hour accumulation from your
model. For the latter, you'd just need to run the 6-hour StageIV
files
through pcp_combine to generate your desired 24-hour accumulation.
Let me go through an example. Run pcp_combine to compute 24-hour
accumulations for GFS. Let's suppose I'm processing the 20150220 00Z
initialization of GFS.
met-5.2/bin/pcp_combine \
-sum 20150220_00 06 20150221_00 24 \
gfs_APCP_24_20150220_00_F00_F24.nc \
-pcprx "gfs_4_20150220_00.*grb2" \
-pcpdir /d1/SBU/GFS/model_data/20150220
Here I'm telling pcp_combine to look in the
/d1/SBU/GFS/model_data/20150220
directory at files which match this regular expression
"gfs_4_20150220_00.*grb2". That directory contains data for 00, 06,
12,
and 18 hour initializations, but the "-pcprx" option narrows the
search
down to the 00 hour initialization which makes it run faster. It
inspects
all the matching files, looking for 6-hour APCP data to sum up to a
24-hour
accumulation valid at 20150221_00. This results in a 24-hour
accumulation
between forecast hours 0 and 24.
The following command will compute the 24-hour accumulation between
forecast hours 12 and 36:
met-5.2/bin/pcp_combine \
-sum 20150220_00 06 20150221_12 24 \
gfs_APCP_24_20150220_00_F12_F36.nc \
-pcprx "gfs_4_20150220_00.*grb2" \
-pcpdir /d1/SBU/GFS/model_data/20150220
The "-sum" command is meant to make things easier by searching your
directory for you. But instead of using "-sum", you could use the "-
add"
command and just explicitly list the 4 files from which you'd like to
extract 6-hour APCP and add them up to 24. In my directory structure,
the
previous "-sum" job could be rewritten with "-add" like this:
cd /d1/SBU/GFS/model_data/20150220
met-5.2/bin/pcp_combine -add \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2 06 \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2 06 \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2 06 \
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2 06 \
gfs_APCP_24_20150220_00_F12_F36_add_option.nc
Here I'm explicitly telling pcp_combine which files to read and what
accumulation interval (6 hours) to extract from them. The resulting
output
should be identical to the output of the "-sum" command.
Hope that helps get you going.
Just let me know what other issues or questions arise.
Thanks,
John Halley Gotway
On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> Transaction: Ticket created by andrew.kren at noaa.gov
> Queue: met_help
> Subject: using pcp combine on GFS grib files
> Owner: Nobody
> Requestors: andrew.kren at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
>
> Dear MET help,
>
> I am trying to use pcp_combine on GFS output files, with file naming
> convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the forecast
hour. The
> GFS output is 6-hr accumulation, but I would like to generate a
netcdf file
> with 24 hour accumulations for each gfs run, where YYYYMMDDHH
specifies the
> initialization date of the GFS.
>
> As for observations, I have 24 hour accumulated precipitation in
this file
> format, already processed from NCAR.
>
> ST4.YYYYMMDDHH.24h
>
> I've looked up the syntax of pcp_combine but its hard to depict how
to do
> it. Would anyone be able to help me? My end goal is to then run this
> through MET MODE to look at equitable threat scores for various
precip
> thresholds per 24 hours to see the forecast impact of two GFS
experiments.
>
> Thank you so much,
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Thu Dec 22 16:11:53 2016
Andrew,
It's basically the same. The only difference is that you specify the
initialization time using all 0's. Usually pcp_combine requires that
the
initialization time stays constant since you generally wouldn't want
to mix
data from different model initializations.
Here's some sample commands to grab some StageIV data, unzip it, and
run
pcp_combine on it:
mkdir test_st4
cd test_st4
wget
ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4.20161015ST4.20161015
tar -xvf ST4.20161015
gunzip ST4*.06h.gz
# Add 2 files together
met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06 ST4.2016101518.06h
06
ST4.2016101518.APCP_12.nc
# Use the sum command instead
met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18 12
ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
Thanks,
John
On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
> Could you show me an example for accumulating the 6hr stage 4 data?
Or
> would it be the same? Thanks so much!
>
> Andrew Kren
>
> From: John Halley Gotway via RT
> Sent: Thursday, December 22, 2016 1:53 PM
> To: andrew.kren at noaa.gov
> Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on GFS grib
files
>
> Hello Andrew,
>
> I apologize for the delay in answering your question. Many of our
staff
> are out of the office over the holidays.
>
> I see that you have questions about running GFS data through the
> pcp_combine tool. You'd like to use pcp_combine to put GFS into 24-
hour
> intervals for comparison against 24-hourly StageIV precipitation.
>
> However, be aware that the 24-hour StageIV data is defined as an
> accumulation from 12Z on one day to 12Z on the next day:
> http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
>
> Therefore, you can only use the 24-hour StageIV data to evaluate 12Z
to 12Z
> accumulations from your model. Alternatively, you could use the 6-
hour
> StageIV accumulations to evaluate any 24 hour accumulation from your
> model. For the latter, you'd just need to run the 6-hour StageIV
files
> through pcp_combine to generate your desired 24-hour accumulation.
>
> Let me go through an example. Run pcp_combine to compute 24-hour
> accumulations for GFS. Let's suppose I'm processing the 20150220
00Z
> initialization of GFS.
>
> met-5.2/bin/pcp_combine \
> -sum 20150220_00 06 20150221_00 24 \
> gfs_APCP_24_20150220_00_F00_F24.nc \
> -pcprx "gfs_4_20150220_00.*grb2" \
> -pcpdir /d1/SBU/GFS/model_data/20150220
>
> Here I'm telling pcp_combine to look in the /d1/SBU/GFS/model_data/
> 20150220
> directory at files which match this regular expression
> "gfs_4_20150220_00.*grb2". That directory contains data for 00, 06,
12,
> and 18 hour initializations, but the "-pcprx" option narrows the
search
> down to the 00 hour initialization which makes it run faster. It
inspects
> all the matching files, looking for 6-hour APCP data to sum up to a
24-hour
> accumulation valid at 20150221_00. This results in a 24-hour
accumulation
> between forecast hours 0 and 24.
>
> The following command will compute the 24-hour accumulation between
> forecast hours 12 and 36:
>
> met-5.2/bin/pcp_combine \
> -sum 20150220_00 06 20150221_12 24 \
> gfs_APCP_24_20150220_00_F12_F36.nc \
> -pcprx "gfs_4_20150220_00.*grb2" \
> -pcpdir /d1/SBU/GFS/model_data/20150220
>
> The "-sum" command is meant to make things easier by searching your
> directory for you. But instead of using "-sum", you could use the
"-add"
> command and just explicitly list the 4 files from which you'd like
to
> extract 6-hour APCP and add them up to 24. In my directory
structure, the
> previous "-sum" job could be rewritten with "-add" like this:
>
> cd /d1/SBU/GFS/model_data/20150220
> met-5.2/bin/pcp_combine -add \
> /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2 06
\
> /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2 06
\
> /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2 06
\
> /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2 06
\
> gfs_APCP_24_20150220_00_F12_F36_add_option.nc
>
> Here I'm explicitly telling pcp_combine which files to read and what
> accumulation interval (6 hours) to extract from them. The resulting
output
> should be identical to the output of the "-sum" command.
>
> Hope that helps get you going.
>
> Just let me know what other issues or questions arise.
>
> Thanks,
> John Halley Gotway
>
>
> On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> > Transaction: Ticket created by andrew.kren at noaa.gov
> > Queue: met_help
> > Subject: using pcp combine on GFS grib files
> > Owner: Nobody
> > Requestors: andrew.kren at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >
> >
> > Dear MET help,
> >
> > I am trying to use pcp_combine on GFS output files, with file
naming
> > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the forecast
hour. The
> > GFS output is 6-hr accumulation, but I would like to generate a
netcdf
> file
> > with 24 hour accumulations for each gfs run, where YYYYMMDDHH
specifies
> the
> > initialization date of the GFS.
> >
> > As for observations, I have 24 hour accumulated precipitation in
this
> file
> > format, already processed from NCAR.
> >
> > ST4.YYYYMMDDHH.24h
> >
> > I've looked up the syntax of pcp_combine but its hard to depict
how to do
> > it. Would anyone be able to help me? My end goal is to then run
this
> > through MET MODE to look at equitable threat scores for various
precip
> > thresholds per 24 hours to see the forecast impact of two GFS
> experiments.
> >
> > Thank you so much,
> >
> > --
> > Andrew Kren, PhD
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>
>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: Andrew Kren - NOAA Affiliate
Time: Fri Jan 20 09:46:38 2017
John,
I finally got time to try out your MET example on my GFS output. My
GFS
output has the format of pgbqff.gfs.2016022118, where the ff stands
for the
forecast hours, 0 to 384, and the date corresponds to the init date of
the
GFS run.
I used this command in my directory where the files were and it did
not
work:
/scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum 20160221_18 06
20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \ -pcprx
"pgbq*.gfs*2016022118" \ -pcpdir .
Am I doing something wrong?
On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Andrew,
>
> It's basically the same. The only difference is that you specify
the
> initialization time using all 0's. Usually pcp_combine requires
that the
> initialization time stays constant since you generally wouldn't want
to mix
> data from different model initializations.
>
> Here's some sample commands to grab some StageIV data, unzip it, and
run
> pcp_combine on it:
>
> mkdir test_st4
> cd test_st4
> wget
> ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/
> ST4.20161015ST4.20161015
> tar -xvf ST4.20161015
> gunzip ST4*.06h.gz
>
> # Add 2 files together
> met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06
ST4.2016101518.06h 06
> ST4.2016101518.APCP_12.nc
>
> # Use the sum command instead
> met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18 12
> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
>
> Thanks,
> John
>
>
>
> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >
> > Could you show me an example for accumulating the 6hr stage 4
data? Or
> > would it be the same? Thanks so much!
> >
> > Andrew Kren
> >
> > From: John Halley Gotway via RT
> > Sent: Thursday, December 22, 2016 1:53 PM
> > To: andrew.kren at noaa.gov
> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on GFS
grib
> files
> >
> > Hello Andrew,
> >
> > I apologize for the delay in answering your question. Many of our
staff
> > are out of the office over the holidays.
> >
> > I see that you have questions about running GFS data through the
> > pcp_combine tool. You'd like to use pcp_combine to put GFS into
24-hour
> > intervals for comparison against 24-hourly StageIV precipitation.
> >
> > However, be aware that the 24-hour StageIV data is defined as an
> > accumulation from 12Z on one day to 12Z on the next day:
> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> >
> > Therefore, you can only use the 24-hour StageIV data to evaluate
12Z to
> 12Z
> > accumulations from your model. Alternatively, you could use the
6-hour
> > StageIV accumulations to evaluate any 24 hour accumulation from
your
> > model. For the latter, you'd just need to run the 6-hour StageIV
files
> > through pcp_combine to generate your desired 24-hour accumulation.
> >
> > Let me go through an example. Run pcp_combine to compute 24-hour
> > accumulations for GFS. Let's suppose I'm processing the 20150220
00Z
> > initialization of GFS.
> >
> > met-5.2/bin/pcp_combine \
> > -sum 20150220_00 06 20150221_00 24 \
> > gfs_APCP_24_20150220_00_F00_F24.nc \
> > -pcprx "gfs_4_20150220_00.*grb2" \
> > -pcpdir /d1/SBU/GFS/model_data/20150220
> >
> > Here I'm telling pcp_combine to look in the
/d1/SBU/GFS/model_data/
> > 20150220
> > directory at files which match this regular expression
> > "gfs_4_20150220_00.*grb2". That directory contains data for 00,
06, 12,
> > and 18 hour initializations, but the "-pcprx" option narrows the
search
> > down to the 00 hour initialization which makes it run faster. It
> inspects
> > all the matching files, looking for 6-hour APCP data to sum up to
a
> 24-hour
> > accumulation valid at 20150221_00. This results in a 24-hour
> accumulation
> > between forecast hours 0 and 24.
> >
> > The following command will compute the 24-hour accumulation
between
> > forecast hours 12 and 36:
> >
> > met-5.2/bin/pcp_combine \
> > -sum 20150220_00 06 20150221_12 24 \
> > gfs_APCP_24_20150220_00_F12_F36.nc \
> > -pcprx "gfs_4_20150220_00.*grb2" \
> > -pcpdir /d1/SBU/GFS/model_data/20150220
> >
> > The "-sum" command is meant to make things easier by searching
your
> > directory for you. But instead of using "-sum", you could use the
"-add"
> > command and just explicitly list the 4 files from which you'd like
to
> > extract 6-hour APCP and add them up to 24. In my directory
structure,
> the
> > previous "-sum" job could be rewritten with "-add" like this:
> >
> > cd /d1/SBU/GFS/model_data/20150220
> > met-5.2/bin/pcp_combine -add \
> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2
06 \
> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2
06 \
> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2
06 \
> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2
06 \
> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> >
> > Here I'm explicitly telling pcp_combine which files to read and
what
> > accumulation interval (6 hours) to extract from them. The
resulting
> output
> > should be identical to the output of the "-sum" command.
> >
> > Hope that helps get you going.
> >
> > Just let me know what other issues or questions arise.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > Queue: met_help
> > > Subject: using pcp combine on GFS grib files
> > > Owner: Nobody
> > > Requestors: andrew.kren at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
> >
> > >
> > >
> > > Dear MET help,
> > >
> > > I am trying to use pcp_combine on GFS output files, with file
naming
> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the forecast
hour.
> The
> > > GFS output is 6-hr accumulation, but I would like to generate a
netcdf
> > file
> > > with 24 hour accumulations for each gfs run, where YYYYMMDDHH
specifies
> > the
> > > initialization date of the GFS.
> > >
> > > As for observations, I have 24 hour accumulated precipitation in
this
> > file
> > > format, already processed from NCAR.
> > >
> > > ST4.YYYYMMDDHH.24h
> > >
> > > I've looked up the syntax of pcp_combine but its hard to depict
how to
> do
> > > it. Would anyone be able to help me? My end goal is to then run
this
> > > through MET MODE to look at equitable threat scores for various
precip
> > > thresholds per 24 hours to see the forecast impact of two GFS
> > experiments.
> > >
> > > Thank you so much,
> > >
> > > --
> > > Andrew Kren, PhD
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
> >
> >
>
>
--
Andrew Kren, PhD
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: Andrew Kren - NOAA Affiliate
Time: Fri Jan 20 10:07:53 2017
I noticed I should not have included the \ things. I redid the
expression
but got this error:
/scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum 20160221_18 06
20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
"pgbq*.gfs.2016022118"
ERROR :
ERROR : sum_data_files() -> Cannot find a file with a valid time of
20160222_180000 and accumulation time of 030000 matching the regular
expression "pgbq*.gfs.2016022118"
ERROR :
On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA Affiliate <
andrew.kren at noaa.gov> wrote:
> John,
>
> I finally got time to try out your MET example on my GFS output. My
GFS
> output has the format of pgbqff.gfs.2016022118 <(201)%20602-2118>,
where
> the ff stands for the forecast hours, 0 to 384, and the date
corresponds to
> the init date of the GFS run.
>
> I used this command in my directory where the files were and it did
not
> work:
>
> /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum 20160221_18 06
> 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \ -pcprx
> "pgbq*.gfs*2016022118" \ -pcpdir .
>
>
> Am I doing something wrong?
>
> On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Andrew,
>>
>> It's basically the same. The only difference is that you specify
the
>> initialization time using all 0's. Usually pcp_combine requires
that the
>> initialization time stays constant since you generally wouldn't
want to
>> mix
>> data from different model initializations.
>>
>> Here's some sample commands to grab some StageIV data, unzip it,
and run
>> pcp_combine on it:
>>
>> mkdir test_st4
>> cd test_st4
>> wget
>> ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
>> .20161015ST4.20161015
>> tar -xvf ST4.20161015
>> gunzip ST4*.06h.gz
>>
>> # Add 2 files together
>> met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06 ST4.2016101518
>> <(201)%20610-1518>.06h 06
>> ST4.2016101518.APCP_12.nc
>>
>> # Use the sum command instead
>> met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18 12
>> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
>>
>> Thanks,
>> John
>>
>>
>>
>> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA Affiliate via
RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>> >
>> > Could you show me an example for accumulating the 6hr stage 4
data? Or
>> > would it be the same? Thanks so much!
>> >
>> > Andrew Kren
>> >
>> > From: John Halley Gotway via RT
>> > Sent: Thursday, December 22, 2016 1:53 PM
>> > To: andrew.kren at noaa.gov
>> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on GFS
grib
>> files
>> >
>> > Hello Andrew,
>> >
>> > I apologize for the delay in answering your question. Many of
our staff
>> > are out of the office over the holidays.
>> >
>> > I see that you have questions about running GFS data through the
>> > pcp_combine tool. You'd like to use pcp_combine to put GFS into
24-hour
>> > intervals for comparison against 24-hourly StageIV precipitation.
>> >
>> > However, be aware that the 24-hour StageIV data is defined as an
>> > accumulation from 12Z on one day to 12Z on the next day:
>> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
>> >
>> > Therefore, you can only use the 24-hour StageIV data to evaluate
12Z to
>> 12Z
>> > accumulations from your model. Alternatively, you could use the
6-hour
>> > StageIV accumulations to evaluate any 24 hour accumulation from
your
>> > model. For the latter, you'd just need to run the 6-hour StageIV
files
>> > through pcp_combine to generate your desired 24-hour
accumulation.
>> >
>> > Let me go through an example. Run pcp_combine to compute 24-hour
>> > accumulations for GFS. Let's suppose I'm processing the 20150220
00Z
>> > initialization of GFS.
>> >
>> > met-5.2/bin/pcp_combine \
>> > -sum 20150220_00 06 20150221_00 24 \
>> > gfs_APCP_24_20150220_00_F00_F24.nc \
>> > -pcprx "gfs_4_20150220_00.*grb2" \
>> > -pcpdir /d1/SBU/GFS/model_data/20150220
>> >
>> > Here I'm telling pcp_combine to look in the
/d1/SBU/GFS/model_data/
>> > 20150220
>> > directory at files which match this regular expression
>> > "gfs_4_20150220_00.*grb2". That directory contains data for 00,
06, 12,
>> > and 18 hour initializations, but the "-pcprx" option narrows the
search
>> > down to the 00 hour initialization which makes it run faster. It
>> inspects
>> > all the matching files, looking for 6-hour APCP data to sum up to
a
>> 24-hour
>> > accumulation valid at 20150221_00. This results in a 24-hour
>> accumulation
>> > between forecast hours 0 and 24.
>> >
>> > The following command will compute the 24-hour accumulation
between
>> > forecast hours 12 and 36:
>> >
>> > met-5.2/bin/pcp_combine \
>> > -sum 20150220_00 06 20150221_12 24 \
>> > gfs_APCP_24_20150220_00_F12_F36.nc \
>> > -pcprx "gfs_4_20150220_00.*grb2" \
>> > -pcpdir /d1/SBU/GFS/model_data/20150220
>> >
>> > The "-sum" command is meant to make things easier by searching
your
>> > directory for you. But instead of using "-sum", you could use
the
>> "-add"
>> > command and just explicitly list the 4 files from which you'd
like to
>> > extract 6-hour APCP and add them up to 24. In my directory
structure,
>> the
>> > previous "-sum" job could be rewritten with "-add" like this:
>> >
>> > cd /d1/SBU/GFS/model_data/20150220
>> > met-5.2/bin/pcp_combine -add \
>> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2
06 \
>> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2
06 \
>> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2
06 \
>> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2
06 \
>> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
>> >
>> > Here I'm explicitly telling pcp_combine which files to read and
what
>> > accumulation interval (6 hours) to extract from them. The
resulting
>> output
>> > should be identical to the output of the "-sum" command.
>> >
>> > Hope that helps get you going.
>> >
>> > Just let me know what other issues or questions arise.
>> >
>> > Thanks,
>> > John Halley Gotway
>> >
>> >
>> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA Affiliate
via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
>> > > Transaction: Ticket created by andrew.kren at noaa.gov
>> > > Queue: met_help
>> > > Subject: using pcp combine on GFS grib files
>> > > Owner: Nobody
>> > > Requestors: andrew.kren at noaa.gov
>> > > Status: new
>> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
>> >
>> > >
>> > >
>> > > Dear MET help,
>> > >
>> > > I am trying to use pcp_combine on GFS output files, with file
naming
>> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the forecast
hour.
>> The
>> > > GFS output is 6-hr accumulation, but I would like to generate a
netcdf
>> > file
>> > > with 24 hour accumulations for each gfs run, where YYYYMMDDHH
>> specifies
>> > the
>> > > initialization date of the GFS.
>> > >
>> > > As for observations, I have 24 hour accumulated precipitation
in this
>> > file
>> > > format, already processed from NCAR.
>> > >
>> > > ST4.YYYYMMDDHH.24h
>> > >
>> > > I've looked up the syntax of pcp_combine but its hard to depict
how
>> to do
>> > > it. Would anyone be able to help me? My end goal is to then run
this
>> > > through MET MODE to look at equitable threat scores for various
precip
>> > > thresholds per 24 hours to see the forecast impact of two GFS
>> > experiments.
>> > >
>> > > Thank you so much,
>> > >
>> > > --
>> > > Andrew Kren, PhD
>> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > 325 Broadway, Boulder, CO 80305
>> > > (303) 497-5418
>> > >
>> > >
>> >
>> >
>> >
>> >
>>
>>
>
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
--
Andrew Kren, PhD
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Tue Jan 24 13:20:52 2017
Andrew,
Please try removing the "-pcprx pgbq*.gfs*2016022118" option and
running
again. The star '*' you're using is a wildcard on the command line
but not
part of a regular expression.
Try to get it working without the "-pcprx" option... and once that's
done,
you could figure out how to add it back in.
If/when you get there, I'd try...
-pcprx pgbq[0-9]+.gfs.2016022118
Thanks,
John
On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
> I noticed I should not have included the \ things. I redid the
expression
> but got this error:
>
> /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum 20160221_18 06
> 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
> "pgbq*.gfs.2016022118"
>
> ERROR :
>
> ERROR : sum_data_files() -> Cannot find a file with a valid time of
> 20160222_180000 and accumulation time of 030000 matching the regular
> expression "pgbq*.gfs.2016022118"
>
> ERROR :
>
>
> On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA Affiliate <
> andrew.kren at noaa.gov> wrote:
>
> > John,
> >
> > I finally got time to try out your MET example on my GFS output.
My GFS
> > output has the format of pgbqff.gfs.2016022118 <(201)%20602-2118>,
where
> > the ff stands for the forecast hours, 0 to 384, and the date
corresponds
> to
> > the init date of the GFS run.
> >
> > I used this command in my directory where the files were and it
did not
> > work:
> >
> > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum 20160221_18
06
> > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \ -pcprx
> > "pgbq*.gfs*2016022118" \ -pcpdir .
> >
> >
> > Am I doing something wrong?
> >
> > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Andrew,
> >>
> >> It's basically the same. The only difference is that you specify
the
> >> initialization time using all 0's. Usually pcp_combine requires
that
> the
> >> initialization time stays constant since you generally wouldn't
want to
> >> mix
> >> data from different model initializations.
> >>
> >> Here's some sample commands to grab some StageIV data, unzip it,
and run
> >> pcp_combine on it:
> >>
> >> mkdir test_st4
> >> cd test_st4
> >> wget
> >> ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
> >> .20161015ST4.20161015
> >> tar -xvf ST4.20161015
> >> gunzip ST4*.06h.gz
> >>
> >> # Add 2 files together
> >> met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06 ST4.2016101518
> >> <(201)%20610-1518>.06h 06
> >> ST4.2016101518.APCP_12.nc
> >>
> >> # Use the sum command instead
> >> met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18 12
> >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> >>
> >> Thanks,
> >> John
> >>
> >>
> >>
> >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA Affiliate via
RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >> >
> >> > Could you show me an example for accumulating the 6hr stage 4
data? Or
> >> > would it be the same? Thanks so much!
> >> >
> >> > Andrew Kren
> >> >
> >> > From: John Halley Gotway via RT
> >> > Sent: Thursday, December 22, 2016 1:53 PM
> >> > To: andrew.kren at noaa.gov
> >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on GFS
grib
> >> files
> >> >
> >> > Hello Andrew,
> >> >
> >> > I apologize for the delay in answering your question. Many of
our
> staff
> >> > are out of the office over the holidays.
> >> >
> >> > I see that you have questions about running GFS data through
the
> >> > pcp_combine tool. You'd like to use pcp_combine to put GFS
into
> 24-hour
> >> > intervals for comparison against 24-hourly StageIV
precipitation.
> >> >
> >> > However, be aware that the 24-hour StageIV data is defined as
an
> >> > accumulation from 12Z on one day to 12Z on the next day:
> >> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> >> >
> >> > Therefore, you can only use the 24-hour StageIV data to
evaluate 12Z
> to
> >> 12Z
> >> > accumulations from your model. Alternatively, you could use
the
> 6-hour
> >> > StageIV accumulations to evaluate any 24 hour accumulation from
your
> >> > model. For the latter, you'd just need to run the 6-hour
StageIV
> files
> >> > through pcp_combine to generate your desired 24-hour
accumulation.
> >> >
> >> > Let me go through an example. Run pcp_combine to compute 24-
hour
> >> > accumulations for GFS. Let's suppose I'm processing the
20150220 00Z
> >> > initialization of GFS.
> >> >
> >> > met-5.2/bin/pcp_combine \
> >> > -sum 20150220_00 06 20150221_00 24 \
> >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> >> > -pcprx "gfs_4_20150220_00.*grb2" \
> >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> >> >
> >> > Here I'm telling pcp_combine to look in the
/d1/SBU/GFS/model_data/
> >> > 20150220
> >> > directory at files which match this regular expression
> >> > "gfs_4_20150220_00.*grb2". That directory contains data for
00, 06,
> 12,
> >> > and 18 hour initializations, but the "-pcprx" option narrows
the
> search
> >> > down to the 00 hour initialization which makes it run faster.
It
> >> inspects
> >> > all the matching files, looking for 6-hour APCP data to sum up
to a
> >> 24-hour
> >> > accumulation valid at 20150221_00. This results in a 24-hour
> >> accumulation
> >> > between forecast hours 0 and 24.
> >> >
> >> > The following command will compute the 24-hour accumulation
between
> >> > forecast hours 12 and 36:
> >> >
> >> > met-5.2/bin/pcp_combine \
> >> > -sum 20150220_00 06 20150221_12 24 \
> >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> >> > -pcprx "gfs_4_20150220_00.*grb2" \
> >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> >> >
> >> > The "-sum" command is meant to make things easier by searching
your
> >> > directory for you. But instead of using "-sum", you could use
the
> >> "-add"
> >> > command and just explicitly list the 4 files from which you'd
like to
> >> > extract 6-hour APCP and add them up to 24. In my directory
structure,
> >> the
> >> > previous "-sum" job could be rewritten with "-add" like this:
> >> >
> >> > cd /d1/SBU/GFS/model_data/20150220
> >> > met-5.2/bin/pcp_combine -add \
> >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2 06 \
> >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2 06 \
> >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2 06 \
> >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2 06 \
> >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> >> >
> >> > Here I'm explicitly telling pcp_combine which files to read and
what
> >> > accumulation interval (6 hours) to extract from them. The
resulting
> >> output
> >> > should be identical to the output of the "-sum" command.
> >> >
> >> > Hope that helps get you going.
> >> >
> >> > Just let me know what other issues or questions arise.
> >> >
> >> > Thanks,
> >> > John Halley Gotway
> >> >
> >> >
> >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA Affiliate
via RT
> <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > >
> >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> >> > > Transaction: Ticket created by andrew.kren at noaa.gov
> >> > > Queue: met_help
> >> > > Subject: using pcp combine on GFS grib files
> >> > > Owner: Nobody
> >> > > Requestors: andrew.kren at noaa.gov
> >> > > Status: new
> >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=78971
> >> >
> >> > >
> >> > >
> >> > > Dear MET help,
> >> > >
> >> > > I am trying to use pcp_combine on GFS output files, with file
naming
> >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the
forecast
> hour.
> >> The
> >> > > GFS output is 6-hr accumulation, but I would like to generate
a
> netcdf
> >> > file
> >> > > with 24 hour accumulations for each gfs run, where YYYYMMDDHH
> >> specifies
> >> > the
> >> > > initialization date of the GFS.
> >> > >
> >> > > As for observations, I have 24 hour accumulated precipitation
in
> this
> >> > file
> >> > > format, already processed from NCAR.
> >> > >
> >> > > ST4.YYYYMMDDHH.24h
> >> > >
> >> > > I've looked up the syntax of pcp_combine but its hard to
depict how
> >> to do
> >> > > it. Would anyone be able to help me? My end goal is to then
run this
> >> > > through MET MODE to look at equitable threat scores for
various
> precip
> >> > > thresholds per 24 hours to see the forecast impact of two GFS
> >> > experiments.
> >> > >
> >> > > Thank you so much,
> >> > >
> >> > > --
> >> > > Andrew Kren, PhD
> >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
> >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > 325 Broadway, Boulder, CO 80305
> >> > > (303) 497-5418
> >> > >
> >> > >
> >> >
> >> >
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > Andrew Kren, PhD
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
>
>
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: Andrew Kren - NOAA Affiliate
Time: Mon Jan 30 14:02:12 2017
Hi John,
I removed the expression but now it is just hanging there and not
doing
anything. I assume its because I didn't list the file name convention.
How
would I do that if I remove the -pcprx?
Thanks,
On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Andrew,
>
> Please try removing the "-pcprx pgbq*.gfs*2016022118" option and
running
> again. The star '*' you're using is a wildcard on the command line
but not
> part of a regular expression.
>
> Try to get it working without the "-pcprx" option... and once that's
done,
> you could figure out how to add it back in.
>
> If/when you get there, I'd try...
> -pcprx pgbq[0-9]+.gfs.2016022118
>
> Thanks,
> John
>
> On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >
> > I noticed I should not have included the \ things. I redid the
expression
> > but got this error:
> >
> > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum 20160221_18 06
> > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
> > "pgbq*.gfs.2016022118"
> >
> > ERROR :
> >
> > ERROR : sum_data_files() -> Cannot find a file with a valid time
of
> > 20160222_180000 and accumulation time of 030000 matching the
regular
> > expression "pgbq*.gfs.2016022118"
> >
> > ERROR :
> >
> >
> > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA Affiliate <
> > andrew.kren at noaa.gov> wrote:
> >
> > > John,
> > >
> > > I finally got time to try out your MET example on my GFS output.
My GFS
> > > output has the format of pgbqff.gfs.2016022118 <(201)%20602-
2118>,
> where
> > > the ff stands for the forecast hours, 0 to 384, and the date
> corresponds
> > to
> > > the init date of the GFS run.
> > >
> > > I used this command in my directory where the files were and it
did not
> > > work:
> > >
> > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum 20160221_18
06
> > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \ -pcprx
> > > "pgbq*.gfs*2016022118" \ -pcpdir .
> > >
> > >
> > > Am I doing something wrong?
> > >
> > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Andrew,
> > >>
> > >> It's basically the same. The only difference is that you
specify the
> > >> initialization time using all 0's. Usually pcp_combine
requires that
> > the
> > >> initialization time stays constant since you generally wouldn't
want
> to
> > >> mix
> > >> data from different model initializations.
> > >>
> > >> Here's some sample commands to grab some StageIV data, unzip
it, and
> run
> > >> pcp_combine on it:
> > >>
> > >> mkdir test_st4
> > >> cd test_st4
> > >> wget
> > >> ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
> > >> .20161015ST4.20161015
> > >> tar -xvf ST4.20161015
> > >> gunzip ST4*.06h.gz
> > >>
> > >> # Add 2 files together
> > >> met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06
ST4.2016101518
> > >> <(201)%20610-1518>.06h 06
> > >> ST4.2016101518.APCP_12.nc
> > >>
> > >> # Use the sum command instead
> > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18 12
> > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >>
> > >>
> > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA Affiliate
via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
>
> > >> >
> > >> > Could you show me an example for accumulating the 6hr stage 4
data?
> Or
> > >> > would it be the same? Thanks so much!
> > >> >
> > >> > Andrew Kren
> > >> >
> > >> > From: John Halley Gotway via RT
> > >> > Sent: Thursday, December 22, 2016 1:53 PM
> > >> > To: andrew.kren at noaa.gov
> > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on
GFS grib
> > >> files
> > >> >
> > >> > Hello Andrew,
> > >> >
> > >> > I apologize for the delay in answering your question. Many
of our
> > staff
> > >> > are out of the office over the holidays.
> > >> >
> > >> > I see that you have questions about running GFS data through
the
> > >> > pcp_combine tool. You'd like to use pcp_combine to put GFS
into
> > 24-hour
> > >> > intervals for comparison against 24-hourly StageIV
precipitation.
> > >> >
> > >> > However, be aware that the 24-hour StageIV data is defined as
an
> > >> > accumulation from 12Z on one day to 12Z on the next day:
> > >> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> > >> >
> > >> > Therefore, you can only use the 24-hour StageIV data to
evaluate 12Z
> > to
> > >> 12Z
> > >> > accumulations from your model. Alternatively, you could use
the
> > 6-hour
> > >> > StageIV accumulations to evaluate any 24 hour accumulation
from your
> > >> > model. For the latter, you'd just need to run the 6-hour
StageIV
> > files
> > >> > through pcp_combine to generate your desired 24-hour
accumulation.
> > >> >
> > >> > Let me go through an example. Run pcp_combine to compute 24-
hour
> > >> > accumulations for GFS. Let's suppose I'm processing the
20150220
> 00Z
> > >> > initialization of GFS.
> > >> >
> > >> > met-5.2/bin/pcp_combine \
> > >> > -sum 20150220_00 06 20150221_00 24 \
> > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > >> >
> > >> > Here I'm telling pcp_combine to look in the
/d1/SBU/GFS/model_data/
> > >> > 20150220
> > >> > directory at files which match this regular expression
> > >> > "gfs_4_20150220_00.*grb2". That directory contains data for
00, 06,
> > 12,
> > >> > and 18 hour initializations, but the "-pcprx" option narrows
the
> > search
> > >> > down to the 00 hour initialization which makes it run faster.
It
> > >> inspects
> > >> > all the matching files, looking for 6-hour APCP data to sum
up to a
> > >> 24-hour
> > >> > accumulation valid at 20150221_00. This results in a 24-hour
> > >> accumulation
> > >> > between forecast hours 0 and 24.
> > >> >
> > >> > The following command will compute the 24-hour accumulation
between
> > >> > forecast hours 12 and 36:
> > >> >
> > >> > met-5.2/bin/pcp_combine \
> > >> > -sum 20150220_00 06 20150221_12 24 \
> > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > >> >
> > >> > The "-sum" command is meant to make things easier by
searching your
> > >> > directory for you. But instead of using "-sum", you could
use the
> > >> "-add"
> > >> > command and just explicitly list the 4 files from which you'd
like
> to
> > >> > extract 6-hour APCP and add them up to 24. In my directory
> structure,
> > >> the
> > >> > previous "-sum" job could be rewritten with "-add" like this:
> > >> >
> > >> > cd /d1/SBU/GFS/model_data/20150220
> > >> > met-5.2/bin/pcp_combine -add \
> > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2
> 06 \
> > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2
> 06 \
> > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2
> 06 \
> > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2
> 06 \
> > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> > >> >
> > >> > Here I'm explicitly telling pcp_combine which files to read
and what
> > >> > accumulation interval (6 hours) to extract from them. The
resulting
> > >> output
> > >> > should be identical to the output of the "-sum" command.
> > >> >
> > >> > Hope that helps get you going.
> > >> >
> > >> > Just let me know what other issues or questions arise.
> > >> >
> > >> > Thanks,
> > >> > John Halley Gotway
> > >> >
> > >> >
> > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA
Affiliate via
> RT
> > <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > >
> > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> > >> > > Transaction: Ticket created by andrew.kren at noaa.gov
> > >> > > Queue: met_help
> > >> > > Subject: using pcp combine on GFS grib files
> > >> > > Owner: Nobody
> > >> > > Requestors: andrew.kren at noaa.gov
> > >> > > Status: new
> > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=78971
> > >> >
> > >> > >
> > >> > >
> > >> > > Dear MET help,
> > >> > >
> > >> > > I am trying to use pcp_combine on GFS output files, with
file
> naming
> > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the
forecast
> > hour.
> > >> The
> > >> > > GFS output is 6-hr accumulation, but I would like to
generate a
> > netcdf
> > >> > file
> > >> > > with 24 hour accumulations for each gfs run, where
YYYYMMDDHH
> > >> specifies
> > >> > the
> > >> > > initialization date of the GFS.
> > >> > >
> > >> > > As for observations, I have 24 hour accumulated
precipitation in
> > this
> > >> > file
> > >> > > format, already processed from NCAR.
> > >> > >
> > >> > > ST4.YYYYMMDDHH.24h
> > >> > >
> > >> > > I've looked up the syntax of pcp_combine but its hard to
depict
> how
> > >> to do
> > >> > > it. Would anyone be able to help me? My end goal is to then
run
> this
> > >> > > through MET MODE to look at equitable threat scores for
various
> > precip
> > >> > > thresholds per 24 hours to see the forecast impact of two
GFS
> > >> > experiments.
> > >> > >
> > >> > > Thank you so much,
> > >> > >
> > >> > > --
> > >> > > Andrew Kren, PhD
> > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > 325 Broadway, Boulder, CO 80305
> > >> > > (303) 497-5418
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >> >
> > >> >
> > >>
> > >>
> > >
> > >
> > > --
> > > Andrew Kren, PhD
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> >
> >
> >
> > --
> > Andrew Kren, PhD
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>
--
Andrew Kren, PhD
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Mon Jan 30 14:56:36 2017
Andrew,
If you remove the expression, you should also remove "-pcprx" from the
command line. It isn't a required argument... but we can use it to
speed
up the checking of files.
Based on the path, I'm guessing you're running on theia, to which I
have
access. If you send me the path to where you're trying to run, I
could try
to find a regular expression that'd work for you.
Thanks,
John
On Mon, Jan 30, 2017 at 2:02 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
> Hi John,
>
> I removed the expression but now it is just hanging there and not
doing
> anything. I assume its because I didn't list the file name
convention. How
> would I do that if I remove the -pcprx?
>
> Thanks,
>
> On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andrew,
> >
> > Please try removing the "-pcprx pgbq*.gfs*2016022118" option and
running
> > again. The star '*' you're using is a wildcard on the command
line but
> not
> > part of a regular expression.
> >
> > Try to get it working without the "-pcprx" option... and once
that's
> done,
> > you could figure out how to add it back in.
> >
> > If/when you get there, I'd try...
> > -pcprx pgbq[0-9]+.gfs.2016022118
> >
> > Thanks,
> > John
> >
> > On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > >
> > > I noticed I should not have included the \ things. I redid the
> expression
> > > but got this error:
> > >
> > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum 20160221_18
06
> > > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
> > > "pgbq*.gfs.2016022118"
> > >
> > > ERROR :
> > >
> > > ERROR : sum_data_files() -> Cannot find a file with a valid
time of
> > > 20160222_180000 and accumulation time of 030000 matching the
regular
> > > expression "pgbq*.gfs.2016022118"
> > >
> > > ERROR :
> > >
> > >
> > > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA Affiliate <
> > > andrew.kren at noaa.gov> wrote:
> > >
> > > > John,
> > > >
> > > > I finally got time to try out your MET example on my GFS
output. My
> GFS
> > > > output has the format of pgbqff.gfs.2016022118 <(201)%20602-
2118>,
> > where
> > > > the ff stands for the forecast hours, 0 to 384, and the date
> > corresponds
> > > to
> > > > the init date of the GFS run.
> > > >
> > > > I used this command in my directory where the files were and
it did
> not
> > > > work:
> > > >
> > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum
20160221_18 06
> > > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \ -pcprx
> > > > "pgbq*.gfs*2016022118" \ -pcpdir .
> > > >
> > > >
> > > > Am I doing something wrong?
> > > >
> > > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Andrew,
> > > >>
> > > >> It's basically the same. The only difference is that you
specify
> the
> > > >> initialization time using all 0's. Usually pcp_combine
requires
> that
> > > the
> > > >> initialization time stays constant since you generally
wouldn't want
> > to
> > > >> mix
> > > >> data from different model initializations.
> > > >>
> > > >> Here's some sample commands to grab some StageIV data, unzip
it, and
> > run
> > > >> pcp_combine on it:
> > > >>
> > > >> mkdir test_st4
> > > >> cd test_st4
> > > >> wget
> > > >> ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
> > > >> .20161015ST4.20161015
> > > >> tar -xvf ST4.20161015
> > > >> gunzip ST4*.06h.gz
> > > >>
> > > >> # Add 2 files together
> > > >> met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06
ST4.2016101518
> > > >> <(201)%20610-1518>.06h 06
> > > >> ST4.2016101518.APCP_12.nc
> > > >>
> > > >> # Use the sum command instead
> > > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18
12
> > > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >>
> > > >>
> > > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA Affiliate
via
> RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > > >> >
> > > >> > Could you show me an example for accumulating the 6hr stage
4
> data?
> > Or
> > > >> > would it be the same? Thanks so much!
> > > >> >
> > > >> > Andrew Kren
> > > >> >
> > > >> > From: John Halley Gotway via RT
> > > >> > Sent: Thursday, December 22, 2016 1:53 PM
> > > >> > To: andrew.kren at noaa.gov
> > > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine on
GFS
> grib
> > > >> files
> > > >> >
> > > >> > Hello Andrew,
> > > >> >
> > > >> > I apologize for the delay in answering your question. Many
of our
> > > staff
> > > >> > are out of the office over the holidays.
> > > >> >
> > > >> > I see that you have questions about running GFS data
through the
> > > >> > pcp_combine tool. You'd like to use pcp_combine to put GFS
into
> > > 24-hour
> > > >> > intervals for comparison against 24-hourly StageIV
precipitation.
> > > >> >
> > > >> > However, be aware that the 24-hour StageIV data is defined
as an
> > > >> > accumulation from 12Z on one day to 12Z on the next day:
> > > >> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> > > >> >
> > > >> > Therefore, you can only use the 24-hour StageIV data to
evaluate
> 12Z
> > > to
> > > >> 12Z
> > > >> > accumulations from your model. Alternatively, you could
use the
> > > 6-hour
> > > >> > StageIV accumulations to evaluate any 24 hour accumulation
from
> your
> > > >> > model. For the latter, you'd just need to run the 6-hour
StageIV
> > > files
> > > >> > through pcp_combine to generate your desired 24-hour
accumulation.
> > > >> >
> > > >> > Let me go through an example. Run pcp_combine to compute
24-hour
> > > >> > accumulations for GFS. Let's suppose I'm processing the
20150220
> > 00Z
> > > >> > initialization of GFS.
> > > >> >
> > > >> > met-5.2/bin/pcp_combine \
> > > >> > -sum 20150220_00 06 20150221_00 24 \
> > > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > > >> >
> > > >> > Here I'm telling pcp_combine to look in the
> /d1/SBU/GFS/model_data/
> > > >> > 20150220
> > > >> > directory at files which match this regular expression
> > > >> > "gfs_4_20150220_00.*grb2". That directory contains data
for 00,
> 06,
> > > 12,
> > > >> > and 18 hour initializations, but the "-pcprx" option
narrows the
> > > search
> > > >> > down to the 00 hour initialization which makes it run
faster. It
> > > >> inspects
> > > >> > all the matching files, looking for 6-hour APCP data to sum
up to
> a
> > > >> 24-hour
> > > >> > accumulation valid at 20150221_00. This results in a 24-
hour
> > > >> accumulation
> > > >> > between forecast hours 0 and 24.
> > > >> >
> > > >> > The following command will compute the 24-hour accumulation
> between
> > > >> > forecast hours 12 and 36:
> > > >> >
> > > >> > met-5.2/bin/pcp_combine \
> > > >> > -sum 20150220_00 06 20150221_12 24 \
> > > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > > >> >
> > > >> > The "-sum" command is meant to make things easier by
searching
> your
> > > >> > directory for you. But instead of using "-sum", you could
use the
> > > >> "-add"
> > > >> > command and just explicitly list the 4 files from which
you'd like
> > to
> > > >> > extract 6-hour APCP and add them up to 24. In my directory
> > structure,
> > > >> the
> > > >> > previous "-sum" job could be rewritten with "-add" like
this:
> > > >> >
> > > >> > cd /d1/SBU/GFS/model_data/20150220
> > > >> > met-5.2/bin/pcp_combine -add \
> > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_018.grb2
> > 06 \
> > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_024.grb2
> > 06 \
> > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_030.grb2
> > 06 \
> > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_036.grb2
> > 06 \
> > > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> > > >> >
> > > >> > Here I'm explicitly telling pcp_combine which files to read
and
> what
> > > >> > accumulation interval (6 hours) to extract from them. The
> resulting
> > > >> output
> > > >> > should be identical to the output of the "-sum" command.
> > > >> >
> > > >> > Hope that helps get you going.
> > > >> >
> > > >> > Just let me know what other issues or questions arise.
> > > >> >
> > > >> > Thanks,
> > > >> > John Halley Gotway
> > > >> >
> > > >> >
> > > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA
Affiliate via
> > RT
> > > <
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> > >
> > > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> > > >> > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > >> > > Queue: met_help
> > > >> > > Subject: using pcp combine on GFS grib files
> > > >> > > Owner: Nobody
> > > >> > > Requestors: andrew.kren at noaa.gov
> > > >> > > Status: new
> > > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=78971
> > > >> >
> > > >> > >
> > > >> > >
> > > >> > > Dear MET help,
> > > >> > >
> > > >> > > I am trying to use pcp_combine on GFS output files, with
file
> > naming
> > > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the
forecast
> > > hour.
> > > >> The
> > > >> > > GFS output is 6-hr accumulation, but I would like to
generate a
> > > netcdf
> > > >> > file
> > > >> > > with 24 hour accumulations for each gfs run, where
YYYYMMDDHH
> > > >> specifies
> > > >> > the
> > > >> > > initialization date of the GFS.
> > > >> > >
> > > >> > > As for observations, I have 24 hour accumulated
precipitation in
> > > this
> > > >> > file
> > > >> > > format, already processed from NCAR.
> > > >> > >
> > > >> > > ST4.YYYYMMDDHH.24h
> > > >> > >
> > > >> > > I've looked up the syntax of pcp_combine but its hard to
depict
> > how
> > > >> to do
> > > >> > > it. Would anyone be able to help me? My end goal is to
then run
> > this
> > > >> > > through MET MODE to look at equitable threat scores for
various
> > > precip
> > > >> > > thresholds per 24 hours to see the forecast impact of two
GFS
> > > >> > experiments.
> > > >> > >
> > > >> > > Thank you so much,
> > > >> > >
> > > >> > > --
> > > >> > > Andrew Kren, PhD
> > > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > 325 Broadway, Boulder, CO 80305
> > > >> > > (303) 497-5418
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Andrew Kren, PhD
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > >
> > >
> > >
> > > --
> > > Andrew Kren, PhD
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
>
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: Andrew Kren - NOAA Affiliate
Time: Mon Jan 30 15:01:38 2017
John,
you are correct, I am running on Theia.
The path from where I am trying to run is located here:
/scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/
On Mon, Jan 30, 2017 at 2:56 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Andrew,
>
> If you remove the expression, you should also remove "-pcprx" from
the
> command line. It isn't a required argument... but we can use it to
speed
> up the checking of files.
>
> Based on the path, I'm guessing you're running on theia, to which I
have
> access. If you send me the path to where you're trying to run, I
could try
> to find a regular expression that'd work for you.
>
> Thanks,
> John
>
> On Mon, Jan 30, 2017 at 2:02 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >
> > Hi John,
> >
> > I removed the expression but now it is just hanging there and not
doing
> > anything. I assume its because I didn't list the file name
convention.
> How
> > would I do that if I remove the -pcprx?
> >
> > Thanks,
> >
> > On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Andrew,
> > >
> > > Please try removing the "-pcprx pgbq*.gfs*2016022118" option and
> running
> > > again. The star '*' you're using is a wildcard on the command
line but
> > not
> > > part of a regular expression.
> > >
> > > Try to get it working without the "-pcprx" option... and once
that's
> > done,
> > > you could figure out how to add it back in.
> > >
> > > If/when you get there, I'd try...
> > > -pcprx pgbq[0-9]+.gfs.2016022118
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
>
> > > >
> > > > I noticed I should not have included the \ things. I redid the
> > expression
> > > > but got this error:
> > > >
> > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum 20160221_18
06
> > > > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
> > > > "pgbq*.gfs.2016022118"
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : sum_data_files() -> Cannot find a file with a valid
time of
> > > > 20160222_180000 and accumulation time of 030000 matching the
regular
> > > > expression "pgbq*.gfs.2016022118"
> > > >
> > > > ERROR :
> > > >
> > > >
> > > > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA Affiliate
<
> > > > andrew.kren at noaa.gov> wrote:
> > > >
> > > > > John,
> > > > >
> > > > > I finally got time to try out your MET example on my GFS
output. My
> > GFS
> > > > > output has the format of pgbqff.gfs.2016022118 <(201)%20602-
2118>,
> > > where
> > > > > the ff stands for the forecast hours, 0 to 384, and the date
> > > corresponds
> > > > to
> > > > > the init date of the GFS run.
> > > > >
> > > > > I used this command in my directory where the files were and
it did
> > not
> > > > > work:
> > > > >
> > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum
20160221_18
> 06
> > > > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \ -pcprx
> > > > > "pgbq*.gfs*2016022118" \ -pcpdir .
> > > > >
> > > > >
> > > > > Am I doing something wrong?
> > > > >
> > > > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Andrew,
> > > > >>
> > > > >> It's basically the same. The only difference is that you
specify
> > the
> > > > >> initialization time using all 0's. Usually pcp_combine
requires
> > that
> > > > the
> > > > >> initialization time stays constant since you generally
wouldn't
> want
> > > to
> > > > >> mix
> > > > >> data from different model initializations.
> > > > >>
> > > > >> Here's some sample commands to grab some StageIV data,
unzip it,
> and
> > > run
> > > > >> pcp_combine on it:
> > > > >>
> > > > >> mkdir test_st4
> > > > >> cd test_st4
> > > > >> wget
> > > > >>
ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
> > > > >> .20161015ST4.20161015
> > > > >> tar -xvf ST4.20161015
> > > > >> gunzip ST4*.06h.gz
> > > > >>
> > > > >> # Add 2 files together
> > > > >> met-5.2/bin/pcp_combine -add ST4.2016101512.06h 06
ST4.2016101518
> > > > >> <(201)%20610-1518>.06h 06
> > > > >> ST4.2016101518.APCP_12.nc
> > > > >>
> > > > >> # Use the sum command instead
> > > > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06 20161015_18
12
> > > > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA
Affiliate via
> > RT <
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > > > >> >
> > > > >> > Could you show me an example for accumulating the 6hr
stage 4
> > data?
> > > Or
> > > > >> > would it be the same? Thanks so much!
> > > > >> >
> > > > >> > Andrew Kren
> > > > >> >
> > > > >> > From: John Halley Gotway via RT
> > > > >> > Sent: Thursday, December 22, 2016 1:53 PM
> > > > >> > To: andrew.kren at noaa.gov
> > > > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine
on GFS
> > grib
> > > > >> files
> > > > >> >
> > > > >> > Hello Andrew,
> > > > >> >
> > > > >> > I apologize for the delay in answering your question.
Many of
> our
> > > > staff
> > > > >> > are out of the office over the holidays.
> > > > >> >
> > > > >> > I see that you have questions about running GFS data
through the
> > > > >> > pcp_combine tool. You'd like to use pcp_combine to put
GFS into
> > > > 24-hour
> > > > >> > intervals for comparison against 24-hourly StageIV
> precipitation.
> > > > >> >
> > > > >> > However, be aware that the 24-hour StageIV data is
defined as an
> > > > >> > accumulation from 12Z on one day to 12Z on the next day:
> > > > >> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> > > > >> >
> > > > >> > Therefore, you can only use the 24-hour StageIV data to
evaluate
> > 12Z
> > > > to
> > > > >> 12Z
> > > > >> > accumulations from your model. Alternatively, you could
use the
> > > > 6-hour
> > > > >> > StageIV accumulations to evaluate any 24 hour
accumulation from
> > your
> > > > >> > model. For the latter, you'd just need to run the 6-hour
> StageIV
> > > > files
> > > > >> > through pcp_combine to generate your desired 24-hour
> accumulation.
> > > > >> >
> > > > >> > Let me go through an example. Run pcp_combine to compute
> 24-hour
> > > > >> > accumulations for GFS. Let's suppose I'm processing the
> 20150220
> > > 00Z
> > > > >> > initialization of GFS.
> > > > >> >
> > > > >> > met-5.2/bin/pcp_combine \
> > > > >> > -sum 20150220_00 06 20150221_00 24 \
> > > > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > > > >> >
> > > > >> > Here I'm telling pcp_combine to look in the
> > /d1/SBU/GFS/model_data/
> > > > >> > 20150220
> > > > >> > directory at files which match this regular expression
> > > > >> > "gfs_4_20150220_00.*grb2". That directory contains data
for 00,
> > 06,
> > > > 12,
> > > > >> > and 18 hour initializations, but the "-pcprx" option
narrows the
> > > > search
> > > > >> > down to the 00 hour initialization which makes it run
faster.
> It
> > > > >> inspects
> > > > >> > all the matching files, looking for 6-hour APCP data to
sum up
> to
> > a
> > > > >> 24-hour
> > > > >> > accumulation valid at 20150221_00. This results in a 24-
hour
> > > > >> accumulation
> > > > >> > between forecast hours 0 and 24.
> > > > >> >
> > > > >> > The following command will compute the 24-hour
accumulation
> > between
> > > > >> > forecast hours 12 and 36:
> > > > >> >
> > > > >> > met-5.2/bin/pcp_combine \
> > > > >> > -sum 20150220_00 06 20150221_12 24 \
> > > > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > > > >> >
> > > > >> > The "-sum" command is meant to make things easier by
searching
> > your
> > > > >> > directory for you. But instead of using "-sum", you
could use
> the
> > > > >> "-add"
> > > > >> > command and just explicitly list the 4 files from which
you'd
> like
> > > to
> > > > >> > extract 6-hour APCP and add them up to 24. In my
directory
> > > structure,
> > > > >> the
> > > > >> > previous "-sum" job could be rewritten with "-add" like
this:
> > > > >> >
> > > > >> > cd /d1/SBU/GFS/model_data/20150220
> > > > >> > met-5.2/bin/pcp_combine -add \
> > > > >> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> 018.grb2
> > > 06 \
> > > > >> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> 024.grb2
> > > 06 \
> > > > >> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> 030.grb2
> > > 06 \
> > > > >> > /d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> 036.grb2
> > > 06 \
> > > > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> > > > >> >
> > > > >> > Here I'm explicitly telling pcp_combine which files to
read and
> > what
> > > > >> > accumulation interval (6 hours) to extract from them.
The
> > resulting
> > > > >> output
> > > > >> > should be identical to the output of the "-sum" command.
> > > > >> >
> > > > >> > Hope that helps get you going.
> > > > >> >
> > > > >> > Just let me know what other issues or questions arise.
> > > > >> >
> > > > >> > Thanks,
> > > > >> > John Halley Gotway
> > > > >> >
> > > > >> >
> > > > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA
Affiliate
> via
> > > RT
> > > > <
> > > > >> > met_help at ucar.edu> wrote:
> > > > >> >
> > > > >> > >
> > > > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted upon.
> > > > >> > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > > >> > > Queue: met_help
> > > > >> > > Subject: using pcp combine on GFS grib files
> > > > >> > > Owner: Nobody
> > > > >> > > Requestors: andrew.kren at noaa.gov
> > > > >> > > Status: new
> > > > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > Ticket/Display.html?id=78971
> > > > >> >
> > > > >> > >
> > > > >> > >
> > > > >> > > Dear MET help,
> > > > >> > >
> > > > >> > > I am trying to use pcp_combine on GFS output files,
with file
> > > naming
> > > > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is the
> forecast
> > > > hour.
> > > > >> The
> > > > >> > > GFS output is 6-hr accumulation, but I would like to
generate
> a
> > > > netcdf
> > > > >> > file
> > > > >> > > with 24 hour accumulations for each gfs run, where
YYYYMMDDHH
> > > > >> specifies
> > > > >> > the
> > > > >> > > initialization date of the GFS.
> > > > >> > >
> > > > >> > > As for observations, I have 24 hour accumulated
precipitation
> in
> > > > this
> > > > >> > file
> > > > >> > > format, already processed from NCAR.
> > > > >> > >
> > > > >> > > ST4.YYYYMMDDHH.24h
> > > > >> > >
> > > > >> > > I've looked up the syntax of pcp_combine but its hard
to
> depict
> > > how
> > > > >> to do
> > > > >> > > it. Would anyone be able to help me? My end goal is to
then
> run
> > > this
> > > > >> > > through MET MODE to look at equitable threat scores for
> various
> > > > precip
> > > > >> > > thresholds per 24 hours to see the forecast impact of
two GFS
> > > > >> > experiments.
> > > > >> > >
> > > > >> > > Thank you so much,
> > > > >> > >
> > > > >> > > --
> > > > >> > > Andrew Kren, PhD
> > > > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > > Group
> > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > >> > > 325 Broadway, Boulder, CO 80305
> > > > >> > > (303) 497-5418
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > > --
> > > > > Andrew Kren, PhD
> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > 325 Broadway, Boulder, CO 80305
> > > > > (303) 497-5418
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Andrew Kren, PhD
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Andrew Kren, PhD
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>
--
Andrew Kren, PhD
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Mon Jan 30 15:19:01 2017
Andrew,
It *looked* like it was hung, but it was actually doing work...
inventorying the timing info of all the data files in that directory.
Running at a higher verbosity level (-v 4) will print out info about
this.
I see why you wanted to use -pcprx to speed it up! It's running
pretty
slowly.
Heres a command that works:
/scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \
-sum 20160221_18 06 20160222_18 24 \
gfs_APCP_24_20160221_18_F00_F24.nc \
-pcpdir /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp \
-pcprx 'pgbq[0-9][0-9].gfs.2016022118' -v 3
But this only matches 2-digit forecast hours. I'm a little concerned
about
how slowly this is running. Perhaps, I should run it in the debugger
to
figure out what's taking so long.
John
On Mon, Jan 30, 2017 at 3:01 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
> John,
> you are correct, I am running on Theia.
>
> The path from where I am trying to run is located here:
>
> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/
>
> On Mon, Jan 30, 2017 at 2:56 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andrew,
> >
> > If you remove the expression, you should also remove "-pcprx" from
the
> > command line. It isn't a required argument... but we can use it
to speed
> > up the checking of files.
> >
> > Based on the path, I'm guessing you're running on theia, to which
I have
> > access. If you send me the path to where you're trying to run, I
could
> try
> > to find a regular expression that'd work for you.
> >
> > Thanks,
> > John
> >
> > On Mon, Jan 30, 2017 at 2:02 PM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > >
> > > Hi John,
> > >
> > > I removed the expression but now it is just hanging there and
not doing
> > > anything. I assume its because I didn't list the file name
convention.
> > How
> > > would I do that if I remove the -pcprx?
> > >
> > > Thanks,
> > >
> > > On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Andrew,
> > > >
> > > > Please try removing the "-pcprx pgbq*.gfs*2016022118" option
and
> > running
> > > > again. The star '*' you're using is a wildcard on the command
line
> but
> > > not
> > > > part of a regular expression.
> > > >
> > > > Try to get it working without the "-pcprx" option... and once
that's
> > > done,
> > > > you could figure out how to add it back in.
> > > >
> > > > If/when you get there, I'd try...
> > > > -pcprx pgbq[0-9]+.gfs.2016022118
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA Affiliate
via
> RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > > > >
> > > > > I noticed I should not have included the \ things. I redid
the
> > > expression
> > > > > but got this error:
> > > > >
> > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum
20160221_18 06
> > > > > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
> > > > > "pgbq*.gfs.2016022118 <(201)%20602-2118>"
> > > > >
> > > > > ERROR :
> > > > >
> > > > > ERROR : sum_data_files() -> Cannot find a file with a valid
time
> of
> > > > > 20160222_180000 and accumulation time of 030000 matching the
> regular
> > > > > expression "pgbq*.gfs.2016022118 <(201)%20602-2118>"
> > > > >
> > > > > ERROR :
> > > > >
> > > > >
> > > > > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA
Affiliate <
> > > > > andrew.kren at noaa.gov> wrote:
> > > > >
> > > > > > John,
> > > > > >
> > > > > > I finally got time to try out your MET example on my GFS
output.
> My
> > > GFS
> > > > > > output has the format of pgbqff.gfs.2016022118
> <(201)%20602-2118>,
> > > > where
> > > > > > the ff stands for the forecast hours, 0 to 384, and the
date
> > > > corresponds
> > > > > to
> > > > > > the init date of the GFS run.
> > > > > >
> > > > > > I used this command in my directory where the files were
and it
> did
> > > not
> > > > > > work:
> > > > > >
> > > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum
20160221_18
> > 06
> > > > > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \
-pcprx
> > > > > > "pgbq*.gfs*2016022118 <(201)%20602-2118>" \ -pcpdir .
> > > > > >
> > > > > >
> > > > > > Am I doing something wrong?
> > > > > >
> > > > > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >> Andrew,
> > > > > >>
> > > > > >> It's basically the same. The only difference is that you
> specify
> > > the
> > > > > >> initialization time using all 0's. Usually pcp_combine
requires
> > > that
> > > > > the
> > > > > >> initialization time stays constant since you generally
wouldn't
> > want
> > > > to
> > > > > >> mix
> > > > > >> data from different model initializations.
> > > > > >>
> > > > > >> Here's some sample commands to grab some StageIV data,
unzip it,
> > and
> > > > run
> > > > > >> pcp_combine on it:
> > > > > >>
> > > > > >> mkdir test_st4
> > > > > >> cd test_st4
> > > > > >> wget
> > > > > >>
ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
> > > > > >> .20161015ST4.20161015
> > > > > >> tar -xvf ST4.20161015
> > > > > >> gunzip ST4*.06h.gz
> > > > > >>
> > > > > >> # Add 2 files together
> > > > > >> met-5.2/bin/pcp_combine -add ST4.2016101512 <(201)%20610-
1512>.06h
> 06 ST4.2016101518 <(201)%20610-1518>
> > > > > >> <(201)%20610-1518>.06h 06
> > > > > >> ST4.2016101518.APCP_12.nc
> > > > > >>
> > > > > >> # Use the sum command instead
> > > > > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06
20161015_18 12
> > > > > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> > > > > >>
> > > > > >> Thanks,
> > > > > >> John
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA
Affiliate
> via
> > > RT <
> > > > > >> met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
> >
> > > > > >> >
> > > > > >> > Could you show me an example for accumulating the 6hr
stage 4
> > > data?
> > > > Or
> > > > > >> > would it be the same? Thanks so much!
> > > > > >> >
> > > > > >> > Andrew Kren
> > > > > >> >
> > > > > >> > From: John Halley Gotway via RT
> > > > > >> > Sent: Thursday, December 22, 2016 1:53 PM
> > > > > >> > To: andrew.kren at noaa.gov
> > > > > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp combine
on
> GFS
> > > grib
> > > > > >> files
> > > > > >> >
> > > > > >> > Hello Andrew,
> > > > > >> >
> > > > > >> > I apologize for the delay in answering your question.
Many of
> > our
> > > > > staff
> > > > > >> > are out of the office over the holidays.
> > > > > >> >
> > > > > >> > I see that you have questions about running GFS data
through
> the
> > > > > >> > pcp_combine tool. You'd like to use pcp_combine to put
GFS
> into
> > > > > 24-hour
> > > > > >> > intervals for comparison against 24-hourly StageIV
> > precipitation.
> > > > > >> >
> > > > > >> > However, be aware that the 24-hour StageIV data is
defined as
> an
> > > > > >> > accumulation from 12Z on one day to 12Z on the next
day:
> > > > > >> > http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> > > > > >> >
> > > > > >> > Therefore, you can only use the 24-hour StageIV data to
> evaluate
> > > 12Z
> > > > > to
> > > > > >> 12Z
> > > > > >> > accumulations from your model. Alternatively, you
could use
> the
> > > > > 6-hour
> > > > > >> > StageIV accumulations to evaluate any 24 hour
accumulation
> from
> > > your
> > > > > >> > model. For the latter, you'd just need to run the 6-
hour
> > StageIV
> > > > > files
> > > > > >> > through pcp_combine to generate your desired 24-hour
> > accumulation.
> > > > > >> >
> > > > > >> > Let me go through an example. Run pcp_combine to
compute
> > 24-hour
> > > > > >> > accumulations for GFS. Let's suppose I'm processing
the
> > 20150220
> > > > 00Z
> > > > > >> > initialization of GFS.
> > > > > >> >
> > > > > >> > met-5.2/bin/pcp_combine \
> > > > > >> > -sum 20150220_00 06 20150221_00 24 \
> > > > > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > > > > >> >
> > > > > >> > Here I'm telling pcp_combine to look in the
> > > /d1/SBU/GFS/model_data/
> > > > > >> > 20150220
> > > > > >> > directory at files which match this regular expression
> > > > > >> > "gfs_4_20150220_00.*grb2". That directory contains
data for
> 00,
> > > 06,
> > > > > 12,
> > > > > >> > and 18 hour initializations, but the "-pcprx" option
narrows
> the
> > > > > search
> > > > > >> > down to the 00 hour initialization which makes it run
faster.
> > It
> > > > > >> inspects
> > > > > >> > all the matching files, looking for 6-hour APCP data to
sum up
> > to
> > > a
> > > > > >> 24-hour
> > > > > >> > accumulation valid at 20150221_00. This results in a
24-hour
> > > > > >> accumulation
> > > > > >> > between forecast hours 0 and 24.
> > > > > >> >
> > > > > >> > The following command will compute the 24-hour
accumulation
> > > between
> > > > > >> > forecast hours 12 and 36:
> > > > > >> >
> > > > > >> > met-5.2/bin/pcp_combine \
> > > > > >> > -sum 20150220_00 06 20150221_12 24 \
> > > > > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > > > > >> >
> > > > > >> > The "-sum" command is meant to make things easier by
searching
> > > your
> > > > > >> > directory for you. But instead of using "-sum", you
could use
> > the
> > > > > >> "-add"
> > > > > >> > command and just explicitly list the 4 files from which
you'd
> > like
> > > > to
> > > > > >> > extract 6-hour APCP and add them up to 24. In my
directory
> > > > structure,
> > > > > >> the
> > > > > >> > previous "-sum" job could be rewritten with "-add" like
this:
> > > > > >> >
> > > > > >> > cd /d1/SBU/GFS/model_data/20150220
> > > > > >> > met-5.2/bin/pcp_combine -add \
> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > 018.grb2
> > > > 06 \
> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > 024.grb2
> > > > 06 \
> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > 030.grb2
> > > > 06 \
> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > 036.grb2
> > > > 06 \
> > > > > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> > > > > >> >
> > > > > >> > Here I'm explicitly telling pcp_combine which files to
read
> and
> > > what
> > > > > >> > accumulation interval (6 hours) to extract from them.
The
> > > resulting
> > > > > >> output
> > > > > >> > should be identical to the output of the "-sum"
command.
> > > > > >> >
> > > > > >> > Hope that helps get you going.
> > > > > >> >
> > > > > >> > Just let me know what other issues or questions arise.
> > > > > >> >
> > > > > >> > Thanks,
> > > > > >> > John Halley Gotway
> > > > > >> >
> > > > > >> >
> > > > > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA
Affiliate
> > via
> > > > RT
> > > > > <
> > > > > >> > met_help at ucar.edu> wrote:
> > > > > >> >
> > > > > >> > >
> > > > > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted
upon.
> > > > > >> > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > > > >> > > Queue: met_help
> > > > > >> > > Subject: using pcp combine on GFS grib files
> > > > > >> > > Owner: Nobody
> > > > > >> > > Requestors: andrew.kren at noaa.gov
> > > > > >> > > Status: new
> > > > > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > > Ticket/Display.html?id=78971
> > > > > >> >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > Dear MET help,
> > > > > >> > >
> > > > > >> > > I am trying to use pcp_combine on GFS output files,
with
> file
> > > > naming
> > > > > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is
the
> > forecast
> > > > > hour.
> > > > > >> The
> > > > > >> > > GFS output is 6-hr accumulation, but I would like to
> generate
> > a
> > > > > netcdf
> > > > > >> > file
> > > > > >> > > with 24 hour accumulations for each gfs run, where
> YYYYMMDDHH
> > > > > >> specifies
> > > > > >> > the
> > > > > >> > > initialization date of the GFS.
> > > > > >> > >
> > > > > >> > > As for observations, I have 24 hour accumulated
> precipitation
> > in
> > > > > this
> > > > > >> > file
> > > > > >> > > format, already processed from NCAR.
> > > > > >> > >
> > > > > >> > > ST4.YYYYMMDDHH.24h
> > > > > >> > >
> > > > > >> > > I've looked up the syntax of pcp_combine but its hard
to
> > depict
> > > > how
> > > > > >> to do
> > > > > >> > > it. Would anyone be able to help me? My end goal is
to then
> > run
> > > > this
> > > > > >> > > through MET MODE to look at equitable threat scores
for
> > various
> > > > > precip
> > > > > >> > > thresholds per 24 hours to see the forecast impact of
two
> GFS
> > > > > >> > experiments.
> > > > > >> > >
> > > > > >> > > Thank you so much,
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > > Andrew Kren, PhD
> > > > > >> > > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> > > > Group
> > > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > >> > > 325 Broadway, Boulder, CO 80305
> > > > > >> > > (303) 497-5418
> > > > > >> > >
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Andrew Kren, PhD
> > > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > > 325 Broadway, Boulder, CO 80305
> > > > > > (303) 497-5418
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Andrew Kren, PhD
> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > 325 Broadway, Boulder, CO 80305
> > > > > (303) 497-5418
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Andrew Kren, PhD
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
>
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Mon Jan 30 15:23:34 2017
Andrew,
I wanted to also mention that you could use the "-add" command
instead:
/scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -add
/scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/pgbq06.gfs.2016022118
06
/scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/pgbq12.gfs.2016022118
06
/scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/pgbq18.gfs.2016022118
06
/scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/pgbq24.gfs.2016022118
06 gfs_APCP_24_20160221_18_F00_F24_ADD.nc
The -sum and -add options both do the same thing... it's just that '-
sum'
finds the files for you first. But you could always do that in the
calling
script instead.
John
On Mon, Jan 30, 2017 at 3:18 PM, John Halley Gotway <johnhg at ucar.edu>
wrote:
> Andrew,
>
> It *looked* like it was hung, but it was actually doing work...
> inventorying the timing info of all the data files in that
directory.
> Running at a higher verbosity level (-v 4) will print out info about
this.
>
> I see why you wanted to use -pcprx to speed it up! It's running
pretty
> slowly.
>
> Heres a command that works:
>
> /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \
>
> -sum 20160221_18 06 20160222_18 24 \
>
> gfs_APCP_24_20160221_18_F00_F24.nc \
>
> -pcpdir /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp \
>
> -pcprx 'pgbq[0-9][0-9].gfs.2016022118 <(201)%20602-2118>' -v 3
>
>
> But this only matches 2-digit forecast hours. I'm a little
concerned
> about how slowly this is running. Perhaps, I should run it in the
debugger
> to figure out what's taking so long.
>
>
> John
>
>
>
> On Mon, Jan 30, 2017 at 3:01 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>>
>> John,
>> you are correct, I am running on Theia.
>>
>> The path from where I am trying to run is located here:
>>
>> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/
>>
>> On Mon, Jan 30, 2017 at 2:56 PM, John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>> > Andrew,
>> >
>> > If you remove the expression, you should also remove "-pcprx"
from the
>> > command line. It isn't a required argument... but we can use it
to
>> speed
>> > up the checking of files.
>> >
>> > Based on the path, I'm guessing you're running on theia, to which
I have
>> > access. If you send me the path to where you're trying to run, I
could
>> try
>> > to find a regular expression that'd work for you.
>> >
>> > Thanks,
>> > John
>> >
>> > On Mon, Jan 30, 2017 at 2:02 PM, Andrew Kren - NOAA Affiliate via
RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>> > >
>> > > Hi John,
>> > >
>> > > I removed the expression but now it is just hanging there and
not
>> doing
>> > > anything. I assume its because I didn't list the file name
convention.
>> > How
>> > > would I do that if I remove the -pcprx?
>> > >
>> > > Thanks,
>> > >
>> > > On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > > Andrew,
>> > > >
>> > > > Please try removing the "-pcprx pgbq*.gfs*2016022118" option
and
>> > running
>> > > > again. The star '*' you're using is a wildcard on the
command line
>> but
>> > > not
>> > > > part of a regular expression.
>> > > >
>> > > > Try to get it working without the "-pcprx" option... and once
that's
>> > > done,
>> > > > you could figure out how to add it back in.
>> > > >
>> > > > If/when you get there, I'd try...
>> > > > -pcprx pgbq[0-9]+.gfs.2016022118
>> > > >
>> > > > Thanks,
>> > > > John
>> > > >
>> > > > On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA
Affiliate via
>> RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>> > > > >
>> > > > > I noticed I should not have included the \ things. I redid
the
>> > > expression
>> > > > > but got this error:
>> > > > >
>> > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum
20160221_18 06
>> > > > > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
>> > > > > "pgbq*.gfs.2016022118 <(201)%20602-2118>"
>> > > > >
>> > > > > ERROR :
>> > > > >
>> > > > > ERROR : sum_data_files() -> Cannot find a file with a
valid time
>> of
>> > > > > 20160222_180000 and accumulation time of 030000 matching
the
>> regular
>> > > > > expression "pgbq*.gfs.2016022118 <(201)%20602-2118>"
>> > > > >
>> > > > > ERROR :
>> > > > >
>> > > > >
>> > > > > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA
Affiliate <
>> > > > > andrew.kren at noaa.gov> wrote:
>> > > > >
>> > > > > > John,
>> > > > > >
>> > > > > > I finally got time to try out your MET example on my GFS
>> output. My
>> > > GFS
>> > > > > > output has the format of pgbqff.gfs.2016022118
>> <(201)%20602-2118>,
>> > > > where
>> > > > > > the ff stands for the forecast hours, 0 to 384, and the
date
>> > > > corresponds
>> > > > > to
>> > > > > > the init date of the GFS run.
>> > > > > >
>> > > > > > I used this command in my directory where the files were
and it
>> did
>> > > not
>> > > > > > work:
>> > > > > >
>> > > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum
>> 20160221_18
>> > 06
>> > > > > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \
-pcprx
>> > > > > > "pgbq*.gfs*2016022118 <(201)%20602-2118>" \ -pcpdir .
>> > > > > >
>> > > > > >
>> > > > > > Am I doing something wrong?
>> > > > > >
>> > > > > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via
RT <
>> > > > > > met_help at ucar.edu> wrote:
>> > > > > >
>> > > > > >> Andrew,
>> > > > > >>
>> > > > > >> It's basically the same. The only difference is that
you
>> specify
>> > > the
>> > > > > >> initialization time using all 0's. Usually pcp_combine
>> requires
>> > > that
>> > > > > the
>> > > > > >> initialization time stays constant since you generally
wouldn't
>> > want
>> > > > to
>> > > > > >> mix
>> > > > > >> data from different model initializations.
>> > > > > >>
>> > > > > >> Here's some sample commands to grab some StageIV data,
unzip
>> it,
>> > and
>> > > > run
>> > > > > >> pcp_combine on it:
>> > > > > >>
>> > > > > >> mkdir test_st4
>> > > > > >> cd test_st4
>> > > > > >> wget
>> > > > > >>
ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
>> > > > > >> .20161015ST4.20161015
>> > > > > >> tar -xvf ST4.20161015
>> > > > > >> gunzip ST4*.06h.gz
>> > > > > >>
>> > > > > >> # Add 2 files together
>> > > > > >> met-5.2/bin/pcp_combine -add ST4.2016101512
<(201)%20610-1512>.06h
>> 06 ST4.2016101518 <(201)%20610-1518>
>> > > > > >> <(201)%20610-1518>.06h 06
>> > > > > >> ST4.2016101518.APCP_12.nc
>> > > > > >>
>> > > > > >> # Use the sum command instead
>> > > > > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06
20161015_18 12
>> > > > > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
>> > > > > >>
>> > > > > >> Thanks,
>> > > > > >> John
>> > > > > >>
>> > > > > >>
>> > > > > >>
>> > > > > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA
Affiliate
>> via
>> > > RT <
>> > > > > >> met_help at ucar.edu> wrote:
>> > > > > >>
>> > > > > >> >
>> > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
>> ket/Display.html?id=78971 >
>> > > > > >> >
>> > > > > >> > Could you show me an example for accumulating the 6hr
stage 4
>> > > data?
>> > > > Or
>> > > > > >> > would it be the same? Thanks so much!
>> > > > > >> >
>> > > > > >> > Andrew Kren
>> > > > > >> >
>> > > > > >> > From: John Halley Gotway via RT
>> > > > > >> > Sent: Thursday, December 22, 2016 1:53 PM
>> > > > > >> > To: andrew.kren at noaa.gov
>> > > > > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp
combine on
>> GFS
>> > > grib
>> > > > > >> files
>> > > > > >> >
>> > > > > >> > Hello Andrew,
>> > > > > >> >
>> > > > > >> > I apologize for the delay in answering your question.
Many
>> of
>> > our
>> > > > > staff
>> > > > > >> > are out of the office over the holidays.
>> > > > > >> >
>> > > > > >> > I see that you have questions about running GFS data
through
>> the
>> > > > > >> > pcp_combine tool. You'd like to use pcp_combine to
put GFS
>> into
>> > > > > 24-hour
>> > > > > >> > intervals for comparison against 24-hourly StageIV
>> > precipitation.
>> > > > > >> >
>> > > > > >> > However, be aware that the 24-hour StageIV data is
defined
>> as an
>> > > > > >> > accumulation from 12Z on one day to 12Z on the next
day:
>> > > > > >> >
http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
>> > > > > >> >
>> > > > > >> > Therefore, you can only use the 24-hour StageIV data
to
>> evaluate
>> > > 12Z
>> > > > > to
>> > > > > >> 12Z
>> > > > > >> > accumulations from your model. Alternatively, you
could use
>> the
>> > > > > 6-hour
>> > > > > >> > StageIV accumulations to evaluate any 24 hour
accumulation
>> from
>> > > your
>> > > > > >> > model. For the latter, you'd just need to run the 6-
hour
>> > StageIV
>> > > > > files
>> > > > > >> > through pcp_combine to generate your desired 24-hour
>> > accumulation.
>> > > > > >> >
>> > > > > >> > Let me go through an example. Run pcp_combine to
compute
>> > 24-hour
>> > > > > >> > accumulations for GFS. Let's suppose I'm processing
the
>> > 20150220
>> > > > 00Z
>> > > > > >> > initialization of GFS.
>> > > > > >> >
>> > > > > >> > met-5.2/bin/pcp_combine \
>> > > > > >> > -sum 20150220_00 06 20150221_00 24 \
>> > > > > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
>> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
>> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
>> > > > > >> >
>> > > > > >> > Here I'm telling pcp_combine to look in the
>> > > /d1/SBU/GFS/model_data/
>> > > > > >> > 20150220
>> > > > > >> > directory at files which match this regular expression
>> > > > > >> > "gfs_4_20150220_00.*grb2". That directory contains
data for
>> 00,
>> > > 06,
>> > > > > 12,
>> > > > > >> > and 18 hour initializations, but the "-pcprx" option
narrows
>> the
>> > > > > search
>> > > > > >> > down to the 00 hour initialization which makes it run
faster.
>> > It
>> > > > > >> inspects
>> > > > > >> > all the matching files, looking for 6-hour APCP data
to sum
>> up
>> > to
>> > > a
>> > > > > >> 24-hour
>> > > > > >> > accumulation valid at 20150221_00. This results in a
24-hour
>> > > > > >> accumulation
>> > > > > >> > between forecast hours 0 and 24.
>> > > > > >> >
>> > > > > >> > The following command will compute the 24-hour
accumulation
>> > > between
>> > > > > >> > forecast hours 12 and 36:
>> > > > > >> >
>> > > > > >> > met-5.2/bin/pcp_combine \
>> > > > > >> > -sum 20150220_00 06 20150221_12 24 \
>> > > > > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
>> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
>> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
>> > > > > >> >
>> > > > > >> > The "-sum" command is meant to make things easier by
>> searching
>> > > your
>> > > > > >> > directory for you. But instead of using "-sum", you
could
>> use
>> > the
>> > > > > >> "-add"
>> > > > > >> > command and just explicitly list the 4 files from
which you'd
>> > like
>> > > > to
>> > > > > >> > extract 6-hour APCP and add them up to 24. In my
directory
>> > > > structure,
>> > > > > >> the
>> > > > > >> > previous "-sum" job could be rewritten with "-add"
like this:
>> > > > > >> >
>> > > > > >> > cd /d1/SBU/GFS/model_data/20150220
>> > > > > >> > met-5.2/bin/pcp_combine -add \
>> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
>> > 018.grb2
>> > > > 06 \
>> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
>> > 024.grb2
>> > > > 06 \
>> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
>> > 030.grb2
>> > > > 06 \
>> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
>> > 036.grb2
>> > > > 06 \
>> > > > > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
>> > > > > >> >
>> > > > > >> > Here I'm explicitly telling pcp_combine which files to
read
>> and
>> > > what
>> > > > > >> > accumulation interval (6 hours) to extract from them.
The
>> > > resulting
>> > > > > >> output
>> > > > > >> > should be identical to the output of the "-sum"
command.
>> > > > > >> >
>> > > > > >> > Hope that helps get you going.
>> > > > > >> >
>> > > > > >> > Just let me know what other issues or questions arise.
>> > > > > >> >
>> > > > > >> > Thanks,
>> > > > > >> > John Halley Gotway
>> > > > > >> >
>> > > > > >> >
>> > > > > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA
>> Affiliate
>> > via
>> > > > RT
>> > > > > <
>> > > > > >> > met_help at ucar.edu> wrote:
>> > > > > >> >
>> > > > > >> > >
>> > > > > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted
upon.
>> > > > > >> > > Transaction: Ticket created by andrew.kren at noaa.gov
>> > > > > >> > > Queue: met_help
>> > > > > >> > > Subject: using pcp combine on GFS grib files
>> > > > > >> > > Owner: Nobody
>> > > > > >> > > Requestors: andrew.kren at noaa.gov
>> > > > > >> > > Status: new
>> > > > > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > > > > Ticket/Display.html?id=78971
>> > > > > >> >
>> > > > > >> > >
>> > > > > >> > >
>> > > > > >> > > Dear MET help,
>> > > > > >> > >
>> > > > > >> > > I am trying to use pcp_combine on GFS output files,
with
>> file
>> > > > naming
>> > > > > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is
the
>> > forecast
>> > > > > hour.
>> > > > > >> The
>> > > > > >> > > GFS output is 6-hr accumulation, but I would like to
>> generate
>> > a
>> > > > > netcdf
>> > > > > >> > file
>> > > > > >> > > with 24 hour accumulations for each gfs run, where
>> YYYYMMDDHH
>> > > > > >> specifies
>> > > > > >> > the
>> > > > > >> > > initialization date of the GFS.
>> > > > > >> > >
>> > > > > >> > > As for observations, I have 24 hour accumulated
>> precipitation
>> > in
>> > > > > this
>> > > > > >> > file
>> > > > > >> > > format, already processed from NCAR.
>> > > > > >> > >
>> > > > > >> > > ST4.YYYYMMDDHH.24h
>> > > > > >> > >
>> > > > > >> > > I've looked up the syntax of pcp_combine but its
hard to
>> > depict
>> > > > how
>> > > > > >> to do
>> > > > > >> > > it. Would anyone be able to help me? My end goal is
to then
>> > run
>> > > > this
>> > > > > >> > > through MET MODE to look at equitable threat scores
for
>> > various
>> > > > > precip
>> > > > > >> > > thresholds per 24 hours to see the forecast impact
of two
>> GFS
>> > > > > >> > experiments.
>> > > > > >> > >
>> > > > > >> > > Thank you so much,
>> > > > > >> > >
>> > > > > >> > > --
>> > > > > >> > > Andrew Kren, PhD
>> > > > > >> > > Research Scientist I, Global Observing Systems
Analysis
>> (GOSA)
>> > > > Group
>> > > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > > >> > > 325 Broadway, Boulder, CO 80305
>> > > > > >> > > (303) 497-5418
>> > > > > >> > >
>> > > > > >> > >
>> > > > > >> >
>> > > > > >> >
>> > > > > >> >
>> > > > > >> >
>> > > > > >>
>> > > > > >>
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Andrew Kren, PhD
>> > > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> > Group
>> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > > > 325 Broadway, Boulder, CO 80305
>> > > > > > (303) 497-5418
>> > > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Andrew Kren, PhD
>> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> Group
>> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > > 325 Broadway, Boulder, CO 80305
>> > > > > (303) 497-5418
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> > > --
>> > > Andrew Kren, PhD
>> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > 325 Broadway, Boulder, CO 80305
>> > > (303) 497-5418
>> > >
>> > >
>> >
>> >
>>
>>
>> --
>> Andrew Kren, PhD
>> Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> NOAA ESRL Global Systems Division (Rm 3C515)
>> 325 Broadway, Boulder, CO 80305
>> (303) 497-5418
>>
>>
>
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: Andrew Kren - NOAA Affiliate
Time: Tue Jan 31 10:25:22 2017
I'll try the add functionality today. Is there a way to create 24 hour
accumulations from each GFS initialization and incrementing the
forecast
hours or would that have to be done using a script?
Thanks for your help!
On Mon, Jan 30, 2017 at 3:23 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Andrew,
>
> I wanted to also mention that you could use the "-add" command
instead:
>
> /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -add
> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/pgbq06.gfs.
> 2016022118
> 06
> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/
> temp/pgbq12.gfs.2016022118
> 06
> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/
> temp/pgbq18.gfs.2016022118
> 06
> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/
> temp/pgbq24.gfs.2016022118
> 06 gfs_APCP_24_20160221_18_F00_F24_ADD.nc
>
> The -sum and -add options both do the same thing... it's just that
'-sum'
> finds the files for you first. But you could always do that in the
calling
> script instead.
>
> John
>
> On Mon, Jan 30, 2017 at 3:18 PM, John Halley Gotway
<johnhg at ucar.edu>
> wrote:
>
> > Andrew,
> >
> > It *looked* like it was hung, but it was actually doing work...
> > inventorying the timing info of all the data files in that
directory.
> > Running at a higher verbosity level (-v 4) will print out info
about
> this.
> >
> > I see why you wanted to use -pcprx to speed it up! It's running
pretty
> > slowly.
> >
> > Heres a command that works:
> >
> > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \
> >
> > -sum 20160221_18 06 20160222_18 24 \
> >
> > gfs_APCP_24_20160221_18_F00_F24.nc \
> >
> > -pcpdir /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp \
> >
> > -pcprx 'pgbq[0-9][0-9].gfs.2016022118 <(201)%20602-2118>' -v 3
> >
> >
> > But this only matches 2-digit forecast hours. I'm a little
concerned
> > about how slowly this is running. Perhaps, I should run it in the
> debugger
> > to figure out what's taking so long.
> >
> >
> > John
> >
> >
> >
> > On Mon, Jan 30, 2017 at 3:01 PM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >>
> >> John,
> >> you are correct, I am running on Theia.
> >>
> >> The path from where I am trying to run is located here:
> >>
> >> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/
> >>
> >> On Mon, Jan 30, 2017 at 2:56 PM, John Halley Gotway via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> > Andrew,
> >> >
> >> > If you remove the expression, you should also remove "-pcprx"
from the
> >> > command line. It isn't a required argument... but we can use
it to
> >> speed
> >> > up the checking of files.
> >> >
> >> > Based on the path, I'm guessing you're running on theia, to
which I
> have
> >> > access. If you send me the path to where you're trying to run,
I
> could
> >> try
> >> > to find a regular expression that'd work for you.
> >> >
> >> > Thanks,
> >> > John
> >> >
> >> > On Mon, Jan 30, 2017 at 2:02 PM, Andrew Kren - NOAA Affiliate
via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > >
> >> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
>
> >> > >
> >> > > Hi John,
> >> > >
> >> > > I removed the expression but now it is just hanging there and
not
> >> doing
> >> > > anything. I assume its because I didn't list the file name
> convention.
> >> > How
> >> > > would I do that if I remove the -pcprx?
> >> > >
> >> > > Thanks,
> >> > >
> >> > > On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > > Andrew,
> >> > > >
> >> > > > Please try removing the "-pcprx pgbq*.gfs*2016022118"
option and
> >> > running
> >> > > > again. The star '*' you're using is a wildcard on the
command
> line
> >> but
> >> > > not
> >> > > > part of a regular expression.
> >> > > >
> >> > > > Try to get it working without the "-pcprx" option... and
once
> that's
> >> > > done,
> >> > > > you could figure out how to add it back in.
> >> > > >
> >> > > > If/when you get there, I'd try...
> >> > > > -pcprx pgbq[0-9]+.gfs.2016022118
> >> > > >
> >> > > > Thanks,
> >> > > > John
> >> > > >
> >> > > > On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA
Affiliate via
> >> RT <
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > >
> >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> >> > > > >
> >> > > > > I noticed I should not have included the \ things. I
redid the
> >> > > expression
> >> > > > > but got this error:
> >> > > > >
> >> > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum
20160221_18
> 06
> >> > > > > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc -pcprx
> >> > > > > "pgbq*.gfs.2016022118 <(201)%20602-2118>"
> >> > > > >
> >> > > > > ERROR :
> >> > > > >
> >> > > > > ERROR : sum_data_files() -> Cannot find a file with a
valid
> time
> >> of
> >> > > > > 20160222_180000 and accumulation time of 030000 matching
the
> >> regular
> >> > > > > expression "pgbq*.gfs.2016022118 <(201)%20602-2118>"
> >> > > > >
> >> > > > > ERROR :
> >> > > > >
> >> > > > >
> >> > > > > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA
Affiliate <
> >> > > > > andrew.kren at noaa.gov> wrote:
> >> > > > >
> >> > > > > > John,
> >> > > > > >
> >> > > > > > I finally got time to try out your MET example on my
GFS
> >> output. My
> >> > > GFS
> >> > > > > > output has the format of pgbqff.gfs.2016022118
> >> <(201)%20602-2118>,
> >> > > > where
> >> > > > > > the ff stands for the forecast hours, 0 to 384, and the
date
> >> > > > corresponds
> >> > > > > to
> >> > > > > > the init date of the GFS run.
> >> > > > > >
> >> > > > > > I used this command in my directory where the files
were and
> it
> >> did
> >> > > not
> >> > > > > > work:
> >> > > > > >
> >> > > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum
> >> 20160221_18
> >> > 06
> >> > > > > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \
-pcprx
> >> > > > > > "pgbq*.gfs*2016022118 <(201)%20602-2118>" \ -pcpdir .
> >> > > > > >
> >> > > > > >
> >> > > > > > Am I doing something wrong?
> >> > > > > >
> >> > > > > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway via
RT <
> >> > > > > > met_help at ucar.edu> wrote:
> >> > > > > >
> >> > > > > >> Andrew,
> >> > > > > >>
> >> > > > > >> It's basically the same. The only difference is that
you
> >> specify
> >> > > the
> >> > > > > >> initialization time using all 0's. Usually
pcp_combine
> >> requires
> >> > > that
> >> > > > > the
> >> > > > > >> initialization time stays constant since you generally
> wouldn't
> >> > want
> >> > > > to
> >> > > > > >> mix
> >> > > > > >> data from different model initializations.
> >> > > > > >>
> >> > > > > >> Here's some sample commands to grab some StageIV data,
unzip
> >> it,
> >> > and
> >> > > > run
> >> > > > > >> pcp_combine on it:
> >> > > > > >>
> >> > > > > >> mkdir test_st4
> >> > > > > >> cd test_st4
> >> > > > > >> wget
> >> > > > > >>
ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/ST4
> >> > > > > >> .20161015ST4.20161015
> >> > > > > >> tar -xvf ST4.20161015
> >> > > > > >> gunzip ST4*.06h.gz
> >> > > > > >>
> >> > > > > >> # Add 2 files together
> >> > > > > >> met-5.2/bin/pcp_combine -add ST4.2016101512
> <(201)%20610-1512>.06h
> >> 06 ST4.2016101518 <(201)%20610-1518>
> >> > > > > >> <(201)%20610-1518>.06h 06
> >> > > > > >> ST4.2016101518.APCP_12.nc
> >> > > > > >>
> >> > > > > >> # Use the sum command instead
> >> > > > > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06
20161015_18
> 12
> >> > > > > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> >> > > > > >>
> >> > > > > >> Thanks,
> >> > > > > >> John
> >> > > > > >>
> >> > > > > >>
> >> > > > > >>
> >> > > > > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA
Affiliate
> >> via
> >> > > RT <
> >> > > > > >> met_help at ucar.edu> wrote:
> >> > > > > >>
> >> > > > > >> >
> >> > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> >> ket/Display.html?id=78971 >
> >> > > > > >> >
> >> > > > > >> > Could you show me an example for accumulating the
6hr
> stage 4
> >> > > data?
> >> > > > Or
> >> > > > > >> > would it be the same? Thanks so much!
> >> > > > > >> >
> >> > > > > >> > Andrew Kren
> >> > > > > >> >
> >> > > > > >> > From: John Halley Gotway via RT
> >> > > > > >> > Sent: Thursday, December 22, 2016 1:53 PM
> >> > > > > >> > To: andrew.kren at noaa.gov
> >> > > > > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp
combine on
> >> GFS
> >> > > grib
> >> > > > > >> files
> >> > > > > >> >
> >> > > > > >> > Hello Andrew,
> >> > > > > >> >
> >> > > > > >> > I apologize for the delay in answering your
question. Many
> >> of
> >> > our
> >> > > > > staff
> >> > > > > >> > are out of the office over the holidays.
> >> > > > > >> >
> >> > > > > >> > I see that you have questions about running GFS data
> through
> >> the
> >> > > > > >> > pcp_combine tool. You'd like to use pcp_combine to
put GFS
> >> into
> >> > > > > 24-hour
> >> > > > > >> > intervals for comparison against 24-hourly StageIV
> >> > precipitation.
> >> > > > > >> >
> >> > > > > >> > However, be aware that the 24-hour StageIV data is
defined
> >> as an
> >> > > > > >> > accumulation from 12Z on one day to 12Z on the next
day:
> >> > > > > >> >
http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> >> > > > > >> >
> >> > > > > >> > Therefore, you can only use the 24-hour StageIV data
to
> >> evaluate
> >> > > 12Z
> >> > > > > to
> >> > > > > >> 12Z
> >> > > > > >> > accumulations from your model. Alternatively, you
could
> use
> >> the
> >> > > > > 6-hour
> >> > > > > >> > StageIV accumulations to evaluate any 24 hour
accumulation
> >> from
> >> > > your
> >> > > > > >> > model. For the latter, you'd just need to run the
6-hour
> >> > StageIV
> >> > > > > files
> >> > > > > >> > through pcp_combine to generate your desired 24-hour
> >> > accumulation.
> >> > > > > >> >
> >> > > > > >> > Let me go through an example. Run pcp_combine to
compute
> >> > 24-hour
> >> > > > > >> > accumulations for GFS. Let's suppose I'm processing
the
> >> > 20150220
> >> > > > 00Z
> >> > > > > >> > initialization of GFS.
> >> > > > > >> >
> >> > > > > >> > met-5.2/bin/pcp_combine \
> >> > > > > >> > -sum 20150220_00 06 20150221_00 24 \
> >> > > > > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> >> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> >> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> >> > > > > >> >
> >> > > > > >> > Here I'm telling pcp_combine to look in the
> >> > > /d1/SBU/GFS/model_data/
> >> > > > > >> > 20150220
> >> > > > > >> > directory at files which match this regular
expression
> >> > > > > >> > "gfs_4_20150220_00.*grb2". That directory contains
data
> for
> >> 00,
> >> > > 06,
> >> > > > > 12,
> >> > > > > >> > and 18 hour initializations, but the "-pcprx" option
> narrows
> >> the
> >> > > > > search
> >> > > > > >> > down to the 00 hour initialization which makes it
run
> faster.
> >> > It
> >> > > > > >> inspects
> >> > > > > >> > all the matching files, looking for 6-hour APCP data
to sum
> >> up
> >> > to
> >> > > a
> >> > > > > >> 24-hour
> >> > > > > >> > accumulation valid at 20150221_00. This results in
a
> 24-hour
> >> > > > > >> accumulation
> >> > > > > >> > between forecast hours 0 and 24.
> >> > > > > >> >
> >> > > > > >> > The following command will compute the 24-hour
accumulation
> >> > > between
> >> > > > > >> > forecast hours 12 and 36:
> >> > > > > >> >
> >> > > > > >> > met-5.2/bin/pcp_combine \
> >> > > > > >> > -sum 20150220_00 06 20150221_12 24 \
> >> > > > > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> >> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> >> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> >> > > > > >> >
> >> > > > > >> > The "-sum" command is meant to make things easier by
> >> searching
> >> > > your
> >> > > > > >> > directory for you. But instead of using "-sum", you
could
> >> use
> >> > the
> >> > > > > >> "-add"
> >> > > > > >> > command and just explicitly list the 4 files from
which
> you'd
> >> > like
> >> > > > to
> >> > > > > >> > extract 6-hour APCP and add them up to 24. In my
directory
> >> > > > structure,
> >> > > > > >> the
> >> > > > > >> > previous "-sum" job could be rewritten with "-add"
like
> this:
> >> > > > > >> >
> >> > > > > >> > cd /d1/SBU/GFS/model_data/20150220
> >> > > > > >> > met-5.2/bin/pcp_combine -add \
> >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> >> > 018.grb2
> >> > > > 06 \
> >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> >> > 024.grb2
> >> > > > 06 \
> >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> >> > 030.grb2
> >> > > > 06 \
> >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> >> > 036.grb2
> >> > > > 06 \
> >> > > > > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> >> > > > > >> >
> >> > > > > >> > Here I'm explicitly telling pcp_combine which files
to read
> >> and
> >> > > what
> >> > > > > >> > accumulation interval (6 hours) to extract from
them. The
> >> > > resulting
> >> > > > > >> output
> >> > > > > >> > should be identical to the output of the "-sum"
command.
> >> > > > > >> >
> >> > > > > >> > Hope that helps get you going.
> >> > > > > >> >
> >> > > > > >> > Just let me know what other issues or questions
arise.
> >> > > > > >> >
> >> > > > > >> > Thanks,
> >> > > > > >> > John Halley Gotway
> >> > > > > >> >
> >> > > > > >> >
> >> > > > > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren - NOAA
> >> Affiliate
> >> > via
> >> > > > RT
> >> > > > > <
> >> > > > > >> > met_help at ucar.edu> wrote:
> >> > > > > >> >
> >> > > > > >> > >
> >> > > > > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was acted
upon.
> >> > > > > >> > > Transaction: Ticket created by
andrew.kren at noaa.gov
> >> > > > > >> > > Queue: met_help
> >> > > > > >> > > Subject: using pcp combine on GFS grib files
> >> > > > > >> > > Owner: Nobody
> >> > > > > >> > > Requestors: andrew.kren at noaa.gov
> >> > > > > >> > > Status: new
> >> > > > > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > > > > Ticket/Display.html?id=78971
> >> > > > > >> >
> >> > > > > >> > >
> >> > > > > >> > >
> >> > > > > >> > > Dear MET help,
> >> > > > > >> > >
> >> > > > > >> > > I am trying to use pcp_combine on GFS output
files, with
> >> file
> >> > > > naming
> >> > > > > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF is
the
> >> > forecast
> >> > > > > hour.
> >> > > > > >> The
> >> > > > > >> > > GFS output is 6-hr accumulation, but I would like
to
> >> generate
> >> > a
> >> > > > > netcdf
> >> > > > > >> > file
> >> > > > > >> > > with 24 hour accumulations for each gfs run, where
> >> YYYYMMDDHH
> >> > > > > >> specifies
> >> > > > > >> > the
> >> > > > > >> > > initialization date of the GFS.
> >> > > > > >> > >
> >> > > > > >> > > As for observations, I have 24 hour accumulated
> >> precipitation
> >> > in
> >> > > > > this
> >> > > > > >> > file
> >> > > > > >> > > format, already processed from NCAR.
> >> > > > > >> > >
> >> > > > > >> > > ST4.YYYYMMDDHH.24h
> >> > > > > >> > >
> >> > > > > >> > > I've looked up the syntax of pcp_combine but its
hard to
> >> > depict
> >> > > > how
> >> > > > > >> to do
> >> > > > > >> > > it. Would anyone be able to help me? My end goal
is to
> then
> >> > run
> >> > > > this
> >> > > > > >> > > through MET MODE to look at equitable threat
scores for
> >> > various
> >> > > > > precip
> >> > > > > >> > > thresholds per 24 hours to see the forecast impact
of two
> >> GFS
> >> > > > > >> > experiments.
> >> > > > > >> > >
> >> > > > > >> > > Thank you so much,
> >> > > > > >> > >
> >> > > > > >> > > --
> >> > > > > >> > > Andrew Kren, PhD
> >> > > > > >> > > Research Scientist I, Global Observing Systems
Analysis
> >> (GOSA)
> >> > > > Group
> >> > > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > > >> > > 325 Broadway, Boulder, CO 80305
> >> > > > > >> > > (303) 497-5418
> >> > > > > >> > >
> >> > > > > >> > >
> >> > > > > >> >
> >> > > > > >> >
> >> > > > > >> >
> >> > > > > >> >
> >> > > > > >>
> >> > > > > >>
> >> > > > > >
> >> > > > > >
> >> > > > > > --
> >> > > > > > Andrew Kren, PhD
> >> > > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> >> > Group
> >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > > > 325 Broadway, Boulder, CO 80305
> >> > > > > > (303) 497-5418
> >> > > > > >
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > > --
> >> > > > > Andrew Kren, PhD
> >> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> >> Group
> >> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > > 325 Broadway, Boulder, CO 80305
> >> > > > > (303) 497-5418
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> > > --
> >> > > Andrew Kren, PhD
> >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
> >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > 325 Broadway, Boulder, CO 80305
> >> > > (303) 497-5418
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
> >> --
> >> Andrew Kren, PhD
> >> Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> >> NOAA ESRL Global Systems Division (Rm 3C515)
> >> 325 Broadway, Boulder, CO 80305
> >> (303) 497-5418
> >>
> >>
> >
>
>
--
Andrew Kren, PhD
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418
------------------------------------------------
Subject: using pcp combine on GFS grib files
From: John Halley Gotway
Time: Tue Jan 31 11:42:20 2017
Andrew,
pcp_combine only has logic to process one set of timing information in
each
run. So running it for multiple times would be done through a script.
Thanks,
John
On Tue, Jan 31, 2017 at 10:25 AM, Andrew Kren - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
>
> I'll try the add functionality today. Is there a way to create 24
hour
> accumulations from each GFS initialization and incrementing the
forecast
> hours or would that have to be done using a script?
>
> Thanks for your help!
>
> On Mon, Jan 30, 2017 at 3:23 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andrew,
> >
> > I wanted to also mention that you could use the "-add" command
instead:
> >
> > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -add
> >
/scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/pgbq06.gfs.
> > 2016022118
> > 06
> > /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/
> > temp/pgbq12.gfs.2016022118
> > 06
> > /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/
> > temp/pgbq18.gfs.2016022118
> > 06
> > /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/
> > temp/pgbq24.gfs.2016022118
> > 06 gfs_APCP_24_20160221_18_F00_F24_ADD.nc
> >
> > The -sum and -add options both do the same thing... it's just that
'-sum'
> > finds the files for you first. But you could always do that in
the
> calling
> > script instead.
> >
> > John
> >
> > On Mon, Jan 30, 2017 at 3:18 PM, John Halley Gotway
<johnhg at ucar.edu>
> > wrote:
> >
> > > Andrew,
> > >
> > > It *looked* like it was hung, but it was actually doing work...
> > > inventorying the timing info of all the data files in that
directory.
> > > Running at a higher verbosity level (-v 4) will print out info
about
> > this.
> > >
> > > I see why you wanted to use -pcprx to speed it up! It's running
pretty
> > > slowly.
> > >
> > > Heres a command that works:
> > >
> > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \
> > >
> > > -sum 20160221_18 06 20160222_18 24 \
> > >
> > > gfs_APCP_24_20160221_18_F00_F24.nc \
> > >
> > > -pcpdir /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp
\
> > >
> > > -pcprx 'pgbq[0-9][0-9].gfs.2016022118 <(201)%20602-2118>' -v 3
> > >
> > >
> > > But this only matches 2-digit forecast hours. I'm a little
concerned
> > > about how slowly this is running. Perhaps, I should run it in
the
> > debugger
> > > to figure out what's taking so long.
> > >
> > >
> > > John
> > >
> > >
> > >
> > > On Mon, Jan 30, 2017 at 3:01 PM, Andrew Kren - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > >>
> > >> John,
> > >> you are correct, I am running on Theia.
> > >>
> > >> The path from where I am trying to run is located here:
> > >>
> > >> /scratch4/BMC/shout/ptmp/Andrew.Kren/pre2016c3_corr/temp/
> > >>
> > >> On Mon, Jan 30, 2017 at 2:56 PM, John Halley Gotway via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> > Andrew,
> > >> >
> > >> > If you remove the expression, you should also remove "-pcprx"
from
> the
> > >> > command line. It isn't a required argument... but we can use
it to
> > >> speed
> > >> > up the checking of files.
> > >> >
> > >> > Based on the path, I'm guessing you're running on theia, to
which I
> > have
> > >> > access. If you send me the path to where you're trying to
run, I
> > could
> > >> try
> > >> > to find a regular expression that'd work for you.
> > >> >
> > >> > Thanks,
> > >> > John
> > >> >
> > >> > On Mon, Jan 30, 2017 at 2:02 PM, Andrew Kren - NOAA Affiliate
via
> RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > >
> > >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971 >
> > >> > >
> > >> > > Hi John,
> > >> > >
> > >> > > I removed the expression but now it is just hanging there
and not
> > >> doing
> > >> > > anything. I assume its because I didn't list the file name
> > convention.
> > >> > How
> > >> > > would I do that if I remove the -pcprx?
> > >> > >
> > >> > > Thanks,
> > >> > >
> > >> > > On Tue, Jan 24, 2017 at 1:20 PM, John Halley Gotway via RT
<
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > > > Andrew,
> > >> > > >
> > >> > > > Please try removing the "-pcprx pgbq*.gfs*2016022118"
option
> and
> > >> > running
> > >> > > > again. The star '*' you're using is a wildcard on the
command
> > line
> > >> but
> > >> > > not
> > >> > > > part of a regular expression.
> > >> > > >
> > >> > > > Try to get it working without the "-pcprx" option... and
once
> > that's
> > >> > > done,
> > >> > > > you could figure out how to add it back in.
> > >> > > >
> > >> > > > If/when you get there, I'd try...
> > >> > > > -pcprx pgbq[0-9]+.gfs.2016022118
> > >> > > >
> > >> > > > Thanks,
> > >> > > > John
> > >> > > >
> > >> > > > On Fri, Jan 20, 2017 at 10:07 AM, Andrew Kren - NOAA
Affiliate
> via
> > >> RT <
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > >
> > >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=78971
> >
> > >> > > > >
> > >> > > > > I noticed I should not have included the \ things. I
redid the
> > >> > > expression
> > >> > > > > but got this error:
> > >> > > > >
> > >> > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine -sum
> 20160221_18
> > 06
> > >> > > > > 20160222_18 24 gfs_APCP_24_20160221_18_F00_F24.nc
-pcprx
> > >> > > > > "pgbq*.gfs.2016022118 <(201)%20602-2118>"
> > >> > > > >
> > >> > > > > ERROR :
> > >> > > > >
> > >> > > > > ERROR : sum_data_files() -> Cannot find a file with a
valid
> > time
> > >> of
> > >> > > > > 20160222_180000 and accumulation time of 030000
matching the
> > >> regular
> > >> > > > > expression "pgbq*.gfs.2016022118 <(201)%20602-2118>"
> > >> > > > >
> > >> > > > > ERROR :
> > >> > > > >
> > >> > > > >
> > >> > > > > On Fri, Jan 20, 2017 at 9:46 AM, Andrew Kren - NOAA
Affiliate
> <
> > >> > > > > andrew.kren at noaa.gov> wrote:
> > >> > > > >
> > >> > > > > > John,
> > >> > > > > >
> > >> > > > > > I finally got time to try out your MET example on my
GFS
> > >> output. My
> > >> > > GFS
> > >> > > > > > output has the format of pgbqff.gfs.2016022118
> > >> <(201)%20602-2118>,
> > >> > > > where
> > >> > > > > > the ff stands for the forecast hours, 0 to 384, and
the date
> > >> > > > corresponds
> > >> > > > > to
> > >> > > > > > the init date of the GFS run.
> > >> > > > > >
> > >> > > > > > I used this command in my directory where the files
were and
> > it
> > >> did
> > >> > > not
> > >> > > > > > work:
> > >> > > > > >
> > >> > > > > > /scratch4/BMC/dtc/MET/met-5.1/bin/pcp_combine \ -sum
> > >> 20160221_18
> > >> > 06
> > >> > > > > > 20160222_18 24 \ gfs_APCP_24_20160221_18_F00_F24.nc \
> -pcprx
> > >> > > > > > "pgbq*.gfs*2016022118 <(201)%20602-2118>" \ -pcpdir .
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Am I doing something wrong?
> > >> > > > > >
> > >> > > > > > On Thu, Dec 22, 2016 at 4:11 PM, John Halley Gotway
via RT <
> > >> > > > > > met_help at ucar.edu> wrote:
> > >> > > > > >
> > >> > > > > >> Andrew,
> > >> > > > > >>
> > >> > > > > >> It's basically the same. The only difference is
that you
> > >> specify
> > >> > > the
> > >> > > > > >> initialization time using all 0's. Usually
pcp_combine
> > >> requires
> > >> > > that
> > >> > > > > the
> > >> > > > > >> initialization time stays constant since you
generally
> > wouldn't
> > >> > want
> > >> > > > to
> > >> > > > > >> mix
> > >> > > > > >> data from different model initializations.
> > >> > > > > >>
> > >> > > > > >> Here's some sample commands to grab some StageIV
data,
> unzip
> > >> it,
> > >> > and
> > >> > > > run
> > >> > > > > >> pcp_combine on it:
> > >> > > > > >>
> > >> > > > > >> mkdir test_st4
> > >> > > > > >> cd test_st4
> > >> > > > > >> wget
> > >> > > > > >>
ftp://ftp.emc.ncep.noaa.gov/mmb/precip/st2n4.arch/201610/
> ST4
> > >> > > > > >> .20161015ST4.20161015
> > >> > > > > >> tar -xvf ST4.20161015
> > >> > > > > >> gunzip ST4*.06h.gz
> > >> > > > > >>
> > >> > > > > >> # Add 2 files together
> > >> > > > > >> met-5.2/bin/pcp_combine -add ST4.2016101512
> > <(201)%20610-1512>.06h
> > >> 06 ST4.2016101518 <(201)%20610-1518>
> > >> > > > > >> <(201)%20610-1518>.06h 06
> > >> > > > > >> ST4.2016101518.APCP_12.nc
> > >> > > > > >>
> > >> > > > > >> # Use the sum command instead
> > >> > > > > >> met-5.2/bin/pcp_combine -sum 00000000_000000 06
20161015_18
> > 12
> > >> > > > > >> ST4.2016101518.APCP_12_SUM.nc -pcprx "ST4.*.06h"
> > >> > > > > >>
> > >> > > > > >> Thanks,
> > >> > > > > >> John
> > >> > > > > >>
> > >> > > > > >>
> > >> > > > > >>
> > >> > > > > >> On Thu, Dec 22, 2016 at 3:15 PM, Andrew Kren - NOAA
> Affiliate
> > >> via
> > >> > > RT <
> > >> > > > > >> met_help at ucar.edu> wrote:
> > >> > > > > >>
> > >> > > > > >> >
> > >> > > > > >> > <URL: https://rt.rap.ucar.edu/rt/Tic
> > >> ket/Display.html?id=78971 >
> > >> > > > > >> >
> > >> > > > > >> > Could you show me an example for accumulating the
6hr
> > stage 4
> > >> > > data?
> > >> > > > Or
> > >> > > > > >> > would it be the same? Thanks so much!
> > >> > > > > >> >
> > >> > > > > >> > Andrew Kren
> > >> > > > > >> >
> > >> > > > > >> > From: John Halley Gotway via RT
> > >> > > > > >> > Sent: Thursday, December 22, 2016 1:53 PM
> > >> > > > > >> > To: andrew.kren at noaa.gov
> > >> > > > > >> > Subject: Re: [rt.rap.ucar.edu #78971] using pcp
combine
> on
> > >> GFS
> > >> > > grib
> > >> > > > > >> files
> > >> > > > > >> >
> > >> > > > > >> > Hello Andrew,
> > >> > > > > >> >
> > >> > > > > >> > I apologize for the delay in answering your
question.
> Many
> > >> of
> > >> > our
> > >> > > > > staff
> > >> > > > > >> > are out of the office over the holidays.
> > >> > > > > >> >
> > >> > > > > >> > I see that you have questions about running GFS
data
> > through
> > >> the
> > >> > > > > >> > pcp_combine tool. You'd like to use pcp_combine
to put
> GFS
> > >> into
> > >> > > > > 24-hour
> > >> > > > > >> > intervals for comparison against 24-hourly StageIV
> > >> > precipitation.
> > >> > > > > >> >
> > >> > > > > >> > However, be aware that the 24-hour StageIV data is
> defined
> > >> as an
> > >> > > > > >> > accumulation from 12Z on one day to 12Z on the
next day:
> > >> > > > > >> >
http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/
> > >> > > > > >> >
> > >> > > > > >> > Therefore, you can only use the 24-hour StageIV
data to
> > >> evaluate
> > >> > > 12Z
> > >> > > > > to
> > >> > > > > >> 12Z
> > >> > > > > >> > accumulations from your model. Alternatively, you
could
> > use
> > >> the
> > >> > > > > 6-hour
> > >> > > > > >> > StageIV accumulations to evaluate any 24 hour
> accumulation
> > >> from
> > >> > > your
> > >> > > > > >> > model. For the latter, you'd just need to run the
6-hour
> > >> > StageIV
> > >> > > > > files
> > >> > > > > >> > through pcp_combine to generate your desired 24-
hour
> > >> > accumulation.
> > >> > > > > >> >
> > >> > > > > >> > Let me go through an example. Run pcp_combine to
compute
> > >> > 24-hour
> > >> > > > > >> > accumulations for GFS. Let's suppose I'm
processing the
> > >> > 20150220
> > >> > > > 00Z
> > >> > > > > >> > initialization of GFS.
> > >> > > > > >> >
> > >> > > > > >> > met-5.2/bin/pcp_combine \
> > >> > > > > >> > -sum 20150220_00 06 20150221_00 24 \
> > >> > > > > >> > gfs_APCP_24_20150220_00_F00_F24.nc \
> > >> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > >> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > >> > > > > >> >
> > >> > > > > >> > Here I'm telling pcp_combine to look in the
> > >> > > /d1/SBU/GFS/model_data/
> > >> > > > > >> > 20150220
> > >> > > > > >> > directory at files which match this regular
expression
> > >> > > > > >> > "gfs_4_20150220_00.*grb2". That directory
contains data
> > for
> > >> 00,
> > >> > > 06,
> > >> > > > > 12,
> > >> > > > > >> > and 18 hour initializations, but the "-pcprx"
option
> > narrows
> > >> the
> > >> > > > > search
> > >> > > > > >> > down to the 00 hour initialization which makes it
run
> > faster.
> > >> > It
> > >> > > > > >> inspects
> > >> > > > > >> > all the matching files, looking for 6-hour APCP
data to
> sum
> > >> up
> > >> > to
> > >> > > a
> > >> > > > > >> 24-hour
> > >> > > > > >> > accumulation valid at 20150221_00. This results
in a
> > 24-hour
> > >> > > > > >> accumulation
> > >> > > > > >> > between forecast hours 0 and 24.
> > >> > > > > >> >
> > >> > > > > >> > The following command will compute the 24-hour
> accumulation
> > >> > > between
> > >> > > > > >> > forecast hours 12 and 36:
> > >> > > > > >> >
> > >> > > > > >> > met-5.2/bin/pcp_combine \
> > >> > > > > >> > -sum 20150220_00 06 20150221_12 24 \
> > >> > > > > >> > gfs_APCP_24_20150220_00_F12_F36.nc \
> > >> > > > > >> > -pcprx "gfs_4_20150220_00.*grb2" \
> > >> > > > > >> > -pcpdir /d1/SBU/GFS/model_data/20150220
> > >> > > > > >> >
> > >> > > > > >> > The "-sum" command is meant to make things easier
by
> > >> searching
> > >> > > your
> > >> > > > > >> > directory for you. But instead of using "-sum",
you
> could
> > >> use
> > >> > the
> > >> > > > > >> "-add"
> > >> > > > > >> > command and just explicitly list the 4 files from
which
> > you'd
> > >> > like
> > >> > > > to
> > >> > > > > >> > extract 6-hour APCP and add them up to 24. In my
> directory
> > >> > > > structure,
> > >> > > > > >> the
> > >> > > > > >> > previous "-sum" job could be rewritten with "-add"
like
> > this:
> > >> > > > > >> >
> > >> > > > > >> > cd /d1/SBU/GFS/model_data/20150220
> > >> > > > > >> > met-5.2/bin/pcp_combine -add \
> > >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > >> > 018.grb2
> > >> > > > 06 \
> > >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > >> > 024.grb2
> > >> > > > 06 \
> > >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > >> > 030.grb2
> > >> > > > 06 \
> > >> > > > > >> >
/d1/SBU/GFS/model_data/20150220/gfs_4_20150220_0000_
> > >> > 036.grb2
> > >> > > > 06 \
> > >> > > > > >> > gfs_APCP_24_20150220_00_F12_F36_add_option.nc
> > >> > > > > >> >
> > >> > > > > >> > Here I'm explicitly telling pcp_combine which
files to
> read
> > >> and
> > >> > > what
> > >> > > > > >> > accumulation interval (6 hours) to extract from
them.
> The
> > >> > > resulting
> > >> > > > > >> output
> > >> > > > > >> > should be identical to the output of the "-sum"
command.
> > >> > > > > >> >
> > >> > > > > >> > Hope that helps get you going.
> > >> > > > > >> >
> > >> > > > > >> > Just let me know what other issues or questions
arise.
> > >> > > > > >> >
> > >> > > > > >> > Thanks,
> > >> > > > > >> > John Halley Gotway
> > >> > > > > >> >
> > >> > > > > >> >
> > >> > > > > >> > On Thu, Dec 15, 2016 at 11:35 AM, Andrew Kren -
NOAA
> > >> Affiliate
> > >> > via
> > >> > > > RT
> > >> > > > > <
> > >> > > > > >> > met_help at ucar.edu> wrote:
> > >> > > > > >> >
> > >> > > > > >> > >
> > >> > > > > >> > > Thu Dec 15 11:35:19 2016: Request 78971 was
acted upon.
> > >> > > > > >> > > Transaction: Ticket created by
andrew.kren at noaa.gov
> > >> > > > > >> > > Queue: met_help
> > >> > > > > >> > > Subject: using pcp combine on GFS grib
files
> > >> > > > > >> > > Owner: Nobody
> > >> > > > > >> > > Requestors: andrew.kren at noaa.gov
> > >> > > > > >> > > Status: new
> > >> > > > > >> > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> > >> > > > > Ticket/Display.html?id=78971
> > >> > > > > >> >
> > >> > > > > >> > >
> > >> > > > > >> > >
> > >> > > > > >> > > Dear MET help,
> > >> > > > > >> > >
> > >> > > > > >> > > I am trying to use pcp_combine on GFS output
files,
> with
> > >> file
> > >> > > > naming
> > >> > > > > >> > > convention of pgbqFFF.gfs.YYYYMMDDHH, where FFF
is the
> > >> > forecast
> > >> > > > > hour.
> > >> > > > > >> The
> > >> > > > > >> > > GFS output is 6-hr accumulation, but I would
like to
> > >> generate
> > >> > a
> > >> > > > > netcdf
> > >> > > > > >> > file
> > >> > > > > >> > > with 24 hour accumulations for each gfs run,
where
> > >> YYYYMMDDHH
> > >> > > > > >> specifies
> > >> > > > > >> > the
> > >> > > > > >> > > initialization date of the GFS.
> > >> > > > > >> > >
> > >> > > > > >> > > As for observations, I have 24 hour accumulated
> > >> precipitation
> > >> > in
> > >> > > > > this
> > >> > > > > >> > file
> > >> > > > > >> > > format, already processed from NCAR.
> > >> > > > > >> > >
> > >> > > > > >> > > ST4.YYYYMMDDHH.24h
> > >> > > > > >> > >
> > >> > > > > >> > > I've looked up the syntax of pcp_combine but its
hard
> to
> > >> > depict
> > >> > > > how
> > >> > > > > >> to do
> > >> > > > > >> > > it. Would anyone be able to help me? My end goal
is to
> > then
> > >> > run
> > >> > > > this
> > >> > > > > >> > > through MET MODE to look at equitable threat
scores for
> > >> > various
> > >> > > > > precip
> > >> > > > > >> > > thresholds per 24 hours to see the forecast
impact of
> two
> > >> GFS
> > >> > > > > >> > experiments.
> > >> > > > > >> > >
> > >> > > > > >> > > Thank you so much,
> > >> > > > > >> > >
> > >> > > > > >> > > --
> > >> > > > > >> > > Andrew Kren, PhD
> > >> > > > > >> > > Research Scientist I, Global Observing Systems
Analysis
> > >> (GOSA)
> > >> > > > Group
> > >> > > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > > >> > > 325 Broadway, Boulder, CO 80305
> > >> > > > > >> > > (303) 497-5418
> > >> > > > > >> > >
> > >> > > > > >> > >
> > >> > > > > >> >
> > >> > > > > >> >
> > >> > > > > >> >
> > >> > > > > >> >
> > >> > > > > >>
> > >> > > > > >>
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > --
> > >> > > > > > Andrew Kren, PhD
> > >> > > > > > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> > >> > Group
> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > >> > > > > > (303) 497-5418
> > >> > > > > >
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > > > > --
> > >> > > > > Andrew Kren, PhD
> > >> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > >> Group
> > >> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > > 325 Broadway, Boulder, CO 80305
> > >> > > > > (303) 497-5418
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> > > --
> > >> > > Andrew Kren, PhD
> > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > 325 Broadway, Boulder, CO 80305
> > >> > > (303) 497-5418
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >>
> > >>
> > >> --
> > >> Andrew Kren, PhD
> > >> Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > >> NOAA ESRL Global Systems Division (Rm 3C515)
> > >> 325 Broadway, Boulder, CO 80305
> > >> (303) 497-5418
> > >>
> > >>
> > >
> >
> >
>
>
> --
> Andrew Kren, PhD
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>
------------------------------------------------
More information about the Met_help
mailing list