[Met_help] [rt.rap.ucar.edu #46648] History for Use of archived NAM forecasts in Point-Stat (UNCLASSIFIED)

Tue May 3 13:11:13 MDT 2011

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Classification: UNCLASSIFIED
Caveats: NONE

>From an earlier request I received the following advice from John Halley
Gotway regarding the use of archived NAM forecast files in Point-Stat:

"Acquiring archived data - both forecasts and observations - is always an
issue.  A good source of data is the NCAR CISL research data archive.
You'll likely have to fill out the free registration form to access this
site.  Dataset 335.0 contains NCEP model data:
   http://dss.ucar.edu/datasets/ds335.0/

Through that site, you can request access to NAM data going back to 2006.
Here's a link for the 2009 data:
   http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809

Please note that this data is in GRIB2 format.  And MET can currently only
read GRIB version 1.  If necessary, I'd suggest using the "cnvgrib" tool to
convert from GRIB2 to GRIB1.

Hope that helps.

John"

I obtained access to the site mentioned above and have downloaded the .tar
file for the date 20090326 (20090326_NAM12.tar)

On untarring the file, I found that it contains four GRIB2 files:

NAM_CONUS_12km_20090326_0000.grib2
NAM_CONUS_12km_20090326_0600.grib2
NAM_CONUS_12km_20090326_1200.grib2
NAM_CONUS_12km_20090326_1800.grib2

I only need the file for the 0600GMT base time (second one from the top of
the list), so I deleted the others.

I used the "cnvgrib" tool to successfully convert it to GRIB1. 

I used "wgrib" to inspect the file contents and found that it contains NAM
model output for the date 20090326 for all my desired met variables, at all
my desired levels and for all forecast valid times from 00 (anl) to 84
hours. The NAM has 3-hourly valid times (00, 03, 06, ...83).

I run Point-Stat so that it reads individual GRIB1 files for each of the
forecast valid times along with the corresponding hourly netcdf observation
files by using a loop in my script, but I don't think this is going to work
for this situation where one forecast GRIB1 file contains all valid times.

How can I get Point-Stat results for each available forecast valid time from
the one GRIB1 file?

Thanks.

John

Mr John W. Raby, Meteorologist
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
(575) 678-2004 DSN 258-2004
FAX (575) 678-1230 DSN 258-1230
Email: john.raby at us.army.mil

Classification: UNCLASSIFIED
Caveats: NONE

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Re: [rt.rap.ucar.edu #46648] Use of archived NAM forecasts in Point-Stat (UNCLASSIFIED)
From: Paul Oldenburg
Time: Tue May 03 10:56:00 2011

John,

Check the command line usage statement for point_stat by running it
with no arguments.  Use the following option to
specify the valid time in the model data file that you want:

    "-fcst_valid time" in YYYYMMDD[_HH[MMSS]] format sets the forecast
valid time to be verified (optional).

Paul

On 05/03/2011 10:53 AM, RAL HelpDesk {for Raby, John} wrote:
>
> Tue May 03 10:53:06 2011: Request 46648 was acted upon.
> Transaction: Ticket created by john.raby at us.army.mil
>        Queue: met_help
>      Subject: Use of archived NAM forecasts in Point-Stat
(UNCLASSIFIED)
>        Owner: Nobody
>   Requestors: john.raby at us.army.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46648 >
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>>From an earlier request I received the following advice from John
Halley
> Gotway regarding the use of archived NAM forecast files in Point-
Stat:
>
> "Acquiring archived data - both forecasts and observations - is
always an
> issue.  A good source of data is the NCAR CISL research data
archive.
> You'll likely have to fill out the free registration form to access
this
> site.  Dataset 335.0 contains NCEP model data:
>    http://dss.ucar.edu/datasets/ds335.0/
>
> Through that site, you can request access to NAM data going back to
2006.
> Here's a link for the 2009 data:
>    http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
>
> Please note that this data is in GRIB2 format.  And MET can
currently only
> read GRIB version 1.  If necessary, I'd suggest using the "cnvgrib"
tool to
> convert from GRIB2 to GRIB1.
>
> Hope that helps.
>
> John"
>
> I obtained access to the site mentioned above and have downloaded
the .tar
> file for the date 20090326 (20090326_NAM12.tar)
>
> On untarring the file, I found that it contains four GRIB2 files:
>
> NAM_CONUS_12km_20090326_0000.grib2
> NAM_CONUS_12km_20090326_0600.grib2
> NAM_CONUS_12km_20090326_1200.grib2
> NAM_CONUS_12km_20090326_1800.grib2
>
> I only need the file for the 0600GMT base time (second one from the
top of
> the list), so I deleted the others.
>
> I used the "cnvgrib" tool to successfully convert it to GRIB1.
>
> I used "wgrib" to inspect the file contents and found that it
contains NAM
> model output for the date 20090326 for all my desired met variables,
at all
> my desired levels and for all forecast valid times from 00 (anl) to
84
> hours. The NAM has 3-hourly valid times (00, 03, 06, ...83).
>
> I run Point-Stat so that it reads individual GRIB1 files for each of
the
> forecast valid times along with the corresponding hourly netcdf
observation
> files by using a loop in my script, but I don't think this is going
to work
> for this situation where one forecast GRIB1 file contains all valid
times.
>
> How can I get Point-Stat results for each available forecast valid
time from
> the one GRIB1 file?
>
> Thanks.
>
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.raby at us.army.mil
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>

------------------------------------------------
Subject: Use of archived NAM forecasts in Point-Stat (UNCLASSIFIED)
From: Raby, John
Time: Tue May 03 11:21:55 2011

Classification: UNCLASSIFIED
Caveats: NONE

Hi Paul -

I just ran point_stat and found the options listed, but what I see is
something slightly different.

I provides for the following options:

-valid_beg time in YYYYMMDD[_HH[MMSS]] (beginning of matching time
window)
-valid_end time in YYYYMMDD[_HH[MMSS]] (end of matching time window)

Will this work the same way? If I want Point-Stat results for hours
00, 03,
06, 09, 12, 15, 18, 21, 24 do I start with the beg time of
20090326_060000 and
end with 20090327_060000?

Thanks.
John

-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Tuesday, May 03, 2011 10:56 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Brown, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46648] Use of archived NAM forecasts in
Point-Stat (UNCLASSIFIED)

John,

Check the command line usage statement for point_stat by running it
with no
arguments.  Use the following option to specify the valid time in the
model
data file that you want:

    "-fcst_valid time" in YYYYMMDD[_HH[MMSS]] format sets the forecast
valid
time to be verified (optional).

Paul

On 05/03/2011 10:53 AM, RAL HelpDesk {for Raby, John} wrote:
>
> Tue May 03 10:53:06 2011: Request 46648 was acted upon.
> Transaction: Ticket created by john.raby at us.army.mil
>        Queue: met_help
>      Subject: Use of archived NAM forecasts in Point-Stat
(UNCLASSIFIED)
>        Owner: Nobody
>   Requestors: john.raby at us.army.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46648
> >
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>>From an earlier request I received the following advice from John
>>Halley
> Gotway regarding the use of archived NAM forecast files in Point-
Stat:
>
> "Acquiring archived data - both forecasts and observations - is
always
> an issue.  A good source of data is the NCAR CISL research data
archive.
> You'll likely have to fill out the free registration form to access
> this site.  Dataset 335.0 contains NCEP model data:
>    http://dss.ucar.edu/datasets/ds335.0/
>
> Through that site, you can request access to NAM data going back to
2006.
> Here's a link for the 2009 data:
>    http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
>
> Please note that this data is in GRIB2 format.  And MET can
currently
> only read GRIB version 1.  If necessary, I'd suggest using the
> "cnvgrib" tool to convert from GRIB2 to GRIB1.
>
> Hope that helps.
>
> John"
>
> I obtained access to the site mentioned above and have downloaded
the
> .tar file for the date 20090326 (20090326_NAM12.tar)
>
> On untarring the file, I found that it contains four GRIB2 files:
>
> NAM_CONUS_12km_20090326_0000.grib2
> NAM_CONUS_12km_20090326_0600.grib2
> NAM_CONUS_12km_20090326_1200.grib2
> NAM_CONUS_12km_20090326_1800.grib2
>
> I only need the file for the 0600GMT base time (second one from the
> top of the list), so I deleted the others.
>
> I used the "cnvgrib" tool to successfully convert it to GRIB1.
>
> I used "wgrib" to inspect the file contents and found that it
contains
> NAM model output for the date 20090326 for all my desired met
> variables, at all my desired levels and for all forecast valid times
> from 00 (anl) to 84 hours. The NAM has 3-hourly valid times (00, 03,
06,
> ...83).
>
> I run Point-Stat so that it reads individual GRIB1 files for each of
> the forecast valid times along with the corresponding hourly netcdf
> observation files by using a loop in my script, but I don't think
this
> is going to work for this situation where one forecast GRIB1 file
contains
> all valid times.
>
> How can I get Point-Stat results for each available forecast valid
> time from the one GRIB1 file?
>
> Thanks.
>
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.raby at us.army.mil
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>

Classification: UNCLASSIFIED
Caveats: NONE

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46648] Use of archived NAM forecasts in Point-Stat (UNCLASSIFIED)
From: Paul Oldenburg
Time: Tue May 03 11:28:21 2011

John,

I see you are running METv2.0.  In any case, point_stat must be called
once for each valid time that you want to verify.
 Thus, you will need to make the following 9 calls:

point_stat ... -valid_beg 20090326_000000 -valid_end 20090326_000000
...
point_stat ... -valid_beg 20090326_030000 -valid_end 20090326_030000
...
...
point_stat ... -valid_beg 20090326_210000 -valid_end 20090326_210000
...
point_stat ... -valid_beg 20090327_000000 -valid_end 20090327_000000
...

Paul

On 05/03/2011 11:21 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46648 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Hi Paul -
>
> I just ran point_stat and found the options listed, but what I see
is
> something slightly different.
>
> I provides for the following options:
>
> -valid_beg time in YYYYMMDD[_HH[MMSS]] (beginning of matching time
window)
> -valid_end time in YYYYMMDD[_HH[MMSS]] (end of matching time window)
>
> Will this work the same way? If I want Point-Stat results for hours
00, 03,
> 06, 09, 12, 15, 18, 21, 24 do I start with the beg time of
20090326_060000 and
> end with 20090327_060000?
>
> Thanks.
> John
>
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Tuesday, May 03, 2011 10:56 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Brown, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46648] Use of archived NAM forecasts
in
> Point-Stat (UNCLASSIFIED)
>
> John,
>
> Check the command line usage statement for point_stat by running it
with no
> arguments.  Use the following option to specify the valid time in
the model
> data file that you want:
>
>     "-fcst_valid time" in YYYYMMDD[_HH[MMSS]] format sets the
forecast valid
> time to be verified (optional).
>
> Paul
>
>
> On 05/03/2011 10:53 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> Tue May 03 10:53:06 2011: Request 46648 was acted upon.
>> Transaction: Ticket created by john.raby at us.army.mil
>>        Queue: met_help
>>      Subject: Use of archived NAM forecasts in Point-Stat
(UNCLASSIFIED)
>>        Owner: Nobody
>>   Requestors: john.raby at us.army.mil
>>       Status: new
>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46648
>>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> >From an earlier request I received the following advice from John
>>> Halley
>> Gotway regarding the use of archived NAM forecast files in Point-
Stat:
>>
>> "Acquiring archived data - both forecasts and observations - is
always
>> an issue.  A good source of data is the NCAR CISL research data
archive.
>> You'll likely have to fill out the free registration form to access
>> this site.  Dataset 335.0 contains NCEP model data:
>>    http://dss.ucar.edu/datasets/ds335.0/
>>
>> Through that site, you can request access to NAM data going back to
2006.
>> Here's a link for the 2009 data:
>>    http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
>>
>> Please note that this data is in GRIB2 format.  And MET can
currently
>> only read GRIB version 1.  If necessary, I'd suggest using the
>> "cnvgrib" tool to convert from GRIB2 to GRIB1.
>>
>> Hope that helps.
>>
>> John"
>>
>> I obtained access to the site mentioned above and have downloaded
the
>> .tar file for the date 20090326 (20090326_NAM12.tar)
>>
>> On untarring the file, I found that it contains four GRIB2 files:
>>
>> NAM_CONUS_12km_20090326_0000.grib2
>> NAM_CONUS_12km_20090326_0600.grib2
>> NAM_CONUS_12km_20090326_1200.grib2
>> NAM_CONUS_12km_20090326_1800.grib2
>>
>> I only need the file for the 0600GMT base time (second one from the
>> top of the list), so I deleted the others.
>>
>> I used the "cnvgrib" tool to successfully convert it to GRIB1.
>>
>> I used "wgrib" to inspect the file contents and found that it
contains
>> NAM model output for the date 20090326 for all my desired met
>> variables, at all my desired levels and for all forecast valid
times
>> from 00 (anl) to 84 hours. The NAM has 3-hourly valid times (00,
03, 06,
>> ...83).
>>
>> I run Point-Stat so that it reads individual GRIB1 files for each
of
>> the forecast valid times along with the corresponding hourly netcdf
>> observation files by using a loop in my script, but I don't think
this
>> is going to work for this situation where one forecast GRIB1 file
contains
>> all valid times.
>>
>> How can I get Point-Stat results for each available forecast valid
>> time from the one GRIB1 file?
>>
>> Thanks.
>>
>> John
>>
>> Mr John W. Raby, Meteorologist
>> U.S. Army Research Laboratory
>> White Sands Missile Range, NM 88002
>> (575) 678-2004 DSN 258-2004
>> FAX (575) 678-1230 DSN 258-1230
>> Email: john.raby at us.army.mil
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>

------------------------------------------------
Subject: Use of archived NAM forecasts in Point-Stat (UNCLASSIFIED)
From: Raby, John
Time: Tue May 03 13:04:47 2011

Classification: UNCLASSIFIED
Caveats: NONE

Paul -

Thanks. This clears up how that works.
R/
John

-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Tuesday, May 03, 2011 11:28 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Brown, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46648] Use of archived NAM forecasts in
Point-Stat (UNCLASSIFIED)

John,

I see you are running METv2.0.  In any case, point_stat must be called
once
for each valid time that you want to verify.
 Thus, you will need to make the following 9 calls:

point_stat ... -valid_beg 20090326_000000 -valid_end 20090326_000000
...
point_stat ... -valid_beg 20090326_030000 -valid_end 20090326_030000
...
...
point_stat ... -valid_beg 20090326_210000 -valid_end 20090326_210000
...
point_stat ... -valid_beg 20090327_000000 -valid_end 20090327_000000
...

Paul

On 05/03/2011 11:21 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46648 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Hi Paul -
>
> I just ran point_stat and found the options listed, but what I see
is
> something slightly different.
>
> I provides for the following options:
>
> -valid_beg time in YYYYMMDD[_HH[MMSS]] (beginning of matching time
> window) -valid_end time in YYYYMMDD[_HH[MMSS]] (end of matching time
> window)
>
> Will this work the same way? If I want Point-Stat results for hours
> 00, 03, 06, 09, 12, 15, 18, 21, 24 do I start with the beg time of
> 20090326_060000 and end with 20090327_060000?
>
> Thanks.
> John
>
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Tuesday, May 03, 2011 10:56 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Brown, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46648] Use of archived NAM forecasts
in
> Point-Stat (UNCLASSIFIED)
>
> John,
>
> Check the command line usage statement for point_stat by running it
> with no arguments.  Use the following option to specify the valid
time
> in the model data file that you want:
>
>     "-fcst_valid time" in YYYYMMDD[_HH[MMSS]] format sets the
forecast
> valid time to be verified (optional).
>
> Paul
>
>
> On 05/03/2011 10:53 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> Tue May 03 10:53:06 2011: Request 46648 was acted upon.
>> Transaction: Ticket created by john.raby at us.army.mil
>>        Queue: met_help
>>      Subject: Use of archived NAM forecasts in Point-Stat
(UNCLASSIFIED)
>>        Owner: Nobody
>>   Requestors: john.raby at us.army.mil
>>       Status: new
>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46648
>>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> >From an earlier request I received the following advice from John
>>> Halley
>> Gotway regarding the use of archived NAM forecast files in Point-
Stat:
>>
>> "Acquiring archived data - both forecasts and observations - is
>> always an issue.  A good source of data is the NCAR CISL research
data
>> archive.
>> You'll likely have to fill out the free registration form to access
>> this site.  Dataset 335.0 contains NCEP model data:
>>    http://dss.ucar.edu/datasets/ds335.0/
>>
>> Through that site, you can request access to NAM data going back to
2006.
>> Here's a link for the 2009 data:
>>    http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
>>
>> Please note that this data is in GRIB2 format.  And MET can
currently
>> only read GRIB version 1.  If necessary, I'd suggest using the
>> "cnvgrib" tool to convert from GRIB2 to GRIB1.
>>
>> Hope that helps.
>>
>> John"
>>
>> I obtained access to the site mentioned above and have downloaded
the
>> .tar file for the date 20090326 (20090326_NAM12.tar)
>>
>> On untarring the file, I found that it contains four GRIB2 files:
>>
>> NAM_CONUS_12km_20090326_0000.grib2
>> NAM_CONUS_12km_20090326_0600.grib2
>> NAM_CONUS_12km_20090326_1200.grib2
>> NAM_CONUS_12km_20090326_1800.grib2
>>
>> I only need the file for the 0600GMT base time (second one from the
>> top of the list), so I deleted the others.
>>
>> I used the "cnvgrib" tool to successfully convert it to GRIB1.
>>
>> I used "wgrib" to inspect the file contents and found that it
>> contains NAM model output for the date 20090326 for all my desired
>> met variables, at all my desired levels and for all forecast valid
>> times from 00 (anl) to 84 hours. The NAM has 3-hourly valid times
>> (00, 03, 06, ...83).
>>
>> I run Point-Stat so that it reads individual GRIB1 files for each
of
>> the forecast valid times along with the corresponding hourly netcdf
>> observation files by using a loop in my script, but I don't think
>> this is going to work for this situation where one forecast GRIB1
>> file contains all valid times.
>>
>> How can I get Point-Stat results for each available forecast valid
>> time from the one GRIB1 file?
>>
>> Thanks.
>>
>> John
>>
>> Mr John W. Raby, Meteorologist
>> U.S. Army Research Laboratory
>> White Sands Missile Range, NM 88002
>> (575) 678-2004 DSN 258-2004
>> FAX (575) 678-1230 DSN 258-1230
>> Email: john.raby at us.army.mil
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>

Classification: UNCLASSIFIED
Caveats: NONE

------------------------------------------------