[Met_help] [rt.rap.ucar.edu #46262] History for Use of NAM output in MET (UNCLASSIFIED)
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Tue Apr 26 11:09:15 MDT 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Classification: UNCLASSIFIED
Caveats: NONE
I receive NAM model output in grib format from the following site:
http://nomads.ncdc.noaa.gov/data/meso-eta-hi/201104/20110410/
Can I input these files (nam_218_20110410_0000_000.grb) into MET Point-Stat?
Thanks.
John
Mr John W. Raby, Meteorologist
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
(575) 678-2004 DSN 258-2004
FAX (575) 678-1230 DSN 258-1230
Email: john.raby at us.army.mil
Classification: UNCLASSIFIED
Caveats: NONE
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Use of NAM output in MET (UNCLASSIFIED)
From: John Halley Gotway
Time: Tue Apr 19 11:12:04 2011
John,
I don't see any reason why you couldn't. Go ahead and try running
that NAM data in GRIB format using Point-Stat, and let us know if you
run into any problems.
Thanks,
John
On 04/19/2011 10:53 AM, RAL HelpDesk {for Raby, John} wrote:
>
> Tue Apr 19 10:53:58 2011: Request 46262 was acted upon.
> Transaction: Ticket created by john.raby at us.army.mil
> Queue: met_help
> Subject: Use of NAM output in MET (UNCLASSIFIED)
> Owner: Nobody
> Requestors: john.raby at us.army.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> I receive NAM model output in grib format from the following site:
>
> http://nomads.ncdc.noaa.gov/data/meso-eta-hi/201104/20110410/
>
> Can I input these files (nam_218_20110410_0000_000.grb) into MET
Point-Stat?
>
>
> Thanks.
>
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.raby at us.army.mil
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Fri Apr 22 07:43:49 2011
Classification: UNCLASSIFIED
Caveats: NONE
John -
I set up our system to run Point-Stat with the NAM GRIB files.
The NAM files have 8 forecast valid times: 00,03,06,09,12,15,18,21,24
and are
named WRFPRS_d01.00 -> WRFPRSd01.24 respectively.
I've attached my config file and the Point-Stat event log for ref.
My Point-Stat script attempts to process every forecast hour 00-24
rather than
every 3 hours since we normally have WRF output for all 24 hours as
well as
hourly observations from 2 separate files. This results in regular
occurring
statements in the log to the effect: "can't open..."
In the config file I specify 56 different levels/fields to be
verified.
>From the log file, it starts out with hour 00 and finds forecast
levels for
each level/field combination in the order specified in the config
file. It
starts with TMP, then goes to HGT and so on until it gets to the first
level/field combination for DPT (GRIB code 17) and then has an ERROR
as
follows:
ERROR: process_grib_codes() -> no records matching GRIB code 17 with
level
indicator of P225-100 found in GRIB file:
../MET_WRFpostprd/20100617/WRFPRS_d01.00
It then terminates any further searching for forecast levels
altogether and
then starts searching in hours 01 and 02 where it reports the "can't
open"
problem.
It start searching in hour 03 and repeats the findings described above
for
hour 00.
This continues for all the remaining hours and finally Point-Stat ends
with no
results.
Is this problem caused by an incomplete forecast data set? If not, can
you
debug this to determine the problem?
Thanks.
R/
John
Mr John W. Raby, Meteorologist
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
(575) 678-2004 DSN 258-2004
FAX (575) 678-1230 DSN 258-1230
Email: john.raby at us.army.mil
-----Original Message-----
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent: Thursday, April 21, 2011 1:16 PM
To: Raby, John (Civ, ARL/CISD)
Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET
(UNCLASSIFIED)
According to our records, your request has been resolved. If you have
any
further questions or concerns, please respond to this message.
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: Paul Oldenburg
Time: Fri Apr 22 08:13:54 2011
John,
Can you please upload the script that calls point_stat a set of your
data to the MET help ftp site using the
instructions located here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
I have a couple of immediate suggestions:
1. Only call point_stat from your script on valid times for which you
have data
2. Start with a simple configuration to get it working and
incrementally add complexity until you are verifying all
cases that you are interested in
When your data is on the FTP site, please let me know.
Thanks,
Paul
On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> I set up our system to run Point-Stat with the NAM GRIB files.
>
> The NAM files have 8 forecast valid times:
00,03,06,09,12,15,18,21,24 and are
> named WRFPRS_d01.00 -> WRFPRSd01.24 respectively.
>
> I've attached my config file and the Point-Stat event log for ref.
>
> My Point-Stat script attempts to process every forecast hour 00-24
rather than
> every 3 hours since we normally have WRF output for all 24 hours as
well as
> hourly observations from 2 separate files. This results in regular
occurring
> statements in the log to the effect: "can't open..."
>
> In the config file I specify 56 different levels/fields to be
verified.
>
>>From the log file, it starts out with hour 00 and finds forecast
levels for
> each level/field combination in the order specified in the config
file. It
> starts with TMP, then goes to HGT and so on until it gets to the
first
> level/field combination for DPT (GRIB code 17) and then has an ERROR
as
> follows:
>
> ERROR: process_grib_codes() -> no records matching GRIB code 17 with
level
> indicator of P225-100 found in GRIB file:
> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>
> It then terminates any further searching for forecast levels
altogether and
> then starts searching in hours 01 and 02 where it reports the "can't
open"
> problem.
>
> It start searching in hour 03 and repeats the findings described
above for
> hour 00.
>
> This continues for all the remaining hours and finally Point-Stat
ends with no
> results.
>
> Is this problem caused by an incomplete forecast data set? If not,
can you
> debug this to determine the problem?
>
> Thanks.
>
> R/
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.raby at us.army.mil
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Thursday, April 21, 2011 1:16 PM
> To: Raby, John (Civ, ARL/CISD)
> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET
> (UNCLASSIFIED)
>
> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Fri Apr 22 10:08:19 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
I've uploaded the 2 scripts which run Point_Stat, 2 observation files
(netcdf), and 1 forecast file (WRFPRS_d01.00). There is another
forecast file
there which is for the wrong time and was put there by mistake.
The user input I used for the runs I tried is as follows:
Start_Date = 20100617
WRF run variation = control
Domain/resolution = m1o1
I use METV2.0
Thanks for your help.
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 8:14 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
Can you please upload the script that calls point_stat a set of your
data to
the MET help ftp site using the instructions located here:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
I have a couple of immediate suggestions:
1. Only call point_stat from your script on valid times for which you
have
data
2. Start with a simple configuration to get it working and
incrementally add
complexity until you are verifying all cases that you are interested
in
When your data is on the FTP site, please let me know.
Thanks,
Paul
On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> I set up our system to run Point-Stat with the NAM GRIB files.
>
> The NAM files have 8 forecast valid times:
00,03,06,09,12,15,18,21,24
> and are named WRFPRS_d01.00 -> WRFPRSd01.24 respectively.
>
> I've attached my config file and the Point-Stat event log for ref.
>
> My Point-Stat script attempts to process every forecast hour 00-24
> rather than every 3 hours since we normally have WRF output for all
24
> hours as well as hourly observations from 2 separate files. This
> results in regular occurring statements in the log to the effect:
"can't
> open..."
>
> In the config file I specify 56 different levels/fields to be
verified.
>
>>From the log file, it starts out with hour 00 and finds forecast
>>levels for
> each level/field combination in the order specified in the config
> file. It starts with TMP, then goes to HGT and so on until it gets
to
> the first level/field combination for DPT (GRIB code 17) and then
has
> an ERROR as
> follows:
>
> ERROR: process_grib_codes() -> no records matching GRIB code 17 with
> level indicator of P225-100 found in GRIB file:
> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>
> It then terminates any further searching for forecast levels
> altogether and then starts searching in hours 01 and 02 where it
reports the
> "can't open"
> problem.
>
> It start searching in hour 03 and repeats the findings described
above
> for hour 00.
>
> This continues for all the remaining hours and finally Point-Stat
ends
> with no results.
>
> Is this problem caused by an incomplete forecast data set? If not,
can
> you debug this to determine the problem?
>
> Thanks.
>
> R/
> John
>
> Mr John W. Raby, Meteorologist
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> (575) 678-2004 DSN 258-2004
> FAX (575) 678-1230 DSN 258-1230
> Email: john.raby at us.army.mil
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Thursday, April 21, 2011 1:16 PM
> To: Raby, John (Civ, ARL/CISD)
> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET
> (UNCLASSIFIED)
>
> According to our records, your request has been resolved. If you
have
> any further questions or concerns, please respond to this message.
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: Paul Oldenburg
Time: Fri Apr 22 10:31:38 2011
John,
The GRIB data that you sent me does not look right (see output below).
Can you please try tar'ing it and putting it on
the FTP site? Also, you may want to issue the command "binary" before
you issue the "put" command to put your FTP
client in binary mode.
More generally, point_stat may not be able to find DPT (GRIB code 17)
data in your GRIB file. One way to check that it
is present is to use wgrib like this:
$ wgrib WRFPRS_d01.00 | grep DPT
If that command returns nothing, then your GRIB file does not have any
DPT data in it.
Regarding the interval of verification, try replacing this line (line
81) in your run_PointStat_Passner.sh script:
for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19
20 21 22 23 24
with this:
for i in $(seq 0 3 24)
Paul
$ wgrib WRFPRS_d01.00
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:MSL:anl:NAve=0
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:MSL:anl:NAve=0
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:TimeU=1:2
m above gnd:anl:NAve=0
error, could not read to end of record 7
On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I've uploaded the 2 scripts which run Point_Stat, 2 observation
files
> (netcdf), and 1 forecast file (WRFPRS_d01.00). There is another
forecast file
> there which is for the wrong time and was put there by mistake.
>
> The user input I used for the runs I tried is as follows:
>
> Start_Date = 20100617
> WRF run variation = control
> Domain/resolution = m1o1
>
> I use METV2.0
>
> Thanks for your help.
>
> John
>
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 8:14 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> John,
>
> Can you please upload the script that calls point_stat a set of your
data to
> the MET help ftp site using the instructions located here:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> I have a couple of immediate suggestions:
>
> 1. Only call point_stat from your script on valid times for which
you have
> data
>
> 2. Start with a simple configuration to get it working and
incrementally add
> complexity until you are verifying all cases that you are interested
in
>
> When your data is on the FTP site, please let me know.
>
> Thanks,
>
> Paul
>
>
> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> I set up our system to run Point-Stat with the NAM GRIB files.
>>
>> The NAM files have 8 forecast valid times:
00,03,06,09,12,15,18,21,24
>> and are named WRFPRS_d01.00 -> WRFPRSd01.24 respectively.
>>
>> I've attached my config file and the Point-Stat event log for ref.
>>
>> My Point-Stat script attempts to process every forecast hour 00-24
>> rather than every 3 hours since we normally have WRF output for all
24
>> hours as well as hourly observations from 2 separate files. This
>> results in regular occurring statements in the log to the effect:
"can't
>> open..."
>>
>> In the config file I specify 56 different levels/fields to be
verified.
>>
>> >From the log file, it starts out with hour 00 and finds forecast
>>> levels for
>> each level/field combination in the order specified in the config
>> file. It starts with TMP, then goes to HGT and so on until it gets
to
>> the first level/field combination for DPT (GRIB code 17) and then
has
>> an ERROR as
>> follows:
>>
>> ERROR: process_grib_codes() -> no records matching GRIB code 17
with
>> level indicator of P225-100 found in GRIB file:
>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>
>> It then terminates any further searching for forecast levels
>> altogether and then starts searching in hours 01 and 02 where it
reports the
>> "can't open"
>> problem.
>>
>> It start searching in hour 03 and repeats the findings described
above
>> for hour 00.
>>
>> This continues for all the remaining hours and finally Point-Stat
ends
>> with no results.
>>
>> Is this problem caused by an incomplete forecast data set? If not,
can
>> you debug this to determine the problem?
>>
>> Thanks.
>>
>> R/
>> John
>>
>> Mr John W. Raby, Meteorologist
>> U.S. Army Research Laboratory
>> White Sands Missile Range, NM 88002
>> (575) 678-2004 DSN 258-2004
>> FAX (575) 678-1230 DSN 258-1230
>> Email: john.raby at us.army.mil
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Sent: Thursday, April 21, 2011 1:16 PM
>> To: Raby, John (Civ, ARL/CISD)
>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
>> (UNCLASSIFIED)
>>
>> According to our records, your request has been resolved. If you
have
>> any further questions or concerns, please respond to this message.
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Fri Apr 22 10:59:43 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
Thanks for your suggestions. I'll be working to give them a try.
I was not able to upload an archive.tar file I created using the
command:
tar -cf archive.tar WRFPRS_d01.00
I specified binary as you mentioned before the put command. The system
replied
"Type set to I"
Error after put command: "Permission denied on server. (UPLOAD)"
Do you have any suggestions on how to resolve this?
Thanks.
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 10:32 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
The GRIB data that you sent me does not look right (see output below).
Can
you please try tar'ing it and putting it on the FTP site? Also, you
may want
to issue the command "binary" before you issue the "put" command to
put your
FTP client in binary mode.
More generally, point_stat may not be able to find DPT (GRIB code 17)
data in
your GRIB file. One way to check that it is present is to use wgrib
like
this:
$ wgrib WRFPRS_d01.00 | grep DPT
If that command returns nothing, then your GRIB file does not have any
DPT
data in it.
Regarding the interval of verification, try replacing this line (line
81) in
your run_PointStat_Passner.sh script:
for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19
20 21 22
23 24
with this:
for i in $(seq 0 3 24)
Paul
$ wgrib WRFPRS_d01.00
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:MSL:anl:NAve=0
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:MSL:anl:NAve=0
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:TimeU=1:2
m
above gnd:anl:NAve=0 error, could not read to end of record 7
On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I've uploaded the 2 scripts which run Point_Stat, 2 observation
files
> (netcdf), and 1 forecast file (WRFPRS_d01.00). There is another
> forecast file there which is for the wrong time and was put there by
> mistake.
>
> The user input I used for the runs I tried is as follows:
>
> Start_Date = 20100617
> WRF run variation = control
> Domain/resolution = m1o1
>
> I use METV2.0
>
> Thanks for your help.
>
> John
>
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 8:14 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> John,
>
> Can you please upload the script that calls point_stat a set of your
> data to the MET help ftp site using the instructions located here:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> I have a couple of immediate suggestions:
>
> 1. Only call point_stat from your script on valid times for which
you
> have data
>
> 2. Start with a simple configuration to get it working and
> incrementally add complexity until you are verifying all cases that
> you are interested in
>
> When your data is on the FTP site, please let me know.
>
> Thanks,
>
> Paul
>
>
> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> I set up our system to run Point-Stat with the NAM GRIB files.
>>
>> The NAM files have 8 forecast valid times:
00,03,06,09,12,15,18,21,24
>> and are named WRFPRS_d01.00 -> WRFPRSd01.24 respectively.
>>
>> I've attached my config file and the Point-Stat event log for ref.
>>
>> My Point-Stat script attempts to process every forecast hour 00-24
>> rather than every 3 hours since we normally have WRF output for all
>> 24 hours as well as hourly observations from 2 separate files. This
>> results in regular occurring statements in the log to the effect:
>> "can't open..."
>>
>> In the config file I specify 56 different levels/fields to be
verified.
>>
>> >From the log file, it starts out with hour 00 and finds forecast
>>> levels for
>> each level/field combination in the order specified in the config
>> file. It starts with TMP, then goes to HGT and so on until it gets
to
>> the first level/field combination for DPT (GRIB code 17) and then
has
>> an ERROR as
>> follows:
>>
>> ERROR: process_grib_codes() -> no records matching GRIB code 17
with
>> level indicator of P225-100 found in GRIB file:
>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>
>> It then terminates any further searching for forecast levels
>> altogether and then starts searching in hours 01 and 02 where it
>> reports the "can't open"
>> problem.
>>
>> It start searching in hour 03 and repeats the findings described
>> above for hour 00.
>>
>> This continues for all the remaining hours and finally Point-Stat
>> ends with no results.
>>
>> Is this problem caused by an incomplete forecast data set? If not,
>> can you debug this to determine the problem?
>>
>> Thanks.
>>
>> R/
>> John
>>
>> Mr John W. Raby, Meteorologist
>> U.S. Army Research Laboratory
>> White Sands Missile Range, NM 88002
>> (575) 678-2004 DSN 258-2004
>> FAX (575) 678-1230 DSN 258-1230
>> Email: john.raby at us.army.mil
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
>> [mailto:met_help at ucar.edu]
>> Sent: Thursday, April 21, 2011 1:16 PM
>> To: Raby, John (Civ, ARL/CISD)
>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
>> (UNCLASSIFIED)
>>
>> According to our records, your request has been resolved. If you
have
>> any further questions or concerns, please respond to this message.
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: Paul Oldenburg
Time: Fri Apr 22 11:06:17 2011
John,
Perhaps try to upload your archive.tar file without issuing the
"binary" command first. I'll take the permissions issue
up with our internal admins. Sorry for the trouble.
Paul
On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> Thanks for your suggestions. I'll be working to give them a try.
>
> I was not able to upload an archive.tar file I created using the
command:
> tar -cf archive.tar WRFPRS_d01.00
>
> I specified binary as you mentioned before the put command. The
system replied
> "Type set to I"
>
> Error after put command: "Permission denied on server. (UPLOAD)"
>
> Do you have any suggestions on how to resolve this?
>
> Thanks.
> John
>
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 10:32 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> John,
>
> The GRIB data that you sent me does not look right (see output
below). Can
> you please try tar'ing it and putting it on the FTP site? Also, you
may want
> to issue the command "binary" before you issue the "put" command to
put your
> FTP client in binary mode.
>
> More generally, point_stat may not be able to find DPT (GRIB code
17) data in
> your GRIB file. One way to check that it is present is to use wgrib
like
> this:
>
> $ wgrib WRFPRS_d01.00 | grep DPT
>
> If that command returns nothing, then your GRIB file does not have
any DPT
> data in it.
>
> Regarding the interval of verification, try replacing this line
(line 81) in
> your run_PointStat_Passner.sh script:
>
> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19
20 21 22
> 23 24
>
> with this:
>
> for i in $(seq 0 3 24)
>
>
> Paul
>
>
>
> $ wgrib WRFPRS_d01.00
>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:MSL:anl:NAve=0
>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:MSL:anl:NAve=0
>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=1:sfc:anl:NAve=0
>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:TimeU=1:2
m
> above gnd:anl:NAve=0 error, could not read to end of record 7
>
>
>
> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
files
>> (netcdf), and 1 forecast file (WRFPRS_d01.00). There is another
>> forecast file there which is for the wrong time and was put there
by
>> mistake.
>>
>> The user input I used for the runs I tried is as follows:
>>
>> Start_Date = 20100617
>> WRF run variation = control
>> Domain/resolution = m1o1
>>
>> I use METV2.0
>>
>> Thanks for your help.
>>
>> John
>>
>>
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 8:14 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Can you please upload the script that calls point_stat a set of
your
>> data to the MET help ftp site using the instructions located here:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> I have a couple of immediate suggestions:
>>
>> 1. Only call point_stat from your script on valid times for which
you
>> have data
>>
>> 2. Start with a simple configuration to get it working and
>> incrementally add complexity until you are verifying all cases that
>> you are interested in
>>
>> When your data is on the FTP site, please let me know.
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> John -
>>>
>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>
>>> The NAM files have 8 forecast valid times:
00,03,06,09,12,15,18,21,24
>>> and are named WRFPRS_d01.00 -> WRFPRSd01.24 respectively.
>>>
>>> I've attached my config file and the Point-Stat event log for ref.
>>>
>>> My Point-Stat script attempts to process every forecast hour 00-24
>>> rather than every 3 hours since we normally have WRF output for
all
>>> 24 hours as well as hourly observations from 2 separate files.
This
>>> results in regular occurring statements in the log to the effect:
>>> "can't open..."
>>>
>>> In the config file I specify 56 different levels/fields to be
verified.
>>>
>>> >From the log file, it starts out with hour 00 and finds forecast
>>>> levels for
>>> each level/field combination in the order specified in the config
>>> file. It starts with TMP, then goes to HGT and so on until it gets
to
>>> the first level/field combination for DPT (GRIB code 17) and then
has
>>> an ERROR as
>>> follows:
>>>
>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
with
>>> level indicator of P225-100 found in GRIB file:
>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>
>>> It then terminates any further searching for forecast levels
>>> altogether and then starts searching in hours 01 and 02 where it
>>> reports the "can't open"
>>> problem.
>>>
>>> It start searching in hour 03 and repeats the findings described
>>> above for hour 00.
>>>
>>> This continues for all the remaining hours and finally Point-Stat
>>> ends with no results.
>>>
>>> Is this problem caused by an incomplete forecast data set? If not,
>>> can you debug this to determine the problem?
>>>
>>> Thanks.
>>>
>>> R/
>>> John
>>>
>>> Mr John W. Raby, Meteorologist
>>> U.S. Army Research Laboratory
>>> White Sands Missile Range, NM 88002
>>> (575) 678-2004 DSN 258-2004
>>> FAX (575) 678-1230 DSN 258-1230
>>> Email: john.raby at us.army.mil
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for John Halley Gotway}
>>> [mailto:met_help at ucar.edu]
>>> Sent: Thursday, April 21, 2011 1:16 PM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
>>> (UNCLASSIFIED)
>>>
>>> According to our records, your request has been resolved. If you
have
>>> any further questions or concerns, please respond to this message.
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Fri Apr 22 11:18:34 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
I just tried another upload this time without the binary command, but
no
success. Same error statement.
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 11:06 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
Perhaps try to upload your archive.tar file without issuing the
"binary"
command first. I'll take the permissions issue up with our internal
admins.
Sorry for the trouble.
Paul
On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> Thanks for your suggestions. I'll be working to give them a try.
>
> I was not able to upload an archive.tar file I created using the
command:
> tar -cf archive.tar WRFPRS_d01.00
>
> I specified binary as you mentioned before the put command. The
system
> replied "Type set to I"
>
> Error after put command: "Permission denied on server. (UPLOAD)"
>
> Do you have any suggestions on how to resolve this?
>
> Thanks.
> John
>
>
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 10:32 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> John,
>
> The GRIB data that you sent me does not look right (see output
below).
> Can you please try tar'ing it and putting it on the FTP site? Also,
> you may want to issue the command "binary" before you issue the
"put"
> command to put your FTP client in binary mode.
>
> More generally, point_stat may not be able to find DPT (GRIB code
17)
> data in your GRIB file. One way to check that it is present is to
use
> wgrib like
> this:
>
> $ wgrib WRFPRS_d01.00 | grep DPT
>
> If that command returns nothing, then your GRIB file does not have
any
> DPT data in it.
>
> Regarding the interval of verification, try replacing this line
(line
> 81) in your run_PointStat_Passner.sh script:
>
> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19
> 20 21 22
> 23 24
>
> with this:
>
> for i in $(seq 0 3 24)
>
>
> Paul
>
>
>
> $ wgrib WRFPRS_d01.00
>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=
> 1:MSL:anl:NAve=0
>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Tim
> eU=1:MSL:anl:NAve=0
>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=
> 1:sfc:anl:NAve=0
>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=
> 1:sfc:anl:NAve=0
>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU
> =1:sfc:anl:NAve=0
>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:Tim
> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of record
7
>
>
>
> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
files
>> (netcdf), and 1 forecast file (WRFPRS_d01.00). There is another
>> forecast file there which is for the wrong time and was put there
by
>> mistake.
>>
>> The user input I used for the runs I tried is as follows:
>>
>> Start_Date = 20100617
>> WRF run variation = control
>> Domain/resolution = m1o1
>>
>> I use METV2.0
>>
>> Thanks for your help.
>>
>> John
>>
>>
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 8:14 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Can you please upload the script that calls point_stat a set of
your
>> data to the MET help ftp site using the instructions located here:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> I have a couple of immediate suggestions:
>>
>> 1. Only call point_stat from your script on valid times for which
>> you have data
>>
>> 2. Start with a simple configuration to get it working and
>> incrementally add complexity until you are verifying all cases that
>> you are interested in
>>
>> When your data is on the FTP site, please let me know.
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> John -
>>>
>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>
>>> The NAM files have 8 forecast valid times:
>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
WRFPRSd01.24
>>> respectively.
>>>
>>> I've attached my config file and the Point-Stat event log for ref.
>>>
>>> My Point-Stat script attempts to process every forecast hour 00-24
>>> rather than every 3 hours since we normally have WRF output for
all
>>> 24 hours as well as hourly observations from 2 separate files.
This
>>> results in regular occurring statements in the log to the effect:
>>> "can't open..."
>>>
>>> In the config file I specify 56 different levels/fields to be
verified.
>>>
>>> >From the log file, it starts out with hour 00 and finds forecast
>>>> levels for
>>> each level/field combination in the order specified in the config
>>> file. It starts with TMP, then goes to HGT and so on until it gets
>>> to the first level/field combination for DPT (GRIB code 17) and
then
>>> has an ERROR as
>>> follows:
>>>
>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
with
>>> level indicator of P225-100 found in GRIB file:
>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>
>>> It then terminates any further searching for forecast levels
>>> altogether and then starts searching in hours 01 and 02 where it
>>> reports the "can't open"
>>> problem.
>>>
>>> It start searching in hour 03 and repeats the findings described
>>> above for hour 00.
>>>
>>> This continues for all the remaining hours and finally Point-Stat
>>> ends with no results.
>>>
>>> Is this problem caused by an incomplete forecast data set? If not,
>>> can you debug this to determine the problem?
>>>
>>> Thanks.
>>>
>>> R/
>>> John
>>>
>>> Mr John W. Raby, Meteorologist
>>> U.S. Army Research Laboratory
>>> White Sands Missile Range, NM 88002
>>> (575) 678-2004 DSN 258-2004
>>> FAX (575) 678-1230 DSN 258-1230
>>> Email: john.raby at us.army.mil
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for John Halley Gotway}
>>> [mailto:met_help at ucar.edu]
>>> Sent: Thursday, April 21, 2011 1:16 PM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
>>> (UNCLASSIFIED)
>>>
>>> According to our records, your request has been resolved. If you
>>> have any further questions or concerns, please respond to this
message.
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: Paul Oldenburg
Time: Fri Apr 22 13:03:25 2011
John,
Our system administrator thinks that there should be no problem
uploading your file, archive.tar, to the folder
/incoming/irap/met_help/Raby_data on our FTP site. Are you sure that
you are using the -p option when you start your
FTP client, as specified in the directions I sent you? Here they are
again:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Otherwise, how large is archive.tar? If you gzip it, is it < 2MB? If
so, you can attach it to an email.
Were you able to try the wgrib command that I sent on your model data?
If so, do you see DPT there?
Paul
On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I just tried another upload this time without the binary command,
but no
> success. Same error statement.
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 11:06 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> John,
>
> Perhaps try to upload your archive.tar file without issuing the
"binary"
> command first. I'll take the permissions issue up with our internal
admins.
> Sorry for the trouble.
>
> Paul
>
>
> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> Thanks for your suggestions. I'll be working to give them a try.
>>
>> I was not able to upload an archive.tar file I created using the
command:
>> tar -cf archive.tar WRFPRS_d01.00
>>
>> I specified binary as you mentioned before the put command. The
system
>> replied "Type set to I"
>>
>> Error after put command: "Permission denied on server. (UPLOAD)"
>>
>> Do you have any suggestions on how to resolve this?
>>
>> Thanks.
>> John
>>
>>
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 10:32 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> The GRIB data that you sent me does not look right (see output
below).
>> Can you please try tar'ing it and putting it on the FTP site?
Also,
>> you may want to issue the command "binary" before you issue the
"put"
>> command to put your FTP client in binary mode.
>>
>> More generally, point_stat may not be able to find DPT (GRIB code
17)
>> data in your GRIB file. One way to check that it is present is to
use
>> wgrib like
>> this:
>>
>> $ wgrib WRFPRS_d01.00 | grep DPT
>>
>> If that command returns nothing, then your GRIB file does not have
any
>> DPT data in it.
>>
>> Regarding the interval of verification, try replacing this line
(line
>> 81) in your run_PointStat_Passner.sh script:
>>
>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
19
>> 20 21 22
>> 23 24
>>
>> with this:
>>
>> for i in $(seq 0 3 24)
>>
>>
>> Paul
>>
>>
>>
>> $ wgrib WRFPRS_d01.00
>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU=
>> 1:MSL:anl:NAve=0
>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Tim
>> eU=1:MSL:anl:NAve=0
>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=
>> 1:sfc:anl:NAve=0
>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU=
>> 1:sfc:anl:NAve=0
>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU
>> =1:sfc:anl:NAve=0
>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:Tim
>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
record 7
>>
>>
>>
>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
files
>>> (netcdf), and 1 forecast file (WRFPRS_d01.00). There is another
>>> forecast file there which is for the wrong time and was put there
by
>>> mistake.
>>>
>>> The user input I used for the runs I tried is as follows:
>>>
>>> Start_Date = 20100617
>>> WRF run variation = control
>>> Domain/resolution = m1o1
>>>
>>> I use METV2.0
>>>
>>> Thanks for your help.
>>>
>>> John
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 8:14 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> Can you please upload the script that calls point_stat a set of
your
>>> data to the MET help ftp site using the instructions located here:
>>>
>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>
>>> I have a couple of immediate suggestions:
>>>
>>> 1. Only call point_stat from your script on valid times for which
>>> you have data
>>>
>>> 2. Start with a simple configuration to get it working and
>>> incrementally add complexity until you are verifying all cases
that
>>> you are interested in
>>>
>>> When your data is on the FTP site, please let me know.
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> John -
>>>>
>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>
>>>> The NAM files have 8 forecast valid times:
>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
WRFPRSd01.24
>>>> respectively.
>>>>
>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>
>>>> My Point-Stat script attempts to process every forecast hour 00-
24
>>>> rather than every 3 hours since we normally have WRF output for
all
>>>> 24 hours as well as hourly observations from 2 separate files.
This
>>>> results in regular occurring statements in the log to the effect:
>>>> "can't open..."
>>>>
>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>
>>>> >From the log file, it starts out with hour 00 and finds forecast
>>>>> levels for
>>>> each level/field combination in the order specified in the config
>>>> file. It starts with TMP, then goes to HGT and so on until it
gets
>>>> to the first level/field combination for DPT (GRIB code 17) and
then
>>>> has an ERROR as
>>>> follows:
>>>>
>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
with
>>>> level indicator of P225-100 found in GRIB file:
>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>
>>>> It then terminates any further searching for forecast levels
>>>> altogether and then starts searching in hours 01 and 02 where it
>>>> reports the "can't open"
>>>> problem.
>>>>
>>>> It start searching in hour 03 and repeats the findings described
>>>> above for hour 00.
>>>>
>>>> This continues for all the remaining hours and finally Point-Stat
>>>> ends with no results.
>>>>
>>>> Is this problem caused by an incomplete forecast data set? If
not,
>>>> can you debug this to determine the problem?
>>>>
>>>> Thanks.
>>>>
>>>> R/
>>>> John
>>>>
>>>> Mr John W. Raby, Meteorologist
>>>> U.S. Army Research Laboratory
>>>> White Sands Missile Range, NM 88002
>>>> (575) 678-2004 DSN 258-2004
>>>> FAX (575) 678-1230 DSN 258-1230
>>>> Email: john.raby at us.army.mil
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>> [mailto:met_help at ucar.edu]
>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
>>>> (UNCLASSIFIED)
>>>>
>>>> According to our records, your request has been resolved. If you
>>>> have any further questions or concerns, please respond to this
message.
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Fri Apr 22 13:43:59 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
I checked the command I was using for the ftp client and it uses the
-p
option.
I used the wgrib command for each field I specify in the config file.
For DPT I received one line of response which indicated that the only
level is
2m above gnd
For the other fields:
HGT- all levels
RH - all levels
TMP - all levels
UGRD - all levels
VGRD - all levels
For PRMSL - one level
For WIND - no levels
The archive.tar file is 119 MB before gzip
After gzip it is 58 MB.
Should I try uploading the gzipped file? I had not tried this before.
I will be leaving the office at 2:00pm today, so I won't pick this up
again
until Monday.
Thanks for your help and I look forward to working with you next week.
BTW, I
learned a lot from your instructions!
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 1:03 PM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
Our system administrator thinks that there should be no problem
uploading your
file, archive.tar, to the folder /incoming/irap/met_help/Raby_data on
our FTP
site. Are you sure that you are using the -p option when you start
your FTP
client, as specified in the directions I sent you? Here they are
again:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
Otherwise, how large is archive.tar? If you gzip it, is it < 2MB? If
so, you
can attach it to an email.
Were you able to try the wgrib command that I sent on your model data?
If so,
do you see DPT there?
Paul
On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I just tried another upload this time without the binary command,
but
> no success. Same error statement.
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 11:06 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> John,
>
> Perhaps try to upload your archive.tar file without issuing the
"binary"
> command first. I'll take the permissions issue up with our internal
admins.
> Sorry for the trouble.
>
> Paul
>
>
> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> Thanks for your suggestions. I'll be working to give them a try.
>>
>> I was not able to upload an archive.tar file I created using the
command:
>> tar -cf archive.tar WRFPRS_d01.00
>>
>> I specified binary as you mentioned before the put command. The
>> system replied "Type set to I"
>>
>> Error after put command: "Permission denied on server. (UPLOAD)"
>>
>> Do you have any suggestions on how to resolve this?
>>
>> Thanks.
>> John
>>
>>
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 10:32 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> The GRIB data that you sent me does not look right (see output
below).
>> Can you please try tar'ing it and putting it on the FTP site?
Also,
>> you may want to issue the command "binary" before you issue the
"put"
>> command to put your FTP client in binary mode.
>>
>> More generally, point_stat may not be able to find DPT (GRIB code
17)
>> data in your GRIB file. One way to check that it is present is to
>> use wgrib like
>> this:
>>
>> $ wgrib WRFPRS_d01.00 | grep DPT
>>
>> If that command returns nothing, then your GRIB file does not have
>> any DPT data in it.
>>
>> Regarding the interval of verification, try replacing this line
(line
>> 81) in your run_PointStat_Passner.sh script:
>>
>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
19
>> 20 21 22
>> 23 24
>>
>> with this:
>>
>> for i in $(seq 0 3 24)
>>
>>
>> Paul
>>
>>
>>
>> $ wgrib WRFPRS_d01.00
>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU
>> =
>> 1:MSL:anl:NAve=0
>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Ti
>> m
>> eU=1:MSL:anl:NAve=0
>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU
>> =
>> 1:sfc:anl:NAve=0
>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU
>> =
>> 1:sfc:anl:NAve=0
>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>> U
>> =1:sfc:anl:NAve=0
>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:Ti
>> m
>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
record
>> 7
>>
>>
>>
>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
>>> files (netcdf), and 1 forecast file (WRFPRS_d01.00). There is
>>> another forecast file there which is for the wrong time and was
put
>>> there by mistake.
>>>
>>> The user input I used for the runs I tried is as follows:
>>>
>>> Start_Date = 20100617
>>> WRF run variation = control
>>> Domain/resolution = m1o1
>>>
>>> I use METV2.0
>>>
>>> Thanks for your help.
>>>
>>> John
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 8:14 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> Can you please upload the script that calls point_stat a set of
your
>>> data to the MET help ftp site using the instructions located here:
>>>
>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>
>>> I have a couple of immediate suggestions:
>>>
>>> 1. Only call point_stat from your script on valid times for which
>>> you have data
>>>
>>> 2. Start with a simple configuration to get it working and
>>> incrementally add complexity until you are verifying all cases
that
>>> you are interested in
>>>
>>> When your data is on the FTP site, please let me know.
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> John -
>>>>
>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>
>>>> The NAM files have 8 forecast valid times:
>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
>>>> WRFPRSd01.24 respectively.
>>>>
>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>
>>>> My Point-Stat script attempts to process every forecast hour 00-
24
>>>> rather than every 3 hours since we normally have WRF output for
all
>>>> 24 hours as well as hourly observations from 2 separate files.
This
>>>> results in regular occurring statements in the log to the effect:
>>>> "can't open..."
>>>>
>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>
>>>> >From the log file, it starts out with hour 00 and finds forecast
>>>>> levels for
>>>> each level/field combination in the order specified in the config
>>>> file. It starts with TMP, then goes to HGT and so on until it
gets
>>>> to the first level/field combination for DPT (GRIB code 17) and
>>>> then has an ERROR as
>>>> follows:
>>>>
>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
>>>> with level indicator of P225-100 found in GRIB file:
>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>
>>>> It then terminates any further searching for forecast levels
>>>> altogether and then starts searching in hours 01 and 02 where it
>>>> reports the "can't open"
>>>> problem.
>>>>
>>>> It start searching in hour 03 and repeats the findings described
>>>> above for hour 00.
>>>>
>>>> This continues for all the remaining hours and finally Point-Stat
>>>> ends with no results.
>>>>
>>>> Is this problem caused by an incomplete forecast data set? If
not,
>>>> can you debug this to determine the problem?
>>>>
>>>> Thanks.
>>>>
>>>> R/
>>>> John
>>>>
>>>> Mr John W. Raby, Meteorologist
>>>> U.S. Army Research Laboratory
>>>> White Sands Missile Range, NM 88002
>>>> (575) 678-2004 DSN 258-2004
>>>> FAX (575) 678-1230 DSN 258-1230
>>>> Email: john.raby at us.army.mil
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>> [mailto:met_help at ucar.edu]
>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
>>>> MET
>>>> (UNCLASSIFIED)
>>>>
>>>> According to our records, your request has been resolved. If you
>>>> have any further questions or concerns, please respond to this
message.
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: Paul Oldenburg
Time: Fri Apr 22 13:45:17 2011
John,
Yes, please try uploading the gzip'ed archive file. It is definitely
too large to send as an email attachment. Sorry
for the trouble. Have a good weekend.
Paul
On 04/22/2011 01:44 PM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I checked the command I was using for the ftp client and it uses the
-p
> option.
>
> I used the wgrib command for each field I specify in the config
file.
>
> For DPT I received one line of response which indicated that the
only level is
> 2m above gnd
>
> For the other fields:
>
> HGT- all levels
> RH - all levels
> TMP - all levels
> UGRD - all levels
> VGRD - all levels
>
> For PRMSL - one level
>
> For WIND - no levels
>
> The archive.tar file is 119 MB before gzip
>
> After gzip it is 58 MB.
>
> Should I try uploading the gzipped file? I had not tried this
before.
>
> I will be leaving the office at 2:00pm today, so I won't pick this
up again
> until Monday.
>
> Thanks for your help and I look forward to working with you next
week. BTW, I
> learned a lot from your instructions!
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:03 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> John,
>
> Our system administrator thinks that there should be no problem
uploading your
> file, archive.tar, to the folder /incoming/irap/met_help/Raby_data
on our FTP
> site. Are you sure that you are using the -p option when you start
your FTP
> client, as specified in the directions I sent you? Here they are
again:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Otherwise, how large is archive.tar? If you gzip it, is it < 2MB?
If so, you
> can attach it to an email.
>
> Were you able to try the wgrib command that I sent on your model
data? If so,
> do you see DPT there?
>
> Paul
>
>
>
> On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I just tried another upload this time without the binary command,
but
>> no success. Same error statement.
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 11:06 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Perhaps try to upload your archive.tar file without issuing the
"binary"
>> command first. I'll take the permissions issue up with our
internal admins.
>> Sorry for the trouble.
>>
>> Paul
>>
>>
>> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> Thanks for your suggestions. I'll be working to give them a try.
>>>
>>> I was not able to upload an archive.tar file I created using the
command:
>>> tar -cf archive.tar WRFPRS_d01.00
>>>
>>> I specified binary as you mentioned before the put command. The
>>> system replied "Type set to I"
>>>
>>> Error after put command: "Permission denied on server. (UPLOAD)"
>>>
>>> Do you have any suggestions on how to resolve this?
>>>
>>> Thanks.
>>> John
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 10:32 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> The GRIB data that you sent me does not look right (see output
below).
>>> Can you please try tar'ing it and putting it on the FTP site?
Also,
>>> you may want to issue the command "binary" before you issue the
"put"
>>> command to put your FTP client in binary mode.
>>>
>>> More generally, point_stat may not be able to find DPT (GRIB code
17)
>>> data in your GRIB file. One way to check that it is present is to
>>> use wgrib like
>>> this:
>>>
>>> $ wgrib WRFPRS_d01.00 | grep DPT
>>>
>>> If that command returns nothing, then your GRIB file does not have
>>> any DPT data in it.
>>>
>>> Regarding the interval of verification, try replacing this line
(line
>>> 81) in your run_PointStat_Passner.sh script:
>>>
>>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
19
>>> 20 21 22
>>> 23 24
>>>
>>> with this:
>>>
>>> for i in $(seq 0 3 24)
>>>
>>>
>>> Paul
>>>
>>>
>>>
>>> $ wgrib WRFPRS_d01.00
>>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:TimeU
>>> =
>>> 1:MSL:anl:NAve=0
>>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Ti
>>> m
>>> eU=1:MSL:anl:NAve=0
>>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU
>>> =
>>> 1:sfc:anl:NAve=0
>>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:TimeU
>>> =
>>> 1:sfc:anl:NAve=0
>>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =1:sfc:anl:NAve=0
>>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:Ti
>>> m
>>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
record
>>> 7
>>>
>>>
>>>
>>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> Paul -
>>>>
>>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
>>>> files (netcdf), and 1 forecast file (WRFPRS_d01.00). There is
>>>> another forecast file there which is for the wrong time and was
put
>>>> there by mistake.
>>>>
>>>> The user input I used for the runs I tried is as follows:
>>>>
>>>> Start_Date = 20100617
>>>> WRF run variation = control
>>>> Domain/resolution = m1o1
>>>>
>>>> I use METV2.0
>>>>
>>>> Thanks for your help.
>>>>
>>>> John
>>>>
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>> Sent: Friday, April 22, 2011 8:14 AM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>>> MET
>>>> (UNCLASSIFIED)
>>>>
>>>> John,
>>>>
>>>> Can you please upload the script that calls point_stat a set of
your
>>>> data to the MET help ftp site using the instructions located
here:
>>>>
>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>
>>>> I have a couple of immediate suggestions:
>>>>
>>>> 1. Only call point_stat from your script on valid times for
which
>>>> you have data
>>>>
>>>> 2. Start with a simple configuration to get it working and
>>>> incrementally add complexity until you are verifying all cases
that
>>>> you are interested in
>>>>
>>>> When your data is on the FTP site, please let me know.
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>> John -
>>>>>
>>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>>
>>>>> The NAM files have 8 forecast valid times:
>>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
>>>>> WRFPRSd01.24 respectively.
>>>>>
>>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>>
>>>>> My Point-Stat script attempts to process every forecast hour 00-
24
>>>>> rather than every 3 hours since we normally have WRF output for
all
>>>>> 24 hours as well as hourly observations from 2 separate files.
This
>>>>> results in regular occurring statements in the log to the
effect:
>>>>> "can't open..."
>>>>>
>>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>>
>>>>> >From the log file, it starts out with hour 00 and finds
forecast
>>>>>> levels for
>>>>> each level/field combination in the order specified in the
config
>>>>> file. It starts with TMP, then goes to HGT and so on until it
gets
>>>>> to the first level/field combination for DPT (GRIB code 17) and
>>>>> then has an ERROR as
>>>>> follows:
>>>>>
>>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
>>>>> with level indicator of P225-100 found in GRIB file:
>>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>>
>>>>> It then terminates any further searching for forecast levels
>>>>> altogether and then starts searching in hours 01 and 02 where it
>>>>> reports the "can't open"
>>>>> problem.
>>>>>
>>>>> It start searching in hour 03 and repeats the findings described
>>>>> above for hour 00.
>>>>>
>>>>> This continues for all the remaining hours and finally Point-
Stat
>>>>> ends with no results.
>>>>>
>>>>> Is this problem caused by an incomplete forecast data set? If
not,
>>>>> can you debug this to determine the problem?
>>>>>
>>>>> Thanks.
>>>>>
>>>>> R/
>>>>> John
>>>>>
>>>>> Mr John W. Raby, Meteorologist
>>>>> U.S. Army Research Laboratory
>>>>> White Sands Missile Range, NM 88002
>>>>> (575) 678-2004 DSN 258-2004
>>>>> FAX (575) 678-1230 DSN 258-1230
>>>>> Email: john.raby at us.army.mil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>>> [mailto:met_help at ucar.edu]
>>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
>>>>> MET
>>>>> (UNCLASSIFIED)
>>>>>
>>>>> According to our records, your request has been resolved. If you
>>>>> have any further questions or concerns, please respond to this
message.
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Fri Apr 22 13:47:17 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
Got it. I'll try on Monday. Have a great weekend.
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 1:45 PM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
Yes, please try uploading the gzip'ed archive file. It is definitely
too
large to send as an email attachment. Sorry for the trouble. Have a
good
weekend.
Paul
On 04/22/2011 01:44 PM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I checked the command I was using for the ftp client and it uses the
> -p option.
>
> I used the wgrib command for each field I specify in the config
file.
>
> For DPT I received one line of response which indicated that the
only
> level is 2m above gnd
>
> For the other fields:
>
> HGT- all levels
> RH - all levels
> TMP - all levels
> UGRD - all levels
> VGRD - all levels
>
> For PRMSL - one level
>
> For WIND - no levels
>
> The archive.tar file is 119 MB before gzip
>
> After gzip it is 58 MB.
>
> Should I try uploading the gzipped file? I had not tried this
before.
>
> I will be leaving the office at 2:00pm today, so I won't pick this
up
> again until Monday.
>
> Thanks for your help and I look forward to working with you next
week.
> BTW, I learned a lot from your instructions!
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:03 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> John,
>
> Our system administrator thinks that there should be no problem
> uploading your file, archive.tar, to the folder
> /incoming/irap/met_help/Raby_data on our FTP site. Are you sure
that
> you are using the -p option when you start your FTP client, as
specified in
> the directions I sent you? Here they are again:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Otherwise, how large is archive.tar? If you gzip it, is it < 2MB?
If
> so, you can attach it to an email.
>
> Were you able to try the wgrib command that I sent on your model
data?
> If so, do you see DPT there?
>
> Paul
>
>
>
> On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I just tried another upload this time without the binary command,
but
>> no success. Same error statement.
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 11:06 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Perhaps try to upload your archive.tar file without issuing the
"binary"
>> command first. I'll take the permissions issue up with our
internal
>> admins.
>> Sorry for the trouble.
>>
>> Paul
>>
>>
>> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> Thanks for your suggestions. I'll be working to give them a try.
>>>
>>> I was not able to upload an archive.tar file I created using the
command:
>>> tar -cf archive.tar WRFPRS_d01.00
>>>
>>> I specified binary as you mentioned before the put command. The
>>> system replied "Type set to I"
>>>
>>> Error after put command: "Permission denied on server. (UPLOAD)"
>>>
>>> Do you have any suggestions on how to resolve this?
>>>
>>> Thanks.
>>> John
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 10:32 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> The GRIB data that you sent me does not look right (see output
below).
>>> Can you please try tar'ing it and putting it on the FTP site?
Also,
>>> you may want to issue the command "binary" before you issue the
"put"
>>> command to put your FTP client in binary mode.
>>>
>>> More generally, point_stat may not be able to find DPT (GRIB code
>>> 17) data in your GRIB file. One way to check that it is present
is
>>> to use wgrib like
>>> this:
>>>
>>> $ wgrib WRFPRS_d01.00 | grep DPT
>>>
>>> If that command returns nothing, then your GRIB file does not have
>>> any DPT data in it.
>>>
>>> Regarding the interval of verification, try replacing this line
>>> (line
>>> 81) in your run_PointStat_Passner.sh script:
>>>
>>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
19
>>> 20 21 22
>>> 23 24
>>>
>>> with this:
>>>
>>> for i in $(seq 0 3 24)
>>>
>>>
>>> Paul
>>>
>>>
>>>
>>> $ wgrib WRFPRS_d01.00
>>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =
>>> 1:MSL:anl:NAve=0
>>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:T
>>> i
>>> m
>>> eU=1:MSL:anl:NAve=0
>>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =
>>> 1:sfc:anl:NAve=0
>>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =
>>> 1:sfc:anl:NAve=0
>>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Tim
>>> e
>>> U
>>> =1:sfc:anl:NAve=0
>>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:T
>>> i
>>> m
>>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
record
>>> 7
>>>
>>>
>>>
>>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> Paul -
>>>>
>>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
>>>> files (netcdf), and 1 forecast file (WRFPRS_d01.00). There is
>>>> another forecast file there which is for the wrong time and was
put
>>>> there by mistake.
>>>>
>>>> The user input I used for the runs I tried is as follows:
>>>>
>>>> Start_Date = 20100617
>>>> WRF run variation = control
>>>> Domain/resolution = m1o1
>>>>
>>>> I use METV2.0
>>>>
>>>> Thanks for your help.
>>>>
>>>> John
>>>>
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>> Sent: Friday, April 22, 2011 8:14 AM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
>>>> in MET
>>>> (UNCLASSIFIED)
>>>>
>>>> John,
>>>>
>>>> Can you please upload the script that calls point_stat a set of
>>>> your data to the MET help ftp site using the instructions located
here:
>>>>
>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>
>>>> I have a couple of immediate suggestions:
>>>>
>>>> 1. Only call point_stat from your script on valid times for
which
>>>> you have data
>>>>
>>>> 2. Start with a simple configuration to get it working and
>>>> incrementally add complexity until you are verifying all cases
that
>>>> you are interested in
>>>>
>>>> When your data is on the FTP site, please let me know.
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>> John -
>>>>>
>>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>>
>>>>> The NAM files have 8 forecast valid times:
>>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
>>>>> WRFPRSd01.24 respectively.
>>>>>
>>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>>
>>>>> My Point-Stat script attempts to process every forecast hour 00-
24
>>>>> rather than every 3 hours since we normally have WRF output for
>>>>> all
>>>>> 24 hours as well as hourly observations from 2 separate files.
>>>>> This results in regular occurring statements in the log to the
effect:
>>>>> "can't open..."
>>>>>
>>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>>
>>>>> >From the log file, it starts out with hour 00 and finds
forecast
>>>>>> levels for
>>>>> each level/field combination in the order specified in the
config
>>>>> file. It starts with TMP, then goes to HGT and so on until it
gets
>>>>> to the first level/field combination for DPT (GRIB code 17) and
>>>>> then has an ERROR as
>>>>> follows:
>>>>>
>>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
>>>>> with level indicator of P225-100 found in GRIB file:
>>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>>
>>>>> It then terminates any further searching for forecast levels
>>>>> altogether and then starts searching in hours 01 and 02 where it
>>>>> reports the "can't open"
>>>>> problem.
>>>>>
>>>>> It start searching in hour 03 and repeats the findings described
>>>>> above for hour 00.
>>>>>
>>>>> This continues for all the remaining hours and finally Point-
Stat
>>>>> ends with no results.
>>>>>
>>>>> Is this problem caused by an incomplete forecast data set? If
not,
>>>>> can you debug this to determine the problem?
>>>>>
>>>>> Thanks.
>>>>>
>>>>> R/
>>>>> John
>>>>>
>>>>> Mr John W. Raby, Meteorologist
>>>>> U.S. Army Research Laboratory
>>>>> White Sands Missile Range, NM 88002
>>>>> (575) 678-2004 DSN 258-2004
>>>>> FAX (575) 678-1230 DSN 258-1230
>>>>> Email: john.raby at us.army.mil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>>> [mailto:met_help at ucar.edu]
>>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
>>>>> MET
>>>>> (UNCLASSIFIED)
>>>>>
>>>>> According to our records, your request has been resolved. If you
>>>>> have any further questions or concerns, please respond to this
message.
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Mon Apr 25 07:51:55 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
This morning I attempted to upload the NAM forecast file
(WRFPRS_d01.00) which
had been tar'd and gzip'd to size 56MB. It took several minutes and I
think it
was uploaded OK, but I noted one anomaly before it returned to the
ftp>
prompt. There was a statement "Data Connection: Bad file descriptor."
I guess the real concern is whether you are able to get the file, open
it and
view the contents.
John
-----Original Message-----
From: RAL HelpDesk {for Raby, John} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 1:47 PM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
Got it. I'll try on Monday. Have a great weekend.
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Friday, April 22, 2011 1:45 PM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
Yes, please try uploading the gzip'ed archive file. It is definitely
too
large to send as an email attachment. Sorry for the trouble. Have a
good
weekend.
Paul
On 04/22/2011 01:44 PM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> I checked the command I was using for the ftp client and it uses the
> -p option.
>
> I used the wgrib command for each field I specify in the config
file.
>
> For DPT I received one line of response which indicated that the
only
> level is 2m above gnd
>
> For the other fields:
>
> HGT- all levels
> RH - all levels
> TMP - all levels
> UGRD - all levels
> VGRD - all levels
>
> For PRMSL - one level
>
> For WIND - no levels
>
> The archive.tar file is 119 MB before gzip
>
> After gzip it is 58 MB.
>
> Should I try uploading the gzipped file? I had not tried this
before.
>
> I will be leaving the office at 2:00pm today, so I won't pick this
up
> again until Monday.
>
> Thanks for your help and I look forward to working with you next
week.
> BTW, I learned a lot from your instructions!
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:03 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> John,
>
> Our system administrator thinks that there should be no problem
> uploading your file, archive.tar, to the folder
> /incoming/irap/met_help/Raby_data on our FTP site. Are you sure
that
> you are using the -p option when you start your FTP client, as
> specified in the directions I sent you? Here they are again:
>
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Otherwise, how large is archive.tar? If you gzip it, is it < 2MB?
If
> so, you can attach it to an email.
>
> Were you able to try the wgrib command that I sent on your model
data?
> If so, do you see DPT there?
>
> Paul
>
>
>
> On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I just tried another upload this time without the binary command,
but
>> no success. Same error statement.
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 11:06 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Perhaps try to upload your archive.tar file without issuing the
"binary"
>> command first. I'll take the permissions issue up with our
internal
>> admins.
>> Sorry for the trouble.
>>
>> Paul
>>
>>
>> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> Thanks for your suggestions. I'll be working to give them a try.
>>>
>>> I was not able to upload an archive.tar file I created using the
command:
>>> tar -cf archive.tar WRFPRS_d01.00
>>>
>>> I specified binary as you mentioned before the put command. The
>>> system replied "Type set to I"
>>>
>>> Error after put command: "Permission denied on server. (UPLOAD)"
>>>
>>> Do you have any suggestions on how to resolve this?
>>>
>>> Thanks.
>>> John
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 10:32 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> The GRIB data that you sent me does not look right (see output
below).
>>> Can you please try tar'ing it and putting it on the FTP site?
Also,
>>> you may want to issue the command "binary" before you issue the
"put"
>>> command to put your FTP client in binary mode.
>>>
>>> More generally, point_stat may not be able to find DPT (GRIB code
>>> 17) data in your GRIB file. One way to check that it is present
is
>>> to use wgrib like
>>> this:
>>>
>>> $ wgrib WRFPRS_d01.00 | grep DPT
>>>
>>> If that command returns nothing, then your GRIB file does not have
>>> any DPT data in it.
>>>
>>> Regarding the interval of verification, try replacing this line
>>> (line
>>> 81) in your run_PointStat_Passner.sh script:
>>>
>>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
19
>>> 20 21 22
>>> 23 24
>>>
>>> with this:
>>>
>>> for i in $(seq 0 3 24)
>>>
>>>
>>> Paul
>>>
>>>
>>>
>>> $ wgrib WRFPRS_d01.00
>>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =
>>> 1:MSL:anl:NAve=0
>>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:T
>>> i
>>> m
>>> eU=1:MSL:anl:NAve=0
>>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =
>>> 1:sfc:anl:NAve=0
>>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>> U
>>> =
>>> 1:sfc:anl:NAve=0
>>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Tim
>>> e
>>> U
>>> =1:sfc:anl:NAve=0
>>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:T
>>> i
>>> m
>>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
record
>>> 7
>>>
>>>
>>>
>>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> Paul -
>>>>
>>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
>>>> files (netcdf), and 1 forecast file (WRFPRS_d01.00). There is
>>>> another forecast file there which is for the wrong time and was
put
>>>> there by mistake.
>>>>
>>>> The user input I used for the runs I tried is as follows:
>>>>
>>>> Start_Date = 20100617
>>>> WRF run variation = control
>>>> Domain/resolution = m1o1
>>>>
>>>> I use METV2.0
>>>>
>>>> Thanks for your help.
>>>>
>>>> John
>>>>
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>> Sent: Friday, April 22, 2011 8:14 AM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
>>>> in MET
>>>> (UNCLASSIFIED)
>>>>
>>>> John,
>>>>
>>>> Can you please upload the script that calls point_stat a set of
>>>> your data to the MET help ftp site using the instructions located
here:
>>>>
>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>
>>>> I have a couple of immediate suggestions:
>>>>
>>>> 1. Only call point_stat from your script on valid times for
which
>>>> you have data
>>>>
>>>> 2. Start with a simple configuration to get it working and
>>>> incrementally add complexity until you are verifying all cases
that
>>>> you are interested in
>>>>
>>>> When your data is on the FTP site, please let me know.
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>> John -
>>>>>
>>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>>
>>>>> The NAM files have 8 forecast valid times:
>>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
>>>>> WRFPRSd01.24 respectively.
>>>>>
>>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>>
>>>>> My Point-Stat script attempts to process every forecast hour 00-
24
>>>>> rather than every 3 hours since we normally have WRF output for
>>>>> all
>>>>> 24 hours as well as hourly observations from 2 separate files.
>>>>> This results in regular occurring statements in the log to the
effect:
>>>>> "can't open..."
>>>>>
>>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>>
>>>>> >From the log file, it starts out with hour 00 and finds
forecast
>>>>>> levels for
>>>>> each level/field combination in the order specified in the
config
>>>>> file. It starts with TMP, then goes to HGT and so on until it
gets
>>>>> to the first level/field combination for DPT (GRIB code 17) and
>>>>> then has an ERROR as
>>>>> follows:
>>>>>
>>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
>>>>> with level indicator of P225-100 found in GRIB file:
>>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>>
>>>>> It then terminates any further searching for forecast levels
>>>>> altogether and then starts searching in hours 01 and 02 where it
>>>>> reports the "can't open"
>>>>> problem.
>>>>>
>>>>> It start searching in hour 03 and repeats the findings described
>>>>> above for hour 00.
>>>>>
>>>>> This continues for all the remaining hours and finally Point-
Stat
>>>>> ends with no results.
>>>>>
>>>>> Is this problem caused by an incomplete forecast data set? If
not,
>>>>> can you debug this to determine the problem?
>>>>>
>>>>> Thanks.
>>>>>
>>>>> R/
>>>>> John
>>>>>
>>>>> Mr John W. Raby, Meteorologist
>>>>> U.S. Army Research Laboratory
>>>>> White Sands Missile Range, NM 88002
>>>>> (575) 678-2004 DSN 258-2004
>>>>> FAX (575) 678-1230 DSN 258-1230
>>>>> Email: john.raby at us.army.mil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>>> [mailto:met_help at ucar.edu]
>>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
>>>>> MET
>>>>> (UNCLASSIFIED)
>>>>>
>>>>> According to our records, your request has been resolved. If you
>>>>> have any further questions or concerns, please respond to this
message.
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: Paul Oldenburg
Time: Mon Apr 25 09:10:30 2011
John,
The grib file did not appear to get through completely. More of it
appears to have made it, but there are still no DPT
records. None of our other FTP users have reported problems. Is it
possible that the problem is on your side? Do you
have an external FTP site that I could pull your data from?
To figure out your problem, you should look at the output of the
following command:
wgrib WRFPRS_d01.00 | grep DPT
That will list all DPT records in the grib file and show their level
type (kpds6) and level value (kpds7). If kpds=100,
then the value of kpds7 is a pressure level. For the DPT records,
make sure that the entries in the point_stat config
fcst_field have pressure ranges that contain the levels in the grib
file. Is see that you have entries like this:
DPT/P100-225. That would match DPT grib records with a pressure level
between 100 (kpds6=100:kpds7=100) and 225
(kpds6=100:kpds7=225). Does that make sense?
Paul
On 04/25/2011 07:51 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> This morning I attempted to upload the NAM forecast file
(WRFPRS_d01.00) which
> had been tar'd and gzip'd to size 56MB. It took several minutes and
I think it
> was uploaded OK, but I noted one anomaly before it returned to the
ftp>
> prompt. There was a statement "Data Connection: Bad file
descriptor."
>
> I guess the real concern is whether you are able to get the file,
open it and
> view the contents.
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Raby, John} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:47 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
> Got it. I'll try on Monday. Have a great weekend.
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:45 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> John,
>
> Yes, please try uploading the gzip'ed archive file. It is
definitely too
> large to send as an email attachment. Sorry for the trouble. Have
a good
> weekend.
>
> Paul
>
>
> On 04/22/2011 01:44 PM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I checked the command I was using for the ftp client and it uses
the
>> -p option.
>>
>> I used the wgrib command for each field I specify in the config
file.
>>
>> For DPT I received one line of response which indicated that the
only
>> level is 2m above gnd
>>
>> For the other fields:
>>
>> HGT- all levels
>> RH - all levels
>> TMP - all levels
>> UGRD - all levels
>> VGRD - all levels
>>
>> For PRMSL - one level
>>
>> For WIND - no levels
>>
>> The archive.tar file is 119 MB before gzip
>>
>> After gzip it is 58 MB.
>>
>> Should I try uploading the gzipped file? I had not tried this
before.
>>
>> I will be leaving the office at 2:00pm today, so I won't pick this
up
>> again until Monday.
>>
>> Thanks for your help and I look forward to working with you next
week.
>> BTW, I learned a lot from your instructions!
>>
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 1:03 PM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Our system administrator thinks that there should be no problem
>> uploading your file, archive.tar, to the folder
>> /incoming/irap/met_help/Raby_data on our FTP site. Are you sure
that
>> you are using the -p option when you start your FTP client, as
>> specified in the directions I sent you? Here they are again:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Otherwise, how large is archive.tar? If you gzip it, is it < 2MB?
If
>> so, you can attach it to an email.
>>
>> Were you able to try the wgrib command that I sent on your model
data?
>> If so, do you see DPT there?
>>
>> Paul
>>
>>
>>
>> On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> I just tried another upload this time without the binary command,
but
>>> no success. Same error statement.
>>> John
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 11:06 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> Perhaps try to upload your archive.tar file without issuing the
"binary"
>>> command first. I'll take the permissions issue up with our
internal
>>> admins.
>>> Sorry for the trouble.
>>>
>>> Paul
>>>
>>>
>>> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> Paul -
>>>>
>>>> Thanks for your suggestions. I'll be working to give them a try.
>>>>
>>>> I was not able to upload an archive.tar file I created using the
command:
>>>> tar -cf archive.tar WRFPRS_d01.00
>>>>
>>>> I specified binary as you mentioned before the put command. The
>>>> system replied "Type set to I"
>>>>
>>>> Error after put command: "Permission denied on server. (UPLOAD)"
>>>>
>>>> Do you have any suggestions on how to resolve this?
>>>>
>>>> Thanks.
>>>> John
>>>>
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>> Sent: Friday, April 22, 2011 10:32 AM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>>> MET
>>>> (UNCLASSIFIED)
>>>>
>>>> John,
>>>>
>>>> The GRIB data that you sent me does not look right (see output
below).
>>>> Can you please try tar'ing it and putting it on the FTP site?
Also,
>>>> you may want to issue the command "binary" before you issue the
"put"
>>>> command to put your FTP client in binary mode.
>>>>
>>>> More generally, point_stat may not be able to find DPT (GRIB code
>>>> 17) data in your GRIB file. One way to check that it is present
is
>>>> to use wgrib like
>>>> this:
>>>>
>>>> $ wgrib WRFPRS_d01.00 | grep DPT
>>>>
>>>> If that command returns nothing, then your GRIB file does not
have
>>>> any DPT data in it.
>>>>
>>>> Regarding the interval of verification, try replacing this line
>>>> (line
>>>> 81) in your run_PointStat_Passner.sh script:
>>>>
>>>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
19
>>>> 20 21 22
>>>> 23 24
>>>>
>>>> with this:
>>>>
>>>> for i in $(seq 0 3 24)
>>>>
>>>>
>>>> Paul
>>>>
>>>>
>>>>
>>>> $ wgrib WRFPRS_d01.00
>>>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Time
>>>> U
>>>> =
>>>> 1:MSL:anl:NAve=0
>>>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:T
>>>> i
>>>> m
>>>> eU=1:MSL:anl:NAve=0
>>>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>>> U
>>>> =
>>>> 1:sfc:anl:NAve=0
>>>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Time
>>>> U
>>>> =
>>>> 1:sfc:anl:NAve=0
>>>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Tim
>>>> e
>>>> U
>>>> =1:sfc:anl:NAve=0
>>>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:T
>>>> i
>>>> m
>>>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
record
>>>> 7
>>>>
>>>>
>>>>
>>>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>> Paul -
>>>>>
>>>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
>>>>> files (netcdf), and 1 forecast file (WRFPRS_d01.00). There is
>>>>> another forecast file there which is for the wrong time and was
put
>>>>> there by mistake.
>>>>>
>>>>> The user input I used for the runs I tried is as follows:
>>>>>
>>>>> Start_Date = 20100617
>>>>> WRF run variation = control
>>>>> Domain/resolution = m1o1
>>>>>
>>>>> I use METV2.0
>>>>>
>>>>> Thanks for your help.
>>>>>
>>>>> John
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>>> Sent: Friday, April 22, 2011 8:14 AM
>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM
output
>>>>> in MET
>>>>> (UNCLASSIFIED)
>>>>>
>>>>> John,
>>>>>
>>>>> Can you please upload the script that calls point_stat a set of
>>>>> your data to the MET help ftp site using the instructions
located here:
>>>>>
>>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>
>>>>> I have a couple of immediate suggestions:
>>>>>
>>>>> 1. Only call point_stat from your script on valid times for
which
>>>>> you have data
>>>>>
>>>>> 2. Start with a simple configuration to get it working and
>>>>> incrementally add complexity until you are verifying all cases
that
>>>>> you are interested in
>>>>>
>>>>> When your data is on the FTP site, please let me know.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>>
>>>>>> Classification: UNCLASSIFIED
>>>>>> Caveats: NONE
>>>>>>
>>>>>> John -
>>>>>>
>>>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>>>
>>>>>> The NAM files have 8 forecast valid times:
>>>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
>>>>>> WRFPRSd01.24 respectively.
>>>>>>
>>>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>>>
>>>>>> My Point-Stat script attempts to process every forecast hour
00-24
>>>>>> rather than every 3 hours since we normally have WRF output for
>>>>>> all
>>>>>> 24 hours as well as hourly observations from 2 separate files.
>>>>>> This results in regular occurring statements in the log to the
effect:
>>>>>> "can't open..."
>>>>>>
>>>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>>>
>>>>>> >From the log file, it starts out with hour 00 and finds
forecast
>>>>>>> levels for
>>>>>> each level/field combination in the order specified in the
config
>>>>>> file. It starts with TMP, then goes to HGT and so on until it
gets
>>>>>> to the first level/field combination for DPT (GRIB code 17) and
>>>>>> then has an ERROR as
>>>>>> follows:
>>>>>>
>>>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
>>>>>> with level indicator of P225-100 found in GRIB file:
>>>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>>>
>>>>>> It then terminates any further searching for forecast levels
>>>>>> altogether and then starts searching in hours 01 and 02 where
it
>>>>>> reports the "can't open"
>>>>>> problem.
>>>>>>
>>>>>> It start searching in hour 03 and repeats the findings
described
>>>>>> above for hour 00.
>>>>>>
>>>>>> This continues for all the remaining hours and finally Point-
Stat
>>>>>> ends with no results.
>>>>>>
>>>>>> Is this problem caused by an incomplete forecast data set? If
not,
>>>>>> can you debug this to determine the problem?
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> R/
>>>>>> John
>>>>>>
>>>>>> Mr John W. Raby, Meteorologist
>>>>>> U.S. Army Research Laboratory
>>>>>> White Sands Missile Range, NM 88002
>>>>>> (575) 678-2004 DSN 258-2004
>>>>>> FAX (575) 678-1230 DSN 258-1230
>>>>>> Email: john.raby at us.army.mil
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>>>> [mailto:met_help at ucar.edu]
>>>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>>>>> MET
>>>>>> (UNCLASSIFIED)
>>>>>>
>>>>>> According to our records, your request has been resolved. If
you
>>>>>> have any further questions or concerns, please respond to this
message.
>>>>>>
>>>>>> Classification: UNCLASSIFIED
>>>>>> Caveats: NONE
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Mon Apr 25 09:52:07 2011
Classification: UNCLASSIFIED
Caveats: NONE
Paul -
Thanks for checking on it. I will attempt to deliver the file by
Secure Access
File Exchange (SAFE). Can you send me an email address where SAFE can
send you
a link to the server and password to download the file?
I used wgrib to determine what is available in those files for all the
fcst_field entries I am looking for in my point_stat config file.
For DPT there is only one level (2m) of fcst data.
>From my list of fcst_field entries I also note that there is no data
at all
for WIND.
The rest of my fcst_field entries do have data at several levels.
I am following your advice on making sure that the fcst_field entries
in my
config file match what is available in the grib file to eliminate
occurrences
of "ERROR: process_grib_codes() -> no records matching GRIB code"
problems.
Before running point_stat again I will also restrict the interval of
verification per your earlier suggestion.
John
-----Original Message-----
From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
Sent: Monday, April 25, 2011 9:11 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
John,
The grib file did not appear to get through completely. More of it
appears to
have made it, but there are still no DPT records. None of our other
FTP users
have reported problems. Is it possible that the problem is on your
side? Do
you have an external FTP site that I could pull your data from?
To figure out your problem, you should look at the output of the
following
command:
wgrib WRFPRS_d01.00 | grep DPT
That will list all DPT records in the grib file and show their level
type
(kpds6) and level value (kpds7). If kpds=100, then the value of kpds7
is a
pressure level. For the DPT records, make sure that the entries in
the
point_stat config fcst_field have pressure ranges that contain the
levels in
the grib file. Is see that you have entries like this:
DPT/P100-225. That would match DPT grib records with a pressure level
between
100 (kpds6=100:kpds7=100) and 225 (kpds6=100:kpds7=225). Does that
make
sense?
Paul
On 04/25/2011 07:51 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
>
> This morning I attempted to upload the NAM forecast file
> (WRFPRS_d01.00) which had been tar'd and gzip'd to size 56MB. It
took
> several minutes and I think it was uploaded OK, but I noted one
> anomaly before it returned to the ftp> prompt. There was a statement
"Data
> Connection: Bad file descriptor."
>
> I guess the real concern is whether you are able to get the file,
open
> it and view the contents.
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Raby, John} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:47 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> Paul -
> Got it. I'll try on Monday. Have a great weekend.
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
> Sent: Friday, April 22, 2011 1:45 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> John,
>
> Yes, please try uploading the gzip'ed archive file. It is
definitely
> too large to send as an email attachment. Sorry for the trouble.
> Have a good weekend.
>
> Paul
>
>
> On 04/22/2011 01:44 PM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> Paul -
>>
>> I checked the command I was using for the ftp client and it uses
the
>> -p option.
>>
>> I used the wgrib command for each field I specify in the config
file.
>>
>> For DPT I received one line of response which indicated that the
only
>> level is 2m above gnd
>>
>> For the other fields:
>>
>> HGT- all levels
>> RH - all levels
>> TMP - all levels
>> UGRD - all levels
>> VGRD - all levels
>>
>> For PRMSL - one level
>>
>> For WIND - no levels
>>
>> The archive.tar file is 119 MB before gzip
>>
>> After gzip it is 58 MB.
>>
>> Should I try uploading the gzipped file? I had not tried this
before.
>>
>> I will be leaving the office at 2:00pm today, so I won't pick this
up
>> again until Monday.
>>
>> Thanks for your help and I look forward to working with you next
week.
>> BTW, I learned a lot from your instructions!
>>
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>> Sent: Friday, April 22, 2011 1:03 PM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> John,
>>
>> Our system administrator thinks that there should be no problem
>> uploading your file, archive.tar, to the folder
>> /incoming/irap/met_help/Raby_data on our FTP site. Are you sure
that
>> you are using the -p option when you start your FTP client, as
>> specified in the directions I sent you? Here they are again:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Otherwise, how large is archive.tar? If you gzip it, is it < 2MB?
>> If so, you can attach it to an email.
>>
>> Were you able to try the wgrib command that I sent on your model
data?
>> If so, do you see DPT there?
>>
>> Paul
>>
>>
>>
>> On 04/22/2011 11:18 AM, RAL HelpDesk {for Raby, John} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> Paul -
>>>
>>> I just tried another upload this time without the binary command,
>>> but no success. Same error statement.
>>> John
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for Paul Oldenburg} [mailto:met_help at ucar.edu]
>>> Sent: Friday, April 22, 2011 11:06 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> John,
>>>
>>> Perhaps try to upload your archive.tar file without issuing the
"binary"
>>> command first. I'll take the permissions issue up with our
internal
>>> admins.
>>> Sorry for the trouble.
>>>
>>> Paul
>>>
>>>
>>> On 04/22/2011 10:59 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>> Paul -
>>>>
>>>> Thanks for your suggestions. I'll be working to give them a try.
>>>>
>>>> I was not able to upload an archive.tar file I created using the
command:
>>>> tar -cf archive.tar WRFPRS_d01.00
>>>>
>>>> I specified binary as you mentioned before the put command. The
>>>> system replied "Type set to I"
>>>>
>>>> Error after put command: "Permission denied on server. (UPLOAD)"
>>>>
>>>> Do you have any suggestions on how to resolve this?
>>>>
>>>> Thanks.
>>>> John
>>>>
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>> Sent: Friday, April 22, 2011 10:32 AM
>>>> To: Raby, John (Civ, ARL/CISD)
>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
>>>> in MET
>>>> (UNCLASSIFIED)
>>>>
>>>> John,
>>>>
>>>> The GRIB data that you sent me does not look right (see output
below).
>>>> Can you please try tar'ing it and putting it on the FTP site?
>>>> Also, you may want to issue the command "binary" before you issue
the
>>>> "put"
>>>> command to put your FTP client in binary mode.
>>>>
>>>> More generally, point_stat may not be able to find DPT (GRIB code
>>>> 17) data in your GRIB file. One way to check that it is present
is
>>>> to use wgrib like
>>>> this:
>>>>
>>>> $ wgrib WRFPRS_d01.00 | grep DPT
>>>>
>>>> If that command returns nothing, then your GRIB file does not
have
>>>> any DPT data in it.
>>>>
>>>> Regarding the interval of verification, try replacing this line
>>>> (line
>>>> 81) in your run_PointStat_Passner.sh script:
>>>>
>>>> for i in 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18
>>>> 19 20 21 22
>>>> 23 24
>>>>
>>>> with this:
>>>>
>>>> for i in $(seq 0 3 24)
>>>>
>>>>
>>>> Paul
>>>>
>>>>
>>>>
>>>> $ wgrib WRFPRS_d01.00
>>>>
1:0:d=10061706:MSLET:kpds5=130:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:Tim
>>>> e
>>>> U
>>>> =
>>>> 1:MSL:anl:NAve=0
>>>>
2:427130:d=10061706:PRMSL:kpds5=2:kpds6=102:kpds7=0:TR=1:P1=0:P2=0:
>>>> T
>>>> i
>>>> m
>>>> eU=1:MSL:anl:NAve=0
>>>>
3:854260:d=10061706:PRES:kpds5=1:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Tim
>>>> e
>>>> U
>>>> =
>>>> 1:sfc:anl:NAve=0
>>>>
4:1379938:d=10061706:HGT:kpds5=7:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Tim
>>>> e
>>>> U
>>>> =
>>>> 1:sfc:anl:NAve=0
>>>>
5:1839918:d=10061706:TMP:kpds5=11:kpds6=1:kpds7=0:TR=1:P1=0:P2=0:Ti
>>>> m
>>>> e
>>>> U
>>>> =1:sfc:anl:NAve=0
>>>>
6:2135652:d=10061706:TMP:kpds5=11:kpds6=105:kpds7=2:TR=1:P1=0:P2=0:
>>>> T
>>>> i
>>>> m
>>>> eU=1:2 m above gnd:anl:NAve=0 error, could not read to end of
>>>> record
>>>> 7
>>>>
>>>>
>>>>
>>>> On 04/22/2011 10:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>> Paul -
>>>>>
>>>>> I've uploaded the 2 scripts which run Point_Stat, 2 observation
>>>>> files (netcdf), and 1 forecast file (WRFPRS_d01.00). There is
>>>>> another forecast file there which is for the wrong time and was
>>>>> put there by mistake.
>>>>>
>>>>> The user input I used for the runs I tried is as follows:
>>>>>
>>>>> Start_Date = 20100617
>>>>> WRF run variation = control
>>>>> Domain/resolution = m1o1
>>>>>
>>>>> I use METV2.0
>>>>>
>>>>> Thanks for your help.
>>>>>
>>>>> John
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: RAL HelpDesk {for Paul Oldenburg}
[mailto:met_help at ucar.edu]
>>>>> Sent: Friday, April 22, 2011 8:14 AM
>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM
output
>>>>> in MET
>>>>> (UNCLASSIFIED)
>>>>>
>>>>> John,
>>>>>
>>>>> Can you please upload the script that calls point_stat a set of
>>>>> your data to the MET help ftp site using the instructions
located here:
>>>>>
>>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>
>>>>> I have a couple of immediate suggestions:
>>>>>
>>>>> 1. Only call point_stat from your script on valid times for
which
>>>>> you have data
>>>>>
>>>>> 2. Start with a simple configuration to get it working and
>>>>> incrementally add complexity until you are verifying all cases
>>>>> that you are interested in
>>>>>
>>>>> When your data is on the FTP site, please let me know.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 04/22/2011 07:43 AM, RAL HelpDesk {for Raby, John} wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>>>>
>>>>>> Classification: UNCLASSIFIED
>>>>>> Caveats: NONE
>>>>>>
>>>>>> John -
>>>>>>
>>>>>> I set up our system to run Point-Stat with the NAM GRIB files.
>>>>>>
>>>>>> The NAM files have 8 forecast valid times:
>>>>>> 00,03,06,09,12,15,18,21,24 and are named WRFPRS_d01.00 ->
>>>>>> WRFPRSd01.24 respectively.
>>>>>>
>>>>>> I've attached my config file and the Point-Stat event log for
ref.
>>>>>>
>>>>>> My Point-Stat script attempts to process every forecast hour
>>>>>> 00-24 rather than every 3 hours since we normally have WRF
output
>>>>>> for all
>>>>>> 24 hours as well as hourly observations from 2 separate files.
>>>>>> This results in regular occurring statements in the log to the
effect:
>>>>>> "can't open..."
>>>>>>
>>>>>> In the config file I specify 56 different levels/fields to be
verified.
>>>>>>
>>>>>> >From the log file, it starts out with hour 00 and finds
forecast
>>>>>>> levels for
>>>>>> each level/field combination in the order specified in the
config
>>>>>> file. It starts with TMP, then goes to HGT and so on until it
>>>>>> gets to the first level/field combination for DPT (GRIB code
17)
>>>>>> and then has an ERROR as
>>>>>> follows:
>>>>>>
>>>>>> ERROR: process_grib_codes() -> no records matching GRIB code 17
>>>>>> with level indicator of P225-100 found in GRIB file:
>>>>>> ../MET_WRFpostprd/20100617/WRFPRS_d01.00
>>>>>>
>>>>>> It then terminates any further searching for forecast levels
>>>>>> altogether and then starts searching in hours 01 and 02 where
it
>>>>>> reports the "can't open"
>>>>>> problem.
>>>>>>
>>>>>> It start searching in hour 03 and repeats the findings
described
>>>>>> above for hour 00.
>>>>>>
>>>>>> This continues for all the remaining hours and finally Point-
Stat
>>>>>> ends with no results.
>>>>>>
>>>>>> Is this problem caused by an incomplete forecast data set? If
>>>>>> not, can you debug this to determine the problem?
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> R/
>>>>>> John
>>>>>>
>>>>>> Mr John W. Raby, Meteorologist
>>>>>> U.S. Army Research Laboratory
>>>>>> White Sands Missile Range, NM 88002
>>>>>> (575) 678-2004 DSN 258-2004
>>>>>> FAX (575) 678-1230 DSN 258-1230
>>>>>> Email: john.raby at us.army.mil
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: RAL HelpDesk {for John Halley Gotway}
>>>>>> [mailto:met_help at ucar.edu]
>>>>>> Sent: Thursday, April 21, 2011 1:16 PM
>>>>>> To: Raby, John (Civ, ARL/CISD)
>>>>>> Subject: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>>>>> MET
>>>>>> (UNCLASSIFIED)
>>>>>>
>>>>>> According to our records, your request has been resolved. If
you
>>>>>> have any further questions or concerns, please respond to this
message.
>>>>>>
>>>>>> Classification: UNCLASSIFIED
>>>>>> Caveats: NONE
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Classification: UNCLASSIFIED
>>>>> Caveats: NONE
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> Classification: UNCLASSIFIED
>>>> Caveats: NONE
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: John Halley Gotway
Time: Mon Apr 25 11:30:43 2011
Hello John,
This is John Halley Gotway. I've been following the message traffic
on this. Paul's really busy this week on another project, but I'd be
happy to help you with it. I understand that you need an
email address for a "SAFE" transfer. My email address is:
johnhg at ucar.edu
Thanks,
John
On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
> anks for checking on it. I will attempt to deliver the file by
Secure Access
> File Exchange (SAFE). Can you send me an email address where SAFE
can send you
> a link to the server and password to download the file?
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Mon Apr 25 11:54:54 2011
Classification: UNCLASSIFIED
Caveats: NONE
John -
Thanks.
I just uploaded the file on the SAFE site. You should receive an email
from
the site soon.
R/
John
-----Original Message-----
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent: Monday, April 25, 2011 11:31 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
Hello John,
This is John Halley Gotway. I've been following the message traffic
on this.
Paul's really busy this week on another project, but I'd be happy to
help you
with it. I understand that you need an email address for a "SAFE"
transfer.
My email address is:
johnhg at ucar.edu
Thanks,
John
On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
> anks for checking on it. I will attempt to deliver the file by
Secure
> Access File Exchange (SAFE). Can you send me an email address where
> SAFE can send you a link to the server and password to download the
file?
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Mon Apr 25 13:49:37 2011
Classification: UNCLASSIFIED
Caveats: NONE
John -
Ref my point_stat config file which you should have, if I specify an
ascii
file containing lat/lon points in the mask_poly masking region
(DUGd01.poly)
as the only region over which I want to perform scoring, then it would
not be
necessary to specify a mask_grid at all unless I wanted to score over
two
regions. Is this correct? I take it that the purpose of mask_grid is
to define
a scoring region using a defined NCEP grid approach (or FULL) as
distinguished
from mask_poly which defines a scoring region using 4 specific file
types. If
I only want the scoring to occur over the DUGd01.poly region then I
should set
the mask_grid to [] or empty vice FULL which is the way it's set now.
R/
John
-----Original Message-----
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent: Monday, April 25, 2011 11:31 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
Hello John,
This is John Halley Gotway. I've been following the message traffic
on this.
Paul's really busy this week on another project, but I'd be happy to
help you
with it. I understand that you need an email address for a "SAFE"
transfer.
My email address is:
johnhg at ucar.edu
Thanks,
John
On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
> anks for checking on it. I will attempt to deliver the file by
Secure
> Access File Exchange (SAFE). Can you send me an email address where
> SAFE can send you a link to the server and password to download the
file?
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Mon Apr 25 15:20:42 2011
Classification: UNCLASSIFIED
Caveats: NONE
John -
I think I have point_stat running on the NAM data now.
Summary of required changes to my run script and config files:
I left the run script as I sent it to you. Even though the loop on
line 81
cycles through all possible forecast verification times (00, 01, 02,
...24),
point_stat doesn't have any errors. It just states that it can't open
NAM
files for the times where NAM doesn't have a forecast. (i.e. 01, 02,
04, 05,
...)
I changed my config file to eliminate the fcst_field and associated
fcst_thresh thresholds which were not present in the NAM GRIB files.
This
prevented the error when point_stat can't find a particular variable I
asked
for in the config file.
I changed the config file to eliminate the scoring over the entire NAM
domain
which is CONUS by changing ["FULL"] to []. Now the only region I score
over is
the one I set in the config file using the mask_poly ascii file
"DUGd01.poly".
See attached point_stat log file.
I inspected the ME, MAE and RMSE stats in the .cnt result file and
they look
reasonable.
Do you have any observations/suggestions from your examination of the
info I
sent?
Thanks.
John
-----Original Message-----
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent: Monday, April 25, 2011 11:31 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
(UNCLASSIFIED)
Hello John,
This is John Halley Gotway. I've been following the message traffic
on this.
Paul's really busy this week on another project, but I'd be happy to
help you
with it. I understand that you need an email address for a "SAFE"
transfer.
My email address is:
johnhg at ucar.edu
Thanks,
John
On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
> anks for checking on it. I will attempt to deliver the file by
Secure
> Access File Exchange (SAFE). Can you send me an email address where
> SAFE can send you a link to the server and password to download the
file?
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: John Halley Gotway
Time: Mon Apr 25 20:04:04 2011
John,
I'm sorry for the delay in getting back to you. It was a busy day
here.
I'm glad you were able to get Point-Stat running on the NAM data. NAM
forecasts are produced 4 times per day (00Z, 06Z, 12Z, and 18Z) out to
84
hours at 3-hourly intervals. If it's easier for you to script up
calls to
Point-Stat to run every hour, that's fine. It'll just error out when
the
input NAM file you specify does not exist. We typically handle that
sort
of thing in the script and only call Point-Stat when the input file
actually exists. But however you want to handle it is fine.
When you run Point-Stat, you have to specify at least one masking
region
using mask_grid or mask_poly. And since you only want to use a single
polyline, leaving mask_poly blank is definitely the thing to do.
Regarding sources of observations, all I'd suggest is using the
PREPRBUFR
point observations - specifically those available for NDAS (North
American
Data Assimilation). A 1-month archive of them can be found here:
http://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/
You'd run them through PB2NC before using them in Point-Stat.
Sorry I wasn't able to help more promptly, but I'm glad you were able
to
get it up and running by yourself.
Just let me know if any more questions arise.
Thanks,
John
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> I think I have point_stat running on the NAM data now.
>
> Summary of required changes to my run script and config files:
>
> I left the run script as I sent it to you. Even though the loop on
line 81
> cycles through all possible forecast verification times (00, 01, 02,
> ...24),
> point_stat doesn't have any errors. It just states that it can't
open NAM
> files for the times where NAM doesn't have a forecast. (i.e. 01, 02,
04,
> 05,
> ...)
>
> I changed my config file to eliminate the fcst_field and associated
> fcst_thresh thresholds which were not present in the NAM GRIB files.
This
> prevented the error when point_stat can't find a particular variable
I
> asked
> for in the config file.
>
> I changed the config file to eliminate the scoring over the entire
NAM
> domain
> which is CONUS by changing ["FULL"] to []. Now the only region I
score
> over is
> the one I set in the config file using the mask_poly ascii file
> "DUGd01.poly".
>
> See attached point_stat log file.
>
> I inspected the ME, MAE and RMSE stats in the .cnt result file and
they
> look
> reasonable.
>
> Do you have any observations/suggestions from your examination of
the info
> I
> sent?
>
> Thanks.
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Monday, April 25, 2011 11:31 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET
> (UNCLASSIFIED)
>
> Hello John,
>
> This is John Halley Gotway. I've been following the message traffic
on
> this.
> Paul's really busy this week on another project, but I'd be happy to
help
> you
> with it. I understand that you need an email address for a "SAFE"
> transfer.
> My email address is:
>
> johnhg at ucar.edu
>
> Thanks,
> John
>
> On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
>> anks for checking on it. I will attempt to deliver the file by
Secure
>> Access File Exchange (SAFE). Can you send me an email address where
>> SAFE can send you a link to the server and password to download the
>> file?
>>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Tue Apr 26 07:08:13 2011
Classification: UNCLASSIFIED
Caveats: NONE
John -
Thanks. I will look at how I can modify my script to only use the
forecast times available in the forecast data set.
For now, it seems to run fine without any errors or warnings, just
flags occurrences where it doesn’t find the file and goes on to the
next file in the sequence.
Just to be clear on my masking region, since I want to use a single
polyline to score over my study domains in UT, I should specify the
.poly file in the mask_poly and leave the mask_grid blank, right?
Do you know where I can get archived NAM data? I've searched around at
NCEP/NOMAD and can only locate old NAM forecast datasets back to June
2010. I am looking for older data back into 2009.
John
-----Original Message-----
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent: Monday, April 25, 2011 8:04 PM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET (UNCLASSIFIED)
John,
I'm sorry for the delay in getting back to you. It was a busy day
here.
I'm glad you were able to get Point-Stat running on the NAM data. NAM
forecasts are produced 4 times per day (00Z, 06Z, 12Z, and 18Z) out to
84 hours at 3-hourly intervals. If it's easier for you to script up
calls to Point-Stat to run every hour, that's fine. It'll just error
out when the input NAM file you specify does not exist. We typically
handle that sort of thing in the script and only call Point-Stat when
the input file actually exists. But however you want to handle it is
fine.
When you run Point-Stat, you have to specify at least one masking
region using mask_grid or mask_poly. And since you only want to use a
single polyline, leaving mask_poly blank is definitely the thing to
do.
Regarding sources of observations, all I'd suggest is using the
PREPRBUFR point observations - specifically those available for NDAS
(North American Data Assimilation). A 1-month archive of them can be
found here:
http://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/
You'd run them through PB2NC before using them in Point-Stat.
Sorry I wasn't able to help more promptly, but I'm glad you were able
to get it up and running by yourself.
Just let me know if any more questions arise.
Thanks,
John
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> I think I have point_stat running on the NAM data now.
>
> Summary of required changes to my run script and config files:
>
> I left the run script as I sent it to you. Even though the loop on
> line 81 cycles through all possible forecast verification times (00,
> 01, 02, ...24), point_stat doesn't have any errors. It just states
> that it can't open NAM files for the times where NAM doesn't have a
> forecast. (i.e. 01, 02, 04, 05,
> ...)
>
> I changed my config file to eliminate the fcst_field and associated
> fcst_thresh thresholds which were not present in the NAM GRIB files.
> This prevented the error when point_stat can't find a particular
> variable I asked for in the config file.
>
> I changed the config file to eliminate the scoring over the entire
NAM
> domain which is CONUS by changing ["FULL"] to []. Now the only
region
> I score over is the one I set in the config file using the mask_poly
> ascii file "DUGd01.poly".
>
> See attached point_stat log file.
>
> I inspected the ME, MAE and RMSE stats in the .cnt result file and
> they look reasonable.
>
> Do you have any observations/suggestions from your examination of
the
> info I sent?
>
> Thanks.
>
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Monday, April 25, 2011 11:31 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET
> (UNCLASSIFIED)
>
> Hello John,
>
> This is John Halley Gotway. I've been following the message traffic
> on this.
> Paul's really busy this week on another project, but I'd be happy to
> help you with it. I understand that you need an email address for a
> "SAFE"
> transfer.
> My email address is:
>
> johnhg at ucar.edu
>
> Thanks,
> John
>
> On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
>> anks for checking on it. I will attempt to deliver the file by
Secure
>> Access File Exchange (SAFE). Can you send me an email address where
>> SAFE can send you a link to the server and password to download the
>> file?
>>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: John Halley Gotway
Time: Tue Apr 26 08:59:51 2011
John,
Yes, that's correct. List the polyline file in the "mask_poly"
parameter and leave "mask_grid" empty.
Acquiring archived data - both forecasts and observations - is always
an issue. A good source of data is the NCAR CISL research data
archive. You'll likely have to fill out the free registration
form to access this site. Dataset 335.0 contains NCEP model data:
http://dss.ucar.edu/datasets/ds335.0/
Through that site, you can request access to NAM data going back to
2006. Here's a link for the 2009 data:
http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
Please note that this data is in GRIB2 format. And MET can currently
only read GRIB version 1. If necessary, I'd suggest using the
"cnvgrib" tool to convert from GRIB2 to GRIB1.
Hope that helps.
John
On 04/26/2011 07:08 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> Thanks. I will look at how I can modify my script to only use the
forecast times available in the forecast data set.
> For now, it seems to run fine without any errors or warnings, just
flags occurrences where it doesn’t find the file and goes on to the
next file in the sequence.
>
> Just to be clear on my masking region, since I want to use a single
polyline to score over my study domains in UT, I should specify the
.poly file in the mask_poly and leave the mask_grid blank, right?
>
> Do you know where I can get archived NAM data? I've searched around
at NCEP/NOMAD and can only locate old NAM forecast datasets back to
June 2010. I am looking for older data back into 2009.
>
> John
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Monday, April 25, 2011 8:04 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET (UNCLASSIFIED)
>
> John,
>
> I'm sorry for the delay in getting back to you. It was a busy day
here.
>
> I'm glad you were able to get Point-Stat running on the NAM data.
NAM forecasts are produced 4 times per day (00Z, 06Z, 12Z, and 18Z)
out to 84 hours at 3-hourly intervals. If it's easier for you to
script up calls to Point-Stat to run every hour, that's fine. It'll
just error out when the input NAM file you specify does not exist. We
typically handle that sort of thing in the script and only call Point-
Stat when the input file actually exists. But however you want to
handle it is fine.
>
> When you run Point-Stat, you have to specify at least one masking
region using mask_grid or mask_poly. And since you only want to use a
single polyline, leaving mask_poly blank is definitely the thing to
do.
>
> Regarding sources of observations, all I'd suggest is using the
PREPRBUFR point observations - specifically those available for NDAS
(North American Data Assimilation). A 1-month archive of them can be
found here:
> http://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/
>
> You'd run them through PB2NC before using them in Point-Stat.
>
> Sorry I wasn't able to help more promptly, but I'm glad you were
able to get it up and running by yourself.
>
> Just let me know if any more questions arise.
>
> Thanks,
> John
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> I think I have point_stat running on the NAM data now.
>>
>> Summary of required changes to my run script and config files:
>>
>> I left the run script as I sent it to you. Even though the loop on
>> line 81 cycles through all possible forecast verification times
(00,
>> 01, 02, ...24), point_stat doesn't have any errors. It just states
>> that it can't open NAM files for the times where NAM doesn't have a
>> forecast. (i.e. 01, 02, 04, 05,
>> ...)
>>
>> I changed my config file to eliminate the fcst_field and associated
>> fcst_thresh thresholds which were not present in the NAM GRIB
files.
>> This prevented the error when point_stat can't find a particular
>> variable I asked for in the config file.
>>
>> I changed the config file to eliminate the scoring over the entire
NAM
>> domain which is CONUS by changing ["FULL"] to []. Now the only
region
>> I score over is the one I set in the config file using the
mask_poly
>> ascii file "DUGd01.poly".
>>
>> See attached point_stat log file.
>>
>> I inspected the ME, MAE and RMSE stats in the .cnt result file and
>> they look reasonable.
>>
>> Do you have any observations/suggestions from your examination of
the
>> info I sent?
>>
>> Thanks.
>>
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Sent: Monday, April 25, 2011 11:31 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> Hello John,
>>
>> This is John Halley Gotway. I've been following the message
traffic
>> on this.
>> Paul's really busy this week on another project, but I'd be happy
to
>> help you with it. I understand that you need an email address for
a
>> "SAFE"
>> transfer.
>> My email address is:
>>
>> johnhg at ucar.edu
>>
>> Thanks,
>> John
>>
>> On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
>>> anks for checking on it. I will attempt to deliver the file by
Secure
>>> Access File Exchange (SAFE). Can you send me an email address
where
>>> SAFE can send you a link to the server and password to download
the
>>> file?
>>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>>
>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
Subject: Use of NAM output in MET (UNCLASSIFIED)
From: Raby, John
Time: Tue Apr 26 10:17:32 2011
Classification: UNCLASSIFIED
Caveats: NONE
John -
Thanks for the clarification and the leads on NAM forecast datasets.
John
-----Original Message-----
From: RAL HelpDesk {for John Halley Gotway} [mailto:met_help at ucar.edu]
Sent: Tuesday, April 26, 2011 9:00 AM
To: Raby, John (Civ, ARL/CISD)
Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET (UNCLASSIFIED)
John,
Yes, that's correct. List the polyline file in the "mask_poly"
parameter and leave "mask_grid" empty.
Acquiring archived data - both forecasts and observations - is always
an issue. A good source of data is the NCAR CISL research data
archive. You'll likely have to fill out the free registration form to
access this site. Dataset 335.0 contains NCEP model data:
http://dss.ucar.edu/datasets/ds335.0/
Through that site, you can request access to NAM data going back to
2006. Here's a link for the 2009 data:
http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
Please note that this data is in GRIB2 format. And MET can currently
only read GRIB version 1. If necessary, I'd suggest using the
"cnvgrib" tool to convert from GRIB2 to GRIB1.
Hope that helps.
John
On 04/26/2011 07:08 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> Thanks. I will look at how I can modify my script to only use the
forecast times available in the forecast data set.
> For now, it seems to run fine without any errors or warnings, just
flags occurrences where it doesn’t find the file and goes on to the
next file in the sequence.
>
> Just to be clear on my masking region, since I want to use a single
polyline to score over my study domains in UT, I should specify the
.poly file in the mask_poly and leave the mask_grid blank, right?
>
> Do you know where I can get archived NAM data? I've searched around
at NCEP/NOMAD and can only locate old NAM forecast datasets back to
June 2010. I am looking for older data back into 2009.
>
> John
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Monday, April 25, 2011 8:04 PM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
> MET (UNCLASSIFIED)
>
> John,
>
> I'm sorry for the delay in getting back to you. It was a busy day
here.
>
> I'm glad you were able to get Point-Stat running on the NAM data.
NAM forecasts are produced 4 times per day (00Z, 06Z, 12Z, and 18Z)
out to 84 hours at 3-hourly intervals. If it's easier for you to
script up calls to Point-Stat to run every hour, that's fine. It'll
just error out when the input NAM file you specify does not exist. We
typically handle that sort of thing in the script and only call Point-
Stat when the input file actually exists. But however you want to
handle it is fine.
>
> When you run Point-Stat, you have to specify at least one masking
region using mask_grid or mask_poly. And since you only want to use a
single polyline, leaving mask_poly blank is definitely the thing to
do.
>
> Regarding sources of observations, all I'd suggest is using the
PREPRBUFR point observations - specifically those available for NDAS
(North American Data Assimilation). A 1-month archive of them can be
found here:
> http://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/
>
> You'd run them through PB2NC before using them in Point-Stat.
>
> Sorry I wasn't able to help more promptly, but I'm glad you were
able to get it up and running by yourself.
>
> Just let me know if any more questions arise.
>
> Thanks,
> John
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> I think I have point_stat running on the NAM data now.
>>
>> Summary of required changes to my run script and config files:
>>
>> I left the run script as I sent it to you. Even though the loop on
>> line 81 cycles through all possible forecast verification times
(00,
>> 01, 02, ...24), point_stat doesn't have any errors. It just states
>> that it can't open NAM files for the times where NAM doesn't have a
>> forecast. (i.e. 01, 02, 04, 05,
>> ...)
>>
>> I changed my config file to eliminate the fcst_field and associated
>> fcst_thresh thresholds which were not present in the NAM GRIB
files.
>> This prevented the error when point_stat can't find a particular
>> variable I asked for in the config file.
>>
>> I changed the config file to eliminate the scoring over the entire
>> NAM domain which is CONUS by changing ["FULL"] to []. Now the only
>> region I score over is the one I set in the config file using the
>> mask_poly ascii file "DUGd01.poly".
>>
>> See attached point_stat log file.
>>
>> I inspected the ME, MAE and RMSE stats in the .cnt result file and
>> they look reasonable.
>>
>> Do you have any observations/suggestions from your examination of
the
>> info I sent?
>>
>> Thanks.
>>
>> John
>>
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
>> [mailto:met_help at ucar.edu]
>> Sent: Monday, April 25, 2011 11:31 AM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET
>> (UNCLASSIFIED)
>>
>> Hello John,
>>
>> This is John Halley Gotway. I've been following the message
traffic
>> on this.
>> Paul's really busy this week on another project, but I'd be happy
to
>> help you with it. I understand that you need an email address for
a
>> "SAFE"
>> transfer.
>> My email address is:
>>
>> johnhg at ucar.edu
>>
>> Thanks,
>> John
>>
>> On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
>>> anks for checking on it. I will attempt to deliver the file by
>>> Secure Access File Exchange (SAFE). Can you send me an email
address
>>> where SAFE can send you a link to the server and password to
>>> download the file?
>>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>>
>
>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
Classification: UNCLASSIFIED
Caveats: NONE
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in MET (UNCLASSIFIED)
From: John Halley Gotway
Time: Tue Apr 26 11:09:01 2011
John,
Sure. No problem. I'll go ahead and re-resolve this ticket. If more
questions arise, please just send us a new message to
met_help at ucar.edu.
Thanks,
John
On 04/26/2011 10:17 AM, RAL HelpDesk {for Raby, John} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
> John -
>
> Thanks for the clarification and the leads on NAM forecast datasets.
> John
>
>
> -----Original Message-----
> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
> Sent: Tuesday, April 26, 2011 9:00 AM
> To: Raby, John (Civ, ARL/CISD)
> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output in
MET (UNCLASSIFIED)
>
> John,
>
> Yes, that's correct. List the polyline file in the "mask_poly"
parameter and leave "mask_grid" empty.
>
> Acquiring archived data - both forecasts and observations - is
always an issue. A good source of data is the NCAR CISL research data
archive. You'll likely have to fill out the free registration form to
access this site. Dataset 335.0 contains NCEP model data:
> http://dss.ucar.edu/datasets/ds335.0/
>
> Through that site, you can request access to NAM data going back to
2006. Here's a link for the 2009 data:
> http://dss.ucar.edu/datasets/ds335.0/MSS-rqst-list.html?g=809
>
> Please note that this data is in GRIB2 format. And MET can
currently only read GRIB version 1. If necessary, I'd suggest using
the "cnvgrib" tool to convert from GRIB2 to GRIB1.
>
> Hope that helps.
>
> John
>
> On 04/26/2011 07:08 AM, RAL HelpDesk {for Raby, John} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>> John -
>>
>> Thanks. I will look at how I can modify my script to only use the
forecast times available in the forecast data set.
>> For now, it seems to run fine without any errors or warnings, just
flags occurrences where it doesn’t find the file and goes on to the
next file in the sequence.
>>
>> Just to be clear on my masking region, since I want to use a single
polyline to score over my study domains in UT, I should specify the
.poly file in the mask_poly and leave the mask_grid blank, right?
>>
>> Do you know where I can get archived NAM data? I've searched around
at NCEP/NOMAD and can only locate old NAM forecast datasets back to
June 2010. I am looking for older data back into 2009.
>>
>> John
>>
>> -----Original Message-----
>> From: RAL HelpDesk {for John Halley Gotway}
[mailto:met_help at ucar.edu]
>> Sent: Monday, April 25, 2011 8:04 PM
>> To: Raby, John (Civ, ARL/CISD)
>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>> Subject: RE: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>> MET (UNCLASSIFIED)
>>
>> John,
>>
>> I'm sorry for the delay in getting back to you. It was a busy day
here.
>>
>> I'm glad you were able to get Point-Stat running on the NAM data.
NAM forecasts are produced 4 times per day (00Z, 06Z, 12Z, and 18Z)
out to 84 hours at 3-hourly intervals. If it's easier for you to
script up calls to Point-Stat to run every hour, that's fine. It'll
just error out when the input NAM file you specify does not exist. We
typically handle that sort of thing in the script and only call Point-
Stat when the input file actually exists. But however you want to
handle it is fine.
>>
>> When you run Point-Stat, you have to specify at least one masking
region using mask_grid or mask_poly. And since you only want to use a
single polyline, leaving mask_poly blank is definitely the thing to
do.
>>
>> Regarding sources of observations, all I'd suggest is using the
PREPRBUFR point observations - specifically those available for NDAS
(North American Data Assimilation). A 1-month archive of them can be
found here:
>> http://nomads.ncep.noaa.gov/pub/data/nccf/com/nam/prod/
>>
>> You'd run them through PB2NC before using them in Point-Stat.
>>
>> Sorry I wasn't able to help more promptly, but I'm glad you were
able to get it up and running by yourself.
>>
>> Just let me know if any more questions arise.
>>
>> Thanks,
>> John
>>
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=46262 >
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>> John -
>>>
>>> I think I have point_stat running on the NAM data now.
>>>
>>> Summary of required changes to my run script and config files:
>>>
>>> I left the run script as I sent it to you. Even though the loop on
>>> line 81 cycles through all possible forecast verification times
(00,
>>> 01, 02, ...24), point_stat doesn't have any errors. It just states
>>> that it can't open NAM files for the times where NAM doesn't have
a
>>> forecast. (i.e. 01, 02, 04, 05,
>>> ...)
>>>
>>> I changed my config file to eliminate the fcst_field and
associated
>>> fcst_thresh thresholds which were not present in the NAM GRIB
files.
>>> This prevented the error when point_stat can't find a particular
>>> variable I asked for in the config file.
>>>
>>> I changed the config file to eliminate the scoring over the entire
>>> NAM domain which is CONUS by changing ["FULL"] to []. Now the only
>>> region I score over is the one I set in the config file using the
>>> mask_poly ascii file "DUGd01.poly".
>>>
>>> See attached point_stat log file.
>>>
>>> I inspected the ME, MAE and RMSE stats in the .cnt result file and
>>> they look reasonable.
>>>
>>> Do you have any observations/suggestions from your examination of
the
>>> info I sent?
>>>
>>> Thanks.
>>>
>>> John
>>>
>>>
>>> -----Original Message-----
>>> From: RAL HelpDesk {for John Halley Gotway}
>>> [mailto:met_help at ucar.edu]
>>> Sent: Monday, April 25, 2011 11:31 AM
>>> To: Raby, John (Civ, ARL/CISD)
>>> Cc: Passner, Jeff (Civ, ARL/CISD); Dumais, Bob (Civ, ARL/CISD)
>>> Subject: Re: [rt.rap.ucar.edu #46262] Resolved: Use of NAM output
in
>>> MET
>>> (UNCLASSIFIED)
>>>
>>> Hello John,
>>>
>>> This is John Halley Gotway. I've been following the message
traffic
>>> on this.
>>> Paul's really busy this week on another project, but I'd be happy
to
>>> help you with it. I understand that you need an email address for
a
>>> "SAFE"
>>> transfer.
>>> My email address is:
>>>
>>> johnhg at ucar.edu
>>>
>>> Thanks,
>>> John
>>>
>>> On 04/25/2011 09:52 AM, RAL HelpDesk {for Raby, John} wrote:
>>>> anks for checking on it. I will attempt to deliver the file by
>>>> Secure Access File Exchange (SAFE). Can you send me an email
address
>>>> where SAFE can send you a link to the server and password to
>>>> download the file?
>>>>
>>>
>>>
>>> Classification: UNCLASSIFIED
>>> Caveats: NONE
>>>
>>>
>>>
>>>
>>
>>
>>
>>
>> Classification: UNCLASSIFIED
>> Caveats: NONE
>>
>>
>>
>
>
> Classification: UNCLASSIFIED
> Caveats: NONE
>
>
>
------------------------------------------------
More information about the Met_help
mailing list