[Met_help] [rt.rap.ucar.edu #40986] History for application of MODE to satellite data
RAL HelpDesk {for John Halley Gotway}
met_help at ucar.edu
Thu Sep 23 13:43:46 MDT 2010
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I am very interested in applying MET, and especially MODE to the cloud water path field, as well as brightness temperature in satellite imagery during the analysis period of an observing system simulation experiment. My question revolves around the initial conversion of the WRF output data to grib1 format. Are cloud properties such as cloud water path (liquid and ice water path also) and cloud top pressure able to be converted to grib format? I haven't had any luck finding whether or not they are already supported grib fields in the wrf post processor. I'm sorry if this is not a question that should be directed to this help line, so if you are aware of someone who might be able to further help me that would be greatly appreciated.
Thanks,
Dan Hartung
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: John Halley Gotway
Time: Mon Sep 20 12:44:09 2010
Dan,
This really is more of a WRF-Help/WRF-PostProcessor question. I'll
take a shot at it, but if you need more detail, I'll refer you to WRF-
Help.
I believe the answer is yes, WPP is able to output those types of
fields. Please take a look at Table 3 in the WRF User's Guide:
http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
This table lists the fields that WPP can output. You'll see entries
for "Cloud water" and "Cloud ice", as well as "Cloud top pressure".
I'm believe these would correspond to GRIB codes 76, 58, and
1, respectively:
http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
Thanks,
John Halley Gotway
met_help at ucar.edu
RAL HelpDesk {for Dan Hartung} wrote:
> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
> Queue: met_help
> Subject: application of MODE to satellite data
> Owner: Nobody
> Requestors: daniel.hartung at ssec.wisc.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>
>
> Hi,
>
> I am very interested in applying MET, and especially MODE to the
cloud water path field, as well as brightness temperature in satellite
imagery during the analysis period of an observing system simulation
experiment. My question revolves around the initial conversion of the
WRF output data to grib1 format. Are cloud properties such as cloud
water path (liquid and ice water path also) and cloud top pressure
able to be converted to grib format? I haven't had any luck finding
whether or not they are already supported grib fields in the wrf post
processor. I'm sorry if this is not a question that should be
directed to this help line, so if you are aware of someone who might
be able to further help me that would be greatly appreciated.
>
> Thanks,
> Dan Hartung
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: Dan Hartung
Time: Wed Sep 22 08:17:01 2010
Hi John,
Thanks for the help.. I have at least been able to convert the WRF
output to GRIB and am in the process of trying to process some sample
files in MODE looking at the precipitable water field. I am getting
an error that says MODE can not find grib code 54 (PWAT) on L1 (and I
also tried Z1).. I'm not sure what to type in for a level in the
configuration file since this is a total column variable. Is there a
simple way of specifying this in the config file?
Thanks,
Dan
Copy of config file as it stands:
/
// Specify the fields to be used in the verification. The forecast
and
// observation fields may be specified separately.
//
// Each field is specified as a grib code or corresponding grib code
// abbreviation followed by an accumulation or vertical level
indicator.
//
// Each verification field is specified as one of the following:
// GC/ANNN for accumulation interval NNN
// GC/ZNNN for vertical level NNN
// GC/PNNN for pressure level NNN in hPa
// GC/PNNN-NNN for a range of pressure levels in hPa
// GC/LNNN for a generic level type
// GC/RNNN for a specific GRIB record number
// Where GC is the number of or abbreviation for the grib code
// to be verified.
// http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
//
// e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
//
fcst_field = "54/Z1";
obs_field = "54/Z1";
On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
> Dan,
>
> This really is more of a WRF-Help/WRF-PostProcessor question. I'll
take a shot at it, but if you need more detail, I'll refer you to WRF-
Help.
>
> I believe the answer is yes, WPP is able to output those types of
fields. Please take a look at Table 3 in the WRF User's Guide:
> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>
> This table lists the fields that WPP can output. You'll see entries
for "Cloud water" and "Cloud ice", as well as "Cloud top pressure".
I'm believe these would correspond to GRIB codes 76, 58, and
> 1, respectively:
> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>
> I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
> RAL HelpDesk {for Dan Hartung} wrote:
>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>> Queue: met_help
>> Subject: application of MODE to satellite data
>> Owner: Nobody
>> Requestors: daniel.hartung at ssec.wisc.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>
>>
>> Hi,
>>
>> I am very interested in applying MET, and especially MODE to the
cloud water path field, as well as brightness temperature in satellite
imagery during the analysis period of an observing system simulation
experiment. My question revolves around the initial conversion of the
WRF output data to grib1 format. Are cloud properties such as cloud
water path (liquid and ice water path also) and cloud top pressure
able to be converted to grib format? I haven't had any luck finding
whether or not they are already supported grib fields in the wrf post
processor. I'm sorry if this is not a question that should be
directed to this help line, so if you are aware of someone who might
be able to further help me that would be greatly appreciated.
>>
>> Thanks,
>> Dan Hartung
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: John Halley Gotway
Time: Wed Sep 22 08:48:02 2010
Dan,
Try running the wgrib utility to make sure that GRIB code 54 is in
your output file:
wgrib file.grb | grep "kpds5=54"
The value of kpds5 tells you the GRIB code for each record. If there
are no records with a GRIB code of 54, you'll need to look at how
you're running WPP. You may need to modify the "wrf_cntrl.parm"
file for WPP to tell it to output PWAT.
If you do have PWAT records in your GRIB file, then it's an issue with
MODE configuration file. Please send me a sample GRIB file containing
PWAT records along with your MODE configuration file.
I'll take a look and see if I can figure out what's going on. You can
post that data to our anonymous FTP site with the following commands:
ftp ftp.rap.ucar.edu
username=anonymous
password="your email address"
cd incoming/irap/met_help
mkdir hartung_data
cd hartung_data
put "your files"
bye
Thanks,
John
RAL HelpDesk {for Dan Hartung} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>
> Hi John,
>
> Thanks for the help.. I have at least been able to convert the WRF
output to GRIB and am in the process of trying to process some sample
files in MODE looking at the precipitable water field. I am getting
an error that says MODE can not find grib code 54 (PWAT) on L1 (and I
also tried Z1).. I'm not sure what to type in for a level in the
configuration file since this is a total column variable. Is there a
simple way of specifying this in the config file?
>
> Thanks,
> Dan
>
>
> Copy of config file as it stands:
>
> /
> // Specify the fields to be used in the verification. The forecast
and
> // observation fields may be specified separately.
> //
> // Each field is specified as a grib code or corresponding grib code
> // abbreviation followed by an accumulation or vertical level
indicator.
> //
> // Each verification field is specified as one of the following:
> // GC/ANNN for accumulation interval NNN
> // GC/ZNNN for vertical level NNN
> // GC/PNNN for pressure level NNN in hPa
> // GC/PNNN-NNN for a range of pressure levels in hPa
> // GC/LNNN for a generic level type
> // GC/RNNN for a specific GRIB record number
> // Where GC is the number of or abbreviation for the grib code
> // to be verified.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
> //
> fcst_field = "54/Z1";
> obs_field = "54/Z1";
>
>
>
> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>
>> Dan,
>>
>> This really is more of a WRF-Help/WRF-PostProcessor question. I'll
take a shot at it, but if you need more detail, I'll refer you to WRF-
Help.
>>
>> I believe the answer is yes, WPP is able to output those types of
fields. Please take a look at Table 3 in the WRF User's Guide:
>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>
>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>> 1, respectively:
>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>
>> I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
>>
>> Thanks,
>> John Halley Gotway
>> met_help at ucar.edu
>>
>> RAL HelpDesk {for Dan Hartung} wrote:
>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>> Queue: met_help
>>> Subject: application of MODE to satellite data
>>> Owner: Nobody
>>> Requestors: daniel.hartung at ssec.wisc.edu
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>
>>>
>>> Hi,
>>>
>>> I am very interested in applying MET, and especially MODE to the
cloud water path field, as well as brightness temperature in satellite
imagery during the analysis period of an observing system simulation
experiment. My question revolves around the initial conversion of the
WRF output data to grib1 format. Are cloud properties such as cloud
water path (liquid and ice water path also) and cloud top pressure
able to be converted to grib format? I haven't had any luck finding
whether or not they are already supported grib fields in the wrf post
processor. I'm sorry if this is not a question that should be
directed to this help line, so if you are aware of someone who might
be able to further help me that would be greatly appreciated.
>>>
>>> Thanks,
>>> Dan Hartung
>>>
>>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: Dan Hartung
Time: Wed Sep 22 09:07:14 2010
Hi John,
The PWAT field is present in the GRIB files so it must be a MODE
configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
Thanks,
Dan
On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley Gotway}
wrote:
> Dan,
>
> Try running the wgrib utility to make sure that GRIB code 54 is in
your output file:
> wgrib file.grb | grep "kpds5=54"
>
> The value of kpds5 tells you the GRIB code for each record. If
there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
> file for WPP to tell it to output PWAT.
>
> If you do have PWAT records in your GRIB file, then it's an issue
with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
> I'll take a look and see if I can figure out what's going on. You
can post that data to our anonymous FTP site with the following
commands:
>
> ftp ftp.rap.ucar.edu
> username=anonymous
> password="your email address"
> cd incoming/irap/met_help
> mkdir hartung_data
> cd hartung_data
> put "your files"
> bye
>
> Thanks,
> John
>
> RAL HelpDesk {for Dan Hartung} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>
>> Hi John,
>>
>> Thanks for the help.. I have at least been able to convert the WRF
output to GRIB and am in the process of trying to process some sample
files in MODE looking at the precipitable water field. I am getting
an error that says MODE can not find grib code 54 (PWAT) on L1 (and I
also tried Z1).. I'm not sure what to type in for a level in the
configuration file since this is a total column variable. Is there a
simple way of specifying this in the config file?
>>
>> Thanks,
>> Dan
>>
>>
>> Copy of config file as it stands:
>>
>> /
>> // Specify the fields to be used in the verification. The forecast
and
>> // observation fields may be specified separately.
>> //
>> // Each field is specified as a grib code or corresponding grib
code
>> // abbreviation followed by an accumulation or vertical level
indicator.
>> //
>> // Each verification field is specified as one of the following:
>> // GC/ANNN for accumulation interval NNN
>> // GC/ZNNN for vertical level NNN
>> // GC/PNNN for pressure level NNN in hPa
>> // GC/PNNN-NNN for a range of pressure levels in hPa
>> // GC/LNNN for a generic level type
>> // GC/RNNN for a specific GRIB record number
>> // Where GC is the number of or abbreviation for the grib code
>> // to be verified.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>> //
>> fcst_field = "54/Z1";
>> obs_field = "54/Z1";
>>
>>
>>
>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>
>>> Dan,
>>>
>>> This really is more of a WRF-Help/WRF-PostProcessor question.
I'll take a shot at it, but if you need more detail, I'll refer you to
WRF-Help.
>>>
>>> I believe the answer is yes, WPP is able to output those types of
fields. Please take a look at Table 3 in the WRF User's Guide:
>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>
>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>> 1, respectively:
>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>
>>> I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
>>>
>>> Thanks,
>>> John Halley Gotway
>>> met_help at ucar.edu
>>>
>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>> Queue: met_help
>>>> Subject: application of MODE to satellite data
>>>> Owner: Nobody
>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>
>>>>
>>>> Hi,
>>>>
>>>> I am very interested in applying MET, and especially MODE to the
cloud water path field, as well as brightness temperature in satellite
imagery during the analysis period of an observing system simulation
experiment. My question revolves around the initial conversion of the
WRF output data to grib1 format. Are cloud properties such as cloud
water path (liquid and ice water path also) and cloud top pressure
able to be converted to grib format? I haven't had any luck finding
whether or not they are already supported grib fields in the wrf post
processor. I'm sorry if this is not a question that should be
directed to this help line, so if you are aware of someone who might
be able to further help me that would be greatly appreciated.
>>>>
>>>> Thanks,
>>>> Dan Hartung
>>>>
>>>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: John Halley Gotway
Time: Wed Sep 22 12:26:38 2010
Dan,
Please try using the "-p" (for "passive") option. That may help:
ftp -p ftp.rap.ucar.edu
username=anonymous
password="your email address"
cd incoming/irap/met_help
mkdir hartung_data
cd hartung_data
put "your files"
bye
Thanks,
John
RAL HelpDesk {for Dan Hartung} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>
> Hi John,
>
> The PWAT field is present in the GRIB files so it must be a MODE
configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>
> Thanks,
> Dan
>
> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley Gotway}
wrote:
>
>> Dan,
>>
>> Try running the wgrib utility to make sure that GRIB code 54 is in
your output file:
>> wgrib file.grb | grep "kpds5=54"
>>
>> The value of kpds5 tells you the GRIB code for each record. If
there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>> file for WPP to tell it to output PWAT.
>>
>> If you do have PWAT records in your GRIB file, then it's an issue
with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>> I'll take a look and see if I can figure out what's going on. You
can post that data to our anonymous FTP site with the following
commands:
>>
>> ftp ftp.rap.ucar.edu
>> username=anonymous
>> password="your email address"
>> cd incoming/irap/met_help
>> mkdir hartung_data
>> cd hartung_data
>> put "your files"
>> bye
>>
>> Thanks,
>> John
>>
>> RAL HelpDesk {for Dan Hartung} wrote:
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>
>>> Hi John,
>>>
>>> Thanks for the help.. I have at least been able to convert the WRF
output to GRIB and am in the process of trying to process some sample
files in MODE looking at the precipitable water field. I am getting
an error that says MODE can not find grib code 54 (PWAT) on L1 (and I
also tried Z1).. I'm not sure what to type in for a level in the
configuration file since this is a total column variable. Is there a
simple way of specifying this in the config file?
>>>
>>> Thanks,
>>> Dan
>>>
>>>
>>> Copy of config file as it stands:
>>>
>>> /
>>> // Specify the fields to be used in the verification. The
forecast and
>>> // observation fields may be specified separately.
>>> //
>>> // Each field is specified as a grib code or corresponding grib
code
>>> // abbreviation followed by an accumulation or vertical level
indicator.
>>> //
>>> // Each verification field is specified as one of the following:
>>> // GC/ANNN for accumulation interval NNN
>>> // GC/ZNNN for vertical level NNN
>>> // GC/PNNN for pressure level NNN in hPa
>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>> // GC/LNNN for a generic level type
>>> // GC/RNNN for a specific GRIB record number
>>> // Where GC is the number of or abbreviation for the grib code
>>> // to be verified.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>> //
>>> fcst_field = "54/Z1";
>>> obs_field = "54/Z1";
>>>
>>>
>>>
>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>
>>>> Dan,
>>>>
>>>> This really is more of a WRF-Help/WRF-PostProcessor question.
I'll take a shot at it, but if you need more detail, I'll refer you to
WRF-Help.
>>>>
>>>> I believe the answer is yes, WPP is able to output those types of
fields. Please take a look at Table 3 in the WRF User's Guide:
>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>
>>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>> 1, respectively:
>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>
>>>> I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
>>>>
>>>> Thanks,
>>>> John Halley Gotway
>>>> met_help at ucar.edu
>>>>
>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>>> Queue: met_help
>>>>> Subject: application of MODE to satellite data
>>>>> Owner: Nobody
>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>> Status: new
>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>
>>>>>
>>>>> Hi,
>>>>>
>>>>> I am very interested in applying MET, and especially MODE to the
cloud water path field, as well as brightness temperature in satellite
imagery during the analysis period of an observing system simulation
experiment. My question revolves around the initial conversion of the
WRF output data to grib1 format. Are cloud properties such as cloud
water path (liquid and ice water path also) and cloud top pressure
able to be converted to grib format? I haven't had any luck finding
whether or not they are already supported grib fields in the wrf post
processor. I'm sorry if this is not a question that should be
directed to this help line, so if you are aware of someone who might
be able to further help me that would be greatly appreciated.
>>>>>
>>>>> Thanks,
>>>>> Dan Hartung
>>>>>
>>>>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: Dan Hartung
Time: Wed Sep 22 13:28:25 2010
John,
Hmm.. I tried that, but "-p" isn't an ftp option for me. Instead, I
have uploaded all of the files to our anonymous ftp site here at
CIMSS. You should be able to download all of the files by doing the
following:
ftp ftp.ssec.wisc.edu
username=anonymous
password="your email address"
cd pub/ssec/dhartung/hartung_data
mget *
bye
The GRIB obs file is in the "obs" folder and the GRIB forecast file is
in the "fcst" folder. I have also put the Mode configuration file in
the directory.
Let me know if you encounter any issues.
Thanks,
Dan
On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
> Dan,
>
> Please try using the "-p" (for "passive") option. That may help:
>
> ftp -p ftp.rap.ucar.edu
> username=anonymous
> password="your email address"
> cd incoming/irap/met_help
> mkdir hartung_data
> cd hartung_data
> put "your files"
> bye
>
> Thanks,
> John
>
>
> RAL HelpDesk {for Dan Hartung} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>
>> Hi John,
>>
>> The PWAT field is present in the GRIB files so it must be a MODE
configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>>
>> Thanks,
>> Dan
>>
>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>
>>> Dan,
>>>
>>> Try running the wgrib utility to make sure that GRIB code 54 is in
your output file:
>>> wgrib file.grb | grep "kpds5=54"
>>>
>>> The value of kpds5 tells you the GRIB code for each record. If
there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>>> file for WPP to tell it to output PWAT.
>>>
>>> If you do have PWAT records in your GRIB file, then it's an issue
with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>>> I'll take a look and see if I can figure out what's going on. You
can post that data to our anonymous FTP site with the following
commands:
>>>
>>> ftp ftp.rap.ucar.edu
>>> username=anonymous
>>> password="your email address"
>>> cd incoming/irap/met_help
>>> mkdir hartung_data
>>> cd hartung_data
>>> put "your files"
>>> bye
>>>
>>> Thanks,
>>> John
>>>
>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>
>>>> Hi John,
>>>>
>>>> Thanks for the help.. I have at least been able to convert the
WRF output to GRIB and am in the process of trying to process some
sample files in MODE looking at the precipitable water field. I am
getting an error that says MODE can not find grib code 54 (PWAT) on L1
(and I also tried Z1).. I'm not sure what to type in for a level in
the configuration file since this is a total column variable. Is
there a simple way of specifying this in the config file?
>>>>
>>>> Thanks,
>>>> Dan
>>>>
>>>>
>>>> Copy of config file as it stands:
>>>>
>>>> /
>>>> // Specify the fields to be used in the verification. The
forecast and
>>>> // observation fields may be specified separately.
>>>> //
>>>> // Each field is specified as a grib code or corresponding grib
code
>>>> // abbreviation followed by an accumulation or vertical level
indicator.
>>>> //
>>>> // Each verification field is specified as one of the following:
>>>> // GC/ANNN for accumulation interval NNN
>>>> // GC/ZNNN for vertical level NNN
>>>> // GC/PNNN for pressure level NNN in hPa
>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>> // GC/LNNN for a generic level type
>>>> // GC/RNNN for a specific GRIB record number
>>>> // Where GC is the number of or abbreviation for the grib code
>>>> // to be verified.
>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>> //
>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>>> //
>>>> fcst_field = "54/Z1";
>>>> obs_field = "54/Z1";
>>>>
>>>>
>>>>
>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>
>>>>> Dan,
>>>>>
>>>>> This really is more of a WRF-Help/WRF-PostProcessor question.
I'll take a shot at it, but if you need more detail, I'll refer you to
WRF-Help.
>>>>>
>>>>> I believe the answer is yes, WPP is able to output those types
of fields. Please take a look at Table 3 in the WRF User's Guide:
>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>
>>>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>>> 1, respectively:
>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>
>>>>> I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
>>>>>
>>>>> Thanks,
>>>>> John Halley Gotway
>>>>> met_help at ucar.edu
>>>>>
>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>>>> Queue: met_help
>>>>>> Subject: application of MODE to satellite data
>>>>>> Owner: Nobody
>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>> Status: new
>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I am very interested in applying MET, and especially MODE to
the cloud water path field, as well as brightness temperature in
satellite imagery during the analysis period of an observing system
simulation experiment. My question revolves around the initial
conversion of the WRF output data to grib1 format. Are cloud
properties such as cloud water path (liquid and ice water path also)
and cloud top pressure able to be converted to grib format? I haven't
had any luck finding whether or not they are already supported grib
fields in the wrf post processor. I'm sorry if this is not a question
that should be directed to this help line, so if you are aware of
someone who might be able to further help me that would be greatly
appreciated.
>>>>>>
>>>>>> Thanks,
>>>>>> Dan Hartung
>>>>>>
>>>>>>
>>
>
------------------------------------------------
Subject: application of MODE to satellite data
From: John Halley Gotway
Time: Wed Sep 22 15:19:53 2010
Dan,
OK, here's the output of wgrib for your forecast file:
778:51443170:d=08010700:PWAT:kpds5=54:kpds6=200:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:atmos
col:36hr fcst:NAve=0
822:54154874:d=08010700:PWAT:kpds5=54:kpds6=116:kpds7=7680:TR=10:P1=0:P2=36:TimeU=1:30-
0 mb above gnd:36hr fcst:NAve=0
The first record is PWAT defined over the entire atmosphere column,
which I assume is what you want to use. The level value for this is 0
(kpds7=0). So please try setting:
fcst_field = "54/L0";
obs_field = "54/L0";
When I did that, it was able to find the forecast record, but errored
out with the following:
ERROR: main() -> forecast and observation grid dimensions do not
match (265, 171) != (797, 515)
It appears your forecast and observation data aren't on the same grid.
MODE requires that users put their data onto a common grid before
comparing them. We recommend using the copygb tool
(http://www.cpc.noaa.gov/products/wesley/copygb.html) to regrid your
GRIB data. The following command should work to regrid your forecast
data onto the observation domain:
copygb -xg"255 3 797 515 21659 -119878 8 -97500 6000 6000 0 64
60000 30000" -k'4*-1 54' fcst/WRFPRS_d01.036
fcst/WRFPRS_d01.036_regrid
FYI, I constructed this grid definition by looking at the wgrib output
of your observation data (listed below) and following some
instructions from the MET website:
http://www.dtcenter.org/met/users/support/OnLinePractical/OnLinePractical_810/copygb/run3.php
wgrib -d 1 -V obs/WRFPRS_d01.036
...
Lambert Conf: Lat1 21.659000 Lon1 -119.878000 Lov -97.500000
Latin1 60.000000 Latin2 30.000000 LatSP 0.000000 LonSP 0.000000
North Pole (797 x 515) Dx 6.000000 Dy 6.000000 scan 64 mode 137
The -k argument tells copygb to only copy over the PWAT (grib code =
54) records.
Once the datasets are on the same grid, you can run them through MODE.
I've attached a png image showing a summary of the output I see. I
got this output after making the following changes to your
MODE config file:
(1) Set fcst_field = "54/L0";
(2) Set obs_field = "54/L0";
(3) Set mask_poly = ""; - Since I don't have your polyline file.
(4) Set mask_poly_flag = 0;
(5) Set zero_border_size = 1; - Unless you have a good reason for
making this larger, I'd suggest using a value of 1.
Here's the command I used to run MODE:
bin/mode fcst/WRFPRS_d01.036_regrid obs/WRFPRS_d01.036
WrfModeConfig_PWAT -outdir out -v 2
Looking at the objects it found, I'd suggest modifying the thresholds
you're using. The objects that we defined using the current setting
don't look very useful. Perhaps you could increase your
thresholds to somewhere around 28.
Hope that's helpful.
Thanks,
John
RAL HelpDesk {for Dan Hartung} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>
> John,
>
> Hmm.. I tried that, but "-p" isn't an ftp option for me. Instead, I
have uploaded all of the files to our anonymous ftp site here at
CIMSS. You should be able to download all of the files by doing the
following:
>
>
> ftp ftp.ssec.wisc.edu
> username=anonymous
> password="your email address"
> cd pub/ssec/dhartung/hartung_data
> mget *
> bye
>
> The GRIB obs file is in the "obs" folder and the GRIB forecast file
is in the "fcst" folder. I have also put the Mode configuration file
in the directory.
>
> Let me know if you encounter any issues.
>
> Thanks,
> Dan
>
>
> On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>
>> Dan,
>>
>> Please try using the "-p" (for "passive") option. That may help:
>>
>> ftp -p ftp.rap.ucar.edu
>> username=anonymous
>> password="your email address"
>> cd incoming/irap/met_help
>> mkdir hartung_data
>> cd hartung_data
>> put "your files"
>> bye
>>
>> Thanks,
>> John
>>
>>
>> RAL HelpDesk {for Dan Hartung} wrote:
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>
>>> Hi John,
>>>
>>> The PWAT field is present in the GRIB files so it must be a MODE
configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>>>
>>> Thanks,
>>> Dan
>>>
>>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>
>>>> Dan,
>>>>
>>>> Try running the wgrib utility to make sure that GRIB code 54 is
in your output file:
>>>> wgrib file.grb | grep "kpds5=54"
>>>>
>>>> The value of kpds5 tells you the GRIB code for each record. If
there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>>>> file for WPP to tell it to output PWAT.
>>>>
>>>> If you do have PWAT records in your GRIB file, then it's an issue
with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>>>> I'll take a look and see if I can figure out what's going on.
You can post that data to our anonymous FTP site with the following
commands:
>>>>
>>>> ftp ftp.rap.ucar.edu
>>>> username=anonymous
>>>> password="your email address"
>>>> cd incoming/irap/met_help
>>>> mkdir hartung_data
>>>> cd hartung_data
>>>> put "your files"
>>>> bye
>>>>
>>>> Thanks,
>>>> John
>>>>
>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>
>>>>> Hi John,
>>>>>
>>>>> Thanks for the help.. I have at least been able to convert the
WRF output to GRIB and am in the process of trying to process some
sample files in MODE looking at the precipitable water field. I am
getting an error that says MODE can not find grib code 54 (PWAT) on L1
(and I also tried Z1).. I'm not sure what to type in for a level in
the configuration file since this is a total column variable. Is
there a simple way of specifying this in the config file?
>>>>>
>>>>> Thanks,
>>>>> Dan
>>>>>
>>>>>
>>>>> Copy of config file as it stands:
>>>>>
>>>>> /
>>>>> // Specify the fields to be used in the verification. The
forecast and
>>>>> // observation fields may be specified separately.
>>>>> //
>>>>> // Each field is specified as a grib code or corresponding grib
code
>>>>> // abbreviation followed by an accumulation or vertical level
indicator.
>>>>> //
>>>>> // Each verification field is specified as one of the following:
>>>>> // GC/ANNN for accumulation interval NNN
>>>>> // GC/ZNNN for vertical level NNN
>>>>> // GC/PNNN for pressure level NNN in hPa
>>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>>> // GC/LNNN for a generic level type
>>>>> // GC/RNNN for a specific GRIB record number
>>>>> // Where GC is the number of or abbreviation for the grib
code
>>>>> // to be verified.
>>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>> //
>>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>>>> //
>>>>> fcst_field = "54/Z1";
>>>>> obs_field = "54/Z1";
>>>>>
>>>>>
>>>>>
>>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>
>>>>>> Dan,
>>>>>>
>>>>>> This really is more of a WRF-Help/WRF-PostProcessor question.
I'll take a shot at it, but if you need more detail, I'll refer you to
WRF-Help.
>>>>>>
>>>>>> I believe the answer is yes, WPP is able to output those types
of fields. Please take a look at Table 3 in the WRF User's Guide:
>>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>>
>>>>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>>>> 1, respectively:
>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>
>>>>>> I'd say, give WPP a shot, and once you have your output in GRIB
format, please let us know if you have any trouble reading it into the
MET tools.
>>>>>>
>>>>>> Thanks,
>>>>>> John Halley Gotway
>>>>>> met_help at ucar.edu
>>>>>>
>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>>>>> Queue: met_help
>>>>>>> Subject: application of MODE to satellite data
>>>>>>> Owner: Nobody
>>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>>> Status: new
>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I am very interested in applying MET, and especially MODE to
the cloud water path field, as well as brightness temperature in
satellite imagery during the analysis period of an observing system
simulation experiment. My question revolves around the initial
conversion of the WRF output data to grib1 format. Are cloud
properties such as cloud water path (liquid and ice water path also)
and cloud top pressure able to be converted to grib format? I haven't
had any luck finding whether or not they are already supported grib
fields in the wrf post processor. I'm sorry if this is not a question
that should be directed to this help line, so if you are aware of
someone who might be able to further help me that would be greatly
appreciated.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Dan Hartung
>>>>>>>
>>>>>>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: Dan Hartung
Time: Wed Sep 22 22:27:22 2010
Hi John,
This is exceptionally helpful. I will try it out on my
machine with the test files tomorrow when I get into the
office. I guess I was not familiar with how to read the
output of the wgrib utility so I didn't know that kpds7
gave the level. Also, the reason I was using a zero_border
of 10 was just to make sure that the errors at the domain
boundaries weren't dominating the verification statistics.
I will let you know if I have any other questions. We
really appreciate how wonderful all of you guys at MET
help are at what you do. Since we began utilizing the
software package here at CIMSS this summer, the technical
support has been awesome. Look forward to meeting you at
the MET verification workshop in November if you will be
present.
Thanks again,
Dan
On Wed, 22 Sep 2010 15:19:54 -0600
"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:
> Dan,
>
> OK, here's the output of wgrib for your forecast file:
>
778:51443170:d=08010700:PWAT:kpds5=54:kpds6=200:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:atmos
>col:36hr fcst:NAve=0
>
822:54154874:d=08010700:PWAT:kpds5=54:kpds6=116:kpds7=7680:TR=10:P1=0:P2=36:TimeU=1:30-
0
>mb above gnd:36hr fcst:NAve=0
>
> The first record is PWAT defined over the entire
>atmosphere column, which I assume is what you want to
>use. The level value for this is 0 (kpds7=0). So please
>try setting:
> fcst_field = "54/L0";
> obs_field = "54/L0";
>
> When I did that, it was able to find the forecast
>record, but errored out with the following:
> ERROR: main() -> forecast and observation grid
>dimensions do not match (265, 171) != (797, 515)
>
> It appears your forecast and observation data aren't on
>the same grid. MODE requires that users put their data
>onto a common grid before comparing them. We recommend
>using the copygb tool
> (http://www.cpc.noaa.gov/products/wesley/copygb.html) to
>regrid your GRIB data. The following command should work
>to regrid your forecast data onto the observation domain:
>
> copygb -xg"255 3 797 515 21659 -119878 8 -97500 6000
>6000 0 64 60000 30000" -k'4*-1 54' fcst/WRFPRS_d01.036
>fcst/WRFPRS_d01.036_regrid
>
>FYI, I constructed this grid definition by looking at the
>wgrib output of your observation data (listed below) and
>following some instructions from the MET website:
>
http://www.dtcenter.org/met/users/support/OnLinePractical/OnLinePractical_810/copygb/run3.php
>
> wgrib -d 1 -V obs/WRFPRS_d01.036
> ...
> Lambert Conf: Lat1 21.659000 Lon1 -119.878000 Lov
>-97.500000
> Latin1 60.000000 Latin2 30.000000 LatSP 0.000000
>LonSP 0.000000
> North Pole (797 x 515) Dx 6.000000 Dy 6.000000 scan
>64 mode 137
>
> The -k argument tells copygb to only copy over the PWAT
>(grib code = 54) records.
>
> Once the datasets are on the same grid, you can run them
>through MODE. I've attached a png image showing a
>summary of the output I see. I got this output after
>making the following changes to your
> MODE config file:
> (1) Set fcst_field = "54/L0";
> (2) Set obs_field = "54/L0";
> (3) Set mask_poly = ""; - Since I don't have your
>polyline file.
> (4) Set mask_poly_flag = 0;
> (5) Set zero_border_size = 1; - Unless you have a good
>reason for making this larger, I'd suggest using a value
>of 1.
>
> Here's the command I used to run MODE:
> bin/mode fcst/WRFPRS_d01.036_regrid obs/WRFPRS_d01.036
>WrfModeConfig_PWAT -outdir out -v 2
>
> Looking at the objects it found, I'd suggest modifying
>the thresholds you're using. The objects that we defined
>using the current setting don't look very useful.
> Perhaps you could increase your
> thresholds to somewhere around 28.
>
> Hope that's helpful.
>
> Thanks,
> John
>
>
> RAL HelpDesk {for Dan Hartung} wrote:
>> <URL:
>>https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>
>> John,
>>
>> Hmm.. I tried that, but "-p" isn't an ftp option for me.
>> Instead, I have uploaded all of the files to our
>>anonymous ftp site here at CIMSS. You should be able to
>>download all of the files by doing the following:
>>
>>
>> ftp ftp.ssec.wisc.edu
>> username=anonymous
>> password="your email address"
>> cd pub/ssec/dhartung/hartung_data
>> mget *
>> bye
>>
>> The GRIB obs file is in the "obs" folder and the GRIB
>>forecast file is in the "fcst" folder. I have also put
>>the Mode configuration file in the directory.
>>
>> Let me know if you encounter any issues.
>>
>> Thanks,
>> Dan
>>
>>
>> On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John
>>Halley Gotway} wrote:
>>
>>> Dan,
>>>
>>> Please try using the "-p" (for "passive") option. That
>>>may help:
>>>
>>> ftp -p ftp.rap.ucar.edu
>>> username=anonymous
>>> password="your email address"
>>> cd incoming/irap/met_help
>>> mkdir hartung_data
>>> cd hartung_data
>>> put "your files"
>>> bye
>>>
>>> Thanks,
>>> John
>>>
>>>
>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>> <URL:
>>>>https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>
>>>> Hi John,
>>>>
>>>> The PWAT field is present in the GRIB files so it must
>>>>be a MODE configuration issue. I am getting a permission
>>>>denied error when trying to upload the files after
>>>>following all of your steps below. I have already
>>>>created a "hartung_data" folder as well as subsequent
>>>>"obs" and "forecast" folders. Any idea why I'm getting
>>>>such an error?
>>>>
>>>> Thanks,
>>>> Dan
>>>>
>>>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John
>>>>Halley Gotway} wrote:
>>>>
>>>>> Dan,
>>>>>
>>>>> Try running the wgrib utility to make sure that GRIB
>>>>>code 54 is in your output file:
>>>>> wgrib file.grb | grep "kpds5=54"
>>>>>
>>>>> The value of kpds5 tells you the GRIB code for each
>>>>>record. If there are no records with a GRIB code of 54,
>>>>>you'll need to look at how you're running WPP. You may
>>>>>need to modify the "wrf_cntrl.parm"
>>>>> file for WPP to tell it to output PWAT.
>>>>>
>>>>> If you do have PWAT records in your GRIB file, then it's
>>>>>an issue with MODE configuration file. Please send me a
>>>>>sample GRIB file containing PWAT records along with your
>>>>>MODE configuration file.
>>>>> I'll take a look and see if I can figure out what's
>>>>>going on. You can post that data to our anonymous FTP
>>>>>site with the following commands:
>>>>>
>>>>> ftp ftp.rap.ucar.edu
>>>>> username=anonymous
>>>>> password="your email address"
>>>>> cd incoming/irap/met_help
>>>>> mkdir hartung_data
>>>>> cd hartung_data
>>>>> put "your files"
>>>>> bye
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>> <URL:
>>>>>>https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>
>>>>>> Hi John,
>>>>>>
>>>>>> Thanks for the help.. I have at least been able to
>>>>>>convert the WRF output to GRIB and am in the process of
>>>>>>trying to process some sample files in MODE looking at
>>>>>>the precipitable water field. I am getting an error that
>>>>>>says MODE can not find grib code 54 (PWAT) on L1 (and I
>>>>>>also tried Z1).. I'm not sure what to type in for a level
>>>>>>in the configuration file since this is a total column
>>>>>>variable. Is there a simple way of specifying this in
>>>>>>the config file?
>>>>>>
>>>>>> Thanks,
>>>>>> Dan
>>>>>>
>>>>>>
>>>>>> Copy of config file as it stands:
>>>>>>
>>>>>> /
>>>>>> // Specify the fields to be used in the verification.
>>>>>> The forecast and
>>>>>> // observation fields may be specified separately.
>>>>>> //
>>>>>> // Each field is specified as a grib code or
>>>>>>corresponding grib code
>>>>>> // abbreviation followed by an accumulation or vertical
>>>>>>level indicator.
>>>>>> //
>>>>>> // Each verification field is specified as one of the
>>>>>>following:
>>>>>> // GC/ANNN for accumulation interval NNN
>>>>>> // GC/ZNNN for vertical level NNN
>>>>>> // GC/PNNN for pressure level NNN in hPa
>>>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>>>> // GC/LNNN for a generic level type
>>>>>> // GC/RNNN for a specific GRIB record number
>>>>>> // Where GC is the number of or abbreviation for the
>>>>>>grib code
>>>>>> // to be verified.
>>>>>> //
>>>>>>http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>> //
>>>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10"
>>>>>>];
>>>>>> //
>>>>>> fcst_field = "54/Z1";
>>>>>> obs_field = "54/Z1";
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John
>>>>>>Halley Gotway} wrote:
>>>>>>
>>>>>>> Dan,
>>>>>>>
>>>>>>> This really is more of a WRF-Help/WRF-PostProcessor
>>>>>>>question. I'll take a shot at it, but if you need more
>>>>>>>detail, I'll refer you to WRF-Help.
>>>>>>>
>>>>>>> I believe the answer is yes, WPP is able to output those
>>>>>>>types of fields. Please take a look at Table 3 in the
>>>>>>>WRF User's Guide:
>>>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>>>
>>>>>>> This table lists the fields that WPP can output. You'll
>>>>>>>see entries for "Cloud water" and "Cloud ice", as well as
>>>>>>>"Cloud top pressure". I'm believe these would correspond
>>>>>>>to GRIB codes 76, 58, and
>>>>>>> 1, respectively:
>>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>
>>>>>>> I'd say, give WPP a shot, and once you have your output
>>>>>>>in GRIB format, please let us know if you have any
>>>>>>>trouble reading it into the MET tools.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> John Halley Gotway
>>>>>>> met_help at ucar.edu
>>>>>>>
>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>>>> Transaction: Ticket created by
>>>>>>>>daniel.hartung at ssec.wisc.edu
>>>>>>>> Queue: met_help
>>>>>>>> Subject: application of MODE to satellite data
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
>>>>>>>>https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I am very interested in applying MET, and especially
>>>>>>>>MODE to the cloud water path field, as well as brightness
>>>>>>>>temperature in satellite imagery during the analysis
>>>>>>>>period of an observing system simulation experiment. My
>>>>>>>>question revolves around the initial conversion of the
>>>>>>>>WRF output data to grib1 format. Are cloud properties
>>>>>>>>such as cloud water path (liquid and ice water path also)
>>>>>>>>and cloud top pressure able to be converted to grib
>>>>>>>>format? I haven't had any luck finding whether or not
>>>>>>>>they are already supported grib fields in the wrf post
>>>>>>>>processor. I'm sorry if this is not a question that
>>>>>>>>should be directed to this help line, so if you are aware
>>>>>>>>of someone who might be able to further help me that
>>>>>>>>would be greatly appreciated.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Dan Hartung
>>>>>>>>
>>>>>>>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: Dan Hartung
Time: Thu Sep 23 11:44:21 2010
Hi John,
I have one more question if you have time.. I am also trying to
compare cloud top pressure and cloud base height in MODE, but there
are multiple pressure fields with kpds5=1 in each forecast GRIB file
such as:
828:491187038:d=08010612:PRES:kpds5=1:kpds6=243:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:convect-
cld top:36hr fcst:NAve=0
829:491187132:d=08010612:PRES:kpds5=1:kpds6=252:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:deep
convect-cld top:36hr fcst:NAve=0
830:491187226:d=08010612:PRES:kpds5=1:kpds6=249:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:shallow
convect-cld top:36hr fcst:NAve=0
831:491187320:d=08010612:PRES:kpds5=1:kpds6=207:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:grid-
scale cld top:36hr fcst:NAve=0
The only thing I see different here are the "kpds6" values but I'm not
sure how to distinguish between them in MODE. I only want to look at
the last, but using kpds5=1 as the grib code always plots surface
pressure.
Thanks,
Dan
On Sep 22, 2010, at 4:19 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
> Dan,
>
> OK, here's the output of wgrib for your forecast file:
>
778:51443170:d=08010700:PWAT:kpds5=54:kpds6=200:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:atmos
col:36hr fcst:NAve=0
>
822:54154874:d=08010700:PWAT:kpds5=54:kpds6=116:kpds7=7680:TR=10:P1=0:P2=36:TimeU=1:30-
0 mb above gnd:36hr fcst:NAve=0
>
> The first record is PWAT defined over the entire atmosphere column,
which I assume is what you want to use. The level value for this is 0
(kpds7=0). So please try setting:
> fcst_field = "54/L0";
> obs_field = "54/L0";
>
> When I did that, it was able to find the forecast record, but
errored out with the following:
> ERROR: main() -> forecast and observation grid dimensions do not
match (265, 171) != (797, 515)
>
> It appears your forecast and observation data aren't on the same
grid. MODE requires that users put their data onto a common grid
before comparing them. We recommend using the copygb tool
> (http://www.cpc.noaa.gov/products/wesley/copygb.html) to regrid your
GRIB data. The following command should work to regrid your forecast
data onto the observation domain:
>
> copygb -xg"255 3 797 515 21659 -119878 8 -97500 6000 6000 0 64
60000 30000" -k'4*-1 54' fcst/WRFPRS_d01.036
fcst/WRFPRS_d01.036_regrid
>
> FYI, I constructed this grid definition by looking at the wgrib
output of your observation data (listed below) and following some
instructions from the MET website:
>
http://www.dtcenter.org/met/users/support/OnLinePractical/OnLinePractical_810/copygb/run3.php
>
> wgrib -d 1 -V obs/WRFPRS_d01.036
> ...
> Lambert Conf: Lat1 21.659000 Lon1 -119.878000 Lov -97.500000
> Latin1 60.000000 Latin2 30.000000 LatSP 0.000000 LonSP 0.000000
> North Pole (797 x 515) Dx 6.000000 Dy 6.000000 scan 64 mode 137
>
> The -k argument tells copygb to only copy over the PWAT (grib code =
54) records.
>
> Once the datasets are on the same grid, you can run them through
MODE. I've attached a png image showing a summary of the output I
see. I got this output after making the following changes to your
> MODE config file:
> (1) Set fcst_field = "54/L0";
> (2) Set obs_field = "54/L0";
> (3) Set mask_poly = ""; - Since I don't have your polyline file.
> (4) Set mask_poly_flag = 0;
> (5) Set zero_border_size = 1; - Unless you have a good reason for
making this larger, I'd suggest using a value of 1.
>
> Here's the command I used to run MODE:
> bin/mode fcst/WRFPRS_d01.036_regrid obs/WRFPRS_d01.036
WrfModeConfig_PWAT -outdir out -v 2
>
> Looking at the objects it found, I'd suggest modifying the
thresholds you're using. The objects that we defined using the
current setting don't look very useful. Perhaps you could increase
your
> thresholds to somewhere around 28.
>
> Hope that's helpful.
>
> Thanks,
> John
>
>
> RAL HelpDesk {for Dan Hartung} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>
>> John,
>>
>> Hmm.. I tried that, but "-p" isn't an ftp option for me. Instead,
I have uploaded all of the files to our anonymous ftp site here at
CIMSS. You should be able to download all of the files by doing the
following:
>>
>>
>> ftp ftp.ssec.wisc.edu
>> username=anonymous
>> password="your email address"
>> cd pub/ssec/dhartung/hartung_data
>> mget *
>> bye
>>
>> The GRIB obs file is in the "obs" folder and the GRIB forecast file
is in the "fcst" folder. I have also put the Mode configuration file
in the directory.
>>
>> Let me know if you encounter any issues.
>>
>> Thanks,
>> Dan
>>
>>
>> On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>
>>> Dan,
>>>
>>> Please try using the "-p" (for "passive") option. That may help:
>>>
>>> ftp -p ftp.rap.ucar.edu
>>> username=anonymous
>>> password="your email address"
>>> cd incoming/irap/met_help
>>> mkdir hartung_data
>>> cd hartung_data
>>> put "your files"
>>> bye
>>>
>>> Thanks,
>>> John
>>>
>>>
>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>
>>>> Hi John,
>>>>
>>>> The PWAT field is present in the GRIB files so it must be a MODE
configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>>>>
>>>> Thanks,
>>>> Dan
>>>>
>>>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>
>>>>> Dan,
>>>>>
>>>>> Try running the wgrib utility to make sure that GRIB code 54 is
in your output file:
>>>>> wgrib file.grb | grep "kpds5=54"
>>>>>
>>>>> The value of kpds5 tells you the GRIB code for each record. If
there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>>>>> file for WPP to tell it to output PWAT.
>>>>>
>>>>> If you do have PWAT records in your GRIB file, then it's an
issue with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>>>>> I'll take a look and see if I can figure out what's going on.
You can post that data to our anonymous FTP site with the following
commands:
>>>>>
>>>>> ftp ftp.rap.ucar.edu
>>>>> username=anonymous
>>>>> password="your email address"
>>>>> cd incoming/irap/met_help
>>>>> mkdir hartung_data
>>>>> cd hartung_data
>>>>> put "your files"
>>>>> bye
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>
>>>>>> Hi John,
>>>>>>
>>>>>> Thanks for the help.. I have at least been able to convert the
WRF output to GRIB and am in the process of trying to process some
sample files in MODE looking at the precipitable water field. I am
getting an error that says MODE can not find grib code 54 (PWAT) on L1
(and I also tried Z1).. I'm not sure what to type in for a level in
the configuration file since this is a total column variable. Is
there a simple way of specifying this in the config file?
>>>>>>
>>>>>> Thanks,
>>>>>> Dan
>>>>>>
>>>>>>
>>>>>> Copy of config file as it stands:
>>>>>>
>>>>>> /
>>>>>> // Specify the fields to be used in the verification. The
forecast and
>>>>>> // observation fields may be specified separately.
>>>>>> //
>>>>>> // Each field is specified as a grib code or corresponding grib
code
>>>>>> // abbreviation followed by an accumulation or vertical level
indicator.
>>>>>> //
>>>>>> // Each verification field is specified as one of the
following:
>>>>>> // GC/ANNN for accumulation interval NNN
>>>>>> // GC/ZNNN for vertical level NNN
>>>>>> // GC/PNNN for pressure level NNN in hPa
>>>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>>>> // GC/LNNN for a generic level type
>>>>>> // GC/RNNN for a specific GRIB record number
>>>>>> // Where GC is the number of or abbreviation for the grib
code
>>>>>> // to be verified.
>>>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>> //
>>>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>>>>> //
>>>>>> fcst_field = "54/Z1";
>>>>>> obs_field = "54/Z1";
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>>
>>>>>>> Dan,
>>>>>>>
>>>>>>> This really is more of a WRF-Help/WRF-PostProcessor question.
I'll take a shot at it, but if you need more detail, I'll refer you to
WRF-Help.
>>>>>>>
>>>>>>> I believe the answer is yes, WPP is able to output those types
of fields. Please take a look at Table 3 in the WRF User's Guide:
>>>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>>>
>>>>>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>>>>> 1, respectively:
>>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>
>>>>>>> I'd say, give WPP a shot, and once you have your output in
GRIB format, please let us know if you have any trouble reading it
into the MET tools.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> John Halley Gotway
>>>>>>> met_help at ucar.edu
>>>>>>>
>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>>>>>> Queue: met_help
>>>>>>>> Subject: application of MODE to satellite data
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I am very interested in applying MET, and especially MODE to
the cloud water path field, as well as brightness temperature in
satellite imagery during the analysis period of an observing system
simulation experiment. My question revolves around the initial
conversion of the WRF output data to grib1 format. Are cloud
properties such as cloud water path (liquid and ice water path also)
and cloud top pressure able to be converted to grib format? I haven't
had any luck finding whether or not they are already supported grib
fields in the wrf post processor. I'm sorry if this is not a question
that should be directed to this help line, so if you are aware of
someone who might be able to further help me that would be greatly
appreciated.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Dan Hartung
>>>>>>>>
>>>>>>>>
>>
>
> <mode_PWAT_EATM_vs_PWAT_EATM_360000L_20080108_120000V_000000A.png>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: John Halley Gotway
Time: Thu Sep 23 12:04:05 2010
Dan,
Yes, as people have expanded the fields on which they're running MODE,
we're realized that shortcoming in our way of specifying which records
you're after.
I think you basically have two options:
(1) You can explicitly specify which GRIB record to use:
fcst_field = "1/R828";
obs_field = "1/R830";
That'll compare the pressure data in GRIB record 828 with the
pressure data in GRIB record 830. The obvious drawback here is that
if the order of your records change, the data the you use in MODE
will change.
(2) The other option is a multi-step approach:
First, run copygb to select out your forecast record of interest.
Second, run copygb to select out your observation record of
interest.
Next, pass those files as input to MODE. And set:
fcst_field = "1/L0";
obs_field = "1/L0";
For example, the following commands will pull off only the GRIB
records defined at the cloud base and top, respectively:
copygb -x -k'5*-1 2' WRFPRS_d01.036 WRFPRS_d01.036_cld_base
copygb -x -k'5*-1 3' WRFPRS_d01.036 WRFPRS_d01.036_cld_top
And then you could input those files into MODE.
Sorry, it's such a hassle.
John
RAL HelpDesk {for Dan Hartung} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>
> Hi John,
>
> I have one more question if you have time.. I am also trying to
compare cloud top pressure and cloud base height in MODE, but there
are multiple pressure fields with kpds5=1 in each forecast GRIB file
such as:
>
>
828:491187038:d=08010612:PRES:kpds5=1:kpds6=243:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:convect-
cld top:36hr fcst:NAve=0
>
829:491187132:d=08010612:PRES:kpds5=1:kpds6=252:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:deep
convect-cld top:36hr fcst:NAve=0
>
830:491187226:d=08010612:PRES:kpds5=1:kpds6=249:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:shallow
convect-cld top:36hr fcst:NAve=0
>
831:491187320:d=08010612:PRES:kpds5=1:kpds6=207:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:grid-
scale cld top:36hr fcst:NAve=0
>
> The only thing I see different here are the "kpds6" values but I'm
not sure how to distinguish between them in MODE. I only want to look
at the last, but using kpds5=1 as the grib code always plots surface
pressure.
>
> Thanks,
> Dan
>
>
>
> On Sep 22, 2010, at 4:19 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>
>> Dan,
>>
>> OK, here's the output of wgrib for your forecast file:
>>
778:51443170:d=08010700:PWAT:kpds5=54:kpds6=200:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:atmos
col:36hr fcst:NAve=0
>>
822:54154874:d=08010700:PWAT:kpds5=54:kpds6=116:kpds7=7680:TR=10:P1=0:P2=36:TimeU=1:30-
0 mb above gnd:36hr fcst:NAve=0
>>
>> The first record is PWAT defined over the entire atmosphere column,
which I assume is what you want to use. The level value for this is 0
(kpds7=0). So please try setting:
>> fcst_field = "54/L0";
>> obs_field = "54/L0";
>>
>> When I did that, it was able to find the forecast record, but
errored out with the following:
>> ERROR: main() -> forecast and observation grid dimensions do not
match (265, 171) != (797, 515)
>>
>> It appears your forecast and observation data aren't on the same
grid. MODE requires that users put their data onto a common grid
before comparing them. We recommend using the copygb tool
>> (http://www.cpc.noaa.gov/products/wesley/copygb.html) to regrid
your GRIB data. The following command should work to regrid your
forecast data onto the observation domain:
>>
>> copygb -xg"255 3 797 515 21659 -119878 8 -97500 6000 6000 0 64
60000 30000" -k'4*-1 54' fcst/WRFPRS_d01.036
fcst/WRFPRS_d01.036_regrid
>>
>> FYI, I constructed this grid definition by looking at the wgrib
output of your observation data (listed below) and following some
instructions from the MET website:
>>
http://www.dtcenter.org/met/users/support/OnLinePractical/OnLinePractical_810/copygb/run3.php
>>
>> wgrib -d 1 -V obs/WRFPRS_d01.036
>> ...
>> Lambert Conf: Lat1 21.659000 Lon1 -119.878000 Lov -97.500000
>> Latin1 60.000000 Latin2 30.000000 LatSP 0.000000 LonSP
0.000000
>> North Pole (797 x 515) Dx 6.000000 Dy 6.000000 scan 64 mode
137
>>
>> The -k argument tells copygb to only copy over the PWAT (grib code
= 54) records.
>>
>> Once the datasets are on the same grid, you can run them through
MODE. I've attached a png image showing a summary of the output I
see. I got this output after making the following changes to your
>> MODE config file:
>> (1) Set fcst_field = "54/L0";
>> (2) Set obs_field = "54/L0";
>> (3) Set mask_poly = ""; - Since I don't have your polyline file.
>> (4) Set mask_poly_flag = 0;
>> (5) Set zero_border_size = 1; - Unless you have a good reason for
making this larger, I'd suggest using a value of 1.
>>
>> Here's the command I used to run MODE:
>> bin/mode fcst/WRFPRS_d01.036_regrid obs/WRFPRS_d01.036
WrfModeConfig_PWAT -outdir out -v 2
>>
>> Looking at the objects it found, I'd suggest modifying the
thresholds you're using. The objects that we defined using the
current setting don't look very useful. Perhaps you could increase
your
>> thresholds to somewhere around 28.
>>
>> Hope that's helpful.
>>
>> Thanks,
>> John
>>
>>
>> RAL HelpDesk {for Dan Hartung} wrote:
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>
>>> John,
>>>
>>> Hmm.. I tried that, but "-p" isn't an ftp option for me. Instead,
I have uploaded all of the files to our anonymous ftp site here at
CIMSS. You should be able to download all of the files by doing the
following:
>>>
>>>
>>> ftp ftp.ssec.wisc.edu
>>> username=anonymous
>>> password="your email address"
>>> cd pub/ssec/dhartung/hartung_data
>>> mget *
>>> bye
>>>
>>> The GRIB obs file is in the "obs" folder and the GRIB forecast
file is in the "fcst" folder. I have also put the Mode configuration
file in the directory.
>>>
>>> Let me know if you encounter any issues.
>>>
>>> Thanks,
>>> Dan
>>>
>>>
>>> On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>
>>>> Dan,
>>>>
>>>> Please try using the "-p" (for "passive") option. That may help:
>>>>
>>>> ftp -p ftp.rap.ucar.edu
>>>> username=anonymous
>>>> password="your email address"
>>>> cd incoming/irap/met_help
>>>> mkdir hartung_data
>>>> cd hartung_data
>>>> put "your files"
>>>> bye
>>>>
>>>> Thanks,
>>>> John
>>>>
>>>>
>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>
>>>>> Hi John,
>>>>>
>>>>> The PWAT field is present in the GRIB files so it must be a MODE
configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>>>>>
>>>>> Thanks,
>>>>> Dan
>>>>>
>>>>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>
>>>>>> Dan,
>>>>>>
>>>>>> Try running the wgrib utility to make sure that GRIB code 54 is
in your output file:
>>>>>> wgrib file.grb | grep "kpds5=54"
>>>>>>
>>>>>> The value of kpds5 tells you the GRIB code for each record. If
there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>>>>>> file for WPP to tell it to output PWAT.
>>>>>>
>>>>>> If you do have PWAT records in your GRIB file, then it's an
issue with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>>>>>> I'll take a look and see if I can figure out what's going on.
You can post that data to our anonymous FTP site with the following
commands:
>>>>>>
>>>>>> ftp ftp.rap.ucar.edu
>>>>>> username=anonymous
>>>>>> password="your email address"
>>>>>> cd incoming/irap/met_help
>>>>>> mkdir hartung_data
>>>>>> cd hartung_data
>>>>>> put "your files"
>>>>>> bye
>>>>>>
>>>>>> Thanks,
>>>>>> John
>>>>>>
>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986
>
>>>>>>>
>>>>>>> Hi John,
>>>>>>>
>>>>>>> Thanks for the help.. I have at least been able to convert the
WRF output to GRIB and am in the process of trying to process some
sample files in MODE looking at the precipitable water field. I am
getting an error that says MODE can not find grib code 54 (PWAT) on L1
(and I also tried Z1).. I'm not sure what to type in for a level in
the configuration file since this is a total column variable. Is
there a simple way of specifying this in the config file?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Dan
>>>>>>>
>>>>>>>
>>>>>>> Copy of config file as it stands:
>>>>>>>
>>>>>>> /
>>>>>>> // Specify the fields to be used in the verification. The
forecast and
>>>>>>> // observation fields may be specified separately.
>>>>>>> //
>>>>>>> // Each field is specified as a grib code or corresponding
grib code
>>>>>>> // abbreviation followed by an accumulation or vertical level
indicator.
>>>>>>> //
>>>>>>> // Each verification field is specified as one of the
following:
>>>>>>> // GC/ANNN for accumulation interval NNN
>>>>>>> // GC/ZNNN for vertical level NNN
>>>>>>> // GC/PNNN for pressure level NNN in hPa
>>>>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>>>>> // GC/LNNN for a generic level type
>>>>>>> // GC/RNNN for a specific GRIB record number
>>>>>>> // Where GC is the number of or abbreviation for the grib
code
>>>>>>> // to be verified.
>>>>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>> //
>>>>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>>>>>> //
>>>>>>> fcst_field = "54/Z1";
>>>>>>> obs_field = "54/Z1";
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>>>
>>>>>>>> Dan,
>>>>>>>>
>>>>>>>> This really is more of a WRF-Help/WRF-PostProcessor question.
I'll take a shot at it, but if you need more detail, I'll refer you to
WRF-Help.
>>>>>>>>
>>>>>>>> I believe the answer is yes, WPP is able to output those
types of fields. Please take a look at Table 3 in the WRF User's
Guide:
>>>>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>>>>
>>>>>>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>>>>>> 1, respectively:
>>>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>>
>>>>>>>> I'd say, give WPP a shot, and once you have your output in
GRIB format, please let us know if you have any trouble reading it
into the MET tools.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> John Halley Gotway
>>>>>>>> met_help at ucar.edu
>>>>>>>>
>>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>>>>>>> Queue: met_help
>>>>>>>>> Subject: application of MODE to satellite data
>>>>>>>>> Owner: Nobody
>>>>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>>>>> Status: new
>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> I am very interested in applying MET, and especially MODE to
the cloud water path field, as well as brightness temperature in
satellite imagery during the analysis period of an observing system
simulation experiment. My question revolves around the initial
conversion of the WRF output data to grib1 format. Are cloud
properties such as cloud water path (liquid and ice water path also)
and cloud top pressure able to be converted to grib format? I haven't
had any luck finding whether or not they are already supported grib
fields in the wrf post processor. I'm sorry if this is not a question
that should be directed to this help line, so if you are aware of
someone who might be able to further help me that would be greatly
appreciated.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Dan Hartung
>>>>>>>>>
>>>>>>>>>
>> <mode_PWAT_EATM_vs_PWAT_EATM_360000L_20080108_120000V_000000A.png>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: Dan Hartung
Time: Thu Sep 23 13:03:51 2010
Thanks John, I really do appreciate the assistance. I have the fields
working now.
-Dan
On Sep 23, 2010, at 1:04 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
> Dan,
>
> Yes, as people have expanded the fields on which they're running
MODE, we're realized that shortcoming in our way of specifying which
records you're after.
>
> I think you basically have two options:
> (1) You can explicitly specify which GRIB record to use:
> fcst_field = "1/R828";
> obs_field = "1/R830";
> That'll compare the pressure data in GRIB record 828 with the
pressure data in GRIB record 830. The obvious drawback here is that
if the order of your records change, the data the you use in MODE
> will change.
>
> (2) The other option is a multi-step approach:
> First, run copygb to select out your forecast record of interest.
> Second, run copygb to select out your observation record of
interest.
> Next, pass those files as input to MODE. And set:
> fcst_field = "1/L0";
> obs_field = "1/L0";
>
> For example, the following commands will pull off only the GRIB
records defined at the cloud base and top, respectively:
> copygb -x -k'5*-1 2' WRFPRS_d01.036 WRFPRS_d01.036_cld_base
> copygb -x -k'5*-1 3' WRFPRS_d01.036 WRFPRS_d01.036_cld_top
> And then you could input those files into MODE.
>
> Sorry, it's such a hassle.
>
> John
>
>
> RAL HelpDesk {for Dan Hartung} wrote:
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>
>> Hi John,
>>
>> I have one more question if you have time.. I am also trying to
compare cloud top pressure and cloud base height in MODE, but there
are multiple pressure fields with kpds5=1 in each forecast GRIB file
such as:
>>
>>
828:491187038:d=08010612:PRES:kpds5=1:kpds6=243:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:convect-
cld top:36hr fcst:NAve=0
>>
829:491187132:d=08010612:PRES:kpds5=1:kpds6=252:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:deep
convect-cld top:36hr fcst:NAve=0
>>
830:491187226:d=08010612:PRES:kpds5=1:kpds6=249:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:shallow
convect-cld top:36hr fcst:NAve=0
>>
831:491187320:d=08010612:PRES:kpds5=1:kpds6=207:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:grid-
scale cld top:36hr fcst:NAve=0
>>
>> The only thing I see different here are the "kpds6" values but I'm
not sure how to distinguish between them in MODE. I only want to look
at the last, but using kpds5=1 as the grib code always plots surface
pressure.
>>
>> Thanks,
>> Dan
>>
>>
>>
>> On Sep 22, 2010, at 4:19 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>
>>> Dan,
>>>
>>> OK, here's the output of wgrib for your forecast file:
>>>
778:51443170:d=08010700:PWAT:kpds5=54:kpds6=200:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:atmos
col:36hr fcst:NAve=0
>>>
822:54154874:d=08010700:PWAT:kpds5=54:kpds6=116:kpds7=7680:TR=10:P1=0:P2=36:TimeU=1:30-
0 mb above gnd:36hr fcst:NAve=0
>>>
>>> The first record is PWAT defined over the entire atmosphere
column, which I assume is what you want to use. The level value for
this is 0 (kpds7=0). So please try setting:
>>> fcst_field = "54/L0";
>>> obs_field = "54/L0";
>>>
>>> When I did that, it was able to find the forecast record, but
errored out with the following:
>>> ERROR: main() -> forecast and observation grid dimensions do not
match (265, 171) != (797, 515)
>>>
>>> It appears your forecast and observation data aren't on the same
grid. MODE requires that users put their data onto a common grid
before comparing them. We recommend using the copygb tool
>>> (http://www.cpc.noaa.gov/products/wesley/copygb.html) to regrid
your GRIB data. The following command should work to regrid your
forecast data onto the observation domain:
>>>
>>> copygb -xg"255 3 797 515 21659 -119878 8 -97500 6000 6000 0 64
60000 30000" -k'4*-1 54' fcst/WRFPRS_d01.036
fcst/WRFPRS_d01.036_regrid
>>>
>>> FYI, I constructed this grid definition by looking at the wgrib
output of your observation data (listed below) and following some
instructions from the MET website:
>>>
http://www.dtcenter.org/met/users/support/OnLinePractical/OnLinePractical_810/copygb/run3.php
>>>
>>> wgrib -d 1 -V obs/WRFPRS_d01.036
>>> ...
>>> Lambert Conf: Lat1 21.659000 Lon1 -119.878000 Lov -97.500000
>>> Latin1 60.000000 Latin2 30.000000 LatSP 0.000000 LonSP
0.000000
>>> North Pole (797 x 515) Dx 6.000000 Dy 6.000000 scan 64 mode
137
>>>
>>> The -k argument tells copygb to only copy over the PWAT (grib code
= 54) records.
>>>
>>> Once the datasets are on the same grid, you can run them through
MODE. I've attached a png image showing a summary of the output I
see. I got this output after making the following changes to your
>>> MODE config file:
>>> (1) Set fcst_field = "54/L0";
>>> (2) Set obs_field = "54/L0";
>>> (3) Set mask_poly = ""; - Since I don't have your polyline file.
>>> (4) Set mask_poly_flag = 0;
>>> (5) Set zero_border_size = 1; - Unless you have a good reason for
making this larger, I'd suggest using a value of 1.
>>>
>>> Here's the command I used to run MODE:
>>> bin/mode fcst/WRFPRS_d01.036_regrid obs/WRFPRS_d01.036
WrfModeConfig_PWAT -outdir out -v 2
>>>
>>> Looking at the objects it found, I'd suggest modifying the
thresholds you're using. The objects that we defined using the
current setting don't look very useful. Perhaps you could increase
your
>>> thresholds to somewhere around 28.
>>>
>>> Hope that's helpful.
>>>
>>> Thanks,
>>> John
>>>
>>>
>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>
>>>> John,
>>>>
>>>> Hmm.. I tried that, but "-p" isn't an ftp option for me.
Instead, I have uploaded all of the files to our anonymous ftp site
here at CIMSS. You should be able to download all of the files by
doing the following:
>>>>
>>>>
>>>> ftp ftp.ssec.wisc.edu
>>>> username=anonymous
>>>> password="your email address"
>>>> cd pub/ssec/dhartung/hartung_data
>>>> mget *
>>>> bye
>>>>
>>>> The GRIB obs file is in the "obs" folder and the GRIB forecast
file is in the "fcst" folder. I have also put the Mode configuration
file in the directory.
>>>>
>>>> Let me know if you encounter any issues.
>>>>
>>>> Thanks,
>>>> Dan
>>>>
>>>>
>>>> On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>
>>>>> Dan,
>>>>>
>>>>> Please try using the "-p" (for "passive") option. That may
help:
>>>>>
>>>>> ftp -p ftp.rap.ucar.edu
>>>>> username=anonymous
>>>>> password="your email address"
>>>>> cd incoming/irap/met_help
>>>>> mkdir hartung_data
>>>>> cd hartung_data
>>>>> put "your files"
>>>>> bye
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>>
>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>
>>>>>> Hi John,
>>>>>>
>>>>>> The PWAT field is present in the GRIB files so it must be a
MODE configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>>>>>>
>>>>>> Thanks,
>>>>>> Dan
>>>>>>
>>>>>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>>
>>>>>>> Dan,
>>>>>>>
>>>>>>> Try running the wgrib utility to make sure that GRIB code 54
is in your output file:
>>>>>>> wgrib file.grb | grep "kpds5=54"
>>>>>>>
>>>>>>> The value of kpds5 tells you the GRIB code for each record.
If there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>>>>>>> file for WPP to tell it to output PWAT.
>>>>>>>
>>>>>>> If you do have PWAT records in your GRIB file, then it's an
issue with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>>>>>>> I'll take a look and see if I can figure out what's going on.
You can post that data to our anonymous FTP site with the following
commands:
>>>>>>>
>>>>>>> ftp ftp.rap.ucar.edu
>>>>>>> username=anonymous
>>>>>>> password="your email address"
>>>>>>> cd incoming/irap/met_help
>>>>>>> mkdir hartung_data
>>>>>>> cd hartung_data
>>>>>>> put "your files"
>>>>>>> bye
>>>>>>>
>>>>>>> Thanks,
>>>>>>> John
>>>>>>>
>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986
>
>>>>>>>>
>>>>>>>> Hi John,
>>>>>>>>
>>>>>>>> Thanks for the help.. I have at least been able to convert
the WRF output to GRIB and am in the process of trying to process some
sample files in MODE looking at the precipitable water field. I am
getting an error that says MODE can not find grib code 54 (PWAT) on L1
(and I also tried Z1).. I'm not sure what to type in for a level in
the configuration file since this is a total column variable. Is
there a simple way of specifying this in the config file?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Dan
>>>>>>>>
>>>>>>>>
>>>>>>>> Copy of config file as it stands:
>>>>>>>>
>>>>>>>> /
>>>>>>>> // Specify the fields to be used in the verification. The
forecast and
>>>>>>>> // observation fields may be specified separately.
>>>>>>>> //
>>>>>>>> // Each field is specified as a grib code or corresponding
grib code
>>>>>>>> // abbreviation followed by an accumulation or vertical level
indicator.
>>>>>>>> //
>>>>>>>> // Each verification field is specified as one of the
following:
>>>>>>>> // GC/ANNN for accumulation interval NNN
>>>>>>>> // GC/ZNNN for vertical level NNN
>>>>>>>> // GC/PNNN for pressure level NNN in hPa
>>>>>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>>>>>> // GC/LNNN for a generic level type
>>>>>>>> // GC/RNNN for a specific GRIB record number
>>>>>>>> // Where GC is the number of or abbreviation for the grib
code
>>>>>>>> // to be verified.
>>>>>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>> //
>>>>>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>>>>>>> //
>>>>>>>> fcst_field = "54/Z1";
>>>>>>>> obs_field = "54/Z1";
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>>>>
>>>>>>>>> Dan,
>>>>>>>>>
>>>>>>>>> This really is more of a WRF-Help/WRF-PostProcessor
question. I'll take a shot at it, but if you need more detail, I'll
refer you to WRF-Help.
>>>>>>>>>
>>>>>>>>> I believe the answer is yes, WPP is able to output those
types of fields. Please take a look at Table 3 in the WRF User's
Guide:
>>>>>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>>>>>
>>>>>>>>> This table lists the fields that WPP can output. You'll see
entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>>>>>>> 1, respectively:
>>>>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>>>
>>>>>>>>> I'd say, give WPP a shot, and once you have your output in
GRIB format, please let us know if you have any trouble reading it
into the MET tools.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> John Halley Gotway
>>>>>>>>> met_help at ucar.edu
>>>>>>>>>
>>>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>>>>>> Transaction: Ticket created by daniel.hartung at ssec.wisc.edu
>>>>>>>>>> Queue: met_help
>>>>>>>>>> Subject: application of MODE to satellite data
>>>>>>>>>> Owner: Nobody
>>>>>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>>>>>> Status: new
>>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I am very interested in applying MET, and especially MODE
to the cloud water path field, as well as brightness temperature in
satellite imagery during the analysis period of an observing system
simulation experiment. My question revolves around the initial
conversion of the WRF output data to grib1 format. Are cloud
properties such as cloud water path (liquid and ice water path also)
and cloud top pressure able to be converted to grib format? I haven't
had any luck finding whether or not they are already supported grib
fields in the wrf post processor. I'm sorry if this is not a question
that should be directed to this help line, so if you are aware of
someone who might be able to further help me that would be greatly
appreciated.
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Dan Hartung
>>>>>>>>>>
>>>>>>>>>>
>>> <mode_PWAT_EATM_vs_PWAT_EATM_360000L_20080108_120000V_000000A.png>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #40986] application of MODE to satellite data
From: John Halley Gotway
Time: Thu Sep 23 13:43:32 2010
Dan,
Sure. Glad to help.
I'll go ahead and resolve this ticket.
If any more issues or questions come up, just send them to
met_help at ucar.edu.
Thanks,
John
RAL HelpDesk {for Dan Hartung} wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>
> Thanks John, I really do appreciate the assistance. I have the
fields working now.
>
> -Dan
>
>
> On Sep 23, 2010, at 1:04 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>
>> Dan,
>>
>> Yes, as people have expanded the fields on which they're running
MODE, we're realized that shortcoming in our way of specifying which
records you're after.
>>
>> I think you basically have two options:
>> (1) You can explicitly specify which GRIB record to use:
>> fcst_field = "1/R828";
>> obs_field = "1/R830";
>> That'll compare the pressure data in GRIB record 828 with the
pressure data in GRIB record 830. The obvious drawback here is that
if the order of your records change, the data the you use in MODE
>> will change.
>>
>> (2) The other option is a multi-step approach:
>> First, run copygb to select out your forecast record of interest.
>> Second, run copygb to select out your observation record of
interest.
>> Next, pass those files as input to MODE. And set:
>> fcst_field = "1/L0";
>> obs_field = "1/L0";
>>
>> For example, the following commands will pull off only the GRIB
records defined at the cloud base and top, respectively:
>> copygb -x -k'5*-1 2' WRFPRS_d01.036 WRFPRS_d01.036_cld_base
>> copygb -x -k'5*-1 3' WRFPRS_d01.036 WRFPRS_d01.036_cld_top
>> And then you could input those files into MODE.
>>
>> Sorry, it's such a hassle.
>>
>> John
>>
>>
>> RAL HelpDesk {for Dan Hartung} wrote:
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>
>>> Hi John,
>>>
>>> I have one more question if you have time.. I am also trying to
compare cloud top pressure and cloud base height in MODE, but there
are multiple pressure fields with kpds5=1 in each forecast GRIB file
such as:
>>>
>>>
828:491187038:d=08010612:PRES:kpds5=1:kpds6=243:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:convect-
cld top:36hr fcst:NAve=0
>>>
829:491187132:d=08010612:PRES:kpds5=1:kpds6=252:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:deep
convect-cld top:36hr fcst:NAve=0
>>>
830:491187226:d=08010612:PRES:kpds5=1:kpds6=249:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:shallow
convect-cld top:36hr fcst:NAve=0
>>>
831:491187320:d=08010612:PRES:kpds5=1:kpds6=207:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:grid-
scale cld top:36hr fcst:NAve=0
>>>
>>> The only thing I see different here are the "kpds6" values but I'm
not sure how to distinguish between them in MODE. I only want to look
at the last, but using kpds5=1 as the grib code always plots surface
pressure.
>>>
>>> Thanks,
>>> Dan
>>>
>>>
>>>
>>> On Sep 22, 2010, at 4:19 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>
>>>> Dan,
>>>>
>>>> OK, here's the output of wgrib for your forecast file:
>>>>
778:51443170:d=08010700:PWAT:kpds5=54:kpds6=200:kpds7=0:TR=10:P1=0:P2=36:TimeU=1:atmos
col:36hr fcst:NAve=0
>>>>
822:54154874:d=08010700:PWAT:kpds5=54:kpds6=116:kpds7=7680:TR=10:P1=0:P2=36:TimeU=1:30-
0 mb above gnd:36hr fcst:NAve=0
>>>>
>>>> The first record is PWAT defined over the entire atmosphere
column, which I assume is what you want to use. The level value for
this is 0 (kpds7=0). So please try setting:
>>>> fcst_field = "54/L0";
>>>> obs_field = "54/L0";
>>>>
>>>> When I did that, it was able to find the forecast record, but
errored out with the following:
>>>> ERROR: main() -> forecast and observation grid dimensions do not
match (265, 171) != (797, 515)
>>>>
>>>> It appears your forecast and observation data aren't on the same
grid. MODE requires that users put their data onto a common grid
before comparing them. We recommend using the copygb tool
>>>> (http://www.cpc.noaa.gov/products/wesley/copygb.html) to regrid
your GRIB data. The following command should work to regrid your
forecast data onto the observation domain:
>>>>
>>>> copygb -xg"255 3 797 515 21659 -119878 8 -97500 6000 6000 0 64
60000 30000" -k'4*-1 54' fcst/WRFPRS_d01.036
fcst/WRFPRS_d01.036_regrid
>>>>
>>>> FYI, I constructed this grid definition by looking at the wgrib
output of your observation data (listed below) and following some
instructions from the MET website:
>>>>
http://www.dtcenter.org/met/users/support/OnLinePractical/OnLinePractical_810/copygb/run3.php
>>>>
>>>> wgrib -d 1 -V obs/WRFPRS_d01.036
>>>> ...
>>>> Lambert Conf: Lat1 21.659000 Lon1 -119.878000 Lov -97.500000
>>>> Latin1 60.000000 Latin2 30.000000 LatSP 0.000000 LonSP
0.000000
>>>> North Pole (797 x 515) Dx 6.000000 Dy 6.000000 scan 64 mode
137
>>>>
>>>> The -k argument tells copygb to only copy over the PWAT (grib
code = 54) records.
>>>>
>>>> Once the datasets are on the same grid, you can run them through
MODE. I've attached a png image showing a summary of the output I
see. I got this output after making the following changes to your
>>>> MODE config file:
>>>> (1) Set fcst_field = "54/L0";
>>>> (2) Set obs_field = "54/L0";
>>>> (3) Set mask_poly = ""; - Since I don't have your polyline file.
>>>> (4) Set mask_poly_flag = 0;
>>>> (5) Set zero_border_size = 1; - Unless you have a good reason for
making this larger, I'd suggest using a value of 1.
>>>>
>>>> Here's the command I used to run MODE:
>>>> bin/mode fcst/WRFPRS_d01.036_regrid obs/WRFPRS_d01.036
WrfModeConfig_PWAT -outdir out -v 2
>>>>
>>>> Looking at the objects it found, I'd suggest modifying the
thresholds you're using. The objects that we defined using the
current setting don't look very useful. Perhaps you could increase
your
>>>> thresholds to somewhere around 28.
>>>>
>>>> Hope that's helpful.
>>>>
>>>> Thanks,
>>>> John
>>>>
>>>>
>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>
>>>>> John,
>>>>>
>>>>> Hmm.. I tried that, but "-p" isn't an ftp option for me.
Instead, I have uploaded all of the files to our anonymous ftp site
here at CIMSS. You should be able to download all of the files by
doing the following:
>>>>>
>>>>>
>>>>> ftp ftp.ssec.wisc.edu
>>>>> username=anonymous
>>>>> password="your email address"
>>>>> cd pub/ssec/dhartung/hartung_data
>>>>> mget *
>>>>> bye
>>>>>
>>>>> The GRIB obs file is in the "obs" folder and the GRIB forecast
file is in the "fcst" folder. I have also put the Mode configuration
file in the directory.
>>>>>
>>>>> Let me know if you encounter any issues.
>>>>>
>>>>> Thanks,
>>>>> Dan
>>>>>
>>>>>
>>>>> On Sep 22, 2010, at 1:26 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>
>>>>>> Dan,
>>>>>>
>>>>>> Please try using the "-p" (for "passive") option. That may
help:
>>>>>>
>>>>>> ftp -p ftp.rap.ucar.edu
>>>>>> username=anonymous
>>>>>> password="your email address"
>>>>>> cd incoming/irap/met_help
>>>>>> mkdir hartung_data
>>>>>> cd hartung_data
>>>>>> put "your files"
>>>>>> bye
>>>>>>
>>>>>> Thanks,
>>>>>> John
>>>>>>
>>>>>>
>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986
>
>>>>>>>
>>>>>>> Hi John,
>>>>>>>
>>>>>>> The PWAT field is present in the GRIB files so it must be a
MODE configuration issue. I am getting a permission denied error when
trying to upload the files after following all of your steps below. I
have already created a "hartung_data" folder as well as subsequent
"obs" and "forecast" folders. Any idea why I'm getting such an error?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Dan
>>>>>>>
>>>>>>> On Sep 22, 2010, at 9:48 AM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>>>
>>>>>>>> Dan,
>>>>>>>>
>>>>>>>> Try running the wgrib utility to make sure that GRIB code 54
is in your output file:
>>>>>>>> wgrib file.grb | grep "kpds5=54"
>>>>>>>>
>>>>>>>> The value of kpds5 tells you the GRIB code for each record.
If there are no records with a GRIB code of 54, you'll need to look at
how you're running WPP. You may need to modify the "wrf_cntrl.parm"
>>>>>>>> file for WPP to tell it to output PWAT.
>>>>>>>>
>>>>>>>> If you do have PWAT records in your GRIB file, then it's an
issue with MODE configuration file. Please send me a sample GRIB file
containing PWAT records along with your MODE configuration file.
>>>>>>>> I'll take a look and see if I can figure out what's going on.
You can post that data to our anonymous FTP site with the following
commands:
>>>>>>>>
>>>>>>>> ftp ftp.rap.ucar.edu
>>>>>>>> username=anonymous
>>>>>>>> password="your email address"
>>>>>>>> cd incoming/irap/met_help
>>>>>>>> mkdir hartung_data
>>>>>>>> cd hartung_data
>>>>>>>> put "your files"
>>>>>>>> bye
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> John
>>>>>>>>
>>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>>>
>>>>>>>>> Hi John,
>>>>>>>>>
>>>>>>>>> Thanks for the help.. I have at least been able to convert
the WRF output to GRIB and am in the process of trying to process some
sample files in MODE looking at the precipitable water field. I am
getting an error that says MODE can not find grib code 54 (PWAT) on L1
(and I also tried Z1).. I'm not sure what to type in for a level in
the configuration file since this is a total column variable. Is
there a simple way of specifying this in the config file?
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Dan
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Copy of config file as it stands:
>>>>>>>>>
>>>>>>>>> /
>>>>>>>>> // Specify the fields to be used in the verification. The
forecast and
>>>>>>>>> // observation fields may be specified separately.
>>>>>>>>> //
>>>>>>>>> // Each field is specified as a grib code or corresponding
grib code
>>>>>>>>> // abbreviation followed by an accumulation or vertical
level indicator.
>>>>>>>>> //
>>>>>>>>> // Each verification field is specified as one of the
following:
>>>>>>>>> // GC/ANNN for accumulation interval NNN
>>>>>>>>> // GC/ZNNN for vertical level NNN
>>>>>>>>> // GC/PNNN for pressure level NNN in hPa
>>>>>>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>>>>>>> // GC/LNNN for a generic level type
>>>>>>>>> // GC/RNNN for a specific GRIB record number
>>>>>>>>> // Where GC is the number of or abbreviation for the grib
code
>>>>>>>>> // to be verified.
>>>>>>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>>> //
>>>>>>>>> // e.g. fcst_field[] = [ "61/A3", "APCP/A24", "RH/L10" ];
>>>>>>>>> //
>>>>>>>>> fcst_field = "54/Z1";
>>>>>>>>> obs_field = "54/Z1";
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Sep 20, 2010, at 1:44 PM, RAL HelpDesk {for John Halley
Gotway} wrote:
>>>>>>>>>
>>>>>>>>>> Dan,
>>>>>>>>>>
>>>>>>>>>> This really is more of a WRF-Help/WRF-PostProcessor
question. I'll take a shot at it, but if you need more detail, I'll
refer you to WRF-Help.
>>>>>>>>>>
>>>>>>>>>> I believe the answer is yes, WPP is able to output those
types of fields. Please take a look at Table 3 in the WRF User's
Guide:
>>>>>>>>>> http://www.dtcenter.org/wrf-
nmm/users/docs/user_guide/V3/users_guide_nmm_chap1-7.pdf
>>>>>>>>>>
>>>>>>>>>> This table lists the fields that WPP can output. You'll
see entries for "Cloud water" and "Cloud ice", as well as "Cloud top
pressure". I'm believe these would correspond to GRIB codes 76, 58,
and
>>>>>>>>>> 1, respectively:
>>>>>>>>>> http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>>>>>>>>
>>>>>>>>>> I'd say, give WPP a shot, and once you have your output in
GRIB format, please let us know if you have any trouble reading it
into the MET tools.
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> John Halley Gotway
>>>>>>>>>> met_help at ucar.edu
>>>>>>>>>>
>>>>>>>>>> RAL HelpDesk {for Dan Hartung} wrote:
>>>>>>>>>>> Mon Sep 20 11:01:17 2010: Request 40986 was acted upon.
>>>>>>>>>>> Transaction: Ticket created by
daniel.hartung at ssec.wisc.edu
>>>>>>>>>>> Queue: met_help
>>>>>>>>>>> Subject: application of MODE to satellite data
>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>> Requestors: daniel.hartung at ssec.wisc.edu
>>>>>>>>>>> Status: new
>>>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=40986 >
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I am very interested in applying MET, and especially MODE
to the cloud water path field, as well as brightness temperature in
satellite imagery during the analysis period of an observing system
simulation experiment. My question revolves around the initial
conversion of the WRF output data to grib1 format. Are cloud
properties such as cloud water path (liquid and ice water path also)
and cloud top pressure able to be converted to grib format? I haven't
had any luck finding whether or not they are already supported grib
fields in the wrf post processor. I'm sorry if this is not a question
that should be directed to this help line, so if you are aware of
someone who might be able to further help me that would be greatly
appreciated.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Dan Hartung
>>>>>>>>>>>
>>>>>>>>>>>
>>>>
<mode_PWAT_EATM_vs_PWAT_EATM_360000L_20080108_120000V_000000A.png>
>
------------------------------------------------
More information about the Met_help
mailing list