[Met_help] [rt.rap.ucar.edu #62252] History for Mode Cloud Verification
John Halley Gotway via RT
met_help at ucar.edu
Tue Aug 27 10:39:20 MDT 2013
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John, I am using mode to verify cloud fcsts using WWMCA for ground truth. If you notice the listing below, it is not matching because it thinks the WWMCA data is on valid on a half hour so doesn't match the fcst field. These data are only valid on the hour so I am not sure why this is happening.
/h/GRIBI/bin/GRIBI_degrib.exe /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1
/h/GRIBI/bin/GRIBI_degrib.exe /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d 17 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71 -grib
17:20247632:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos col:anl:NAve=0
/h/GRIBI/bin/GRIBI_degrib.exe /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d 18 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183 -grib
18:21156214:d=13071412:LASUPD:kpds5=183:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos col:anl:NAve=0
/h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500 1667 1667 0 64 60000 30000" -x /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71 /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
/h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500 1667 1667 0 64 60000 30000" -x /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183 /h/data/global/WXQC/data/temp/met/cloud_obs_file_183
DEBUG 1: Default Config File: /home/qcteam/METv4.1/data/config/MODEConfig_default
DEBUG 1: Match Config File: /home/qcteam/METv4.1/data/config/DCFModeConfig_2
DEBUG 1: Merge Config File: /home/qcteam/METv4.1/data/config/DCFModeConfig_2
DEBUG 1: Forecast File: /prod8/data/global/DCF4/data/fcsts/t044/fcsts_t044_2013071400_012.GR1
DEBUG 1: Observation File: /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
WARNING:
WARNING: process_fcst_obs_files() -> Forecast and observation valid times do not match 20130714_120000 != 20130714_123000 for TCDC/L0 versus TCDC/L0.
WARNING:
The config files are attached. I ftp the data files to your server.
Bob Craig
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
From: John Halley Gotway
Time: Mon Jul 15 14:29:22 2013
Bob,
I retrieved the data you sent and ran it here. And I see the warning
you're getting:
WARNING: process_fcst_obs_files() -> Forecast and observation
valid times do not match 20130714_120000 != 20130714_123000 for
TCDC/L0 versus TCDC/L0.
However, that is only a warning and MODE should still run. It just
takes a long time for this dataset!
But I think your question is really, why is the timestamp for the
observation file (cloud_obs_file_71) 30-minutes past the hour:
20130714_123000
I used wgrib to dump the Product Description Section (PDS) from that
GRIB file:
[johnhg at rambler]% wgrib -PDS10 cloud_obs_file_71
1:0:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos
col:anl:NAve=0:PDS10= 0 0 45 128 57 32 255 128 71 200 0 0 13 7 14 12
30 1 0 0 0 0 0 0 21 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 99 0
0 0 0
That string of numbers is difficult parse, but here's the timing info:
13 7 14 12 30
It corresponds to 20130714_123000. So MODE is parsing that
information from the file correctly.
I don't think there's a problem in the MET tools. We just don't
understand why the timestamp in that GRIB file is 30-minutes past the
hour. And unfortunately, I don't have an answer on that for you.
I don't know very much about the WWMCA data - perhaps someone else
as AFWA could help?
Thanks,
John
On 07/15/2013 01:20 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via RT
wrote:
>
> Mon Jul 15 13:20:58 2013: Request 62252 was acted upon.
> Transaction: Ticket created by Robert.Craig at offutt.af.mil
> Queue: met_help
> Subject: Mode Cloud Verification
> Owner: Nobody
> Requestors: Robert.Craig at offutt.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252 >
>
>
> John, I am using mode to verify cloud fcsts using WWMCA for ground
truth. If you notice the listing below, it is not matching because it
thinks the WWMCA data is on valid on a half hour so doesn't match the
fcst field. These data are only valid on the hour so I am not sure
why this is happening.
>
>
>
> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1
>
> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
17 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
-grib
>
>
17:20247632:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos
col:anl:NAve=0
>
> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
18 -o
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
-grib
>
>
18:21156214:d=13071412:LASUPD:kpds5=183:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos
col:anl:NAve=0
>
> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
1667 1667 0 64 60000 30000" -x
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
/h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>
> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
1667 1667 0 64 60000 30000" -x
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
/h/data/global/WXQC/data/temp/met/cloud_obs_file_183
>
> DEBUG 1: Default Config File:
/home/qcteam/METv4.1/data/config/MODEConfig_default
>
> DEBUG 1: Match Config File:
/home/qcteam/METv4.1/data/config/DCFModeConfig_2
>
> DEBUG 1: Merge Config File:
/home/qcteam/METv4.1/data/config/DCFModeConfig_2
>
> DEBUG 1: Forecast File:
/prod8/data/global/DCF4/data/fcsts/t044/fcsts_t044_2013071400_012.GR1
>
> DEBUG 1: Observation File:
/h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>
> WARNING:
>
> WARNING: process_fcst_obs_files() -> Forecast and observation valid
times do not match 20130714_120000 != 20130714_123000 for TCDC/L0
versus TCDC/L0.
>
> WARNING:
>
>
>
> The config files are attached. I ftp the data files to your server.
>
>
>
> Bob Craig
>
>
>
>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62252] Mode Cloud Verification
From: Craig, Robert J Civ USAF AFWA 16 WS/WXN
Time: Mon Jul 15 14:33:48 2013
Thanks John, I will wait longer next time.
Bob
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, July 15, 2013 3:29 PM
To: Craig, Robert J Civ USAF AFWA 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
Bob,
I retrieved the data you sent and ran it here. And I see the warning
you're getting:
WARNING: process_fcst_obs_files() -> Forecast and observation
valid times do not match 20130714_120000 != 20130714_123000 for
TCDC/L0 versus TCDC/L0.
However, that is only a warning and MODE should still run. It just
takes a long time for this dataset!
But I think your question is really, why is the timestamp for the
observation file (cloud_obs_file_71) 30-minutes past the hour:
20130714_123000
I used wgrib to dump the Product Description Section (PDS) from that
GRIB file:
[johnhg at rambler]% wgrib -PDS10 cloud_obs_file_71
1:0:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos
col:anl:NAve=0:PDS10= 0 0 45 128 57 32 255 128 71 200 0 0 13 7 14 12
30 1 0 0 0 0 0 0 21 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 99 0
0 0 0
That string of numbers is difficult parse, but here's the timing info:
13 7 14 12 30 It corresponds to 20130714_123000. So MODE is parsing
that information from the file correctly.
I don't think there's a problem in the MET tools. We just don't
understand why the timestamp in that GRIB file is 30-minutes past the
hour. And unfortunately, I don't have an answer on that for you.
I don't know very much about the WWMCA data - perhaps someone else
as AFWA could help?
Thanks,
John
On 07/15/2013 01:20 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via RT
wrote:
>
> Mon Jul 15 13:20:58 2013: Request 62252 was acted upon.
> Transaction: Ticket created by Robert.Craig at offutt.af.mil
> Queue: met_help
> Subject: Mode Cloud Verification
> Owner: Nobody
> Requestors: Robert.Craig at offutt.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252
> >
>
>
> John, I am using mode to verify cloud fcsts using WWMCA for ground
truth. If you notice the listing below, it is not matching because it
thinks the WWMCA data is on valid on a half hour so doesn't match the
fcst field. These data are only valid on the hour so I am not sure
why this is happening.
>
>
>
> /h/GRIBI/bin/GRIBI_degrib.exe
> /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1
>
> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
17 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
-grib
>
>
17:20247632:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:
> TimeU=1:atmos col:anl:NAve=0
>
> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
18 -o
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
-grib
>
>
18:21156214:d=13071412:LASUPD:kpds5=183:kpds6=200:kpds7=0:TR=0:P1=0:P2
> =0:TimeU=1:atmos col:anl:NAve=0
>
> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
> 1667 1667 0 64 60000 30000" -x
> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>
> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
> 1667 1667 0 64 60000 30000" -x
> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
> /h/data/global/WXQC/data/temp/met/cloud_obs_file_183
>
> DEBUG 1: Default Config File:
> /home/qcteam/METv4.1/data/config/MODEConfig_default
>
> DEBUG 1: Match Config File:
> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>
> DEBUG 1: Merge Config File:
> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>
> DEBUG 1: Forecast File:
>
/prod8/data/global/DCF4/data/fcsts/t044/fcsts_t044_2013071400_012.GR1
>
> DEBUG 1: Observation File:
> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>
> WARNING:
>
> WARNING: process_fcst_obs_files() -> Forecast and observation valid
times do not match 20130714_120000 != 20130714_123000 for TCDC/L0
versus TCDC/L0.
>
> WARNING:
>
>
>
> The config files are attached. I ftp the data files to your server.
>
>
>
> Bob Craig
>
>
>
>
>
>
------------------------------------------------
Subject: Mode Cloud Verification
From: John Halley Gotway
Time: Mon Jul 15 16:17:13 2013
Bob,
When I ran with your configuration, it took 17 minutes to complete
that single run! That's an awfully long time. Doing the math, it
looks like your convolution radius is 125 grid squares
(=200/1.667). I think that's way too much smoothing. That's what's
taking so long.
I reran it using a convolution radius of 5. I also changed the
merge_thresh (for double threshold merging to >= 40.0). It took about
2 minutes to run and the first page of the resulting postscript
image is attached.
So I'd suggest playing around with the convolution radius to create
objects that match the features you're trying to study. Hope that
helps.
Thanks,
John
On 07/15/2013 02:33 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252 >
>
> Thanks John, I will wait longer next time.
>
> Bob
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, July 15, 2013 3:29 PM
> To: Craig, Robert J Civ USAF AFWA 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
>
> Bob,
>
> I retrieved the data you sent and ran it here. And I see the
warning you're getting:
>
> WARNING: process_fcst_obs_files() -> Forecast and observation
valid times do not match 20130714_120000 != 20130714_123000 for
TCDC/L0 versus TCDC/L0.
>
> However, that is only a warning and MODE should still run. It just
takes a long time for this dataset!
>
> But I think your question is really, why is the timestamp for the
observation file (cloud_obs_file_71) 30-minutes past the hour:
20130714_123000
>
> I used wgrib to dump the Product Description Section (PDS) from that
GRIB file:
>
> [johnhg at rambler]% wgrib -PDS10 cloud_obs_file_71
1:0:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:atmos
col:anl:NAve=0:PDS10= 0 0 45 128 57 32 255 128 71 200 0 0 13 7 14 12
30 1 0 0 0 0 0 0 21 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 99 0
> 0 0 0
>
> That string of numbers is difficult parse, but here's the timing
info: 13 7 14 12 30 It corresponds to 20130714_123000. So MODE is
parsing that information from the file correctly.
>
> I don't think there's a problem in the MET tools. We just don't
understand why the timestamp in that GRIB file is 30-minutes past the
hour. And unfortunately, I don't have an answer on that for you.
> I don't know very much about the WWMCA data - perhaps someone
else as AFWA could help?
>
> Thanks,
> John
>
> On 07/15/2013 01:20 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via
RT wrote:
>>
>> Mon Jul 15 13:20:58 2013: Request 62252 was acted upon.
>> Transaction: Ticket created by Robert.Craig at offutt.af.mil
>> Queue: met_help
>> Subject: Mode Cloud Verification
>> Owner: Nobody
>> Requestors: Robert.Craig at offutt.af.mil
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252
>>>
>>
>>
>> John, I am using mode to verify cloud fcsts using WWMCA for ground
truth. If you notice the listing below, it is not matching because it
thinks the WWMCA data is on valid on a half hour so doesn't match the
fcst field. These data are only valid on the hour so I am not sure
why this is happening.
>>
>>
>>
>> /h/GRIBI/bin/GRIBI_degrib.exe
>> /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1
>>
>> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
17 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
-grib
>>
>>
17:20247632:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:
>> TimeU=1:atmos col:anl:NAve=0
>>
>> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
18 -o
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
-grib
>>
>>
18:21156214:d=13071412:LASUPD:kpds5=183:kpds6=200:kpds7=0:TR=0:P1=0:P2
>> =0:TimeU=1:atmos col:anl:NAve=0
>>
>> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
>> 1667 1667 0 64 60000 30000" -x
>> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>>
>> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
>> 1667 1667 0 64 60000 30000" -x
>> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_183
>>
>> DEBUG 1: Default Config File:
>> /home/qcteam/METv4.1/data/config/MODEConfig_default
>>
>> DEBUG 1: Match Config File:
>> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>>
>> DEBUG 1: Merge Config File:
>> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>>
>> DEBUG 1: Forecast File:
>>
/prod8/data/global/DCF4/data/fcsts/t044/fcsts_t044_2013071400_012.GR1
>>
>> DEBUG 1: Observation File:
>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>>
>> WARNING:
>>
>> WARNING: process_fcst_obs_files() -> Forecast and observation valid
times do not match 20130714_120000 != 20130714_123000 for TCDC/L0
versus TCDC/L0.
>>
>> WARNING:
>>
>>
>>
>> The config files are attached. I ftp the data files to your
server.
>>
>>
>>
>> Bob Craig
>>
>>
>>
>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #62252] Mode Cloud Verification
From: Craig, Robert J Civ USAF AFWA 16 WS/WXN
Time: Tue Jul 16 06:40:16 2013
John, thanks for looking into this. Figuring out the right settings
is the most challenging part of MET. By the way, in the newest
version of MET there is a WWMCA tool - what does this do? I looked
through the user manual but I didn't see a description.
thanks
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday, July 15, 2013 5:17 PM
To: Craig, Robert J Civ USAF AFWA 16 WS/WXN
Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
Bob,
When I ran with your configuration, it took 17 minutes to complete
that single run! That's an awfully long time. Doing the math, it
looks like your convolution radius is 125 grid squares (=200/1.667).
I think that's way too much smoothing. That's what's taking so long.
I reran it using a convolution radius of 5. I also changed the
merge_thresh (for double threshold merging to >= 40.0). It took about
2 minutes to run and the first page of the resulting postscript image
is attached.
So I'd suggest playing around with the convolution radius to create
objects that match the features you're trying to study. Hope that
helps.
Thanks,
John
On 07/15/2013 02:33 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252 >
>
> Thanks John, I will wait longer next time.
>
> Bob
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, July 15, 2013 3:29 PM
> To: Craig, Robert J Civ USAF AFWA 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
>
> Bob,
>
> I retrieved the data you sent and ran it here. And I see the
warning you're getting:
>
> WARNING: process_fcst_obs_files() -> Forecast and observation
valid times do not match 20130714_120000 != 20130714_123000 for
TCDC/L0 versus TCDC/L0.
>
> However, that is only a warning and MODE should still run. It just
takes a long time for this dataset!
>
> But I think your question is really, why is the timestamp for the
> observation file (cloud_obs_file_71) 30-minutes past the hour:
> 20130714_123000
>
> I used wgrib to dump the Product Description Section (PDS) from that
GRIB file:
>
> [johnhg at rambler]% wgrib -PDS10 cloud_obs_file_71
>
1:0:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:
> atmos col:anl:NAve=0:PDS10= 0 0 45 128 57 32 255 128 71 200 0 0 13 7
> 14 12 30 1 0 0 0 0 0 0 21 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 99 0
> 0 0 0
>
> That string of numbers is difficult parse, but here's the timing
info: 13 7 14 12 30 It corresponds to 20130714_123000. So MODE is
parsing that information from the file correctly.
>
> I don't think there's a problem in the MET tools. We just don't
understand why the timestamp in that GRIB file is 30-minutes past the
hour. And unfortunately, I don't have an answer on that for you.
> I don't know very much about the WWMCA data - perhaps someone
else as AFWA could help?
>
> Thanks,
> John
>
> On 07/15/2013 01:20 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via
RT wrote:
>>
>> Mon Jul 15 13:20:58 2013: Request 62252 was acted upon.
>> Transaction: Ticket created by Robert.Craig at offutt.af.mil
>> Queue: met_help
>> Subject: Mode Cloud Verification
>> Owner: Nobody
>> Requestors: Robert.Craig at offutt.af.mil
>> Status: new
>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252
>>>
>>
>>
>> John, I am using mode to verify cloud fcsts using WWMCA for ground
truth. If you notice the listing below, it is not matching because it
thinks the WWMCA data is on valid on a half hour so doesn't match the
fcst field. These data are only valid on the hour so I am not sure
why this is happening.
>>
>>
>>
>> /h/GRIBI/bin/GRIBI_degrib.exe
>> /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1
>>
>> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
17 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
-grib
>>
>>
17:20247632:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:
>> TimeU=1:atmos col:anl:NAve=0
>>
>> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
18 -o
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
-grib
>>
>>
18:21156214:d=13071412:LASUPD:kpds5=183:kpds6=200:kpds7=0:TR=0:P1=0:P
>> 2
>> =0:TimeU=1:atmos col:anl:NAve=0
>>
>> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
>> 1667 1667 0 64 60000 30000" -x
>> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>>
>> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
>> 1667 1667 0 64 60000 30000" -x
>> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_183
>>
>> DEBUG 1: Default Config File:
>> /home/qcteam/METv4.1/data/config/MODEConfig_default
>>
>> DEBUG 1: Match Config File:
>> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>>
>> DEBUG 1: Merge Config File:
>> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>>
>> DEBUG 1: Forecast File:
>>
/prod8/data/global/DCF4/data/fcsts/t044/fcsts_t044_2013071400_012.GR1
>>
>> DEBUG 1: Observation File:
>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>>
>> WARNING:
>>
>> WARNING: process_fcst_obs_files() -> Forecast and observation valid
times do not match 20130714_120000 != 20130714_123000 for TCDC/L0
versus TCDC/L0.
>>
>> WARNING:
>>
>>
>>
>> The config files are attached. I ftp the data files to your
server.
>>
>>
>>
>> Bob Craig
>>
>>
>>
>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
From: John Halley Gotway
Time: Tue Jul 16 09:46:42 2013
Bob,
The WWMCA tools (wwmca_regrid and wwmca_plot) have been there for
several versions. The wwmca_regrid tool reads binary WWMCA data,
regrids it to a user-defined grid, and then writes a gridded NetCDF
file that the other MET tools can read. The modis_regrid tool (new in
METv4.1) basically does the same thing for modis data. That's
described in section 3.9 of the user's guide.
If you have questions about running wwmca_regrid, I can put you in
touch with Randy Bullock, its developer. I believe the logic for not
including a section on it in the user's guide is that WWMCA is
not a publicly available data source. So the vast majority of MET
users would have no interest in it. Of course, folks at AFWA, like
yourself, would be interested.
Thanks,
John
On 07/16/2013 06:40 AM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252 >
>
> John, thanks for looking into this. Figuring out the right settings
is the most challenging part of MET. By the way, in the newest
version of MET there is a WWMCA tool - what does this do? I looked
through the user manual but I didn't see a description.
>
> thanks
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, July 15, 2013 5:17 PM
> To: Craig, Robert J Civ USAF AFWA 16 WS/WXN
> Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
>
> Bob,
>
> When I ran with your configuration, it took 17 minutes to complete
that single run! That's an awfully long time. Doing the math, it
looks like your convolution radius is 125 grid squares (=200/1.667).
I think that's way too much smoothing. That's what's taking so long.
>
> I reran it using a convolution radius of 5. I also changed the
merge_thresh (for double threshold merging to >= 40.0). It took about
2 minutes to run and the first page of the resulting postscript image
is attached.
>
> So I'd suggest playing around with the convolution radius to create
objects that match the features you're trying to study. Hope that
helps.
>
> Thanks,
> John
>
> On 07/15/2013 02:33 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via
RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252 >
>>
>> Thanks John, I will wait longer next time.
>>
>> Bob
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Monday, July 15, 2013 3:29 PM
>> To: Craig, Robert J Civ USAF AFWA 16 WS/WXN
>> Subject: Re: [rt.rap.ucar.edu #62252] Mode Cloud Verification
>>
>> Bob,
>>
>> I retrieved the data you sent and ran it here. And I see the
warning you're getting:
>>
>> WARNING: process_fcst_obs_files() -> Forecast and observation
valid times do not match 20130714_120000 != 20130714_123000 for
TCDC/L0 versus TCDC/L0.
>>
>> However, that is only a warning and MODE should still run. It just
takes a long time for this dataset!
>>
>> But I think your question is really, why is the timestamp for the
>> observation file (cloud_obs_file_71) 30-minutes past the hour:
>> 20130714_123000
>>
>> I used wgrib to dump the Product Description Section (PDS) from
that GRIB file:
>>
>> [johnhg at rambler]% wgrib -PDS10 cloud_obs_file_71
>>
1:0:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:TimeU=1:
>> atmos col:anl:NAve=0:PDS10= 0 0 45 128 57 32 255 128 71 200 0 0 13
7
>> 14 12 30 1 0 0 0 0 0 0 21 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 99 0
>> 0 0 0
>>
>> That string of numbers is difficult parse, but here's the timing
info: 13 7 14 12 30 It corresponds to 20130714_123000. So MODE is
parsing that information from the file correctly.
>>
>> I don't think there's a problem in the MET tools. We just don't
understand why the timestamp in that GRIB file is 30-minutes past the
hour. And unfortunately, I don't have an answer on that for you.
>> I don't know very much about the WWMCA data - perhaps someone
else as AFWA could help?
>>
>> Thanks,
>> John
>>
>> On 07/15/2013 01:20 PM, Craig, Robert J Civ USAF AFWA 16 WS/WXN via
RT wrote:
>>>
>>> Mon Jul 15 13:20:58 2013: Request 62252 was acted upon.
>>> Transaction: Ticket created by Robert.Craig at offutt.af.mil
>>> Queue: met_help
>>> Subject: Mode Cloud Verification
>>> Owner: Nobody
>>> Requestors: Robert.Craig at offutt.af.mil
>>> Status: new
>>> Ticket <URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=62252
>>>>
>>>
>>>
>>> John, I am using mode to verify cloud fcsts using WWMCA for
ground truth. If you notice the listing below, it is not matching
because it thinks the WWMCA data is on valid on a half hour so doesn't
match the fcst field. These data are only valid on the hour so I am
not sure why this is happening.
>>>
>>>
>>>
>>> /h/GRIBI/bin/GRIBI_degrib.exe
>>> /h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1
>>>
>>> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
17 -o /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
-grib
>>>
>>>
17:20247632:d=13071412:TCDC:kpds5=71:kpds6=200:kpds7=0:TR=0:P1=0:P2=0:
>>> TimeU=1:atmos col:anl:NAve=0
>>>
>>> /h/GRIBI/bin/GRIBI_degrib.exe
/h/data/global/WXQC/data/wwmca/wwmca_global_2013071412.GR1 -d
18 -o
/h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
-grib
>>>
>>>
18:21156214:d=13071412:LASUPD:kpds5=183:kpds6=200:kpds7=0:TR=0:P1=0:P
>>> 2
>>> =0:TimeU=1:atmos col:anl:NAve=0
>>>
>>> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
>>> 1667 1667 0 64 60000 30000" -x
>>> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_71
>>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>>>
>>> /h/GRIBI/bin/GRIBI_copygb.exe -g"255 3 717 897 24908 60824 8 66500
>>> 1667 1667 0 64 60000 30000" -x
>>> /h/data/global/WXQC/data/temp/met/wwmca_global_2013071412.GR1_183
>>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_183
>>>
>>> DEBUG 1: Default Config File:
>>> /home/qcteam/METv4.1/data/config/MODEConfig_default
>>>
>>> DEBUG 1: Match Config File:
>>> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>>>
>>> DEBUG 1: Merge Config File:
>>> /home/qcteam/METv4.1/data/config/DCFModeConfig_2
>>>
>>> DEBUG 1: Forecast File:
>>>
/prod8/data/global/DCF4/data/fcsts/t044/fcsts_t044_2013071400_012.GR1
>>>
>>> DEBUG 1: Observation File:
>>> /h/data/global/WXQC/data/temp/met/cloud_obs_file_71
>>>
>>> WARNING:
>>>
>>> WARNING: process_fcst_obs_files() -> Forecast and observation
valid times do not match 20130714_120000 != 20130714_123000 for
TCDC/L0 versus TCDC/L0.
>>>
>>> WARNING:
>>>
>>>
>>>
>>> The config files are attached. I ftp the data files to your
server.
>>>
>>>
>>>
>>> Bob Craig
>>>
>>>
>>>
>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
More information about the Met_help
mailing list