[Met_help] [rt.rap.ucar.edu #73764] History for tc_pair question
John Halley Gotway via RT
met_help at ucar.edu
Thu Oct 29 15:44:06 MDT 2015
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Dear Helpdesk,
I am trying to run tc_pair for hurricane Sandy simulation. However, the
output file "sandy.tcst" only includes head information.
I attach the job script, config, and data ( from WRF simulation and from
BestTrack) in this email. Please take a look and let me know if you
need more information.
I also attach a .pdf file showing the observed and simulated Sandy
track, just for your reference.
Many thanks!
Ming
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: tc_pair question
From: John Halley Gotway
Time: Thu Oct 15 14:13:04 2015
Ming,
Thanks for sending the data. That makes the situation a lot easier to
debug. There are a few things going on here.
(1) First, met-5.0 only reads track data files that end in the ".dat"
suffix. The data files you are passing it end with ".orig". When I
run
met-5.0 tc_pairs using the data you sent, the output includes these
lines:
DEBUG 2: Processing 0 ADECK file(s).
DEBUG 2: Found 0 BDECK track(s).
(2) Renaming those files to use the ".dat" suffix instead, it reads
those
files, but we still end up with empty output:
DEBUG 2: Processing 1 ADECK file(s).
DEBUG 2: Found 1 BDECK track(s).
(3) Rerunning again, but using a verbosity level of 4 (-v 4), the
output
includes this line:
DEBUG 4: Discarding track 1 for storm name mismatch: (nul)
(4) Looking in the config file, I see that you're only using track
data
where the storm name = SANDY:
storm_name = ["SANDY"];
But the storm name "SANDY" doesn't actually show up in ADECK track
data...
so tc_pairs skips over that track. I tried setting "storm_name" to an
empty list, but still ended up with empty output. But the output
includes
this:
DEBUG 4: Discarding track 1 for falling outside the valid time window:
20121023_000000 to 20141112_000000
(5) To simplify things, I set all the timing info to their default
values:
init_end = "";
init_inc = [];
init_exc = [];
valid_beg = "";
valid_end = "";
init_hour = [];
(6) Rerunning reveals this error:
ERROR : compute_track_err() -> exceeded the maximum number of
allowable
track points (3006 > 1000)
Looking at your ADECK data your forecast hours have a "00" at the end.
So
a 24-hour forecast written as "2400" is interpreted as a 2400-hour
forecast!
(7) I tried stripping off the trailing "00" for the forecast hours and
rerunning. And finally, that's a success. I've attached the output
sandy.tcst file, aal182012.dat file I used, and config.sandy.
A couple more points to make...
- While met-5.0 tc_pairs only reads files ending in .dat, met-5.1
tc_pairs
will read any file name you pass to it. If you use the option "-
lookin
filename", it'll read that file regardless of suffix. If you pass it
"-lookin directory", it'll search that directory only for files ending
in
.dat. met-5.1 will likely be released on Monday.
- When you can't figure out what the MET tools are doing, try
rerunning
with a higher verbosity level (-v 2, -v 3, or -v 4) and closely
inspect the
log messages to get a better idea of what it's doing.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Wed, Oct 14, 2015 at 1:20 PM, chenming at ucar.edu via RT
<met_help at ucar.edu
> wrote:
>
> Wed Oct 14 13:20:07 2015: Request 73764 was acted upon.
> Transaction: Ticket created by chenming at ucar.edu
> Queue: met_help
> Subject: tc_pair question
> Owner: Nobody
> Requestors: chenming at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73764 >
>
>
> Dear Helpdesk,
>
> I am trying to run tc_pair for hurricane Sandy simulation. However,
the
> output file "sandy.tcst" only includes head information.
>
> I attach the job script, config, and data ( from WRF simulation and
from
> BestTrack) in this email. Please take a look and let me know if you
> need more information.
>
> I also attach a .pdf file showing the observed and simulated Sandy
> track, just for your reference.
>
> Many thanks!
>
> Ming
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #73764] tc_pair question
From: chenming at ucar.edu
Time: Thu Oct 15 14:51:11 2015
Dear John,
Many thanks for the detailed explanation. This is really helpful. I
just have two question:
(1) for the config file, if I leave those settings to empty, where
does
the code get the default values? Does it simply derive the values from
what it reads from the ADECK and BDECK data?
(2) SANDY is listed in BDECK file ( the BestTrack data), but
apparently
the code doesn't recognize it. Does this mean that 'storm-name' is
actually an invalid entry?
Thanks again!
Ming
On 10/15/15 2:13 PM, John Halley Gotway via RT wrote:
> Ming,
>
> Thanks for sending the data. That makes the situation a lot easier
to
> debug. There are a few things going on here.
>
> (1) First, met-5.0 only reads track data files that end in the
".dat"
> suffix. The data files you are passing it end with ".orig". When I
run
> met-5.0 tc_pairs using the data you sent, the output includes these
lines:
>
> DEBUG 2: Processing 0 ADECK file(s).
>
> DEBUG 2: Found 0 BDECK track(s).
>
> (2) Renaming those files to use the ".dat" suffix instead, it reads
those
> files, but we still end up with empty output:
>
> DEBUG 2: Processing 1 ADECK file(s).
>
> DEBUG 2: Found 1 BDECK track(s).
>
> (3) Rerunning again, but using a verbosity level of 4 (-v 4), the
output
> includes this line:
>
> DEBUG 4: Discarding track 1 for storm name mismatch: (nul)
>
> (4) Looking in the config file, I see that you're only using track
data
> where the storm name = SANDY:
>
> storm_name = ["SANDY"];
>
> But the storm name "SANDY" doesn't actually show up in ADECK track
data...
> so tc_pairs skips over that track. I tried setting "storm_name" to
an
> empty list, but still ended up with empty output. But the output
includes
> this:
>
> DEBUG 4: Discarding track 1 for falling outside the valid time
window:
> 20121023_000000 to 20141112_000000
>
> (5) To simplify things, I set all the timing info to their default
values:
>
> init_end = "";
>
> init_inc = [];
>
> init_exc = [];
>
> valid_beg = "";
>
> valid_end = "";
>
> init_hour = [];
>
> (6) Rerunning reveals this error:
>
> ERROR : compute_track_err() -> exceeded the maximum number of
allowable
> track points (3006 > 1000)
>
> Looking at your ADECK data your forecast hours have a "00" at the
end. So
> a 24-hour forecast written as "2400" is interpreted as a 2400-hour
forecast!
>
> (7) I tried stripping off the trailing "00" for the forecast hours
and
> rerunning. And finally, that's a success. I've attached the output
> sandy.tcst file, aal182012.dat file I used, and config.sandy.
>
> A couple more points to make...
>
> - While met-5.0 tc_pairs only reads files ending in .dat, met-5.1
tc_pairs
> will read any file name you pass to it. If you use the option "-
lookin
> filename", it'll read that file regardless of suffix. If you pass
it
> "-lookin directory", it'll search that directory only for files
ending in
> .dat. met-5.1 will likely be released on Monday.
>
> - When you can't figure out what the MET tools are doing, try
rerunning
> with a higher verbosity level (-v 2, -v 3, or -v 4) and closely
inspect the
> log messages to get a better idea of what it's doing.
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
> met_help at ucar.edu
>
>
> On Wed, Oct 14, 2015 at 1:20 PM, chenming at ucar.edu via RT
<met_help at ucar.edu
>> wrote:
>> Wed Oct 14 13:20:07 2015: Request 73764 was acted upon.
>> Transaction: Ticket created by chenming at ucar.edu
>> Queue: met_help
>> Subject: tc_pair question
>> Owner: Nobody
>> Requestors: chenming at ucar.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73764 >
>>
>>
>> Dear Helpdesk,
>>
>> I am trying to run tc_pair for hurricane Sandy simulation. However,
the
>> output file "sandy.tcst" only includes head information.
>>
>> I attach the job script, config, and data ( from WRF simulation and
from
>> BestTrack) in this email. Please take a look and let me know if
you
>> need more information.
>>
>> I also attach a .pdf file showing the observed and simulated Sandy
>> track, just for your reference.
>>
>> Many thanks!
>>
>> Ming
>>
>>
>>
>>
------------------------------------------------
Subject: tc_pair question
From: John Halley Gotway
Time: Thu Oct 15 15:02:38 2015
Ming,
Specify an empty list causes to tool to use of the data it encounters.
Basically, an empty list says "do not apply this filtering criteria".
If
you do specify a list of values or non-empty string, it'll only use
the
data which meets the filtering criteria you've defined.
Yes, you're correct, "SANDY" does appear in the BDECK file. And
you'll
notice that when tc_pairs reads the BDECK track data it keeps that
track
because it includes the storm name "SANDY". However, it does *NOT*
include
the ADECK track because "SANDY" doesn't appear in the storm name
column of
the ADECK track data. So we have 1 BDECK track, 0 ADECK tracks, and
therefore 0 pairs of tracks. That's why the output is empty.
Perhaps we should modify the logic of the storm name filtering
criteria and
only apply it to BDECK tracks because ADECK tracks usually do not
include
the storm name. But in met-5.0 the storm name filtering logic is
applied
the same way to both the ADECK and BDECK tracks.
I think you're making things more confusing than they need to be.
When
running on a single ADECK and BDECK track, you really don't need to
specify
anything special in the config file. Just use the default settings,
and
it'll use whatever track data it finds in the input data files. If
you
start running on a whole season or year's worth of data, or you're
processing many models, that's when you may want to start defining the
filtering criteria available in the config file.
Thanks,
John
On Thu, Oct 15, 2015 at 2:51 PM, chenming at ucar.edu via RT
<met_help at ucar.edu
> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73764 >
>
> Dear John,
>
> Many thanks for the detailed explanation. This is really helpful. I
> just have two question:
>
> (1) for the config file, if I leave those settings to empty, where
does
> the code get the default values? Does it simply derive the values
from
> what it reads from the ADECK and BDECK data?
>
> (2) SANDY is listed in BDECK file ( the BestTrack data), but
apparently
> the code doesn't recognize it. Does this mean that 'storm-name' is
> actually an invalid entry?
>
> Thanks again!
>
> Ming
>
>
>
> On 10/15/15 2:13 PM, John Halley Gotway via RT wrote:
> > Ming,
> >
> > Thanks for sending the data. That makes the situation a lot
easier to
> > debug. There are a few things going on here.
> >
> > (1) First, met-5.0 only reads track data files that end in the
".dat"
> > suffix. The data files you are passing it end with ".orig". When
I run
> > met-5.0 tc_pairs using the data you sent, the output includes
these
> lines:
> >
> > DEBUG 2: Processing 0 ADECK file(s).
> >
> > DEBUG 2: Found 0 BDECK track(s).
> >
> > (2) Renaming those files to use the ".dat" suffix instead, it
reads those
> > files, but we still end up with empty output:
> >
> > DEBUG 2: Processing 1 ADECK file(s).
> >
> > DEBUG 2: Found 1 BDECK track(s).
> >
> > (3) Rerunning again, but using a verbosity level of 4 (-v 4), the
output
> > includes this line:
> >
> > DEBUG 4: Discarding track 1 for storm name mismatch: (nul)
> >
> > (4) Looking in the config file, I see that you're only using track
data
> > where the storm name = SANDY:
> >
> > storm_name = ["SANDY"];
> >
> > But the storm name "SANDY" doesn't actually show up in ADECK track
> data...
> > so tc_pairs skips over that track. I tried setting "storm_name"
to an
> > empty list, but still ended up with empty output. But the output
> includes
> > this:
> >
> > DEBUG 4: Discarding track 1 for falling outside the valid time
window:
> > 20121023_000000 to 20141112_000000
> >
> > (5) To simplify things, I set all the timing info to their default
> values:
> >
> > init_end = "";
> >
> > init_inc = [];
> >
> > init_exc = [];
> >
> > valid_beg = "";
> >
> > valid_end = "";
> >
> > init_hour = [];
> >
> > (6) Rerunning reveals this error:
> >
> > ERROR : compute_track_err() -> exceeded the maximum number of
allowable
> > track points (3006 > 1000)
> >
> > Looking at your ADECK data your forecast hours have a "00" at the
end.
> So
> > a 24-hour forecast written as "2400" is interpreted as a 2400-hour
> forecast!
> >
> > (7) I tried stripping off the trailing "00" for the forecast hours
and
> > rerunning. And finally, that's a success. I've attached the
output
> > sandy.tcst file, aal182012.dat file I used, and config.sandy.
> >
> > A couple more points to make...
> >
> > - While met-5.0 tc_pairs only reads files ending in .dat, met-5.1
> tc_pairs
> > will read any file name you pass to it. If you use the option "-
lookin
> > filename", it'll read that file regardless of suffix. If you pass
it
> > "-lookin directory", it'll search that directory only for files
ending in
> > .dat. met-5.1 will likely be released on Monday.
> >
> > - When you can't figure out what the MET tools are doing, try
rerunning
> > with a higher verbosity level (-v 2, -v 3, or -v 4) and closely
inspect
> the
> > log messages to get a better idea of what it's doing.
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> > met_help at ucar.edu
> >
> >
> > On Wed, Oct 14, 2015 at 1:20 PM, chenming at ucar.edu via RT <
> met_help at ucar.edu
> >> wrote:
> >> Wed Oct 14 13:20:07 2015: Request 73764 was acted upon.
> >> Transaction: Ticket created by chenming at ucar.edu
> >> Queue: met_help
> >> Subject: tc_pair question
> >> Owner: Nobody
> >> Requestors: chenming at ucar.edu
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=73764
> >
> >>
> >>
> >> Dear Helpdesk,
> >>
> >> I am trying to run tc_pair for hurricane Sandy simulation.
However, the
> >> output file "sandy.tcst" only includes head information.
> >>
> >> I attach the job script, config, and data ( from WRF simulation
and from
> >> BestTrack) in this email. Please take a look and let me know if
you
> >> need more information.
> >>
> >> I also attach a .pdf file showing the observed and simulated
Sandy
> >> track, just for your reference.
> >>
> >> Many thanks!
> >>
> >> Ming
> >>
> >>
> >>
> >>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list