[Met_help] [rt.rap.ucar.edu #48368] History for About the bootsrap

RAL HelpDesk {for Paul Oldenburg} met_help at ucar.edu
Fri Jul 22 13:51:55 MDT 2011


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hello, I am using the MET to calculate the ETS. I have got a month results from the Point_stat tool. When I aggregate them using the Stat_analysis tool, I found that bootsrap is not calculated.
 
My usage is :
"-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
The result is :
     CTS: 1923  0.12220 0.10831   0.13760   NA        NA        0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990 0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592  0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA       0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA      NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA      0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337 12.30571 24.49975 NA       NA

 
When I changed the usage as:
"-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100 -out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
The result is :
     CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286   0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937 0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401  0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824  0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442 0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849 0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514 0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
 
Now bootsrap is calculated. But we can see that the values of GSS are different.
So which usage is right when I want to aggregate the GSS and get the bootsrap?
I sent the corresponding files to you! Thank you!




--

Xubin Zhang, Ph.D candidate
Key Lab of Mesoscale Severe Weather
School of the Atmosphere  Science
Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
email:zhxubinchaoshan at 163.com

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: About the bootsrap
From: 张旭斌
Time: Thu Jul 14 08:39:48 2011



--

Xubin Zhang, Ph.D candidate
Key Lab of Mesoscale Severe Weather
School of the Atmosphere  Science
Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
email:zhxubinchaoshan at 163.com



At 2011-07-14 22:30:27,"RAL HelpDesk {for met_help at ucar.edu}"
<met_help at ucar.edu> wrote:

>Greetings,
>
>This message has been automatically generated in response to the
>creation of a trouble ticket regarding:
>	"About the bootsrap",
>a summary of which appears below.
>
>There is no need to reply to this message right now.  Your ticket has
been
>assigned an ID of [rt.rap.ucar.edu #48368].
>
>Please include the string:
>
>         [rt.rap.ucar.edu #48368]
>
>in the subject line of all future correspondence about this issue. To
do so,
>you may reply to this message.
>
>                        Thank you,
>                        met_help at ucar.edu
>
>-------------------------------------------------------------------------
>Hello, I am using the MET to calculate the ETS. I have got a month
results from the Point_stat tool. When I aggregate them using the
Stat_analysis tool, I found that bootsrap is not calculated.
>
>My usage is :
>"-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100 -fcst_var
APCP_06 -out_line_type CTS"
>The result is :
>     CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>
>
>When I changed the usage as:
>"-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>The result is :
>     CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>
>Now bootsrap is calculated. But we can see that the values of GSS are
different.
>So which usage is right when I want to aggregate the GSS and get the
bootsrap?
>I sent the corresponding files to you! Thank you!
>
>
>
>
>--
>
>Xubin Zhang, Ph.D candidate
>Key Lab of Mesoscale Severe Weather
>School of the Atmosphere  Science
>Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>email:zhxubinchaoshan at 163.com

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #48368] About the bootsrap
From: Paul Oldenburg
Time: Thu Jul 14 08:41:59 2011

Xubin,

Can you please send us your point_stat output files so that we can
reproduce your situation?  If you would prefer to
upload them to our FTP site, you can follow the instructions here:

http://www.dtcenter.org/met/users/support/met_help.php#ftp

Thanks,

Paul


On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>
> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
> Transaction: Ticket created by zhxubinchaoshan at 163.com
>        Queue: met_help
>      Subject: About the bootsrap
>        Owner: Nobody
>   Requestors: zhxubinchaoshan at 163.com
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>
>
> Hello, I am using the MET to calculate the ETS. I have got a month
results from the Point_stat tool. When I aggregate them using the
Stat_analysis tool, I found that bootsrap is not calculated.
>
> My usage is :
> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100 -fcst_var
APCP_06 -out_line_type CTS"
> The result is :
>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>
>
> When I changed the usage as:
> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
> The result is :
>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>
> Now bootsrap is calculated. But we can see that the values of GSS
are different.
> So which usage is right when I want to aggregate the GSS and get the
bootsrap?
> I sent the corresponding files to you! Thank you!
>
>
>
>
> --
>
> Xubin Zhang, Ph.D candidate
> Key Lab of Mesoscale Severe Weather
> School of the Atmosphere  Science
> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
> email:zhxubinchaoshan at 163.com


------------------------------------------------
Subject: About the bootsrap
From: 张旭斌
Time: Thu Jul 14 09:01:53 2011

Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
So I have to sent the data to you by e-mail.


--

Xubin Zhang, Ph.D candidate
Key Lab of Mesoscale Severe Weather
School of the Atmosphere  Science
Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
email:zhxubinchaoshan at 163.com



At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:

>Xubin,
>
>Can you please send us your point_stat output files so that we can
reproduce your situation?  If you would prefer to
>upload them to our FTP site, you can follow the instructions here:
>
>http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
>Thanks,
>
>Paul
>
>
>On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>
>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>        Queue: met_help
>>      Subject: About the bootsrap
>>        Owner: Nobody
>>   Requestors: zhxubinchaoshan at 163.com
>>       Status: new
>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>
>>
>> Hello, I am using the MET to calculate the ETS. I have got a month
results from the Point_stat tool. When I aggregate them using the
Stat_analysis tool, I found that bootsrap is not calculated.
>>
>> My usage is :
>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100 -fcst_var
APCP_06 -out_line_type CTS"
>> The result is :
>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>
>>
>> When I changed the usage as:
>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>> The result is :
>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>
>> Now bootsrap is calculated. But we can see that the values of GSS
are different.
>> So which usage is right when I want to aggregate the GSS and get
the bootsrap?
>> I sent the corresponding files to you! Thank you!
>>
>>
>>
>>
>> --
>>
>> Xubin Zhang, Ph.D candidate
>> Key Lab of Mesoscale Severe Weather
>> School of the Atmosphere  Science
>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>> email:zhxubinchaoshan at 163.com
>
>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #48368] About the bootsrap
From: John Halley Gotway
Time: Thu Jul 14 16:03:22 2011

Xubin,

Hello.  My name is John, and I work with Paul on support for MET.

We have been looking at the issue you sent us.  While we definitely
see the behavior you're describing in the data you sent, we're not
able to replicate the problem using any other datasets.

One thing we did notice is that when we ran your second job - the
aggregate_stat job that converts from MPR to CTS - we were able to
replicate the expected output values but only when we changed the
type of thresholding used by STAT-Analysis:
   -out_fcst_thresh ge0.100 -out_obs_thresh ge0.100

Note that we've changed the greater-than (gt) to a greater-than-or-
equal-to (ge).  We see that your observations are really binned into
0.1 bins, and 0.1 is the threshold you're using.  We're
suspicious the fact that many of the observation values are exactly
equal to the threshold you're using is causing the problem.

So I'm trying to isolate the problem, but am having a difficult time.
I'm wondering if you would be able to send us your input to the Point-
Stat tool.  Specifically, I'm looking for:
   - Forecast file
   - ASCII and NetCDF observation files
   - Point-Stat configuration file
   - Command line you use to call Point-Stat.

That way, I'll be able to run Point-Stat on the same set of data your
using, and figure out if the process of thresholding is not working
the it should in Point-Stat and/or STAT-Analysis.

I tried following the instructions for accessing the FTP site, and
they worked as listed.  So please give that another try:
   http://www.dtcenter.org/met/users/support/met_help.php#ftp

Thanks,
John

On 07/14/2011 09:01 AM, RAL HelpDesk {for 张旭斌} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>
> Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
> So I have to sent the data to you by e-mail.
>
>
> --
>
> Xubin Zhang, Ph.D candidate
> Key Lab of Mesoscale Severe Weather
> School of the Atmosphere  Science
> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
> email:zhxubinchaoshan at 163.com
>
>
>
> At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:
>
>> Xubin,
>>
>> Can you please send us your point_stat output files so that we can
reproduce your situation?  If you would prefer to
>> upload them to our FTP site, you can follow the instructions here:
>>
>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>
>>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>>        Queue: met_help
>>>      Subject: About the bootsrap
>>>        Owner: Nobody
>>>   Requestors: zhxubinchaoshan at 163.com
>>>       Status: new
>>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>
>>>
>>> Hello, I am using the MET to calculate the ETS. I have got a month
results from the Point_stat tool. When I aggregate them using the
Stat_analysis tool, I found that bootsrap is not calculated.
>>>
>>> My usage is :
>>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100
-fcst_var APCP_06 -out_line_type CTS"
>>> The result is :
>>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>>
>>>
>>> When I changed the usage as:
>>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>>> The result is :
>>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>>
>>> Now bootsrap is calculated. But we can see that the values of GSS
are different.
>>> So which usage is right when I want to aggregate the GSS and get
the bootsrap?
>>> I sent the corresponding files to you! Thank you!
>>>
>>>
>>>
>>>
>>> --
>>>
>>> Xubin Zhang, Ph.D candidate
>>> Key Lab of Mesoscale Severe Weather
>>> School of the Atmosphere  Science
>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>> email:zhxubinchaoshan at 163.com
>>
>>
>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #48368] About the bootsrap
From: John Halley Gotway
Time: Thu Jul 14 16:56:48 2011

Xubin,

Sorry, you can disregard my previous email.  I don't need you to send
us any data.  I was able to replicate the problem you're seeing, and
see how the problem can be fixed in the file
METv2.0/lib/vx_util/threshold.cc.

We'll work up a patch for this and let you know when it's available.

Sorry for the trouble.

John


On 07/14/2011 04:03 PM, RAL HelpDesk {for John Halley Gotway} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>
> Xubin,
>
> Hello.  My name is John, and I work with Paul on support for MET.
>
> We have been looking at the issue you sent us.  While we definitely
see the behavior you're describing in the data you sent, we're not
able to replicate the problem using any other datasets.
>
> One thing we did notice is that when we ran your second job - the
aggregate_stat job that converts from MPR to CTS - we were able to
replicate the expected output values but only when we changed the
> type of thresholding used by STAT-Analysis:
>    -out_fcst_thresh ge0.100 -out_obs_thresh ge0.100
>
> Note that we've changed the greater-than (gt) to a greater-than-or-
equal-to (ge).  We see that your observations are really binned into
0.1 bins, and 0.1 is the threshold you're using.  We're
> suspicious the fact that many of the observation values are exactly
equal to the threshold you're using is causing the problem.
>
> So I'm trying to isolate the problem, but am having a difficult
time.  I'm wondering if you would be able to send us your input to the
Point-Stat tool.  Specifically, I'm looking for:
>    - Forecast file
>    - ASCII and NetCDF observation files
>    - Point-Stat configuration file
>    - Command line you use to call Point-Stat.
>
> That way, I'll be able to run Point-Stat on the same set of data
your using, and figure out if the process of thresholding is not
working the it should in Point-Stat and/or STAT-Analysis.
>
> I tried following the instructions for accessing the FTP site, and
they worked as listed.  So please give that another try:
>    http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> Thanks,
> John
>
> On 07/14/2011 09:01 AM, RAL HelpDesk {for 张旭斌} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>
>> Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
>> So I have to sent the data to you by e-mail.
>>
>>
>> --
>>
>> Xubin Zhang, Ph.D candidate
>> Key Lab of Mesoscale Severe Weather
>> School of the Atmosphere  Science
>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>> email:zhxubinchaoshan at 163.com
>>
>>
>>
>> At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:
>>
>>> Xubin,
>>>
>>> Can you please send us your point_stat output files so that we can
reproduce your situation?  If you would prefer to
>>> upload them to our FTP site, you can follow the instructions here:
>>>
>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>
>>>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>>>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>>>        Queue: met_help
>>>>      Subject: About the bootsrap
>>>>        Owner: Nobody
>>>>   Requestors: zhxubinchaoshan at 163.com
>>>>       Status: new
>>>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>
>>>>
>>>> Hello, I am using the MET to calculate the ETS. I have got a
month results from the Point_stat tool. When I aggregate them using
the Stat_analysis tool, I found that bootsrap is not calculated.
>>>>
>>>> My usage is :
>>>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100
-fcst_var APCP_06 -out_line_type CTS"
>>>> The result is :
>>>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>>>
>>>>
>>>> When I changed the usage as:
>>>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>>>> The result is :
>>>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>>>
>>>> Now bootsrap is calculated. But we can see that the values of GSS
are different.
>>>> So which usage is right when I want to aggregate the GSS and get
the bootsrap?
>>>> I sent the corresponding files to you! Thank you!
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Xubin Zhang, Ph.D candidate
>>>> Key Lab of Mesoscale Severe Weather
>>>> School of the Atmosphere  Science
>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>> email:zhxubinchaoshan at 163.com
>>>
>>>
>>

------------------------------------------------
Subject: About the bootsrap
From: 张旭斌
Time: Fri Jul 15 07:05:49 2011

Thank you for your replys! It dose not matter! I will look foward to
your results!

--

Xubin Zhang, Ph.D candidate
Key Lab of Mesoscale Severe Weather
School of the Atmosphere  Science
Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
email:zhxubinchaoshan at 163.com



At 2011-07-15 06:56:49,"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:

>Xubin,
>
>Sorry, you can disregard my previous email.  I don't need you to send
us any data.  I was able to replicate the problem you're seeing, and
see how the problem can be fixed in the file
>METv2.0/lib/vx_util/threshold.cc.
>
>We'll work up a patch for this and let you know when it's available.
>
>Sorry for the trouble.
>
>John
>
>
>On 07/14/2011 04:03 PM, RAL HelpDesk {for John Halley Gotway} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>
>> Xubin,
>>
>> Hello.  My name is John, and I work with Paul on support for MET.
>>
>> We have been looking at the issue you sent us.  While we definitely
see the behavior you're describing in the data you sent, we're not
able to replicate the problem using any other datasets.
>>
>> One thing we did notice is that when we ran your second job - the
aggregate_stat job that converts from MPR to CTS - we were able to
replicate the expected output values but only when we changed the
>> type of thresholding used by STAT-Analysis:
>>    -out_fcst_thresh ge0.100 -out_obs_thresh ge0.100
>>
>> Note that we've changed the greater-than (gt) to a greater-than-or-
equal-to (ge).  We see that your observations are really binned into
0.1 bins, and 0.1 is the threshold you're using.  We're
>> suspicious the fact that many of the observation values are exactly
equal to the threshold you're using is causing the problem.
>>
>> So I'm trying to isolate the problem, but am having a difficult
time.  I'm wondering if you would be able to send us your input to the
Point-Stat tool.  Specifically, I'm looking for:
>>    - Forecast file
>>    - ASCII and NetCDF observation files
>>    - Point-Stat configuration file
>>    - Command line you use to call Point-Stat.
>>
>> That way, I'll be able to run Point-Stat on the same set of data
your using, and figure out if the process of thresholding is not
working the it should in Point-Stat and/or STAT-Analysis.
>>
>> I tried following the instructions for accessing the FTP site, and
they worked as listed.  So please give that another try:
>>    http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>
>> Thanks,
>> John
>>
>> On 07/14/2011 09:01 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>
>>> Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
>>> So I have to sent the data to you by e-mail.
>>>
>>>
>>> --
>>>
>>> Xubin Zhang, Ph.D candidate
>>> Key Lab of Mesoscale Severe Weather
>>> School of the Atmosphere  Science
>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>> email:zhxubinchaoshan at 163.com
>>>
>>>
>>>
>>> At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:
>>>
>>>> Xubin,
>>>>
>>>> Can you please send us your point_stat output files so that we
can reproduce your situation?  If you would prefer to
>>>> upload them to our FTP site, you can follow the instructions
here:
>>>>
>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>>
>>>>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>>>>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>>>>        Queue: met_help
>>>>>      Subject: About the bootsrap
>>>>>        Owner: Nobody
>>>>>   Requestors: zhxubinchaoshan at 163.com
>>>>>       Status: new
>>>>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>
>>>>>
>>>>> Hello, I am using the MET to calculate the ETS. I have got a
month results from the Point_stat tool. When I aggregate them using
the Stat_analysis tool, I found that bootsrap is not calculated.
>>>>>
>>>>> My usage is :
>>>>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100
-fcst_var APCP_06 -out_line_type CTS"
>>>>> The result is :
>>>>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>>>>
>>>>>
>>>>> When I changed the usage as:
>>>>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>>>>> The result is :
>>>>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>>>>
>>>>> Now bootsrap is calculated. But we can see that the values of
GSS are different.
>>>>> So which usage is right when I want to aggregate the GSS and get
the bootsrap?
>>>>> I sent the corresponding files to you! Thank you!
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Xubin Zhang, Ph.D candidate
>>>>> Key Lab of Mesoscale Severe Weather
>>>>> School of the Atmosphere  Science
>>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>>> email:zhxubinchaoshan at 163.com
>>>>
>>>>
>>>
>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #48368] About the bootsrap
From: John Halley Gotway
Time: Fri Jul 15 10:12:36 2011

Xubin,

OK, I've posted a bugfix for this to the MET website.  Since you're
using METv2.0, here's the page you should look at:
   http://www.dtcenter.org/met/users/support/known_issues/METv2.0/index.php

Just follow the instructions at the top of the page to get all of the
patches and rebuild MET.  For details on the bugfix, look for the
entry on that page dated 07/15/2011.

However, while you're doing this, you may want to consider upgrading
to the latest version, METv3.0.1.  If you do, please be sure to get
the latest set of patches for that release as well before
rebuilding.  I've posted this bugfix for METv2.0, METv3.0, and
METv3.0.1.  Generally speaking, we're not actively support METv2.0.
So you'll need to upgrade at some point anyway.

After you apply the patch and rerun, please make sure that the bad
behavior you were seeing has been corrected.

Thanks for paying close attention to your data and raising this issue!

John

On 07/15/2011 07:05 AM, RAL HelpDesk {for 张旭斌} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>
> Thank you for your replys! It dose not matter! I will look foward to
your results!
>
> --
>
> Xubin Zhang, Ph.D candidate
> Key Lab of Mesoscale Severe Weather
> School of the Atmosphere  Science
> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
> email:zhxubinchaoshan at 163.com
>
>
>
> At 2011-07-15 06:56:49,"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:
>
>> Xubin,
>>
>> Sorry, you can disregard my previous email.  I don't need you to
send us any data.  I was able to replicate the problem you're seeing,
and see how the problem can be fixed in the file
>> METv2.0/lib/vx_util/threshold.cc.
>>
>> We'll work up a patch for this and let you know when it's
available.
>>
>> Sorry for the trouble.
>>
>> John
>>
>>
>> On 07/14/2011 04:03 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>
>>> Xubin,
>>>
>>> Hello.  My name is John, and I work with Paul on support for MET.
>>>
>>> We have been looking at the issue you sent us.  While we
definitely see the behavior you're describing in the data you sent,
we're not able to replicate the problem using any other datasets.
>>>
>>> One thing we did notice is that when we ran your second job - the
aggregate_stat job that converts from MPR to CTS - we were able to
replicate the expected output values but only when we changed the
>>> type of thresholding used by STAT-Analysis:
>>>    -out_fcst_thresh ge0.100 -out_obs_thresh ge0.100
>>>
>>> Note that we've changed the greater-than (gt) to a greater-than-
or-equal-to (ge).  We see that your observations are really binned
into 0.1 bins, and 0.1 is the threshold you're using.  We're
>>> suspicious the fact that many of the observation values are
exactly equal to the threshold you're using is causing the problem.
>>>
>>> So I'm trying to isolate the problem, but am having a difficult
time.  I'm wondering if you would be able to send us your input to the
Point-Stat tool.  Specifically, I'm looking for:
>>>    - Forecast file
>>>    - ASCII and NetCDF observation files
>>>    - Point-Stat configuration file
>>>    - Command line you use to call Point-Stat.
>>>
>>> That way, I'll be able to run Point-Stat on the same set of data
your using, and figure out if the process of thresholding is not
working the it should in Point-Stat and/or STAT-Analysis.
>>>
>>> I tried following the instructions for accessing the FTP site, and
they worked as listed.  So please give that another try:
>>>    http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>
>>> Thanks,
>>> John
>>>
>>> On 07/14/2011 09:01 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>
>>>> Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
>>>> So I have to sent the data to you by e-mail.
>>>>
>>>>
>>>> --
>>>>
>>>> Xubin Zhang, Ph.D candidate
>>>> Key Lab of Mesoscale Severe Weather
>>>> School of the Atmosphere  Science
>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>> email:zhxubinchaoshan at 163.com
>>>>
>>>>
>>>>
>>>> At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:
>>>>
>>>>> Xubin,
>>>>>
>>>>> Can you please send us your point_stat output files so that we
can reproduce your situation?  If you would prefer to
>>>>> upload them to our FTP site, you can follow the instructions
here:
>>>>>
>>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>>>
>>>>>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>>>>>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>>>>>        Queue: met_help
>>>>>>      Subject: About the bootsrap
>>>>>>        Owner: Nobody
>>>>>>   Requestors: zhxubinchaoshan at 163.com
>>>>>>       Status: new
>>>>>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>>
>>>>>>
>>>>>> Hello, I am using the MET to calculate the ETS. I have got a
month results from the Point_stat tool. When I aggregate them using
the Stat_analysis tool, I found that bootsrap is not calculated.
>>>>>>
>>>>>> My usage is :
>>>>>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100
-fcst_var APCP_06 -out_line_type CTS"
>>>>>> The result is :
>>>>>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>>>>>
>>>>>>
>>>>>> When I changed the usage as:
>>>>>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>>>>>> The result is :
>>>>>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>>>>>
>>>>>> Now bootsrap is calculated. But we can see that the values of
GSS are different.
>>>>>> So which usage is right when I want to aggregate the GSS and
get the bootsrap?
>>>>>> I sent the corresponding files to you! Thank you!
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Xubin Zhang, Ph.D candidate
>>>>>> Key Lab of Mesoscale Severe Weather
>>>>>> School of the Atmosphere  Science
>>>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>>>> email:zhxubinchaoshan at 163.com
>>>>>
>>>>>
>>>>
>>

------------------------------------------------
Subject: About the bootsrap
From: 张旭斌
Time: Thu Jul 21 01:10:49 2011

If I follow the instructions you gave, do I need to rerun the  Point-
Stat tool?

--

Xubin Zhang, Ph.D candidate
Key Lab of Mesoscale Severe Weather
School of the Atmosphere  Science
Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
email:zhxubinchaoshan at 163.com



At 2011-07-16 00:12:36,"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:
>Xubin,
>
>OK, I've posted a bugfix for this to the MET website.  Since you're
using METv2.0, here's the page you should look at:
>
http://www.dtcenter.org/met/users/support/known_issues/METv2.0/index.php
>
>Just follow the instructions at the top of the page to get all of the
patches and rebuild MET.  For details on the bugfix, look for the
entry on that page dated 07/15/2011.
>
>However, while you're doing this, you may want to consider upgrading
to the latest version, METv3.0.1.  If you do, please be sure to get
the latest set of patches for that release as well before
>rebuilding.  I've posted this bugfix for METv2.0, METv3.0, and
METv3.0.1.  Generally speaking, we're not actively support METv2.0.
So you'll need to upgrade at some point anyway.
>
>After you apply the patch and rerun, please make sure that the bad
behavior you were seeing has been corrected.
>
>Thanks for paying close attention to your data and raising this
issue!
>
>John
>
>On 07/15/2011 07:05 AM, RAL HelpDesk {for 张旭斌} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>
>> Thank you for your replys! It dose not matter! I will look foward
to your results!
>>
>> --
>>
>> Xubin Zhang, Ph.D candidate
>> Key Lab of Mesoscale Severe Weather
>> School of the Atmosphere  Science
>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>> email:zhxubinchaoshan at 163.com
>>
>>
>>
>> At 2011-07-15 06:56:49,"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:
>>
>>> Xubin,
>>>
>>> Sorry, you can disregard my previous email.  I don't need you to
send us any data.  I was able to replicate the problem you're seeing,
and see how the problem can be fixed in the file
>>> METv2.0/lib/vx_util/threshold.cc.
>>>
>>> We'll work up a patch for this and let you know when it's
available.
>>>
>>> Sorry for the trouble.
>>>
>>> John
>>>
>>>
>>> On 07/14/2011 04:03 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>
>>>> Xubin,
>>>>
>>>> Hello.  My name is John, and I work with Paul on support for MET.
>>>>
>>>> We have been looking at the issue you sent us.  While we
definitely see the behavior you're describing in the data you sent,
we're not able to replicate the problem using any other datasets.
>>>>
>>>> One thing we did notice is that when we ran your second job - the
aggregate_stat job that converts from MPR to CTS - we were able to
replicate the expected output values but only when we changed the
>>>> type of thresholding used by STAT-Analysis:
>>>>    -out_fcst_thresh ge0.100 -out_obs_thresh ge0.100
>>>>
>>>> Note that we've changed the greater-than (gt) to a greater-than-
or-equal-to (ge).  We see that your observations are really binned
into 0.1 bins, and 0.1 is the threshold you're using.  We're
>>>> suspicious the fact that many of the observation values are
exactly equal to the threshold you're using is causing the problem.
>>>>
>>>> So I'm trying to isolate the problem, but am having a difficult
time.  I'm wondering if you would be able to send us your input to the
Point-Stat tool.  Specifically, I'm looking for:
>>>>    - Forecast file
>>>>    - ASCII and NetCDF observation files
>>>>    - Point-Stat configuration file
>>>>    - Command line you use to call Point-Stat.
>>>>
>>>> That way, I'll be able to run Point-Stat on the same set of data
your using, and figure out if the process of thresholding is not
working the it should in Point-Stat and/or STAT-Analysis.
>>>>
>>>> I tried following the instructions for accessing the FTP site,
and they worked as listed.  So please give that another try:
>>>>    http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>
>>>> Thanks,
>>>> John
>>>>
>>>> On 07/14/2011 09:01 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>
>>>>> Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
>>>>> So I have to sent the data to you by e-mail.
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Xubin Zhang, Ph.D candidate
>>>>> Key Lab of Mesoscale Severe Weather
>>>>> School of the Atmosphere  Science
>>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>>> email:zhxubinchaoshan at 163.com
>>>>>
>>>>>
>>>>>
>>>>> At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:
>>>>>
>>>>>> Xubin,
>>>>>>
>>>>>> Can you please send us your point_stat output files so that we
can reproduce your situation?  If you would prefer to
>>>>>> upload them to our FTP site, you can follow the instructions
here:
>>>>>>
>>>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>>
>>>>>> On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>>>>
>>>>>>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>>>>>>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>>>>>>        Queue: met_help
>>>>>>>      Subject: About the bootsrap
>>>>>>>        Owner: Nobody
>>>>>>>   Requestors: zhxubinchaoshan at 163.com
>>>>>>>       Status: new
>>>>>>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>>>
>>>>>>>
>>>>>>> Hello, I am using the MET to calculate the ETS. I have got a
month results from the Point_stat tool. When I aggregate them using
the Stat_analysis tool, I found that bootsrap is not calculated.
>>>>>>>
>>>>>>> My usage is :
>>>>>>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100
-fcst_var APCP_06 -out_line_type CTS"
>>>>>>> The result is :
>>>>>>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>>>>>>
>>>>>>>
>>>>>>> When I changed the usage as:
>>>>>>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>>>>>>> The result is :
>>>>>>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>>>>>>
>>>>>>> Now bootsrap is calculated. But we can see that the values of
GSS are different.
>>>>>>> So which usage is right when I want to aggregate the GSS and
get the bootsrap?
>>>>>>> I sent the corresponding files to you! Thank you!
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> Xubin Zhang, Ph.D candidate
>>>>>>> Key Lab of Mesoscale Severe Weather
>>>>>>> School of the Atmosphere  Science
>>>>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>>>>> email:zhxubinchaoshan at 163.com
>>>>>>
>>>>>>
>>>>>
>>>
>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #48368] About the bootsrap
From: John Halley Gotway
Time: Thu Jul 21 09:00:59 2011

Xubin,

Yes, you need to rerun Point-Stat.  While the problem was in the MET
library code, it showed up in the output of the Point-Stat tool.  So
you'll need to rerun it.

John

On 07/21/2011 01:10 AM, RAL HelpDesk {for 张旭斌} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>
> If I follow the instructions you gave, do I need to rerun the
Point-Stat tool?
>
> --
>
> Xubin Zhang, Ph.D candidate
> Key Lab of Mesoscale Severe Weather
> School of the Atmosphere  Science
> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
> email:zhxubinchaoshan at 163.com
>
>
>
> At 2011-07-16 00:12:36,"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:
>> Xubin,
>>
>> OK, I've posted a bugfix for this to the MET website.  Since you're
using METv2.0, here's the page you should look at:
>>
http://www.dtcenter.org/met/users/support/known_issues/METv2.0/index.php
>>
>> Just follow the instructions at the top of the page to get all of
the patches and rebuild MET.  For details on the bugfix, look for the
entry on that page dated 07/15/2011.
>>
>> However, while you're doing this, you may want to consider
upgrading to the latest version, METv3.0.1.  If you do, please be sure
to get the latest set of patches for that release as well before
>> rebuilding.  I've posted this bugfix for METv2.0, METv3.0, and
METv3.0.1.  Generally speaking, we're not actively support METv2.0.
So you'll need to upgrade at some point anyway.
>>
>> After you apply the patch and rerun, please make sure that the bad
behavior you were seeing has been corrected.
>>
>> Thanks for paying close attention to your data and raising this
issue!
>>
>> John
>>
>> On 07/15/2011 07:05 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>
>>> Thank you for your replys! It dose not matter! I will look foward
to your results!
>>>
>>> --
>>>
>>> Xubin Zhang, Ph.D candidate
>>> Key Lab of Mesoscale Severe Weather
>>> School of the Atmosphere  Science
>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>> email:zhxubinchaoshan at 163.com
>>>
>>>
>>>
>>> At 2011-07-15 06:56:49,"RAL HelpDesk {for John Halley Gotway}"
<met_help at ucar.edu> wrote:
>>>
>>>> Xubin,
>>>>
>>>> Sorry, you can disregard my previous email.  I don't need you to
send us any data.  I was able to replicate the problem you're seeing,
and see how the problem can be fixed in the file
>>>> METv2.0/lib/vx_util/threshold.cc.
>>>>
>>>> We'll work up a patch for this and let you know when it's
available.
>>>>
>>>> Sorry for the trouble.
>>>>
>>>> John
>>>>
>>>>
>>>> On 07/14/2011 04:03 PM, RAL HelpDesk {for John Halley Gotway}
wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>
>>>>> Xubin,
>>>>>
>>>>> Hello.  My name is John, and I work with Paul on support for
MET.
>>>>>
>>>>> We have been looking at the issue you sent us.  While we
definitely see the behavior you're describing in the data you sent,
we're not able to replicate the problem using any other datasets.
>>>>>
>>>>> One thing we did notice is that when we ran your second job -
the aggregate_stat job that converts from MPR to CTS - we were able to
replicate the expected output values but only when we changed the
>>>>> type of thresholding used by STAT-Analysis:
>>>>>    -out_fcst_thresh ge0.100 -out_obs_thresh ge0.100
>>>>>
>>>>> Note that we've changed the greater-than (gt) to a greater-than-
or-equal-to (ge).  We see that your observations are really binned
into 0.1 bins, and 0.1 is the threshold you're using.  We're
>>>>> suspicious the fact that many of the observation values are
exactly equal to the threshold you're using is causing the problem.
>>>>>
>>>>> So I'm trying to isolate the problem, but am having a difficult
time.  I'm wondering if you would be able to send us your input to the
Point-Stat tool.  Specifically, I'm looking for:
>>>>>    - Forecast file
>>>>>    - ASCII and NetCDF observation files
>>>>>    - Point-Stat configuration file
>>>>>    - Command line you use to call Point-Stat.
>>>>>
>>>>> That way, I'll be able to run Point-Stat on the same set of data
your using, and figure out if the process of thresholding is not
working the it should in Point-Stat and/or STAT-Analysis.
>>>>>
>>>>> I tried following the instructions for accessing the FTP site,
and they worked as listed.  So please give that another try:
>>>>>    http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>> On 07/14/2011 09:01 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>>
>>>>>> Sorry, I have log on your ftp, but I can not find
theincoming/irap/met_help.
>>>>>> So I have to sent the data to you by e-mail.
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Xubin Zhang, Ph.D candidate
>>>>>> Key Lab of Mesoscale Severe Weather
>>>>>> School of the Atmosphere  Science
>>>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R. China
>>>>>> email:zhxubinchaoshan at 163.com
>>>>>>
>>>>>>
>>>>>>
>>>>>> At 2011-07-14 22:42:00,"RAL HelpDesk {for Paul Oldenburg}"
<met_help at ucar.edu> wrote:
>>>>>>
>>>>>>> Xubin,
>>>>>>>
>>>>>>> Can you please send us your point_stat output files so that we
can reproduce your situation?  If you would prefer to
>>>>>>> upload them to our FTP site, you can follow the instructions
here:
>>>>>>>
>>>>>>> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Paul
>>>>>>>
>>>>>>>
>>>>>>> On 07/14/2011 08:30 AM, RAL HelpDesk {for 张旭斌} wrote:
>>>>>>>>
>>>>>>>> Thu Jul 14 08:30:27 2011: Request 48368 was acted upon.
>>>>>>>> Transaction: Ticket created by zhxubinchaoshan at 163.com
>>>>>>>>        Queue: met_help
>>>>>>>>      Subject: About the bootsrap
>>>>>>>>        Owner: Nobody
>>>>>>>>   Requestors: zhxubinchaoshan at 163.com
>>>>>>>>       Status: new
>>>>>>>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=48368 >
>>>>>>>>
>>>>>>>>
>>>>>>>> Hello, I am using the MET to calculate the ETS. I have got a
month results from the Point_stat tool. When I aggregate them using
the Stat_analysis tool, I found that bootsrap is not calculated.
>>>>>>>>
>>>>>>>> My usage is :
>>>>>>>> "-job aggregate_stat -line_type CTC  -fcst_thresh gt0.100
-fcst_var APCP_06 -out_line_type CTS"
>>>>>>>> The result is :
>>>>>>>>      CTS: 1923  0.12220 0.10831   0.13760   NA        NA
0.26625 0.24698   0.28646   NA        NA        0.80811 0.78990
0.82509 NA      NA      2.17872 NA        NA        0.80426 0.78592
0.82138  NA       NA       0.80865 0.79046  0.82561  NA       NA
0.19135 0.17439  0.20954  NA       NA       0.63086 0.60905 0.65215 NA
NA      0.33871 0.31790 0.36017 NA      NA      0.25519 NA      NA
0.61290 0.55892 0.66689 NA     NA     0.40662 NA      NA      17.36337
12.30571 24.49975 NA       NA
>>>>>>>>
>>>>>>>>
>>>>>>>> When I changed the usage as:
>>>>>>>> "-job aggregate_stat -line_type MPR  -out_fcst_thresh gt0.100
-out_obs_thresh gt0.100 -fcst_var APCP_06 -out_line_type CTS"
>>>>>>>> The result is :
>>>>>>>>      CTS: 1923  0.09984 0.08723   0.11405   0.08632   0.11286
0.26625 0.24698   0.28646   0.24649   0.28653   0.80759 0.78937
0.82459 0.78938 0.82475 2.66667 2.38461   3.01677   0.86979 0.85401
0.88410  0.81726  0.91667  0.80069 0.78225  0.81794  0.78061  0.81824
0.19931 0.18206  0.21775  0.18176  0.21939  0.67383 0.65255 0.69442
0.63651 0.71562 0.31099 0.29069 0.33204 0.27203 0.34659 0.23849
0.20372 0.27081 0.67048 0.62023 0.72074 0.61509 0.71870 0.38514
0.33848 0.42620 26.83617 17.34337 41.52481 17.71552 43.80575
>>>>>>>>
>>>>>>>> Now bootsrap is calculated. But we can see that the values of
GSS are different.
>>>>>>>> So which usage is right when I want to aggregate the GSS and
get the bootsrap?
>>>>>>>> I sent the corresponding files to you! Thank you!
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Xubin Zhang, Ph.D candidate
>>>>>>>> Key Lab of Mesoscale Severe Weather
>>>>>>>> School of the Atmosphere  Science
>>>>>>>> Nanjing University, Hankou Road 22, Nanjing 210093, P.R.
China
>>>>>>>> email:zhxubinchaoshan at 163.com
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>

------------------------------------------------


More information about the Met_help mailing list