[Met_help] [rt.rap.ucar.edu #77370] History for Computation time for continuous statistics

Fri Aug 5 09:11:59 MDT 2016

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi,

I had a question about computation time for verification. I running MET
with the RTMA and was wondering if it always take a long time to run the
verification, or if I could make it run faster? It took 14 min on my
machine for a single time. I have a 425x425 grid at 3 km that the RTMA is
mapped to, so I know it is a lot of grid points being verified.

Thanks!
Mark Benoit

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Re: [rt.rap.ucar.edu #77370] Computation time for continuous statistics
From: Julie Prestopnik
Time: Thu Jul 28 12:41:34 2016

Hi Mark.

I'm sorry to hear that MET is taking a long time to run verification.
There are times when the MET tools can run slowly and consume a lot of
memory.  Computing bootstrap confidence intervals and ran correlation
coefficients over a large number of matched pairs can be costly, but
they can easily be disabled in the config files.

You can make sure that the number of bootstrap replicates is set to 0
to disable the bootstrapping process:

boot = {
   ...
   n_rep    = 0;
   ...
}

Also, you can set "rank_corr_flag   = FALSE;" to disable the
computation of rank correlations.

I hope that helps.  If these changes will work for you, give them a
try and let us know if it improves the verification time.

Thanks,
Julie

On Thu, Jul 28, 2016 at 11:27 AM, Mark Benoit via RT
<met_help at ucar.edu> wrote:
>
> Thu Jul 28 11:27:55 2016: Request 77370 was acted upon.
> Transaction: Ticket created by mark.benoit at tamu.edu
>        Queue: met_help
>      Subject: Computation time for continuous statistics
>        Owner: Nobody
>   Requestors: mark.benoit at tamu.edu
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77370 >
>
>
> Hi,
>
> I had a question about computation time for verification. I running
MET
> with the RTMA and was wondering if it always take a long time to run
the
> verification, or if I could make it run faster? It took 14 min on my
> machine for a single time. I have a 425x425 grid at 3 km that the
RTMA is
> mapped to, so I know it is a lot of grid points being verified.
>
>
> Thanks!
> Mark Benoit
>

--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu

------------------------------------------------
Subject: Computation time for continuous statistics
From: Mark Benoit
Time: Thu Aug 04 21:40:14 2016

Julie,
The bootstrapping was already off, but turning the rank correlations
off
helped tremendously. Thanks for the advice!

Mark

On Thu, Jul 28, 2016 at 1:41 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:

> Hi Mark.
>
> I'm sorry to hear that MET is taking a long time to run
verification.
> There are times when the MET tools can run slowly and consume a lot
of
> memory.  Computing bootstrap confidence intervals and ran
correlation
> coefficients over a large number of matched pairs can be costly, but
> they can easily be disabled in the config files.
>
> You can make sure that the number of bootstrap replicates is set to
0
> to disable the bootstrapping process:
>
> boot = {
>    ...
>    n_rep    = 0;
>    ...
> }
>
>
> Also, you can set "rank_corr_flag   = FALSE;" to disable the
> computation of rank correlations.
>
> I hope that helps.  If these changes will work for you, give them a
> try and let us know if it improves the verification time.
>
> Thanks,
> Julie
>
> On Thu, Jul 28, 2016 at 11:27 AM, Mark Benoit via RT
<met_help at ucar.edu>
> wrote:
> >
> > Thu Jul 28 11:27:55 2016: Request 77370 was acted upon.
> > Transaction: Ticket created by mark.benoit at tamu.edu
> >        Queue: met_help
> >      Subject: Computation time for continuous statistics
> >        Owner: Nobody
> >   Requestors: mark.benoit at tamu.edu
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77370 >
> >
> >
> > Hi,
> >
> > I had a question about computation time for verification. I
running MET
> > with the RTMA and was wondering if it always take a long time to
run the
> > verification, or if I could make it run faster? It took 14 min on
my
> > machine for a single time. I have a 425x425 grid at 3 km that the
RTMA is
> > mapped to, so I know it is a lot of grid points being verified.
> >
> >
> > Thanks!
> > Mark Benoit
> >
>
>
>
> --
> Julie Prestopnik
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #77370] Computation time for continuous statistics
From: Julie Prestopnik
Time: Fri Aug 05 09:11:50 2016

Great!  I'm glad turning off the rank correlations helped.  I'll close
this ticket, but please let us know if you encounter any other issues.

Julie

On Thu, Aug 4, 2016 at 9:40 PM, Mark Benoit via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77370 >
>
> Julie,
> The bootstrapping was already off, but turning the rank correlations
off
> helped tremendously. Thanks for the advice!
>
> Mark
>
> On Thu, Jul 28, 2016 at 1:41 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Mark.
>>
>> I'm sorry to hear that MET is taking a long time to run
verification.
>> There are times when the MET tools can run slowly and consume a lot
of
>> memory.  Computing bootstrap confidence intervals and ran
correlation
>> coefficients over a large number of matched pairs can be costly,
but
>> they can easily be disabled in the config files.
>>
>> You can make sure that the number of bootstrap replicates is set to
0
>> to disable the bootstrapping process:
>>
>> boot = {
>>    ...
>>    n_rep    = 0;
>>    ...
>> }
>>
>>
>> Also, you can set "rank_corr_flag   = FALSE;" to disable the
>> computation of rank correlations.
>>
>> I hope that helps.  If these changes will work for you, give them a
>> try and let us know if it improves the verification time.
>>
>> Thanks,
>> Julie
>>
>> On Thu, Jul 28, 2016 at 11:27 AM, Mark Benoit via RT
<met_help at ucar.edu>
>> wrote:
>> >
>> > Thu Jul 28 11:27:55 2016: Request 77370 was acted upon.
>> > Transaction: Ticket created by mark.benoit at tamu.edu
>> >        Queue: met_help
>> >      Subject: Computation time for continuous statistics
>> >        Owner: Nobody
>> >   Requestors: mark.benoit at tamu.edu
>> >       Status: new
>> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=77370 >
>> >
>> >
>> > Hi,
>> >
>> > I had a question about computation time for verification. I
running MET
>> > with the RTMA and was wondering if it always take a long time to
run the
>> > verification, or if I could make it run faster? It took 14 min on
my
>> > machine for a single time. I have a 425x425 grid at 3 km that the
RTMA is
>> > mapped to, so I know it is a lot of grid points being verified.
>> >
>> >
>> > Thanks!
>> > Mark Benoit
>> >
>>
>>
>>
>> --
>> Julie Prestopnik
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>>
>

--
Julie Prestopnik
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu

------------------------------------------------