[Met_help] [rt.rap.ucar.edu #82438] History for Error with MET

Tue Jul 9 12:04:14 MDT 2019

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi John,

I am running MET Mode tool on observation and precipitation files. I
noticed this one error for certain 24 hour forecast accumulation,

DEBUG 3: Applying convolution threshold >=10.0 resulted in 242 simple
observation objects.

DEBUG 3: Skipping observation object area threshold.

DEBUG 3: Skipping observation object intensity percentile threshold.

DEBUG 2: Computing contingency table statistics...

DEBUG 2: Identified: 67 forecast objects and 242 observation objects.

DEBUG 2: Performing merging (THRESH) in the forecast field.

DEBUG 2: Performing merging (THRESH) in the observation field.

ERROR  :

ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!

ERROR  :

Do you know what is causing this? Is there a way to fix it?

Thanks,

-- 
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Error with MET
From: John Halley Gotway
Time: Fri Oct 20 16:42:59 2017

Andrew,

I see that you're running MODE to generate a large number of objects.

Looking in src/libcode/vx_shapedata/set.h, I see that we have defined
hard
upper limits:
   static const int max_fcst_numbers = 100;
   static const int max_obs_numbers  = 100;

You could change those to arbitrarily large values... maybe 500 and
then
recompile.

However, I realize that that's less than ideal.  Instead, we should
dynamically allocate as much memory as required rather than having a
fixed
upper limit.  I'll add a development task to update this for MODE in a
future release.

Sorry I don't have a better answer for you.

Thanks,
John Halley Gotway
met_help at ucar.edu

On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> Transaction: Ticket created by andrew.kren at noaa.gov
>        Queue: met_help
>      Subject: Error with MET
>        Owner: Nobody
>   Requestors: andrew.kren at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
>
> Hi John,
>
> I am running MET Mode tool on observation and precipitation files. I
> noticed this one error for certain 24 hour forecast accumulation,
>
> DEBUG 3: Applying convolution threshold >=10.0 resulted in 242
simple
> observation objects.
>
> DEBUG 3: Skipping observation object area threshold.
>
> DEBUG 3: Skipping observation object intensity percentile threshold.
>
> DEBUG 2: Computing contingency table statistics...
>
> DEBUG 2: Identified: 67 forecast objects and 242 observation
objects.
>
> DEBUG 2: Performing merging (THRESH) in the forecast field.
>
> DEBUG 2: Performing merging (THRESH) in the observation field.
>
> ERROR  :
>
> ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
>
> ERROR  :
>
>
> Do you know what is causing this? Is there a way to fix it?
>
>
> Thanks,
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Fri Oct 20 21:56:20 2017

Thanks John

On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> I see that you're running MODE to generate a large number of
objects.
>
> Looking in src/libcode/vx_shapedata/set.h, I see that we have
defined hard
> upper limits:
>    static const int max_fcst_numbers = 100;
>    static const int max_obs_numbers  = 100;
>
> You could change those to arbitrarily large values... maybe 500 and
then
> recompile.
>
> However, I realize that that's less than ideal.  Instead, we should
> dynamically allocate as much memory as required rather than having a
fixed
> upper limit.  I'll add a development task to update this for MODE in
a
> future release.
>
> Sorry I don't have a better answer for you.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
>
> On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> > Transaction: Ticket created by andrew.kren at noaa.gov
> >        Queue: met_help
> >      Subject: Error with MET
> >        Owner: Nobody
> >   Requestors: andrew.kren at noaa.gov
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> >
> > Hi John,
> >
> > I am running MET Mode tool on observation and precipitation files.
I
> > noticed this one error for certain 24 hour forecast accumulation,
> >
> > DEBUG 3: Applying convolution threshold >=10.0 resulted in 242
simple
> > observation objects.
> >
> > DEBUG 3: Skipping observation object area threshold.
> >
> > DEBUG 3: Skipping observation object intensity percentile
threshold.
> >
> > DEBUG 2: Computing contingency table statistics...
> >
> > DEBUG 2: Identified: 67 forecast objects and 242 observation
objects.
> >
> > DEBUG 2: Performing merging (THRESH) in the forecast field.
> >
> > DEBUG 2: Performing merging (THRESH) in the observation field.
> >
> > ERROR  :
> >
> > ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
> >
> > ERROR  :
> >
> >
> > Do you know what is causing this? Is there a way to fix it?
> >
> >
> > Thanks,
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Mon Oct 23 13:34:50 2017

Thanks John. How would I recompile after making that change?

On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> I see that you're running MODE to generate a large number of
objects.
>
> Looking in src/libcode/vx_shapedata/set.h, I see that we have
defined hard
> upper limits:
>    static const int max_fcst_numbers = 100;
>    static const int max_obs_numbers  = 100;
>
> You could change those to arbitrarily large values... maybe 500 and
then
> recompile.
>
> However, I realize that that's less than ideal.  Instead, we should
> dynamically allocate as much memory as required rather than having a
fixed
> upper limit.  I'll add a development task to update this for MODE in
a
> future release.
>
> Sorry I don't have a better answer for you.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
>
> On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> > Transaction: Ticket created by andrew.kren at noaa.gov
> >        Queue: met_help
> >      Subject: Error with MET
> >        Owner: Nobody
> >   Requestors: andrew.kren at noaa.gov
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> >
> > Hi John,
> >
> > I am running MET Mode tool on observation and precipitation files.
I
> > noticed this one error for certain 24 hour forecast accumulation,
> >
> > DEBUG 3: Applying convolution threshold >=10.0 resulted in 242
simple
> > observation objects.
> >
> > DEBUG 3: Skipping observation object area threshold.
> >
> > DEBUG 3: Skipping observation object intensity percentile
threshold.
> >
> > DEBUG 2: Computing contingency table statistics...
> >
> > DEBUG 2: Identified: 67 forecast objects and 242 observation
objects.
> >
> > DEBUG 2: Performing merging (THRESH) in the forecast field.
> >
> > DEBUG 2: Performing merging (THRESH) in the observation field.
> >
> > ERROR  :
> >
> > ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
> >
> > ERROR  :
> >
> >
> > Do you know what is causing this? Is there a way to fix it?
> >
> >
> > Thanks,
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Mon Oct 23 13:58:38 2017

Andrew,

Can you remind me, did you compile MET yourself or are you running a
pre-compiled version?

If so, where are you running it?

Thanks,
John

On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> Thanks John. How would I recompile after making that change?
>
> On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andrew,
> >
> > I see that you're running MODE to generate a large number of
objects.
> >
> > Looking in src/libcode/vx_shapedata/set.h, I see that we have
defined
> hard
> > upper limits:
> >    static const int max_fcst_numbers = 100;
> >    static const int max_obs_numbers  = 100;
> >
> > You could change those to arbitrarily large values... maybe 500
and then
> > recompile.
> >
> > However, I realize that that's less than ideal.  Instead, we
should
> > dynamically allocate as much memory as required rather than having
a
> fixed
> > upper limit.  I'll add a development task to update this for MODE
in a
> > future release.
> >
> > Sorry I don't have a better answer for you.
> >
> > Thanks,
> > John Halley Gotway
> > met_help at ucar.edu
> >
> >
> > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> > > Transaction: Ticket created by andrew.kren at noaa.gov
> > >        Queue: met_help
> > >      Subject: Error with MET
> > >        Owner: Nobody
> > >   Requestors: andrew.kren at noaa.gov
> > >       Status: new
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
> >
> > >
> > >
> > > Hi John,
> > >
> > > I am running MET Mode tool on observation and precipitation
files. I
> > > noticed this one error for certain 24 hour forecast
accumulation,
> > >
> > > DEBUG 3: Applying convolution threshold >=10.0 resulted in 242
simple
> > > observation objects.
> > >
> > > DEBUG 3: Skipping observation object area threshold.
> > >
> > > DEBUG 3: Skipping observation object intensity percentile
threshold.
> > >
> > > DEBUG 2: Computing contingency table statistics...
> > >
> > > DEBUG 2: Identified: 67 forecast objects and 242 observation
objects.
> > >
> > > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > >
> > > DEBUG 2: Performing merging (THRESH) in the observation field.
> > >
> > > ERROR  :
> > >
> > > ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
> > >
> > > ERROR  :
> > >
> > >
> > > Do you know what is causing this? Is there a way to fix it?
> > >
> > >
> > > Thanks,
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Mon Oct 23 13:59:32 2017

I'm calling scripts from here on Theia.

/scratch4/BMC/dtc/MET/met-5.1/

On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> Can you remind me, did you compile MET yourself or are you running a
> pre-compiled version?
>
> If so, where are you running it?
>
> Thanks,
> John
>
> On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> > Thanks John. How would I recompile after making that change?
> >
> > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Andrew,
> > >
> > > I see that you're running MODE to generate a large number of
objects.
> > >
> > > Looking in src/libcode/vx_shapedata/set.h, I see that we have
defined
> > hard
> > > upper limits:
> > >    static const int max_fcst_numbers = 100;
> > >    static const int max_obs_numbers  = 100;
> > >
> > > You could change those to arbitrarily large values... maybe 500
and
> then
> > > recompile.
> > >
> > > However, I realize that that's less than ideal.  Instead, we
should
> > > dynamically allocate as much memory as required rather than
having a
> > fixed
> > > upper limit.  I'll add a development task to update this for
MODE in a
> > > future release.
> > >
> > > Sorry I don't have a better answer for you.
> > >
> > > Thanks,
> > > John Halley Gotway
> > > met_help at ucar.edu
> > >
> > >
> > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> > > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > >        Queue: met_help
> > > >      Subject: Error with MET
> > > >        Owner: Nobody
> > > >   Requestors: andrew.kren at noaa.gov
> > > >       Status: new
> > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=82438
> > >
> > > >
> > > >
> > > > Hi John,
> > > >
> > > > I am running MET Mode tool on observation and precipitation
files. I
> > > > noticed this one error for certain 24 hour forecast
accumulation,
> > > >
> > > > DEBUG 3: Applying convolution threshold >=10.0 resulted in 242
simple
> > > > observation objects.
> > > >
> > > > DEBUG 3: Skipping observation object area threshold.
> > > >
> > > > DEBUG 3: Skipping observation object intensity percentile
threshold.
> > > >
> > > > DEBUG 2: Computing contingency table statistics...
> > > >
> > > > DEBUG 2: Identified: 67 forecast objects and 242 observation
objects.
> > > >
> > > > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > > >
> > > > DEBUG 2: Performing merging (THRESH) in the observation field.
> > > >
> > > > ERROR  :
> > > >
> > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
> > > >
> > > > ERROR  :
> > > >
> > > >
> > > > Do you know what is causing this? Is there a way to fix it?
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > --
> > > > Andrew Kren
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Mon Oct 23 14:36:50 2017

Andrew,

OK, great.  You could consider switching to using the current version
of
met-6.0.
I did try recompiling MET version 5.1 but had problems.  So I'll list
instructions for compiling the current 6.0 release of MET.

To test this out, here are the commands I ran:

cd /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023

# Get latest bugfix version of code from here:
wget
https://dtcenter.org/met/users/downloads/MET_releases/met-
6.0_bugfix.20170920.tar.gz

# Untar
tar -xvzf met-6.0_bugfix.20170920.tar.gz
cd met-6.0_bugfix

# Configure

module load intel

setenv CC `which icc`

setenv CXX `which icc`

setenv F77 `which ifort`

# Variables for compiling MET

setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel

setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel

setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel

setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel

setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel

setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel

setenv MET_CAIROINC
/scratch4/BMC/dtc/MET/external_libs_intel/include/cairo

setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/external_libs_intel/lib

setenv MET_FREETYPEINC
/scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2

setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/external_libs_intel/lib

./configure --prefix=`pwd` --enable-grib2 --enable-modis --enable-
lidar2nc
# Compile
make install test

Once you get it to compile... make any necessary code changes and then
do...

make clean install

On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> I'm calling scripts from here on Theia.
>
> /scratch4/BMC/dtc/MET/met-5.1/
>
> On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andrew,
> >
> > Can you remind me, did you compile MET yourself or are you running
a
> > pre-compiled version?
> >
> > If so, where are you running it?
> >
> > Thanks,
> > John
> >
> > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > >
> > > Thanks John. How would I recompile after making that change?
> > >
> > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Andrew,
> > > >
> > > > I see that you're running MODE to generate a large number of
objects.
> > > >
> > > > Looking in src/libcode/vx_shapedata/set.h, I see that we have
> defined
> > > hard
> > > > upper limits:
> > > >    static const int max_fcst_numbers = 100;
> > > >    static const int max_obs_numbers  = 100;
> > > >
> > > > You could change those to arbitrarily large values... maybe
500 and
> > then
> > > > recompile.
> > > >
> > > > However, I realize that that's less than ideal.  Instead, we
should
> > > > dynamically allocate as much memory as required rather than
having a
> > > fixed
> > > > upper limit.  I'll add a development task to update this for
MODE in
> a
> > > > future release.
> > > >
> > > > Sorry I don't have a better answer for you.
> > > >
> > > > Thanks,
> > > > John Halley Gotway
> > > > met_help at ucar.edu
> > > >
> > > >
> > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA Affiliate
via RT
> <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> > > > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > > >        Queue: met_help
> > > > >      Subject: Error with MET
> > > > >        Owner: Nobody
> > > > >   Requestors: andrew.kren at noaa.gov
> > > > >       Status: new
> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=82438
> > > >
> > > > >
> > > > >
> > > > > Hi John,
> > > > >
> > > > > I am running MET Mode tool on observation and precipitation
files.
> I
> > > > > noticed this one error for certain 24 hour forecast
accumulation,
> > > > >
> > > > > DEBUG 3: Applying convolution threshold >=10.0 resulted in
242
> simple
> > > > > observation objects.
> > > > >
> > > > > DEBUG 3: Skipping observation object area threshold.
> > > > >
> > > > > DEBUG 3: Skipping observation object intensity percentile
> threshold.
> > > > >
> > > > > DEBUG 2: Computing contingency table statistics...
> > > > >
> > > > > DEBUG 2: Identified: 67 forecast objects and 242 observation
> objects.
> > > > >
> > > > > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > > > >
> > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
> > > > >
> > > > > ERROR  :
> > > > >
> > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
> > > > >
> > > > > ERROR  :
> > > > >
> > > > >
> > > > > Do you know what is causing this? Is there a way to fix it?
> > > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > > --
> > > > > Andrew Kren
> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > 325 Broadway, Boulder, CO 80305
> > > > > (303) 497-5418
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Mon Oct 23 14:39:17 2017

I will try this tomorrow John and let you know how it goes. Thanks.

On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> OK, great.  You could consider switching to using the current
version of
> met-6.0.
> I did try recompiling MET version 5.1 but had problems.  So I'll
list
> instructions for compiling the current 6.0 release of MET.
>
> To test this out, here are the commands I ran:
>
> cd /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023
>
> # Get latest bugfix version of code from here:
> wget
> https://dtcenter.org/met/users/downloads/MET_releases/
> met-6.0_bugfix.20170920.tar.gz
>
> # Untar
> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> cd met-6.0_bugfix
>
> # Configure
>
> module load intel
>
> setenv CC `which icc`
>
> setenv CXX `which icc`
>
> setenv F77 `which ifort`
>
> # Variables for compiling MET
>
> setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel
>
> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
>
> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
>
> setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel
>
> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
>
> setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel
>
> setenv MET_CAIROINC
/scratch4/BMC/dtc/MET/external_libs_intel/include/
> cairo
>
> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/external_libs_intel/lib
>
> setenv MET_FREETYPEINC
> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
>
> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/external_libs_intel/lib
>
> ./configure --prefix=`pwd` --enable-grib2 --enable-modis --enable-
lidar2nc
> # Compile
> make install test
>
> Once you get it to compile... make any necessary code changes and
then
> do...
>
> make clean install
>
> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> > I'm calling scripts from here on Theia.
> >
> > /scratch4/BMC/dtc/MET/met-5.1/
> >
> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Andrew,
> > >
> > > Can you remind me, did you compile MET yourself or are you
running a
> > > pre-compiled version?
> > >
> > > If so, where are you running it?
> > >
> > > Thanks,
> > > John
> > >
> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
> > > >
> > > > Thanks John. How would I recompile after making that change?
> > > >
> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Andrew,
> > > > >
> > > > > I see that you're running MODE to generate a large number of
> objects.
> > > > >
> > > > > Looking in src/libcode/vx_shapedata/set.h, I see that we
have
> > defined
> > > > hard
> > > > > upper limits:
> > > > >    static const int max_fcst_numbers = 100;
> > > > >    static const int max_obs_numbers  = 100;
> > > > >
> > > > > You could change those to arbitrarily large values... maybe
500 and
> > > then
> > > > > recompile.
> > > > >
> > > > > However, I realize that that's less than ideal.  Instead, we
should
> > > > > dynamically allocate as much memory as required rather than
having
> a
> > > > fixed
> > > > > upper limit.  I'll add a development task to update this for
MODE
> in
> > a
> > > > > future release.
> > > > >
> > > > > Sorry I don't have a better answer for you.
> > > > >
> > > > > Thanks,
> > > > > John Halley Gotway
> > > > > met_help at ucar.edu
> > > > >
> > > > >
> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA
Affiliate via
> RT
> > <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> > > > > > Transaction: Ticket created by andrew.kren at noaa.gov
> > > > > >        Queue: met_help
> > > > > >      Subject: Error with MET
> > > > > >        Owner: Nobody
> > > > > >   Requestors: andrew.kren at noaa.gov
> > > > > >       Status: new
> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=82438
> > > > >
> > > > > >
> > > > > >
> > > > > > Hi John,
> > > > > >
> > > > > > I am running MET Mode tool on observation and
precipitation
> files.
> > I
> > > > > > noticed this one error for certain 24 hour forecast
accumulation,
> > > > > >
> > > > > > DEBUG 3: Applying convolution threshold >=10.0 resulted in
242
> > simple
> > > > > > observation objects.
> > > > > >
> > > > > > DEBUG 3: Skipping observation object area threshold.
> > > > > >
> > > > > > DEBUG 3: Skipping observation object intensity percentile
> > threshold.
> > > > > >
> > > > > > DEBUG 2: Computing contingency table statistics...
> > > > > >
> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
observation
> > objects.
> > > > > >
> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
> > > > > >
> > > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
> > > > > >
> > > > > > ERROR  :
> > > > > >
> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs numbers!
> > > > > >
> > > > > > ERROR  :
> > > > > >
> > > > > >
> > > > > > Do you know what is causing this? Is there a way to fix
it?
> > > > > >
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > --
> > > > > > Andrew Kren
> > > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > > 325 Broadway, Boulder, CO 80305
> > > > > > (303) 497-5418
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Andrew Kren
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Tue Oct 24 09:06:29 2017

John,
I compiled and installed this morning, but got this error, is it
normal:

/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_stream.o):
In
function `jas_stream_tmpfile':

/scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_testing/METv4.1/MET_releases/intel/external_libs/jasper/jasper-
1.900.1/src/libjasper/base/jas_stream.c:368:
warning: the use of `tmpnam' is dangerous, better use `mkstemp'

/bin/ld:
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_cm.o):
undefined reference to symbol '__svml_pow2'

/apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64/libsvml.so:
error adding symbols: DSO missing from command line

collect2: error: ld returned 1 exit status

make[4]: *** [ensemble_stat] Error 1

make[4]: Leaving directory
`/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools/core/ensemble_stat'

make[3]: *** [install-recursive] Error 1

make[3]: Leaving directory
`/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools/core'

make[2]: *** [install-recursive] Error 1

make[2]: Leaving directory
`/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'

make[1]: *** [install-recursive] Error 1

make[1]: Leaving directory
`/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'

make: *** [install-recursive] Error 1

Thanks,

On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
andrew.kren at noaa.gov> wrote:

> I will try this tomorrow John and let you know how it goes. Thanks.
>
> On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Andrew,
>>
>> OK, great.  You could consider switching to using the current
version of
>> met-6.0.
>> I did try recompiling MET version 5.1 but had problems.  So I'll
list
>> instructions for compiling the current 6.0 release of MET.
>>
>> To test this out, here are the commands I ran:
>>
>> cd /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023
>>
>> # Get latest bugfix version of code from here:
>> wget
>> https://dtcenter.org/met/users/downloads/MET_releases/met-6.
>> 0_bugfix.20170920.tar.gz
>>
>> # Untar
>> tar -xvzf met-6.0_bugfix.20170920.tar.gz
>> cd met-6.0_bugfix
>>
>> # Configure
>>
>> module load intel
>>
>> setenv CC `which icc`
>>
>> setenv CXX `which icc`
>>
>> setenv F77 `which ifort`
>>
>> # Variables for compiling MET
>>
>> setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel
>>
>> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
>>
>> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
>>
>> setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel
>>
>> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
>>
>> setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel
>>
>> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
>> _libs_intel/include/cairo
>>
>> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/external_libs_intel/lib
>>
>> setenv MET_FREETYPEINC
>> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
>>
>> setenv MET_FREETYPELIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
>>
>> ./configure --prefix=`pwd` --enable-grib2 --enable-modis --enable-
lidar2nc
>> # Compile
>> make install test
>>
>> Once you get it to compile... make any necessary code changes and
then
>> do...
>>
>> make clean install
>>
>> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA Affiliate via
RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>> >
>> > I'm calling scripts from here on Theia.
>> >
>> > /scratch4/BMC/dtc/MET/met-5.1/
>> >
>> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > > Andrew,
>> > >
>> > > Can you remind me, did you compile MET yourself or are you
running a
>> > > pre-compiled version?
>> > >
>> > > If so, where are you running it?
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA Affiliate
via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
>> > > >
>> > > > Thanks John. How would I recompile after making that change?
>> > > >
>> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > > Andrew,
>> > > > >
>> > > > > I see that you're running MODE to generate a large number
of
>> objects.
>> > > > >
>> > > > > Looking in src/libcode/vx_shapedata/set.h, I see that we
have
>> > defined
>> > > > hard
>> > > > > upper limits:
>> > > > >    static const int max_fcst_numbers = 100;
>> > > > >    static const int max_obs_numbers  = 100;
>> > > > >
>> > > > > You could change those to arbitrarily large values... maybe
500
>> and
>> > > then
>> > > > > recompile.
>> > > > >
>> > > > > However, I realize that that's less than ideal.  Instead,
we
>> should
>> > > > > dynamically allocate as much memory as required rather than
>> having a
>> > > > fixed
>> > > > > upper limit.  I'll add a development task to update this
for MODE
>> in
>> > a
>> > > > > future release.
>> > > > >
>> > > > > Sorry I don't have a better answer for you.
>> > > > >
>> > > > > Thanks,
>> > > > > John Halley Gotway
>> > > > > met_help at ucar.edu
>> > > > >
>> > > > >
>> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA
Affiliate via
>> RT
>> > <
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > > >
>> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
>> > > > > > Transaction: Ticket created by andrew.kren at noaa.gov
>> > > > > >        Queue: met_help
>> > > > > >      Subject: Error with MET
>> > > > > >        Owner: Nobody
>> > > > > >   Requestors: andrew.kren at noaa.gov
>> > > > > >       Status: new
>> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > > Ticket/Display.html?id=82438
>> > > > >
>> > > > > >
>> > > > > >
>> > > > > > Hi John,
>> > > > > >
>> > > > > > I am running MET Mode tool on observation and
precipitation
>> files.
>> > I
>> > > > > > noticed this one error for certain 24 hour forecast
>> accumulation,
>> > > > > >
>> > > > > > DEBUG 3: Applying convolution threshold >=10.0 resulted
in 242
>> > simple
>> > > > > > observation objects.
>> > > > > >
>> > > > > > DEBUG 3: Skipping observation object area threshold.
>> > > > > >
>> > > > > > DEBUG 3: Skipping observation object intensity percentile
>> > threshold.
>> > > > > >
>> > > > > > DEBUG 2: Computing contingency table statistics...
>> > > > > >
>> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
observation
>> > objects.
>> > > > > >
>> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
>> > > > > >
>> > > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
>> > > > > >
>> > > > > > ERROR  :
>> > > > > >
>> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs
numbers!
>> > > > > >
>> > > > > > ERROR  :
>> > > > > >
>> > > > > >
>> > > > > > Do you know what is causing this? Is there a way to fix
it?
>> > > > > >
>> > > > > >
>> > > > > > Thanks,
>> > > > > >
>> > > > > > --
>> > > > > > Andrew Kren
>> > > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> > Group
>> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > > > 325 Broadway, Boulder, CO 80305
>> > > > > > (303) 497-5418
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > > > --
>> > > > Andrew Kren
>> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
>> > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > 325 Broadway, Boulder, CO 80305
>> > > > (303) 497-5418
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>> > --
>> > Andrew Kren
>> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> > NOAA ESRL Global Systems Division (Rm 3C515)
>> > 325 Broadway, Boulder, CO 80305
>> > (303) 497-5418
>> >
>> >
>>
>>
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Tue Oct 24 13:22:28 2017

Andrew,

Hmmm, could still be an environment issue.  To try to rule that out, I
put
this all into a single script.  Please go to a working directory and
this
command:

/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023/install_met.sh
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023/met-
6.0_bugfix.20170920.tar.gz
>& install.log &

tail -f install.log # Type CNTRL-C to exit the tail

If all goes well, that script will install met-6.0 in the current
directory
and run the test scripts.  In order to get the tools running from the
command line, you'll need to update your LD_LIBRARY_PATH like this:

export
LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_PATH}

Please let me know how that goes.  If you have problems, please send
me (or
point me to) the "install.log" file.

Thanks,
John

On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> John,
> I compiled and installed this morning, but got this error, is it
normal:
>
>
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_stream.o):
> In
> function `jas_stream_tmpfile':
>
> /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> testing/METv4.1/MET_releases/intel/external_libs/jasper/
> jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> warning: the use of `tmpnam' is dangerous, better use `mkstemp'
>
> /bin/ld:
> /scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_cm.o):
> undefined reference to symbol '__svml_pow2'
>
>
/apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64/libsvml.so:
> error adding symbols: DSO missing from command line
>
> collect2: error: ld returned 1 exit status
>
> make[4]: *** [ensemble_stat] Error 1
>
> make[4]: Leaving directory
> `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> tools/core/ensemble_stat'
>
> make[3]: *** [install-recursive] Error 1
>
> make[3]: Leaving directory
> `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools/core'
>
> make[2]: *** [install-recursive] Error 1
>
> make[2]: Leaving directory
> `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
>
> make[1]: *** [install-recursive] Error 1
>
> make[1]: Leaving directory
> `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
>
> make: *** [install-recursive] Error 1
>
>
> Thanks,
>
> On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
> andrew.kren at noaa.gov> wrote:
>
> > I will try this tomorrow John and let you know how it goes.
Thanks.
> >
> > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Andrew,
> >>
> >> OK, great.  You could consider switching to using the current
version of
> >> met-6.0.
> >> I did try recompiling MET version 5.1 but had problems.  So I'll
list
> >> instructions for compiling the current 6.0 release of MET.
> >>
> >> To test this out, here are the commands I ran:
> >>
> >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023
> >>
> >> # Get latest bugfix version of code from here:
> >> wget
> >> https://dtcenter.org/met/users/downloads/MET_releases/met-6.
> >> 0_bugfix.20170920.tar.gz
> >>
> >> # Untar
> >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> >> cd met-6.0_bugfix
> >>
> >> # Configure
> >>
> >> module load intel
> >>
> >> setenv CC `which icc`
> >>
> >> setenv CXX `which icc`
> >>
> >> setenv F77 `which ifort`
> >>
> >> # Variables for compiling MET
> >>
> >> setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel
> >>
> >> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
> >>
> >> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
> >>
> >> setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel
> >>
> >> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
> >>
> >> setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel
> >>
> >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> >> _libs_intel/include/cairo
> >>
> >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/external_libs_intel/lib
> >>
> >> setenv MET_FREETYPEINC
> >> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> >>
> >> setenv MET_FREETYPELIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
> >>
> >> ./configure --prefix=`pwd` --enable-grib2 --enable-modis
> --enable-lidar2nc
> >> # Compile
> >> make install test
> >>
> >> Once you get it to compile... make any necessary code changes and
then
> >> do...
> >>
> >> make clean install
> >>
> >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA Affiliate via
RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >> >
> >> > I'm calling scripts from here on Theia.
> >> >
> >> > /scratch4/BMC/dtc/MET/met-5.1/
> >> >
> >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > > Andrew,
> >> > >
> >> > > Can you remind me, did you compile MET yourself or are you
running a
> >> > > pre-compiled version?
> >> > >
> >> > > If so, where are you running it?
> >> > >
> >> > > Thanks,
> >> > > John
> >> > >
> >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA Affiliate
via
> RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >> > > >
> >> > > > Thanks John. How would I recompile after making that
change?
> >> > > >
> >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via RT
<
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > > Andrew,
> >> > > > >
> >> > > > > I see that you're running MODE to generate a large number
of
> >> objects.
> >> > > > >
> >> > > > > Looking in src/libcode/vx_shapedata/set.h, I see that we
have
> >> > defined
> >> > > > hard
> >> > > > > upper limits:
> >> > > > >    static const int max_fcst_numbers = 100;
> >> > > > >    static const int max_obs_numbers  = 100;
> >> > > > >
> >> > > > > You could change those to arbitrarily large values...
maybe 500
> >> and
> >> > > then
> >> > > > > recompile.
> >> > > > >
> >> > > > > However, I realize that that's less than ideal.  Instead,
we
> >> should
> >> > > > > dynamically allocate as much memory as required rather
than
> >> having a
> >> > > > fixed
> >> > > > > upper limit.  I'll add a development task to update this
for
> MODE
> >> in
> >> > a
> >> > > > > future release.
> >> > > > >
> >> > > > > Sorry I don't have a better answer for you.
> >> > > > >
> >> > > > > Thanks,
> >> > > > > John Halley Gotway
> >> > > > > met_help at ucar.edu
> >> > > > >
> >> > > > >
> >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA
Affiliate
> via
> >> RT
> >> > <
> >> > > > > met_help at ucar.edu> wrote:
> >> > > > >
> >> > > > > >
> >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted upon.
> >> > > > > > Transaction: Ticket created by andrew.kren at noaa.gov
> >> > > > > >        Queue: met_help
> >> > > > > >      Subject: Error with MET
> >> > > > > >        Owner: Nobody
> >> > > > > >   Requestors: andrew.kren at noaa.gov
> >> > > > > >       Status: new
> >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > > Ticket/Display.html?id=82438
> >> > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > Hi John,
> >> > > > > >
> >> > > > > > I am running MET Mode tool on observation and
precipitation
> >> files.
> >> > I
> >> > > > > > noticed this one error for certain 24 hour forecast
> >> accumulation,
> >> > > > > >
> >> > > > > > DEBUG 3: Applying convolution threshold >=10.0 resulted
in 242
> >> > simple
> >> > > > > > observation objects.
> >> > > > > >
> >> > > > > > DEBUG 3: Skipping observation object area threshold.
> >> > > > > >
> >> > > > > > DEBUG 3: Skipping observation object intensity
percentile
> >> > threshold.
> >> > > > > >
> >> > > > > > DEBUG 2: Computing contingency table statistics...
> >> > > > > >
> >> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
observation
> >> > objects.
> >> > > > > >
> >> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
> >> > > > > >
> >> > > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
> >> > > > > >
> >> > > > > > ERROR  :
> >> > > > > >
> >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs
numbers!
> >> > > > > >
> >> > > > > > ERROR  :
> >> > > > > >
> >> > > > > >
> >> > > > > > Do you know what is causing this? Is there a way to fix
it?
> >> > > > > >
> >> > > > > >
> >> > > > > > Thanks,
> >> > > > > >
> >> > > > > > --
> >> > > > > > Andrew Kren
> >> > > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> >> > Group
> >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > > > 325 Broadway, Boulder, CO 80305
> >> > > > > > (303) 497-5418
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > Andrew Kren
> >> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > 325 Broadway, Boulder, CO 80305
> >> > > > (303) 497-5418
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > Andrew Kren
> >> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> >> > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > 325 Broadway, Boulder, CO 80305
> >> > (303) 497-5418
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
>
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Tue Oct 24 14:39:21 2017

Hi John,

That seemed to work, my log file is here, let me know if errors:
/scratch4/BMC/shout/Andrew.Kren/MET/install.log

My .cshrc file in my home directory set the LD_LIBRARY_PATH
previously, but
I have it set with some IF statements, can you check if my current
setting
will cause issues? Also, do I need those export commnds in my .cshrc
for
running? I have added them.

Thanks,

On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> Hmmm, could still be an environment issue.  To try to rule that out,
I put
> this all into a single script.  Please go to a working directory and
this
> command:
>
> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> 20171023/install_met.sh
> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> 20171023/met-6.0_bugfix.20170920.tar.gz
> >& install.log &
>
> tail -f install.log # Type CNTRL-C to exit the tail
>
> If all goes well, that script will install met-6.0 in the current
directory
> and run the test scripts.  In order to get the tools running from
the
> command line, you'll need to update your LD_LIBRARY_PATH like this:
>
> export
> LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/
> lib:${LD_LIBRARY_PATH}
>
> Please let me know how that goes.  If you have problems, please send
me (or
> point me to) the "install.log" file.
>
> Thanks,
> John
>
> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> > John,
> > I compiled and installed this morning, but got this error, is it
normal:
> >
> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_stream.o):
> > In
> > function `jas_stream_tmpfile':
> >
> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> > warning: the use of `tmpnam' is dangerous, better use `mkstemp'
> >
> > /bin/ld:
> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_cm.o):
> > undefined reference to symbol '__svml_pow2'
> >
> >
/apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64/libsvml.so:
> > error adding symbols: DSO missing from command line
> >
> > collect2: error: ld returned 1 exit status
> >
> > make[4]: *** [ensemble_stat] Error 1
> >
> > make[4]: Leaving directory
> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> > tools/core/ensemble_stat'
> >
> > make[3]: *** [install-recursive] Error 1
> >
> > make[3]: Leaving directory
> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools/core'
> >
> > make[2]: *** [install-recursive] Error 1
> >
> > make[2]: Leaving directory
> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
> >
> > make[1]: *** [install-recursive] Error 1
> >
> > make[1]: Leaving directory
> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
> >
> > make: *** [install-recursive] Error 1
> >
> >
> > Thanks,
> >
> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
> > andrew.kren at noaa.gov> wrote:
> >
> > > I will try this tomorrow John and let you know how it goes.
Thanks.
> > >
> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Andrew,
> > >>
> > >> OK, great.  You could consider switching to using the current
version
> of
> > >> met-6.0.
> > >> I did try recompiling MET version 5.1 but had problems.  So
I'll list
> > >> instructions for compiling the current 6.0 release of MET.
> > >>
> > >> To test this out, here are the commands I ran:
> > >>
> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023
> > >>
> > >> # Get latest bugfix version of code from here:
> > >> wget
> > >> https://dtcenter.org/met/users/downloads/MET_releases/met-6.
> > >> 0_bugfix.20170920.tar.gz
> > >>
> > >> # Untar
> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> > >> cd met-6.0_bugfix
> > >>
> > >> # Configure
> > >>
> > >> module load intel
> > >>
> > >> setenv CC `which icc`
> > >>
> > >> setenv CXX `which icc`
> > >>
> > >> setenv F77 `which ifort`
> > >>
> > >> # Variables for compiling MET
> > >>
> > >> setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel
> > >>
> > >> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
> > >>
> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
> > >>
> > >> setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel
> > >>
> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
> > >>
> > >> setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel
> > >>
> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> > >> _libs_intel/include/cairo
> > >>
> > >> setenv MET_CAIROLIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
> > >>
> > >> setenv MET_FREETYPEINC
> > >> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> > >>
> > >> setenv MET_FREETYPELIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
> > >>
> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-modis
> > --enable-lidar2nc
> > >> # Compile
> > >> make install test
> > >>
> > >> Once you get it to compile... make any necessary code changes
and then
> > >> do...
> > >>
> > >> make clean install
> > >>
> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA Affiliate
via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
> > >> >
> > >> > I'm calling scripts from here on Theia.
> > >> >
> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> > >> >
> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > > Andrew,
> > >> > >
> > >> > > Can you remind me, did you compile MET yourself or are you
> running a
> > >> > > pre-compiled version?
> > >> > >
> > >> > > If so, where are you running it?
> > >> > >
> > >> > > Thanks,
> > >> > > John
> > >> > >
> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA
Affiliate via
> > RT <
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > >> > > >
> > >> > > > Thanks John. How would I recompile after making that
change?
> > >> > > >
> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via
RT <
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > > Andrew,
> > >> > > > >
> > >> > > > > I see that you're running MODE to generate a large
number of
> > >> objects.
> > >> > > > >
> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I see that
we have
> > >> > defined
> > >> > > > hard
> > >> > > > > upper limits:
> > >> > > > >    static const int max_fcst_numbers = 100;
> > >> > > > >    static const int max_obs_numbers  = 100;
> > >> > > > >
> > >> > > > > You could change those to arbitrarily large values...
maybe
> 500
> > >> and
> > >> > > then
> > >> > > > > recompile.
> > >> > > > >
> > >> > > > > However, I realize that that's less than ideal.
Instead, we
> > >> should
> > >> > > > > dynamically allocate as much memory as required rather
than
> > >> having a
> > >> > > > fixed
> > >> > > > > upper limit.  I'll add a development task to update
this for
> > MODE
> > >> in
> > >> > a
> > >> > > > > future release.
> > >> > > > >
> > >> > > > > Sorry I don't have a better answer for you.
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > John Halley Gotway
> > >> > > > > met_help at ucar.edu
> > >> > > > >
> > >> > > > >
> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA
Affiliate
> > via
> > >> RT
> > >> > <
> > >> > > > > met_help at ucar.edu> wrote:
> > >> > > > >
> > >> > > > > >
> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted
upon.
> > >> > > > > > Transaction: Ticket created by andrew.kren at noaa.gov
> > >> > > > > >        Queue: met_help
> > >> > > > > >      Subject: Error with MET
> > >> > > > > >        Owner: Nobody
> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> > >> > > > > >       Status: new
> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > >> > > Ticket/Display.html?id=82438
> > >> > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Hi John,
> > >> > > > > >
> > >> > > > > > I am running MET Mode tool on observation and
precipitation
> > >> files.
> > >> > I
> > >> > > > > > noticed this one error for certain 24 hour forecast
> > >> accumulation,
> > >> > > > > >
> > >> > > > > > DEBUG 3: Applying convolution threshold >=10.0
resulted in
> 242
> > >> > simple
> > >> > > > > > observation objects.
> > >> > > > > >
> > >> > > > > > DEBUG 3: Skipping observation object area threshold.
> > >> > > > > >
> > >> > > > > > DEBUG 3: Skipping observation object intensity
percentile
> > >> > threshold.
> > >> > > > > >
> > >> > > > > > DEBUG 2: Computing contingency table statistics...
> > >> > > > > >
> > >> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
observation
> > >> > objects.
> > >> > > > > >
> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
> > >> > > > > >
> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
> field.
> > >> > > > > >
> > >> > > > > > ERROR  :
> > >> > > > > >
> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs
numbers!
> > >> > > > > >
> > >> > > > > > ERROR  :
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Do you know what is causing this? Is there a way to
fix it?
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Thanks,
> > >> > > > > >
> > >> > > > > > --
> > >> > > > > > Andrew Kren
> > >> > > > > > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> > >> > Group
> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > >> > > > > > (303) 497-5418
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > > --
> > >> > > > Andrew Kren
> > >> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > 325 Broadway, Boulder, CO 80305
> > >> > > > (303) 497-5418
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> > Andrew Kren
> > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > 325 Broadway, Boulder, CO 80305
> > >> > (303) 497-5418
> > >> >
> > >> >
> > >>
> > >>
> > >
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> >
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Tue Oct 24 15:19:39 2017

I got it to work with my scripts, but got this error when running:

*** Running MODE  ***

*** APCP02     ***

Init Date: 2013082500

Running 00 to 24 forecast accumulation

/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode: error
while
loading shared libraries: libnetcdf.so.6: cannot open shared object
file:
No such file or directory

I assume its something with the LD_LIBRARY_PATH

On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
andrew.kren at noaa.gov> wrote:

> Hi John,
>
> That seemed to work, my log file is here, let me know if errors:
> /scratch4/BMC/shout/Andrew.Kren/MET/install.log
>
> My .cshrc file in my home directory set the LD_LIBRARY_PATH
previously,
> but I have it set with some IF statements, can you check if my
current
> setting will cause issues? Also, do I need those export commnds in
my
> .cshrc for running? I have added them.
>
> Thanks,
>
> On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Andrew,
>>
>> Hmmm, could still be an environment issue.  To try to rule that
out, I put
>> this all into a single script.  Please go to a working directory
and this
>> command:
>>
>> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
>> 023/install_met.sh
>> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
>> 023/met-6.0_bugfix.20170920.tar.gz
>> >& install.log &
>>
>> tail -f install.log # Type CNTRL-C to exit the tail
>>
>> If all goes well, that script will install met-6.0 in the current
>> directory
>> and run the test scripts.  In order to get the tools running from
the
>> command line, you'll need to update your LD_LIBRARY_PATH like this:
>>
>> export
>> LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
>> b:${LD_LIBRARY_PATH}
>>
>> Please let me know how that goes.  If you have problems, please
send me
>> (or
>> point me to) the "install.log" file.
>>
>> Thanks,
>> John
>>
>> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA Affiliate via
RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>> >
>> > John,
>> > I compiled and installed this morning, but got this error, is it
normal:
>> >
>> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
>> jas_stream.o):
>> > In
>> > function `jas_stream_tmpfile':
>> >
>> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
>> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
>> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
>> > warning: the use of `tmpnam' is dangerous, better use `mkstemp'
>> >
>> > /bin/ld:
>> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_cm.o):
>> > undefined reference to symbol '__svml_pow2'
>> >
>> >
/apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64/libsvml.so:
>> > error adding symbols: DSO missing from command line
>> >
>> > collect2: error: ld returned 1 exit status
>> >
>> > make[4]: *** [ensemble_stat] Error 1
>> >
>> > make[4]: Leaving directory
>> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
>> > tools/core/ensemble_stat'
>> >
>> > make[3]: *** [install-recursive] Error 1
>> >
>> > make[3]: Leaving directory
>> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools/core'
>> >
>> > make[2]: *** [install-recursive] Error 1
>> >
>> > make[2]: Leaving directory
>> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
>> >
>> > make[1]: *** [install-recursive] Error 1
>> >
>> > make[1]: Leaving directory
>> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
>> >
>> > make: *** [install-recursive] Error 1
>> >
>> >
>> > Thanks,
>> >
>> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
>> > andrew.kren at noaa.gov> wrote:
>> >
>> > > I will try this tomorrow John and let you know how it goes.
Thanks.
>> > >
>> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > >> Andrew,
>> > >>
>> > >> OK, great.  You could consider switching to using the current
>> version of
>> > >> met-6.0.
>> > >> I did try recompiling MET version 5.1 but had problems.  So
I'll list
>> > >> instructions for compiling the current 6.0 release of MET.
>> > >>
>> > >> To test this out, here are the commands I ran:
>> > >>
>> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023
>> > >>
>> > >> # Get latest bugfix version of code from here:
>> > >> wget
>> > >> https://dtcenter.org/met/users/downloads/MET_releases/met-6.
>> > >> 0_bugfix.20170920.tar.gz
>> > >>
>> > >> # Untar
>> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
>> > >> cd met-6.0_bugfix
>> > >>
>> > >> # Configure
>> > >>
>> > >> module load intel
>> > >>
>> > >> setenv CC `which icc`
>> > >>
>> > >> setenv CXX `which icc`
>> > >>
>> > >> setenv F77 `which ifort`
>> > >>
>> > >> # Variables for compiling MET
>> > >>
>> > >> setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel
>> > >>
>> > >> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
>> > >>
>> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
>> > >>
>> > >> setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel
>> > >>
>> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
>> > >>
>> > >> setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel
>> > >>
>> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
>> > >> _libs_intel/include/cairo
>> > >>
>> > >> setenv MET_CAIROLIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
>> > >>
>> > >> setenv MET_FREETYPEINC
>> > >> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
>> > >>
>> > >> setenv MET_FREETYPELIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
>> > >>
>> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-modis
>> > --enable-lidar2nc
>> > >> # Compile
>> > >> make install test
>> > >>
>> > >> Once you get it to compile... make any necessary code changes
and
>> then
>> > >> do...
>> > >>
>> > >> make clean install
>> > >>
>> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA Affiliate
via RT
>> <
>> > >> met_help at ucar.edu> wrote:
>> > >>
>> > >> >
>> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>> > >> >
>> > >> > I'm calling scripts from here on Theia.
>> > >> >
>> > >> > /scratch4/BMC/dtc/MET/met-5.1/
>> > >> >
>> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT <
>> > >> > met_help at ucar.edu> wrote:
>> > >> >
>> > >> > > Andrew,
>> > >> > >
>> > >> > > Can you remind me, did you compile MET yourself or are you
>> running a
>> > >> > > pre-compiled version?
>> > >> > >
>> > >> > > If so, where are you running it?
>> > >> > >
>> > >> > > Thanks,
>> > >> > > John
>> > >> > >
>> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA
Affiliate via
>> > RT <
>> > >> > > met_help at ucar.edu> wrote:
>> > >> > >
>> > >> > > >
>> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>> >
>> > >> > > >
>> > >> > > > Thanks John. How would I recompile after making that
change?
>> > >> > > >
>> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway via
RT <
>> > >> > > > met_help at ucar.edu> wrote:
>> > >> > > >
>> > >> > > > > Andrew,
>> > >> > > > >
>> > >> > > > > I see that you're running MODE to generate a large
number of
>> > >> objects.
>> > >> > > > >
>> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I see that
we
>> have
>> > >> > defined
>> > >> > > > hard
>> > >> > > > > upper limits:
>> > >> > > > >    static const int max_fcst_numbers = 100;
>> > >> > > > >    static const int max_obs_numbers  = 100;
>> > >> > > > >
>> > >> > > > > You could change those to arbitrarily large values...
maybe
>> 500
>> > >> and
>> > >> > > then
>> > >> > > > > recompile.
>> > >> > > > >
>> > >> > > > > However, I realize that that's less than ideal.
Instead, we
>> > >> should
>> > >> > > > > dynamically allocate as much memory as required rather
than
>> > >> having a
>> > >> > > > fixed
>> > >> > > > > upper limit.  I'll add a development task to update
this for
>> > MODE
>> > >> in
>> > >> > a
>> > >> > > > > future release.
>> > >> > > > >
>> > >> > > > > Sorry I don't have a better answer for you.
>> > >> > > > >
>> > >> > > > > Thanks,
>> > >> > > > > John Halley Gotway
>> > >> > > > > met_help at ucar.edu
>> > >> > > > >
>> > >> > > > >
>> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA
Affiliate
>> > via
>> > >> RT
>> > >> > <
>> > >> > > > > met_help at ucar.edu> wrote:
>> > >> > > > >
>> > >> > > > > >
>> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted
upon.
>> > >> > > > > > Transaction: Ticket created by andrew.kren at noaa.gov
>> > >> > > > > >        Queue: met_help
>> > >> > > > > >      Subject: Error with MET
>> > >> > > > > >        Owner: Nobody
>> > >> > > > > >   Requestors: andrew.kren at noaa.gov
>> > >> > > > > >       Status: new
>> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > >> > > Ticket/Display.html?id=82438
>> > >> > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > Hi John,
>> > >> > > > > >
>> > >> > > > > > I am running MET Mode tool on observation and
precipitation
>> > >> files.
>> > >> > I
>> > >> > > > > > noticed this one error for certain 24 hour forecast
>> > >> accumulation,
>> > >> > > > > >
>> > >> > > > > > DEBUG 3: Applying convolution threshold >=10.0
resulted in
>> 242
>> > >> > simple
>> > >> > > > > > observation objects.
>> > >> > > > > >
>> > >> > > > > > DEBUG 3: Skipping observation object area threshold.
>> > >> > > > > >
>> > >> > > > > > DEBUG 3: Skipping observation object intensity
percentile
>> > >> > threshold.
>> > >> > > > > >
>> > >> > > > > > DEBUG 2: Computing contingency table statistics...
>> > >> > > > > >
>> > >> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
>> observation
>> > >> > objects.
>> > >> > > > > >
>> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
>> > >> > > > > >
>> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
>> field.
>> > >> > > > > >
>> > >> > > > > > ERROR  :
>> > >> > > > > >
>> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs
numbers!
>> > >> > > > > >
>> > >> > > > > > ERROR  :
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > Do you know what is causing this? Is there a way to
fix it?
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > Thanks,
>> > >> > > > > >
>> > >> > > > > > --
>> > >> > > > > > Andrew Kren
>> > >> > > > > > Research Scientist I, Global Observing Systems
Analysis
>> (GOSA)
>> > >> > Group
>> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > >> > > > > > 325 Broadway, Boulder, CO 80305
>> > >> > > > > > (303) 497-5418
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > > >
>> > >> > > > --
>> > >> > > > Andrew Kren
>> > >> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> > Group
>> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > >> > > > 325 Broadway, Boulder, CO 80305
>> > >> > > > (303) 497-5418
>> > >> > > >
>> > >> > > >
>> > >> > >
>> > >> > >
>> > >> >
>> > >> >
>> > >> > --
>> > >> > Andrew Kren
>> > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> Group
>> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
>> > >> > 325 Broadway, Boulder, CO 80305
>> > >> > (303) 497-5418
>> > >> >
>> > >> >
>> > >>
>> > >>
>> > >
>> > >
>> > > --
>> > > Andrew Kren
>> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > 325 Broadway, Boulder, CO 80305
>> > > (303) 497-5418
>> > >
>> >
>> >
>> >
>> > --
>> > Andrew Kren
>> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> > NOAA ESRL Global Systems Division (Rm 3C515)
>> > 325 Broadway, Boulder, CO 80305
>> > (303) 497-5418
>> >
>> >
>>
>>
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Tue Oct 24 17:12:42 2017

Andrew,

I looked through your log installation log and don't see any errors.

So here's the error message:

/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode: error
while
loading shared libraries: libnetcdf.so.6: cannot open shared object
file:
No such file or directory

This is fixed by updating your LD_LIBRARY_PATH:

setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_PATH}

That tells the tools where to find the external libraries needed at
runtime.  I'd suggest putting that in your .cshrc.

Hopefully that fixes it.

John

On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> I got it to work with my scripts, but got this error when running:
>
> *** Running MODE  ***
>
> *** APCP02     ***
>
> Init Date: 2013082500
>
> Running 00 to 24 forecast accumulation
>
>
> /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode: error
while
> loading shared libraries: libnetcdf.so.6: cannot open shared object
file:
> No such file or directory
>
> I assume its something with the LD_LIBRARY_PATH
>
> On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
> andrew.kren at noaa.gov> wrote:
>
> > Hi John,
> >
> > That seemed to work, my log file is here, let me know if errors:
> > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> >
> > My .cshrc file in my home directory set the LD_LIBRARY_PATH
previously,
> > but I have it set with some IF statements, can you check if my
current
> > setting will cause issues? Also, do I need those export commnds in
my
> > .cshrc for running? I have added them.
> >
> > Thanks,
> >
> > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Andrew,
> >>
> >> Hmmm, could still be an environment issue.  To try to rule that
out, I
> put
> >> this all into a single script.  Please go to a working directory
and
> this
> >> command:
> >>
> >> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> >> 023/install_met.sh
> >> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> >> 023/met-6.0_bugfix.20170920.tar.gz
> >> >& install.log &
> >>
> >> tail -f install.log # Type CNTRL-C to exit the tail
> >>
> >> If all goes well, that script will install met-6.0 in the current
> >> directory
> >> and run the test scripts.  In order to get the tools running from
the
> >> command line, you'll need to update your LD_LIBRARY_PATH like
this:
> >>
> >> export
> >> LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
> >> b:${LD_LIBRARY_PATH}
> >>
> >> Please let me know how that goes.  If you have problems, please
send me
> >> (or
> >> point me to) the "install.log" file.
> >>
> >> Thanks,
> >> John
> >>
> >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA Affiliate
via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >> >
> >> > John,
> >> > I compiled and installed this morning, but got this error, is
it
> normal:
> >> >
> >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
> >> jas_stream.o):
> >> > In
> >> > function `jas_stream_tmpfile':
> >> >
> >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> >> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
> >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> >> > warning: the use of `tmpnam' is dangerous, better use `mkstemp'
> >> >
> >> > /bin/ld:
> >> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(jas_cm.o):
> >> > undefined reference to symbol '__svml_pow2'
> >> >
> >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> intel64/libsvml.so:
> >> > error adding symbols: DSO missing from command line
> >> >
> >> > collect2: error: ld returned 1 exit status
> >> >
> >> > make[4]: *** [ensemble_stat] Error 1
> >> >
> >> > make[4]: Leaving directory
> >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> >> > tools/core/ensemble_stat'
> >> >
> >> > make[3]: *** [install-recursive] Error 1
> >> >
> >> > make[3]: Leaving directory
> >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools/core'
> >> >
> >> > make[2]: *** [install-recursive] Error 1
> >> >
> >> > make[2]: Leaving directory
> >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
> >> >
> >> > make[1]: *** [install-recursive] Error 1
> >> >
> >> > make[1]: Leaving directory
> >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
> >> >
> >> > make: *** [install-recursive] Error 1
> >> >
> >> >
> >> > Thanks,
> >> >
> >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
> >> > andrew.kren at noaa.gov> wrote:
> >> >
> >> > > I will try this tomorrow John and let you know how it goes.
Thanks.
> >> > >
> >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > >> Andrew,
> >> > >>
> >> > >> OK, great.  You could consider switching to using the
current
> >> version of
> >> > >> met-6.0.
> >> > >> I did try recompiling MET version 5.1 but had problems.  So
I'll
> list
> >> > >> instructions for compiling the current 6.0 release of MET.
> >> > >>
> >> > >> To test this out, here are the commands I ran:
> >> > >>
> >> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171023
> >> > >>
> >> > >> # Get latest bugfix version of code from here:
> >> > >> wget
> >> > >> https://dtcenter.org/met/users/downloads/MET_releases/met-6.
> >> > >> 0_bugfix.20170920.tar.gz
> >> > >>
> >> > >> # Untar
> >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> >> > >> cd met-6.0_bugfix
> >> > >>
> >> > >> # Configure
> >> > >>
> >> > >> module load intel
> >> > >>
> >> > >> setenv CC `which icc`
> >> > >>
> >> > >> setenv CXX `which icc`
> >> > >>
> >> > >> setenv F77 `which ifort`
> >> > >>
> >> > >> # Variables for compiling MET
> >> > >>
> >> > >> setenv MET_NETCDF /scratch4/BMC/dtc/MET/external_libs_intel
> >> > >>
> >> > >> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
> >> > >>
> >> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
> >> > >>
> >> > >> setenv MET_GRIB2C /scratch4/BMC/dtc/MET/external_libs_intel
> >> > >>
> >> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
> >> > >>
> >> > >> setenv MET_HDFEOS /scratch4/BMC/dtc/MET/external_libs_intel
> >> > >>
> >> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> >> > >> _libs_intel/include/cairo
> >> > >>
> >> > >> setenv MET_CAIROLIB
/scratch4/BMC/dtc/MET/external_libs_intel/lib
> >> > >>
> >> > >> setenv MET_FREETYPEINC
> >> > >> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> >> > >>
> >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> external_libs_intel/lib
> >> > >>
> >> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-modis
> >> > --enable-lidar2nc
> >> > >> # Compile
> >> > >> make install test
> >> > >>
> >> > >> Once you get it to compile... make any necessary code
changes and
> >> then
> >> > >> do...
> >> > >>
> >> > >> make clean install
> >> > >>
> >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA
Affiliate via
> RT
> >> <
> >> > >> met_help at ucar.edu> wrote:
> >> > >>
> >> > >> >
> >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >> > >> >
> >> > >> > I'm calling scripts from here on Theia.
> >> > >> >
> >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> >> > >> >
> >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via RT
<
> >> > >> > met_help at ucar.edu> wrote:
> >> > >> >
> >> > >> > > Andrew,
> >> > >> > >
> >> > >> > > Can you remind me, did you compile MET yourself or are
you
> >> running a
> >> > >> > > pre-compiled version?
> >> > >> > >
> >> > >> > > If so, where are you running it?
> >> > >> > >
> >> > >> > > Thanks,
> >> > >> > > John
> >> > >> > >
> >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA
Affiliate
> via
> >> > RT <
> >> > >> > > met_help at ucar.edu> wrote:
> >> > >> > >
> >> > >> > > >
> >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=82438
> >> >
> >> > >> > > >
> >> > >> > > > Thanks John. How would I recompile after making that
change?
> >> > >> > > >
> >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway
via RT <
> >> > >> > > > met_help at ucar.edu> wrote:
> >> > >> > > >
> >> > >> > > > > Andrew,
> >> > >> > > > >
> >> > >> > > > > I see that you're running MODE to generate a large
number
> of
> >> > >> objects.
> >> > >> > > > >
> >> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I see
that we
> >> have
> >> > >> > defined
> >> > >> > > > hard
> >> > >> > > > > upper limits:
> >> > >> > > > >    static const int max_fcst_numbers = 100;
> >> > >> > > > >    static const int max_obs_numbers  = 100;
> >> > >> > > > >
> >> > >> > > > > You could change those to arbitrarily large
values... maybe
> >> 500
> >> > >> and
> >> > >> > > then
> >> > >> > > > > recompile.
> >> > >> > > > >
> >> > >> > > > > However, I realize that that's less than ideal.
Instead,
> we
> >> > >> should
> >> > >> > > > > dynamically allocate as much memory as required
rather than
> >> > >> having a
> >> > >> > > > fixed
> >> > >> > > > > upper limit.  I'll add a development task to update
this
> for
> >> > MODE
> >> > >> in
> >> > >> > a
> >> > >> > > > > future release.
> >> > >> > > > >
> >> > >> > > > > Sorry I don't have a better answer for you.
> >> > >> > > > >
> >> > >> > > > > Thanks,
> >> > >> > > > > John Halley Gotway
> >> > >> > > > > met_help at ucar.edu
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren - NOAA
> Affiliate
> >> > via
> >> > >> RT
> >> > >> > <
> >> > >> > > > > met_help at ucar.edu> wrote:
> >> > >> > > > >
> >> > >> > > > > >
> >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was acted
upon.
> >> > >> > > > > > Transaction: Ticket created by
andrew.kren at noaa.gov
> >> > >> > > > > >        Queue: met_help
> >> > >> > > > > >      Subject: Error with MET
> >> > >> > > > > >        Owner: Nobody
> >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> >> > >> > > > > >       Status: new
> >> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > >> > > Ticket/Display.html?id=82438
> >> > >> > > > >
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > Hi John,
> >> > >> > > > > >
> >> > >> > > > > > I am running MET Mode tool on observation and
> precipitation
> >> > >> files.
> >> > >> > I
> >> > >> > > > > > noticed this one error for certain 24 hour
forecast
> >> > >> accumulation,
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 3: Applying convolution threshold >=10.0
resulted
> in
> >> 242
> >> > >> > simple
> >> > >> > > > > > observation objects.
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 3: Skipping observation object area
threshold.
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 3: Skipping observation object intensity
percentile
> >> > >> > threshold.
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 2: Computing contingency table statistics...
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
> >> observation
> >> > >> > objects.
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> field.
> >> > >> > > > > >
> >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
> >> field.
> >> > >> > > > > >
> >> > >> > > > > > ERROR  :
> >> > >> > > > > >
> >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many obs
> numbers!
> >> > >> > > > > >
> >> > >> > > > > > ERROR  :
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > Do you know what is causing this? Is there a way
to fix
> it?
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > Thanks,
> >> > >> > > > > >
> >> > >> > > > > > --
> >> > >> > > > > > Andrew Kren
> >> > >> > > > > > Research Scientist I, Global Observing Systems
Analysis
> >> (GOSA)
> >> > >> > Group
> >> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> >> > >> > > > > > (303) 497-5418
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > --
> >> > >> > > > Andrew Kren
> >> > >> > > > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> >> > Group
> >> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > >> > > > 325 Broadway, Boulder, CO 80305
> >> > >> > > > (303) 497-5418
> >> > >> > > >
> >> > >> > > >
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >> >
> >> > >> > --
> >> > >> > Andrew Kren
> >> > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> >> Group
> >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > >> > 325 Broadway, Boulder, CO 80305
> >> > >> > (303) 497-5418
> >> > >> >
> >> > >> >
> >> > >>
> >> > >>
> >> > >
> >> > >
> >> > > --
> >> > > Andrew Kren
> >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
> >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > 325 Broadway, Boulder, CO 80305
> >> > > (303) 497-5418
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Andrew Kren
> >> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> >> > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > 325 Broadway, Boulder, CO 80305
> >> > (303) 497-5418
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
>
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Tue Oct 24 17:26:40 2017

Thanks John,

I have this set in my .cshrc but it didn't work. Should it be
something
else:

if !($?LD_LIBRARY_PATH) then

    setenv LD_LIBRARY_PATH
/scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib

else

    setenv LD_LIBRARY_PATH
${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib

endif

I got it to work by setting it in my shell script and got this error:

DEBUG 1: Default Config File:
/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/share/met/config/MODEConfig_default

DEBUG 1: Match Config File: ./config/MODEConfig_APCP02

DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02

DEBUG 1: Forecast File:
/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
control/gfs_APCP_24_2013082500_F00_F24.nc

DEBUG 1: Observation File:
/scratch4/BMC/qosap/Andrew.Kren/era-
interim/precip/conus/6hourly/CONUS_APCP_24_2013082500_F00_F24.nc

DEBUG 3: Use the grid named "G163".

DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 1008 Ny:
722
Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha: 2537.557
Cone:
0.616 Bx: 501.3848 By: 1960.5885

ERROR  :

ERROR  : setup_fcst_obs_data() -> can't get data from file
"/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
control/gfs_APCP_24_2013082500_F00_F24.nc"

ERROR  :

HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:

  #000: H5T.c line 1723 in H5Tclose(): not a datatype

    major: Invalid arguments to routine

    minor: Inappropriate type

NetCDF: HDF error

file: ncFile.cpp  line:33

HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:

  #000: H5T.c line 1723 in H5Tclose(): not a datatype

    major: Invalid arguments to routine

    minor: Inappropriate type

NetCDF: HDF error

file: ncFile.cpp  line:33

I used the new pcp_combine tool to create the netcdf files so not sure
why
its giving me this error.

Thanks,

On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> I looked through your log installation log and don't see any errors.
>
> So here's the error message:
>
> /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode: error
while
> loading shared libraries: libnetcdf.so.6: cannot open shared object
file:
> No such file or directory
>
> This is fixed by updating your LD_LIBRARY_PATH:
>
> setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_PATH}
>
> That tells the tools where to find the external libraries needed at
> runtime.  I'd suggest putting that in your .cshrc.
>
> Hopefully that fixes it.
>
> John
>
> On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> > I got it to work with my scripts, but got this error when running:
> >
> > *** Running MODE  ***
> >
> > *** APCP02     ***
> >
> > Init Date: 2013082500
> >
> > Running 00 to 24 forecast accumulation
> >
> >
> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode: error
while
> > loading shared libraries: libnetcdf.so.6: cannot open shared
object file:
> > No such file or directory
> >
> > I assume its something with the LD_LIBRARY_PATH
> >
> > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
> > andrew.kren at noaa.gov> wrote:
> >
> > > Hi John,
> > >
> > > That seemed to work, my log file is here, let me know if errors:
> > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> > >
> > > My .cshrc file in my home directory set the LD_LIBRARY_PATH
previously,
> > > but I have it set with some IF statements, can you check if my
current
> > > setting will cause issues? Also, do I need those export commnds
in my
> > > .cshrc for running? I have added them.
> > >
> > > Thanks,
> > >
> > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Andrew,
> > >>
> > >> Hmmm, could still be an environment issue.  To try to rule that
out, I
> > put
> > >> this all into a single script.  Please go to a working
directory and
> > this
> > >> command:
> > >>
> > >> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > >> 023/install_met.sh
> > >> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > >> 023/met-6.0_bugfix.20170920.tar.gz
> > >> >& install.log &
> > >>
> > >> tail -f install.log # Type CNTRL-C to exit the tail
> > >>
> > >> If all goes well, that script will install met-6.0 in the
current
> > >> directory
> > >> and run the test scripts.  In order to get the tools running
from the
> > >> command line, you'll need to update your LD_LIBRARY_PATH like
this:
> > >>
> > >> export
> > >> LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
> > >> b:${LD_LIBRARY_PATH}
> > >>
> > >> Please let me know how that goes.  If you have problems, please
send
> me
> > >> (or
> > >> point me to) the "install.log" file.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA Affiliate
via RT
> <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
> > >> >
> > >> > John,
> > >> > I compiled and installed this morning, but got this error, is
it
> > normal:
> > >> >
> > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
> > >> jas_stream.o):
> > >> > In
> > >> > function `jas_stream_tmpfile':
> > >> >
> > >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> > >> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
> > >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> > >> > warning: the use of `tmpnam' is dangerous, better use
`mkstemp'
> > >> >
> > >> > /bin/ld:
> > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> libjasper.a(jas_cm.o):
> > >> > undefined reference to symbol '__svml_pow2'
> > >> >
> > >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> > intel64/libsvml.so:
> > >> > error adding symbols: DSO missing from command line
> > >> >
> > >> > collect2: error: ld returned 1 exit status
> > >> >
> > >> > make[4]: *** [ensemble_stat] Error 1
> > >> >
> > >> > make[4]: Leaving directory
> > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> > >> > tools/core/ensemble_stat'
> > >> >
> > >> > make[3]: *** [install-recursive] Error 1
> > >> >
> > >> > make[3]: Leaving directory
> > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools/core'
> > >> >
> > >> > make[2]: *** [install-recursive] Error 1
> > >> >
> > >> > make[2]: Leaving directory
> > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools'
> > >> >
> > >> > make[1]: *** [install-recursive] Error 1
> > >> >
> > >> > make[1]: Leaving directory
> > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
> > >> >
> > >> > make: *** [install-recursive] Error 1
> > >> >
> > >> >
> > >> > Thanks,
> > >> >
> > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate
<
> > >> > andrew.kren at noaa.gov> wrote:
> > >> >
> > >> > > I will try this tomorrow John and let you know how it goes.
> Thanks.
> > >> > >
> > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via RT
<
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > >> Andrew,
> > >> > >>
> > >> > >> OK, great.  You could consider switching to using the
current
> > >> version of
> > >> > >> met-6.0.
> > >> > >> I did try recompiling MET version 5.1 but had problems.
So I'll
> > list
> > >> > >> instructions for compiling the current 6.0 release of MET.
> > >> > >>
> > >> > >> To test this out, here are the commands I ran:
> > >> > >>
> > >> > >> cd /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> 20171023
> > >> > >>
> > >> > >> # Get latest bugfix version of code from here:
> > >> > >> wget
> > >> > >> https://dtcenter.org/met/users/downloads/MET_releases/met-
6.
> > >> > >> 0_bugfix.20170920.tar.gz
> > >> > >>
> > >> > >> # Untar
> > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> > >> > >> cd met-6.0_bugfix
> > >> > >>
> > >> > >> # Configure
> > >> > >>
> > >> > >> module load intel
> > >> > >>
> > >> > >> setenv CC `which icc`
> > >> > >>
> > >> > >> setenv CXX `which icc`
> > >> > >>
> > >> > >> setenv F77 `which ifort`
> > >> > >>
> > >> > >> # Variables for compiling MET
> > >> > >>
> > >> > >> setenv MET_NETCDF
/scratch4/BMC/dtc/MET/external_libs_intel
> > >> > >>
> > >> > >> setenv MET_BUFR /scratch4/BMC/dtc/MET/external_libs_intel
> > >> > >>
> > >> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
> > >> > >>
> > >> > >> setenv MET_GRIB2C
/scratch4/BMC/dtc/MET/external_libs_intel
> > >> > >>
> > >> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
> > >> > >>
> > >> > >> setenv MET_HDFEOS
/scratch4/BMC/dtc/MET/external_libs_intel
> > >> > >>
> > >> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> > >> > >> _libs_intel/include/cairo
> > >> > >>
> > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
> external_libs_intel/lib
> > >> > >>
> > >> > >> setenv MET_FREETYPEINC
> > >> > >>
/scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> > >> > >>
> > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> > external_libs_intel/lib
> > >> > >>
> > >> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-modis
> > >> > --enable-lidar2nc
> > >> > >> # Compile
> > >> > >> make install test
> > >> > >>
> > >> > >> Once you get it to compile... make any necessary code
changes and
> > >> then
> > >> > >> do...
> > >> > >>
> > >> > >> make clean install
> > >> > >>
> > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA
Affiliate via
> > RT
> > >> <
> > >> > >> met_help at ucar.edu> wrote:
> > >> > >>
> > >> > >> >
> > >> > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
> >
> > >> > >> >
> > >> > >> > I'm calling scripts from here on Theia.
> > >> > >> >
> > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> > >> > >> >
> > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway via
RT <
> > >> > >> > met_help at ucar.edu> wrote:
> > >> > >> >
> > >> > >> > > Andrew,
> > >> > >> > >
> > >> > >> > > Can you remind me, did you compile MET yourself or are
you
> > >> running a
> > >> > >> > > pre-compiled version?
> > >> > >> > >
> > >> > >> > > If so, where are you running it?
> > >> > >> > >
> > >> > >> > > Thanks,
> > >> > >> > > John
> > >> > >> > >
> > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA
Affiliate
> > via
> > >> > RT <
> > >> > >> > > met_help at ucar.edu> wrote:
> > >> > >> > >
> > >> > >> > > >
> > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=82438
> > >> >
> > >> > >> > > >
> > >> > >> > > > Thanks John. How would I recompile after making that
> change?
> > >> > >> > > >
> > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley Gotway
via RT
> <
> > >> > >> > > > met_help at ucar.edu> wrote:
> > >> > >> > > >
> > >> > >> > > > > Andrew,
> > >> > >> > > > >
> > >> > >> > > > > I see that you're running MODE to generate a large
number
> > of
> > >> > >> objects.
> > >> > >> > > > >
> > >> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I see
that we
> > >> have
> > >> > >> > defined
> > >> > >> > > > hard
> > >> > >> > > > > upper limits:
> > >> > >> > > > >    static const int max_fcst_numbers = 100;
> > >> > >> > > > >    static const int max_obs_numbers  = 100;
> > >> > >> > > > >
> > >> > >> > > > > You could change those to arbitrarily large
values...
> maybe
> > >> 500
> > >> > >> and
> > >> > >> > > then
> > >> > >> > > > > recompile.
> > >> > >> > > > >
> > >> > >> > > > > However, I realize that that's less than ideal.
Instead,
> > we
> > >> > >> should
> > >> > >> > > > > dynamically allocate as much memory as required
rather
> than
> > >> > >> having a
> > >> > >> > > > fixed
> > >> > >> > > > > upper limit.  I'll add a development task to
update this
> > for
> > >> > MODE
> > >> > >> in
> > >> > >> > a
> > >> > >> > > > > future release.
> > >> > >> > > > >
> > >> > >> > > > > Sorry I don't have a better answer for you.
> > >> > >> > > > >
> > >> > >> > > > > Thanks,
> > >> > >> > > > > John Halley Gotway
> > >> > >> > > > > met_help at ucar.edu
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren -
NOAA
> > Affiliate
> > >> > via
> > >> > >> RT
> > >> > >> > <
> > >> > >> > > > > met_help at ucar.edu> wrote:
> > >> > >> > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was
acted upon.
> > >> > >> > > > > > Transaction: Ticket created by
andrew.kren at noaa.gov
> > >> > >> > > > > >        Queue: met_help
> > >> > >> > > > > >      Subject: Error with MET
> > >> > >> > > > > >        Owner: Nobody
> > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> > >> > >> > > > > >       Status: new
> > >> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > >> > >> > > Ticket/Display.html?id=82438
> > >> > >> > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > Hi John,
> > >> > >> > > > > >
> > >> > >> > > > > > I am running MET Mode tool on observation and
> > precipitation
> > >> > >> files.
> > >> > >> > I
> > >> > >> > > > > > noticed this one error for certain 24 hour
forecast
> > >> > >> accumulation,
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 3: Applying convolution threshold >=10.0
resulted
> > in
> > >> 242
> > >> > >> > simple
> > >> > >> > > > > > observation objects.
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 3: Skipping observation object area
threshold.
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 3: Skipping observation object intensity
> percentile
> > >> > >> > threshold.
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 2: Identified: 67 forecast objects and 242
> > >> observation
> > >> > >> > objects.
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> > field.
> > >> > >> > > > > >
> > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
> > >> field.
> > >> > >> > > > > >
> > >> > >> > > > > > ERROR  :
> > >> > >> > > > > >
> > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many
obs
> > numbers!
> > >> > >> > > > > >
> > >> > >> > > > > > ERROR  :
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > Do you know what is causing this? Is there a way
to fix
> > it?
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > Thanks,
> > >> > >> > > > > >
> > >> > >> > > > > > --
> > >> > >> > > > > > Andrew Kren
> > >> > >> > > > > > Research Scientist I, Global Observing Systems
Analysis
> > >> (GOSA)
> > >> > >> > Group
> > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > >> > >> > > > > > (303) 497-5418
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > > > --
> > >> > >> > > > Andrew Kren
> > >> > >> > > > Research Scientist I, Global Observing Systems
Analysis
> > (GOSA)
> > >> > Group
> > >> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > >> > > > 325 Broadway, Boulder, CO 80305
> > >> > >> > > > (303) 497-5418
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >> >
> > >> > >> > --
> > >> > >> > Andrew Kren
> > >> > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > >> Group
> > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > >> > 325 Broadway, Boulder, CO 80305
> > >> > >> > (303) 497-5418
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >>
> > >> > >
> > >> > >
> > >> > > --
> > >> > > Andrew Kren
> > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > 325 Broadway, Boulder, CO 80305
> > >> > > (303) 497-5418
> > >> > >
> > >> >
> > >> >
> > >> >
> > >> > --
> > >> > Andrew Kren
> > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > 325 Broadway, Boulder, CO 80305
> > >> > (303) 497-5418
> > >> >
> > >> >
> > >>
> > >>
> > >
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> >
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Tue Oct 24 17:51:52 2017

Andrew,

Please try setting your LD_LIBRARY_PATH like this:
   setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_PATH}

That places the MET libraries at the *front* of the linker list.  It's
possible that the linker is finding a competing version of NetCDF
instead
of the one it actually needs.

These sorts of details are the reason why modules are very nice...
they
handle setting up the environment correctly.

Hopefully we'll get this issue with MODE resolved and you won't need
to go
through this process in future versions.

Also, can you please go the MET website and fill out the registration
form?  That helps us track the number of users who are actively using
the
MET software:
   https://dtcenter.org/met/users/downloads/index.php

Enter your email address and hit enter.

Thanks,
John

On Tue, Oct 24, 2017 at 7:26 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> Thanks John,
>
> I have this set in my .cshrc but it didn't work. Should it be
something
> else:
>
> if !($?LD_LIBRARY_PATH) then
>
>     setenv LD_LIBRARY_PATH
> /scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/
> svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/
> BMC/dtc/MET/external_libs_intel/lib
>
> else
>
>     setenv LD_LIBRARY_PATH
> ${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.
> Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/
> lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib
>
> endif
>
>
> I got it to work by setting it in my shell script and got this
error:
>
>
> DEBUG 1: Default Config File:
> /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/share/
> met/config/MODEConfig_default
>
> DEBUG 1: Match Config File: ./config/MODEConfig_APCP02
>
> DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02
>
> DEBUG 1: Forecast File:
> /scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> control/gfs_APCP_24_2013082500_F00_F24.nc
>
> DEBUG 1: Observation File:
> /scratch4/BMC/qosap/Andrew.Kren/era-interim/precip/conus/
> 6hourly/CONUS_APCP_24_2013082500_F00_F24.nc
>
> DEBUG 3: Use the grid named "G163".
>
> DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 1008 Ny:
722
> Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha: 2537.557
Cone:
> 0.616 Bx: 501.3848 By: 1960.5885
>
> ERROR  :
>
> ERROR  : setup_fcst_obs_data() -> can't get data from file
> "/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> control/gfs_APCP_24_2013082500_F00_F24.nc"
>
> ERROR  :
>
> HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
>
>   #000: H5T.c line 1723 in H5Tclose(): not a datatype
>
>     major: Invalid arguments to routine
>
>     minor: Inappropriate type
>
> NetCDF: HDF error
>
> file: ncFile.cpp  line:33
>
> HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
>
>   #000: H5T.c line 1723 in H5Tclose(): not a datatype
>
>     major: Invalid arguments to routine
>
>     minor: Inappropriate type
>
> NetCDF: HDF error
>
> file: ncFile.cpp  line:33
>
>
>
> I used the new pcp_combine tool to create the netcdf files so not
sure why
> its giving me this error.
>
>
> Thanks,
>
>
>
>
> On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andrew,
> >
> > I looked through your log installation log and don't see any
errors.
> >
> > So here's the error message:
> >
> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode: error
while
> > loading shared libraries: libnetcdf.so.6: cannot open shared
object file:
> > No such file or directory
> >
> > This is fixed by updating your LD_LIBRARY_PATH:
> >
> > setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_PATH}
> >
> > That tells the tools where to find the external libraries needed
at
> > runtime.  I'd suggest putting that in your .cshrc.
> >
> > Hopefully that fixes it.
> >
> > John
> >
> > On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > >
> > > I got it to work with my scripts, but got this error when
running:
> > >
> > > *** Running MODE  ***
> > >
> > > *** APCP02     ***
> > >
> > > Init Date: 2013082500
> > >
> > > Running 00 to 24 forecast accumulation
> > >
> > >
> > > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode:
error
> while
> > > loading shared libraries: libnetcdf.so.6: cannot open shared
object
> file:
> > > No such file or directory
> > >
> > > I assume its something with the LD_LIBRARY_PATH
> > >
> > > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate <
> > > andrew.kren at noaa.gov> wrote:
> > >
> > > > Hi John,
> > > >
> > > > That seemed to work, my log file is here, let me know if
errors:
> > > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> > > >
> > > > My .cshrc file in my home directory set the LD_LIBRARY_PATH
> previously,
> > > > but I have it set with some IF statements, can you check if my
> current
> > > > setting will cause issues? Also, do I need those export
commnds in my
> > > > .cshrc for running? I have added them.
> > > >
> > > > Thanks,
> > > >
> > > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Andrew,
> > > >>
> > > >> Hmmm, could still be an environment issue.  To try to rule
that
> out, I
> > > put
> > > >> this all into a single script.  Please go to a working
directory and
> > > this
> > > >> command:
> > > >>
> > > >> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > > >> 023/install_met.sh
> > > >> /scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > > >> 023/met-6.0_bugfix.20170920.tar.gz
> > > >> >& install.log &
> > > >>
> > > >> tail -f install.log # Type CNTRL-C to exit the tail
> > > >>
> > > >> If all goes well, that script will install met-6.0 in the
current
> > > >> directory
> > > >> and run the test scripts.  In order to get the tools running
from
> the
> > > >> command line, you'll need to update your LD_LIBRARY_PATH like
this:
> > > >>
> > > >> export
> > > >> LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
> > > >> b:${LD_LIBRARY_PATH}
> > > >>
> > > >> Please let me know how that goes.  If you have problems,
please send
> > me
> > > >> (or
> > > >> point me to) the "install.log" file.
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA
Affiliate via
> RT
> > <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > > >> >
> > > >> > John,
> > > >> > I compiled and installed this morning, but got this error,
is it
> > > normal:
> > > >> >
> > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
> > > >> jas_stream.o):
> > > >> > In
> > > >> > function `jas_stream_tmpfile':
> > > >> >
> > > >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> > > >> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
> > > >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> > > >> > warning: the use of `tmpnam' is dangerous, better use
`mkstemp'
> > > >> >
> > > >> > /bin/ld:
> > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> > libjasper.a(jas_cm.o):
> > > >> > undefined reference to symbol '__svml_pow2'
> > > >> >
> > > >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> > > intel64/libsvml.so:
> > > >> > error adding symbols: DSO missing from command line
> > > >> >
> > > >> > collect2: error: ld returned 1 exit status
> > > >> >
> > > >> > make[4]: *** [ensemble_stat] Error 1
> > > >> >
> > > >> > make[4]: Leaving directory
> > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> > > >> > tools/core/ensemble_stat'
> > > >> >
> > > >> > make[3]: *** [install-recursive] Error 1
> > > >> >
> > > >> > make[3]: Leaving directory
> > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> tools/core'
> > > >> >
> > > >> > make[2]: *** [install-recursive] Error 1
> > > >> >
> > > >> > make[2]: Leaving directory
> > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools'
> > > >> >
> > > >> > make[1]: *** [install-recursive] Error 1
> > > >> >
> > > >> > make[1]: Leaving directory
> > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
> > > >> >
> > > >> > make: *** [install-recursive] Error 1
> > > >> >
> > > >> >
> > > >> > Thanks,
> > > >> >
> > > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA
Affiliate <
> > > >> > andrew.kren at noaa.gov> wrote:
> > > >> >
> > > >> > > I will try this tomorrow John and let you know how it
goes.
> > Thanks.
> > > >> > >
> > > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via
RT <
> > > >> > > met_help at ucar.edu> wrote:
> > > >> > >
> > > >> > >> Andrew,
> > > >> > >>
> > > >> > >> OK, great.  You could consider switching to using the
current
> > > >> version of
> > > >> > >> met-6.0.
> > > >> > >> I did try recompiling MET version 5.1 but had problems.
So
> I'll
> > > list
> > > >> > >> instructions for compiling the current 6.0 release of
MET.
> > > >> > >>
> > > >> > >> To test this out, here are the commands I ran:
> > > >> > >>
> > > >> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> > 20171023
> > > >> > >>
> > > >> > >> # Get latest bugfix version of code from here:
> > > >> > >> wget
> > > >> > >>
https://dtcenter.org/met/users/downloads/MET_releases/met-6.
> > > >> > >> 0_bugfix.20170920.tar.gz
> > > >> > >>
> > > >> > >> # Untar
> > > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> > > >> > >> cd met-6.0_bugfix
> > > >> > >>
> > > >> > >> # Configure
> > > >> > >>
> > > >> > >> module load intel
> > > >> > >>
> > > >> > >> setenv CC `which icc`
> > > >> > >>
> > > >> > >> setenv CXX `which icc`
> > > >> > >>
> > > >> > >> setenv F77 `which ifort`
> > > >> > >>
> > > >> > >> # Variables for compiling MET
> > > >> > >>
> > > >> > >> setenv MET_NETCDF
/scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > >>
> > > >> > >> setenv MET_BUFR
/scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > >>
> > > >> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > >>
> > > >> > >> setenv MET_GRIB2C
/scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > >>
> > > >> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > >>
> > > >> > >> setenv MET_HDFEOS
/scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > >>
> > > >> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> > > >> > >> _libs_intel/include/cairo
> > > >> > >>
> > > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
> > external_libs_intel/lib
> > > >> > >>
> > > >> > >> setenv MET_FREETYPEINC
> > > >> > >>
/scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> > > >> > >>
> > > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> > > external_libs_intel/lib
> > > >> > >>
> > > >> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-modis
> > > >> > --enable-lidar2nc
> > > >> > >> # Compile
> > > >> > >> make install test
> > > >> > >>
> > > >> > >> Once you get it to compile... make any necessary code
changes
> and
> > > >> then
> > > >> > >> do...
> > > >> > >>
> > > >> > >> make clean install
> > > >> > >>
> > > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA
Affiliate
> via
> > > RT
> > > >> <
> > > >> > >> met_help at ucar.edu> wrote:
> > > >> > >>
> > > >> > >> >
> > > >> > >> > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=82438
> > >
> > > >> > >> >
> > > >> > >> > I'm calling scripts from here on Theia.
> > > >> > >> >
> > > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> > > >> > >> >
> > > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway
via RT <
> > > >> > >> > met_help at ucar.edu> wrote:
> > > >> > >> >
> > > >> > >> > > Andrew,
> > > >> > >> > >
> > > >> > >> > > Can you remind me, did you compile MET yourself or
are you
> > > >> running a
> > > >> > >> > > pre-compiled version?
> > > >> > >> > >
> > > >> > >> > > If so, where are you running it?
> > > >> > >> > >
> > > >> > >> > > Thanks,
> > > >> > >> > > John
> > > >> > >> > >
> > > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren - NOAA
> Affiliate
> > > via
> > > >> > RT <
> > > >> > >> > > met_help at ucar.edu> wrote:
> > > >> > >> > >
> > > >> > >> > > >
> > > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=82438
> > > >> >
> > > >> > >> > > >
> > > >> > >> > > > Thanks John. How would I recompile after making
that
> > change?
> > > >> > >> > > >
> > > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley
Gotway via
> RT
> > <
> > > >> > >> > > > met_help at ucar.edu> wrote:
> > > >> > >> > > >
> > > >> > >> > > > > Andrew,
> > > >> > >> > > > >
> > > >> > >> > > > > I see that you're running MODE to generate a
large
> number
> > > of
> > > >> > >> objects.
> > > >> > >> > > > >
> > > >> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I see
that
> we
> > > >> have
> > > >> > >> > defined
> > > >> > >> > > > hard
> > > >> > >> > > > > upper limits:
> > > >> > >> > > > >    static const int max_fcst_numbers = 100;
> > > >> > >> > > > >    static const int max_obs_numbers  = 100;
> > > >> > >> > > > >
> > > >> > >> > > > > You could change those to arbitrarily large
values...
> > maybe
> > > >> 500
> > > >> > >> and
> > > >> > >> > > then
> > > >> > >> > > > > recompile.
> > > >> > >> > > > >
> > > >> > >> > > > > However, I realize that that's less than ideal.
> Instead,
> > > we
> > > >> > >> should
> > > >> > >> > > > > dynamically allocate as much memory as required
rather
> > than
> > > >> > >> having a
> > > >> > >> > > > fixed
> > > >> > >> > > > > upper limit.  I'll add a development task to
update
> this
> > > for
> > > >> > MODE
> > > >> > >> in
> > > >> > >> > a
> > > >> > >> > > > > future release.
> > > >> > >> > > > >
> > > >> > >> > > > > Sorry I don't have a better answer for you.
> > > >> > >> > > > >
> > > >> > >> > > > > Thanks,
> > > >> > >> > > > > John Halley Gotway
> > > >> > >> > > > > met_help at ucar.edu
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren -
NOAA
> > > Affiliate
> > > >> > via
> > > >> > >> RT
> > > >> > >> > <
> > > >> > >> > > > > met_help at ucar.edu> wrote:
> > > >> > >> > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was
acted
> upon.
> > > >> > >> > > > > > Transaction: Ticket created by
andrew.kren at noaa.gov
> > > >> > >> > > > > >        Queue: met_help
> > > >> > >> > > > > >      Subject: Error with MET
> > > >> > >> > > > > >        Owner: Nobody
> > > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> > > >> > >> > > > > >       Status: new
> > > >> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > >> > >> > > Ticket/Display.html?id=82438
> > > >> > >> > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > Hi John,
> > > >> > >> > > > > >
> > > >> > >> > > > > > I am running MET Mode tool on observation and
> > > precipitation
> > > >> > >> files.
> > > >> > >> > I
> > > >> > >> > > > > > noticed this one error for certain 24 hour
forecast
> > > >> > >> accumulation,
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 3: Applying convolution threshold >=10.0
> resulted
> > > in
> > > >> 242
> > > >> > >> > simple
> > > >> > >> > > > > > observation objects.
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 3: Skipping observation object area
threshold.
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 3: Skipping observation object intensity
> > percentile
> > > >> > >> > threshold.
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 2: Identified: 67 forecast objects and
242
> > > >> observation
> > > >> > >> > objects.
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> > > field.
> > > >> > >> > > > > >
> > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> observation
> > > >> field.
> > > >> > >> > > > > >
> > > >> > >> > > > > > ERROR  :
> > > >> > >> > > > > >
> > > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too many
obs
> > > numbers!
> > > >> > >> > > > > >
> > > >> > >> > > > > > ERROR  :
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > Do you know what is causing this? Is there a
way to
> fix
> > > it?
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > Thanks,
> > > >> > >> > > > > >
> > > >> > >> > > > > > --
> > > >> > >> > > > > > Andrew Kren
> > > >> > >> > > > > > Research Scientist I, Global Observing Systems
> Analysis
> > > >> (GOSA)
> > > >> > >> > Group
> > > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > > >> > >> > > > > > (303) 497-5418
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > > >
> > > >> > >> > > > --
> > > >> > >> > > > Andrew Kren
> > > >> > >> > > > Research Scientist I, Global Observing Systems
Analysis
> > > (GOSA)
> > > >> > Group
> > > >> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > >> > > > 325 Broadway, Boulder, CO 80305
> > > >> > >> > > > (303) 497-5418
> > > >> > >> > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >> >
> > > >> > >> > --
> > > >> > >> > Andrew Kren
> > > >> > >> > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> > > >> Group
> > > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > >> > 325 Broadway, Boulder, CO 80305
> > > >> > >> > (303) 497-5418
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> > >>
> > > >> > >
> > > >> > >
> > > >> > > --
> > > >> > > Andrew Kren
> > > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > 325 Broadway, Boulder, CO 80305
> > > >> > > (303) 497-5418
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > Andrew Kren
> > > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > 325 Broadway, Boulder, CO 80305
> > > >> > (303) 497-5418
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Andrew Kren
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > >
> > >
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Wed Oct 25 08:58:29 2017

Thanks John,

I will fill out the form too. Also, any reason you can think of as to
why I
am getting the other error with MODE? Thanks.

On Tue, Oct 24, 2017 at 5:51 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andrew,
>
> Please try setting your LD_LIBRARY_PATH like this:
>    setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_PATH}
>
> That places the MET libraries at the *front* of the linker list.
It's
> possible that the linker is finding a competing version of NetCDF
instead
> of the one it actually needs.
>
> These sorts of details are the reason why modules are very nice...
they
> handle setting up the environment correctly.
>
> Hopefully we'll get this issue with MODE resolved and you won't need
to go
> through this process in future versions.
>
> Also, can you please go the MET website and fill out the
registration
> form?  That helps us track the number of users who are actively
using the
> MET software:
>    https://dtcenter.org/met/users/downloads/index.php
>
> Enter your email address and hit enter.
>
> Thanks,
> John
>
> On Tue, Oct 24, 2017 at 7:26 PM, Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> > Thanks John,
> >
> > I have this set in my .cshrc but it didn't work. Should it be
something
> > else:
> >
> > if !($?LD_LIBRARY_PATH) then
> >
> >     setenv LD_LIBRARY_PATH
> > /scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/
> > svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/
> > BMC/dtc/MET/external_libs_intel/lib
> >
> > else
> >
> >     setenv LD_LIBRARY_PATH
> > ${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.
> > Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/
> > lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib
> >
> > endif
> >
> >
> > I got it to work by setting it in my shell script and got this
error:
> >
> >
> > DEBUG 1: Default Config File:
> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/share/
> > met/config/MODEConfig_default
> >
> > DEBUG 1: Match Config File: ./config/MODEConfig_APCP02
> >
> > DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02
> >
> > DEBUG 1: Forecast File:
> > /scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> > control/gfs_APCP_24_2013082500_F00_F24.nc
> >
> > DEBUG 1: Observation File:
> > /scratch4/BMC/qosap/Andrew.Kren/era-interim/precip/conus/
> > 6hourly/CONUS_APCP_24_2013082500_F00_F24.nc
> >
> > DEBUG 3: Use the grid named "G163".
> >
> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 1008
Ny: 722
> > Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha: 2537.557
Cone:
> > 0.616 Bx: 501.3848 By: 1960.5885
> >
> > ERROR  :
> >
> > ERROR  : setup_fcst_obs_data() -> can't get data from file
> > "/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> > control/gfs_APCP_24_2013082500_F00_F24.nc"
> >
> > ERROR  :
> >
> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> >
> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> >
> >     major: Invalid arguments to routine
> >
> >     minor: Inappropriate type
> >
> > NetCDF: HDF error
> >
> > file: ncFile.cpp  line:33
> >
> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> >
> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> >
> >     major: Invalid arguments to routine
> >
> >     minor: Inappropriate type
> >
> > NetCDF: HDF error
> >
> > file: ncFile.cpp  line:33
> >
> >
> >
> > I used the new pcp_combine tool to create the netcdf files so not
sure
> why
> > its giving me this error.
> >
> >
> > Thanks,
> >
> >
> >
> >
> > On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Andrew,
> > >
> > > I looked through your log installation log and don't see any
errors.
> > >
> > > So here's the error message:
> > >
> > > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode:
error
> while
> > > loading shared libraries: libnetcdf.so.6: cannot open shared
object
> file:
> > > No such file or directory
> > >
> > > This is fixed by updating your LD_LIBRARY_PATH:
> > >
> > > setenv /scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_
> LIBRARY_PATH}
> > >
> > > That tells the tools where to find the external libraries needed
at
> > > runtime.  I'd suggest putting that in your .cshrc.
> > >
> > > Hopefully that fixes it.
> > >
> > > John
> > >
> > > On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
> > > >
> > > > I got it to work with my scripts, but got this error when
running:
> > > >
> > > > *** Running MODE  ***
> > > >
> > > > *** APCP02     ***
> > > >
> > > > Init Date: 2013082500
> > > >
> > > > Running 00 to 24 forecast accumulation
> > > >
> > > >
> > > > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode:
error
> > while
> > > > loading shared libraries: libnetcdf.so.6: cannot open shared
object
> > file:
> > > > No such file or directory
> > > >
> > > > I assume its something with the LD_LIBRARY_PATH
> > > >
> > > > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate
<
> > > > andrew.kren at noaa.gov> wrote:
> > > >
> > > > > Hi John,
> > > > >
> > > > > That seemed to work, my log file is here, let me know if
errors:
> > > > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> > > > >
> > > > > My .cshrc file in my home directory set the LD_LIBRARY_PATH
> > previously,
> > > > > but I have it set with some IF statements, can you check if
my
> > current
> > > > > setting will cause issues? Also, do I need those export
commnds in
> my
> > > > > .cshrc for running? I have added them.
> > > > >
> > > > > Thanks,
> > > > >
> > > > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Andrew,
> > > > >>
> > > > >> Hmmm, could still be an environment issue.  To try to rule
that
> > out, I
> > > > put
> > > > >> this all into a single script.  Please go to a working
directory
> and
> > > > this
> > > > >> command:
> > > > >>
> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > > > >> 023/install_met.sh
> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > > > >> 023/met-6.0_bugfix.20170920.tar.gz
> > > > >> >& install.log &
> > > > >>
> > > > >> tail -f install.log # Type CNTRL-C to exit the tail
> > > > >>
> > > > >> If all goes well, that script will install met-6.0 in the
current
> > > > >> directory
> > > > >> and run the test scripts.  In order to get the tools
running from
> > the
> > > > >> command line, you'll need to update your LD_LIBRARY_PATH
like
> this:
> > > > >>
> > > > >> export
> > > > >>
LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
> > > > >> b:${LD_LIBRARY_PATH}
> > > > >>
> > > > >> Please let me know how that goes.  If you have problems,
please
> send
> > > me
> > > > >> (or
> > > > >> point me to) the "install.log" file.
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA
Affiliate via
> > RT
> > > <
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > > > >> >
> > > > >> > John,
> > > > >> > I compiled and installed this morning, but got this
error, is it
> > > > normal:
> > > > >> >
> > > > >> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
> > > > >> jas_stream.o):
> > > > >> > In
> > > > >> > function `jas_stream_tmpfile':
> > > > >> >
> > > > >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> > > > >> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
> > > > >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> > > > >> > warning: the use of `tmpnam' is dangerous, better use
`mkstemp'
> > > > >> >
> > > > >> > /bin/ld:
> > > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> > > libjasper.a(jas_cm.o):
> > > > >> > undefined reference to symbol '__svml_pow2'
> > > > >> >
> > > > >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> > > > intel64/libsvml.so:
> > > > >> > error adding symbols: DSO missing from command line
> > > > >> >
> > > > >> > collect2: error: ld returned 1 exit status
> > > > >> >
> > > > >> > make[4]: *** [ensemble_stat] Error 1
> > > > >> >
> > > > >> > make[4]: Leaving directory
> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> > > > >> > tools/core/ensemble_stat'
> > > > >> >
> > > > >> > make[3]: *** [install-recursive] Error 1
> > > > >> >
> > > > >> > make[3]: Leaving directory
> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
> > tools/core'
> > > > >> >
> > > > >> > make[2]: *** [install-recursive] Error 1
> > > > >> >
> > > > >> > make[2]: Leaving directory
> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools'
> > > > >> >
> > > > >> > make[1]: *** [install-recursive] Error 1
> > > > >> >
> > > > >> > make[1]: Leaving directory
> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
> > > > >> >
> > > > >> > make: *** [install-recursive] Error 1
> > > > >> >
> > > > >> >
> > > > >> > Thanks,
> > > > >> >
> > > > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA
Affiliate <
> > > > >> > andrew.kren at noaa.gov> wrote:
> > > > >> >
> > > > >> > > I will try this tomorrow John and let you know how it
goes.
> > > Thanks.
> > > > >> > >
> > > > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway via
RT <
> > > > >> > > met_help at ucar.edu> wrote:
> > > > >> > >
> > > > >> > >> Andrew,
> > > > >> > >>
> > > > >> > >> OK, great.  You could consider switching to using the
current
> > > > >> version of
> > > > >> > >> met-6.0.
> > > > >> > >> I did try recompiling MET version 5.1 but had
problems.  So
> > I'll
> > > > list
> > > > >> > >> instructions for compiling the current 6.0 release of
MET.
> > > > >> > >>
> > > > >> > >> To test this out, here are the commands I ran:
> > > > >> > >>
> > > > >> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> > > 20171023
> > > > >> > >>
> > > > >> > >> # Get latest bugfix version of code from here:
> > > > >> > >> wget
> > > > >> > >>
https://dtcenter.org/met/users/downloads/MET_releases/met-6.
> > > > >> > >> 0_bugfix.20170920.tar.gz
> > > > >> > >>
> > > > >> > >> # Untar
> > > > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> > > > >> > >> cd met-6.0_bugfix
> > > > >> > >>
> > > > >> > >> # Configure
> > > > >> > >>
> > > > >> > >> module load intel
> > > > >> > >>
> > > > >> > >> setenv CC `which icc`
> > > > >> > >>
> > > > >> > >> setenv CXX `which icc`
> > > > >> > >>
> > > > >> > >> setenv F77 `which ifort`
> > > > >> > >>
> > > > >> > >> # Variables for compiling MET
> > > > >> > >>
> > > > >> > >> setenv MET_NETCDF
/scratch4/BMC/dtc/MET/external_libs_intel
> > > > >> > >>
> > > > >> > >> setenv MET_BUFR
/scratch4/BMC/dtc/MET/external_libs_intel
> > > > >> > >>
> > > > >> > >> setenv MET_GSL
/scratch4/BMC/dtc/MET/external_libs_intel
> > > > >> > >>
> > > > >> > >> setenv MET_GRIB2C
/scratch4/BMC/dtc/MET/external_libs_intel
> > > > >> > >>
> > > > >> > >> setenv MET_HDF
/scratch4/BMC/dtc/MET/external_libs_intel
> > > > >> > >>
> > > > >> > >> setenv MET_HDFEOS
/scratch4/BMC/dtc/MET/external_libs_intel
> > > > >> > >>
> > > > >> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> > > > >> > >> _libs_intel/include/cairo
> > > > >> > >>
> > > > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
> > > external_libs_intel/lib
> > > > >> > >>
> > > > >> > >> setenv MET_FREETYPEINC
> > > > >> > >>
/scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> > > > >> > >>
> > > > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> > > > external_libs_intel/lib
> > > > >> > >>
> > > > >> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-
modis
> > > > >> > --enable-lidar2nc
> > > > >> > >> # Compile
> > > > >> > >> make install test
> > > > >> > >>
> > > > >> > >> Once you get it to compile... make any necessary code
changes
> > and
> > > > >> then
> > > > >> > >> do...
> > > > >> > >>
> > > > >> > >> make clean install
> > > > >> > >>
> > > > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA
Affiliate
> > via
> > > > RT
> > > > >> <
> > > > >> > >> met_help at ucar.edu> wrote:
> > > > >> > >>
> > > > >> > >> >
> > > > >> > >> > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=82438
> > > >
> > > > >> > >> >
> > > > >> > >> > I'm calling scripts from here on Theia.
> > > > >> > >> >
> > > > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> > > > >> > >> >
> > > > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway
via RT
> <
> > > > >> > >> > met_help at ucar.edu> wrote:
> > > > >> > >> >
> > > > >> > >> > > Andrew,
> > > > >> > >> > >
> > > > >> > >> > > Can you remind me, did you compile MET yourself or
are
> you
> > > > >> running a
> > > > >> > >> > > pre-compiled version?
> > > > >> > >> > >
> > > > >> > >> > > If so, where are you running it?
> > > > >> > >> > >
> > > > >> > >> > > Thanks,
> > > > >> > >> > > John
> > > > >> > >> > >
> > > > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren -
NOAA
> > Affiliate
> > > > via
> > > > >> > RT <
> > > > >> > >> > > met_help at ucar.edu> wrote:
> > > > >> > >> > >
> > > > >> > >> > > >
> > > > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > > > Ticket/Display.html?id=82438
> > > > >> >
> > > > >> > >> > > >
> > > > >> > >> > > > Thanks John. How would I recompile after making
that
> > > change?
> > > > >> > >> > > >
> > > > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley
Gotway via
> > RT
> > > <
> > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > > >> > >> > > >
> > > > >> > >> > > > > Andrew,
> > > > >> > >> > > > >
> > > > >> > >> > > > > I see that you're running MODE to generate a
large
> > number
> > > > of
> > > > >> > >> objects.
> > > > >> > >> > > > >
> > > > >> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I
see
> that
> > we
> > > > >> have
> > > > >> > >> > defined
> > > > >> > >> > > > hard
> > > > >> > >> > > > > upper limits:
> > > > >> > >> > > > >    static const int max_fcst_numbers = 100;
> > > > >> > >> > > > >    static const int max_obs_numbers  = 100;
> > > > >> > >> > > > >
> > > > >> > >> > > > > You could change those to arbitrarily large
values...
> > > maybe
> > > > >> 500
> > > > >> > >> and
> > > > >> > >> > > then
> > > > >> > >> > > > > recompile.
> > > > >> > >> > > > >
> > > > >> > >> > > > > However, I realize that that's less than
ideal.
> > Instead,
> > > > we
> > > > >> > >> should
> > > > >> > >> > > > > dynamically allocate as much memory as
required
> rather
> > > than
> > > > >> > >> having a
> > > > >> > >> > > > fixed
> > > > >> > >> > > > > upper limit.  I'll add a development task to
update
> > this
> > > > for
> > > > >> > MODE
> > > > >> > >> in
> > > > >> > >> > a
> > > > >> > >> > > > > future release.
> > > > >> > >> > > > >
> > > > >> > >> > > > > Sorry I don't have a better answer for you.
> > > > >> > >> > > > >
> > > > >> > >> > > > > Thanks,
> > > > >> > >> > > > > John Halley Gotway
> > > > >> > >> > > > > met_help at ucar.edu
> > > > >> > >> > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren -
NOAA
> > > > Affiliate
> > > > >> > via
> > > > >> > >> RT
> > > > >> > >> > <
> > > > >> > >> > > > > met_help at ucar.edu> wrote:
> > > > >> > >> > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was
acted
> > upon.
> > > > >> > >> > > > > > Transaction: Ticket created by
> andrew.kren at noaa.gov
> > > > >> > >> > > > > >        Queue: met_help
> > > > >> > >> > > > > >      Subject: Error with MET
> > > > >> > >> > > > > >        Owner: Nobody
> > > > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> > > > >> > >> > > > > >       Status: new
> > > > >> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > > >> > >> > > Ticket/Display.html?id=82438
> > > > >> > >> > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > Hi John,
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > I am running MET Mode tool on observation
and
> > > > precipitation
> > > > >> > >> files.
> > > > >> > >> > I
> > > > >> > >> > > > > > noticed this one error for certain 24 hour
forecast
> > > > >> > >> accumulation,
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 3: Applying convolution threshold
>=10.0
> > resulted
> > > > in
> > > > >> 242
> > > > >> > >> > simple
> > > > >> > >> > > > > > observation objects.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 3: Skipping observation object area
> threshold.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
intensity
> > > percentile
> > > > >> > >> > threshold.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 2: Identified: 67 forecast objects and
242
> > > > >> observation
> > > > >> > >> > objects.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> forecast
> > > > field.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> > observation
> > > > >> field.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > ERROR  :
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too
many obs
> > > > numbers!
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > ERROR  :
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > Do you know what is causing this? Is there a
way to
> > fix
> > > > it?
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > Thanks,
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > --
> > > > >> > >> > > > > > Andrew Kren
> > > > >> > >> > > > > > Research Scientist I, Global Observing
Systems
> > Analysis
> > > > >> (GOSA)
> > > > >> > >> > Group
> > > > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > > > >> > >> > > > > > (303) 497-5418
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > >
> > > > >> > >> > > >
> > > > >> > >> > > > --
> > > > >> > >> > > > Andrew Kren
> > > > >> > >> > > > Research Scientist I, Global Observing Systems
Analysis
> > > > (GOSA)
> > > > >> > Group
> > > > >> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > >> > >> > > > 325 Broadway, Boulder, CO 80305
> > > > >> > >> > > > (303) 497-5418
> > > > >> > >> > > >
> > > > >> > >> > > >
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >> > --
> > > > >> > >> > Andrew Kren
> > > > >> > >> > Research Scientist I, Global Observing Systems
Analysis
> > (GOSA)
> > > > >> Group
> > > > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > >> > >> > 325 Broadway, Boulder, CO 80305
> > > > >> > >> > (303) 497-5418
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> > >>
> > > > >> > >
> > > > >> > >
> > > > >> > > --
> > > > >> > > Andrew Kren
> > > > >> > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > > Group
> > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > >> > > 325 Broadway, Boulder, CO 80305
> > > > >> > > (303) 497-5418
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> > Andrew Kren
> > > > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > >> > 325 Broadway, Boulder, CO 80305
> > > > >> > (303) 497-5418
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > > --
> > > > > Andrew Kren
> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > > 325 Broadway, Boulder, CO 80305
> > > > > (303) 497-5418
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Andrew Kren
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Wed Oct 25 10:51:26 2017

Everything is working fine now John, thanks so much for your help. I
did
have a question about the merge_flag setting in the config file. Right
now
I  have it set to NONE, but is it recommended to have it set to both?

Thanks,

On Wed, Oct 25, 2017 at 8:58 AM, Andrew Kren - NOAA Affiliate <
andrew.kren at noaa.gov> wrote:

> Thanks John,
>
> I will fill out the form too. Also, any reason you can think of as
to why
> I am getting the other error with MODE? Thanks.
>
> On Tue, Oct 24, 2017 at 5:51 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Andrew,
>>
>> Please try setting your LD_LIBRARY_PATH like this:
>>    setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_
>> PATH}
>>
>> That places the MET libraries at the *front* of the linker list.
It's
>> possible that the linker is finding a competing version of NetCDF
instead
>> of the one it actually needs.
>>
>> These sorts of details are the reason why modules are very nice...
they
>> handle setting up the environment correctly.
>>
>> Hopefully we'll get this issue with MODE resolved and you won't
need to go
>> through this process in future versions.
>>
>> Also, can you please go the MET website and fill out the
registration
>> form?  That helps us track the number of users who are actively
using the
>> MET software:
>>    https://dtcenter.org/met/users/downloads/index.php
>>
>> Enter your email address and hit enter.
>>
>> Thanks,
>> John
>>
>> On Tue, Oct 24, 2017 at 7:26 PM, Andrew Kren - NOAA Affiliate via
RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>> >
>> > Thanks John,
>> >
>> > I have this set in my .cshrc but it didn't work. Should it be
something
>> > else:
>> >
>> > if !($?LD_LIBRARY_PATH) then
>> >
>> >     setenv LD_LIBRARY_PATH
>> > /scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/
>> > svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/
>> > BMC/dtc/MET/external_libs_intel/lib
>> >
>> > else
>> >
>> >     setenv LD_LIBRARY_PATH
>> > ${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.
>> > Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/
>> > lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib
>> >
>> > endif
>> >
>> >
>> > I got it to work by setting it in my shell script and got this
error:
>> >
>> >
>> > DEBUG 1: Default Config File:
>> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/share/
>> > met/config/MODEConfig_default
>> >
>> > DEBUG 1: Match Config File: ./config/MODEConfig_APCP02
>> >
>> > DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02
>> >
>> > DEBUG 1: Forecast File:
>> > /scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
>> > control/gfs_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc
>> >
>> > DEBUG 1: Observation File:
>> > /scratch4/BMC/qosap/Andrew.Kren/era-interim/precip/conus/
>> > 6hourly/CONUS_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc
>> >
>> > DEBUG 3: Use the grid named "G163".
>> >
>> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 1008
Ny: 722
>> > Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha: 2537.557
Cone:
>> > 0.616 Bx: 501.3848 By: 1960.5885
>> >
>> > ERROR  :
>> >
>> > ERROR  : setup_fcst_obs_data() -> can't get data from file
>> > "/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
>> > control/gfs_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc"
>> >
>> > ERROR  :
>> >
>> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
>> >
>> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
>> >
>> >     major: Invalid arguments to routine
>> >
>> >     minor: Inappropriate type
>> >
>> > NetCDF: HDF error
>> >
>> > file: ncFile.cpp  line:33
>> >
>> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
>> >
>> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
>> >
>> >     major: Invalid arguments to routine
>> >
>> >     minor: Inappropriate type
>> >
>> > NetCDF: HDF error
>> >
>> > file: ncFile.cpp  line:33
>> >
>> >
>> >
>> > I used the new pcp_combine tool to create the netcdf files so not
sure
>> why
>> > its giving me this error.
>> >
>> >
>> > Thanks,
>> >
>> >
>> >
>> >
>> > On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > > Andrew,
>> > >
>> > > I looked through your log installation log and don't see any
errors.
>> > >
>> > > So here's the error message:
>> > >
>> > > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode:
error
>> while
>> > > loading shared libraries: libnetcdf.so.6: cannot open shared
object
>> file:
>> > > No such file or directory
>> > >
>> > > This is fixed by updating your LD_LIBRARY_PATH:
>> > >
>> > > setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_
>> PATH}
>> > >
>> > > That tells the tools where to find the external libraries
needed at
>> > > runtime.  I'd suggest putting that in your .cshrc.
>> > >
>> > > Hopefully that fixes it.
>> > >
>> > > John
>> > >
>> > > On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA Affiliate
via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
>> > > >
>> > > > I got it to work with my scripts, but got this error when
running:
>> > > >
>> > > > *** Running MODE  ***
>> > > >
>> > > > *** APCP02     ***
>> > > >
>> > > > Init Date: 2013082500
>> > > >
>> > > > Running 00 to 24 forecast accumulation
>> > > >
>> > > >
>> > > > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode:
error
>> > while
>> > > > loading shared libraries: libnetcdf.so.6: cannot open shared
object
>> > file:
>> > > > No such file or directory
>> > > >
>> > > > I assume its something with the LD_LIBRARY_PATH
>> > > >
>> > > > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA Affiliate
<
>> > > > andrew.kren at noaa.gov> wrote:
>> > > >
>> > > > > Hi John,
>> > > > >
>> > > > > That seemed to work, my log file is here, let me know if
errors:
>> > > > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
>> > > > >
>> > > > > My .cshrc file in my home directory set the LD_LIBRARY_PATH
>> > previously,
>> > > > > but I have it set with some IF statements, can you check if
my
>> > current
>> > > > > setting will cause issues? Also, do I need those export
commnds
>> in my
>> > > > > .cshrc for running? I have added them.
>> > > > >
>> > > > > Thanks,
>> > > > >
>> > > > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via RT
<
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > >> Andrew,
>> > > > >>
>> > > > >> Hmmm, could still be an environment issue.  To try to rule
that
>> > out, I
>> > > > put
>> > > > >> this all into a single script.  Please go to a working
directory
>> and
>> > > > this
>> > > > >> command:
>> > > > >>
>> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
>> > > > >> 023/install_met.sh
>> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
>> > > > >> 023/met-6.0_bugfix.20170920.tar.gz
>> > > > >> >& install.log &
>> > > > >>
>> > > > >> tail -f install.log # Type CNTRL-C to exit the tail
>> > > > >>
>> > > > >> If all goes well, that script will install met-6.0 in the
current
>> > > > >> directory
>> > > > >> and run the test scripts.  In order to get the tools
running from
>> > the
>> > > > >> command line, you'll need to update your LD_LIBRARY_PATH
like
>> this:
>> > > > >>
>> > > > >> export
>> > > > >>
LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
>> > > > >> b:${LD_LIBRARY_PATH}
>> > > > >>
>> > > > >> Please let me know how that goes.  If you have problems,
please
>> send
>> > > me
>> > > > >> (or
>> > > > >> point me to) the "install.log" file.
>> > > > >>
>> > > > >> Thanks,
>> > > > >> John
>> > > > >>
>> > > > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA
Affiliate
>> via
>> > RT
>> > > <
>> > > > >> met_help at ucar.edu> wrote:
>> > > > >>
>> > > > >> >
>> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>> >
>> > > > >> >
>> > > > >> > John,
>> > > > >> > I compiled and installed this morning, but got this
error, is
>> it
>> > > > normal:
>> > > > >> >
>> > > > >> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
>> > > > >> jas_stream.o):
>> > > > >> > In
>> > > > >> > function `jas_stream_tmpfile':
>> > > > >> >
>> > > > >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
>> > > > >> > testing/METv4.1/MET_releases/intel/external_libs/jasper/
>> > > > >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
>> > > > >> > warning: the use of `tmpnam' is dangerous, better use
`mkstemp'
>> > > > >> >
>> > > > >> > /bin/ld:
>> > > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
>> > > libjasper.a(jas_cm.o):
>> > > > >> > undefined reference to symbol '__svml_pow2'
>> > > > >> >
>> > > > >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
>> > > > intel64/libsvml.so:
>> > > > >> > error adding symbols: DSO missing from command line
>> > > > >> >
>> > > > >> > collect2: error: ld returned 1 exit status
>> > > > >> >
>> > > > >> > make[4]: *** [ensemble_stat] Error 1
>> > > > >> >
>> > > > >> > make[4]: Leaving directory
>> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
>> > > > >> > tools/core/ensemble_stat'
>> > > > >> >
>> > > > >> > make[3]: *** [install-recursive] Error 1
>> > > > >> >
>> > > > >> > make[3]: Leaving directory
>> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/
>> > tools/core'
>> > > > >> >
>> > > > >> > make[2]: *** [install-recursive] Error 1
>> > > > >> >
>> > > > >> > make[2]: Leaving directory
>> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/tools'
>> > > > >> >
>> > > > >> > make[1]: *** [install-recursive] Error 1
>> > > > >> >
>> > > > >> > make[1]: Leaving directory
>> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src'
>> > > > >> >
>> > > > >> > make: *** [install-recursive] Error 1
>> > > > >> >
>> > > > >> >
>> > > > >> > Thanks,
>> > > > >> >
>> > > > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA
Affiliate <
>> > > > >> > andrew.kren at noaa.gov> wrote:
>> > > > >> >
>> > > > >> > > I will try this tomorrow John and let you know how it
goes.
>> > > Thanks.
>> > > > >> > >
>> > > > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway
via RT <
>> > > > >> > > met_help at ucar.edu> wrote:
>> > > > >> > >
>> > > > >> > >> Andrew,
>> > > > >> > >>
>> > > > >> > >> OK, great.  You could consider switching to using the
>> current
>> > > > >> version of
>> > > > >> > >> met-6.0.
>> > > > >> > >> I did try recompiling MET version 5.1 but had
problems.  So
>> > I'll
>> > > > list
>> > > > >> > >> instructions for compiling the current 6.0 release of
MET.
>> > > > >> > >>
>> > > > >> > >> To test this out, here are the commands I ran:
>> > > > >> > >>
>> > > > >> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
>> > > 20171023
>> > > > >> > >>
>> > > > >> > >> # Get latest bugfix version of code from here:
>> > > > >> > >> wget
>> > > > >> > >>
https://dtcenter.org/met/users/downloads/MET_releases/met-6
>> .
>> > > > >> > >> 0_bugfix.20170920.tar.gz
>> > > > >> > >>
>> > > > >> > >> # Untar
>> > > > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
>> > > > >> > >> cd met-6.0_bugfix
>> > > > >> > >>
>> > > > >> > >> # Configure
>> > > > >> > >>
>> > > > >> > >> module load intel
>> > > > >> > >>
>> > > > >> > >> setenv CC `which icc`
>> > > > >> > >>
>> > > > >> > >> setenv CXX `which icc`
>> > > > >> > >>
>> > > > >> > >> setenv F77 `which ifort`
>> > > > >> > >>
>> > > > >> > >> # Variables for compiling MET
>> > > > >> > >>
>> > > > >> > >> setenv MET_NETCDF
/scratch4/BMC/dtc/MET/external_libs_intel
>> > > > >> > >>
>> > > > >> > >> setenv MET_BUFR
/scratch4/BMC/dtc/MET/external_libs_intel
>> > > > >> > >>
>> > > > >> > >> setenv MET_GSL
/scratch4/BMC/dtc/MET/external_libs_intel
>> > > > >> > >>
>> > > > >> > >> setenv MET_GRIB2C
/scratch4/BMC/dtc/MET/external_libs_intel
>> > > > >> > >>
>> > > > >> > >> setenv MET_HDF
/scratch4/BMC/dtc/MET/external_libs_intel
>> > > > >> > >>
>> > > > >> > >> setenv MET_HDFEOS
/scratch4/BMC/dtc/MET/external_libs_intel
>> > > > >> > >>
>> > > > >> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
>> > > > >> > >> _libs_intel/include/cairo
>> > > > >> > >>
>> > > > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
>> > > external_libs_intel/lib
>> > > > >> > >>
>> > > > >> > >> setenv MET_FREETYPEINC
>> > > > >> > >>
/scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
>> > > > >> > >>
>> > > > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
>> > > > external_libs_intel/lib
>> > > > >> > >>
>> > > > >> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-
modis
>> > > > >> > --enable-lidar2nc
>> > > > >> > >> # Compile
>> > > > >> > >> make install test
>> > > > >> > >>
>> > > > >> > >> Once you get it to compile... make any necessary code
>> changes
>> > and
>> > > > >> then
>> > > > >> > >> do...
>> > > > >> > >>
>> > > > >> > >> make clean install
>> > > > >> > >>
>> > > > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA
>> Affiliate
>> > via
>> > > > RT
>> > > > >> <
>> > > > >> > >> met_help at ucar.edu> wrote:
>> > > > >> > >>
>> > > > >> > >> >
>> > > > >> > >> > <URL: https://rt.rap.ucar.edu/rt/
>> > Ticket/Display.html?id=82438
>> > > >
>> > > > >> > >> >
>> > > > >> > >> > I'm calling scripts from here on Theia.
>> > > > >> > >> >
>> > > > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
>> > > > >> > >> >
>> > > > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley Gotway
via
>> RT <
>> > > > >> > >> > met_help at ucar.edu> wrote:
>> > > > >> > >> >
>> > > > >> > >> > > Andrew,
>> > > > >> > >> > >
>> > > > >> > >> > > Can you remind me, did you compile MET yourself
or are
>> you
>> > > > >> running a
>> > > > >> > >> > > pre-compiled version?
>> > > > >> > >> > >
>> > > > >> > >> > > If so, where are you running it?
>> > > > >> > >> > >
>> > > > >> > >> > > Thanks,
>> > > > >> > >> > > John
>> > > > >> > >> > >
>> > > > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren -
NOAA
>> > Affiliate
>> > > > via
>> > > > >> > RT <
>> > > > >> > >> > > met_help at ucar.edu> wrote:
>> > > > >> > >> > >
>> > > > >> > >> > > >
>> > > > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
>> > > > Ticket/Display.html?id=82438
>> > > > >> >
>> > > > >> > >> > > >
>> > > > >> > >> > > > Thanks John. How would I recompile after making
that
>> > > change?
>> > > > >> > >> > > >
>> > > > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley
Gotway
>> via
>> > RT
>> > > <
>> > > > >> > >> > > > met_help at ucar.edu> wrote:
>> > > > >> > >> > > >
>> > > > >> > >> > > > > Andrew,
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > I see that you're running MODE to generate a
large
>> > number
>> > > > of
>> > > > >> > >> objects.
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > Looking in src/libcode/vx_shapedata/set.h, I
see
>> that
>> > we
>> > > > >> have
>> > > > >> > >> > defined
>> > > > >> > >> > > > hard
>> > > > >> > >> > > > > upper limits:
>> > > > >> > >> > > > >    static const int max_fcst_numbers = 100;
>> > > > >> > >> > > > >    static const int max_obs_numbers  = 100;
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > You could change those to arbitrarily large
>> values...
>> > > maybe
>> > > > >> 500
>> > > > >> > >> and
>> > > > >> > >> > > then
>> > > > >> > >> > > > > recompile.
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > However, I realize that that's less than
ideal.
>> > Instead,
>> > > > we
>> > > > >> > >> should
>> > > > >> > >> > > > > dynamically allocate as much memory as
required
>> rather
>> > > than
>> > > > >> > >> having a
>> > > > >> > >> > > > fixed
>> > > > >> > >> > > > > upper limit.  I'll add a development task to
update
>> > this
>> > > > for
>> > > > >> > MODE
>> > > > >> > >> in
>> > > > >> > >> > a
>> > > > >> > >> > > > > future release.
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > Sorry I don't have a better answer for you.
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > Thanks,
>> > > > >> > >> > > > > John Halley Gotway
>> > > > >> > >> > > > > met_help at ucar.edu
>> > > > >> > >> > > > >
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew Kren
- NOAA
>> > > > Affiliate
>> > > > >> > via
>> > > > >> > >> RT
>> > > > >> > >> > <
>> > > > >> > >> > > > > met_help at ucar.edu> wrote:
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438 was
acted
>> > upon.
>> > > > >> > >> > > > > > Transaction: Ticket created by
>> andrew.kren at noaa.gov
>> > > > >> > >> > > > > >        Queue: met_help
>> > > > >> > >> > > > > >      Subject: Error with MET
>> > > > >> > >> > > > > >        Owner: Nobody
>> > > > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
>> > > > >> > >> > > > > >       Status: new
>> > > > >> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > > > >> > >> > > Ticket/Display.html?id=82438
>> > > > >> > >> > > > >
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > Hi John,
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > I am running MET Mode tool on observation
and
>> > > > precipitation
>> > > > >> > >> files.
>> > > > >> > >> > I
>> > > > >> > >> > > > > > noticed this one error for certain 24 hour
>> forecast
>> > > > >> > >> accumulation,
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 3: Applying convolution threshold
>=10.0
>> > resulted
>> > > > in
>> > > > >> 242
>> > > > >> > >> > simple
>> > > > >> > >> > > > > > observation objects.
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 3: Skipping observation object area
>> threshold.
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
intensity
>> > > percentile
>> > > > >> > >> > threshold.
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 2: Computing contingency table
statistics...
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 2: Identified: 67 forecast objects
and 242
>> > > > >> observation
>> > > > >> > >> > objects.
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
>> forecast
>> > > > field.
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
>> > observation
>> > > > >> field.
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > ERROR  :
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too
many obs
>> > > > numbers!
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > ERROR  :
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > Do you know what is causing this? Is there
a way
>> to
>> > fix
>> > > > it?
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > Thanks,
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > > --
>> > > > >> > >> > > > > > Andrew Kren
>> > > > >> > >> > > > > > Research Scientist I, Global Observing
Systems
>> > Analysis
>> > > > >> (GOSA)
>> > > > >> > >> > Group
>> > > > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm
3C515)
>> > > > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
>> > > > >> > >> > > > > > (303) 497-5418
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > > >
>> > > > >> > >> > > > >
>> > > > >> > >> > > > >
>> > > > >> > >> > > >
>> > > > >> > >> > > >
>> > > > >> > >> > > > --
>> > > > >> > >> > > > Andrew Kren
>> > > > >> > >> > > > Research Scientist I, Global Observing Systems
>> Analysis
>> > > > (GOSA)
>> > > > >> > Group
>> > > > >> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > >> > >> > > > 325 Broadway, Boulder, CO 80305
>> > > > >> > >> > > > (303) 497-5418
>> > > > >> > >> > > >
>> > > > >> > >> > > >
>> > > > >> > >> > >
>> > > > >> > >> > >
>> > > > >> > >> >
>> > > > >> > >> >
>> > > > >> > >> > --
>> > > > >> > >> > Andrew Kren
>> > > > >> > >> > Research Scientist I, Global Observing Systems
Analysis
>> > (GOSA)
>> > > > >> Group
>> > > > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > >> > >> > 325 Broadway, Boulder, CO 80305
>> > > > >> > >> > (303) 497-5418
>> > > > >> > >> >
>> > > > >> > >> >
>> > > > >> > >>
>> > > > >> > >>
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > --
>> > > > >> > > Andrew Kren
>> > > > >> > > Research Scientist I, Global Observing Systems
Analysis
>> (GOSA)
>> > > Group
>> > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > >> > > 325 Broadway, Boulder, CO 80305
>> > > > >> > > (303) 497-5418
>> > > > >> > >
>> > > > >> >
>> > > > >> >
>> > > > >> >
>> > > > >> > --
>> > > > >> > Andrew Kren
>> > > > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> > Group
>> > > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > >> > 325 Broadway, Boulder, CO 80305
>> > > > >> > (303) 497-5418
>> > > > >> >
>> > > > >> >
>> > > > >>
>> > > > >>
>> > > > >
>> > > > >
>> > > > > --
>> > > > > Andrew Kren
>> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
>> Group
>> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > > 325 Broadway, Boulder, CO 80305
>> > > > > (303) 497-5418
>> > > > >
>> > > >
>> > > >
>> > > >
>> > > > --
>> > > > Andrew Kren
>> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
>> > > > NOAA ESRL Global Systems Division (Rm 3C515)
>> > > > 325 Broadway, Boulder, CO 80305
>> > > > (303) 497-5418
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>> > --
>> > Andrew Kren
>> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
>> > NOAA ESRL Global Systems Division (Rm 3C515)
>> > 325 Broadway, Boulder, CO 80305
>> > (303) 497-5418
>> >
>> >
>>
>>
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Wed Oct 25 11:15:25 2017

Andy,

There is no official “recommendation” for that.  It’s just a
configuration
option for MODE.  Please read about it in users guide.

I can say that when I run MODE I prefer using:

merge_flag = THRESH;
match_flag = MERGE_BOTH;

But for the threshold merging, you need to pick a sensible threshold
in
merge_thresh.

Glad you were able to make progress!

Thanks
John

On Wed, Oct 25, 2017 at 12:51 PM Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> Everything is working fine now John, thanks so much for your help. I
did
> have a question about the merge_flag setting in the config file.
Right now
> I  have it set to NONE, but is it recommended to have it set to
both?
>
> Thanks,
>
> On Wed, Oct 25, 2017 at 8:58 AM, Andrew Kren - NOAA Affiliate <
> andrew.kren at noaa.gov> wrote:
>
> > Thanks John,
> >
> > I will fill out the form too. Also, any reason you can think of as
to why
> > I am getting the other error with MODE? Thanks.
> >
> > On Tue, Oct 24, 2017 at 5:51 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Andrew,
> >>
> >> Please try setting your LD_LIBRARY_PATH like this:
> >>    setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_
> >> PATH}
> >>
> >> That places the MET libraries at the *front* of the linker list.
It's
> >> possible that the linker is finding a competing version of NetCDF
> instead
> >> of the one it actually needs.
> >>
> >> These sorts of details are the reason why modules are very
nice... they
> >> handle setting up the environment correctly.
> >>
> >> Hopefully we'll get this issue with MODE resolved and you won't
need to
> go
> >> through this process in future versions.
> >>
> >> Also, can you please go the MET website and fill out the
registration
> >> form?  That helps us track the number of users who are actively
using
> the
> >> MET software:
> >>    https://dtcenter.org/met/users/downloads/index.php
> >>
> >> Enter your email address and hit enter.
> >>
> >> Thanks,
> >> John
> >>
> >> On Tue, Oct 24, 2017 at 7:26 PM, Andrew Kren - NOAA Affiliate via
RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >> >
> >> > Thanks John,
> >> >
> >> > I have this set in my .cshrc but it didn't work. Should it be
> something
> >> > else:
> >> >
> >> > if !($?LD_LIBRARY_PATH) then
> >> >
> >> >     setenv LD_LIBRARY_PATH
> >> > /scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/
> >> > svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/
> >> > BMC/dtc/MET/external_libs_intel/lib
> >> >
> >> > else
> >> >
> >> >     setenv LD_LIBRARY_PATH
> >> > ${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.
> >> > Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/
> >> > lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib
> >> >
> >> > endif
> >> >
> >> >
> >> > I got it to work by setting it in my shell script and got this
error:
> >> >
> >> >
> >> > DEBUG 1: Default Config File:
> >> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/share/
> >> > met/config/MODEConfig_default
> >> >
> >> > DEBUG 1: Match Config File: ./config/MODEConfig_APCP02
> >> >
> >> > DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02
> >> >
> >> > DEBUG 1: Forecast File:
> >> > /scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> >> > control/gfs_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc
> >> >
> >> > DEBUG 1: Observation File:
> >> > /scratch4/BMC/qosap/Andrew.Kren/era-interim/precip/conus/
> >> > 6hourly/CONUS_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc
> >> >
> >> > DEBUG 3: Use the grid named "G163".
> >> >
> >> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx:
1008 Ny:
> 722
> >> > Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha:
2537.557
> Cone:
> >> > 0.616 Bx: 501.3848 By: 1960.5885
> >> >
> >> > ERROR  :
> >> >
> >> > ERROR  : setup_fcst_obs_data() -> can't get data from file
> >> > "/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> >> > control/gfs_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc"
> >> >
> >> > ERROR  :
> >> >
> >> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> >> >
> >> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> >> >
> >> >     major: Invalid arguments to routine
> >> >
> >> >     minor: Inappropriate type
> >> >
> >> > NetCDF: HDF error
> >> >
> >> > file: ncFile.cpp  line:33
> >> >
> >> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> >> >
> >> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> >> >
> >> >     major: Invalid arguments to routine
> >> >
> >> >     minor: Inappropriate type
> >> >
> >> > NetCDF: HDF error
> >> >
> >> > file: ncFile.cpp  line:33
> >> >
> >> >
> >> >
> >> > I used the new pcp_combine tool to create the netcdf files so
not sure
> >> why
> >> > its giving me this error.
> >> >
> >> >
> >> > Thanks,
> >> >
> >> >
> >> >
> >> >
> >> > On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > > Andrew,
> >> > >
> >> > > I looked through your log installation log and don't see any
errors.
> >> > >
> >> > > So here's the error message:
> >> > >
> >> > > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/bin/mode:
error
> >> while
> >> > > loading shared libraries: libnetcdf.so.6: cannot open shared
object
> >> file:
> >> > > No such file or directory
> >> > >
> >> > > This is fixed by updating your LD_LIBRARY_PATH:
> >> > >
> >> > > setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_
> >> PATH}
> >> > >
> >> > > That tells the tools where to find the external libraries
needed at
> >> > > runtime.  I'd suggest putting that in your .cshrc.
> >> > >
> >> > > Hopefully that fixes it.
> >> > >
> >> > > John
> >> > >
> >> > > On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA Affiliate
via
> RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >> > > >
> >> > > > I got it to work with my scripts, but got this error when
running:
> >> > > >
> >> > > > *** Running MODE  ***
> >> > > >
> >> > > > *** APCP02     ***
> >> > > >
> >> > > > Init Date: 2013082500
> >> > > >
> >> > > > Running 00 to 24 forecast accumulation
> >> > > >
> >> > > >
> >> > > > /scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/bin/mode: error
> >> > while
> >> > > > loading shared libraries: libnetcdf.so.6: cannot open
shared
> object
> >> > file:
> >> > > > No such file or directory
> >> > > >
> >> > > > I assume its something with the LD_LIBRARY_PATH
> >> > > >
> >> > > > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA
Affiliate <
> >> > > > andrew.kren at noaa.gov> wrote:
> >> > > >
> >> > > > > Hi John,
> >> > > > >
> >> > > > > That seemed to work, my log file is here, let me know if
errors:
> >> > > > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> >> > > > >
> >> > > > > My .cshrc file in my home directory set the
LD_LIBRARY_PATH
> >> > previously,
> >> > > > > but I have it set with some IF statements, can you check
if my
> >> > current
> >> > > > > setting will cause issues? Also, do I need those export
commnds
> >> in my
> >> > > > > .cshrc for running? I have added them.
> >> > > > >
> >> > > > > Thanks,
> >> > > > >
> >> > > > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via
RT <
> >> > > > > met_help at ucar.edu> wrote:
> >> > > > >
> >> > > > >> Andrew,
> >> > > > >>
> >> > > > >> Hmmm, could still be an environment issue.  To try to
rule that
> >> > out, I
> >> > > > put
> >> > > > >> this all into a single script.  Please go to a working
> directory
> >> and
> >> > > > this
> >> > > > >> command:
> >> > > > >>
> >> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> >> > > > >> 023/install_met.sh
> >> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> >> > > > >> 023/met-6.0_bugfix.20170920.tar.gz
> >> > > > >> >& install.log &
> >> > > > >>
> >> > > > >> tail -f install.log # Type CNTRL-C to exit the tail
> >> > > > >>
> >> > > > >> If all goes well, that script will install met-6.0 in
the
> current
> >> > > > >> directory
> >> > > > >> and run the test scripts.  In order to get the tools
running
> from
> >> > the
> >> > > > >> command line, you'll need to update your LD_LIBRARY_PATH
like
> >> this:
> >> > > > >>
> >> > > > >> export
> >> > > > >>
LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
> >> > > > >> b:${LD_LIBRARY_PATH}
> >> > > > >>
> >> > > > >> Please let me know how that goes.  If you have problems,
please
> >> send
> >> > > me
> >> > > > >> (or
> >> > > > >> point me to) the "install.log" file.
> >> > > > >>
> >> > > > >> Thanks,
> >> > > > >> John
> >> > > > >>
> >> > > > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA
Affiliate
> >> via
> >> > RT
> >> > > <
> >> > > > >> met_help at ucar.edu> wrote:
> >> > > > >>
> >> > > > >> >
> >> > > > >> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
> >> >
> >> > > > >> >
> >> > > > >> > John,
> >> > > > >> > I compiled and installed this morning, but got this
error, is
> >> it
> >> > > > normal:
> >> > > > >> >
> >> > > > >> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
> >> > > > >> jas_stream.o):
> >> > > > >> > In
> >> > > > >> > function `jas_stream_tmpfile':
> >> > > > >> >
> >> > > > >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> >> > > > >> >
testing/METv4.1/MET_releases/intel/external_libs/jasper/
> >> > > > >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> >> > > > >> > warning: the use of `tmpnam' is dangerous, better use
> `mkstemp'
> >> > > > >> >
> >> > > > >> > /bin/ld:
> >> > > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> >> > > libjasper.a(jas_cm.o):
> >> > > > >> > undefined reference to symbol '__svml_pow2'
> >> > > > >> >
> >> > > > >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> >> > > > intel64/libsvml.so:
> >> > > > >> > error adding symbols: DSO missing from command line
> >> > > > >> >
> >> > > > >> > collect2: error: ld returned 1 exit status
> >> > > > >> >
> >> > > > >> > make[4]: *** [ensemble_stat] Error 1
> >> > > > >> >
> >> > > > >> > make[4]: Leaving directory
> >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/
> >> > > > >> > tools/core/ensemble_stat'
> >> > > > >> >
> >> > > > >> > make[3]: *** [install-recursive] Error 1
> >> > > > >> >
> >> > > > >> > make[3]: Leaving directory
> >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/
> >> > tools/core'
> >> > > > >> >
> >> > > > >> > make[2]: *** [install-recursive] Error 1
> >> > > > >> >
> >> > > > >> > make[2]: Leaving directory
> >> > > > >> >
> `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
> >> > > > >> >
> >> > > > >> > make[1]: *** [install-recursive] Error 1
> >> > > > >> >
> >> > > > >> > make[1]: Leaving directory
> >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src'
> >> > > > >> >
> >> > > > >> > make: *** [install-recursive] Error 1
> >> > > > >> >
> >> > > > >> >
> >> > > > >> > Thanks,
> >> > > > >> >
> >> > > > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA
> Affiliate <
> >> > > > >> > andrew.kren at noaa.gov> wrote:
> >> > > > >> >
> >> > > > >> > > I will try this tomorrow John and let you know how
it goes.
> >> > > Thanks.
> >> > > > >> > >
> >> > > > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley Gotway
via RT
> <
> >> > > > >> > > met_help at ucar.edu> wrote:
> >> > > > >> > >
> >> > > > >> > >> Andrew,
> >> > > > >> > >>
> >> > > > >> > >> OK, great.  You could consider switching to using
the
> >> current
> >> > > > >> version of
> >> > > > >> > >> met-6.0.
> >> > > > >> > >> I did try recompiling MET version 5.1 but had
problems.
> So
> >> > I'll
> >> > > > list
> >> > > > >> > >> instructions for compiling the current 6.0 release
of MET.
> >> > > > >> > >>
> >> > > > >> > >> To test this out, here are the commands I ran:
> >> > > > >> > >>
> >> > > > >> > >> cd
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> >> > > 20171023
> >> > > > >> > >>
> >> > > > >> > >> # Get latest bugfix version of code from here:
> >> > > > >> > >> wget
> >> > > > >> > >>
> https://dtcenter.org/met/users/downloads/MET_releases/met-6
> >> .
> >> > > > >> > >> 0_bugfix.20170920.tar.gz
> >> > > > >> > >>
> >> > > > >> > >> # Untar
> >> > > > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> >> > > > >> > >> cd met-6.0_bugfix
> >> > > > >> > >>
> >> > > > >> > >> # Configure
> >> > > > >> > >>
> >> > > > >> > >> module load intel
> >> > > > >> > >>
> >> > > > >> > >> setenv CC `which icc`
> >> > > > >> > >>
> >> > > > >> > >> setenv CXX `which icc`
> >> > > > >> > >>
> >> > > > >> > >> setenv F77 `which ifort`
> >> > > > >> > >>
> >> > > > >> > >> # Variables for compiling MET
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_NETCDF
> /scratch4/BMC/dtc/MET/external_libs_intel
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_BUFR
/scratch4/BMC/dtc/MET/external_libs_intel
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_GSL
/scratch4/BMC/dtc/MET/external_libs_intel
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_GRIB2C
> /scratch4/BMC/dtc/MET/external_libs_intel
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_HDF
/scratch4/BMC/dtc/MET/external_libs_intel
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_HDFEOS
> /scratch4/BMC/dtc/MET/external_libs_intel
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_CAIROINC /scratch4/BMC/dtc/MET/external
> >> > > > >> > >> _libs_intel/include/cairo
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
> >> > > external_libs_intel/lib
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_FREETYPEINC
> >> > > > >> > >>
> /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> >> > > > >> > >>
> >> > > > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> >> > > > external_libs_intel/lib
> >> > > > >> > >>
> >> > > > >> > >> ./configure --prefix=`pwd` --enable-grib2 --enable-
modis
> >> > > > >> > --enable-lidar2nc
> >> > > > >> > >> # Compile
> >> > > > >> > >> make install test
> >> > > > >> > >>
> >> > > > >> > >> Once you get it to compile... make any necessary
code
> >> changes
> >> > and
> >> > > > >> then
> >> > > > >> > >> do...
> >> > > > >> > >>
> >> > > > >> > >> make clean install
> >> > > > >> > >>
> >> > > > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren - NOAA
> >> Affiliate
> >> > via
> >> > > > RT
> >> > > > >> <
> >> > > > >> > >> met_help at ucar.edu> wrote:
> >> > > > >> > >>
> >> > > > >> > >> >
> >> > > > >> > >> > <URL: https://rt.rap.ucar.edu/rt/
> >> > Ticket/Display.html?id=82438
> >> > > >
> >> > > > >> > >> >
> >> > > > >> > >> > I'm calling scripts from here on Theia.
> >> > > > >> > >> >
> >> > > > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> >> > > > >> > >> >
> >> > > > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley
Gotway via
> >> RT <
> >> > > > >> > >> > met_help at ucar.edu> wrote:
> >> > > > >> > >> >
> >> > > > >> > >> > > Andrew,
> >> > > > >> > >> > >
> >> > > > >> > >> > > Can you remind me, did you compile MET yourself
or are
> >> you
> >> > > > >> running a
> >> > > > >> > >> > > pre-compiled version?
> >> > > > >> > >> > >
> >> > > > >> > >> > > If so, where are you running it?
> >> > > > >> > >> > >
> >> > > > >> > >> > > Thanks,
> >> > > > >> > >> > > John
> >> > > > >> > >> > >
> >> > > > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren -
NOAA
> >> > Affiliate
> >> > > > via
> >> > > > >> > RT <
> >> > > > >> > >> > > met_help at ucar.edu> wrote:
> >> > > > >> > >> > >
> >> > > > >> > >> > > >
> >> > > > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> >> > > > Ticket/Display.html?id=82438
> >> > > > >> >
> >> > > > >> > >> > > >
> >> > > > >> > >> > > > Thanks John. How would
>
<https://maps.google.com/?q=%3E+%3E+%3E+%3E+Thanks+John.+How+would&entry=gmail&source=g>I
> recompile after making that
> >> > > change?
> >> > > > >> > >> > > >
> >> > > > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John Halley
Gotway
> >> via
> >> > RT
> >> > > <
> >> > > > >> > >> > > > met_help at ucar.edu> wrote:
> >> > > > >> > >> > > >
> >> > > > >> > >> > > > > Andrew,
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > I see that you're running MODE to generate
a large
> >> > number
> >> > > > of
> >> > > > >> > >> objects.
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > Looking in src/libcode/vx_shapedata/set.h,
I see
> >> that
> >> > we
> >> > > > >> have
> >> > > > >> > >> > defined
> >> > > > >> > >> > > > hard
> >> > > > >> > >> > > > > upper limits:
> >> > > > >> > >> > > > >    static const int max_fcst_numbers = 100;
> >> > > > >> > >> > > > >    static const int max_obs_numbers  = 100;
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > You could change those to arbitrarily large
> >> values...
> >> > > maybe
> >> > > > >> 500
> >> > > > >> > >> and
> >> > > > >> > >> > > then
> >> > > > >> > >> > > > > recompile.
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > However, I realize that that's less than
ideal.
> >> > Instead,
> >> > > > we
> >> > > > >> > >> should
> >> > > > >> > >> > > > > dynamically allocate as much memory as
required
> >> rather
> >> > > than
> >> > > > >> > >> having a
> >> > > > >> > >> > > > fixed
> >> > > > >> > >> > > > > upper limit.  I'll add a development task
to
> update
> >> > this
> >> > > > for
> >> > > > >> > MODE
> >> > > > >> > >> in
> >> > > > >> > >> > a
> >> > > > >> > >> > > > > future release.
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > Sorry I don't have a better answer for you.
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > Thanks,
> >> > > > >> > >> > > > > John Halley Gotway
> >> > > > >> > >> > > > > met_help at ucar.edu
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew
Kren -
> NOAA
> >> > > > Affiliate
> >> > > > >> > via
> >> > > > >> > >> RT
> >> > > > >> > >> > <
> >> > > > >> > >> > > > > met_help at ucar.edu> wrote:
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438
was
> acted
> >> > upon.
> >> > > > >> > >> > > > > > Transaction: Ticket created by
> >> andrew.kren at noaa.gov
> >> > > > >> > >> > > > > >        Queue: met_help
> >> > > > >> > >> > > > > >      Subject: Error with MET
> >> > > > >> > >> > > > > >        Owner: Nobody
> >> > > > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> >> > > > >> > >> > > > > >       Status: new
> >> > > > >> > >> > > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > > > >> > >> > > Ticket/Display.html?id=82438
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > Hi John,
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > I am running MET Mode tool on observation
and
> >> > > > precipitation
> >> > > > >> > >> files.
> >> > > > >> > >> > I
> >> > > > >> > >> > > > > > noticed this one error for certain 24
hour
> >> forecast
> >> > > > >> > >> accumulation,
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 3: Applying convolution threshold
>=10.0
> >> > resulted
> >> > > > in
> >> > > > >> 242
> >> > > > >> > >> > simple
> >> > > > >> > >> > > > > > observation objects.
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 3: Skipping observation object area
> >> threshold.
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
intensity
> >> > > percentile
> >> > > > >> > >> > threshold.
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 2: Computing contingency table
> statistics...
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 2: Identified: 67 forecast objects
and 242
> >> > > > >> observation
> >> > > > >> > >> > objects.
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
> >> forecast
> >> > > > field.
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
> >> > observation
> >> > > > >> field.
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > ERROR  :
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) -> too
many
> obs
> >> > > > numbers!
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > ERROR  :
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > Do you know what is causing this? Is
there a way
> >> to
> >> > fix
> >> > > > it?
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > Thanks,
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > > --
> >> > > > >> > >> > > > > > Andrew Kren
> >> > > > >> > >> > > > > > Research Scientist I, Global Observing
Systems
> >> > Analysis
> >> > > > >> (GOSA)
> >> > > > >> > >> > Group
> >> > > > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm
3C515)
> >> > > > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> >> > > > >> > >> > > > > > (303) 497-5418
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > > >
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > > >
> >> > > > >> > >> > > >
> >> > > > >> > >> > > >
> >> > > > >> > >> > > > --
> >> > > > >> > >> > > > Andrew Kren
> >> > > > >> > >> > > > Research Scientist I, Global Observing
Systems
> >> Analysis
> >> > > > (GOSA)
> >> > > > >> > Group
> >> > > > >> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > >> > >> > > > 325 Broadway, Boulder, CO 80305
> >> > > > >> > >> > > > (303) 497-5418
> >> > > > >> > >> > > >
> >> > > > >> > >> > > >
> >> > > > >> > >> > >
> >> > > > >> > >> > >
> >> > > > >> > >> >
> >> > > > >> > >> >
> >> > > > >> > >> > --
> >> > > > >> > >> > Andrew Kren
> >> > > > >> > >> > Research Scientist I, Global Observing Systems
Analysis
> >> > (GOSA)
> >> > > > >> Group
> >> > > > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > >> > >> > 325 Broadway, Boulder, CO 80305
> >> > > > >> > >> > (303) 497-5418
> >> > > > >> > >> >
> >> > > > >> > >> >
> >> > > > >> > >>
> >> > > > >> > >>
> >> > > > >> > >
> >> > > > >> > >
> >> > > > >> > > --
> >> > > > >> > > Andrew Kren
> >> > > > >> > > Research Scientist I, Global Observing Systems
Analysis
> >> (GOSA)
> >> > > Group
> >> > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > >> > > 325 Broadway, Boulder, CO 80305
> >> > > > >> > > (303) 497-5418
> >> > > > >> > >
> >> > > > >> >
> >> > > > >> >
> >> > > > >> >
> >> > > > >> > --
> >> > > > >> > Andrew Kren
> >> > > > >> > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> >> > Group
> >> > > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > >> > 325 Broadway, Boulder, CO 80305
> >> > > > >> > (303) 497-5418
> >> > > > >> >
> >> > > > >> >
> >> > > > >>
> >> > > > >>
> >> > > > >
> >> > > > >
> >> > > > > --
> >> > > > > Andrew Kren
> >> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> >> Group
> >> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > > 325 Broadway, Boulder, CO 80305
> >> > > > > (303) 497-5418
> >> > > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > Andrew Kren
> >> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > > > 325 Broadway, Boulder, CO 80305
> >> > > > (303) 497-5418
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > Andrew Kren
> >> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> >> > NOAA ESRL Global Systems Division (Rm 3C515)
> >> > 325 Broadway, Boulder, CO 80305
> >> > (303) 497-5418
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
>
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------
Subject: Error with MET
From: Andrew Kren - NOAA Affiliate
Time: Wed Oct 25 16:46:58 2017

John,

One last issue if you don't mind. I put the setenv path for MET at the
beginning of the linking and it fixed the issue with MET. However, it
led
to other issues with NCL not working correctly, which tells me I guess
other programs were using different competing libraries. Is there a
way to
get around this to avoid this conflict?

Thanks,

On Wed, Oct 25, 2017 at 11:15 AM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Andy,
>
> There is no official “recommendation” for that.  It’s just a
configuration
> option for MODE.  Please read about it in users guide.
>
> I can say that when I run MODE I prefer using:
>
> merge_flag = THRESH;
> match_flag = MERGE_BOTH;
>
> But for the threshold merging, you need to pick a sensible threshold
in
> merge_thresh.
>
> Glad you were able to make progress!
>
> Thanks
> John
>
> On Wed, Oct 25, 2017 at 12:51 PM Andrew Kren - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> >
> > Everything is working fine now John, thanks so much for your help.
I did
> > have a question about the merge_flag setting in the config file.
Right
> now
> > I  have it set to NONE, but is it recommended to have it set to
both?
> >
> > Thanks,
> >
> > On Wed, Oct 25, 2017 at 8:58 AM, Andrew Kren - NOAA Affiliate <
> > andrew.kren at noaa.gov> wrote:
> >
> > > Thanks John,
> > >
> > > I will fill out the form too. Also, any reason you can think of
as to
> why
> > > I am getting the other error with MODE? Thanks.
> > >
> > > On Tue, Oct 24, 2017 at 5:51 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Andrew,
> > >>
> > >> Please try setting your LD_LIBRARY_PATH like this:
> > >>    setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_LIBRARY_
> > >> PATH}
> > >>
> > >> That places the MET libraries at the *front* of the linker
list.  It's
> > >> possible that the linker is finding a competing version of
NetCDF
> > instead
> > >> of the one it actually needs.
> > >>
> > >> These sorts of details are the reason why modules are very
nice...
> they
> > >> handle setting up the environment correctly.
> > >>
> > >> Hopefully we'll get this issue with MODE resolved and you won't
need
> to
> > go
> > >> through this process in future versions.
> > >>
> > >> Also, can you please go the MET website and fill out the
registration
> > >> form?  That helps us track the number of users who are actively
using
> > the
> > >> MET software:
> > >>    https://dtcenter.org/met/users/downloads/index.php
> > >>
> > >> Enter your email address and hit enter.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Tue, Oct 24, 2017 at 7:26 PM, Andrew Kren - NOAA Affiliate
via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
>
> > >> >
> > >> > Thanks John,
> > >> >
> > >> > I have this set in my .cshrc but it didn't work. Should it be
> > something
> > >> > else:
> > >> >
> > >> > if !($?LD_LIBRARY_PATH) then
> > >> >
> > >> >     setenv LD_LIBRARY_PATH
> > >> > /scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/
> > >> > svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/
> > >> > BMC/dtc/MET/external_libs_intel/lib
> > >> >
> > >> > else
> > >> >
> > >> >     setenv LD_LIBRARY_PATH
> > >> > ${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.
> > >> > Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/
> > >> > lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib
> > >> >
> > >> > endif
> > >> >
> > >> >
> > >> > I got it to work by setting it in my shell script and got
this
> error:
> > >> >
> > >> >
> > >> > DEBUG 1: Default Config File:
> > >> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/share/
> > >> > met/config/MODEConfig_default
> > >> >
> > >> > DEBUG 1: Match Config File: ./config/MODEConfig_APCP02
> > >> >
> > >> > DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02
> > >> >
> > >> > DEBUG 1: Forecast File:
> > >> > /scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> > >> > control/gfs_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc
> > >> >
> > >> > DEBUG 1: Observation File:
> > >> > /scratch4/BMC/qosap/Andrew.Kren/era-interim/precip/conus/
> > >> > 6hourly/CONUS_APCP_24_2013082500 <(201)%20308-
2500>_F00_F24.nc
> > >> >
> > >> > DEBUG 3: Use the grid named "G163".
> > >> >
> > >> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx:
1008 Ny:
> > 722
> > >> > Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha:
2537.557
> > Cone:
> > >> > 0.616 Bx: 501.3848 By: 1960.5885
> > >> >
> > >> > ERROR  :
> > >> >
> > >> > ERROR  : setup_fcst_obs_data() -> can't get data from file
> > >> > "/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> > >> > control/gfs_APCP_24_2013082500 <(201)%20308-2500>_F00_F24.nc"
> > >> >
> > >> > ERROR  :
> > >> >
> > >> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> > >> >
> > >> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> > >> >
> > >> >     major: Invalid arguments to routine
> > >> >
> > >> >     minor: Inappropriate type
> > >> >
> > >> > NetCDF: HDF error
> > >> >
> > >> > file: ncFile.cpp  line:33
> > >> >
> > >> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> > >> >
> > >> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> > >> >
> > >> >     major: Invalid arguments to routine
> > >> >
> > >> >     minor: Inappropriate type
> > >> >
> > >> > NetCDF: HDF error
> > >> >
> > >> > file: ncFile.cpp  line:33
> > >> >
> > >> >
> > >> >
> > >> > I used the new pcp_combine tool to create the netcdf files so
not
> sure
> > >> why
> > >> > its giving me this error.
> > >> >
> > >> >
> > >> > Thanks,
> > >> >
> > >> >
> > >> >
> > >> >
> > >> > On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > > Andrew,
> > >> > >
> > >> > > I looked through your log installation log and don't see
any
> errors.
> > >> > >
> > >> > > So here's the error message:
> > >> > >
> > >> > > /scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/bin/mode:
> error
> > >> while
> > >> > > loading shared libraries: libnetcdf.so.6: cannot open
shared
> object
> > >> file:
> > >> > > No such file or directory
> > >> > >
> > >> > > This is fixed by updating your LD_LIBRARY_PATH:
> > >> > >
> > >> > > setenv /scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_
> LIBRARY_
> > >> PATH}
> > >> > >
> > >> > > That tells the tools where to find the external libraries
needed
> at
> > >> > > runtime.  I'd suggest putting that in your .cshrc.
> > >> > >
> > >> > > Hopefully that fixes it.
> > >> > >
> > >> > > John
> > >> > >
> > >> > > On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA
Affiliate via
> > RT <
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > >> > > >
> > >> > > > I got it to work with my scripts, but got this error when
> running:
> > >> > > >
> > >> > > > *** Running MODE  ***
> > >> > > >
> > >> > > > *** APCP02     ***
> > >> > > >
> > >> > > > Init Date: 2013082500
> > >> > > >
> > >> > > > Running 00 to 24 forecast accumulation
> > >> > > >
> > >> > > >
> > >> > > > /scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/bin/mode:
> error
> > >> > while
> > >> > > > loading shared libraries: libnetcdf.so.6: cannot open
shared
> > object
> > >> > file:
> > >> > > > No such file or directory
> > >> > > >
> > >> > > > I assume its something with the LD_LIBRARY_PATH
> > >> > > >
> > >> > > > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA
Affiliate <
> > >> > > > andrew.kren at noaa.gov> wrote:
> > >> > > >
> > >> > > > > Hi John,
> > >> > > > >
> > >> > > > > That seemed to work, my log file is here, let me know
if
> errors:
> > >> > > > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> > >> > > > >
> > >> > > > > My .cshrc file in my home directory set the
LD_LIBRARY_PATH
> > >> > previously,
> > >> > > > > but I have it set with some IF statements, can you
check if my
> > >> > current
> > >> > > > > setting will cause issues? Also, do I need those export
> commnds
> > >> in my
> > >> > > > > .cshrc for running? I have added them.
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > >
> > >> > > > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway via
RT <
> > >> > > > > met_help at ucar.edu> wrote:
> > >> > > > >
> > >> > > > >> Andrew,
> > >> > > > >>
> > >> > > > >> Hmmm, could still be an environment issue.  To try to
rule
> that
> > >> > out, I
> > >> > > > put
> > >> > > > >> this all into a single script.  Please go to a working
> > directory
> > >> and
> > >> > > > this
> > >> > > > >> command:
> > >> > > > >>
> > >> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > >> > > > >> 023/install_met.sh
> > >> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_20171
> > >> > > > >> 023/met-6.0_bugfix.20170920.tar.gz
> > >> > > > >> >& install.log &
> > >> > > > >>
> > >> > > > >> tail -f install.log # Type CNTRL-C to exit the tail
> > >> > > > >>
> > >> > > > >> If all goes well, that script will install met-6.0 in
the
> > current
> > >> > > > >> directory
> > >> > > > >> and run the test scripts.  In order to get the tools
running
> > from
> > >> > the
> > >> > > > >> command line, you'll need to update your
LD_LIBRARY_PATH like
> > >> this:
> > >> > > > >>
> > >> > > > >> export
> > >> > > > >>
LD_LIBRARY_PATH=/scratch4/BMC/dtc/MET/external_libs_intel/li
> > >> > > > >> b:${LD_LIBRARY_PATH}
> > >> > > > >>
> > >> > > > >> Please let me know how that goes.  If you have
problems,
> please
> > >> send
> > >> > > me
> > >> > > > >> (or
> > >> > > > >> point me to) the "install.log" file.
> > >> > > > >>
> > >> > > > >> Thanks,
> > >> > > > >> John
> > >> > > > >>
> > >> > > > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA
> Affiliate
> > >> via
> > >> > RT
> > >> > > <
> > >> > > > >> met_help at ucar.edu> wrote:
> > >> > > > >>
> > >> > > > >> >
> > >> > > > >> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
> > >> >
> > >> > > > >> >
> > >> > > > >> > John,
> > >> > > > >> > I compiled and installed this morning, but got this
error,
> is
> > >> it
> > >> > > > normal:
> > >> > > > >> >
> > >> > > > >> >
/scratch4/BMC/dtc/MET/external_libs_intel/lib/libjasper.a(
> > >> > > > >> jas_stream.o):
> > >> > > > >> > In
> > >> > > > >> > function `jas_stream_tmpfile':
> > >> > > > >> >
> > >> > > > >> > /scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> > >> > > > >> >
testing/METv4.1/MET_releases/intel/external_libs/jasper/
> > >> > > > >> > jasper-1.900.1/src/libjasper/base/jas_stream.c:368:
> > >> > > > >> > warning: the use of `tmpnam' is dangerous, better
use
> > `mkstemp'
> > >> > > > >> >
> > >> > > > >> > /bin/ld:
> > >> > > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> > >> > > libjasper.a(jas_cm.o):
> > >> > > > >> > undefined reference to symbol '__svml_pow2'
> > >> > > > >> >
> > >> > > > >> > /apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> > >> > > > intel64/libsvml.so:
> > >> > > > >> > error adding symbols: DSO missing from command line
> > >> > > > >> >
> > >> > > > >> > collect2: error: ld returned 1 exit status
> > >> > > > >> >
> > >> > > > >> > make[4]: *** [ensemble_stat] Error 1
> > >> > > > >> >
> > >> > > > >> > make[4]: Leaving directory
> > >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/
> > >> > > > >> > tools/core/ensemble_stat'
> > >> > > > >> >
> > >> > > > >> > make[3]: *** [install-recursive] Error 1
> > >> > > > >> >
> > >> > > > >> > make[3]: Leaving directory
> > >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/
> > >> > tools/core'
> > >> > > > >> >
> > >> > > > >> > make[2]: *** [install-recursive] Error 1
> > >> > > > >> >
> > >> > > > >> > make[2]: Leaving directory
> > >> > > > >> >
> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
> > >> > > > >> >
> > >> > > > >> > make[1]: *** [install-recursive] Error 1
> > >> > > > >> >
> > >> > > > >> > make[1]: Leaving directory
> > >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src'
> > >> > > > >> >
> > >> > > > >> > make: *** [install-recursive] Error 1
> > >> > > > >> >
> > >> > > > >> >
> > >> > > > >> > Thanks,
> > >> > > > >> >
> > >> > > > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren - NOAA
> > Affiliate <
> > >> > > > >> > andrew.kren at noaa.gov> wrote:
> > >> > > > >> >
> > >> > > > >> > > I will try this tomorrow John and let you know how
it
> goes.
> > >> > > Thanks.
> > >> > > > >> > >
> > >> > > > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley
Gotway via
> RT
> > <
> > >> > > > >> > > met_help at ucar.edu> wrote:
> > >> > > > >> > >
> > >> > > > >> > >> Andrew,
> > >> > > > >> > >>
> > >> > > > >> > >> OK, great.  You could consider switching to using
the
> > >> current
> > >> > > > >> version of
> > >> > > > >> > >> met-6.0.
> > >> > > > >> > >> I did try recompiling MET version 5.1 but had
problems.
> > So
> > >> > I'll
> > >> > > > list
> > >> > > > >> > >> instructions for compiling the current 6.0
release of
> MET.
> > >> > > > >> > >>
> > >> > > > >> > >> To test this out, here are the commands I ran:
> > >> > > > >> > >>
> > >> > > > >> > >> cd /scratch4/BMC/dtc/John.H.
> Gotway/MET/MET_Help/kren_data_
> > >> > > 20171023
> > >> > > > >> > >>
> > >> > > > >> > >> # Get latest bugfix version of code from here:
> > >> > > > >> > >> wget
> > >> > > > >> > >>
> > https://dtcenter.org/met/users/downloads/MET_releases/met-6
> > >> .
> > >> > > > >> > >> 0_bugfix.20170920.tar.gz
> > >> > > > >> > >>
> > >> > > > >> > >> # Untar
> > >> > > > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> > >> > > > >> > >> cd met-6.0_bugfix
> > >> > > > >> > >>
> > >> > > > >> > >> # Configure
> > >> > > > >> > >>
> > >> > > > >> > >> module load intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv CC `which icc`
> > >> > > > >> > >>
> > >> > > > >> > >> setenv CXX `which icc`
> > >> > > > >> > >>
> > >> > > > >> > >> setenv F77 `which ifort`
> > >> > > > >> > >>
> > >> > > > >> > >> # Variables for compiling MET
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_NETCDF
> > /scratch4/BMC/dtc/MET/external_libs_intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_BUFR /scratch4/BMC/dtc/MET/
> external_libs_intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/
> external_libs_intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_GRIB2C
> > /scratch4/BMC/dtc/MET/external_libs_intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/
> external_libs_intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_HDFEOS
> > /scratch4/BMC/dtc/MET/external_libs_intel
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_CAIROINC
/scratch4/BMC/dtc/MET/external
> > >> > > > >> > >> _libs_intel/include/cairo
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
> > >> > > external_libs_intel/lib
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_FREETYPEINC
> > >> > > > >> > >>
> > /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> > >> > > > >> > >>
> > >> > > > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> > >> > > > external_libs_intel/lib
> > >> > > > >> > >>
> > >> > > > >> > >> ./configure --prefix=`pwd` --enable-grib2
--enable-modis
> > >> > > > >> > --enable-lidar2nc
> > >> > > > >> > >> # Compile
> > >> > > > >> > >> make install test
> > >> > > > >> > >>
> > >> > > > >> > >> Once you get it to compile... make any necessary
code
> > >> changes
> > >> > and
> > >> > > > >> then
> > >> > > > >> > >> do...
> > >> > > > >> > >>
> > >> > > > >> > >> make clean install
> > >> > > > >> > >>
> > >> > > > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren -
NOAA
> > >> Affiliate
> > >> > via
> > >> > > > RT
> > >> > > > >> <
> > >> > > > >> > >> met_help at ucar.edu> wrote:
> > >> > > > >> > >>
> > >> > > > >> > >> >
> > >> > > > >> > >> > <URL: https://rt.rap.ucar.edu/rt/
> > >> > Ticket/Display.html?id=82438
> > >> > > >
> > >> > > > >> > >> >
> > >> > > > >> > >> > I'm calling scripts from here on Theia.
> > >> > > > >> > >> >
> > >> > > > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> > >> > > > >> > >> >
> > >> > > > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley
Gotway
> via
> > >> RT <
> > >> > > > >> > >> > met_help at ucar.edu> wrote:
> > >> > > > >> > >> >
> > >> > > > >> > >> > > Andrew,
> > >> > > > >> > >> > >
> > >> > > > >> > >> > > Can you remind me, did you compile MET
yourself or
> are
> > >> you
> > >> > > > >> running a
> > >> > > > >> > >> > > pre-compiled version?
> > >> > > > >> > >> > >
> > >> > > > >> > >> > > If so, where are you running it?
> > >> > > > >> > >> > >
> > >> > > > >> > >> > > Thanks,
> > >> > > > >> > >> > > John
> > >> > > > >> > >> > >
> > >> > > > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew Kren
- NOAA
> > >> > Affiliate
> > >> > > > via
> > >> > > > >> > RT <
> > >> > > > >> > >> > > met_help at ucar.edu> wrote:
> > >> > > > >> > >> > >
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > >> > > > Ticket/Display.html?id=82438
> > >> > > > >> >
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > > Thanks John. How would
> > <https://maps.google.com/?q=%3E+%3E+%3E+%3E+Thanks+John.+
> How+would&entry=gmail&source=g>I
> > recompile after making that
> > >> > > change?
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John
Halley
> Gotway
> > >> via
> > >> > RT
> > >> > > <
> > >> > > > >> > >> > > > met_help at ucar.edu> wrote:
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > > > Andrew,
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > I see that you're running MODE to
generate a
> large
> > >> > number
> > >> > > > of
> > >> > > > >> > >> objects.
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > Looking in
src/libcode/vx_shapedata/set.h, I
> see
> > >> that
> > >> > we
> > >> > > > >> have
> > >> > > > >> > >> > defined
> > >> > > > >> > >> > > > hard
> > >> > > > >> > >> > > > > upper limits:
> > >> > > > >> > >> > > > >    static const int max_fcst_numbers =
100;
> > >> > > > >> > >> > > > >    static const int max_obs_numbers  =
100;
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > You could change those to arbitrarily
large
> > >> values...
> > >> > > maybe
> > >> > > > >> 500
> > >> > > > >> > >> and
> > >> > > > >> > >> > > then
> > >> > > > >> > >> > > > > recompile.
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > However, I realize that that's less than
ideal.
> > >> > Instead,
> > >> > > > we
> > >> > > > >> > >> should
> > >> > > > >> > >> > > > > dynamically allocate as much memory as
required
> > >> rather
> > >> > > than
> > >> > > > >> > >> having a
> > >> > > > >> > >> > > > fixed
> > >> > > > >> > >> > > > > upper limit.  I'll add a development task
to
> > update
> > >> > this
> > >> > > > for
> > >> > > > >> > MODE
> > >> > > > >> > >> in
> > >> > > > >> > >> > a
> > >> > > > >> > >> > > > > future release.
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > Sorry I don't have a better answer for
you.
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > Thanks,
> > >> > > > >> > >> > > > > John Halley Gotway
> > >> > > > >> > >> > > > > met_help at ucar.edu
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew
Kren -
> > NOAA
> > >> > > > Affiliate
> > >> > > > >> > via
> > >> > > > >> > >> RT
> > >> > > > >> > >> > <
> > >> > > > >> > >> > > > > met_help at ucar.edu> wrote:
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request 82438
was
> > acted
> > >> > upon.
> > >> > > > >> > >> > > > > > Transaction: Ticket created by
> > >> andrew.kren at noaa.gov
> > >> > > > >> > >> > > > > >        Queue: met_help
> > >> > > > >> > >> > > > > >      Subject: Error with MET
> > >> > > > >> > >> > > > > >        Owner: Nobody
> > >> > > > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> > >> > > > >> > >> > > > > >       Status: new
> > >> > > > >> > >> > > > > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/
> > >> > > > >> > >> > > Ticket/Display.html?id=82438
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > Hi John,
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > I am running MET Mode tool on
observation and
> > >> > > > precipitation
> > >> > > > >> > >> files.
> > >> > > > >> > >> > I
> > >> > > > >> > >> > > > > > noticed this one error for certain 24
hour
> > >> forecast
> > >> > > > >> > >> accumulation,
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 3: Applying convolution threshold
>=10.0
> > >> > resulted
> > >> > > > in
> > >> > > > >> 242
> > >> > > > >> > >> > simple
> > >> > > > >> > >> > > > > > observation objects.
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
area
> > >> threshold.
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
intensity
> > >> > > percentile
> > >> > > > >> > >> > threshold.
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 2: Computing contingency table
> > statistics...
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 2: Identified: 67 forecast
objects and
> 242
> > >> > > > >> observation
> > >> > > > >> > >> > objects.
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
> > >> forecast
> > >> > > > field.
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
> > >> > observation
> > >> > > > >> field.
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > ERROR  :
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) ->
too many
> > obs
> > >> > > > numbers!
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > ERROR  :
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > Do you know what is causing this? Is
there a
> way
> > >> to
> > >> > fix
> > >> > > > it?
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > Thanks,
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > > --
> > >> > > > >> > >> > > > > > Andrew Kren
> > >> > > > >> > >> > > > > > Research Scientist I, Global Observing
Systems
> > >> > Analysis
> > >> > > > >> (GOSA)
> > >> > > > >> > >> > Group
> > >> > > > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm
3C515)
> > >> > > > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > >> > > > >> > >> > > > > > (303) 497-5418
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > > >
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > > >
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > > --
> > >> > > > >> > >> > > > Andrew Kren
> > >> > > > >> > >> > > > Research Scientist I, Global Observing
Systems
> > >> Analysis
> > >> > > > (GOSA)
> > >> > > > >> > Group
> > >> > > > >> > >> > > > NOAA ESRL Global Systems Division (Rm
3C515)
> > >> > > > >> > >> > > > 325 Broadway, Boulder, CO 80305
> > >> > > > >> > >> > > > (303) 497-5418
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > > >
> > >> > > > >> > >> > >
> > >> > > > >> > >> > >
> > >> > > > >> > >> >
> > >> > > > >> > >> >
> > >> > > > >> > >> > --
> > >> > > > >> > >> > Andrew Kren
> > >> > > > >> > >> > Research Scientist I, Global Observing Systems
> Analysis
> > >> > (GOSA)
> > >> > > > >> Group
> > >> > > > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > >> > >> > 325 Broadway, Boulder, CO 80305
> > >> > > > >> > >> > (303) 497-5418
> > >> > > > >> > >> >
> > >> > > > >> > >> >
> > >> > > > >> > >>
> > >> > > > >> > >>
> > >> > > > >> > >
> > >> > > > >> > >
> > >> > > > >> > > --
> > >> > > > >> > > Andrew Kren
> > >> > > > >> > > Research Scientist I, Global Observing Systems
Analysis
> > >> (GOSA)
> > >> > > Group
> > >> > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > >> > > 325 Broadway, Boulder, CO 80305
> > >> > > > >> > > (303) 497-5418
> > >> > > > >> > >
> > >> > > > >> >
> > >> > > > >> >
> > >> > > > >> >
> > >> > > > >> > --
> > >> > > > >> > Andrew Kren
> > >> > > > >> > Research Scientist I, Global Observing Systems
Analysis
> > (GOSA)
> > >> > Group
> > >> > > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > >> > 325 Broadway, Boulder, CO 80305
> > >> > > > >> > (303) 497-5418
> > >> > > > >> >
> > >> > > > >> >
> > >> > > > >>
> > >> > > > >>
> > >> > > > >
> > >> > > > >
> > >> > > > > --
> > >> > > > > Andrew Kren
> > >> > > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > >> Group
> > >> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > > 325 Broadway, Boulder, CO 80305
> > >> > > > > (303) 497-5418
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > --
> > >> > > > Andrew Kren
> > >> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > Group
> > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > > > 325 Broadway, Boulder, CO 80305
> > >> > > > (303) 497-5418
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> > Andrew Kren
> > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA) Group
> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > >> > 325 Broadway, Boulder, CO 80305
> > >> > (303) 497-5418
> > >> >
> > >> >
> > >>
> > >>
> > >
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> >
> >
> >
> > --
> > Andrew Kren
> > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > NOAA ESRL Global Systems Division (Rm 3C515)
> > 325 Broadway, Boulder, CO 80305
> > (303) 497-5418
> >
> >
>
>

--
Andrew Kren
Research Scientist I, Global Observing Systems Analysis (GOSA) Group
NOAA ESRL Global Systems Division (Rm 3C515)
325 Broadway, Boulder, CO 80305
(303) 497-5418

------------------------------------------------
Subject: Error with MET
From: John Halley Gotway
Time: Thu Oct 26 06:57:32 2017

Unfortunately, in this situation, I'd say no, there's no simple way to
handle this.

That's what's nice about loading modules.  They should (or at least
can) be
set up to check for conflicts and reload the necessary version of
different
packages.  In that case, running "module load met" or "module load
ncl"
could reconcile conflicts.

But since you're running a custom version of MET with that code
change,
using modules won't really help.

I do have one idea.  Earlier versions of MET were compiled using
*static*
linking.  A couple years ago we changed the default to use *dynamic*
linking instead.  Static linking loads all the required external
libraries
at compilation time, while dynamic linking loads required external
libraries at runtime... and therefore requires the LD_LIBRARY_PATH
setting
to tell the linker where to look.

You could try rerunning the configure command for MET using the
"--enable-static_linking"
command line option.  And then you could take MET out of the
LD_LIBRARY_PATH setting... which should get NCL working again.

Honestly I haven't tried this.  So please let me know how it goes.

Thanks,
John

On Wed, Oct 25, 2017 at 6:46 PM, Andrew Kren - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
>
> John,
>
> One last issue if you don't mind. I put the setenv path for MET at
the
> beginning of the linking and it fixed the issue with MET. However,
it led
> to other issues with NCL not working correctly, which tells me I
guess
> other programs were using different competing libraries. Is there a
way to
> get around this to avoid this conflict?
>
> Thanks,
>
> On Wed, Oct 25, 2017 at 11:15 AM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Andy,
> >
> > There is no official “recommendation” for that.  It’s just a
> configuration
> > option for MODE.  Please read about it in users guide.
> >
> > I can say that when I run MODE I prefer using:
> >
> > merge_flag = THRESH;
> > match_flag = MERGE_BOTH;
> >
> > But for the threshold merging, you need to pick a sensible
threshold in
> > merge_thresh.
> >
> > Glad you were able to make progress!
> >
> > Thanks
> > John
> >
> > On Wed, Oct 25, 2017 at 12:51 PM Andrew Kren - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > >
> > > Everything is working fine now John, thanks so much for your
help. I
> did
> > > have a question about the merge_flag setting in the config file.
Right
> > now
> > > I  have it set to NONE, but is it recommended to have it set to
both?
> > >
> > > Thanks,
> > >
> > > On Wed, Oct 25, 2017 at 8:58 AM, Andrew Kren - NOAA Affiliate <
> > > andrew.kren at noaa.gov> wrote:
> > >
> > > > Thanks John,
> > > >
> > > > I will fill out the form too. Also, any reason you can think
of as to
> > why
> > > > I am getting the other error with MODE? Thanks.
> > > >
> > > > On Tue, Oct 24, 2017 at 5:51 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Andrew,
> > > >>
> > > >> Please try setting your LD_LIBRARY_PATH like this:
> > > >>    setenv /scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_
> LIBRARY_
> > > >> PATH}
> > > >>
> > > >> That places the MET libraries at the *front* of the linker
list.
> It's
> > > >> possible that the linker is finding a competing version of
NetCDF
> > > instead
> > > >> of the one it actually needs.
> > > >>
> > > >> These sorts of details are the reason why modules are very
nice...
> > they
> > > >> handle setting up the environment correctly.
> > > >>
> > > >> Hopefully we'll get this issue with MODE resolved and you
won't need
> > to
> > > go
> > > >> through this process in future versions.
> > > >>
> > > >> Also, can you please go the MET website and fill out the
> registration
> > > >> form?  That helps us track the number of users who are
actively
> using
> > > the
> > > >> MET software:
> > > >>    https://dtcenter.org/met/users/downloads/index.php
> > > >>
> > > >> Enter your email address and hit enter.
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Tue, Oct 24, 2017 at 7:26 PM, Andrew Kren - NOAA Affiliate
via
> RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438 >
> > > >> >
> > > >> > Thanks John,
> > > >> >
> > > >> > I have this set in my .cshrc but it didn't work. Should it
be
> > > something
> > > >> > else:
> > > >> >
> > > >> > if !($?LD_LIBRARY_PATH) then
> > > >> >
> > > >> >     setenv LD_LIBRARY_PATH
> > > >> > /scratch4/NCEPDEV/global/noscrub/Eugene.Mirvis/VLAB/
> > > >> > svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/lib:/scratch4/
> > > >> > BMC/dtc/MET/external_libs_intel/lib
> > > >> >
> > > >> > else
> > > >> >
> > > >> >     setenv LD_LIBRARY_PATH
> > > >> > ${LD_LIBRARY_PATH}:/scratch4/NCEPDEV/global/noscrub/Eugene.
> > > >> > Mirvis/VLAB/svn/1.7.20/lib:$GRIB_API_DIR/lib:$EMOS_DIR/
> > > >> > lib:/scratch4/BMC/dtc/MET/external_libs_intel/lib
> > > >> >
> > > >> > endif
> > > >> >
> > > >> >
> > > >> > I got it to work by setting it in my shell script and got
this
> > error:
> > > >> >
> > > >> >
> > > >> > DEBUG 1: Default Config File:
> > > >> > /scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/share/
> > > >> > met/config/MODEConfig_default
> > > >> >
> > > >> > DEBUG 1: Match Config File: ./config/MODEConfig_APCP02
> > > >> >
> > > >> > DEBUG 1: Merge Config File: ./config/MODEConfig_APCP02
> > > >> >
> > > >> > DEBUG 1: Forecast File:
> > > >> > /scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> > > >> > control/gfs_APCP_24_2013082500 <(201)%20308-
2500>_F00_F24.nc
> > > >> >
> > > >> > DEBUG 1: Observation File:
> > > >> > /scratch4/BMC/qosap/Andrew.Kren/era-interim/precip/conus/
> > > >> > 6hourly/CONUS_APCP_24_2013082500 <(201)%20308-
2500>_F00_F24.nc
> > > >> >
> > > >> > DEBUG 3: Use the grid named "G163".
> > > >> >
> > > >> > DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx:
1008
> Ny:
> > > 722
> > > >> > Lat_LL: 20.600 Lon_LL: 118.300 Lon_orient: 95.000 Alpha:
2537.557
> > > Cone:
> > > >> > 0.616 Bx: 501.3848 By: 1960.5885
> > > >> >
> > > >> > ERROR  :
> > > >> >
> > > >> > ERROR  : setup_fcst_obs_data() -> can't get data from file
> > > >> > "/scratch4/BMC/qosap/Andrew.Kren/lightning/pcp_gfs/light-
> > > >> > control/gfs_APCP_24_2013082500 <(201)%20308-
2500>_F00_F24.nc"
> > > >> >
> > > >> > ERROR  :
> > > >> >
> > > >> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> > > >> >
> > > >> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> > > >> >
> > > >> >     major: Invalid arguments to routine
> > > >> >
> > > >> >     minor: Inappropriate type
> > > >> >
> > > >> > NetCDF: HDF error
> > > >> >
> > > >> > file: ncFile.cpp  line:33
> > > >> >
> > > >> > HDF5-DIAG: Error detected in HDF5 (1.10.0-patch1) thread 0:
> > > >> >
> > > >> >   #000: H5T.c line 1723 in H5Tclose(): not a datatype
> > > >> >
> > > >> >     major: Invalid arguments to routine
> > > >> >
> > > >> >     minor: Inappropriate type
> > > >> >
> > > >> > NetCDF: HDF error
> > > >> >
> > > >> > file: ncFile.cpp  line:33
> > > >> >
> > > >> >
> > > >> >
> > > >> > I used the new pcp_combine tool to create the netcdf files
so not
> > sure
> > > >> why
> > > >> > its giving me this error.
> > > >> >
> > > >> >
> > > >> > Thanks,
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Tue, Oct 24, 2017 at 5:12 PM, John Halley Gotway via RT
<
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> > > Andrew,
> > > >> > >
> > > >> > > I looked through your log installation log and don't see
any
> > errors.
> > > >> > >
> > > >> > > So here's the error message:
> > > >> > >
> > > >> > > /scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/bin/mode:
> > error
> > > >> while
> > > >> > > loading shared libraries: libnetcdf.so.6: cannot open
shared
> > object
> > > >> file:
> > > >> > > No such file or directory
> > > >> > >
> > > >> > > This is fixed by updating your LD_LIBRARY_PATH:
> > > >> > >
> > > >> > > setenv
/scratch4/BMC/dtc/MET/external_libs_intel/lib:${LD_
> > LIBRARY_
> > > >> PATH}
> > > >> > >
> > > >> > > That tells the tools where to find the external libraries
needed
> > at
> > > >> > > runtime.  I'd suggest putting that in your .cshrc.
> > > >> > >
> > > >> > > Hopefully that fixes it.
> > > >> > >
> > > >> > > John
> > > >> > >
> > > >> > > On Tue, Oct 24, 2017 at 5:19 PM, Andrew Kren - NOAA
Affiliate
> via
> > > RT <
> > > >> > > met_help at ucar.edu> wrote:
> > > >> > >
> > > >> > > >
> > > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
> >
> > > >> > > >
> > > >> > > > I got it to work with my scripts, but got this error
when
> > running:
> > > >> > > >
> > > >> > > > *** Running MODE  ***
> > > >> > > >
> > > >> > > > *** APCP02     ***
> > > >> > > >
> > > >> > > > Init Date: 2013082500
> > > >> > > >
> > > >> > > > Running 00 to 24 forecast accumulation
> > > >> > > >
> > > >> > > >
> > > >> > > > /scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/bin/mode:
> > error
> > > >> > while
> > > >> > > > loading shared libraries: libnetcdf.so.6: cannot open
shared
> > > object
> > > >> > file:
> > > >> > > > No such file or directory
> > > >> > > >
> > > >> > > > I assume its something with the LD_LIBRARY_PATH
> > > >> > > >
> > > >> > > > On Tue, Oct 24, 2017 at 2:39 PM, Andrew Kren - NOAA
Affiliate
> <
> > > >> > > > andrew.kren at noaa.gov> wrote:
> > > >> > > >
> > > >> > > > > Hi John,
> > > >> > > > >
> > > >> > > > > That seemed to work, my log file is here, let me know
if
> > errors:
> > > >> > > > > /scratch4/BMC/shout/Andrew.Kren/MET/install.log
> > > >> > > > >
> > > >> > > > > My .cshrc file in my home directory set the
LD_LIBRARY_PATH
> > > >> > previously,
> > > >> > > > > but I have it set with some IF statements, can you
check if
> my
> > > >> > current
> > > >> > > > > setting will cause issues? Also, do I need those
export
> > commnds
> > > >> in my
> > > >> > > > > .cshrc for running? I have added them.
> > > >> > > > >
> > > >> > > > > Thanks,
> > > >> > > > >
> > > >> > > > > On Tue, Oct 24, 2017 at 1:22 PM, John Halley Gotway
via RT <
> > > >> > > > > met_help at ucar.edu> wrote:
> > > >> > > > >
> > > >> > > > >> Andrew,
> > > >> > > > >>
> > > >> > > > >> Hmmm, could still be an environment issue.  To try
to rule
> > that
> > > >> > out, I
> > > >> > > > put
> > > >> > > > >> this all into a single script.  Please go to a
working
> > > directory
> > > >> and
> > > >> > > > this
> > > >> > > > >> command:
> > > >> > > > >>
> > > >> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> 20171
> > > >> > > > >> 023/install_met.sh
> > > >> > > > >>
/scratch4/BMC/dtc/John.H.Gotway/MET/MET_Help/kren_data_
> 20171
> > > >> > > > >> 023/met-6.0_bugfix.20170920.tar.gz
> > > >> > > > >> >& install.log &
> > > >> > > > >>
> > > >> > > > >> tail -f install.log # Type CNTRL-C to exit the tail
> > > >> > > > >>
> > > >> > > > >> If all goes well, that script will install met-6.0
in the
> > > current
> > > >> > > > >> directory
> > > >> > > > >> and run the test scripts.  In order to get the tools
> running
> > > from
> > > >> > the
> > > >> > > > >> command line, you'll need to update your
LD_LIBRARY_PATH
> like
> > > >> this:
> > > >> > > > >>
> > > >> > > > >> export
> > > >> > > > >> LD_LIBRARY_PATH=/scratch4/BMC/
> dtc/MET/external_libs_intel/li
> > > >> > > > >> b:${LD_LIBRARY_PATH}
> > > >> > > > >>
> > > >> > > > >> Please let me know how that goes.  If you have
problems,
> > please
> > > >> send
> > > >> > > me
> > > >> > > > >> (or
> > > >> > > > >> point me to) the "install.log" file.
> > > >> > > > >>
> > > >> > > > >> Thanks,
> > > >> > > > >> John
> > > >> > > > >>
> > > >> > > > >> On Tue, Oct 24, 2017 at 11:06 AM, Andrew Kren - NOAA
> > Affiliate
> > > >> via
> > > >> > RT
> > > >> > > <
> > > >> > > > >> met_help at ucar.edu> wrote:
> > > >> > > > >>
> > > >> > > > >> >
> > > >> > > > >> > <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=82438
> > > >> >
> > > >> > > > >> >
> > > >> > > > >> > John,
> > > >> > > > >> > I compiled and installed this morning, but got
this
> error,
> > is
> > > >> it
> > > >> > > > normal:
> > > >> > > > >> >
> > > >> > > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> libjasper.a(
> > > >> > > > >> jas_stream.o):
> > > >> > > > >> > In
> > > >> > > > >> > function `jas_stream_tmpfile':
> > > >> > > > >> >
> > > >> > > > >> >
/scratch1/portfolios/BMC/dtc/MET/MET_cross_platform_
> > > >> > > > >> >
testing/METv4.1/MET_releases/intel/external_libs/jasper/
> > > >> > > > >> > jasper-
1.900.1/src/libjasper/base/jas_stream.c:368:
> > > >> > > > >> > warning: the use of `tmpnam' is dangerous, better
use
> > > `mkstemp'
> > > >> > > > >> >
> > > >> > > > >> > /bin/ld:
> > > >> > > > >> > /scratch4/BMC/dtc/MET/external_libs_intel/lib/
> > > >> > > libjasper.a(jas_cm.o):
> > > >> > > > >> > undefined reference to symbol '__svml_pow2'
> > > >> > > > >> >
> > > >> > > > >> >
/apps/intel/composer_xe_2013_sp1.2.144/compiler/lib/
> > > >> > > > intel64/libsvml.so:
> > > >> > > > >> > error adding symbols: DSO missing from command
line
> > > >> > > > >> >
> > > >> > > > >> > collect2: error: ld returned 1 exit status
> > > >> > > > >> >
> > > >> > > > >> > make[4]: *** [ensemble_stat] Error 1
> > > >> > > > >> >
> > > >> > > > >> > make[4]: Leaving directory
> > > >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/
> > > >> > > > >> > tools/core/ensemble_stat'
> > > >> > > > >> >
> > > >> > > > >> > make[3]: *** [install-recursive] Error 1
> > > >> > > > >> >
> > > >> > > > >> > make[3]: Leaving directory
> > > >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src/
> > > >> > tools/core'
> > > >> > > > >> >
> > > >> > > > >> > make[2]: *** [install-recursive] Error 1
> > > >> > > > >> >
> > > >> > > > >> > make[2]: Leaving directory
> > > >> > > > >> >
> > > `/scratch4/BMC/shout/Andrew.Kren/MET/met-6.0_bugfix/src/tools'
> > > >> > > > >> >
> > > >> > > > >> > make[1]: *** [install-recursive] Error 1
> > > >> > > > >> >
> > > >> > > > >> > make[1]: Leaving directory
> > > >> > > > >> > `/scratch4/BMC/shout/Andrew.Kren/MET/met-
6.0_bugfix/src'
> > > >> > > > >> >
> > > >> > > > >> > make: *** [install-recursive] Error 1
> > > >> > > > >> >
> > > >> > > > >> >
> > > >> > > > >> > Thanks,
> > > >> > > > >> >
> > > >> > > > >> > On Mon, Oct 23, 2017 at 2:39 PM, Andrew Kren -
NOAA
> > > Affiliate <
> > > >> > > > >> > andrew.kren at noaa.gov> wrote:
> > > >> > > > >> >
> > > >> > > > >> > > I will try this tomorrow John and let you know
how it
> > goes.
> > > >> > > Thanks.
> > > >> > > > >> > >
> > > >> > > > >> > > On Mon, Oct 23, 2017 at 2:36 PM, John Halley
Gotway via
> > RT
> > > <
> > > >> > > > >> > > met_help at ucar.edu> wrote:
> > > >> > > > >> > >
> > > >> > > > >> > >> Andrew,
> > > >> > > > >> > >>
> > > >> > > > >> > >> OK, great.  You could consider switching to
using the
> > > >> current
> > > >> > > > >> version of
> > > >> > > > >> > >> met-6.0.
> > > >> > > > >> > >> I did try recompiling MET version 5.1 but had
> problems.
> > > So
> > > >> > I'll
> > > >> > > > list
> > > >> > > > >> > >> instructions for compiling the current 6.0
release of
> > MET.
> > > >> > > > >> > >>
> > > >> > > > >> > >> To test this out, here are the commands I ran:
> > > >> > > > >> > >>
> > > >> > > > >> > >> cd /scratch4/BMC/dtc/John.H.
> > Gotway/MET/MET_Help/kren_data_
> > > >> > > 20171023
> > > >> > > > >> > >>
> > > >> > > > >> > >> # Get latest bugfix version of code from here:
> > > >> > > > >> > >> wget
> > > >> > > > >> > >>
> > > https://dtcenter.org/met/users/downloads/MET_releases/met-6
> > > >> .
> > > >> > > > >> > >> 0_bugfix.20170920.tar.gz
> > > >> > > > >> > >>
> > > >> > > > >> > >> # Untar
> > > >> > > > >> > >> tar -xvzf met-6.0_bugfix.20170920.tar.gz
> > > >> > > > >> > >> cd met-6.0_bugfix
> > > >> > > > >> > >>
> > > >> > > > >> > >> # Configure
> > > >> > > > >> > >>
> > > >> > > > >> > >> module load intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv CC `which icc`
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv CXX `which icc`
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv F77 `which ifort`
> > > >> > > > >> > >>
> > > >> > > > >> > >> # Variables for compiling MET
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_NETCDF
> > > /scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_BUFR /scratch4/BMC/dtc/MET/
> > external_libs_intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_GSL /scratch4/BMC/dtc/MET/
> > external_libs_intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_GRIB2C
> > > /scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_HDF /scratch4/BMC/dtc/MET/
> > external_libs_intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_HDFEOS
> > > /scratch4/BMC/dtc/MET/external_libs_intel
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_CAIROINC
/scratch4/BMC/dtc/MET/external
> > > >> > > > >> > >> _libs_intel/include/cairo
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_CAIROLIB /scratch4/BMC/dtc/MET/
> > > >> > > external_libs_intel/lib
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_FREETYPEINC
> > > >> > > > >> > >>
> > > /scratch4/BMC/dtc/MET/external_libs_intel/include/freetype2
> > > >> > > > >> > >>
> > > >> > > > >> > >> setenv MET_FREETYPELIB /scratch4/BMC/dtc/MET/
> > > >> > > > external_libs_intel/lib
> > > >> > > > >> > >>
> > > >> > > > >> > >> ./configure --prefix=`pwd` --enable-grib2
> --enable-modis
> > > >> > > > >> > --enable-lidar2nc
> > > >> > > > >> > >> # Compile
> > > >> > > > >> > >> make install test
> > > >> > > > >> > >>
> > > >> > > > >> > >> Once you get it to compile... make any
necessary code
> > > >> changes
> > > >> > and
> > > >> > > > >> then
> > > >> > > > >> > >> do...
> > > >> > > > >> > >>
> > > >> > > > >> > >> make clean install
> > > >> > > > >> > >>
> > > >> > > > >> > >> On Mon, Oct 23, 2017 at 1:59 PM, Andrew Kren -
NOAA
> > > >> Affiliate
> > > >> > via
> > > >> > > > RT
> > > >> > > > >> <
> > > >> > > > >> > >> met_help at ucar.edu> wrote:
> > > >> > > > >> > >>
> > > >> > > > >> > >> >
> > > >> > > > >> > >> > <URL: https://rt.rap.ucar.edu/rt/
> > > >> > Ticket/Display.html?id=82438
> > > >> > > >
> > > >> > > > >> > >> >
> > > >> > > > >> > >> > I'm calling scripts from here on Theia.
> > > >> > > > >> > >> >
> > > >> > > > >> > >> > /scratch4/BMC/dtc/MET/met-5.1/
> > > >> > > > >> > >> >
> > > >> > > > >> > >> > On Mon, Oct 23, 2017 at 1:58 PM, John Halley
Gotway
> > via
> > > >> RT <
> > > >> > > > >> > >> > met_help at ucar.edu> wrote:
> > > >> > > > >> > >> >
> > > >> > > > >> > >> > > Andrew,
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> > > Can you remind me, did you compile MET
yourself or
> > are
> > > >> you
> > > >> > > > >> running a
> > > >> > > > >> > >> > > pre-compiled version?
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> > > If so, where are you running it?
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> > > Thanks,
> > > >> > > > >> > >> > > John
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> > > On Mon, Oct 23, 2017 at 1:34 PM, Andrew
Kren -
> NOAA
> > > >> > Affiliate
> > > >> > > > via
> > > >> > > > >> > RT <
> > > >> > > > >> > >> > > met_help at ucar.edu> wrote:
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > > >> > > > Ticket/Display.html?id=82438
> > > >> > > > >> >
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > > Thanks John. How would
> > > <https://maps.google.com/?q=%3E+%3E+%3E+%3E+Thanks+John.+
> > How+would&entry=gmail&source=g>I
> > > recompile after making that
> > > >> > > change?
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > > On Fri, Oct 20, 2017 at 4:42 PM, John
Halley
> > Gotway
> > > >> via
> > > >> > RT
> > > >> > > <
> > > >> > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > > > Andrew,
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > I see that you're running MODE to
generate a
> > large
> > > >> > number
> > > >> > > > of
> > > >> > > > >> > >> objects.
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > Looking in
src/libcode/vx_shapedata/set.h, I
> > see
> > > >> that
> > > >> > we
> > > >> > > > >> have
> > > >> > > > >> > >> > defined
> > > >> > > > >> > >> > > > hard
> > > >> > > > >> > >> > > > > upper limits:
> > > >> > > > >> > >> > > > >    static const int max_fcst_numbers =
100;
> > > >> > > > >> > >> > > > >    static const int max_obs_numbers  =
100;
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > You could change those to arbitrarily
large
> > > >> values...
> > > >> > > maybe
> > > >> > > > >> 500
> > > >> > > > >> > >> and
> > > >> > > > >> > >> > > then
> > > >> > > > >> > >> > > > > recompile.
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > However, I realize that that's less
than
> ideal.
> > > >> > Instead,
> > > >> > > > we
> > > >> > > > >> > >> should
> > > >> > > > >> > >> > > > > dynamically allocate as much memory as
> required
> > > >> rather
> > > >> > > than
> > > >> > > > >> > >> having a
> > > >> > > > >> > >> > > > fixed
> > > >> > > > >> > >> > > > > upper limit.  I'll add a development
task to
> > > update
> > > >> > this
> > > >> > > > for
> > > >> > > > >> > MODE
> > > >> > > > >> > >> in
> > > >> > > > >> > >> > a
> > > >> > > > >> > >> > > > > future release.
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > Sorry I don't have a better answer for
you.
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > Thanks,
> > > >> > > > >> > >> > > > > John Halley Gotway
> > > >> > > > >> > >> > > > > met_help at ucar.edu
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > On Thu, Oct 19, 2017 at 2:32 PM, Andrew
Kren -
> > > NOAA
> > > >> > > > Affiliate
> > > >> > > > >> > via
> > > >> > > > >> > >> RT
> > > >> > > > >> > >> > <
> > > >> > > > >> > >> > > > > met_help at ucar.edu> wrote:
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > Thu Oct 19 14:32:39 2017: Request
82438 was
> > > acted
> > > >> > upon.
> > > >> > > > >> > >> > > > > > Transaction: Ticket created by
> > > >> andrew.kren at noaa.gov
> > > >> > > > >> > >> > > > > >        Queue: met_help
> > > >> > > > >> > >> > > > > >      Subject: Error with MET
> > > >> > > > >> > >> > > > > >        Owner: Nobody
> > > >> > > > >> > >> > > > > >   Requestors: andrew.kren at noaa.gov
> > > >> > > > >> > >> > > > > >       Status: new
> > > >> > > > >> > >> > > > > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/
> > > >> > > > >> > >> > > Ticket/Display.html?id=82438
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > Hi John,
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > I am running MET Mode tool on
observation
> and
> > > >> > > > precipitation
> > > >> > > > >> > >> files.
> > > >> > > > >> > >> > I
> > > >> > > > >> > >> > > > > > noticed this one error for certain 24
hour
> > > >> forecast
> > > >> > > > >> > >> accumulation,
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 3: Applying convolution
threshold
> >=10.0
> > > >> > resulted
> > > >> > > > in
> > > >> > > > >> 242
> > > >> > > > >> > >> > simple
> > > >> > > > >> > >> > > > > > observation objects.
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
area
> > > >> threshold.
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 3: Skipping observation object
> intensity
> > > >> > > percentile
> > > >> > > > >> > >> > threshold.
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 2: Computing contingency table
> > > statistics...
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 2: Identified: 67 forecast
objects and
> > 242
> > > >> > > > >> observation
> > > >> > > > >> > >> > objects.
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH)
in the
> > > >> forecast
> > > >> > > > field.
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > DEBUG 2: Performing merging (THRESH)
in the
> > > >> > observation
> > > >> > > > >> field.
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > ERROR  :
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > ERROR  : FcstObsSet::add_obs(int) ->
too
> many
> > > obs
> > > >> > > > numbers!
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > ERROR  :
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > Do you know what is causing this? Is
there a
> > way
> > > >> to
> > > >> > fix
> > > >> > > > it?
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > Thanks,
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > > --
> > > >> > > > >> > >> > > > > > Andrew Kren
> > > >> > > > >> > >> > > > > > Research Scientist I, Global
Observing
> Systems
> > > >> > Analysis
> > > >> > > > >> (GOSA)
> > > >> > > > >> > >> > Group
> > > >> > > > >> > >> > > > > > NOAA ESRL Global Systems Division (Rm
3C515)
> > > >> > > > >> > >> > > > > > 325 Broadway, Boulder, CO 80305
> > > >> > > > >> > >> > > > > > (303) 497-5418
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > > >
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > > >
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > > --
> > > >> > > > >> > >> > > > Andrew Kren
> > > >> > > > >> > >> > > > Research Scientist I, Global Observing
Systems
> > > >> Analysis
> > > >> > > > (GOSA)
> > > >> > > > >> > Group
> > > >> > > > >> > >> > > > NOAA ESRL Global Systems Division (Rm
3C515)
> > > >> > > > >> > >> > > > 325 Broadway, Boulder, CO 80305
> > > >> > > > >> > >> > > > (303) 497-5418
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > > >
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> > >
> > > >> > > > >> > >> >
> > > >> > > > >> > >> >
> > > >> > > > >> > >> > --
> > > >> > > > >> > >> > Andrew Kren
> > > >> > > > >> > >> > Research Scientist I, Global Observing
Systems
> > Analysis
> > > >> > (GOSA)
> > > >> > > > >> Group
> > > >> > > > >> > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > > >> > >> > 325 Broadway, Boulder, CO 80305
> > > >> > > > >> > >> > (303) 497-5418
> > > >> > > > >> > >> >
> > > >> > > > >> > >> >
> > > >> > > > >> > >>
> > > >> > > > >> > >>
> > > >> > > > >> > >
> > > >> > > > >> > >
> > > >> > > > >> > > --
> > > >> > > > >> > > Andrew Kren
> > > >> > > > >> > > Research Scientist I, Global Observing Systems
Analysis
> > > >> (GOSA)
> > > >> > > Group
> > > >> > > > >> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > > >> > > 325 Broadway, Boulder, CO 80305
> > > >> > > > >> > > (303) 497-5418
> > > >> > > > >> > >
> > > >> > > > >> >
> > > >> > > > >> >
> > > >> > > > >> >
> > > >> > > > >> > --
> > > >> > > > >> > Andrew Kren
> > > >> > > > >> > Research Scientist I, Global Observing Systems
Analysis
> > > (GOSA)
> > > >> > Group
> > > >> > > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > > >> > 325 Broadway, Boulder, CO 80305
> > > >> > > > >> > (303) 497-5418
> > > >> > > > >> >
> > > >> > > > >> >
> > > >> > > > >>
> > > >> > > > >>
> > > >> > > > >
> > > >> > > > >
> > > >> > > > > --
> > > >> > > > > Andrew Kren
> > > >> > > > > Research Scientist I, Global Observing Systems
Analysis
> (GOSA)
> > > >> Group
> > > >> > > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > > > 325 Broadway, Boulder, CO 80305
> > > >> > > > > (303) 497-5418
> > > >> > > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > --
> > > >> > > > Andrew Kren
> > > >> > > > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> > > Group
> > > >> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > > > 325 Broadway, Boulder, CO 80305
> > > >> > > > (303) 497-5418
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > Andrew Kren
> > > >> > Research Scientist I, Global Observing Systems Analysis
(GOSA)
> Group
> > > >> > NOAA ESRL Global Systems Division (Rm 3C515)
> > > >> > 325 Broadway, Boulder, CO 80305
> > > >> > (303) 497-5418
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Andrew Kren
> > > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > > 325 Broadway, Boulder, CO 80305
> > > > (303) 497-5418
> > > >
> > >
> > >
> > >
> > > --
> > > Andrew Kren
> > > Research Scientist I, Global Observing Systems Analysis (GOSA)
Group
> > > NOAA ESRL Global Systems Division (Rm 3C515)
> > > 325 Broadway, Boulder, CO 80305
> > > (303) 497-5418
> > >
> > >
> >
> >
>
>
> --
> Andrew Kren
> Research Scientist I, Global Observing Systems Analysis (GOSA) Group
> NOAA ESRL Global Systems Division (Rm 3C515)
> 325 Broadway, Boulder, CO 80305
> (303) 497-5418
>
>

------------------------------------------------