[Met_help] [rt.rap.ucar.edu #93937] History for Error with ensemble analysis

John Halley Gotway via RT met_help at ucar.edu
Wed Apr 1 11:12:20 MDT 2020


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hello,

I have a problem with MET Ensemble_stat tool. Here it is:

ERROR  :
ERROR  :   AsciiTable::rc_to_n() -> range check error ...
ERROR  :                            (Nrows, Ncols) = (0, 0)
ERROR  :                            (r, c) = (0, 0)
ERROR  :


Based on what I searched, 
"http://mailman.ucar.edu/pipermail/met_help/2013-August/001985.html", 
there is a bug within.But it is is introduced in the METv4.1 release, 
why I had the problem now with MET8.1? A complete log file is under:

%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh 
 > log

What should I do on WCOSS? Thank you.

Binyu



----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Error with ensemble analysis
From: John Halley Gotway
Time: Mon Jan 27 14:22:02 2020

Binyu,

I'm taking a look at this now.  In
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I found a
call
to ensemble_stat which I assume generated the error message you got.

One thing to note, you can use the "-log logfilename" command line
option
to redirect all of the log messages to a file... including standard
out and
standard error.  That way you don't need to worry about redirecting
standard out and error to the same file.

I'm running these commands...

module use /global/noscrub/Julie.Prestopnik/modulefiles
module load met/8.1
ensemble_stat gefs_file_list_00z_000
verf_g2g_ens_stat_regn_config_ndas
-grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log

Since I didn't know what you're REFERENCE was, I just used data for
the
first ensemble member:
export REFERENCE=`head -1 gefs_file_list_00z_000`

But the underlying problem is that you're running Ensemble-Stat but
passing
as input a Grid-Stat config file.

Before running Ensemble-Stat, you should copy over the default config
file
and edit it:
cp
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
EnsembleStatConfig

Thanks,
John

On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
> Transaction: Ticket created by binyu.wang at noaa.gov
>        Queue: met_help
>      Subject: Error with ensemble analysis
>        Owner: Nobody
>   Requestors: binyu.wang at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>
>
> Hello,
>
> I have a problem with MET Ensemble_stat tool. Here it is:
>
> ERROR  :
> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
> ERROR  :                            (Nrows, Ncols) = (0, 0)
> ERROR  :                            (r, c) = (0, 0)
> ERROR  :
>
>
> Based on what I searched,
> "http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html",
> there is a bug within.But it is is introduced in the METv4.1
release,
> why I had the problem now with MET8.1? A complete log file is under:
>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
>  > log
>
> What should I do on WCOSS? Thank you.
>
> Binyu
>
>
>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #93937] Error with ensemble analysis
From: binyu.wang at noaa.gov
Time: Tue Jan 28 08:47:19 2020

Hello John,

Thank you very much for your quick response. I am sorry  I didn't make
it clear in my previous email. My working directory is

%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,

Below is what I did to get the log file, and the error message is
inside
of the log file.

%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
 > log

Thank you for your help.

BInyu

On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
> Binyu,
>
> I'm taking a look at this now.  In
> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I found a
call
> to ensemble_stat which I assume generated the error message you got.
>
> One thing to note, you can use the "-log logfilename" command line
option
> to redirect all of the log messages to a file... including standard
out and
> standard error.  That way you don't need to worry about redirecting
> standard out and error to the same file.
>
> I'm running these commands...
>
> module use /global/noscrub/Julie.Prestopnik/modulefiles
> module load met/8.1
> ensemble_stat gefs_file_list_00z_000
verf_g2g_ens_stat_regn_config_ndas
> -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
>
> Since I didn't know what you're REFERENCE was, I just used data for
the
> first ensemble member:
> export REFERENCE=`head -1 gefs_file_list_00z_000`
>
> But the underlying problem is that you're running Ensemble-Stat but
passing
> as input a Grid-Stat config file.
>
> Before running Ensemble-Stat, you should copy over the default
config file
> and edit it:
> cp
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
> EnsembleStatConfig
>
> Thanks,
> John
>
> On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
>> Transaction: Ticket created by binyu.wang at noaa.gov
>>         Queue: met_help
>>       Subject: Error with ensemble analysis
>>         Owner: Nobody
>>    Requestors: binyu.wang at noaa.gov
>>        Status: new
>>   Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>>
>>
>> Hello,
>>
>> I have a problem with MET Ensemble_stat tool. Here it is:
>>
>> ERROR  :
>> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
>> ERROR  :                            (Nrows, Ncols) = (0, 0)
>> ERROR  :                            (r, c) = (0, 0)
>> ERROR  :
>>
>>
>> Based on what I searched,
>> "http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html",
>> there is a bug within.But it is is introduced in the METv4.1
release,
>> why I had the problem now with MET8.1? A complete log file is
under:
>>
>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
>>   > log
>>
>> What should I do on WCOSS? Thank you.
>>
>> Binyu
>>
>>
>>

------------------------------------------------
Subject: Error with ensemble analysis
From: John Halley Gotway
Time: Tue Jan 28 14:12:41 2020

Binyu,

OK, I was able to figure this out and know what needs to be fixed.
I'll
fix in the next beta release for met-9.0 (met-9.0_beta3).

Here's how you can fix it now... edit your Ensemble-Stat config file:
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*

Move the setting for "TMP/P850" up to being the first field in the
list.

When processing the "first" field in the "fcst.field" list, Ensemble-
Stat
initializes the output files.  However, your observation file contains
no
data for "TMP/Z2".  So there are zero pairs and it doesn't initialize
the
output files correctly.  Your observations do contain data for
"TMP/P850"
so putting that first in the list causes the output files to be
initialized
correctly.

I'll work on a fix for this.

Thanks,
John


On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>
> Hello John,
>
> Thank you very much for your quick response. I am sorry  I didn't
make
> it clear in my previous email. My working directory is
>
> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
>
> Below is what I did to get the log file, and the error message is
inside
> of the log file.
>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
>  > log
>
> Thank you for your help.
>
> BInyu
>
> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
> > Binyu,
> >
> > I'm taking a look at this now.  In
> > /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I found
a call
> > to ensemble_stat which I assume generated the error message you
got.
> >
> > One thing to note, you can use the "-log logfilename" command line
option
> > to redirect all of the log messages to a file... including
standard out
> and
> > standard error.  That way you don't need to worry about
redirecting
> > standard out and error to the same file.
> >
> > I'm running these commands...
> >
> > module use /global/noscrub/Julie.Prestopnik/modulefiles
> > module load met/8.1
> > ensemble_stat gefs_file_list_00z_000
verf_g2g_ens_stat_regn_config_ndas
> > -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
> >
> > Since I didn't know what you're REFERENCE was, I just used data
for the
> > first ensemble member:
> > export REFERENCE=`head -1 gefs_file_list_00z_000`
> >
> > But the underlying problem is that you're running Ensemble-Stat
but
> passing
> > as input a Grid-Stat config file.
> >
> > Before running Ensemble-Stat, you should copy over the default
config
> file
> > and edit it:
> > cp
>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
> > EnsembleStatConfig
> >
> > Thanks,
> > John
> >
> > On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
> >> Transaction: Ticket created by binyu.wang at noaa.gov
> >>         Queue: met_help
> >>       Subject: Error with ensemble analysis
> >>         Owner: Nobody
> >>    Requestors: binyu.wang at noaa.gov
> >>        Status: new
> >>   Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
> >
> >>
> >>
> >> Hello,
> >>
> >> I have a problem with MET Ensemble_stat tool. Here it is:
> >>
> >> ERROR  :
> >> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
> >> ERROR  :                            (Nrows, Ncols) = (0, 0)
> >> ERROR  :                            (r, c) = (0, 0)
> >> ERROR  :
> >>
> >>
> >> Based on what I searched,
> >> "http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html",
> >> there is a bug within.But it is is introduced in the METv4.1
release,
> >> why I had the problem now with MET8.1? A complete log file is
under:
> >>
> >>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
> >>   > log
> >>
> >> What should I do on WCOSS? Thank you.
> >>
> >> Binyu
> >>
> >>
> >>
>
>

------------------------------------------------
Subject: Error with ensemble analysis
From: John Halley Gotway
Time: Tue Jan 28 14:30:21 2020

FYI, the fix was a one-liner, which I documented here:
https://github.com/NCAR/MET/issues/1242

It'll be included in met-9.0_beta3, but just changing the order of
fields
will get around this issue for now.

Thanks,
John

On Tue, Jan 28, 2020 at 2:12 PM John Halley Gotway <johnhg at ucar.edu>
wrote:

> Binyu,
>
> OK, I was able to figure this out and know what needs to be fixed.
I'll
> fix in the next beta release for met-9.0 (met-9.0_beta3).
>
> Here's how you can fix it now... edit your Ensemble-Stat config
file:
>
>
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*
>
> Move the setting for "TMP/P850" up to being the first field in the
list.
>
> When processing the "first" field in the "fcst.field" list,
Ensemble-Stat
> initializes the output files.  However, your observation file
contains no
> data for "TMP/Z2".  So there are zero pairs and it doesn't
initialize the
> output files correctly.  Your observations do contain data for
"TMP/P850"
> so putting that first in the list causes the output files to be
initialized
> correctly.
>
> I'll work on a fix for this.
>
> Thanks,
> John
>
>
> On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>>
>> Hello John,
>>
>> Thank you very much for your quick response. I am sorry  I didn't
make
>> it clear in my previous email. My working directory is
>>
>> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
>>
>> Below is what I did to get the log file, and the error message is
inside
>> of the log file.
>>
>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
>>
>>  > log
>>
>> Thank you for your help.
>>
>> BInyu
>>
>> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
>> > Binyu,
>> >
>> > I'm taking a look at this now.  In
>> > /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I
found a
>> call
>> > to ensemble_stat which I assume generated the error message you
got.
>> >
>> > One thing to note, you can use the "-log logfilename" command
line
>> option
>> > to redirect all of the log messages to a file... including
standard out
>> and
>> > standard error.  That way you don't need to worry about
redirecting
>> > standard out and error to the same file.
>> >
>> > I'm running these commands...
>> >
>> > module use /global/noscrub/Julie.Prestopnik/modulefiles
>> > module load met/8.1
>> > ensemble_stat gefs_file_list_00z_000
verf_g2g_ens_stat_regn_config_ndas
>> > -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
>> >
>> > Since I didn't know what you're REFERENCE was, I just used data
for the
>> > first ensemble member:
>> > export REFERENCE=`head -1 gefs_file_list_00z_000`
>> >
>> > But the underlying problem is that you're running Ensemble-Stat
but
>> passing
>> > as input a Grid-Stat config file.
>> >
>> > Before running Ensemble-Stat, you should copy over the default
config
>> file
>> > and edit it:
>> > cp
>>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
>> > EnsembleStatConfig
>> >
>> > Thanks,
>> > John
>> >
>> > On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> >> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
>> >> Transaction: Ticket created by binyu.wang at noaa.gov
>> >>         Queue: met_help
>> >>       Subject: Error with ensemble analysis
>> >>         Owner: Nobody
>> >>    Requestors: binyu.wang at noaa.gov
>> >>        Status: new
>> >>   Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
>> >
>> >>
>> >>
>> >> Hello,
>> >>
>> >> I have a problem with MET Ensemble_stat tool. Here it is:
>> >>
>> >> ERROR  :
>> >> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
>> >> ERROR  :                            (Nrows, Ncols) = (0, 0)
>> >> ERROR  :                            (r, c) = (0, 0)
>> >> ERROR  :
>> >>
>> >>
>> >> Based on what I searched,
>> >> "http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html",
>> >> there is a bug within.But it is is introduced in the METv4.1
release,
>> >> why I had the problem now with MET8.1? A complete log file is
under:
>> >>
>> >>
>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
>> >>   > log
>> >>
>> >> What should I do on WCOSS? Thank you.
>> >>
>> >> Binyu
>> >>
>> >>
>> >>
>>
>>

------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #93937] Error with ensemble analysis
From: binyu.wang at noaa.gov
Time: Wed Jan 29 09:05:19 2020

Hello John,

Thank you very much for your quick help. The error message is gone
after
I remove the variables which are not existed in my data from configure
file. However I got new error when I tried to load the database.
Please
see the error below:

cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs

[Binyu.Wang at m71a2 Gefs]$ ./run_g2g_met_verf_gefs.sh
CALLING: cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
CALLING: scp -r ./* binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
scp: //data/mv_data/binyu.wang: No such file or directory
ERROR: Command returned with non-zero status (1): scp -r ./*
binyu.wang at 205.156.8.85://data/mv_data/binyu.wang

Binbin Zhou had kindly offer help by trying the same test under his
account; and he didn't have any problem to run the above script. Any
idea with this error? Thank you.

Binyu

On 1/28/2020 4:30 PM, John Halley Gotway via RT wrote:
> FYI, the fix was a one-liner, which I documented here:
> https://github.com/NCAR/MET/issues/1242
>
> It'll be included in met-9.0_beta3, but just changing the order of
fields
> will get around this issue for now.
>
> Thanks,
> John
>
> On Tue, Jan 28, 2020 at 2:12 PM John Halley Gotway <johnhg at ucar.edu>
wrote:
>> Binyu,
>>
>> OK, I was able to figure this out and know what needs to be fixed.
I'll
>> fix in the next beta release for met-9.0 (met-9.0_beta3).
>>
>> Here's how you can fix it now... edit your Ensemble-Stat config
file:
>>
>>
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*
>>
>> Move the setting for "TMP/P850" up to being the first field in the
list.
>>
>> When processing the "first" field in the "fcst.field" list,
Ensemble-Stat
>> initializes the output files.  However, your observation file
contains no
>> data for "TMP/Z2".  So there are zero pairs and it doesn't
initialize the
>> output files correctly.  Your observations do contain data for
"TMP/P850"
>> so putting that first in the list causes the output files to be
initialized
>> correctly.
>>
>> I'll work on a fix for this.
>>
>> Thanks,
>> John
>>
>>
>> On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>>>
>>> Hello John,
>>>
>>> Thank you very much for your quick response. I am sorry  I didn't
make
>>> it clear in my previous email. My working directory is
>>>
>>> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
>>>
>>> Below is what I did to get the log file, and the error message is
inside
>>> of the log file.
>>>
>>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
>>>
>>>   > log
>>>
>>> Thank you for your help.
>>>
>>> BInyu
>>>
>>> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
>>>> Binyu,
>>>>
>>>> I'm taking a look at this now.  In
>>>> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I
found a
>>> call
>>>> to ensemble_stat which I assume generated the error message you
got.
>>>>
>>>> One thing to note, you can use the "-log logfilename" command
line
>>> option
>>>> to redirect all of the log messages to a file... including
standard out
>>> and
>>>> standard error.  That way you don't need to worry about
redirecting
>>>> standard out and error to the same file.
>>>>
>>>> I'm running these commands...
>>>>
>>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
>>>> module load met/8.1
>>>> ensemble_stat gefs_file_list_00z_000
verf_g2g_ens_stat_regn_config_ndas
>>>> -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
>>>>
>>>> Since I didn't know what you're REFERENCE was, I just used data
for the
>>>> first ensemble member:
>>>> export REFERENCE=`head -1 gefs_file_list_00z_000`
>>>>
>>>> But the underlying problem is that you're running Ensemble-Stat
but
>>> passing
>>>> as input a Grid-Stat config file.
>>>>
>>>> Before running Ensemble-Stat, you should copy over the default
config
>>> file
>>>> and edit it:
>>>> cp
>>>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
>>>> EnsembleStatConfig
>>>>
>>>> Thanks,
>>>> John
>>>>
>>>> On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
>>>> met_help at ucar.edu> wrote:
>>>>
>>>>> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
>>>>> Transaction: Ticket created by binyu.wang at noaa.gov
>>>>>          Queue: met_help
>>>>>        Subject: Error with ensemble analysis
>>>>>          Owner: Nobody
>>>>>     Requestors: binyu.wang at noaa.gov
>>>>>         Status: new
>>>>>    Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
>>>>>
>>>>> Hello,
>>>>>
>>>>> I have a problem with MET Ensemble_stat tool. Here it is:
>>>>>
>>>>> ERROR  :
>>>>> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
>>>>> ERROR  :                            (Nrows, Ncols) = (0, 0)
>>>>> ERROR  :                            (r, c) = (0, 0)
>>>>> ERROR  :
>>>>>
>>>>>
>>>>> Based on what I searched,
>>>>> "http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html",
>>>>> there is a bug within.But it is is introduced in the METv4.1
release,
>>>>> why I had the problem now with MET8.1? A complete log file is
under:
>>>>>
>>>>>
>>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
>>>>>    > log
>>>>>
>>>>> What should I do on WCOSS? Thank you.
>>>>>
>>>>> Binyu
>>>>>
>>>>>
>>>>>
>>>

------------------------------------------------
Subject: Error with ensemble analysis
From: binyu.wang at noaa.gov
Time: Mon Feb 10 12:28:13 2020

Hello, I wondered if there is any update on my previous question
(1/29). If
it is not easy to simulate, maybe I can meet one of your experts next
week
during your visit?  I also had another question assigned to John
(#94051),
so maybe I will put the request to meet with John?

Thank you.
Binyu

On Wed, Jan 29, 2020 at 11:05 AM Binyu NMN. Wang <binyu.wang at noaa.gov>
wrote:

> Hello John,
>
> Thank you very much for your quick help. The error message is gone
after
> I remove the variables which are not existed in my data from
configure
> file. However I got new error when I tried to load the database.
Please
> see the error below:
>
> cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
>
> [Binyu.Wang at m71a2 Gefs]$ ./run_g2g_met_verf_gefs.sh
> CALLING: cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
> CALLING: scp -r ./*
binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
> scp: //data/mv_data/binyu.wang: No such file or directory
> ERROR: Command returned with non-zero status (1): scp -r ./*
> binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
>
> Binbin Zhou had kindly offer help by trying the same test under his
> account; and he didn't have any problem to run the above script. Any
> idea with this error? Thank you.
>
> Binyu
>
> On 1/28/2020 4:30 PM, John Halley Gotway via RT wrote:
> > FYI, the fix was a one-liner, which I documented here:
> > https://github.com/NCAR/MET/issues/1242
> >
> > It'll be included in met-9.0_beta3, but just changing the order of
fields
> > will get around this issue for now.
> >
> > Thanks,
> > John
> >
> > On Tue, Jan 28, 2020 at 2:12 PM John Halley Gotway
<johnhg at ucar.edu>
> wrote:
> >> Binyu,
> >>
> >> OK, I was able to figure this out and know what needs to be
fixed.  I'll
> >> fix in the next beta release for met-9.0 (met-9.0_beta3).
> >>
> >> Here's how you can fix it now... edit your Ensemble-Stat config
file:
> >>
> >>
>
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*
> >>
> >> Move the setting for "TMP/P850" up to being the first field in
the list.
> >>
> >> When processing the "first" field in the "fcst.field" list,
> Ensemble-Stat
> >> initializes the output files.  However, your observation file
contains
> no
> >> data for "TMP/Z2".  So there are zero pairs and it doesn't
initialize
> the
> >> output files correctly.  Your observations do contain data for
> "TMP/P850"
> >> so putting that first in the list causes the output files to be
> initialized
> >> correctly.
> >>
> >> I'll work on a fix for this.
> >>
> >> Thanks,
> >> John
> >>
> >>
> >> On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
> >>>
> >>> Hello John,
> >>>
> >>> Thank you very much for your quick response. I am sorry  I
didn't make
> >>> it clear in my previous email. My working directory is
> >>>
> >>> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
> >>>
> >>> Below is what I did to get the log file, and the error message
is
> inside
> >>> of the log file.
> >>>
> >>>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
> >>>
> >>>   > log
> >>>
> >>> Thank you for your help.
> >>>
> >>> BInyu
> >>>
> >>> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
> >>>> Binyu,
> >>>>
> >>>> I'm taking a look at this now.  In
> >>>> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I
found a
> >>> call
> >>>> to ensemble_stat which I assume generated the error message you
got.
> >>>>
> >>>> One thing to note, you can use the "-log logfilename" command
line
> >>> option
> >>>> to redirect all of the log messages to a file... including
standard
> out
> >>> and
> >>>> standard error.  That way you don't need to worry about
redirecting
> >>>> standard out and error to the same file.
> >>>>
> >>>> I'm running these commands...
> >>>>
> >>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
> >>>> module load met/8.1
> >>>> ensemble_stat gefs_file_list_00z_000
> verf_g2g_ens_stat_regn_config_ndas
> >>>> -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
> >>>>
> >>>> Since I didn't know what you're REFERENCE was, I just used data
for
> the
> >>>> first ensemble member:
> >>>> export REFERENCE=`head -1 gefs_file_list_00z_000`
> >>>>
> >>>> But the underlying problem is that you're running Ensemble-Stat
but
> >>> passing
> >>>> as input a Grid-Stat config file.
> >>>>
> >>>> Before running Ensemble-Stat, you should copy over the default
config
> >>> file
> >>>> and edit it:
> >>>> cp
> >>>
>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
> >>>> EnsembleStatConfig
> >>>>
> >>>> Thanks,
> >>>> John
> >>>>
> >>>> On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
> >>>> met_help at ucar.edu> wrote:
> >>>>
> >>>>> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
> >>>>> Transaction: Ticket created by binyu.wang at noaa.gov
> >>>>>          Queue: met_help
> >>>>>        Subject: Error with ensemble analysis
> >>>>>          Owner: Nobody
> >>>>>     Requestors: binyu.wang at noaa.gov
> >>>>>         Status: new
> >>>>>    Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
> >>>>>
> >>>>> Hello,
> >>>>>
> >>>>> I have a problem with MET Ensemble_stat tool. Here it is:
> >>>>>
> >>>>> ERROR  :
> >>>>> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
> >>>>> ERROR  :                            (Nrows, Ncols) = (0, 0)
> >>>>> ERROR  :                            (r, c) = (0, 0)
> >>>>> ERROR  :
> >>>>>
> >>>>>
> >>>>> Based on what I searched,
> >>>>> "http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html
> ",
> >>>>> there is a bug within.But it is is introduced in the METv4.1
release,
> >>>>> why I had the problem now with MET8.1? A complete log file is
under:
> >>>>>
> >>>>>
> >>>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
> >>>>>    > log
> >>>>>
> >>>>> What should I do on WCOSS? Thank you.
> >>>>>
> >>>>> Binyu
> >>>>>
> >>>>>
> >>>>>
> >>>
>

------------------------------------------------
Subject: Error with ensemble analysis
From: John Halley Gotway
Time: Thu Feb 13 15:22:40 2020

Hi Binyu,

My sincere apologies for letting these issues sit for so long.  I did
get
the meeting invitation and look forward to meeting with you next week.

I just logged on to WCOSS, will take a look at the two issues you
sent, and
will let you know what I find before I leave today.

Thanks,
John

On Mon, Feb 10, 2020 at 12:28 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>
> Hello, I wondered if there is any update on my previous question
(1/29). If
> it is not easy to simulate, maybe I can meet one of your experts
next week
> during your visit?  I also had another question assigned to John
(#94051),
> so maybe I will put the request to meet with John?
>
> Thank you.
> Binyu
>
> On Wed, Jan 29, 2020 at 11:05 AM Binyu NMN. Wang
<binyu.wang at noaa.gov>
> wrote:
>
> > Hello John,
> >
> > Thank you very much for your quick help. The error message is gone
after
> > I remove the variables which are not existed in my data from
configure
> > file. However I got new error when I tried to load the database.
Please
> > see the error below:
> >
> > cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
> >
> > [Binyu.Wang at m71a2 Gefs]$ ./run_g2g_met_verf_gefs.sh
> > CALLING: cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
> > CALLING: scp -r ./*
binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
> > scp: //data/mv_data/binyu.wang: No such file or directory
> > ERROR: Command returned with non-zero status (1): scp -r ./*
> > binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
> >
> > Binbin Zhou had kindly offer help by trying the same test under
his
> > account; and he didn't have any problem to run the above script.
Any
> > idea with this error? Thank you.
> >
> > Binyu
> >
> > On 1/28/2020 4:30 PM, John Halley Gotway via RT wrote:
> > > FYI, the fix was a one-liner, which I documented here:
> > > https://github.com/NCAR/MET/issues/1242
> > >
> > > It'll be included in met-9.0_beta3, but just changing the order
of
> fields
> > > will get around this issue for now.
> > >
> > > Thanks,
> > > John
> > >
> > > On Tue, Jan 28, 2020 at 2:12 PM John Halley Gotway
<johnhg at ucar.edu>
> > wrote:
> > >> Binyu,
> > >>
> > >> OK, I was able to figure this out and know what needs to be
fixed.
> I'll
> > >> fix in the next beta release for met-9.0 (met-9.0_beta3).
> > >>
> > >> Here's how you can fix it now... edit your Ensemble-Stat config
file:
> > >>
> > >>
> >
>
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*
> > >>
> > >> Move the setting for "TMP/P850" up to being the first field in
the
> list.
> > >>
> > >> When processing the "first" field in the "fcst.field" list,
> > Ensemble-Stat
> > >> initializes the output files.  However, your observation file
contains
> > no
> > >> data for "TMP/Z2".  So there are zero pairs and it doesn't
initialize
> > the
> > >> output files correctly.  Your observations do contain data for
> > "TMP/P850"
> > >> so putting that first in the list causes the output files to be
> > initialized
> > >> correctly.
> > >>
> > >> I'll work on a fix for this.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >>
> > >> On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
>
> > >>>
> > >>> Hello John,
> > >>>
> > >>> Thank you very much for your quick response. I am sorry  I
didn't
> make
> > >>> it clear in my previous email. My working directory is
> > >>>
> > >>> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
> > >>>
> > >>> Below is what I did to get the log file, and the error message
is
> > inside
> > >>> of the log file.
> > >>>
> > >>>
> >
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
> > >>>
> > >>>   > log
> > >>>
> > >>> Thank you for your help.
> > >>>
> > >>> BInyu
> > >>>
> > >>> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
> > >>>> Binyu,
> > >>>>
> > >>>> I'm taking a look at this now.  In
> > >>>> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I
found a
> > >>> call
> > >>>> to ensemble_stat which I assume generated the error message
you got.
> > >>>>
> > >>>> One thing to note, you can use the "-log logfilename" command
line
> > >>> option
> > >>>> to redirect all of the log messages to a file... including
standard
> > out
> > >>> and
> > >>>> standard error.  That way you don't need to worry about
redirecting
> > >>>> standard out and error to the same file.
> > >>>>
> > >>>> I'm running these commands...
> > >>>>
> > >>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
> > >>>> module load met/8.1
> > >>>> ensemble_stat gefs_file_list_00z_000
> > verf_g2g_ens_stat_regn_config_ndas
> > >>>> -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
> > >>>>
> > >>>> Since I didn't know what you're REFERENCE was, I just used
data for
> > the
> > >>>> first ensemble member:
> > >>>> export REFERENCE=`head -1 gefs_file_list_00z_000`
> > >>>>
> > >>>> But the underlying problem is that you're running Ensemble-
Stat but
> > >>> passing
> > >>>> as input a Grid-Stat config file.
> > >>>>
> > >>>> Before running Ensemble-Stat, you should copy over the
default
> config
> > >>> file
> > >>>> and edit it:
> > >>>> cp
> > >>>
> >
>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
> > >>>> EnsembleStatConfig
> > >>>>
> > >>>> Thanks,
> > >>>> John
> > >>>>
> > >>>> On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT <
> > >>>> met_help at ucar.edu> wrote:
> > >>>>
> > >>>>> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
> > >>>>> Transaction: Ticket created by binyu.wang at noaa.gov
> > >>>>>          Queue: met_help
> > >>>>>        Subject: Error with ensemble analysis
> > >>>>>          Owner: Nobody
> > >>>>>     Requestors: binyu.wang at noaa.gov
> > >>>>>         Status: new
> > >>>>>    Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
> > >>>>>
> > >>>>> Hello,
> > >>>>>
> > >>>>> I have a problem with MET Ensemble_stat tool. Here it is:
> > >>>>>
> > >>>>> ERROR  :
> > >>>>> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
> > >>>>> ERROR  :                            (Nrows, Ncols) = (0, 0)
> > >>>>> ERROR  :                            (r, c) = (0, 0)
> > >>>>> ERROR  :
> > >>>>>
> > >>>>>
> > >>>>> Based on what I searched,
> > >>>>> "
> http://mailman.ucar.edu/pipermail/met_help/2013-August/001985.html
> > ",
> > >>>>> there is a bug within.But it is is introduced in the METv4.1
> release,
> > >>>>> why I had the problem now with MET8.1? A complete log file
is
> under:
> > >>>>>
> > >>>>>
> > >>>
> >
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
> > >>>>>    > log
> > >>>>>
> > >>>>> What should I do on WCOSS? Thank you.
> > >>>>>
> > >>>>> Binyu
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>
> >
>
>

------------------------------------------------
Subject: Error with ensemble analysis
From: John Halley Gotway
Time: Thu Feb 13 15:42:54 2020

Binyu,

Do you still have any remaining questions on this ticket?  Or were you
just
stuck on the Ensemble-Stat error from #94051?

Thanks,
John

On Thu, Feb 13, 2020 at 3:22 PM John Halley Gotway <johnhg at ucar.edu>
wrote:

> Hi Binyu,
>
> My sincere apologies for letting these issues sit for so long.  I
did get
> the meeting invitation and look forward to meeting with you next
week.
>
> I just logged on to WCOSS, will take a look at the two issues you
sent,
> and will let you know what I find before I leave today.
>
> Thanks,
> John
>
> On Mon, Feb 10, 2020 at 12:28 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
>>
>> Hello, I wondered if there is any update on my previous question
(1/29).
>> If
>> it is not easy to simulate, maybe I can meet one of your experts
next week
>> during your visit?  I also had another question assigned to John
(#94051),
>> so maybe I will put the request to meet with John?
>>
>> Thank you.
>> Binyu
>>
>> On Wed, Jan 29, 2020 at 11:05 AM Binyu NMN. Wang
<binyu.wang at noaa.gov>
>> wrote:
>>
>> > Hello John,
>> >
>> > Thank you very much for your quick help. The error message is
gone after
>> > I remove the variables which are not existed in my data from
configure
>> > file. However I got new error when I tried to load the database.
Please
>> > see the error below:
>> >
>> > cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
>> >
>> > [Binyu.Wang at m71a2 Gefs]$ ./run_g2g_met_verf_gefs.sh
>> > CALLING: cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
>> > CALLING: scp -r ./*
binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
>> > scp: //data/mv_data/binyu.wang: No such file or directory
>> > ERROR: Command returned with non-zero status (1): scp -r ./*
>> > binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
>> >
>> > Binbin Zhou had kindly offer help by trying the same test under
his
>> > account; and he didn't have any problem to run the above script.
Any
>> > idea with this error? Thank you.
>> >
>> > Binyu
>> >
>> > On 1/28/2020 4:30 PM, John Halley Gotway via RT wrote:
>> > > FYI, the fix was a one-liner, which I documented here:
>> > > https://github.com/NCAR/MET/issues/1242
>> > >
>> > > It'll be included in met-9.0_beta3, but just changing the order
of
>> fields
>> > > will get around this issue for now.
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > > On Tue, Jan 28, 2020 at 2:12 PM John Halley Gotway
<johnhg at ucar.edu>
>> > wrote:
>> > >> Binyu,
>> > >>
>> > >> OK, I was able to figure this out and know what needs to be
fixed.
>> I'll
>> > >> fix in the next beta release for met-9.0 (met-9.0_beta3).
>> > >>
>> > >> Here's how you can fix it now... edit your Ensemble-Stat
config file:
>> > >>
>> > >>
>> >
>>
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*
>> > >>
>> > >> Move the setting for "TMP/P850" up to being the first field in
the
>> list.
>> > >>
>> > >> When processing the "first" field in the "fcst.field" list,
>> > Ensemble-Stat
>> > >> initializes the output files.  However, your observation file
>> contains
>> > no
>> > >> data for "TMP/Z2".  So there are zero pairs and it doesn't
initialize
>> > the
>> > >> output files correctly.  Your observations do contain data for
>> > "TMP/P850"
>> > >> so putting that first in the list causes the output files to
be
>> > initialized
>> > >> correctly.
>> > >>
>> > >> I'll work on a fix for this.
>> > >>
>> > >> Thanks,
>> > >> John
>> > >>
>> > >>
>> > >> On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
>> > >> met_help at ucar.edu> wrote:
>> > >>
>> > >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
>
>> > >>>
>> > >>> Hello John,
>> > >>>
>> > >>> Thank you very much for your quick response. I am sorry  I
didn't
>> make
>> > >>> it clear in my previous email. My working directory is
>> > >>>
>> > >>> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
>> > >>>
>> > >>> Below is what I did to get the log file, and the error
message is
>> > inside
>> > >>> of the log file.
>> > >>>
>> > >>>
>> >
>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
>> > >>>
>> > >>>   > log
>> > >>>
>> > >>> Thank you for your help.
>> > >>>
>> > >>> BInyu
>> > >>>
>> > >>> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
>> > >>>> Binyu,
>> > >>>>
>> > >>>> I'm taking a look at this now.  In
>> > >>>> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error I
found
>> a
>> > >>> call
>> > >>>> to ensemble_stat which I assume generated the error message
you
>> got.
>> > >>>>
>> > >>>> One thing to note, you can use the "-log logfilename"
command line
>> > >>> option
>> > >>>> to redirect all of the log messages to a file... including
standard
>> > out
>> > >>> and
>> > >>>> standard error.  That way you don't need to worry about
redirecting
>> > >>>> standard out and error to the same file.
>> > >>>>
>> > >>>> I'm running these commands...
>> > >>>>
>> > >>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
>> > >>>> module load met/8.1
>> > >>>> ensemble_stat gefs_file_list_00z_000
>> > verf_g2g_ens_stat_regn_config_ndas
>> > >>>> -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
>> > >>>>
>> > >>>> Since I didn't know what you're REFERENCE was, I just used
data for
>> > the
>> > >>>> first ensemble member:
>> > >>>> export REFERENCE=`head -1 gefs_file_list_00z_000`
>> > >>>>
>> > >>>> But the underlying problem is that you're running Ensemble-
Stat but
>> > >>> passing
>> > >>>> as input a Grid-Stat config file.
>> > >>>>
>> > >>>> Before running Ensemble-Stat, you should copy over the
default
>> config
>> > >>> file
>> > >>>> and edit it:
>> > >>>> cp
>> > >>>
>> >
>>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
>> > >>>> EnsembleStatConfig
>> > >>>>
>> > >>>> Thanks,
>> > >>>> John
>> > >>>>
>> > >>>> On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via RT
<
>> > >>>> met_help at ucar.edu> wrote:
>> > >>>>
>> > >>>>> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
>> > >>>>> Transaction: Ticket created by binyu.wang at noaa.gov
>> > >>>>>          Queue: met_help
>> > >>>>>        Subject: Error with ensemble analysis
>> > >>>>>          Owner: Nobody
>> > >>>>>     Requestors: binyu.wang at noaa.gov
>> > >>>>>         Status: new
>> > >>>>>    Ticket <URL:
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
>> > >>>>>
>> > >>>>> Hello,
>> > >>>>>
>> > >>>>> I have a problem with MET Ensemble_stat tool. Here it is:
>> > >>>>>
>> > >>>>> ERROR  :
>> > >>>>> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
>> > >>>>> ERROR  :                            (Nrows, Ncols) = (0, 0)
>> > >>>>> ERROR  :                            (r, c) = (0, 0)
>> > >>>>> ERROR  :
>> > >>>>>
>> > >>>>>
>> > >>>>> Based on what I searched,
>> > >>>>> "
>> http://mailman.ucar.edu/pipermail/met_help/2013-August/001985.html
>> > ",
>> > >>>>> there is a bug within.But it is is introduced in the
METv4.1
>> release,
>> > >>>>> why I had the problem now with MET8.1? A complete log file
is
>> under:
>> > >>>>>
>> > >>>>>
>> > >>>
>> >
>>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
>> > >>>>>    > log
>> > >>>>>
>> > >>>>> What should I do on WCOSS? Thank you.
>> > >>>>>
>> > >>>>> Binyu
>> > >>>>>
>> > >>>>>
>> > >>>>>
>> > >>>
>> >
>>
>>

------------------------------------------------
Subject: Error with ensemble analysis
From: binyu.wang at noaa.gov
Time: Mon Feb 17 14:08:05 2020

Hello John,

This one is different with  #94051. I will show you the error when we
meet
on Tuesday. Thank you.

Binyu

On Thu, Feb 13, 2020 at 5:42 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:

> Binyu,
>
> Do you still have any remaining questions on this ticket?  Or were
you just
> stuck on the Ensemble-Stat error from #94051?
>
> Thanks,
> John
>
> On Thu, Feb 13, 2020 at 3:22 PM John Halley Gotway <johnhg at ucar.edu>
> wrote:
>
> > Hi Binyu,
> >
> > My sincere apologies for letting these issues sit for so long.  I
did get
> > the meeting invitation and look forward to meeting with you next
week.
> >
> > I just logged on to WCOSS, will take a look at the two issues you
sent,
> > and will let you know what I find before I leave today.
> >
> > Thanks,
> > John
> >
> > On Mon, Feb 10, 2020 at 12:28 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
> >>
> >> Hello, I wondered if there is any update on my previous question
(1/29).
> >> If
> >> it is not easy to simulate, maybe I can meet one of your experts
next
> week
> >> during your visit?  I also had another question assigned to John
> (#94051),
> >> so maybe I will put the request to meet with John?
> >>
> >> Thank you.
> >> Binyu
> >>
> >> On Wed, Jan 29, 2020 at 11:05 AM Binyu NMN. Wang
<binyu.wang at noaa.gov>
> >> wrote:
> >>
> >> > Hello John,
> >> >
> >> > Thank you very much for your quick help. The error message is
gone
> after
> >> > I remove the variables which are not existed in my data from
configure
> >> > file. However I got new error when I tried to load the
database.
> Please
> >> > see the error below:
> >> >
> >> > cd /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
> >> >
> >> > [Binyu.Wang at m71a2 Gefs]$ ./run_g2g_met_verf_gefs.sh
> >> > CALLING: cd
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs
> >> > CALLING: scp -r ./*
binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
> >> > scp: //data/mv_data/binyu.wang: No such file or directory
> >> > ERROR: Command returned with non-zero status (1): scp -r ./*
> >> > binyu.wang at 205.156.8.85://data/mv_data/binyu.wang
> >> >
> >> > Binbin Zhou had kindly offer help by trying the same test under
his
> >> > account; and he didn't have any problem to run the above
script. Any
> >> > idea with this error? Thank you.
> >> >
> >> > Binyu
> >> >
> >> > On 1/28/2020 4:30 PM, John Halley Gotway via RT wrote:
> >> > > FYI, the fix was a one-liner, which I documented here:
> >> > > https://github.com/NCAR/MET/issues/1242
> >> > >
> >> > > It'll be included in met-9.0_beta3, but just changing the
order of
> >> fields
> >> > > will get around this issue for now.
> >> > >
> >> > > Thanks,
> >> > > John
> >> > >
> >> > > On Tue, Jan 28, 2020 at 2:12 PM John Halley Gotway
<johnhg at ucar.edu
> >
> >> > wrote:
> >> > >> Binyu,
> >> > >>
> >> > >> OK, I was able to figure this out and know what needs to be
fixed.
> >> I'll
> >> > >> fix in the next beta release for met-9.0 (met-9.0_beta3).
> >> > >>
> >> > >> Here's how you can fix it now... edit your Ensemble-Stat
config
> file:
> >> > >>
> >> > >>
> >> >
> >>
>
*/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/verf_g2g_ens_stat_regn_config_gdas*
> >> > >>
> >> > >> Move the setting for "TMP/P850" up to being the first field
in the
> >> list.
> >> > >>
> >> > >> When processing the "first" field in the "fcst.field" list,
> >> > Ensemble-Stat
> >> > >> initializes the output files.  However, your observation
file
> >> contains
> >> > no
> >> > >> data for "TMP/Z2".  So there are zero pairs and it doesn't
> initialize
> >> > the
> >> > >> output files correctly.  Your observations do contain data
for
> >> > "TMP/P850"
> >> > >> so putting that first in the list causes the output files to
be
> >> > initialized
> >> > >> correctly.
> >> > >>
> >> > >> I'll work on a fix for this.
> >> > >>
> >> > >> Thanks,
> >> > >> John
> >> > >>
> >> > >>
> >> > >> On Tue, Jan 28, 2020 at 8:47 AM binyu.wang at noaa.gov via RT <
> >> > >> met_help at ucar.edu> wrote:
> >> > >>
> >> > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937 >
> >> > >>>
> >> > >>> Hello John,
> >> > >>>
> >> > >>> Thank you very much for your quick response. I am sorry  I
didn't
> >> make
> >> > >>> it clear in my previous email. My working directory is
> >> > >>>
> >> > >>> %/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush,
> >> > >>>
> >> > >>> Below is what I did to get the log file, and the error
message is
> >> > inside
> >> > >>> of the log file.
> >> > >>>
> >> > >>>
> >> >
> >>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ush/verf_g2g_gefs.sh
> >> > >>>
> >> > >>>   > log
> >> > >>>
> >> > >>> Thank you for your help.
> >> > >>>
> >> > >>> BInyu
> >> > >>>
> >> > >>> On 1/27/2020 4:22 PM, John Halley Gotway via RT wrote:
> >> > >>>> Binyu,
> >> > >>>>
> >> > >>>> I'm taking a look at this now.  In
> >> > >>>> /gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/error
I
> found
> >> a
> >> > >>> call
> >> > >>>> to ensemble_stat which I assume generated the error
message you
> >> got.
> >> > >>>>
> >> > >>>> One thing to note, you can use the "-log logfilename"
command
> line
> >> > >>> option
> >> > >>>> to redirect all of the log messages to a file... including
> standard
> >> > out
> >> > >>> and
> >> > >>>> standard error.  That way you don't need to worry about
> redirecting
> >> > >>>> standard out and error to the same file.
> >> > >>>>
> >> > >>>> I'm running these commands...
> >> > >>>>
> >> > >>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
> >> > >>>> module load met/8.1
> >> > >>>> ensemble_stat gefs_file_list_00z_000
> >> > verf_g2g_ens_stat_regn_config_ndas
> >> > >>>> -grid_obs gdas.t00z.pgrb2.0p50.anl -log ~/run_es.log
> >> > >>>>
> >> > >>>> Since I didn't know what you're REFERENCE was, I just used
data
> for
> >> > the
> >> > >>>> first ensemble member:
> >> > >>>> export REFERENCE=`head -1 gefs_file_list_00z_000`
> >> > >>>>
> >> > >>>> But the underlying problem is that you're running
Ensemble-Stat
> but
> >> > >>> passing
> >> > >>>> as input a Grid-Stat config file.
> >> > >>>>
> >> > >>>> Before running Ensemble-Stat, you should copy over the
default
> >> config
> >> > >>> file
> >> > >>>> and edit it:
> >> > >>>> cp
> >> > >>>
> >> >
> >>
>
/global/noscrub/Julie.Prestopnik/met/8.1/share/met/config/EnsembleStatConfig_default
> >> > >>>> EnsembleStatConfig
> >> > >>>>
> >> > >>>> Thanks,
> >> > >>>> John
> >> > >>>>
> >> > >>>> On Mon, Jan 27, 2020 at 12:42 PM binyu.wang at noaa.gov via
RT <
> >> > >>>> met_help at ucar.edu> wrote:
> >> > >>>>
> >> > >>>>> Mon Jan 27 12:42:05 2020: Request 93937 was acted upon.
> >> > >>>>> Transaction: Ticket created by binyu.wang at noaa.gov
> >> > >>>>>          Queue: met_help
> >> > >>>>>        Subject: Error with ensemble analysis
> >> > >>>>>          Owner: Nobody
> >> > >>>>>     Requestors: binyu.wang at noaa.gov
> >> > >>>>>         Status: new
> >> > >>>>>    Ticket <URL:
> >> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93937
> >> > >>>>>
> >> > >>>>> Hello,
> >> > >>>>>
> >> > >>>>> I have a problem with MET Ensemble_stat tool. Here it is:
> >> > >>>>>
> >> > >>>>> ERROR  :
> >> > >>>>> ERROR  :   AsciiTable::rc_to_n() -> range check error ...
> >> > >>>>> ERROR  :                            (Nrows, Ncols) = (0,
0)
> >> > >>>>> ERROR  :                            (r, c) = (0, 0)
> >> > >>>>> ERROR  :
> >> > >>>>>
> >> > >>>>>
> >> > >>>>> Based on what I searched,
> >> > >>>>> "
> >> http://mailman.ucar.edu/pipermail/met_help/2013-
August/001985.html
> >> > ",
> >> > >>>>> there is a bug within.But it is is introduced in the
METv4.1
> >> release,
> >> > >>>>> why I had the problem now with MET8.1? A complete log
file is
> >> under:
> >> > >>>>>
> >> > >>>>>
> >> > >>>
> >> >
> >>
>
%/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/Gefs/ushverf_g2g_gefs.sh
> >> > >>>>>    > log
> >> > >>>>>
> >> > >>>>> What should I do on WCOSS? Thank you.
> >> > >>>>>
> >> > >>>>> Binyu
> >> > >>>>>
> >> > >>>>>
> >> > >>>>>
> >> > >>>
> >> >
> >>
> >>
>
>

------------------------------------------------


More information about the Met_help mailing list