[Met_help] [rt.rap.ucar.edu #99878] History for What does the extra refer to
Tatiana Burek via RT
met_help at ucar.edu
Mon May 17 10:29:54 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I was trying to make a RELY plot using METviewer, please see plot
"20210513_030219"
under METviwer (https://metviewer.nws.noaa.gov/metviewer1.jsp). The red
line on the top (jointed line with small cycles) should be the Rely plot,
but what is the other redline coming from? Please let me know if any other
information is needed. Thank you.
Binyu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: What does the extra refer to
From: Tatiana Burek
Time: Thu May 13 12:12:56 2021
Binyu,
You are correct - the jointed line with the small cycles is the Rely
plot.
The gray diagonal line is the perfect reliability line and the dotted
red line is no-skill line.
You can add or remove these lines as well as no-resolution line by
checking/unchecking corresponding check boxes in the Rely web page.
Tatiana
On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> Hello,
>
> I was trying to make a RELY plot using METviewer, please see plot
> "20210513_030219"
> under METviwer (https://metviewer.nws.noaa.gov/metviewer1.jsp). The
red
> line on the top (jointed line with small cycles) should be the Rely
plot,
> but what is the other redline coming from? Please let me know if any
other
> information is needed. Thank you.
>
> Binyu
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Thu May 13 13:18:38 2021
Hello Tatiana,
Thank you. I now see the 3 options. I didn't see it yesterday. It
seems
there was some update on METviewer today, isn't it?
Binyu
On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> You are correct - the jointed line with the small cycles is the Rely
plot.
> The gray diagonal line is the perfect reliability line and the
dotted red
> line is no-skill line.
> You can add or remove these lines as well as no-resolution line by
> checking/unchecking corresponding check boxes in the Rely web page.
>
> Tatiana
>
> On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > Hello,
> >
> > I was trying to make a RELY plot using METviewer, please see plot
> > "20210513_030219"
> > under METviwer (https://metviewer.nws.noaa.gov/metviewer1.jsp).
The red
> > line on the top (jointed line with small cycles) should be the
Rely plot,
> > but what is the other redline coming from? Please let me know if
any
> other
> > information is needed. Thank you.
> >
> > Binyu
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: Tatiana Burek
Time: Thu May 13 13:37:16 2021
You are correct. We released and deployed METviewer 4.0.0 today.
Tatiana
On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> Hello Tatiana,
>
> Thank you. I now see the 3 options. I didn't see it yesterday. It
> seems
> there was some update on METviewer today, isn't it?
>
> Binyu
>
> On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > You are correct - the jointed line with the small cycles is the
Rely
> > plot.
> > The gray diagonal line is the perfect reliability line and the
dotted
> > red
> > line is no-skill line.
> > You can add or remove these lines as well as no-resolution line by
> > checking/unchecking corresponding check boxes in the Rely web
page.
> >
> > Tatiana
> >
> > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > Hello,
> > >
> > > I was trying to make a RELY plot using METviewer, please see
plot
> > > "20210513_030219"
> > > under METviwer (https://metviewer.nws.noaa.gov/metviewer1.jsp).
The
> > > red
> > > line on the top (jointed line with small cycles) should be the
Rely
> > > plot,
> > > but what is the other redline coming from? Please let me know if
> > > any
> > other
> > > information is needed. Thank you.
> > >
> > > Binyu
> >
> >
> >
> >
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Thu May 13 14:16:34 2021
Great, thank you for your help.
Binyu
On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> You are correct. We released and deployed METviewer 4.0.0 today.
>
> Tatiana
>
> On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > Hello Tatiana,
> >
> > Thank you. I now see the 3 options. I didn't see it yesterday. It
> > seems
> > there was some update on METviewer today, isn't it?
> >
> > Binyu
> >
> > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > You are correct - the jointed line with the small cycles is the
Rely
> > > plot.
> > > The gray diagonal line is the perfect reliability line and the
dotted
> > > red
> > > line is no-skill line.
> > > You can add or remove these lines as well as no-resolution line
by
> > > checking/unchecking corresponding check boxes in the Rely web
page.
> > >
> > > Tatiana
> > >
> > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > Hello,
> > > >
> > > > I was trying to make a RELY plot using METviewer, please see
plot
> > > > "20210513_030219"
> > > > under METviwer
(https://metviewer.nws.noaa.gov/metviewer1.jsp). The
> > > > red
> > > > line on the top (jointed line with small cycles) should be the
Rely
> > > > plot,
> > > > but what is the other redline coming from? Please let me know
if
> > > > any
> > > other
> > > > information is needed. Thank you.
> > > >
> > > > Binyu
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Thu May 13 21:38:41 2021
Hello, Tatiana
I am not sure what's the problem, but the same weird thing happen
again:
I tried to load some files to the database, the log file looks fine at
the
beginning, but if you look at the bottom, you can tell the loading is
not
successful because the records are "0". Below is the script:
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
BASE_DIR
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
$SCRIPT/mv_create_db_on_aws.sh binyu.wang mv_g2g_met_verf_Bezy
echo "Create database done!"
$SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
/load_g2g_met_verf_Bezy.xml
The XML file is attached as well. Thank you.
Binyu
On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> You are correct. We released and deployed METviewer 4.0.0 today.
>
> Tatiana
>
> On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > Hello Tatiana,
> >
> > Thank you. I now see the 3 options. I didn't see it yesterday. It
> > seems
> > there was some update on METviewer today, isn't it?
> >
> > Binyu
> >
> > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > You are correct - the jointed line with the small cycles is the
Rely
> > > plot.
> > > The gray diagonal line is the perfect reliability line and the
dotted
> > > red
> > > line is no-skill line.
> > > You can add or remove these lines as well as no-resolution line
by
> > > checking/unchecking corresponding check boxes in the Rely web
page.
> > >
> > > Tatiana
> > >
> > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > Hello,
> > > >
> > > > I was trying to make a RELY plot using METviewer, please see
plot
> > > > "20210513_030219"
> > > > under METviwer
(https://metviewer.nws.noaa.gov/metviewer1.jsp). The
> > > > red
> > > > line on the top (jointed line with small cycles) should be the
Rely
> > > > plot,
> > > > but what is the other redline coming from? Please let me know
if
> > > > any
> > > other
> > > > information is needed. Thank you.
> > > >
> > > > Binyu
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: Tatiana Burek
Time: Fri May 14 07:42:02 2021
Binyu
>From your logs I do see that your data get copied to the server and
METviever attempts to load it.
I don't have the access to WCOSS and can't see your data. Please make
sure that your files are not empty and if it is let me know.
Tatiana
On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> Hello, Tatiana
>
> I am not sure what's the problem, but the same weird thing happen
again:
>
> I tried to load some files to the database, the log file looks fine
at the
> beginning, but if you look at the bottom, you can tell the loading
is not
> successful because the records are "0". Below is the script:
>
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
>
>
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
>
> BASE_DIR
>
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
>
>
> $SCRIPT/mv_create_db_on_aws.sh binyu.wang mv_g2g_met_verf_Bezy
>
> echo "Create database done!"
>
>
> $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> /load_g2g_met_verf_Bezy.xml
>
>
> The XML file is attached as well. Thank you.
>
>
> Binyu
>
> On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
> > You are correct. We released and deployed METviewer 4.0.0 today.
> >
> > Tatiana
> >
> > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > Hello Tatiana,
> > >
> > > Thank you. I now see the 3 options. I didn't see it yesterday.
It
> > > seems
> > > there was some update on METviewer today, isn't it?
> > >
> > > Binyu
> > >
> > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > Binyu,
> > > >
> > > > You are correct - the jointed line with the small cycles is
the Rely
> > > > plot.
> > > > The gray diagonal line is the perfect reliability line and the
dotted
> > > > red
> > > > line is no-skill line.
> > > > You can add or remove these lines as well as no-resolution
line by
> > > > checking/unchecking corresponding check boxes in the Rely web
page.
> > > >
> > > > Tatiana
> > > >
> > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > > Hello,
> > > > >
> > > > > I was trying to make a RELY plot using METviewer, please see
plot
> > > > > "20210513_030219"
> > > > > under METviwer
(https://metviewer.nws.noaa.gov/metviewer1.jsp). The
> > > > > red
> > > > > line on the top (jointed line with small cycles) should be
the Rely
> > > > > plot,
> > > > > but what is the other redline coming from? Please let me
know if
> > > > > any
> > > > other
> > > > > information is needed. Thank you.
> > > > >
> > > > > Binyu
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Fri May 14 08:21:37 2021
Tatiana,
Yes, they are not empty ( I even can not load those files that I used
to
be yesterday morning) . And this morning I got this as below when I
tried
to load it
:
load_g2g_met_verf_Bezy.xml
0% 0 0.0KB/s
--:--
ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space left on
device
load_g2g_met_verf_Bezy.xml
100% 1016 28.9KB/s
00:00
ERROR: Command returned with non-zero status (1): scp
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
binyu.wang at 205.156.8.85:~
On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Binyu
>
> From your logs I do see that your data get copied to the server and
> METviever attempts to load it.
> I don't have the access to WCOSS and can't see your data. Please
make sure
> that your files are not empty and if it is let me know.
>
> Tatiana
>
> On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > Hello, Tatiana
> >
> > I am not sure what's the problem, but the same weird thing happen
again:
> >
> > I tried to load some files to the database, the log file looks
fine at
> the
> > beginning, but if you look at the bottom, you can tell the loading
is not
> > successful because the records are "0". Below is the script:
> >
> >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> >
> >
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> >
> > BASE_DIR
> >
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> >
> >
> > $SCRIPT/mv_create_db_on_aws.sh binyu.wang mv_g2g_met_verf_Bezy
> >
> > echo "Create database done!"
> >
> >
> > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > /load_g2g_met_verf_Bezy.xml
> >
> >
> > The XML file is attached as well. Thank you.
> >
> >
> > Binyu
> >
> > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > You are correct. We released and deployed METviewer 4.0.0 today.
> > >
> > > Tatiana
> > >
> > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > Hello Tatiana,
> > > >
> > > > Thank you. I now see the 3 options. I didn't see it yesterday.
It
> > > > seems
> > > > there was some update on METviewer today, isn't it?
> > > >
> > > > Binyu
> > > >
> > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Binyu,
> > > > >
> > > > > You are correct - the jointed line with the small cycles is
the
> Rely
> > > > > plot.
> > > > > The gray diagonal line is the perfect reliability line and
the
> dotted
> > > > > red
> > > > > line is no-skill line.
> > > > > You can add or remove these lines as well as no-resolution
line by
> > > > > checking/unchecking corresponding check boxes in the Rely
web page.
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > > > Hello,
> > > > > >
> > > > > > I was trying to make a RELY plot using METviewer, please
see plot
> > > > > > "20210513_030219"
> > > > > > under METviwer
(https://metviewer.nws.noaa.gov/metviewer1.jsp).
> The
> > > > > > red
> > > > > > line on the top (jointed line with small cycles) should be
the
> Rely
> > > > > > plot,
> > > > > > but what is the other redline coming from? Please let me
know if
> > > > > > any
> > > > > other
> > > > > > information is needed. Thank you.
> > > > > >
> > > > > > Binyu
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: Tatiana Burek
Time: Fri May 14 08:36:25 2021
I also got the same error and submitted the request to fix it to the
AWS sys admins.
Lets wait till it fixed. I will let you know when to resume the
loading.
Tatiana
On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> Tatiana,
> Yes, they are not empty ( I even can not load those files that I
used
> to
> be yesterday morning) . And this morning I got this as below when I
> tried
> to load it
> :
>
> load_g2g_met_verf_Bezy.xml
> 0% 0 0.0KB/s
> --:--
> ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space left
on
> device
>
> load_g2g_met_verf_Bezy.xml
> 100% 1016 28.9KB/s
> 00:00
>
>
> ERROR: Command returned with non-zero status (1): scp
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> binyu.wang at 205.156.8.85:~
>
> On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Binyu
> >
> > From your logs I do see that your data get copied to the server
and
> > METviever attempts to load it.
> > I don't have the access to WCOSS and can't see your data. Please
make
> > sure
> > that your files are not empty and if it is let me know.
> >
> > Tatiana
> >
> > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > Hello, Tatiana
> > >
> > > I am not sure what's the problem, but the same weird thing
happen
> > > again:
> > >
> > > I tried to load some files to the database, the log file looks
fine
> > > at
> > the
> > > beginning, but if you look at the bottom, you can tell the
loading
> > > is not
> > > successful because the records are "0". Below is the script:
> > >
> > >
> >
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > >
> > >
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > >
> > > BASE_DIR
> > >
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > >
> > >
> > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang mv_g2g_met_verf_Bezy
> > >
> > > echo "Create database done!"
> > >
> > >
> > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > /load_g2g_met_verf_Bezy.xml
> > >
> > >
> > > The XML file is attached as well. Thank you.
> > >
> > >
> > > Binyu
> > >
> > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > You are correct. We released and deployed METviewer 4.0.0
today.
> > > >
> > > > Tatiana
> > > >
> > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > > Hello Tatiana,
> > > > >
> > > > > Thank you. I now see the 3 options. I didn't see it
yesterday.
> > > > > It
> > > > > seems
> > > > > there was some update on METviewer today, isn't it?
> > > > >
> > > > > Binyu
> > > > >
> > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Binyu,
> > > > > >
> > > > > > You are correct - the jointed line with the small cycles
is
> > > > > > the
> > Rely
> > > > > > plot.
> > > > > > The gray diagonal line is the perfect reliability line and
> > > > > > the
> > dotted
> > > > > > red
> > > > > > line is no-skill line.
> > > > > > You can add or remove these lines as well as no-resolution
> > > > > > line by
> > > > > > checking/unchecking corresponding check boxes in the Rely
web
> > > > > > page.
> > > > > >
> > > > > > Tatiana
> > > > > >
> > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > > > > Hello,
> > > > > > >
> > > > > > > I was trying to make a RELY plot using METviewer, please
> > > > > > > see plot
> > > > > > > "20210513_030219"
> > > > > > > under METviwer
> > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > The
> > > > > > > red
> > > > > > > line on the top (jointed line with small cycles) should
be
> > > > > > > the
> > Rely
> > > > > > > plot,
> > > > > > > but what is the other redline coming from? Please let me
> > > > > > > know if
> > > > > > > any
> > > > > > other
> > > > > > > information is needed. Thank you.
> > > > > > >
> > > > > > > Binyu
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Fri May 14 09:22:28 2021
Tatiana,
Sounds good. By the way, I think all the plots created using METViewer
could be generated using python scripts in the MET/METplus package. So
where to find those scripts? (e.g: to create RELY or ROC plot, ). I
guess
those scripts are included in "METplotpy" package? I can not find the
package from WCOSS. Thank you.
Binyu
On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> I also got the same error and submitted the request to fix it to the
AWS
> sys admins.
>
> Lets wait till it fixed. I will let you know when to resume the
loading.
>
> Tatiana
> On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > Tatiana,
> > Yes, they are not empty ( I even can not load those files that I
used
> > to
> > be yesterday morning) . And this morning I got this as below when
I
> > tried
> > to load it
> > :
> >
> > load_g2g_met_verf_Bezy.xml
> > 0% 0
0.0KB/s
> > --:--
> > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space left
on
> > device
> >
> > load_g2g_met_verf_Bezy.xml
> > 100% 1016
28.9KB/s
> > 00:00
> >
> >
> > ERROR: Command returned with non-zero status (1): scp
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > binyu.wang at 205.156.8.85:~
> >
> > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Binyu
> > >
> > > From your logs I do see that your data get copied to the server
and
> > > METviever attempts to load it.
> > > I don't have the access to WCOSS and can't see your data. Please
make
> > > sure
> > > that your files are not empty and if it is let me know.
> > >
> > > Tatiana
> > >
> > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > Hello, Tatiana
> > > >
> > > > I am not sure what's the problem, but the same weird thing
happen
> > > > again:
> > > >
> > > > I tried to load some files to the database, the log file looks
fine
> > > > at
> > > the
> > > > beginning, but if you look at the bottom, you can tell the
loading
> > > > is not
> > > > successful because the records are "0". Below is the script:
> > > >
> > > >
> > >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > >
> > > >
>
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > >
> > > > BASE_DIR
> > > >
>
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > >
> > > >
> > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
mv_g2g_met_verf_Bezy
> > > >
> > > > echo "Create database done!"
> > > >
> > > >
> > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > /load_g2g_met_verf_Bezy.xml
> > > >
> > > >
> > > > The XML file is attached as well. Thank you.
> > > >
> > > >
> > > > Binyu
> > > >
> > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > You are correct. We released and deployed METviewer 4.0.0
today.
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > > > Hello Tatiana,
> > > > > >
> > > > > > Thank you. I now see the 3 options. I didn't see it
yesterday.
> > > > > > It
> > > > > > seems
> > > > > > there was some update on METviewer today, isn't it?
> > > > > >
> > > > > > Binyu
> > > > > >
> > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Binyu,
> > > > > > >
> > > > > > > You are correct - the jointed line with the small cycles
is
> > > > > > > the
> > > Rely
> > > > > > > plot.
> > > > > > > The gray diagonal line is the perfect reliability line
and
> > > > > > > the
> > > dotted
> > > > > > > red
> > > > > > > line is no-skill line.
> > > > > > > You can add or remove these lines as well as no-
resolution
> > > > > > > line by
> > > > > > > checking/unchecking corresponding check boxes in the
Rely web
> > > > > > > page.
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > > > > > Hello,
> > > > > > > >
> > > > > > > > I was trying to make a RELY plot using METviewer,
please
> > > > > > > > see plot
> > > > > > > > "20210513_030219"
> > > > > > > > under METviwer
> > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > The
> > > > > > > > red
> > > > > > > > line on the top (jointed line with small cycles)
should be
> > > > > > > > the
> > > Rely
> > > > > > > > plot,
> > > > > > > > but what is the other redline coming from? Please let
me
> > > > > > > > know if
> > > > > > > > any
> > > > > > > other
> > > > > > > > information is needed. Thank you.
> > > > > > > >
> > > > > > > > Binyu
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Sat May 15 19:23:20 2021
Hello Tatiana,
I just tested the data again, I didn't get the "No space left" message
this
time, but I got the same log file as before (see below): no error,
but no
data was uploaded at all. As I said last time, the data is NOT empty.
---- MVLoad ----
Version: 4.0.0
Begin time: 2021-05-16 01:15:06
Parsing: load_g2g_met_verf_Bezy.xml
Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
==== grid_stat ====
stat_header table time total: 0:00:00.000
stat header records: 0
stat header inserts: 0
line data records: 0
line data inserts: 0
stat group records: 0
stat group inserts: 0
var length records: 0
var length inserts: 0
total lines: 0
insert size: 1
lines / msec: 0.000
num files: 0
==== mode ====
mode_header search time total: 0:00:00.000
mtd_header search time total: 0:00:00.000
stat_header search time total: 0:00:00.000
mode_header inserts: 0
mode_cts inserts: 0
mode_obj_single inserts: 0
mode_obj_pair inserts: 0
==== mtd ====
mtd_header inserts: 0
mtd_3d_obj_single inserts: 0
mtd_3d_obj_pair inserts: 0
mtd_2d_obj inserts: 0
total lines: 0
num files: 0
num files: 0
==== indexes ====creating
Indexes creating 0:00:00.594
End time: 2021-05-16 01:15:07
Load total: 0:00:00.006
Thank you.
On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> I also got the same error and submitted the request to fix it to the
AWS
> sys admins.
>
> Lets wait till it fixed. I will let you know when to resume the
loading.
>
> Tatiana
> On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > Tatiana,
> > Yes, they are not empty ( I even can not load those files that I
used
> > to
> > be yesterday morning) . And this morning I got this as below when
I
> > tried
> > to load it
> > :
> >
> > load_g2g_met_verf_Bezy.xml
> > 0% 0
0.0KB/s
> > --:--
> > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space left
on
> > device
> >
> > load_g2g_met_verf_Bezy.xml
> > 100% 1016
28.9KB/s
> > 00:00
> >
> >
> > ERROR: Command returned with non-zero status (1): scp
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > binyu.wang at 205.156.8.85:~
> >
> > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Binyu
> > >
> > > From your logs I do see that your data get copied to the server
and
> > > METviever attempts to load it.
> > > I don't have the access to WCOSS and can't see your data. Please
make
> > > sure
> > > that your files are not empty and if it is let me know.
> > >
> > > Tatiana
> > >
> > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > Hello, Tatiana
> > > >
> > > > I am not sure what's the problem, but the same weird thing
happen
> > > > again:
> > > >
> > > > I tried to load some files to the database, the log file looks
fine
> > > > at
> > > the
> > > > beginning, but if you look at the bottom, you can tell the
loading
> > > > is not
> > > > successful because the records are "0". Below is the script:
> > > >
> > > >
> > >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > >
> > > >
>
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > >
> > > > BASE_DIR
> > > >
>
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > >
> > > >
> > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
mv_g2g_met_verf_Bezy
> > > >
> > > > echo "Create database done!"
> > > >
> > > >
> > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > /load_g2g_met_verf_Bezy.xml
> > > >
> > > >
> > > > The XML file is attached as well. Thank you.
> > > >
> > > >
> > > > Binyu
> > > >
> > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > You are correct. We released and deployed METviewer 4.0.0
today.
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > > > Hello Tatiana,
> > > > > >
> > > > > > Thank you. I now see the 3 options. I didn't see it
yesterday.
> > > > > > It
> > > > > > seems
> > > > > > there was some update on METviewer today, isn't it?
> > > > > >
> > > > > > Binyu
> > > > > >
> > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Binyu,
> > > > > > >
> > > > > > > You are correct - the jointed line with the small cycles
is
> > > > > > > the
> > > Rely
> > > > > > > plot.
> > > > > > > The gray diagonal line is the perfect reliability line
and
> > > > > > > the
> > > dotted
> > > > > > > red
> > > > > > > line is no-skill line.
> > > > > > > You can add or remove these lines as well as no-
resolution
> > > > > > > line by
> > > > > > > checking/unchecking corresponding check boxes in the
Rely web
> > > > > > > page.
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov wrote:
> > > > > > > > Hello,
> > > > > > > >
> > > > > > > > I was trying to make a RELY plot using METviewer,
please
> > > > > > > > see plot
> > > > > > > > "20210513_030219"
> > > > > > > > under METviwer
> > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > The
> > > > > > > > red
> > > > > > > > line on the top (jointed line with small cycles)
should be
> > > > > > > > the
> > > Rely
> > > > > > > > plot,
> > > > > > > > but what is the other redline coming from? Please let
me
> > > > > > > > know if
> > > > > > > > any
> > > > > > > other
> > > > > > > > information is needed. Thank you.
> > > > > > > >
> > > > > > > > Binyu
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: Tatiana Burek
Time: Mon May 17 08:17:10 2021
Binyu
I commented out some parts of the script where it removes the data
from the server.
Could you please run your load again. This is for the debugging
reasons so don't expect any changes yet. Let me know when it is done.
Tatiana
On Sat May 15 19:23:20 2021, binyu.wang at noaa.gov wrote:
> Hello Tatiana,
>
> I just tested the data again, I didn't get the "No space left"
message
> this
> time, but I got the same log file as before (see below): no error,
> but no
> data was uploaded at all. As I said last time, the data is NOT
empty.
>
> ---- MVLoad ----
>
>
> Version: 4.0.0
>
>
> Begin time: 2021-05-16 01:15:06
>
> Parsing: load_g2g_met_verf_Bezy.xml
>
>
> Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
>
> ==== grid_stat ====
>
>
> stat_header table time total: 0:00:00.000
>
> stat header records: 0
>
> stat header inserts: 0
>
> line data records: 0
>
> line data inserts: 0
>
> stat group records: 0
>
> stat group inserts: 0
>
> var length records: 0
>
> var length inserts: 0
>
> total lines: 0
>
> insert size: 1
>
> lines / msec: 0.000
>
> num files: 0
>
>
> ==== mode ====
>
>
> mode_header search time total: 0:00:00.000
>
> mtd_header search time total: 0:00:00.000
>
> stat_header search time total: 0:00:00.000
>
> mode_header inserts: 0
>
> mode_cts inserts: 0
>
> mode_obj_single inserts: 0
>
> mode_obj_pair inserts: 0
>
> ==== mtd ====
>
>
> mtd_header inserts: 0
>
> mtd_3d_obj_single inserts: 0
>
> mtd_3d_obj_pair inserts: 0
>
> mtd_2d_obj inserts: 0
>
> total lines: 0
>
> num files: 0
>
> num files: 0
>
>
> ==== indexes ====creating
>
> Indexes creating 0:00:00.594
>
>
> End time: 2021-05-16 01:15:07
>
> Load total: 0:00:00.006
>
>
> Thank you.
>
> On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > I also got the same error and submitted the request to fix it to
the
> > AWS
> > sys admins.
> >
> > Lets wait till it fixed. I will let you know when to resume the
> > loading.
> >
> > Tatiana
> > On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > > Tatiana,
> > > Yes, they are not empty ( I even can not load those files that
I
> > > used
> > > to
> > > be yesterday morning) . And this morning I got this as below
when I
> > > tried
> > > to load it
> > > :
> > >
> > > load_g2g_met_verf_Bezy.xml
> > > 0% 0
0.0KB/s
> > > --:--
> > > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space
left
> > > on
> > > device
> > >
> > > load_g2g_met_verf_Bezy.xml
> > > 100% 1016
28.9KB/s
> > > 00:00
> > >
> > >
> > > ERROR: Command returned with non-zero status (1): scp
> > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > > binyu.wang at 205.156.8.85:~
> > >
> > > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > Binyu
> > > >
> > > > From your logs I do see that your data get copied to the
server
> > > > and
> > > > METviever attempts to load it.
> > > > I don't have the access to WCOSS and can't see your data.
Please
> > > > make
> > > > sure
> > > > that your files are not empty and if it is let me know.
> > > >
> > > > Tatiana
> > > >
> > > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > > Hello, Tatiana
> > > > >
> > > > > I am not sure what's the problem, but the same weird thing
> > > > > happen
> > > > > again:
> > > > >
> > > > > I tried to load some files to the database, the log file
looks
> > > > > fine
> > > > > at
> > > > the
> > > > > beginning, but if you look at the bottom, you can tell the
> > > > > loading
> > > > > is not
> > > > > successful because the records are "0". Below is the
script:
> > > > >
> > > > >
> > > >
> >
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > > >
> > > > >
> >
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > > >
> > > > > BASE_DIR
> > > > >
> >
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > > >
> > > > >
> > > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
mv_g2g_met_verf_Bezy
> > > > >
> > > > > echo "Create database done!"
> > > > >
> > > > >
> > > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > > /load_g2g_met_verf_Bezy.xml
> > > > >
> > > > >
> > > > > The XML file is attached as well. Thank you.
> > > > >
> > > > >
> > > > > Binyu
> > > > >
> > > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > You are correct. We released and deployed METviewer 4.0.0
> > > > > > today.
> > > > > >
> > > > > > Tatiana
> > > > > >
> > > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > > > > Hello Tatiana,
> > > > > > >
> > > > > > > Thank you. I now see the 3 options. I didn't see it
> > > > > > > yesterday.
> > > > > > > It
> > > > > > > seems
> > > > > > > there was some update on METviewer today, isn't it?
> > > > > > >
> > > > > > > Binyu
> > > > > > >
> > > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Binyu,
> > > > > > > >
> > > > > > > > You are correct - the jointed line with the small
cycles
> > > > > > > > is
> > > > > > > > the
> > > > Rely
> > > > > > > > plot.
> > > > > > > > The gray diagonal line is the perfect reliability line
> > > > > > > > and
> > > > > > > > the
> > > > dotted
> > > > > > > > red
> > > > > > > > line is no-skill line.
> > > > > > > > You can add or remove these lines as well as no-
> > > > > > > > resolution
> > > > > > > > line by
> > > > > > > > checking/unchecking corresponding check boxes in the
Rely
> > > > > > > > web
> > > > > > > > page.
> > > > > > > >
> > > > > > > > Tatiana
> > > > > > > >
> > > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > Hello,
> > > > > > > > >
> > > > > > > > > I was trying to make a RELY plot using METviewer,
> > > > > > > > > please
> > > > > > > > > see plot
> > > > > > > > > "20210513_030219"
> > > > > > > > > under METviwer
> > > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > > The
> > > > > > > > > red
> > > > > > > > > line on the top (jointed line with small cycles)
should
> > > > > > > > > be
> > > > > > > > > the
> > > > Rely
> > > > > > > > > plot,
> > > > > > > > > but what is the other redline coming from? Please
let
> > > > > > > > > me
> > > > > > > > > know if
> > > > > > > > > any
> > > > > > > > other
> > > > > > > > > information is needed. Thank you.
> > > > > > > > >
> > > > > > > > > Binyu
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: What does the extra refer to
From: Julie Prestopnik
Time: Mon May 17 08:47:30 2021
Hi Binyu.
METplotpy is not yet on WCOSS, however, I am hoping to get it
installed on
WCOSS later this week and can keep you informed of the status once it
is
ready.
Julie
On Mon, May 17, 2021 at 8:17 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99878 >
>
> Binyu
>
> I commented out some parts of the script where it removes the data
from
> the server.
> Could you please run your load again. This is for the debugging
reasons so
> don't expect any changes yet. Let me know when it is done.
>
> Tatiana
>
> On Sat May 15 19:23:20 2021, binyu.wang at noaa.gov wrote:
> > Hello Tatiana,
> >
> > I just tested the data again, I didn't get the "No space left"
message
> > this
> > time, but I got the same log file as before (see below): no
error,
> > but no
> > data was uploaded at all. As I said last time, the data is NOT
empty.
> >
> > ---- MVLoad ----
> >
> >
> > Version: 4.0.0
> >
> >
> > Begin time: 2021-05-16 01:15:06
> >
> > Parsing: load_g2g_met_verf_Bezy.xml
> >
> >
> > Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
> >
> > ==== grid_stat ====
> >
> >
> > stat_header table time total: 0:00:00.000
> >
> > stat header records: 0
> >
> > stat header inserts: 0
> >
> > line data records: 0
> >
> > line data inserts: 0
> >
> > stat group records: 0
> >
> > stat group inserts: 0
> >
> > var length records: 0
> >
> > var length inserts: 0
> >
> > total lines: 0
> >
> > insert size: 1
> >
> > lines / msec: 0.000
> >
> > num files: 0
> >
> >
> > ==== mode ====
> >
> >
> > mode_header search time total: 0:00:00.000
> >
> > mtd_header search time total: 0:00:00.000
> >
> > stat_header search time total: 0:00:00.000
> >
> > mode_header inserts: 0
> >
> > mode_cts inserts: 0
> >
> > mode_obj_single inserts: 0
> >
> > mode_obj_pair inserts: 0
> >
> > ==== mtd ====
> >
> >
> > mtd_header inserts: 0
> >
> > mtd_3d_obj_single inserts: 0
> >
> > mtd_3d_obj_pair inserts: 0
> >
> > mtd_2d_obj inserts: 0
> >
> > total lines: 0
> >
> > num files: 0
> >
> > num files: 0
> >
> >
> > ==== indexes ====creating
> >
> > Indexes creating 0:00:00.594
> >
> >
> > End time: 2021-05-16 01:15:07
> >
> > Load total: 0:00:00.006
> >
> >
> > Thank you.
> >
> > On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > I also got the same error and submitted the request to fix it to
the
> > > AWS
> > > sys admins.
> > >
> > > Lets wait till it fixed. I will let you know when to resume the
> > > loading.
> > >
> > > Tatiana
> > > On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > > > Tatiana,
> > > > Yes, they are not empty ( I even can not load those files
that I
> > > > used
> > > > to
> > > > be yesterday morning) . And this morning I got this as below
when I
> > > > tried
> > > > to load it
> > > > :
> > > >
> > > > load_g2g_met_verf_Bezy.xml
> > > > 0% 0
0.0KB/s
> > > > --:--
> > > > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space
left
> > > > on
> > > > device
> > > >
> > > > load_g2g_met_verf_Bezy.xml
> > > > 100% 1016
28.9KB/s
> > > > 00:00
> > > >
> > > >
> > > > ERROR: Command returned with non-zero status (1): scp
> > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > > > binyu.wang at 205.156.8.85:~
> > > >
> > > > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Binyu
> > > > >
> > > > > From your logs I do see that your data get copied to the
server
> > > > > and
> > > > > METviever attempts to load it.
> > > > > I don't have the access to WCOSS and can't see your data.
Please
> > > > > make
> > > > > sure
> > > > > that your files are not empty and if it is let me know.
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > > > Hello, Tatiana
> > > > > >
> > > > > > I am not sure what's the problem, but the same weird thing
> > > > > > happen
> > > > > > again:
> > > > > >
> > > > > > I tried to load some files to the database, the log file
looks
> > > > > > fine
> > > > > > at
> > > > > the
> > > > > > beginning, but if you look at the bottom, you can tell the
> > > > > > loading
> > > > > > is not
> > > > > > successful because the records are "0". Below is the
script:
> > > > > >
> > > > > >
> > > > >
> > >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > > > >
> > > > > >
> > >
>
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > > > >
> > > > > > BASE_DIR
> > > > > >
> > >
>
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > > > >
> > > > > >
> > > > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
mv_g2g_met_verf_Bezy
> > > > > >
> > > > > > echo "Create database done!"
> > > > > >
> > > > > >
> > > > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > > > /load_g2g_met_verf_Bezy.xml
> > > > > >
> > > > > >
> > > > > > The XML file is attached as well. Thank you.
> > > > > >
> > > > > >
> > > > > > Binyu
> > > > > >
> > > > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > You are correct. We released and deployed METviewer
4.0.0
> > > > > > > today.
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > > > > > Hello Tatiana,
> > > > > > > >
> > > > > > > > Thank you. I now see the 3 options. I didn't see it
> > > > > > > > yesterday.
> > > > > > > > It
> > > > > > > > seems
> > > > > > > > there was some update on METviewer today, isn't it?
> > > > > > > >
> > > > > > > > Binyu
> > > > > > > >
> > > > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > > > <met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Binyu,
> > > > > > > > >
> > > > > > > > > You are correct - the jointed line with the small
cycles
> > > > > > > > > is
> > > > > > > > > the
> > > > > Rely
> > > > > > > > > plot.
> > > > > > > > > The gray diagonal line is the perfect reliability
line
> > > > > > > > > and
> > > > > > > > > the
> > > > > dotted
> > > > > > > > > red
> > > > > > > > > line is no-skill line.
> > > > > > > > > You can add or remove these lines as well as no-
> > > > > > > > > resolution
> > > > > > > > > line by
> > > > > > > > > checking/unchecking corresponding check boxes in the
Rely
> > > > > > > > > web
> > > > > > > > > page.
> > > > > > > > >
> > > > > > > > > Tatiana
> > > > > > > > >
> > > > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > > Hello,
> > > > > > > > > >
> > > > > > > > > > I was trying to make a RELY plot using METviewer,
> > > > > > > > > > please
> > > > > > > > > > see plot
> > > > > > > > > > "20210513_030219"
> > > > > > > > > > under METviwer
> > > > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > > > The
> > > > > > > > > > red
> > > > > > > > > > line on the top (jointed line with small cycles)
should
> > > > > > > > > > be
> > > > > > > > > > the
> > > > > Rely
> > > > > > > > > > plot,
> > > > > > > > > > but what is the other redline coming from? Please
let
> > > > > > > > > > me
> > > > > > > > > > know if
> > > > > > > > > > any
> > > > > > > > > other
> > > > > > > > > > information is needed. Thank you.
> > > > > > > > > >
> > > > > > > > > > Binyu
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Mon May 17 09:02:06 2021
Hello, Tatiana
I just tested again but still got the same thing. Thank you for your
help.
On Mon, May 17, 2021 at 10:17 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Binyu
>
> I commented out some parts of the script where it removes the data
from
> the server.
> Could you please run your load again. This is for the debugging
reasons so
> don't expect any changes yet. Let me know when it is done.
>
> Tatiana
>
> On Sat May 15 19:23:20 2021, binyu.wang at noaa.gov wrote:
> > Hello Tatiana,
> >
> > I just tested the data again, I didn't get the "No space left"
message
> > this
> > time, but I got the same log file as before (see below): no
error,
> > but no
> > data was uploaded at all. As I said last time, the data is NOT
empty.
> >
> > ---- MVLoad ----
> >
> >
> > Version: 4.0.0
> >
> >
> > Begin time: 2021-05-16 01:15:06
> >
> > Parsing: load_g2g_met_verf_Bezy.xml
> >
> >
> > Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
> >
> > ==== grid_stat ====
> >
> >
> > stat_header table time total: 0:00:00.000
> >
> > stat header records: 0
> >
> > stat header inserts: 0
> >
> > line data records: 0
> >
> > line data inserts: 0
> >
> > stat group records: 0
> >
> > stat group inserts: 0
> >
> > var length records: 0
> >
> > var length inserts: 0
> >
> > total lines: 0
> >
> > insert size: 1
> >
> > lines / msec: 0.000
> >
> > num files: 0
> >
> >
> > ==== mode ====
> >
> >
> > mode_header search time total: 0:00:00.000
> >
> > mtd_header search time total: 0:00:00.000
> >
> > stat_header search time total: 0:00:00.000
> >
> > mode_header inserts: 0
> >
> > mode_cts inserts: 0
> >
> > mode_obj_single inserts: 0
> >
> > mode_obj_pair inserts: 0
> >
> > ==== mtd ====
> >
> >
> > mtd_header inserts: 0
> >
> > mtd_3d_obj_single inserts: 0
> >
> > mtd_3d_obj_pair inserts: 0
> >
> > mtd_2d_obj inserts: 0
> >
> > total lines: 0
> >
> > num files: 0
> >
> > num files: 0
> >
> >
> > ==== indexes ====creating
> >
> > Indexes creating 0:00:00.594
> >
> >
> > End time: 2021-05-16 01:15:07
> >
> > Load total: 0:00:00.006
> >
> >
> > Thank you.
> >
> > On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > I also got the same error and submitted the request to fix it to
the
> > > AWS
> > > sys admins.
> > >
> > > Lets wait till it fixed. I will let you know when to resume the
> > > loading.
> > >
> > > Tatiana
> > > On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > > > Tatiana,
> > > > Yes, they are not empty ( I even can not load those files
that I
> > > > used
> > > > to
> > > > be yesterday morning) . And this morning I got this as below
when I
> > > > tried
> > > > to load it
> > > > :
> > > >
> > > > load_g2g_met_verf_Bezy.xml
> > > > 0% 0
0.0KB/s
> > > > --:--
> > > > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No space
left
> > > > on
> > > > device
> > > >
> > > > load_g2g_met_verf_Bezy.xml
> > > > 100% 1016
28.9KB/s
> > > > 00:00
> > > >
> > > >
> > > > ERROR: Command returned with non-zero status (1): scp
> > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > > > binyu.wang at 205.156.8.85:~
> > > >
> > > > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Binyu
> > > > >
> > > > > From your logs I do see that your data get copied to the
server
> > > > > and
> > > > > METviever attempts to load it.
> > > > > I don't have the access to WCOSS and can't see your data.
Please
> > > > > make
> > > > > sure
> > > > > that your files are not empty and if it is let me know.
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > > > Hello, Tatiana
> > > > > >
> > > > > > I am not sure what's the problem, but the same weird thing
> > > > > > happen
> > > > > > again:
> > > > > >
> > > > > > I tried to load some files to the database, the log file
looks
> > > > > > fine
> > > > > > at
> > > > > the
> > > > > > beginning, but if you look at the bottom, you can tell the
> > > > > > loading
> > > > > > is not
> > > > > > successful because the records are "0". Below is the
script:
> > > > > >
> > > > > >
> > > > >
> > >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > > > >
> > > > > >
> > >
>
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > > > >
> > > > > > BASE_DIR
> > > > > >
> > >
>
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > > > >
> > > > > >
> > > > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
mv_g2g_met_verf_Bezy
> > > > > >
> > > > > > echo "Create database done!"
> > > > > >
> > > > > >
> > > > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > > > /load_g2g_met_verf_Bezy.xml
> > > > > >
> > > > > >
> > > > > > The XML file is attached as well. Thank you.
> > > > > >
> > > > > >
> > > > > > Binyu
> > > > > >
> > > > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > You are correct. We released and deployed METviewer
4.0.0
> > > > > > > today.
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov wrote:
> > > > > > > > Hello Tatiana,
> > > > > > > >
> > > > > > > > Thank you. I now see the 3 options. I didn't see it
> > > > > > > > yesterday.
> > > > > > > > It
> > > > > > > > seems
> > > > > > > > there was some update on METviewer today, isn't it?
> > > > > > > >
> > > > > > > > Binyu
> > > > > > > >
> > > > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > > > <met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Binyu,
> > > > > > > > >
> > > > > > > > > You are correct - the jointed line with the small
cycles
> > > > > > > > > is
> > > > > > > > > the
> > > > > Rely
> > > > > > > > > plot.
> > > > > > > > > The gray diagonal line is the perfect reliability
line
> > > > > > > > > and
> > > > > > > > > the
> > > > > dotted
> > > > > > > > > red
> > > > > > > > > line is no-skill line.
> > > > > > > > > You can add or remove these lines as well as no-
> > > > > > > > > resolution
> > > > > > > > > line by
> > > > > > > > > checking/unchecking corresponding check boxes in the
Rely
> > > > > > > > > web
> > > > > > > > > page.
> > > > > > > > >
> > > > > > > > > Tatiana
> > > > > > > > >
> > > > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > > Hello,
> > > > > > > > > >
> > > > > > > > > > I was trying to make a RELY plot using METviewer,
> > > > > > > > > > please
> > > > > > > > > > see plot
> > > > > > > > > > "20210513_030219"
> > > > > > > > > > under METviwer
> > > > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > > > The
> > > > > > > > > > red
> > > > > > > > > > line on the top (jointed line with small cycles)
should
> > > > > > > > > > be
> > > > > > > > > > the
> > > > > Rely
> > > > > > > > > > plot,
> > > > > > > > > > but what is the other redline coming from? Please
let
> > > > > > > > > > me
> > > > > > > > > > know if
> > > > > > > > > > any
> > > > > > > > > other
> > > > > > > > > > information is needed. Thank you.
> > > > > > > > > >
> > > > > > > > > > Binyu
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Mon May 17 09:02:34 2021
Hello Julie,
Sounds good, thank you for the update.
Binyu
On Mon, May 17, 2021 at 10:47 AM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Binyu.
>
> METplotpy is not yet on WCOSS, however, I am hoping to get it
installed on
> WCOSS later this week and can keep you informed of the status once
it is
> ready.
>
> Julie
>
> On Mon, May 17, 2021 at 8:17 AM Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99878 >
> >
> > Binyu
> >
> > I commented out some parts of the script where it removes the data
from
> > the server.
> > Could you please run your load again. This is for the debugging
reasons
> so
> > don't expect any changes yet. Let me know when it is done.
> >
> > Tatiana
> >
> > On Sat May 15 19:23:20 2021, binyu.wang at noaa.gov wrote:
> > > Hello Tatiana,
> > >
> > > I just tested the data again, I didn't get the "No space left"
message
> > > this
> > > time, but I got the same log file as before (see below): no
error,
> > > but no
> > > data was uploaded at all. As I said last time, the data is NOT
empty.
> > >
> > > ---- MVLoad ----
> > >
> > >
> > > Version: 4.0.0
> > >
> > >
> > > Begin time: 2021-05-16 01:15:06
> > >
> > > Parsing: load_g2g_met_verf_Bezy.xml
> > >
> > >
> > > Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
> > >
> > > ==== grid_stat ====
> > >
> > >
> > > stat_header table time total: 0:00:00.000
> > >
> > > stat header records: 0
> > >
> > > stat header inserts: 0
> > >
> > > line data records: 0
> > >
> > > line data inserts: 0
> > >
> > > stat group records: 0
> > >
> > > stat group inserts: 0
> > >
> > > var length records: 0
> > >
> > > var length inserts: 0
> > >
> > > total lines: 0
> > >
> > > insert size: 1
> > >
> > > lines / msec: 0.000
> > >
> > > num files: 0
> > >
> > >
> > > ==== mode ====
> > >
> > >
> > > mode_header search time total: 0:00:00.000
> > >
> > > mtd_header search time total: 0:00:00.000
> > >
> > > stat_header search time total: 0:00:00.000
> > >
> > > mode_header inserts: 0
> > >
> > > mode_cts inserts: 0
> > >
> > > mode_obj_single inserts: 0
> > >
> > > mode_obj_pair inserts: 0
> > >
> > > ==== mtd ====
> > >
> > >
> > > mtd_header inserts: 0
> > >
> > > mtd_3d_obj_single inserts: 0
> > >
> > > mtd_3d_obj_pair inserts: 0
> > >
> > > mtd_2d_obj inserts: 0
> > >
> > > total lines: 0
> > >
> > > num files: 0
> > >
> > > num files: 0
> > >
> > >
> > > ==== indexes ====creating
> > >
> > > Indexes creating 0:00:00.594
> > >
> > >
> > > End time: 2021-05-16 01:15:07
> > >
> > > Load total: 0:00:00.006
> > >
> > >
> > > Thank you.
> > >
> > > On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > I also got the same error and submitted the request to fix it
to the
> > > > AWS
> > > > sys admins.
> > > >
> > > > Lets wait till it fixed. I will let you know when to resume
the
> > > > loading.
> > > >
> > > > Tatiana
> > > > On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > > > > Tatiana,
> > > > > Yes, they are not empty ( I even can not load those files
that I
> > > > > used
> > > > > to
> > > > > be yesterday morning) . And this morning I got this as below
when I
> > > > > tried
> > > > > to load it
> > > > > :
> > > > >
> > > > > load_g2g_met_verf_Bezy.xml
> > > > > 0% 0
0.0KB/s
> > > > > --:--
> > > > > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No
space left
> > > > > on
> > > > > device
> > > > >
> > > > > load_g2g_met_verf_Bezy.xml
> > > > > 100% 1016
28.9KB/s
> > > > > 00:00
> > > > >
> > > > >
> > > > > ERROR: Command returned with non-zero status (1): scp
> > > > >
> > > >
> >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > > > > binyu.wang at 205.156.8.85:~
> > > > >
> > > > > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Binyu
> > > > > >
> > > > > > From your logs I do see that your data get copied to the
server
> > > > > > and
> > > > > > METviever attempts to load it.
> > > > > > I don't have the access to WCOSS and can't see your data.
Please
> > > > > > make
> > > > > > sure
> > > > > > that your files are not empty and if it is let me know.
> > > > > >
> > > > > > Tatiana
> > > > > >
> > > > > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > > > > Hello, Tatiana
> > > > > > >
> > > > > > > I am not sure what's the problem, but the same weird
thing
> > > > > > > happen
> > > > > > > again:
> > > > > > >
> > > > > > > I tried to load some files to the database, the log file
looks
> > > > > > > fine
> > > > > > > at
> > > > > > the
> > > > > > > beginning, but if you look at the bottom, you can tell
the
> > > > > > > loading
> > > > > > > is not
> > > > > > > successful because the records are "0". Below is the
script:
> > > > > > >
> > > > > > >
> > > > > >
> > > >
> >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > > > > >
> > > > > > >
> > > >
> >
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > > > > >
> > > > > > > BASE_DIR
> > > > > > >
> > > >
> >
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > > > > >
> > > > > > >
> > > > > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
mv_g2g_met_verf_Bezy
> > > > > > >
> > > > > > > echo "Create database done!"
> > > > > > >
> > > > > > >
> > > > > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > > > > /load_g2g_met_verf_Bezy.xml
> > > > > > >
> > > > > > >
> > > > > > > The XML file is attached as well. Thank you.
> > > > > > >
> > > > > > >
> > > > > > > Binyu
> > > > > > >
> > > > > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > You are correct. We released and deployed METviewer
4.0.0
> > > > > > > > today.
> > > > > > > >
> > > > > > > > Tatiana
> > > > > > > >
> > > > > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > Hello Tatiana,
> > > > > > > > >
> > > > > > > > > Thank you. I now see the 3 options. I didn't see it
> > > > > > > > > yesterday.
> > > > > > > > > It
> > > > > > > > > seems
> > > > > > > > > there was some update on METviewer today, isn't it?
> > > > > > > > >
> > > > > > > > > Binyu
> > > > > > > > >
> > > > > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Binyu,
> > > > > > > > > >
> > > > > > > > > > You are correct - the jointed line with the small
cycles
> > > > > > > > > > is
> > > > > > > > > > the
> > > > > > Rely
> > > > > > > > > > plot.
> > > > > > > > > > The gray diagonal line is the perfect reliability
line
> > > > > > > > > > and
> > > > > > > > > > the
> > > > > > dotted
> > > > > > > > > > red
> > > > > > > > > > line is no-skill line.
> > > > > > > > > > You can add or remove these lines as well as no-
> > > > > > > > > > resolution
> > > > > > > > > > line by
> > > > > > > > > > checking/unchecking corresponding check boxes in
the Rely
> > > > > > > > > > web
> > > > > > > > > > page.
> > > > > > > > > >
> > > > > > > > > > Tatiana
> > > > > > > > > >
> > > > > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > > > Hello,
> > > > > > > > > > >
> > > > > > > > > > > I was trying to make a RELY plot using
METviewer,
> > > > > > > > > > > please
> > > > > > > > > > > see plot
> > > > > > > > > > > "20210513_030219"
> > > > > > > > > > > under METviwer
> > > > > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > > > > The
> > > > > > > > > > > red
> > > > > > > > > > > line on the top (jointed line with small cycles)
should
> > > > > > > > > > > be
> > > > > > > > > > > the
> > > > > > Rely
> > > > > > > > > > > plot,
> > > > > > > > > > > but what is the other redline coming from?
Please let
> > > > > > > > > > > me
> > > > > > > > > > > know if
> > > > > > > > > > > any
> > > > > > > > > > other
> > > > > > > > > > > information is needed. Thank you.
> > > > > > > > > > >
> > > > > > > > > > > Binyu
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: What does the extra refer to
From: Tatiana Burek
Time: Mon May 17 09:49:32 2021
Binyu
The problem is how you point your data for coping. The data gets put
to /data/mv_data/binyu.wang/ directory directly but in the XML it
specified as /data/mv_data/binyu.wang/stat. So METviewer can't find
the data to load.
Could you edit your XML:
replace
<folder_tmpl>//data/mv_data/binyu.wang//{type}</folder_tmpl>
<load_val>
<field name="type">
<val>stat</val>
</field>
</load_val>
with:
<folder_tmpl>//data/mv_data/{name}/</folder_tmpl>
<load_val>
<field name="name">
<val>binyu.wang</val>
</field>
</load_val>
Tatiana
On Mon May 17 09:02:06 2021, binyu.wang at noaa.gov wrote:
> Hello, Tatiana
>
> I just tested again but still got the same thing. Thank you for your
> help.
>
>
> On Mon, May 17, 2021 at 10:17 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Binyu
> >
> > I commented out some parts of the script where it removes the data
> > from
> > the server.
> > Could you please run your load again. This is for the debugging
> > reasons so
> > don't expect any changes yet. Let me know when it is done.
> >
> > Tatiana
> >
> > On Sat May 15 19:23:20 2021, binyu.wang at noaa.gov wrote:
> > > Hello Tatiana,
> > >
> > > I just tested the data again, I didn't get the "No space left"
> > > message
> > > this
> > > time, but I got the same log file as before (see below): no
error,
> > > but no
> > > data was uploaded at all. As I said last time, the data is NOT
> > > empty.
> > >
> > > ---- MVLoad ----
> > >
> > >
> > > Version: 4.0.0
> > >
> > >
> > > Begin time: 2021-05-16 01:15:06
> > >
> > > Parsing: load_g2g_met_verf_Bezy.xml
> > >
> > >
> > > Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
> > >
> > > ==== grid_stat ====
> > >
> > >
> > > stat_header table time total: 0:00:00.000
> > >
> > > stat header records: 0
> > >
> > > stat header inserts: 0
> > >
> > > line data records: 0
> > >
> > > line data inserts: 0
> > >
> > > stat group records: 0
> > >
> > > stat group inserts: 0
> > >
> > > var length records: 0
> > >
> > > var length inserts: 0
> > >
> > > total lines: 0
> > >
> > > insert size: 1
> > >
> > > lines / msec: 0.000
> > >
> > > num files: 0
> > >
> > >
> > > ==== mode ====
> > >
> > >
> > > mode_header search time total: 0:00:00.000
> > >
> > > mtd_header search time total: 0:00:00.000
> > >
> > > stat_header search time total: 0:00:00.000
> > >
> > > mode_header inserts: 0
> > >
> > > mode_cts inserts: 0
> > >
> > > mode_obj_single inserts: 0
> > >
> > > mode_obj_pair inserts: 0
> > >
> > > ==== mtd ====
> > >
> > >
> > > mtd_header inserts: 0
> > >
> > > mtd_3d_obj_single inserts: 0
> > >
> > > mtd_3d_obj_pair inserts: 0
> > >
> > > mtd_2d_obj inserts: 0
> > >
> > > total lines: 0
> > >
> > > num files: 0
> > >
> > > num files: 0
> > >
> > >
> > > ==== indexes ====creating
> > >
> > > Indexes creating 0:00:00.594
> > >
> > >
> > > End time: 2021-05-16 01:15:07
> > >
> > > Load total: 0:00:00.006
> > >
> > >
> > > Thank you.
> > >
> > > On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > I also got the same error and submitted the request to fix it
to
> > > > the
> > > > AWS
> > > > sys admins.
> > > >
> > > > Lets wait till it fixed. I will let you know when to resume
the
> > > > loading.
> > > >
> > > > Tatiana
> > > > On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > > > > Tatiana,
> > > > > Yes, they are not empty ( I even can not load those files
that
> > > > > I
> > > > > used
> > > > > to
> > > > > be yesterday morning) . And this morning I got this as below
> > > > > when I
> > > > > tried
> > > > > to load it
> > > > > :
> > > > >
> > > > > load_g2g_met_verf_Bezy.xml
> > > > > 0% 0
> > > > > 0.0KB/s
> > > > > --:--
> > > > > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No
space
> > > > > left
> > > > > on
> > > > > device
> > > > >
> > > > > load_g2g_met_verf_Bezy.xml
> > > > > 100% 1016
> > > > > 28.9KB/s
> > > > > 00:00
> > > > >
> > > > >
> > > > > ERROR: Command returned with non-zero status (1): scp
> > > > >
> > > >
> >
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > > > > binyu.wang at 205.156.8.85:~
> > > > >
> > > > > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Binyu
> > > > > >
> > > > > > From your logs I do see that your data get copied to the
> > > > > > server
> > > > > > and
> > > > > > METviever attempts to load it.
> > > > > > I don't have the access to WCOSS and can't see your data.
> > > > > > Please
> > > > > > make
> > > > > > sure
> > > > > > that your files are not empty and if it is let me know.
> > > > > >
> > > > > > Tatiana
> > > > > >
> > > > > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > > > > Hello, Tatiana
> > > > > > >
> > > > > > > I am not sure what's the problem, but the same weird
thing
> > > > > > > happen
> > > > > > > again:
> > > > > > >
> > > > > > > I tried to load some files to the database, the log file
> > > > > > > looks
> > > > > > > fine
> > > > > > > at
> > > > > > the
> > > > > > > beginning, but if you look at the bottom, you can tell
the
> > > > > > > loading
> > > > > > > is not
> > > > > > > successful because the records are "0". Below is the
> > > > > > > script:
> > > > > > >
> > > > > > >
> > > > > >
> > > >
> >
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > > > > >
> > > > > > >
> > > >
> >
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > > > > >
> > > > > > > BASE_DIR
> > > > > > >
> > > >
> >
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > > > > >
> > > > > > >
> > > > > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
> > > > > > > mv_g2g_met_verf_Bezy
> > > > > > >
> > > > > > > echo "Create database done!"
> > > > > > >
> > > > > > >
> > > > > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > > > > /load_g2g_met_verf_Bezy.xml
> > > > > > >
> > > > > > >
> > > > > > > The XML file is attached as well. Thank you.
> > > > > > >
> > > > > > >
> > > > > > > Binyu
> > > > > > >
> > > > > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > You are correct. We released and deployed METviewer
4.0.0
> > > > > > > > today.
> > > > > > > >
> > > > > > > > Tatiana
> > > > > > > >
> > > > > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > Hello Tatiana,
> > > > > > > > >
> > > > > > > > > Thank you. I now see the 3 options. I didn't see it
> > > > > > > > > yesterday.
> > > > > > > > > It
> > > > > > > > > seems
> > > > > > > > > there was some update on METviewer today, isn't it?
> > > > > > > > >
> > > > > > > > > Binyu
> > > > > > > > >
> > > > > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via RT
> > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Binyu,
> > > > > > > > > >
> > > > > > > > > > You are correct - the jointed line with the small
> > > > > > > > > > cycles
> > > > > > > > > > is
> > > > > > > > > > the
> > > > > > Rely
> > > > > > > > > > plot.
> > > > > > > > > > The gray diagonal line is the perfect reliability
> > > > > > > > > > line
> > > > > > > > > > and
> > > > > > > > > > the
> > > > > > dotted
> > > > > > > > > > red
> > > > > > > > > > line is no-skill line.
> > > > > > > > > > You can add or remove these lines as well as no-
> > > > > > > > > > resolution
> > > > > > > > > > line by
> > > > > > > > > > checking/unchecking corresponding check boxes in
the
> > > > > > > > > > Rely
> > > > > > > > > > web
> > > > > > > > > > page.
> > > > > > > > > >
> > > > > > > > > > Tatiana
> > > > > > > > > >
> > > > > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov
> > > > > > > > > > wrote:
> > > > > > > > > > > Hello,
> > > > > > > > > > >
> > > > > > > > > > > I was trying to make a RELY plot using
METviewer,
> > > > > > > > > > > please
> > > > > > > > > > > see plot
> > > > > > > > > > > "20210513_030219"
> > > > > > > > > > > under METviwer
> > > > > > > > > > > (https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > > > > The
> > > > > > > > > > > red
> > > > > > > > > > > line on the top (jointed line with small cycles)
> > > > > > > > > > > should
> > > > > > > > > > > be
> > > > > > > > > > > the
> > > > > > Rely
> > > > > > > > > > > plot,
> > > > > > > > > > > but what is the other redline coming from?
Please
> > > > > > > > > > > let
> > > > > > > > > > > me
> > > > > > > > > > > know if
> > > > > > > > > > > any
> > > > > > > > > > other
> > > > > > > > > > > information is needed. Thank you.
> > > > > > > > > > >
> > > > > > > > > > > Binyu
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: What does the extra refer to
From: binyu.wang at noaa.gov
Time: Mon May 17 10:14:01 2021
You are right, I forgot to move the *stat files to "stat" directory.
It now
works. Thank you.
On Mon, May 17, 2021 at 11:49 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Binyu
>
> The problem is how you point your data for coping. The data gets put
to
> /data/mv_data/binyu.wang/ directory directly but in the XML it
specified as
> /data/mv_data/binyu.wang/stat. So METviewer can't find the data to
load.
> Could you edit your XML:
> replace
> <folder_tmpl>//data/mv_data/binyu.wang//{type}</folder_tmpl>
> <load_val>
> <field name="type">
> <val>stat</val>
> </field>
> </load_val>
>
> with:
> <folder_tmpl>//data/mv_data/{name}/</folder_tmpl>
> <load_val>
> <field name="name">
> <val>binyu.wang</val>
> </field>
> </load_val>
>
> Tatiana
>
> On Mon May 17 09:02:06 2021, binyu.wang at noaa.gov wrote:
> > Hello, Tatiana
> >
> > I just tested again but still got the same thing. Thank you for
your
> > help.
> >
> >
> > On Mon, May 17, 2021 at 10:17 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Binyu
> > >
> > > I commented out some parts of the script where it removes the
data
> > > from
> > > the server.
> > > Could you please run your load again. This is for the debugging
> > > reasons so
> > > don't expect any changes yet. Let me know when it is done.
> > >
> > > Tatiana
> > >
> > > On Sat May 15 19:23:20 2021, binyu.wang at noaa.gov wrote:
> > > > Hello Tatiana,
> > > >
> > > > I just tested the data again, I didn't get the "No space left"
> > > > message
> > > > this
> > > > time, but I got the same log file as before (see below): no
error,
> > > > but no
> > > > data was uploaded at all. As I said last time, the data is
NOT
> > > > empty.
> > > >
> > > > ---- MVLoad ----
> > > >
> > > >
> > > > Version: 4.0.0
> > > >
> > > >
> > > > Begin time: 2021-05-16 01:15:06
> > > >
> > > > Parsing: load_g2g_met_verf_Bezy.xml
> > > >
> > > >
> > > > Permutation 1 of 1 - //data/mv_data/binyu.wang//stat
> > > >
> > > > ==== grid_stat ====
> > > >
> > > >
> > > > stat_header table time total: 0:00:00.000
> > > >
> > > > stat header records: 0
> > > >
> > > > stat header inserts: 0
> > > >
> > > > line data records: 0
> > > >
> > > > line data inserts: 0
> > > >
> > > > stat group records: 0
> > > >
> > > > stat group inserts: 0
> > > >
> > > > var length records: 0
> > > >
> > > > var length inserts: 0
> > > >
> > > > total lines: 0
> > > >
> > > > insert size: 1
> > > >
> > > > lines / msec: 0.000
> > > >
> > > > num files: 0
> > > >
> > > >
> > > > ==== mode ====
> > > >
> > > >
> > > > mode_header search time total: 0:00:00.000
> > > >
> > > > mtd_header search time total: 0:00:00.000
> > > >
> > > > stat_header search time total: 0:00:00.000
> > > >
> > > > mode_header inserts: 0
> > > >
> > > > mode_cts inserts: 0
> > > >
> > > > mode_obj_single inserts: 0
> > > >
> > > > mode_obj_pair inserts: 0
> > > >
> > > > ==== mtd ====
> > > >
> > > >
> > > > mtd_header inserts: 0
> > > >
> > > > mtd_3d_obj_single inserts: 0
> > > >
> > > > mtd_3d_obj_pair inserts: 0
> > > >
> > > > mtd_2d_obj inserts: 0
> > > >
> > > > total lines: 0
> > > >
> > > > num files: 0
> > > >
> > > > num files: 0
> > > >
> > > >
> > > > ==== indexes ====creating
> > > >
> > > > Indexes creating 0:00:00.594
> > > >
> > > >
> > > > End time: 2021-05-16 01:15:07
> > > >
> > > > Load total: 0:00:00.006
> > > >
> > > >
> > > > Thank you.
> > > >
> > > > On Fri, May 14, 2021 at 10:36 AM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > I also got the same error and submitted the request to fix
it to
> > > > > the
> > > > > AWS
> > > > > sys admins.
> > > > >
> > > > > Lets wait till it fixed. I will let you know when to resume
the
> > > > > loading.
> > > > >
> > > > > Tatiana
> > > > > On Fri May 14 08:21:37 2021, binyu.wang at noaa.gov wrote:
> > > > > > Tatiana,
> > > > > > Yes, they are not empty ( I even can not load those files
that
> > > > > > I
> > > > > > used
> > > > > > to
> > > > > > be yesterday morning) . And this morning I got this as
below
> > > > > > when I
> > > > > > tried
> > > > > > to load it
> > > > > > :
> > > > > >
> > > > > > load_g2g_met_verf_Bezy.xml
> > > > > > 0% 0
> > > > > > 0.0KB/s
> > > > > > --:--
> > > > > > ETAscp: /home/binyu.wang/load_g2g_met_verf_Bezy.xml: No
space
> > > > > > left
> > > > > > on
> > > > > > device
> > > > > >
> > > > > > load_g2g_met_verf_Bezy.xml
> > > > > > 100% 1016
> > > > > > 28.9KB/s
> > > > > > 00:00
> > > > > >
> > > > > >
> > > > > > ERROR: Command returned with non-zero status (1): scp
> > > > > >
> > > > >
> > >
>
/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML/load_g2g_met_verf_Bezy.xml
> > > > > > binyu.wang at 205.156.8.85:~
> > > > > >
> > > > > > On Fri, May 14, 2021 at 9:42 AM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Binyu
> > > > > > >
> > > > > > > From your logs I do see that your data get copied to the
> > > > > > > server
> > > > > > > and
> > > > > > > METviever attempts to load it.
> > > > > > > I don't have the access to WCOSS and can't see your
data.
> > > > > > > Please
> > > > > > > make
> > > > > > > sure
> > > > > > > that your files are not empty and if it is let me know.
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > > On Thu May 13 21:38:41 2021, binyu.wang at noaa.gov wrote:
> > > > > > > > Hello, Tatiana
> > > > > > > >
> > > > > > > > I am not sure what's the problem, but the same weird
thing
> > > > > > > > happen
> > > > > > > > again:
> > > > > > > >
> > > > > > > > I tried to load some files to the database, the log
file
> > > > > > > > looks
> > > > > > > > fine
> > > > > > > > at
> > > > > > > the
> > > > > > > > beginning, but if you look at the bottom, you can tell
the
> > > > > > > > loading
> > > > > > > > is not
> > > > > > > > successful because the records are "0". Below is the
> > > > > > > > script:
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > >
> > >
>
SCRIPT=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/script
> > > > > > > >
> > > > > > > >
> > > > >
> > >
>
XML=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/METviewer_AWS/g2g/XML
> > > > > > > >
> > > > > > > > BASE_DIR
> > > > > > > >
> > > > >
> > >
>
=/gpfs/dell2/emc/modeling/noscrub/Binyu.Wang/MET/stat/Bezy_31.thresh.0p1
> > > > > > > >
> > > > > > > >
> > > > > > > > $SCRIPT/mv_create_db_on_aws.sh binyu.wang
> > > > > > > > mv_g2g_met_verf_Bezy
> > > > > > > >
> > > > > > > > echo "Create database done!"
> > > > > > > >
> > > > > > > >
> > > > > > > > $SCRIPT/mv_load_to_aws.sh binyu.wang $BASE_DIR $XML
> > > > > > > > /load_g2g_met_verf_Bezy.xml
> > > > > > > >
> > > > > > > >
> > > > > > > > The XML file is attached as well. Thank you.
> > > > > > > >
> > > > > > > >
> > > > > > > > Binyu
> > > > > > > >
> > > > > > > > On Thu, May 13, 2021 at 3:37 PM Tatiana Burek via RT
> > > > > > > > <met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > You are correct. We released and deployed METviewer
4.0.0
> > > > > > > > > today.
> > > > > > > > >
> > > > > > > > > Tatiana
> > > > > > > > >
> > > > > > > > > On Thu May 13 13:18:38 2021, binyu.wang at noaa.gov
wrote:
> > > > > > > > > > Hello Tatiana,
> > > > > > > > > >
> > > > > > > > > > Thank you. I now see the 3 options. I didn't see
it
> > > > > > > > > > yesterday.
> > > > > > > > > > It
> > > > > > > > > > seems
> > > > > > > > > > there was some update on METviewer today, isn't
it?
> > > > > > > > > >
> > > > > > > > > > Binyu
> > > > > > > > > >
> > > > > > > > > > On Thu, May 13, 2021 at 2:13 PM Tatiana Burek via
RT
> > > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > > > Binyu,
> > > > > > > > > > >
> > > > > > > > > > > You are correct - the jointed line with the
small
> > > > > > > > > > > cycles
> > > > > > > > > > > is
> > > > > > > > > > > the
> > > > > > > Rely
> > > > > > > > > > > plot.
> > > > > > > > > > > The gray diagonal line is the perfect
reliability
> > > > > > > > > > > line
> > > > > > > > > > > and
> > > > > > > > > > > the
> > > > > > > dotted
> > > > > > > > > > > red
> > > > > > > > > > > line is no-skill line.
> > > > > > > > > > > You can add or remove these lines as well as no-
> > > > > > > > > > > resolution
> > > > > > > > > > > line by
> > > > > > > > > > > checking/unchecking corresponding check boxes in
the
> > > > > > > > > > > Rely
> > > > > > > > > > > web
> > > > > > > > > > > page.
> > > > > > > > > > >
> > > > > > > > > > > Tatiana
> > > > > > > > > > >
> > > > > > > > > > > On Wed May 12 21:10:23 2021, binyu.wang at noaa.gov
> > > > > > > > > > > wrote:
> > > > > > > > > > > > Hello,
> > > > > > > > > > > >
> > > > > > > > > > > > I was trying to make a RELY plot using
METviewer,
> > > > > > > > > > > > please
> > > > > > > > > > > > see plot
> > > > > > > > > > > > "20210513_030219"
> > > > > > > > > > > > under METviwer
> > > > > > > > > > > >
(https://metviewer.nws.noaa.gov/metviewer1.jsp).
> > > > > > > The
> > > > > > > > > > > > red
> > > > > > > > > > > > line on the top (jointed line with small
cycles)
> > > > > > > > > > > > should
> > > > > > > > > > > > be
> > > > > > > > > > > > the
> > > > > > > Rely
> > > > > > > > > > > > plot,
> > > > > > > > > > > > but what is the other redline coming from?
Please
> > > > > > > > > > > > let
> > > > > > > > > > > > me
> > > > > > > > > > > > know if
> > > > > > > > > > > > any
> > > > > > > > > > > other
> > > > > > > > > > > > information is needed. Thank you.
> > > > > > > > > > > >
> > > > > > > > > > > > Binyu
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list