[Met_help] [rt.rap.ucar.edu #95193] History for question about METViewer V2.11 (UNCLASSIFIED)
Tatiana Burek via RT
met_help at ucar.edu
Tue Oct 13 12:07:40 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
CLASSIFICATION: UNCLASSIFIED
If I want to generate a plot showing aggregated ME values instead of those
produced by averaging previously computed ME values what do I need to do? I
created a plot of ME for each valid time from 00Z to 23Z using the "Summary
Statistics" method and then tried clicking on "Aggregation Statistics", then
"Scalar partial sums", but the there was an error and it could not generate
the plot. The attached plot shows the plot I generated using the Summary
Statistics method. For this plot, you can see that the values of NStat at
the top along the x-axis indicate that 3 ME values were averaged to produce
the plotted ME value. I need to plot aggregated ME values instead of
averaged ME values.
Thanks.
R/
John
Mr. John W. Raby
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
Office:(575) 678-2004 DSN 258-2004
Teleworking: Contact Admin Specialist at (410) 278-6974
FAX (575) 678-1230 DSN 258-1230
Email: john.w.raby2.civ at mail.mil
CLASSIFICATION: UNCLASSIFIED
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: John Halley Gotway
Time: Thu May 07 17:34:41 2020
Hi John,
I see you'd like some direction as to how you can change from plotting
the
mean of daily statistics to plotting an aggregate statistics in
METviewer.
It sounds like you're on the right track. To briefly outline the
logic, you
are currently...
(1) Telling METviewer to query the ME statistic from the table which
stores
the CNT line type. Then METviewer summarizes multiple ME statistics
by
computing their mean (or median, depending on which you choose).
And what you'd like to do instead is...
(2) Tell METviewer to query the partial sum statistics from the table
which
stores the SL1L2 line type. Then METviewer aggregates multiple SL1L2
partial sums by computing their weighted average, where the weight is
determined by the TOTAL column (which is the number of matched pairs).
Then recompute the ME statistic from the aggregated partial sums.
Since we're talking about ME, you'll find that both (1) and (2)
produce the
same result as long as TOTAL remains constant. However, if the number
of
matched pairs on day 1 is more than the numbers on days 2 and 3, it'll
have
greater weight.
To illustrate, I worked up a simple example using this METviewer
instance:
http://www.dtcenter.org/met/metviewer/metviewer1.jsp
The ME_mean value plot illustrates (1) while MET_agg illustrates (2).
I
manually fixed the Y1 axis so they are the same on both plots. You'll
notice that the results are very slightly different. So the number of
matched pairs must have changed over the 7 cases being plotted.
Note that you can save the .xml files to your local machine, and then
use
the "Load XML" button on METviewer to recover my state. But to
clarify, the
differences are:
- In the "Statistics" box, change from "Summary" to "Aggregation
Statistics".
- And also change the dropdown list from "None" to "Scalar partial
sums
(SL1L2)".
This will only work if your database actually contains that SL1L2
data.
Hope that example helps.
Thanks,
John
On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
> Queue: met_help
> Subject: question about METViewer V2.11 (UNCLASSIFIED)
> Owner: Nobody
> Requestors: john.w.raby2.civ at mail.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
>
>
> CLASSIFICATION: UNCLASSIFIED
>
> If I want to generate a plot showing aggregated ME values instead of
those
> produced by averaging previously computed ME values what do I need
to do? I
> created a plot of ME for each valid time from 00Z to 23Z using the
"Summary
> Statistics" method and then tried clicking on "Aggregation
Statistics",
> then
> "Scalar partial sums", but the there was an error and it could not
generate
> the plot. The attached plot shows the plot I generated using the
Summary
> Statistics method. For this plot, you can see that the values of
NStat at
> the top along the x-axis indicate that 3 ME values were averaged to
produce
> the plotted ME value. I need to plot aggregated ME values instead of
> averaged ME values.
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri May 08 08:57:01 2020
CLASSIFICATION: UNCLASSIFIED
John -
Thanks for the detailed explanation which focused exactly on what I'm
trying
to do. I checked my database to confirm it has the table for the SL1L2
line
type. ("line_data_sl1l2" appears after command "show tables;" )
I checked the .stat files which were loaded into the database and they
contain
the SL1L2 LINE_TYPE.
I've attached a screen capture of my METViewer (web UI) display to
show my
settings and the XML output file for the failed plot. I've also
attached the
"load_spec_file" which I used to load the database in case you can see
how I
loaded the data. I clicked on the "Log" tab on the right side of the
UI page
and the dialog had an error because it needs the GSL library to
function. See
the attached log file. I recall that my sysadmin was able to install
GSL
(gsl-devel) using the instructions provided by Tatiana, but when we
tried to
load the R package for GSL (install.packages('gsl')) we encountered a
problem
and never resolved it. We decided that the impact of not having it was
not
significant at the time. Is this possibly causing the problem or
something
else?
R/
John
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Thursday, May 7, 2020 5:35 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
Hi John,
I see you'd like some direction as to how you can change from plotting
the
mean of daily statistics to plotting an aggregate statistics in
METviewer.
It sounds like you're on the right track. To briefly outline the
logic, you
are currently...
(1) Telling METviewer to query the ME statistic from the table which
stores
the CNT line type. Then METviewer summarizes multiple ME statistics
by
computing their mean (or median, depending on which you choose).
And what you'd like to do instead is...
(2) Tell METviewer to query the partial sum statistics from the table
which
stores the SL1L2 line type. Then METviewer aggregates multiple SL1L2
partial
sums by computing their weighted average, where the weight is
determined by
the TOTAL column (which is the number of matched pairs).
Then recompute the ME statistic from the aggregated partial sums.
Since we're talking about ME, you'll find that both (1) and (2)
produce the
same result as long as TOTAL remains constant. However, if the number
of
matched pairs on day 1 is more than the numbers on days 2 and 3, it'll
have
greater weight.
To illustrate, I worked up a simple example using this METviewer
instance:
Caution-http://www.dtcenter.org/met/metviewer/metviewer1.jsp
The ME_mean value plot illustrates (1) while MET_agg illustrates (2).
I
manually fixed the Y1 axis so they are the same on both plots. You'll
notice
that the results are very slightly different. So the number of
matched pairs
must have changed over the 7 cases being plotted.
Note that you can save the .xml files to your local machine, and then
use the
"Load XML" button on METviewer to recover my state. But to clarify,
the
differences are:
- In the "Statistics" box, change from "Summary" to "Aggregation
Statistics".
- And also change the dropdown list from "None" to "Scalar partial
sums
(SL1L2)".
This will only work if your database actually contains that SL1L2
data.
Hope that example helps.
Thanks,
John
On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
> Queue: met_help
> Subject: question about METViewer V2.11 (UNCLASSIFIED)
> Owner: Nobody
> Requestors: john.w.raby2.civ at mail.mil
> Status: new
> Ticket <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
>
>
> CLASSIFICATION: UNCLASSIFIED
>
> If I want to generate a plot showing aggregated ME values instead of
> those produced by averaging previously computed ME values what do I
> need to do? I created a plot of ME for each valid time from 00Z to
23Z
> using the "Summary Statistics" method and then tried clicking on
> "Aggregation Statistics", then "Scalar partial sums", but the there
> was an error and it could not generate the plot. The attached plot
> shows the plot I generated using the Summary Statistics method. For
> this plot, you can see that the values of NStat at the top along the
> x-axis indicate that 3 ME values were averaged to produce the
plotted
> ME value. I need to plot aggregated ME values instead of averaged ME
> values.
>
> Thanks.
>
> R/
> John
>
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
>
> CLASSIFICATION: UNCLASSIFIED
>
>
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri May 08 08:57:01 2020
<load_spec>
<connection>
<host>carson2.arl.army.mil:3306</host>
<database>mv_URMAval6</database>
<user>ruser</user>
<password>whitesands</password>
<management_system>mariadb</management_system>
</connection>
<verbose>true</verbose>
<insert_size>1</insert_size>
<mode_header_db_check>false</mode_header_db_check>
<stat_header_db_check>true</stat_header_db_check>
<drop_indexes>false</drop_indexes>
<apply_indexes>true</apply_indexes>
<group>URMA_validation6</group>
<load_stat>true</load_stat>
<load_mode>false</load_mode>
<load_mtd>false</load_mtd>
<load_mpr>true</load_mpr>
<load_orank>false</load_orank>
<folder_tmpl>/home/jraby/MET_PointStat_URMA_validation_MSAregion/{run}</folder_tmpl>
<load_val>
<field name="run">
<val>combined_STAT_11-14NOV2016</val>
</field>
</load_val>
</load_spec>
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: John Halley Gotway
Time: Fri May 08 10:00:02 2020
John,
I'm going to reassign this ticket to Tatiana. I think she'd be better
suited to debug it with you.
Thanks,
John
On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> John -
>
> Thanks for the detailed explanation which focused exactly on what
I'm
> trying
> to do. I checked my database to confirm it has the table for the
SL1L2
> line
> type. ("line_data_sl1l2" appears after command "show tables;" )
>
> I checked the .stat files which were loaded into the database and
they
> contain
> the SL1L2 LINE_TYPE.
>
> I've attached a screen capture of my METViewer (web UI) display to
show my
> settings and the XML output file for the failed plot. I've also
attached
> the
> "load_spec_file" which I used to load the database in case you can
see how
> I
> loaded the data. I clicked on the "Log" tab on the right side of the
UI
> page
> and the dialog had an error because it needs the GSL library to
function.
> See
> the attached log file. I recall that my sysadmin was able to install
GSL
> (gsl-devel) using the instructions provided by Tatiana, but when we
tried
> to
> load the R package for GSL (install.packages('gsl')) we encountered
a
> problem
> and never resolved it. We decided that the impact of not having it
was not
> significant at the time. Is this possibly causing the problem or
something
> else?
>
> R/
> John
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, May 7, 2020 5:35 PM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hi John,
>
> I see you'd like some direction as to how you can change from
plotting the
> mean of daily statistics to plotting an aggregate statistics in
METviewer.
>
> It sounds like you're on the right track. To briefly outline the
logic,
> you
> are currently...
> (1) Telling METviewer to query the ME statistic from the table which
> stores
> the CNT line type. Then METviewer summarizes multiple ME statistics
by
> computing their mean (or median, depending on which you choose).
>
> And what you'd like to do instead is...
> (2) Tell METviewer to query the partial sum statistics from the
table
> which
> stores the SL1L2 line type. Then METviewer aggregates multiple
SL1L2
> partial
> sums by computing their weighted average, where the weight is
determined
> by
> the TOTAL column (which is the number of matched pairs).
> Then recompute the ME statistic from the aggregated partial sums.
>
> Since we're talking about ME, you'll find that both (1) and (2)
produce
> the
> same result as long as TOTAL remains constant. However, if the
number of
> matched pairs on day 1 is more than the numbers on days 2 and 3,
it'll
> have
> greater weight.
>
> To illustrate, I worked up a simple example using this METviewer
instance:
> Caution-http://www.dtcenter.org/met/metviewer/metviewer1.jsp
>
> The ME_mean value plot illustrates (1) while MET_agg illustrates
(2). I
> manually fixed the Y1 axis so they are the same on both plots.
You'll
> notice
> that the results are very slightly different. So the number of
matched
> pairs
> must have changed over the 7 cases being plotted.
>
> Note that you can save the .xml files to your local machine, and
then use
> the
> "Load XML" button on METviewer to recover my state. But to clarify,
the
> differences are:
> - In the "Statistics" box, change from "Summary" to "Aggregation
> Statistics".
> - And also change the dropdown list from "None" to "Scalar partial
sums
> (SL1L2)".
>
> This will only work if your database actually contains that SL1L2
data.
>
> Hope that example helps.
>
> Thanks,
> John
>
> On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > Queue: met_help
> > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > Owner: Nobody
> > Requestors: john.w.raby2.civ at mail.mil
> > Status: new
> > Ticket <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > If I want to generate a plot showing aggregated ME values instead
of
> > those produced by averaging previously computed ME values what do
I
> > need to do? I created a plot of ME for each valid time from 00Z to
23Z
> > using the "Summary Statistics" method and then tried clicking on
> > "Aggregation Statistics", then "Scalar partial sums", but the
there
> > was an error and it could not generate the plot. The attached plot
> > shows the plot I generated using the Summary Statistics method.
For
> > this plot, you can see that the values of NStat at the top along
the
> > x-axis indicate that 3 ME values were averaged to produce the
plotted
> > ME value. I need to plot aggregated ME values instead of averaged
ME
> > values.
> >
> > Thanks.
> >
> > R/
> > John
> >
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Tatiana Burek
Time: Mon May 11 09:51:39 2020
Hi John,
I remember you were having difficulties installing gsl package for R
so we decided not to install it for that moment and proseed with it
when it is needed.
>From your log file I see that you run agg_stat.R which requires gsl
only for some operations.
We can start from commenting out this library and rerun your plot.
Hopefully, it will work for you and we can postpone installing gsl for
later. But if you continue to get errors from this script - then gsl
has to be installed.
To comment out gsl you need:
1. Write privileges for
/opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
2. If you can edit this file, open it
3. Put # before library(gsl);
it should look like this: #library(gsl);
4. Save file
5. Rerun your plot.
Let me know if this works for you or we need to install gsl
Tatiana
On Fri May 08 10:00:02 2020, johnhg wrote:
> John,
>
> I'm going to reassign this ticket to Tatiana. I think she'd be
better
> suited to debug it with you.
>
> Thanks,
> John
>
> On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > John -
> >
> > Thanks for the detailed explanation which focused exactly on what
I'm
> > trying
> > to do. I checked my database to confirm it has the table for the
SL1L2
> > line
> > type. ("line_data_sl1l2" appears after command "show tables;" )
> >
> > I checked the .stat files which were loaded into the database and
they
> > contain
> > the SL1L2 LINE_TYPE.
> >
> > I've attached a screen capture of my METViewer (web UI) display to
show my
> > settings and the XML output file for the failed plot. I've also
attached
> > the
> > "load_spec_file" which I used to load the database in case you can
see how
> > I
> > loaded the data. I clicked on the "Log" tab on the right side of
the UI
> > page
> > and the dialog had an error because it needs the GSL library to
function.
> > See
> > the attached log file. I recall that my sysadmin was able to
install GSL
> > (gsl-devel) using the instructions provided by Tatiana, but when
we tried
> > to
> > load the R package for GSL (install.packages('gsl')) we
encountered a
> > problem
> > and never resolved it. We decided that the impact of not having it
was not
> > significant at the time. Is this possibly causing the problem or
something
> > else?
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> > Sent: Thursday, May 7, 2020 5:35 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
about
> > METViewer V2.11 (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
verify the
> > identity of the sender, and confirm the authenticity of all links
> > contained
> > within the message prior to copying and pasting the address to a
Web
> > browser.
> >
> >
> >
> >
> > ----
> >
> > Hi John,
> >
> > I see you'd like some direction as to how you can change from
plotting the
> > mean of daily statistics to plotting an aggregate statistics in
METviewer.
> >
> > It sounds like you're on the right track. To briefly outline the
logic,
> > you
> > are currently...
> > (1) Telling METviewer to query the ME statistic from the table
which
> > stores
> > the CNT line type. Then METviewer summarizes multiple ME
statistics by
> > computing their mean (or median, depending on which you choose).
> >
> > And what you'd like to do instead is...
> > (2) Tell METviewer to query the partial sum statistics from the
table
> > which
> > stores the SL1L2 line type. Then METviewer aggregates multiple
SL1L2
> > partial
> > sums by computing their weighted average, where the weight is
determined
> > by
> > the TOTAL column (which is the number of matched pairs).
> > Then recompute the ME statistic from the aggregated partial sums.
> >
> > Since we're talking about ME, you'll find that both (1) and (2)
produce
> > the
> > same result as long as TOTAL remains constant. However, if the
number of
> > matched pairs on day 1 is more than the numbers on days 2 and 3,
it'll
> > have
> > greater weight.
> >
> > To illustrate, I worked up a simple example using this METviewer
instance:
> > Caution-http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> >
> > The ME_mean value plot illustrates (1) while MET_agg illustrates
(2). I
> > manually fixed the Y1 axis so they are the same on both plots.
You'll
> > notice
> > that the results are very slightly different. So the number of
matched
> > pairs
> > must have changed over the 7 cases being plotted.
> >
> > Note that you can save the .xml files to your local machine, and
then use
> > the
> > "Load XML" button on METviewer to recover my state. But to
clarify, the
> > differences are:
> > - In the "Statistics" box, change from "Summary" to "Aggregation
> > Statistics".
> > - And also change the dropdown list from "None" to "Scalar partial
sums
> > (SL1L2)".
> >
> > This will only work if your database actually contains that SL1L2
data.
> >
> > Hope that example helps.
> >
> > Thanks,
> > John
> >
> > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > Queue: met_help
> > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > Owner: Nobody
> > > Requestors: john.w.raby2.civ at mail.mil
> > > Status: new
> > > Ticket <Caution-url:
> > > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193
>
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > If I want to generate a plot showing aggregated ME values
instead of
> > > those produced by averaging previously computed ME values what
do I
> > > need to do? I created a plot of ME for each valid time from 00Z
to 23Z
> > > using the "Summary Statistics" method and then tried clicking on
> > > "Aggregation Statistics", then "Scalar partial sums", but the
there
> > > was an error and it could not generate the plot. The attached
plot
> > > shows the plot I generated using the Summary Statistics method.
For
> > > this plot, you can see that the values of NStat at the top along
the
> > > x-axis indicate that 3 ME values were averaged to produce the
plotted
> > > ME value. I need to plot aggregated ME values instead of
averaged ME
> > > values.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Mon May 11 10:17:42 2020
CLASSIFICATION: UNCLASSIFIED
Hi Tatiana -
Thanks for your reply to address this issue. I tried to navigate to
the file
which you show in the path below, but it's not accessible from my home
on my
linux machine. I had been communicating with my system admin by email
on this
issue just when I received your email and I have just provided him
with your
fix. He confirmed that gsl-devel is installed and he is going to try
installing the R package for GSL first to see if he can reproduce the
original
error which I was getting last July and he may be able to fix that
issue
himself. If not, he will apply your fix. I will let you know how this
goes.
R/
John
-----Original Message-----
From: Tatiana Burek via RT [mailto:met_help at ucar.edu]
Sent: Monday, May 11, 2020 9:52 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer
V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
Hi John,
I remember you were having difficulties installing gsl package for R
so we
decided not to install it for that moment and proseed with it when it
is
needed.
>From your log file I see that you run agg_stat.R which requires gsl
only for
some operations.
We can start from commenting out this library and rerun your plot.
Hopefully,
it will work for you and we can postpone installing gsl for later. But
if you
continue to get errors from this script - then gsl has to be
installed.
To comment out gsl you need:
1. Write privileges for
/opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
2. If you can edit this file, open it
3. Put # before library(gsl);
it should look like this: #library(gsl); 4. Save file 5. Rerun your
plot.
Let me know if this works for you or we need to install gsl
Tatiana
On Fri May 08 10:00:02 2020, johnhg wrote:
> John,
>
> I'm going to reassign this ticket to Tatiana. I think she'd be
better
> suited to debug it with you.
>
> Thanks,
> John
>
> On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > John -
> >
> > Thanks for the detailed explanation which focused exactly on what
> > I'm trying to do. I checked my database to confirm it has the
table
> > for the SL1L2 line type. ("line_data_sl1l2" appears after command
> > "show tables;" )
> >
> > I checked the .stat files which were loaded into the database and
> > they contain the SL1L2 LINE_TYPE.
> >
> > I've attached a screen capture of my METViewer (web UI) display to
> > show my settings and the XML output file for the failed plot. I've
> > also attached the "load_spec_file" which I used to load the
database
> > in case you can see how I loaded the data. I clicked on the "Log"
> > tab on the right side of the UI page and the dialog had an error
> > because it needs the GSL library to function.
> > See
> > the attached log file. I recall that my sysadmin was able to
install
> > GSL
> > (gsl-devel) using the instructions provided by Tatiana, but when
we
> > tried to load the R package for GSL (install.packages('gsl')) we
> > encountered a problem and never resolved it. We decided that the
> > impact of not having it was not significant at the time. Is this
> > possibly causing the problem or something else?
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, May 7, 2020 5:35 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > about METViewer V2.11 (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify the identity of the sender, and confirm the authenticity of
> > all links contained within the message prior to copying and
pasting
> > the address to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Hi John,
> >
> > I see you'd like some direction as to how you can change from
> > plotting the mean of daily statistics to plotting an aggregate
statistics
> > in METviewer.
> >
> > It sounds like you're on the right track. To briefly outline the
> > logic, you are currently...
> > (1) Telling METviewer to query the ME statistic from the table
which
> > stores the CNT line type. Then METviewer summarizes multiple ME
> > statistics by computing their mean (or median, depending on which
> > you choose).
> >
> > And what you'd like to do instead is...
> > (2) Tell METviewer to query the partial sum statistics from the
> > table which stores the SL1L2 line type. Then METviewer aggregates
> > multiple SL1L2 partial sums by computing their weighted average,
> > where the weight is determined by the TOTAL column (which is the
> > number of matched pairs).
> > Then recompute the ME statistic from the aggregated partial sums.
> >
> > Since we're talking about ME, you'll find that both (1) and (2)
> > produce the same result as long as TOTAL remains constant.
However,
> > if the number of matched pairs on day 1 is more than the numbers
on
> > days 2 and 3, it'll have greater weight.
> >
> > To illustrate, I worked up a simple example using this METviewer
instance:
> > Caution-Caution-
http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> >
> > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > (2). I manually fixed the Y1 axis so they are the same on both
> > plots. You'll notice that the results are very slightly
different.
> > So the number of matched pairs must have changed over the 7 cases
> > being plotted.
> >
> > Note that you can save the .xml files to your local machine, and
> > then use the "Load XML" button on METviewer to recover my state.
But
> > to clarify, the differences are:
> > - In the "Statistics" box, change from "Summary" to "Aggregation
> > Statistics".
> > - And also change the dropdown list from "None" to "Scalar partial
> > sums (SL1L2)".
> >
> > This will only work if your database actually contains that SL1L2
data.
> >
> > Hope that example helps.
> >
> > Thanks,
> > John
> >
> > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > Queue: met_help
> > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > Owner: Nobody
> > > Requestors: john.w.raby2.civ at mail.mil
> > > Status: new
> > > Ticket <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > 95193 >
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > If I want to generate a plot showing aggregated ME values
instead
> > > of those produced by averaging previously computed ME values
what
> > > do I need to do? I created a plot of ME for each valid time from
> > > 00Z to 23Z using the "Summary Statistics" method and then tried
> > > clicking on "Aggregation Statistics", then "Scalar partial
sums",
> > > but the there was an error and it could not generate the plot.
The
> > > attached plot shows the plot I generated using the Summary
> > > Statistics method. For this plot, you can see that the values of
> > > NStat at the top along the x-axis indicate that 3 ME values were
> > > averaged to produce the plotted ME value. I need to plot
> > > aggregated ME values instead of averaged ME values.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Tue May 12 07:30:08 2020
CLASSIFICATION: UNCLASSIFIED
Tatiana -
My system admin was able to reproduce the error when attempting to
load the R
package for gsl. I sent him the info you provided me last July which
pointed
us in the direction of a potential version incompatibility issue which
might
be causing the error. He concluded yesterday that, he thinks the issue
is a
compatibility issue between the installed version of gsl (gsl-devel)
and that
expected by the R package. His next step is to try updating gsl to a
newer
version.
R/
John
-----Original Message-----
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, May 11, 2020 10:17 AM
To: 'met_help at ucar.edu' <met_help at ucar.edu>
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
CLASSIFICATION: UNCLASSIFIED
Hi Tatiana -
Thanks for your reply to address this issue. I tried to navigate to
the file
which you show in the path below, but it's not accessible from my home
on my
linux machine. I had been communicating with my system admin by email
on this
issue just when I received your email and I have just provided him
with your
fix. He confirmed that gsl-devel is installed and he is going to try
installing the R package for GSL first to see if he can reproduce the
original
error which I was getting last July and he may be able to fix that
issue
himself. If not, he will apply your fix. I will let you know how this
goes.
R/
John
-----Original Message-----
From: Tatiana Burek via RT [mailto:met_help at ucar.edu]
Sent: Monday, May 11, 2020 9:52 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer
V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
Hi John,
I remember you were having difficulties installing gsl package for R
so we
decided not to install it for that moment and proseed with it when it
is
needed.
>From your log file I see that you run agg_stat.R which requires gsl
only for
some operations.
We can start from commenting out this library and rerun your plot.
Hopefully,
it will work for you and we can postpone installing gsl for later. But
if you
continue to get errors from this script - then gsl has to be
installed.
To comment out gsl you need:
1. Write privileges for
/opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
2. If you can edit this file, open it
3. Put # before library(gsl);
it should look like this: #library(gsl); 4. Save file 5. Rerun your
plot.
Let me know if this works for you or we need to install gsl
Tatiana
On Fri May 08 10:00:02 2020, johnhg wrote:
> John,
>
> I'm going to reassign this ticket to Tatiana. I think she'd be
better
> suited to debug it with you.
>
> Thanks,
> John
>
> On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > John -
> >
> > Thanks for the detailed explanation which focused exactly on what
> > I'm trying to do. I checked my database to confirm it has the
table
> > for the SL1L2 line type. ("line_data_sl1l2" appears after command
> > "show tables;" )
> >
> > I checked the .stat files which were loaded into the database and
> > they contain the SL1L2 LINE_TYPE.
> >
> > I've attached a screen capture of my METViewer (web UI) display to
> > show my settings and the XML output file for the failed plot. I've
> > also attached the "load_spec_file" which I used to load the
database
> > in case you can see how I loaded the data. I clicked on the "Log"
> > tab on the right side of the UI page and the dialog had an error
> > because it needs the GSL library to function.
> > See
> > the attached log file. I recall that my sysadmin was able to
install
> > GSL
> > (gsl-devel) using the instructions provided by Tatiana, but when
we
> > tried to load the R package for GSL (install.packages('gsl')) we
> > encountered a problem and never resolved it. We decided that the
> > impact of not having it was not significant at the time. Is this
> > possibly causing the problem or something else?
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, May 7, 2020 5:35 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > about METViewer V2.11 (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify the identity of the sender, and confirm the authenticity of
> > all links contained within the message prior to copying and
pasting
> > the address to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Hi John,
> >
> > I see you'd like some direction as to how you can change from
> > plotting the mean of daily statistics to plotting an aggregate
statistics
> > in METviewer.
> >
> > It sounds like you're on the right track. To briefly outline the
> > logic, you are currently...
> > (1) Telling METviewer to query the ME statistic from the table
which
> > stores the CNT line type. Then METviewer summarizes multiple ME
> > statistics by computing their mean (or median, depending on which
> > you choose).
> >
> > And what you'd like to do instead is...
> > (2) Tell METviewer to query the partial sum statistics from the
> > table which stores the SL1L2 line type. Then METviewer aggregates
> > multiple SL1L2 partial sums by computing their weighted average,
> > where the weight is determined by the TOTAL column (which is the
> > number of matched pairs).
> > Then recompute the ME statistic from the aggregated partial sums.
> >
> > Since we're talking about ME, you'll find that both (1) and (2)
> > produce the same result as long as TOTAL remains constant.
However,
> > if the number of matched pairs on day 1 is more than the numbers
on
> > days 2 and 3, it'll have greater weight.
> >
> > To illustrate, I worked up a simple example using this METviewer
instance:
> > Caution-Caution-
http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> >
> > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > (2). I manually fixed the Y1 axis so they are the same on both
> > plots. You'll notice that the results are very slightly
different.
> > So the number of matched pairs must have changed over the 7 cases
> > being plotted.
> >
> > Note that you can save the .xml files to your local machine, and
> > then use the "Load XML" button on METviewer to recover my state.
But
> > to clarify, the differences are:
> > - In the "Statistics" box, change from "Summary" to "Aggregation
> > Statistics".
> > - And also change the dropdown list from "None" to "Scalar partial
> > sums (SL1L2)".
> >
> > This will only work if your database actually contains that SL1L2
data.
> >
> > Hope that example helps.
> >
> > Thanks,
> > John
> >
> > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > Queue: met_help
> > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > Owner: Nobody
> > > Requestors: john.w.raby2.civ at mail.mil
> > > Status: new
> > > Ticket <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > 95193 >
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > If I want to generate a plot showing aggregated ME values
instead
> > > of those produced by averaging previously computed ME values
what
> > > do I need to do? I created a plot of ME for each valid time from
> > > 00Z to 23Z using the "Summary Statistics" method and then tried
> > > clicking on "Aggregation Statistics", then "Scalar partial
sums",
> > > but the there was an error and it could not generate the plot.
The
> > > attached plot shows the plot I generated using the Summary
> > > Statistics method. For this plot, you can see that the values of
> > > NStat at the top along the x-axis indicate that 3 ME values were
> > > averaged to produce the plotted ME value. I need to plot
> > > aggregated ME values instead of averaged ME values.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu May 14 09:00:29 2020
CLASSIFICATION: UNCLASSIFIED
Tatiana -
My system admin successfully installed gsl and then installed the R
package for gsl. I did some testing, but I am still unable to generate
the plot of aggregated ME error. The error we are getting is as
follows:
==== Start Rscript error ====
Error: package or namespace load failed for ‘gsl’ in dyn.load(file,
DLLpath = DLLpath, ...):
unable to load shared object '/home/jraby/R/R-
3.6.1/library/gsl/libs/gsl.so':
libgsl.so.25: cannot open shared object file: No such file or
directory
Execution halted
The file gsl.so is on my system at the above location:
[jraby at carson2 libs]$ pwd
/home/jraby/R/R-3.6.1/library/gsl/libs
[jraby at carson2 libs]$ ll
total 388
-rwxrw-r--. 1 jraby users 394416 May 13 15:24 gsl.so
We are continuing to troubleshoot this error, but if you have any
ideas about the cause we would appreciate hearing from you.
Thanks.
R/
John
-----Original Message-----
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Tuesday, May 12, 2020 7:30 AM
To: 'met_help at ucar.edu' <met_help at ucar.edu>
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
CLASSIFICATION: UNCLASSIFIED
Tatiana -
My system admin was able to reproduce the error when attempting to
load the R
package for gsl. I sent him the info you provided me last July which
pointed
us in the direction of a potential version incompatibility issue which
might
be causing the error. He concluded yesterday that, he thinks the issue
is a
compatibility issue between the installed version of gsl (gsl-devel)
and that
expected by the R package. His next step is to try updating gsl to a
newer
version.
R/
John
-----Original Message-----
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Monday, May 11, 2020 10:17 AM
To: 'met_help at ucar.edu' <met_help at ucar.edu>
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
CLASSIFICATION: UNCLASSIFIED
Hi Tatiana -
Thanks for your reply to address this issue. I tried to navigate to
the file
which you show in the path below, but it's not accessible from my home
on my
linux machine. I had been communicating with my system admin by email
on this
issue just when I received your email and I have just provided him
with your
fix. He confirmed that gsl-devel is installed and he is going to try
installing the R package for GSL first to see if he can reproduce the
original
error which I was getting last July and he may be able to fix that
issue
himself. If not, he will apply your fix. I will let you know how this
goes.
R/
John
-----Original Message-----
From: Tatiana Burek via RT [mailto:met_help at ucar.edu]
Sent: Monday, May 11, 2020 9:52 AM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer
V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.
----
Hi John,
I remember you were having difficulties installing gsl package for R
so we
decided not to install it for that moment and proseed with it when it
is
needed.
>From your log file I see that you run agg_stat.R which requires gsl
only for
some operations.
We can start from commenting out this library and rerun your plot.
Hopefully,
it will work for you and we can postpone installing gsl for later. But
if you
continue to get errors from this script - then gsl has to be
installed.
To comment out gsl you need:
1. Write privileges for
/opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
2. If you can edit this file, open it
3. Put # before library(gsl);
it should look like this: #library(gsl); 4. Save file 5. Rerun your
plot.
Let me know if this works for you or we need to install gsl
Tatiana
On Fri May 08 10:00:02 2020, johnhg wrote:
> John,
>
> I'm going to reassign this ticket to Tatiana. I think she'd be
better
> suited to debug it with you.
>
> Thanks,
> John
>
> On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193 >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > John -
> >
> > Thanks for the detailed explanation which focused exactly on what
> > I'm trying to do. I checked my database to confirm it has the
table
> > for the SL1L2 line type. ("line_data_sl1l2" appears after command
> > "show tables;" )
> >
> > I checked the .stat files which were loaded into the database and
> > they contain the SL1L2 LINE_TYPE.
> >
> > I've attached a screen capture of my METViewer (web UI) display to
> > show my settings and the XML output file for the failed plot. I've
> > also attached the "load_spec_file" which I used to load the
database
> > in case you can see how I loaded the data. I clicked on the "Log"
> > tab on the right side of the UI page and the dialog had an error
> > because it needs the GSL library to function.
> > See
> > the attached log file. I recall that my sysadmin was able to
install
> > GSL
> > (gsl-devel) using the instructions provided by Tatiana, but when
we
> > tried to load the R package for GSL (install.packages('gsl')) we
> > encountered a problem and never resolved it. We decided that the
> > impact of not having it was not significant at the time. Is this
> > possibly causing the problem or something else?
> >
> > R/
> > John
> >
> > -----Original Message-----
> > From: John Halley Gotway via RT [Caution-mailto:met_help at ucar.edu]
> > Sent: Thursday, May 7, 2020 5:35 PM
> > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > <john.w.raby2.civ at mail.mil>
> > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > about METViewer V2.11 (UNCLASSIFIED)
> >
> > All active links contained in this email were disabled. Please
> > verify the identity of the sender, and confirm the authenticity of
> > all links contained within the message prior to copying and
pasting
> > the address to a Web browser.
> >
> >
> >
> >
> > ----
> >
> > Hi John,
> >
> > I see you'd like some direction as to how you can change from
> > plotting the mean of daily statistics to plotting an aggregate
statistics
> > in METviewer.
> >
> > It sounds like you're on the right track. To briefly outline the
> > logic, you are currently...
> > (1) Telling METviewer to query the ME statistic from the table
which
> > stores the CNT line type. Then METviewer summarizes multiple ME
> > statistics by computing their mean (or median, depending on which
> > you choose).
> >
> > And what you'd like to do instead is...
> > (2) Tell METviewer to query the partial sum statistics from the
> > table which stores the SL1L2 line type. Then METviewer aggregates
> > multiple SL1L2 partial sums by computing their weighted average,
> > where the weight is determined by the TOTAL column (which is the
> > number of matched pairs).
> > Then recompute the ME statistic from the aggregated partial sums.
> >
> > Since we're talking about ME, you'll find that both (1) and (2)
> > produce the same result as long as TOTAL remains constant.
However,
> > if the number of matched pairs on day 1 is more than the numbers
on
> > days 2 and 3, it'll have greater weight.
> >
> > To illustrate, I worked up a simple example using this METviewer
instance:
> > Caution-Caution-
http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> >
> > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > (2). I manually fixed the Y1 axis so they are the same on both
> > plots. You'll notice that the results are very slightly
different.
> > So the number of matched pairs must have changed over the 7 cases
> > being plotted.
> >
> > Note that you can save the .xml files to your local machine, and
> > then use the "Load XML" button on METviewer to recover my state.
But
> > to clarify, the differences are:
> > - In the "Statistics" box, change from "Summary" to "Aggregation
> > Statistics".
> > - And also change the dropdown list from "None" to "Scalar partial
> > sums (SL1L2)".
> >
> > This will only work if your database actually contains that SL1L2
data.
> >
> > Hope that example helps.
> >
> > Thanks,
> > John
> >
> > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > Queue: met_help
> > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > Owner: Nobody
> > > Requestors: john.w.raby2.civ at mail.mil
> > > Status: new
> > > Ticket <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > 95193 >
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > If I want to generate a plot showing aggregated ME values
instead
> > > of those produced by averaging previously computed ME values
what
> > > do I need to do? I created a plot of ME for each valid time from
> > > 00Z to 23Z using the "Summary Statistics" method and then tried
> > > clicking on "Aggregation Statistics", then "Scalar partial
sums",
> > > but the there was an error and it could not generate the plot.
The
> > > attached plot shows the plot I generated using the Summary
> > > Statistics method. For this plot, you can see that the values of
> > > NStat at the top along the x-axis indicate that 3 ME values were
> > > averaged to produce the plotted ME value. I need to plot
> > > aggregated ME values instead of averaged ME values.
> > >
> > > Thanks.
> > >
> > > R/
> > > John
> > >
> > > Mr. John W. Raby
> > > U.S. Army Research Laboratory
> > > White Sands Missile Range, NM 88002
> > > Office:(575) 678-2004 DSN 258-2004
> > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > 678-1230 DSN 258-1230
> > > Email: john.w.raby2.civ at mail.mil
> > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Tatiana Burek
Time: Mon May 18 15:10:49 2020
Hi John,
Do you use the same user name 'jraby' to run Tomcat?
If the library is installed in your home directory and the Tomcat is
running as some other user then it might not have the permissions to
access the files in
/home/jraby/.
Tatiana
On Thu May 14 09:00:29 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin successfully installed gsl and then installed the R
> package for gsl. I did some testing, but I am still unable to
generate
> the plot of aggregated ME error. The error we are getting is as
> follows:
>
> ==== Start Rscript error ====
> Error: package or namespace load failed for ‘gsl’ in dyn.load(file,
> DLLpath = DLLpath, ...):
> unable to load shared object '/home/jraby/R/R-
> 3.6.1/library/gsl/libs/gsl.so':
> libgsl.so.25: cannot open shared object file: No such file or
> directory
> Execution halted
>
> The file gsl.so is on my system at the above location:
>
> [jraby at carson2 libs]$ pwd
> /home/jraby/R/R-3.6.1/library/gsl/libs
> [jraby at carson2 libs]$ ll
> total 388
> -rwxrw-r--. 1 jraby users 394416 May 13 15:24 gsl.so
>
> We are continuing to troubleshoot this error, but if you have any
> ideas about the cause we would appreciate hearing from you.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Tuesday, May 12, 2020 7:30 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin was able to reproduce the error when attempting to
> load the R
> package for gsl. I sent him the info you provided me last July which
> pointed
> us in the direction of a potential version incompatibility issue
which
> might
> be causing the error. He concluded yesterday that, he thinks the
issue
> is a
> compatibility issue between the installed version of gsl (gsl-devel)
> and that
> expected by the R package. His next step is to try updating gsl to a
> newer
> version.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, May 11, 2020 10:17 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi Tatiana -
>
> Thanks for your reply to address this issue. I tried to navigate to
> the file
> which you show in the path below, but it's not accessible from my
home
> on my
> linux machine. I had been communicating with my system admin by
email
> on this
> issue just when I received your email and I have just provided him
> with your
> fix. He confirmed that gsl-devel is installed and he is going to try
> installing the R package for GSL first to see if he can reproduce
the
> original
> error which I was getting last July and he may be able to fix that
> issue
> himself. If not, he will apply your fix. I will let you know how
this
> goes.
>
> R/
> John
>
> -----Original Message-----
> From: Tatiana Burek via RT [mailto:met_help at ucar.edu]
> Sent: Monday, May 11, 2020 9:52 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
> METViewer
> V2.11 (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hi John,
> I remember you were having difficulties installing gsl package for R
> so we
> decided not to install it for that moment and proseed with it when
it
> is
> needed.
> From your log file I see that you run agg_stat.R which requires gsl
> only for
> some operations.
> We can start from commenting out this library and rerun your plot.
> Hopefully,
> it will work for you and we can postpone installing gsl for later.
But
> if you
> continue to get errors from this script - then gsl has to be
> installed.
>
> To comment out gsl you need:
> 1. Write privileges for
> /opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
> 2. If you can edit this file, open it
> 3. Put # before library(gsl);
> it should look like this: #library(gsl); 4. Save file 5. Rerun
your
> plot.
>
> Let me know if this works for you or we need to install gsl
>
> Tatiana
>
>
> On Fri May 08 10:00:02 2020, johnhg wrote:
> > John,
> >
> > I'm going to reassign this ticket to Tatiana. I think she'd be
> > better
> > suited to debug it with you.
> >
> > Thanks,
> > John
> >
> > On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-url:
> > > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95193
>
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > John -
> > >
> > > Thanks for the detailed explanation which focused exactly on
what
> > > I'm trying to do. I checked my database to confirm it has the
table
> > > for the SL1L2 line type. ("line_data_sl1l2" appears after
command
> > > "show tables;" )
> > >
> > > I checked the .stat files which were loaded into the database
and
> > > they contain the SL1L2 LINE_TYPE.
> > >
> > > I've attached a screen capture of my METViewer (web UI) display
to
> > > show my settings and the XML output file for the failed plot.
I've
> > > also attached the "load_spec_file" which I used to load the
> > > database
> > > in case you can see how I loaded the data. I clicked on the
"Log"
> > > tab on the right side of the UI page and the dialog had an error
> > > because it needs the GSL library to function.
> > > See
> > > the attached log file. I recall that my sysadmin was able to
> > > install
> > > GSL
> > > (gsl-devel) using the instructions provided by Tatiana, but when
we
> > > tried to load the R package for GSL (install.packages('gsl'))
we
> > > encountered a problem and never resolved it. We decided that the
> > > impact of not having it was not significant at the time. Is this
> > > possibly causing the problem or something else?
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT [Caution-
mailto:met_help at ucar.edu]
> > > Sent: Thursday, May 7, 2020 5:35 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > > about METViewer V2.11 (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
pasting
> > > the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Hi John,
> > >
> > > I see you'd like some direction as to how you can change from
> > > plotting the mean of daily statistics to plotting an aggregate
> > > statistics
> > > in METviewer.
> > >
> > > It sounds like you're on the right track. To briefly outline the
> > > logic, you are currently...
> > > (1) Telling METviewer to query the ME statistic from the table
> > > which
> > > stores the CNT line type. Then METviewer summarizes multiple ME
> > > statistics by computing their mean (or median, depending on
which
> > > you choose).
> > >
> > > And what you'd like to do instead is...
> > > (2) Tell METviewer to query the partial sum statistics from the
> > > table which stores the SL1L2 line type. Then METviewer
aggregates
> > > multiple SL1L2 partial sums by computing their weighted average,
> > > where the weight is determined by the TOTAL column (which is the
> > > number of matched pairs).
> > > Then recompute the ME statistic from the aggregated partial
sums.
> > >
> > > Since we're talking about ME, you'll find that both (1) and (2)
> > > produce the same result as long as TOTAL remains constant.
> > > However,
> > > if the number of matched pairs on day 1 is more than the numbers
on
> > > days 2 and 3, it'll have greater weight.
> > >
> > > To illustrate, I worked up a simple example using this METviewer
> > > instance:
> > > Caution-Caution-
> > > http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> > >
> > > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > > (2). I manually fixed the Y1 axis so they are the same on both
> > > plots. You'll notice that the results are very slightly
different.
> > > So the number of matched pairs must have changed over the 7
cases
> > > being plotted.
> > >
> > > Note that you can save the .xml files to your local machine, and
> > > then use the "Load XML" button on METviewer to recover my state.
> > > But
> > > to clarify, the differences are:
> > > - In the "Statistics" box, change from "Summary" to "Aggregation
> > > Statistics".
> > > - And also change the dropdown list from "None" to "Scalar
partial
> > > sums (SL1L2)".
> > >
> > > This will only work if your database actually contains that
SL1L2
> > > data.
> > >
> > > Hope that example helps.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > Queue: met_help
> > > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > > Owner: Nobody
> > > > Requestors: john.w.raby2.civ at mail.mil
> > > > Status: new
> > > > Ticket <Caution-Caution-url:
> > > > Caution-Caution-
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > 95193 >
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > If I want to generate a plot showing aggregated ME values
instead
> > > > of those produced by averaging previously computed ME values
what
> > > > do I need to do? I created a plot of ME for each valid time
from
> > > > 00Z to 23Z using the "Summary Statistics" method and then
tried
> > > > clicking on "Aggregation Statistics", then "Scalar partial
sums",
> > > > but the there was an error and it could not generate the plot.
> > > > The
> > > > attached plot shows the plot I generated using the Summary
> > > > Statistics method. For this plot, you can see that the values
of
> > > > NStat at the top along the x-axis indicate that 3 ME values
were
> > > > averaged to produce the plotted ME value. I need to plot
> > > > aggregated ME values instead of averaged ME values.
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
(575)
> > > > 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
>
>
>
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Tue May 19 07:39:42 2020
CLASSIFICATION: UNCLASSIFIED
Tatiana -
Thanks for taking a look at this error and offering a possible issue
to consider. I will get with my system admin to confirm the answer to
your question and send you a reply.
R/
John
-----Original Message-----
From: Tatiana Burek via RT [mailto:met_help at ucar.edu]
Sent: Monday, May 18, 2020 3:11 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.
----
Hi John,
Do you use the same user name 'jraby' to run Tomcat?
If the library is installed in your home directory and the Tomcat is
running as some other user then it might not have the permissions to
access the files in /home/jraby/.
Tatiana
On Thu May 14 09:00:29 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin successfully installed gsl and then installed the R
> package for gsl. I did some testing, but I am still unable to
generate
> the plot of aggregated ME error. The error we are getting is as
> follows:
>
> ==== Start Rscript error ====
> Error: package or namespace load failed for ‘gsl’ in dyn.load(file,
> DLLpath = DLLpath, ...):
> unable to load shared object '/home/jraby/R/R-
> 3.6.1/library/gsl/libs/gsl.so':
> libgsl.so.25: cannot open shared object file: No such file or
> directory Execution halted
>
> The file gsl.so is on my system at the above location:
>
> [jraby at carson2 libs]$ pwd
> /home/jraby/R/R-3.6.1/library/gsl/libs
> [jraby at carson2 libs]$ ll
> total 388
> -rwxrw-r--. 1 jraby users 394416 May 13 15:24 gsl.so
>
> We are continuing to troubleshoot this error, but if you have any
> ideas about the cause we would appreciate hearing from you.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Tuesday, May 12, 2020 7:30 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin was able to reproduce the error when attempting to
> load the R package for gsl. I sent him the info you provided me last
> July which pointed us in the direction of a potential version
> incompatibility issue which might be causing the error. He concluded
> yesterday that, he thinks the issue is a compatibility issue between
> the installed version of gsl (gsl-devel) and that expected by the R
> package. His next step is to try updating gsl to a newer version.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, May 11, 2020 10:17 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi Tatiana -
>
> Thanks for your reply to address this issue. I tried to navigate to
> the file which you show in the path below, but it's not accessible
> from my home on my linux machine. I had been communicating with my
> system admin by email on this issue just when I received your email
> and I have just provided him with your fix. He confirmed that
> gsl-devel is installed and he is going to try installing the R
package
> for GSL first to see if he can reproduce the original error which I
> was getting last July and he may be able to fix that issue himself.
If
> not, he will apply your fix. I will let you know how this goes.
>
> R/
> John
>
> -----Original Message-----
> From: Tatiana Burek via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Monday, May 11, 2020 9:52 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
> METViewer
> V2.11 (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hi John,
> I remember you were having difficulties installing gsl package for R
> so we decided not to install it for that moment and proseed with it
> when it is needed.
> From your log file I see that you run agg_stat.R which requires gsl
> only for some operations.
> We can start from commenting out this library and rerun your plot.
> Hopefully,
> it will work for you and we can postpone installing gsl for later.
But
> if you continue to get errors from this script - then gsl has to be
> installed.
>
> To comment out gsl you need:
> 1. Write privileges for
> /opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
> 2. If you can edit this file, open it
> 3. Put # before library(gsl);
> it should look like this: #library(gsl); 4. Save file 5. Rerun
your
> plot.
>
> Let me know if this works for you or we need to install gsl
>
> Tatiana
>
>
> On Fri May 08 10:00:02 2020, johnhg wrote:
> > John,
> >
> > I'm going to reassign this ticket to Tatiana. I think she'd be
> > better suited to debug it with you.
> >
> > Thanks,
> > John
> >
> > On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > 95193 >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > John -
> > >
> > > Thanks for the detailed explanation which focused exactly on
what
> > > I'm trying to do. I checked my database to confirm it has the
> > > table for the SL1L2 line type. ("line_data_sl1l2" appears after
> > > command "show tables;" )
> > >
> > > I checked the .stat files which were loaded into the database
and
> > > they contain the SL1L2 LINE_TYPE.
> > >
> > > I've attached a screen capture of my METViewer (web UI) display
to
> > > show my settings and the XML output file for the failed plot.
I've
> > > also attached the "load_spec_file" which I used to load the
> > > database in case you can see how I loaded the data. I clicked on
> > > the "Log"
> > > tab on the right side of the UI page and the dialog had an error
> > > because it needs the GSL library to function.
> > > See
> > > the attached log file. I recall that my sysadmin was able to
> > > install GSL
> > > (gsl-devel) using the instructions provided by Tatiana, but when
> > > we tried to load the R package for GSL
(install.packages('gsl'))
> > > we encountered a problem and never resolved it. We decided that
> > > the impact of not having it was not significant at the time. Is
> > > this possibly causing the problem or something else?
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT
> > > [Caution-Caution-mailto:met_help at ucar.edu]
> > > Sent: Thursday, May 7, 2020 5:35 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > > about METViewer V2.11 (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
> > > pasting the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Hi John,
> > >
> > > I see you'd like some direction as to how you can change from
> > > plotting the mean of daily statistics to plotting an aggregate
> > > statistics in METviewer.
> > >
> > > It sounds like you're on the right track. To briefly outline the
> > > logic, you are currently...
> > > (1) Telling METviewer to query the ME statistic from the table
> > > which stores the CNT line type. Then METviewer summarizes
> > > multiple ME statistics by computing their mean (or median,
> > > depending on which you choose).
> > >
> > > And what you'd like to do instead is...
> > > (2) Tell METviewer to query the partial sum statistics from the
> > > table which stores the SL1L2 line type. Then METviewer
aggregates
> > > multiple SL1L2 partial sums by computing their weighted average,
> > > where the weight is determined by the TOTAL column (which is the
> > > number of matched pairs).
> > > Then recompute the ME statistic from the aggregated partial
sums.
> > >
> > > Since we're talking about ME, you'll find that both (1) and (2)
> > > produce the same result as long as TOTAL remains constant.
> > > However,
> > > if the number of matched pairs on day 1 is more than the numbers
> > > on days 2 and 3, it'll have greater weight.
> > >
> > > To illustrate, I worked up a simple example using this METviewer
> > > instance:
> > > Caution-Caution-
> > > Caution-http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> > >
> > > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > > (2). I manually fixed the Y1 axis so they are the same on both
> > > plots. You'll notice that the results are very slightly
different.
> > > So the number of matched pairs must have changed over the 7
cases
> > > being plotted.
> > >
> > > Note that you can save the .xml files to your local machine, and
> > > then use the "Load XML" button on METviewer to recover my state.
> > > But
> > > to clarify, the differences are:
> > > - In the "Statistics" box, change from "Summary" to "Aggregation
> > > Statistics".
> > > - And also change the dropdown list from "None" to "Scalar
partial
> > > sums (SL1L2)".
> > >
> > > This will only work if your database actually contains that
SL1L2
> > > data.
> > >
> > > Hope that example helps.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > Queue: met_help
> > > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > > Owner: Nobody
> > > > Requestors: john.w.raby2.civ at mail.mil
> > > > Status: new
> > > > Ticket <Caution-Caution-Caution-url:
> > > > Caution-Caution-
> > > > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > 95193 >
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > If I want to generate a plot showing aggregated ME values
> > > > instead of those produced by averaging previously computed ME
> > > > values what do I need to do? I created a plot of ME for each
> > > > valid time from 00Z to 23Z using the "Summary Statistics"
method
> > > > and then tried clicking on "Aggregation Statistics", then
> > > > "Scalar partial sums", but the there was an error and it could
not generate the plot.
> > > > The
> > > > attached plot shows the plot I generated using the Summary
> > > > Statistics method. For this plot, you can see that the values
of
> > > > NStat at the top along the x-axis indicate that 3 ME values
were
> > > > averaged to produce the plotted ME value. I need to plot
> > > > aggregated ME values instead of averaged ME values.
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
> > > > (575)
> > > > 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
>
>
>
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Wed May 20 14:01:42 2020
CLASSIFICATION: UNCLASSIFIED
Tatiana -
My system admin verified that Tomcat is run by root which should give
all access needed.
R/
John
-----Original Message-----
From: Tatiana Burek via RT <met_help at ucar.edu>
Sent: Monday, May 18, 2020 3:11 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.
----
Hi John,
Do you use the same user name 'jraby' to run Tomcat?
If the library is installed in your home directory and the Tomcat is
running as some other user then it might not have the permissions to
access the files in /home/jraby/.
Tatiana
On Thu May 14 09:00:29 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin successfully installed gsl and then installed the R
> package for gsl. I did some testing, but I am still unable to
generate
> the plot of aggregated ME error. The error we are getting is as
> follows:
>
> ==== Start Rscript error ====
> Error: package or namespace load failed for ‘gsl’ in dyn.load(file,
> DLLpath = DLLpath, ...):
> unable to load shared object '/home/jraby/R/R-
> 3.6.1/library/gsl/libs/gsl.so':
> libgsl.so.25: cannot open shared object file: No such file or
> directory Execution halted
>
> The file gsl.so is on my system at the above location:
>
> [jraby at carson2 libs]$ pwd
> /home/jraby/R/R-3.6.1/library/gsl/libs
> [jraby at carson2 libs]$ ll
> total 388
> -rwxrw-r--. 1 jraby users 394416 May 13 15:24 gsl.so
>
> We are continuing to troubleshoot this error, but if you have any
> ideas about the cause we would appreciate hearing from you.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Tuesday, May 12, 2020 7:30 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin was able to reproduce the error when attempting to
> load the R package for gsl. I sent him the info you provided me last
> July which pointed us in the direction of a potential version
> incompatibility issue which might be causing the error. He concluded
> yesterday that, he thinks the issue is a compatibility issue between
> the installed version of gsl (gsl-devel) and that expected by the R
> package. His next step is to try updating gsl to a newer version.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, May 11, 2020 10:17 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi Tatiana -
>
> Thanks for your reply to address this issue. I tried to navigate to
> the file which you show in the path below, but it's not accessible
> from my home on my linux machine. I had been communicating with my
> system admin by email on this issue just when I received your email
> and I have just provided him with your fix. He confirmed that
> gsl-devel is installed and he is going to try installing the R
package
> for GSL first to see if he can reproduce the original error which I
> was getting last July and he may be able to fix that issue himself.
If
> not, he will apply your fix. I will let you know how this goes.
>
> R/
> John
>
> -----Original Message-----
> From: Tatiana Burek via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Monday, May 11, 2020 9:52 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
> METViewer
> V2.11 (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hi John,
> I remember you were having difficulties installing gsl package for R
> so we decided not to install it for that moment and proseed with it
> when it is needed.
> From your log file I see that you run agg_stat.R which requires gsl
> only for some operations.
> We can start from commenting out this library and rerun your plot.
> Hopefully,
> it will work for you and we can postpone installing gsl for later.
But
> if you continue to get errors from this script - then gsl has to be
> installed.
>
> To comment out gsl you need:
> 1. Write privileges for
> /opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
> 2. If you can edit this file, open it
> 3. Put # before library(gsl);
> it should look like this: #library(gsl); 4. Save file 5. Rerun
your
> plot.
>
> Let me know if this works for you or we need to install gsl
>
> Tatiana
>
>
> On Fri May 08 10:00:02 2020, johnhg wrote:
> > John,
> >
> > I'm going to reassign this ticket to Tatiana. I think she'd be
> > better suited to debug it with you.
> >
> > Thanks,
> > John
> >
> > On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > 95193 >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > John -
> > >
> > > Thanks for the detailed explanation which focused exactly on
what
> > > I'm trying to do. I checked my database to confirm it has the
> > > table for the SL1L2 line type. ("line_data_sl1l2" appears after
> > > command "show tables;" )
> > >
> > > I checked the .stat files which were loaded into the database
and
> > > they contain the SL1L2 LINE_TYPE.
> > >
> > > I've attached a screen capture of my METViewer (web UI) display
to
> > > show my settings and the XML output file for the failed plot.
I've
> > > also attached the "load_spec_file" which I used to load the
> > > database in case you can see how I loaded the data. I clicked on
> > > the "Log"
> > > tab on the right side of the UI page and the dialog had an error
> > > because it needs the GSL library to function.
> > > See
> > > the attached log file. I recall that my sysadmin was able to
> > > install GSL
> > > (gsl-devel) using the instructions provided by Tatiana, but when
> > > we tried to load the R package for GSL
(install.packages('gsl'))
> > > we encountered a problem and never resolved it. We decided that
> > > the impact of not having it was not significant at the time. Is
> > > this possibly causing the problem or something else?
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT
> > > [Caution-Caution-mailto:met_help at ucar.edu]
> > > Sent: Thursday, May 7, 2020 5:35 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > > about METViewer V2.11 (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
> > > pasting the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Hi John,
> > >
> > > I see you'd like some direction as to how you can change from
> > > plotting the mean of daily statistics to plotting an aggregate
> > > statistics in METviewer.
> > >
> > > It sounds like you're on the right track. To briefly outline the
> > > logic, you are currently...
> > > (1) Telling METviewer to query the ME statistic from the table
> > > which stores the CNT line type. Then METviewer summarizes
> > > multiple ME statistics by computing their mean (or median,
> > > depending on which you choose).
> > >
> > > And what you'd like to do instead is...
> > > (2) Tell METviewer to query the partial sum statistics from the
> > > table which stores the SL1L2 line type. Then METviewer
aggregates
> > > multiple SL1L2 partial sums by computing their weighted average,
> > > where the weight is determined by the TOTAL column (which is the
> > > number of matched pairs).
> > > Then recompute the ME statistic from the aggregated partial
sums.
> > >
> > > Since we're talking about ME, you'll find that both (1) and (2)
> > > produce the same result as long as TOTAL remains constant.
> > > However,
> > > if the number of matched pairs on day 1 is more than the numbers
> > > on days 2 and 3, it'll have greater weight.
> > >
> > > To illustrate, I worked up a simple example using this METviewer
> > > instance:
> > > Caution-Caution-
> > > Caution-http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> > >
> > > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > > (2). I manually fixed the Y1 axis so they are the same on both
> > > plots. You'll notice that the results are very slightly
different.
> > > So the number of matched pairs must have changed over the 7
cases
> > > being plotted.
> > >
> > > Note that you can save the .xml files to your local machine, and
> > > then use the "Load XML" button on METviewer to recover my state.
> > > But
> > > to clarify, the differences are:
> > > - In the "Statistics" box, change from "Summary" to "Aggregation
> > > Statistics".
> > > - And also change the dropdown list from "None" to "Scalar
partial
> > > sums (SL1L2)".
> > >
> > > This will only work if your database actually contains that
SL1L2
> > > data.
> > >
> > > Hope that example helps.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > Queue: met_help
> > > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > > Owner: Nobody
> > > > Requestors: john.w.raby2.civ at mail.mil
> > > > Status: new
> > > > Ticket <Caution-Caution-Caution-url:
> > > > Caution-Caution-
> > > > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > 95193 >
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > If I want to generate a plot showing aggregated ME values
> > > > instead of those produced by averaging previously computed ME
> > > > values what do I need to do? I created a plot of ME for each
> > > > valid time from 00Z to 23Z using the "Summary Statistics"
method
> > > > and then tried clicking on "Aggregation Statistics", then
> > > > "Scalar partial sums", but the there was an error and it could
not generate the plot.
> > > > The
> > > > attached plot shows the plot I generated using the Summary
> > > > Statistics method. For this plot, you can see that the values
of
> > > > NStat at the top along the x-axis indicate that 3 ME values
were
> > > > averaged to produce the plotted ME value. I need to plot
> > > > aggregated ME values instead of averaged ME values.
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
> > > > (575)
> > > > 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
>
>
>
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
Subject: question about METViewer V2.11 (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Thu May 21 14:04:55 2020
CLASSIFICATION: UNCLASSIFIED
Tatiana -
We are now able to use the use the option to query the partial sum
statistics to produce aggregated values of the error statistics. My
system admin reported the following information about his experience
in resolving the issue he was having with the R package for GSL and
GSL:
"the GSL package software is an independent package that on its own
needs to be
installed, and the version needs to be compatible with the version of
R that
is installed. Second, understanding that the R gsl package is NOT the
same
as the GSL package software, that was a big confusion for me. Once I
figured this out I learned how the GSL software and the R gsl package
worked
together, which is still kind of fuzzy to me, but I had enough of a
concept
to get it to work. Lastly, hope the environment setting that I put
into
your .bashrc will continue to remain, and load when you source them."
R/
John
-----Original Message-----
From: Raby, John W CIV USARMY CCDC ARL (USA)
Sent: Wednesday, May 20, 2020 1:54 PM
To: 'met_help at ucar.edu' <met_help at ucar.edu>
Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
CLASSIFICATION: UNCLASSIFIED
Tatiana -
My system admin verified that Tomcat is run by root which should give
all access needed.
R/
John
-----Original Message-----
From: Tatiana Burek via RT <met_help at ucar.edu>
Sent: Monday, May 18, 2020 3:11 PM
To: Raby, John W CIV USARMY CCDC ARL (USA) <john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
METViewer V2.11 (UNCLASSIFIED)
All active links contained in this email were disabled. Please verify
the identity of the sender, and confirm the authenticity of all links
contained within the message prior to copying and pasting the address
to a Web browser.
----
Hi John,
Do you use the same user name 'jraby' to run Tomcat?
If the library is installed in your home directory and the Tomcat is
running as some other user then it might not have the permissions to
access the files in /home/jraby/.
Tatiana
On Thu May 14 09:00:29 2020, john.w.raby2.civ at mail.mil wrote:
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin successfully installed gsl and then installed the R
> package for gsl. I did some testing, but I am still unable to
generate
> the plot of aggregated ME error. The error we are getting is as
> follows:
>
> ==== Start Rscript error ====
> Error: package or namespace load failed for ‘gsl’ in dyn.load(file,
> DLLpath = DLLpath, ...):
> unable to load shared object '/home/jraby/R/R-
> 3.6.1/library/gsl/libs/gsl.so':
> libgsl.so.25: cannot open shared object file: No such file or
> directory Execution halted
>
> The file gsl.so is on my system at the above location:
>
> [jraby at carson2 libs]$ pwd
> /home/jraby/R/R-3.6.1/library/gsl/libs
> [jraby at carson2 libs]$ ll
> total 388
> -rwxrw-r--. 1 jraby users 394416 May 13 15:24 gsl.so
>
> We are continuing to troubleshoot this error, but if you have any
> ideas about the cause we would appreciate hearing from you.
>
> Thanks.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Tuesday, May 12, 2020 7:30 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Tatiana -
>
> My system admin was able to reproduce the error when attempting to
> load the R package for gsl. I sent him the info you provided me last
> July which pointed us in the direction of a potential version
> incompatibility issue which might be causing the error. He concluded
> yesterday that, he thinks the issue is a compatibility issue between
> the installed version of gsl (gsl-devel) and that expected by the R
> package. His next step is to try updating gsl to a newer version.
>
> R/
> John
>
> -----Original Message-----
> From: Raby, John W CIV USARMY CCDC ARL (USA)
> Sent: Monday, May 11, 2020 10:17 AM
> To: 'met_help at ucar.edu' <met_help at ucar.edu>
> Subject: RE: [Non-DoD Source] [rt.rap.ucar.edu #95193] question
about
> METViewer V2.11 (UNCLASSIFIED)
>
> CLASSIFICATION: UNCLASSIFIED
>
> Hi Tatiana -
>
> Thanks for your reply to address this issue. I tried to navigate to
> the file which you show in the path below, but it's not accessible
> from my home on my linux machine. I had been communicating with my
> system admin by email on this issue just when I received your email
> and I have just provided him with your fix. He confirmed that
> gsl-devel is installed and he is going to try installing the R
package
> for GSL first to see if he can reproduce the original error which I
> was getting last July and he may be able to fix that issue himself.
If
> not, he will apply your fix. I will let you know how this goes.
>
> R/
> John
>
> -----Original Message-----
> From: Tatiana Burek via RT [Caution-mailto:met_help at ucar.edu]
> Sent: Monday, May 11, 2020 9:52 AM
> To: Raby, John W CIV USARMY CCDC ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] [rt.rap.ucar.edu #95193] question about
> METViewer
> V2.11 (UNCLASSIFIED)
>
> All active links contained in this email were disabled. Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hi John,
> I remember you were having difficulties installing gsl package for R
> so we decided not to install it for that moment and proseed with it
> when it is needed.
> From your log file I see that you run agg_stat.R which requires gsl
> only for some operations.
> We can start from commenting out this library and rerun your plot.
> Hopefully,
> it will work for you and we can postpone installing gsl for later.
But
> if you continue to get errors from this script - then gsl has to be
> installed.
>
> To comment out gsl you need:
> 1. Write privileges for
> /opt/tomcat7/webapps/metviewer/R_work/include/agg_stat.R
> 2. If you can edit this file, open it
> 3. Put # before library(gsl);
> it should look like this: #library(gsl); 4. Save file 5. Rerun
your
> plot.
>
> Let me know if this works for you or we need to install gsl
>
> Tatiana
>
>
> On Fri May 08 10:00:02 2020, johnhg wrote:
> > John,
> >
> > I'm going to reassign this ticket to Tatiana. I think she'd be
> > better suited to debug it with you.
> >
> > Thanks,
> > John
> >
> > On Fri, May 8, 2020 at 8:57 AM Raby, John W USA CIV via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <Caution-Caution-url:
> > > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > 95193 >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > > John -
> > >
> > > Thanks for the detailed explanation which focused exactly on
what
> > > I'm trying to do. I checked my database to confirm it has the
> > > table for the SL1L2 line type. ("line_data_sl1l2" appears after
> > > command "show tables;" )
> > >
> > > I checked the .stat files which were loaded into the database
and
> > > they contain the SL1L2 LINE_TYPE.
> > >
> > > I've attached a screen capture of my METViewer (web UI) display
to
> > > show my settings and the XML output file for the failed plot.
I've
> > > also attached the "load_spec_file" which I used to load the
> > > database in case you can see how I loaded the data. I clicked on
> > > the "Log"
> > > tab on the right side of the UI page and the dialog had an error
> > > because it needs the GSL library to function.
> > > See
> > > the attached log file. I recall that my sysadmin was able to
> > > install GSL
> > > (gsl-devel) using the instructions provided by Tatiana, but when
> > > we tried to load the R package for GSL
(install.packages('gsl'))
> > > we encountered a problem and never resolved it. We decided that
> > > the impact of not having it was not significant at the time. Is
> > > this possibly causing the problem or something else?
> > >
> > > R/
> > > John
> > >
> > > -----Original Message-----
> > > From: John Halley Gotway via RT
> > > [Caution-Caution-mailto:met_help at ucar.edu]
> > > Sent: Thursday, May 7, 2020 5:35 PM
> > > To: Raby, John W CIV USARMY CCDC ARL (USA)
> > > <john.w.raby2.civ at mail.mil>
> > > Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #95193] question
> > > about METViewer V2.11 (UNCLASSIFIED)
> > >
> > > All active links contained in this email were disabled. Please
> > > verify the identity of the sender, and confirm the authenticity
of
> > > all links contained within the message prior to copying and
> > > pasting the address to a Web browser.
> > >
> > >
> > >
> > >
> > > ----
> > >
> > > Hi John,
> > >
> > > I see you'd like some direction as to how you can change from
> > > plotting the mean of daily statistics to plotting an aggregate
> > > statistics in METviewer.
> > >
> > > It sounds like you're on the right track. To briefly outline the
> > > logic, you are currently...
> > > (1) Telling METviewer to query the ME statistic from the table
> > > which stores the CNT line type. Then METviewer summarizes
> > > multiple ME statistics by computing their mean (or median,
> > > depending on which you choose).
> > >
> > > And what you'd like to do instead is...
> > > (2) Tell METviewer to query the partial sum statistics from the
> > > table which stores the SL1L2 line type. Then METviewer
aggregates
> > > multiple SL1L2 partial sums by computing their weighted average,
> > > where the weight is determined by the TOTAL column (which is the
> > > number of matched pairs).
> > > Then recompute the ME statistic from the aggregated partial
sums.
> > >
> > > Since we're talking about ME, you'll find that both (1) and (2)
> > > produce the same result as long as TOTAL remains constant.
> > > However,
> > > if the number of matched pairs on day 1 is more than the numbers
> > > on days 2 and 3, it'll have greater weight.
> > >
> > > To illustrate, I worked up a simple example using this METviewer
> > > instance:
> > > Caution-Caution-
> > > Caution-http://www.dtcenter.org/met/metviewer/metviewer1.jsp
> > >
> > > The ME_mean value plot illustrates (1) while MET_agg illustrates
> > > (2). I manually fixed the Y1 axis so they are the same on both
> > > plots. You'll notice that the results are very slightly
different.
> > > So the number of matched pairs must have changed over the 7
cases
> > > being plotted.
> > >
> > > Note that you can save the .xml files to your local machine, and
> > > then use the "Load XML" button on METviewer to recover my state.
> > > But
> > > to clarify, the differences are:
> > > - In the "Statistics" box, change from "Summary" to "Aggregation
> > > Statistics".
> > > - And also change the dropdown list from "None" to "Scalar
partial
> > > sums (SL1L2)".
> > >
> > > This will only work if your database actually contains that
SL1L2
> > > data.
> > >
> > > Hope that example helps.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, May 7, 2020 at 12:36 PM Raby, John W USA CIV via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu May 07 12:33:23 2020: Request 95193 was acted upon.
> > > > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> > > > Queue: met_help
> > > > Subject: question about METViewer V2.11 (UNCLASSIFIED)
> > > > Owner: Nobody
> > > > Requestors: john.w.raby2.civ at mail.mil
> > > > Status: new
> > > > Ticket <Caution-Caution-Caution-url:
> > > > Caution-Caution-
> > > > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=
> > > > 95193 >
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > > If I want to generate a plot showing aggregated ME values
> > > > instead of those produced by averaging previously computed ME
> > > > values what do I need to do? I created a plot of ME for each
> > > > valid time from 00Z to 23Z using the "Summary Statistics"
method
> > > > and then tried clicking on "Aggregation Statistics", then
> > > > "Scalar partial sums", but the there was an error and it could
not generate the plot.
> > > > The
> > > > attached plot shows the plot I generated using the Summary
> > > > Statistics method. For this plot, you can see that the values
of
> > > > NStat at the top along the x-axis indicate that 3 ME values
were
> > > > averaged to produce the plotted ME value. I need to plot
> > > > aggregated ME values instead of averaged ME values.
> > > >
> > > > Thanks.
> > > >
> > > > R/
> > > > John
> > > >
> > > > Mr. John W. Raby
> > > > U.S. Army Research Laboratory
> > > > White Sands Missile Range, NM 88002
> > > > Office:(575) 678-2004 DSN 258-2004
> > > > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX
> > > > (575)
> > > > 678-1230 DSN 258-1230
> > > > Email: john.w.raby2.civ at mail.mil
> > > >
> > > >
> > > > CLASSIFICATION: UNCLASSIFIED
> > > >
> > > >
> > >
> > > CLASSIFICATION: UNCLASSIFIED
> > >
> > >
>
>
>
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
> CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
CLASSIFICATION: UNCLASSIFIED
------------------------------------------------
More information about the Met_help
mailing list