[Met_help] [rt.rap.ucar.edu #95573] History for Fail to load stat file into METviewer
Tatiana Burek via RT
met_help at ucar.edu
Mon Jun 15 07:18:05 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I successfully built the docker image of METviewer 3.0. I have a just
one point_stat file under /data/point_stat/:
xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la /data
total 16
drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
-rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
-rw-r--r-- 1 1000 1000 1883 May 15 20:57
point_stat_270000L_20190527_000000V.stat
*Here is the content of /data/load_mv_test.xml:*
xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
/data/load_mv_test.xml
<load_spec>
<connection>
<management_system>mysql</management_system>
<host>mysql_mv:3306</host>
<database>mv_test</database>
<user>root</user>
<password>mvuser</password>
</connection>
<folder_tmpl>/data/{met_tool}</folder_tmpl>
<met_version>V6.0</met_version>
<verbose>true</verbose>
<insert_size>1</insert_size>
<mode_header_db_check>false</mode_header_db_check>
<drop_indexes>false</drop_indexes>
<apply_indexes>true</apply_indexes>
<load_stat>true</load_stat>
<load_mode>false</load_mode>
<load_mpr>false</load_mpr>
<load_orank>false</load_orank>
<load_val>
<field name="met_tool">
<val>point_stat</val>
</field>
</load_val>
</load_spec>
*Here is the content of /data/point_stat_270000L_20190527_000000V.stat:*
xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
/data/point_stat_270000L_20190527_000000V.stat
VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END OBS_LEAD
OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS FCST_LEV OBS_VAR
OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH
OBS_THRESH COV_THRESH ALPHA LINE_TYPE
V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
20190526_223000 20190527_013000 TMP K P900-750 TMP NA
P900-750 ADPUPA FULL BILIN 4 NA NA
NA NA SL1L2 96 282.50359 282.95 80007.0758
79885.23007 80131.85659 1.37716
V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
20190526_223000 20190527_013000 TMP K P900-750 TMP NA
P900-750 ADPSFC FULL BILIN 4 NA NA
NA NA SL1L2 175 285.56938 285.37171 81514.22934
81577.11951 81460.56417 2.37752
V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
20190526_223000 20190527_013000 UGRD m/s Z10 UGRD NA
Z10 ADPSFC FULL BILIN 4 NA NA
NA NA SL1L2 1690 0.10631 -0.018225 2.12765
5.01565 4.63367 1.8043
V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
20190526_223000 20190527_013000 VGRD m/s Z10 VGRD NA
Z10 ADPSFC FULL BILIN 4 NA NA
NA NA SL1L2 1690 0.57217 0.49876 8.77582
14.98303 10.41817 2.1663
V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
20190526_223000 20190527_013000 UGRD_VGRD m/s Z10 UGRD_VGRD NA
Z10 ADPSFC FULL BILIN 4 NA NA
NA NA VL1L2 1690 0.10631 0.57217 -0.018225
0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
*When I run docker exec -it metviewer /scripts/common/metv_load_all.ksh
mv_test:*
xinzhang at xinLinux:~/METout$ docker exec -it metviewer
/scripts/common/metv_load_all.ksh mv_test
mysql: [Warning] Using a password on the command line interface can be
insecure.
mysql: [Warning] Using a password on the command line interface can be
insecure.
mysql: [Warning] Using a password on the command line interface can be
insecure.
---- MVLoad ----
Begin time: 2020-06-11 00:23:23
Parsing: /data/load_mv_test.xml
Permutation 1 of 1 - /data/point_stat
==== grid_stat ====
stat_header table time total: 0:00:00.000
stat header records: 0
stat header inserts: 0
line data records: 0
line data inserts: 0
stat group records: 0
stat group inserts: 0
var length records: 0
var length inserts: 0
total lines: 0
insert size: 1
lines / msec: 0.000
num files: 0
==== mode ====
mtd_header search time total: 0:00:00.000
stat_header search time total: 0:00:00.000
mode_header inserts: 0
mode_cts inserts: 0
mode_obj_single inserts: 0
mode_obj_pair inserts: 0
==== mtd ====
mtd_header inserts: 0
mtd_3d_obj_single inserts: 0
mtd_3d_obj_pair inserts: 0
mtd_2d_obj inserts: 0
total lines: 0
num files: 0
num files: 0
==== indexes ====creating
Indexes creating 0:00:00.454
End time: 2020-06-11 00:23:23
Load total: 0:00:00.003
---- MVLoad Done ----
*No error ? but nothing is found under the dataset of METviewer GUI. I am
also wondering why it is processing the grid_stat, mod and mtd which I
don't have, not processing the point_stat I hope ?*
Thanks,
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
*Dr. Xin Zhang
*
*Software Engineer
001-303-497-8652*
*Joint Center for Satellite Data Assimilation
xinzhang at ucar.edu <xinzhang at ucar.edu>*
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Minna Win
Time: Thu Jun 11 09:14:52 2020
Hello Xin,
It looks like you are having issues with METviewer in docker. I am
assigning this ticket to Tatiana Burek. Please allow a few business
days
for a full response.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
On Wed, Jun 10, 2020 at 6:34 PM Xin Zhang via RT <met_help at ucar.edu>
wrote:
>
> Wed Jun 10 18:33:53 2020: Request 95573 was acted upon.
> Transaction: Ticket created by xinzhang at ucar.edu
> Queue: met_help
> Subject: Fail to load stat file into METviewer
> Owner: Nobody
> Requestors: xinzhang at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95573 >
>
>
> Hello,
>
> I successfully built the docker image of METviewer 3.0. I have a
just
> one point_stat file under /data/point_stat/:
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la /data
> total 16
> drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> point_stat_270000L_20190527_000000V.stat
>
> *Here is the content of /data/load_mv_test.xml:*
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> /data/load_mv_test.xml
> <load_spec>
> <connection>
> <management_system>mysql</management_system>
> <host>mysql_mv:3306</host>
> <database>mv_test</database>
> <user>root</user>
> <password>mvuser</password>
> </connection>
>
> <folder_tmpl>/data/{met_tool}</folder_tmpl>
>
> <met_version>V6.0</met_version>
>
> <verbose>true</verbose>
> <insert_size>1</insert_size>
> <mode_header_db_check>false</mode_header_db_check>
> <drop_indexes>false</drop_indexes>
> <apply_indexes>true</apply_indexes>
>
> <load_stat>true</load_stat>
> <load_mode>false</load_mode>
> <load_mpr>false</load_mpr>
> <load_orank>false</load_orank>
>
> <load_val>
> <field name="met_tool">
> <val>point_stat</val>
> </field>
> </load_val>
>
> </load_spec>
>
> *Here is the content of
/data/point_stat_270000L_20190527_000000V.stat:*
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> /data/point_stat_270000L_20190527_000000V.stat
> VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS FCST_LEV
OBS_VAR
> OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
FCST_THRESH
> OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 TMP K P900-750 TMP
NA
> P900-750 ADPUPA FULL BILIN 4 NA
NA
> NA NA SL1L2 96 282.50359 282.95 80007.0758
> 79885.23007 80131.85659 1.37716
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 TMP K P900-750 TMP
NA
> P900-750 ADPSFC FULL BILIN 4 NA
NA
> NA NA SL1L2 175 285.56938 285.37171 81514.22934
> 81577.11951 81460.56417 2.37752
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 UGRD m/s Z10 UGRD
NA
> Z10 ADPSFC FULL BILIN 4 NA
NA
> NA NA SL1L2 1690 0.10631 -0.018225 2.12765
> 5.01565 4.63367 1.8043
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 VGRD m/s Z10 VGRD
NA
> Z10 ADPSFC FULL BILIN 4 NA
NA
> NA NA SL1L2 1690 0.57217 0.49876 8.77582
> 14.98303 10.41817 2.1663
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
UGRD_VGRD NA
> Z10 ADPSFC FULL BILIN 4 NA
NA
> NA NA VL1L2 1690 0.10631 0.57217 -0.018225
> 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
>
> *When I run docker exec -it metviewer
/scripts/common/metv_load_all.ksh
> mv_test:*
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> /scripts/common/metv_load_all.ksh mv_test
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> ---- MVLoad ----
>
> Begin time: 2020-06-11 00:23:23
> Parsing: /data/load_mv_test.xml
>
> Permutation 1 of 1 - /data/point_stat
> ==== grid_stat ====
>
> stat_header table time total: 0:00:00.000
> stat header records: 0
> stat header inserts: 0
> line data records: 0
> line data inserts: 0
> stat group records: 0
> stat group inserts: 0
> var length records: 0
> var length inserts: 0
> total lines: 0
> insert size: 1
> lines / msec: 0.000
> num files: 0
>
> ==== mode ====
>
> mtd_header search time total: 0:00:00.000
> stat_header search time total: 0:00:00.000
> mode_header inserts: 0
> mode_cts inserts: 0
> mode_obj_single inserts: 0
> mode_obj_pair inserts: 0
> ==== mtd ====
>
> mtd_header inserts: 0
> mtd_3d_obj_single inserts: 0
> mtd_3d_obj_pair inserts: 0
> mtd_2d_obj inserts: 0
> total lines: 0
> num files: 0
> num files: 0
>
> ==== indexes ====creating
> Indexes creating 0:00:00.454
>
> End time: 2020-06-11 00:23:23
> Load total: 0:00:00.003
>
> ---- MVLoad Done ----
>
> *No error ? but nothing is found under the dataset of METviewer
GUI. I am
> also wondering why it is processing the grid_stat, mod and mtd which
I
> don't have, not processing the point_stat I hope ?*
>
> Thanks,
> *~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> *Dr. Xin Zhang
> *
> *Software Engineer
> 001-303-497-8652*
> *Joint Center for Satellite Data Assimilation
> xinzhang at ucar.edu <xinzhang at ucar.edu>*
>
>
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Tatiana Burek
Time: Fri Jun 12 10:10:45 2020
Hello Xin,
in your XML you specified the data directory as
<folder_tmpl>/data/{met_tool}</folder_tmpl>
<load_val><field
name="met_tool"><val>point_stat</val></field></load_val>
During the execution METviewer replaces 'met_tool' with 'point_stat'
and looks for data files in /data/point_stat/ directory.
Your file is in /data/ directory and is invisible for METviewer. To
fix it you need to create 'point_stat' directory and move the data
file to this new directory. Try to run the loading script after that.
Tatiana
On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
> Hello,
>
> I successfully built the docker image of METviewer 3.0. I have a
just
> one point_stat file under /data/point_stat/:
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la /data
> total 16
> drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> point_stat_270000L_20190527_000000V.stat
>
> *Here is the content of /data/load_mv_test.xml:*
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> /data/load_mv_test.xml
> <load_spec>
> <connection>
> <management_system>mysql</management_system>
> <host>mysql_mv:3306</host>
> <database>mv_test</database>
> <user>root</user>
> <password>mvuser</password>
> </connection>
>
> <folder_tmpl>/data/{met_tool}</folder_tmpl>
>
> <met_version>V6.0</met_version>
>
> <verbose>true</verbose>
> <insert_size>1</insert_size>
> <mode_header_db_check>false</mode_header_db_check>
> <drop_indexes>false</drop_indexes>
> <apply_indexes>true</apply_indexes>
>
> <load_stat>true</load_stat>
> <load_mode>false</load_mode>
> <load_mpr>false</load_mpr>
> <load_orank>false</load_orank>
>
> <load_val>
> <field name="met_tool">
> <val>point_stat</val>
> </field>
> </load_val>
>
> </load_spec>
>
> *Here is the content of
/data/point_stat_270000L_20190527_000000V.stat:*
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> /data/point_stat_270000L_20190527_000000V.stat
> VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS FCST_LEV
OBS_VAR
> OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
FCST_THRESH
> OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 TMP K P900-750 TMP
NA
> P900-750 ADPUPA FULL BILIN 4 NA
NA
> NA NA SL1L2 96 282.50359 282.95 80007.0758
> 79885.23007 80131.85659 1.37716
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 TMP K P900-750 TMP
NA
> P900-750 ADPSFC FULL BILIN 4 NA
NA
> NA NA SL1L2 175 285.56938 285.37171 81514.22934
> 81577.11951 81460.56417 2.37752
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 UGRD m/s Z10 UGRD
NA
> Z10 ADPSFC FULL BILIN 4 NA
NA
> NA NA SL1L2 1690 0.10631 -0.018225 2.12765
> 5.01565 4.63367 1.8043
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 VGRD m/s Z10 VGRD
NA
> Z10 ADPSFC FULL BILIN 4 NA
NA
> NA NA SL1L2 1690 0.57217 0.49876 8.77582
> 14.98303 10.41817 2.1663
> V9.0.1 WRF NA 270000 20190527_000000 20190527_000000 000000
> 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
UGRD_VGRD NA
> Z10 ADPSFC FULL BILIN 4 NA
NA
> NA NA VL1L2 1690 0.10631 0.57217 -0.018225
> 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
>
> *When I run docker exec -it metviewer
/scripts/common/metv_load_all.ksh
> mv_test:*
>
> xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> /scripts/common/metv_load_all.ksh mv_test
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> ---- MVLoad ----
>
> Begin time: 2020-06-11 00:23:23
> Parsing: /data/load_mv_test.xml
>
> Permutation 1 of 1 - /data/point_stat
> ==== grid_stat ====
>
> stat_header table time total: 0:00:00.000
> stat header records: 0
> stat header inserts: 0
> line data records: 0
> line data inserts: 0
> stat group records: 0
> stat group inserts: 0
> var length records: 0
> var length inserts: 0
> total lines: 0
> insert size: 1
> lines / msec: 0.000
> num files: 0
>
> ==== mode ====
>
> mtd_header search time total: 0:00:00.000
> stat_header search time total: 0:00:00.000
> mode_header inserts: 0
> mode_cts inserts: 0
> mode_obj_single inserts: 0
> mode_obj_pair inserts: 0
> ==== mtd ====
>
> mtd_header inserts: 0
> mtd_3d_obj_single inserts: 0
> mtd_3d_obj_pair inserts: 0
> mtd_2d_obj inserts: 0
> total lines: 0
> num files: 0
> num files: 0
>
> ==== indexes ====creating
> Indexes creating 0:00:00.454
>
> End time: 2020-06-11 00:23:23
> Load total: 0:00:00.003
>
> ---- MVLoad Done ----
>
> *No error ? but nothing is found under the dataset of METviewer
GUI. I am
> also wondering why it is processing the grid_stat, mod and mtd which
I
> don't have, not processing the point_stat I hope ?*
>
> Thanks,
> *~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> *Dr. Xin Zhang
> *
> *Software Engineer
> 001-303-497-8652*
> *Joint Center for Satellite Data Assimilation
> xinzhang at ucar.edu <xinzhang at ucar.edu>*
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Xin Zhang
Time: Fri Jun 12 11:08:55 2020
Hi Tatiana:
* Yes, my mistake ! it works now. now the outputs is:*
*Now, here is what I got:*
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
exec -it
metviewer /scripts/common/metv_load_all.ksh mv_test
mysql: [Warning] Using a password on the command line interface can be
insecure.
mysql: [Warning] Using a password on the command line interface can be
insecure.
mysql: [Warning] Using a password on the command line interface can be
insecure.
---- MVLoad ----
Begin time: 2020-06-12 17:00:51
Parsing: /data/load_mv_test.xml
Permutation 1 of 4 - /data/grid_stat
Permutation 2 of 4 - /data/point_stat
/data/point_stat/point_stat_150000L_20200504_000000V.stat
** WARNING: file
/data/point_stat/point_stat_360000L_20070331_120000V.stat is empty and
will
be ignored
/data/point_stat/point_stat_270000L_20190527_000000V.stat
Permutation 2 of 4 complete - insert time: 0:00:00.040 stat lines: 6
mode
lines: 0
mtd lines: 0
Permutation 3 of 4 - /data/ensemble_stat
Permutation 4 of 4 - /data/mode
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
Permutation 4 of 4 complete - insert time: 0:00:00.368 stat lines: 0
mode
lines: 779
mtd lines: 0
==== grid_stat ====
stat_header table time total: 0:00:00.000
stat header records: 6
stat header inserts: 5
line data records: 6
line data inserts: 9
stat group records: 0
stat group inserts: 0
var length records: 0
var length inserts: 0
total lines: 6
insert size: 1
lines / msec: 0.014
num files: 2
==== mode ====
mtd_header search time total: 0:00:00.000
stat_header search time total: 0:00:00.004
mode_header inserts: 1
mode_cts inserts: 2
mode_obj_single inserts: 163
mode_obj_pair inserts: 612
==== mtd ====
mtd_header inserts: 0
mtd_3d_obj_single inserts: 0
mtd_3d_obj_pair inserts: 0
mtd_2d_obj inserts: 0
total lines: 779
num files: 2
num files: 0
==== indexes ====creating
Indexes creating 0:00:00.435
End time: 2020-06-12 17:00:52
Load total: 0:00:00.414
---- MVLoad Done ----
*However, When I launch the METViewer GUI page, it does not have any
dataset to plot.*
[image: image.png]
I* clicked the "reload dataset", it keep spins; I clicked the "Load
XML",
it is not responding, I think I already load something in.*
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
container exec -it metviewer ls -la
/opt/tomcat/webapps/metviewer_output/scripts
total 8
drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
container exec -it metviewer ls -la
/opt/tomcat/webapps/metviewer_output/data
total 8
drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
container exec -it metviewer ls -la
/opt/tomcat/webapps/metviewer_output/xml
total 16
drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
-rw-r----- 1 root root 4601 Jun 10 23:28 plot_20200610_232809.xml
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
container exec -it metviewer ls -la
/opt/tomcat/webapps/metviewer_output/
total 24
drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
container exec -it metviewer ls -la
/opt/tomcat/webapps/metviewer_output/plots
total 8
drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
*Any hint is appreciated*
*Have a nice weekend,*
On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Hello Xin,
> in your XML you specified the data directory as
> <folder_tmpl>/data/{met_tool}</folder_tmpl>
> <load_val><field
name="met_tool"><val>point_stat</val></field></load_val>
> During the execution METviewer replaces 'met_tool' with 'point_stat'
and
> looks for data files in /data/point_stat/ directory.
> Your file is in /data/ directory and is invisible for METviewer. To
fix it
> you need to create 'point_stat' directory and move the data file to
this
> new directory. Try to run the loading script after that.
>
> Tatiana
> On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
> > Hello,
> >
> > I successfully built the docker image of METviewer 3.0. I have
a just
> > one point_stat file under /data/point_stat/:
> >
> > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la /data
> > total 16
> > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> > -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> > point_stat_270000L_20190527_000000V.stat
> >
> > *Here is the content of /data/load_mv_test.xml:*
> >
> > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > /data/load_mv_test.xml
> > <load_spec>
> > <connection>
> > <management_system>mysql</management_system>
> > <host>mysql_mv:3306</host>
> > <database>mv_test</database>
> > <user>root</user>
> > <password>mvuser</password>
> > </connection>
> >
> > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> >
> > <met_version>V6.0</met_version>
> >
> > <verbose>true</verbose>
> > <insert_size>1</insert_size>
> > <mode_header_db_check>false</mode_header_db_check>
> > <drop_indexes>false</drop_indexes>
> > <apply_indexes>true</apply_indexes>
> >
> > <load_stat>true</load_stat>
> > <load_mode>false</load_mode>
> > <load_mpr>false</load_mpr>
> > <load_orank>false</load_orank>
> >
> > <load_val>
> > <field name="met_tool">
> > <val>point_stat</val>
> > </field>
> > </load_val>
> >
> > </load_spec>
> >
> > *Here is the content of
/data/point_stat_270000L_20190527_000000V.stat:*
> >
> > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > /data/point_stat_270000L_20190527_000000V.stat
> > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD
> > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS FCST_LEV
OBS_VAR
> > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
FCST_THRESH
> > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > 20190526_223000 20190527_013000 TMP K P900-750 TMP
> NA
> > P900-750 ADPUPA FULL BILIN 4 NA
NA
> > NA NA SL1L2 96 282.50359 282.95 80007.0758
> > 79885.23007 80131.85659 1.37716
> > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > 20190526_223000 20190527_013000 TMP K P900-750 TMP
> NA
> > P900-750 ADPSFC FULL BILIN 4 NA
NA
> > NA NA SL1L2 175 285.56938 285.37171 81514.22934
> > 81577.11951 81460.56417 2.37752
> > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > 20190526_223000 20190527_013000 UGRD m/s Z10 UGRD
> NA
> > Z10 ADPSFC FULL BILIN 4 NA
NA
> > NA NA SL1L2 1690 0.10631 -0.018225 2.12765
> > 5.01565 4.63367 1.8043
> > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > 20190526_223000 20190527_013000 VGRD m/s Z10 VGRD
> NA
> > Z10 ADPSFC FULL BILIN 4 NA
NA
> > NA NA SL1L2 1690 0.57217 0.49876 8.77582
> > 14.98303 10.41817 2.1663
> > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
UGRD_VGRD
> NA
> > Z10 ADPSFC FULL BILIN 4 NA
NA
> > NA NA VL1L2 1690 0.10631 0.57217
-0.018225
> > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
> >
> > *When I run docker exec -it metviewer
/scripts/common/metv_load_all.ksh
> > mv_test:*
> >
> > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> > /scripts/common/metv_load_all.ksh mv_test
> > mysql: [Warning] Using a password on the command line interface
can be
> > insecure.
> > mysql: [Warning] Using a password on the command line interface
can be
> > insecure.
> > mysql: [Warning] Using a password on the command line interface
can be
> > insecure.
> > ---- MVLoad ----
> >
> > Begin time: 2020-06-11 00:23:23
> > Parsing: /data/load_mv_test.xml
> >
> > Permutation 1 of 1 - /data/point_stat
> > ==== grid_stat ====
> >
> > stat_header table time total: 0:00:00.000
> > stat header records: 0
> > stat header inserts: 0
> > line data records: 0
> > line data inserts: 0
> > stat group records: 0
> > stat group inserts: 0
> > var length records: 0
> > var length inserts: 0
> > total lines: 0
> > insert size: 1
> > lines / msec: 0.000
> > num files: 0
> >
> > ==== mode ====
> >
> > mtd_header search time total: 0:00:00.000
> > stat_header search time total: 0:00:00.000
> > mode_header inserts: 0
> > mode_cts inserts: 0
> > mode_obj_single inserts: 0
> > mode_obj_pair inserts: 0
> > ==== mtd ====
> >
> > mtd_header inserts: 0
> > mtd_3d_obj_single inserts: 0
> > mtd_3d_obj_pair inserts: 0
> > mtd_2d_obj inserts: 0
> > total lines: 0
> > num files: 0
> > num files: 0
> >
> > ==== indexes ====creating
> > Indexes creating 0:00:00.454
> >
> > End time: 2020-06-11 00:23:23
> > Load total: 0:00:00.003
> >
> > ---- MVLoad Done ----
> >
> > *No error ? but nothing is found under the dataset of METviewer
GUI. I
> am
> > also wondering why it is processing the grid_stat, mod and mtd
which I
> > don't have, not processing the point_stat I hope ?*
> >
> > Thanks,
> >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> > *Dr. Xin Zhang
> > *
> > *Software Engineer
> > 001-303-497-8652*
> > *Joint Center for Satellite Data Assimilation
> > xinzhang at ucar.edu <xinzhang at ucar.edu>*
>
>
>
>
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Tatiana Burek
Time: Fri Jun 12 11:25:01 2020
Clicking the "reload dataset" is the correct think to do after the
load...
You can try to restart the container and see if it helps. If not,
please attache Tomcat log file to this ticket. You can find it in the
container in /opt/tomcat/logs/catalina.out.
It looks like the web app has difficulties to connect to the database.
Tatiana
On Fri Jun 12 11:08:55 2020, xinzhang at ucar.edu wrote:
> Hi Tatiana:
>
> * Yes, my mistake ! it works now. now the outputs is:*
>
> *Now, here is what I got:*
>
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> exec -it
> metviewer /scripts/common/metv_load_all.ksh mv_test
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> mysql: [Warning] Using a password on the command line interface can
be
> insecure.
> ---- MVLoad ----
>
> Begin time: 2020-06-12 17:00:51
> Parsing: /data/load_mv_test.xml
>
> Permutation 1 of 4 - /data/grid_stat
> Permutation 2 of 4 - /data/point_stat
> /data/point_stat/point_stat_150000L_20200504_000000V.stat
> ** WARNING: file
> /data/point_stat/point_stat_360000L_20070331_120000V.stat is empty
and
> will
> be ignored
> /data/point_stat/point_stat_270000L_20190527_000000V.stat
> Permutation 2 of 4 complete - insert time: 0:00:00.040 stat lines:
6
> mode
> lines: 0
> mtd lines: 0
>
> Permutation 3 of 4 - /data/ensemble_stat
> Permutation 4 of 4 - /data/mode
>
>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
>
>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
> Permutation 4 of 4 complete - insert time: 0:00:00.368 stat lines:
0
> mode
> lines: 779
> mtd lines: 0
>
> ==== grid_stat ====
>
> stat_header table time total: 0:00:00.000
> stat header records: 6
> stat header inserts: 5
> line data records: 6
> line data inserts: 9
> stat group records: 0
> stat group inserts: 0
> var length records: 0
> var length inserts: 0
> total lines: 6
> insert size: 1
> lines / msec: 0.014
> num files: 2
>
> ==== mode ====
>
> mtd_header search time total: 0:00:00.000
> stat_header search time total: 0:00:00.004
> mode_header inserts: 1
> mode_cts inserts: 2
> mode_obj_single inserts: 163
> mode_obj_pair inserts: 612
> ==== mtd ====
>
> mtd_header inserts: 0
> mtd_3d_obj_single inserts: 0
> mtd_3d_obj_pair inserts: 0
> mtd_2d_obj inserts: 0
> total lines: 779
> num files: 2
> num files: 0
>
> ==== indexes ====creating
> Indexes creating 0:00:00.435
>
> End time: 2020-06-12 17:00:52
> Load total: 0:00:00.414
>
> ---- MVLoad Done ----
>
> *However, When I launch the METViewer GUI page, it does not have any
> dataset to plot.*
>
> [image: image.png]
>
>
> I* clicked the "reload dataset", it keep spins; I clicked the "Load
> XML",
> it is not responding, I think I already load something in.*
>
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> container exec -it metviewer ls -la
> /opt/tomcat/webapps/metviewer_output/scripts
> total 8
> drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> container exec -it metviewer ls -la
> /opt/tomcat/webapps/metviewer_output/data
> total 8
> drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> container exec -it metviewer ls -la
> /opt/tomcat/webapps/metviewer_output/xml
> total 16
> drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
> drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> -rw-r----- 1 root root 4601 Jun 10 23:28 plot_20200610_232809.xml
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> container exec -it metviewer ls -la
> /opt/tomcat/webapps/metviewer_output/
> total 24
> drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
> drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
> drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
> drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
> drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
> drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> container exec -it metviewer ls -la
> /opt/tomcat/webapps/metviewer_output/plots
> total 8
> drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>
>
> *Any hint is appreciated*
>
> *Have a nice weekend,*
>
>
>
>
>
>
>
> On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Hello Xin,
> > in your XML you specified the data directory as
> > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > <load_val><field
> > name="met_tool"><val>point_stat</val></field></load_val>
> > During the execution METviewer replaces 'met_tool' with
'point_stat'
> > and
> > looks for data files in /data/point_stat/ directory.
> > Your file is in /data/ directory and is invisible for METviewer.
To
> > fix it
> > you need to create 'point_stat' directory and move the data file
to
> > this
> > new directory. Try to run the loading script after that.
> >
> > Tatiana
> > On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
> > > Hello,
> > >
> > > I successfully built the docker image of METviewer 3.0. I have a
> > > just
> > > one point_stat file under /data/point_stat/:
> > >
> > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la
/data
> > > total 16
> > > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> > > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> > > -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> > > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> > > point_stat_270000L_20190527_000000V.stat
> > >
> > > *Here is the content of /data/load_mv_test.xml:*
> > >
> > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > /data/load_mv_test.xml
> > > <load_spec>
> > > <connection>
> > > <management_system>mysql</management_system>
> > > <host>mysql_mv:3306</host>
> > > <database>mv_test</database>
> > > <user>root</user>
> > > <password>mvuser</password>
> > > </connection>
> > >
> > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > >
> > > <met_version>V6.0</met_version>
> > >
> > > <verbose>true</verbose>
> > > <insert_size>1</insert_size>
> > > <mode_header_db_check>false</mode_header_db_check>
> > > <drop_indexes>false</drop_indexes>
> > > <apply_indexes>true</apply_indexes>
> > >
> > > <load_stat>true</load_stat>
> > > <load_mode>false</load_mode>
> > > <load_mpr>false</load_mpr>
> > > <load_orank>false</load_orank>
> > >
> > > <load_val>
> > > <field name="met_tool">
> > > <val>point_stat</val>
> > > </field>
> > > </load_val>
> > >
> > > </load_spec>
> > >
> > > *Here is the content of
> > > /data/point_stat_270000L_20190527_000000V.stat:*
> > >
> > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > /data/point_stat_270000L_20190527_000000V.stat
> > > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
> > > OBS_LEAD
> > > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS FCST_LEV
> > > OBS_VAR
> > > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
> > > FCST_THRESH
> > > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > 20190526_223000 20190527_013000 TMP K P900-750
TMP
> > NA
> > > P900-750 ADPUPA FULL BILIN 4 NA NA
> > > NA NA SL1L2 96 282.50359 282.95 80007.0758
> > > 79885.23007 80131.85659 1.37716
> > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > 20190526_223000 20190527_013000 TMP K P900-750
TMP
> > NA
> > > P900-750 ADPSFC FULL BILIN 4 NA NA
> > > NA NA SL1L2 175 285.56938 285.37171 81514.22934
> > > 81577.11951 81460.56417 2.37752
> > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > 20190526_223000 20190527_013000 UGRD m/s Z10
UGRD
> > NA
> > > Z10 ADPSFC FULL BILIN 4 NA NA
> > > NA NA SL1L2 1690 0.10631 -0.018225 2.12765
> > > 5.01565 4.63367 1.8043
> > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > 20190526_223000 20190527_013000 VGRD m/s Z10
VGRD
> > NA
> > > Z10 ADPSFC FULL BILIN 4 NA NA
> > > NA NA SL1L2 1690 0.57217 0.49876 8.77582
> > > 14.98303 10.41817 2.1663
> > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
> > > UGRD_VGRD
> > NA
> > > Z10 ADPSFC FULL BILIN 4 NA NA
> > > NA NA VL1L2 1690 0.10631 0.57217
-0.018225
> > > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
> > >
> > > *When I run docker exec -it metviewer
> > > /scripts/common/metv_load_all.ksh
> > > mv_test:*
> > >
> > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> > > /scripts/common/metv_load_all.ksh mv_test
> > > mysql: [Warning] Using a password on the command line interface
can
> > > be
> > > insecure.
> > > mysql: [Warning] Using a password on the command line interface
can
> > > be
> > > insecure.
> > > mysql: [Warning] Using a password on the command line interface
can
> > > be
> > > insecure.
> > > ---- MVLoad ----
> > >
> > > Begin time: 2020-06-11 00:23:23
> > > Parsing: /data/load_mv_test.xml
> > >
> > > Permutation 1 of 1 - /data/point_stat
> > > ==== grid_stat ====
> > >
> > > stat_header table time total: 0:00:00.000
> > > stat header records: 0
> > > stat header inserts: 0
> > > line data records: 0
> > > line data inserts: 0
> > > stat group records: 0
> > > stat group inserts: 0
> > > var length records: 0
> > > var length inserts: 0
> > > total lines: 0
> > > insert size: 1
> > > lines / msec: 0.000
> > > num files: 0
> > >
> > > ==== mode ====
> > >
> > > mtd_header search time total: 0:00:00.000
> > > stat_header search time total: 0:00:00.000
> > > mode_header inserts: 0
> > > mode_cts inserts: 0
> > > mode_obj_single inserts: 0
> > > mode_obj_pair inserts: 0
> > > ==== mtd ====
> > >
> > > mtd_header inserts: 0
> > > mtd_3d_obj_single inserts: 0
> > > mtd_3d_obj_pair inserts: 0
> > > mtd_2d_obj inserts: 0
> > > total lines: 0
> > > num files: 0
> > > num files: 0
> > >
> > > ==== indexes ====creating
> > > Indexes creating 0:00:00.454
> > >
> > > End time: 2020-06-11 00:23:23
> > > Load total: 0:00:00.003
> > >
> > > ---- MVLoad Done ----
> > >
> > > *No error ? but nothing is found under the dataset of METviewer
> > > GUI. I
> > am
> > > also wondering why it is processing the grid_stat, mod and mtd
> > > which I
> > > don't have, not processing the point_stat I hope ?*
> > >
> > > Thanks,
> > >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> > > *Dr. Xin Zhang
> > > *
> > > *Software Engineer
> > > 001-303-497-8652*
> > > *Joint Center for Satellite Data Assimilation
> > > xinzhang at ucar.edu <xinzhang at ucar.edu>*
> >
> >
> >
> >
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Xin Zhang
Time: Fri Jun 12 11:40:56 2020
Hi Taniana:
I restarted the docker composer, amd also click the "Reload the
databases", here is the log
xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
container exec -it metviewer cat /opt/tomcat/logs/catalina.out
12-Jun-2020 17:38:25.989 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Server version:
Apache Tomcat/8.5.23
12-Jun-2020 17:38:25.990 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Server built:
Sep 28 2017 10:30:11 UTC
12-Jun-2020 17:38:25.990 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Server number:
8.5.23.0
12-Jun-2020 17:38:25.990 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log OS Name:
Linux
12-Jun-2020 17:38:25.990 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log OS Version:
5.3.0-59-generic
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Architecture:
amd64
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Java Home:
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el8_1.x86_64/jre
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log JVM Version:
1.8.0_252-b09
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:
Oracle Corporation
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:
/opt/tomcat
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:
/opt/tomcat
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument:
-Djava.util.logging.config.file=/opt/tomcat/conf/logging.properties
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument:
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument: -Djdk.tls.ephemeralDHKeySize=2048
12-Jun-2020 17:38:25.991 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument:
-Djava.protocol.handler.pkgs=org.apache.catalina.webresources
12-Jun-2020 17:38:25.992 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument: -Dcatalina.base=/opt/tomcat
12-Jun-2020 17:38:25.992 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument: -Dcatalina.home=/opt/tomcat
12-Jun-2020 17:38:25.992 INFO [main]
org.apache.catalina.startup.VersionLoggerListener.log Command line
argument: -Djava.io.tmpdir=/opt/tomcat/temp
12-Jun-2020 17:38:25.992 INFO [main]
org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The APR
based
Apache Tomcat Native library which allows optimal performance in
production
environments was not found on the java.library.path:
[/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
12-Jun-2020 17:38:26.038 INFO [main]
org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler
["http-nio-8080"]
12-Jun-2020 17:38:26.048 INFO [main]
org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a
shared
selector for servlet write/read
12-Jun-2020 17:38:26.050 INFO [main]
org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler
["ajp-nio-8009"]
12-Jun-2020 17:38:26.051 INFO [main]
org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a
shared
selector for servlet write/read
12-Jun-2020 17:38:26.051 INFO [main]
org.apache.catalina.startup.Catalina.load Initialization processed in
328 ms
12-Jun-2020 17:38:26.066 INFO [main]
org.apache.catalina.core.StandardService.startInternal Starting
service
[Catalina]
12-Jun-2020 17:38:26.066 INFO [main]
org.apache.catalina.core.StandardEngine.startInternal Starting Servlet
Engine: Apache Tomcat/8.5.23
12-Jun-2020 17:38:26.080 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployWAR Deploying web
application
archive [/opt/tomcat/webapps/metviewer.war]
12-Jun-2020 17:38:26.884 INFO [localhost-startStop-1]
org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was
scanned
for TLDs yet contained no TLDs. Enable debug logging for this logger
for a
complete list of JARs that were scanned but no TLDs were found in
them.
Skipping unneeded JARs during scanning can improve startup time and
JSP
compilation time.
12-Jun-2020 17:38:26.903 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployWAR Deployment of web
application archive [/opt/tomcat/webapps/metviewer.war] has finished
in
[823] ms
12-Jun-2020 17:38:26.904 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
application directory [/opt/tomcat/webapps/host-manager]
12-Jun-2020 17:38:26.921 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
web
application directory [/opt/tomcat/webapps/host-manager] has finished
in
[17] ms
12-Jun-2020 17:38:26.922 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
application directory [/opt/tomcat/webapps/manager]
12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
web
application directory [/opt/tomcat/webapps/manager] has finished in
[15] ms
12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
application directory [/opt/tomcat/webapps/ROOT]
12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
web
application directory [/opt/tomcat/webapps/ROOT] has finished in [13]
ms
12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
application directory [/opt/tomcat/webapps/docs]
12-Jun-2020 17:38:26.962 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
web
application directory [/opt/tomcat/webapps/docs] has finished in [12]
ms
12-Jun-2020 17:38:26.963 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
application directory [/opt/tomcat/webapps/examples]
12-Jun-2020 17:38:27.102 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
web
application directory [/opt/tomcat/webapps/examples] has finished in
[140]
ms
12-Jun-2020 17:38:27.103 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
application directory [/opt/tomcat/webapps/metviewer_output]
12-Jun-2020 17:38:27.113 INFO [localhost-startStop-1]
org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
web
application directory [/opt/tomcat/webapps/metviewer_output] has
finished
in [10] ms
12-Jun-2020 17:38:27.116 INFO [main]
org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
["http-nio-8080"]
12-Jun-2020 17:38:27.121 INFO [main]
org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
["ajp-nio-8009"]
12-Jun-2020 17:38:27.124 INFO [main]
org.apache.catalina.startup.Catalina.start Server startup in 1072 ms
*Thanks,*
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
*Dr. Xin Zhang
*
*Software Engineer
001-303-497-8652*
*Joint Center for Satellite Data Assimilation
xinzhang at ucar.edu <xinzhang at ucar.edu>*
On Fri, Jun 12, 2020 at 11:25 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Clicking the "reload dataset" is the correct think to do after the
load...
> You can try to restart the container and see if it helps. If not,
please
> attache Tomcat log file to this ticket. You can find it in the
container in
> /opt/tomcat/logs/catalina.out.
> It looks like the web app has difficulties to connect to the
database.
>
> Tatiana
>
> On Fri Jun 12 11:08:55 2020, xinzhang at ucar.edu wrote:
> > Hi Tatiana:
> >
> > * Yes, my mistake ! it works now. now the outputs is:*
> >
> > *Now, here is what I got:*
> >
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > exec -it
> > metviewer /scripts/common/metv_load_all.ksh mv_test
> > mysql: [Warning] Using a password on the command line interface
can be
> > insecure.
> > mysql: [Warning] Using a password on the command line interface
can be
> > insecure.
> > mysql: [Warning] Using a password on the command line interface
can be
> > insecure.
> > ---- MVLoad ----
> >
> > Begin time: 2020-06-12 17:00:51
> > Parsing: /data/load_mv_test.xml
> >
> > Permutation 1 of 4 - /data/grid_stat
> > Permutation 2 of 4 - /data/point_stat
> > /data/point_stat/point_stat_150000L_20200504_000000V.stat
> > ** WARNING: file
> > /data/point_stat/point_stat_360000L_20070331_120000V.stat is empty
and
> > will
> > be ignored
> > /data/point_stat/point_stat_270000L_20190527_000000V.stat
> > Permutation 2 of 4 complete - insert time: 0:00:00.040 stat
lines: 6
> > mode
> > lines: 0
> > mtd lines: 0
> >
> > Permutation 3 of 4 - /data/ensemble_stat
> > Permutation 4 of 4 - /data/mode
> >
> >
>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
> >
> >
>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
> > Permutation 4 of 4 complete - insert time: 0:00:00.368 stat
lines: 0
> > mode
> > lines: 779
> > mtd lines: 0
> >
> > ==== grid_stat ====
> >
> > stat_header table time total: 0:00:00.000
> > stat header records: 6
> > stat header inserts: 5
> > line data records: 6
> > line data inserts: 9
> > stat group records: 0
> > stat group inserts: 0
> > var length records: 0
> > var length inserts: 0
> > total lines: 6
> > insert size: 1
> > lines / msec: 0.014
> > num files: 2
> >
> > ==== mode ====
> >
> > mtd_header search time total: 0:00:00.000
> > stat_header search time total: 0:00:00.004
> > mode_header inserts: 1
> > mode_cts inserts: 2
> > mode_obj_single inserts: 163
> > mode_obj_pair inserts: 612
> > ==== mtd ====
> >
> > mtd_header inserts: 0
> > mtd_3d_obj_single inserts: 0
> > mtd_3d_obj_pair inserts: 0
> > mtd_2d_obj inserts: 0
> > total lines: 779
> > num files: 2
> > num files: 0
> >
> > ==== indexes ====creating
> > Indexes creating 0:00:00.435
> >
> > End time: 2020-06-12 17:00:52
> > Load total: 0:00:00.414
> >
> > ---- MVLoad Done ----
> >
> > *However, When I launch the METViewer GUI page, it does not have
any
> > dataset to plot.*
> >
> > [image: image.png]
> >
> >
> > I* clicked the "reload dataset", it keep spins; I clicked the
"Load
> > XML",
> > it is not responding, I think I already load something in.*
> >
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > container exec -it metviewer ls -la
> > /opt/tomcat/webapps/metviewer_output/scripts
> > total 8
> > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > container exec -it metviewer ls -la
> > /opt/tomcat/webapps/metviewer_output/data
> > total 8
> > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > container exec -it metviewer ls -la
> > /opt/tomcat/webapps/metviewer_output/xml
> > total 16
> > drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
> > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > -rw-r----- 1 root root 4601 Jun 10 23:28 plot_20200610_232809.xml
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > container exec -it metviewer ls -la
> > /opt/tomcat/webapps/metviewer_output/
> > total 24
> > drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
> > drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
> > drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
> > drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
> > drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
> > drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > container exec -it metviewer ls -la
> > /opt/tomcat/webapps/metviewer_output/plots
> > total 8
> > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> >
> >
> > *Any hint is appreciated*
> >
> > *Have a nice weekend,*
> >
> >
> >
> >
> >
> >
> >
> > On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Hello Xin,
> > > in your XML you specified the data directory as
> > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > > <load_val><field
> > > name="met_tool"><val>point_stat</val></field></load_val>
> > > During the execution METviewer replaces 'met_tool' with
'point_stat'
> > > and
> > > looks for data files in /data/point_stat/ directory.
> > > Your file is in /data/ directory and is invisible for METviewer.
To
> > > fix it
> > > you need to create 'point_stat' directory and move the data file
to
> > > this
> > > new directory. Try to run the loading script after that.
> > >
> > > Tatiana
> > > On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
> > > > Hello,
> > > >
> > > > I successfully built the docker image of METviewer 3.0. I have
a
> > > > just
> > > > one point_stat file under /data/point_stat/:
> > > >
> > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la
/data
> > > > total 16
> > > > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> > > > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> > > > -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> > > > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> > > > point_stat_270000L_20190527_000000V.stat
> > > >
> > > > *Here is the content of /data/load_mv_test.xml:*
> > > >
> > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > > /data/load_mv_test.xml
> > > > <load_spec>
> > > > <connection>
> > > > <management_system>mysql</management_system>
> > > > <host>mysql_mv:3306</host>
> > > > <database>mv_test</database>
> > > > <user>root</user>
> > > > <password>mvuser</password>
> > > > </connection>
> > > >
> > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > > >
> > > > <met_version>V6.0</met_version>
> > > >
> > > > <verbose>true</verbose>
> > > > <insert_size>1</insert_size>
> > > > <mode_header_db_check>false</mode_header_db_check>
> > > > <drop_indexes>false</drop_indexes>
> > > > <apply_indexes>true</apply_indexes>
> > > >
> > > > <load_stat>true</load_stat>
> > > > <load_mode>false</load_mode>
> > > > <load_mpr>false</load_mpr>
> > > > <load_orank>false</load_orank>
> > > >
> > > > <load_val>
> > > > <field name="met_tool">
> > > > <val>point_stat</val>
> > > > </field>
> > > > </load_val>
> > > >
> > > > </load_spec>
> > > >
> > > > *Here is the content of
> > > > /data/point_stat_270000L_20190527_000000V.stat:*
> > > >
> > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > > /data/point_stat_270000L_20190527_000000V.stat
> > > > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
> > > > OBS_LEAD
> > > > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS FCST_LEV
> > > > OBS_VAR
> > > > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
> > > > FCST_THRESH
> > > > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > > 20190526_223000 20190527_013000 TMP K P900-750
TMP
> > > NA
> > > > P900-750 ADPUPA FULL BILIN 4 NA NA
> > > > NA NA SL1L2 96 282.50359 282.95
80007.0758
> > > > 79885.23007 80131.85659 1.37716
> > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > > 20190526_223000 20190527_013000 TMP K P900-750
TMP
> > > NA
> > > > P900-750 ADPSFC FULL BILIN 4 NA NA
> > > > NA NA SL1L2 175 285.56938 285.37171
81514.22934
> > > > 81577.11951 81460.56417 2.37752
> > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > > 20190526_223000 20190527_013000 UGRD m/s Z10
UGRD
> > > NA
> > > > Z10 ADPSFC FULL BILIN 4 NA NA
> > > > NA NA SL1L2 1690 0.10631 -0.018225
2.12765
> > > > 5.01565 4.63367 1.8043
> > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > > 20190526_223000 20190527_013000 VGRD m/s Z10
VGRD
> > > NA
> > > > Z10 ADPSFC FULL BILIN 4 NA NA
> > > > NA NA SL1L2 1690 0.57217 0.49876
8.77582
> > > > 14.98303 10.41817 2.1663
> > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
000000
> > > > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
> > > > UGRD_VGRD
> > > NA
> > > > Z10 ADPSFC FULL BILIN 4 NA NA
> > > > NA NA VL1L2 1690 0.10631 0.57217
-0.018225
> > > > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
> > > >
> > > > *When I run docker exec -it metviewer
> > > > /scripts/common/metv_load_all.ksh
> > > > mv_test:*
> > > >
> > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> > > > /scripts/common/metv_load_all.ksh mv_test
> > > > mysql: [Warning] Using a password on the command line
interface can
> > > > be
> > > > insecure.
> > > > mysql: [Warning] Using a password on the command line
interface can
> > > > be
> > > > insecure.
> > > > mysql: [Warning] Using a password on the command line
interface can
> > > > be
> > > > insecure.
> > > > ---- MVLoad ----
> > > >
> > > > Begin time: 2020-06-11 00:23:23
> > > > Parsing: /data/load_mv_test.xml
> > > >
> > > > Permutation 1 of 1 - /data/point_stat
> > > > ==== grid_stat ====
> > > >
> > > > stat_header table time total: 0:00:00.000
> > > > stat header records: 0
> > > > stat header inserts: 0
> > > > line data records: 0
> > > > line data inserts: 0
> > > > stat group records: 0
> > > > stat group inserts: 0
> > > > var length records: 0
> > > > var length inserts: 0
> > > > total lines: 0
> > > > insert size: 1
> > > > lines / msec: 0.000
> > > > num files: 0
> > > >
> > > > ==== mode ====
> > > >
> > > > mtd_header search time total: 0:00:00.000
> > > > stat_header search time total: 0:00:00.000
> > > > mode_header inserts: 0
> > > > mode_cts inserts: 0
> > > > mode_obj_single inserts: 0
> > > > mode_obj_pair inserts: 0
> > > > ==== mtd ====
> > > >
> > > > mtd_header inserts: 0
> > > > mtd_3d_obj_single inserts: 0
> > > > mtd_3d_obj_pair inserts: 0
> > > > mtd_2d_obj inserts: 0
> > > > total lines: 0
> > > > num files: 0
> > > > num files: 0
> > > >
> > > > ==== indexes ====creating
> > > > Indexes creating 0:00:00.454
> > > >
> > > > End time: 2020-06-11 00:23:23
> > > > Load total: 0:00:00.003
> > > >
> > > > ---- MVLoad Done ----
> > > >
> > > > *No error ? but nothing is found under the dataset of
METviewer
> > > > GUI. I
> > > am
> > > > also wondering why it is processing the grid_stat, mod and mtd
> > > > which I
> > > > don't have, not processing the point_stat I hope ?*
> > > >
> > > > Thanks,
> > > >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> > > > *Dr. Xin Zhang
> > > > *
> > > > *Software Engineer
> > > > 001-303-497-8652*
> > > > *Joint Center for Satellite Data Assimilation
> > > > xinzhang at ucar.edu <xinzhang at ucar.edu>*
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Tatiana Burek
Time: Fri Jun 12 12:26:08 2020
I don't see any errors in the log. Did you 'cat' it after you refresh
the page or before?
Do you still expirience the same issue?
Tatiana
On Fri Jun 12 11:40:56 2020, xinzhang at ucar.edu wrote:
> Hi Taniana:
>
> I restarted the docker composer, amd also click the "Reload the
> databases", here is the log
>
> xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> container exec -it metviewer cat /opt/tomcat/logs/catalina.out
> 12-Jun-2020 17:38:25.989 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Server
version:
> Apache Tomcat/8.5.23
> 12-Jun-2020 17:38:25.990 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Server built:
> Sep 28 2017 10:30:11 UTC
> 12-Jun-2020 17:38:25.990 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Server number:
> 8.5.23.0
> 12-Jun-2020 17:38:25.990 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log OS Name:
> Linux
> 12-Jun-2020 17:38:25.990 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log OS Version:
> 5.3.0-59-generic
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Architecture:
> amd64
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Java Home:
> /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el8_1.x86_64/jre
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log JVM Version:
> 1.8.0_252-b09
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:
> Oracle Corporation
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:
> /opt/tomcat
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:
> /opt/tomcat
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument:
> -Djava.util.logging.config.file=/opt/tomcat/conf/logging.properties
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument:
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument: -Djdk.tls.ephemeralDHKeySize=2048
> 12-Jun-2020 17:38:25.991 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument:
> -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
> 12-Jun-2020 17:38:25.992 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument: -Dcatalina.base=/opt/tomcat
> 12-Jun-2020 17:38:25.992 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument: -Dcatalina.home=/opt/tomcat
> 12-Jun-2020 17:38:25.992 INFO [main]
> org.apache.catalina.startup.VersionLoggerListener.log Command line
> argument: -Djava.io.tmpdir=/opt/tomcat/temp
> 12-Jun-2020 17:38:25.992 INFO [main]
> org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The APR
> based
> Apache Tomcat Native library which allows optimal performance in
> production
> environments was not found on the java.library.path:
> [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
> 12-Jun-2020 17:38:26.038 INFO [main]
> org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler
> ["http-nio-8080"]
> 12-Jun-2020 17:38:26.048 INFO [main]
> org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a
> shared
> selector for servlet write/read
> 12-Jun-2020 17:38:26.050 INFO [main]
> org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler
> ["ajp-nio-8009"]
> 12-Jun-2020 17:38:26.051 INFO [main]
> org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a
> shared
> selector for servlet write/read
> 12-Jun-2020 17:38:26.051 INFO [main]
> org.apache.catalina.startup.Catalina.load Initialization processed
in
> 328 ms
> 12-Jun-2020 17:38:26.066 INFO [main]
> org.apache.catalina.core.StandardService.startInternal Starting
> service
> [Catalina]
> 12-Jun-2020 17:38:26.066 INFO [main]
> org.apache.catalina.core.StandardEngine.startInternal Starting
Servlet
> Engine: Apache Tomcat/8.5.23
> 12-Jun-2020 17:38:26.080 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployWAR Deploying web
> application
> archive [/opt/tomcat/webapps/metviewer.war]
> 12-Jun-2020 17:38:26.884 INFO [localhost-startStop-1]
> org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was
> scanned
> for TLDs yet contained no TLDs. Enable debug logging for this logger
> for a
> complete list of JARs that were scanned but no TLDs were found in
> them.
> Skipping unneeded JARs during scanning can improve startup time and
> JSP
> compilation time.
> 12-Jun-2020 17:38:26.903 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployWAR Deployment of web
> application archive [/opt/tomcat/webapps/metviewer.war] has finished
> in
> [823] ms
> 12-Jun-2020 17:38:26.904 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
> application directory [/opt/tomcat/webapps/host-manager]
> 12-Jun-2020 17:38:26.921 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
> web
> application directory [/opt/tomcat/webapps/host-manager] has
finished
> in
> [17] ms
> 12-Jun-2020 17:38:26.922 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
> application directory [/opt/tomcat/webapps/manager]
> 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
> web
> application directory [/opt/tomcat/webapps/manager] has finished in
> [15] ms
> 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
> application directory [/opt/tomcat/webapps/ROOT]
> 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
> web
> application directory [/opt/tomcat/webapps/ROOT] has finished in
[13]
> ms
> 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
> application directory [/opt/tomcat/webapps/docs]
> 12-Jun-2020 17:38:26.962 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
> web
> application directory [/opt/tomcat/webapps/docs] has finished in
[12]
> ms
> 12-Jun-2020 17:38:26.963 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
> application directory [/opt/tomcat/webapps/examples]
> 12-Jun-2020 17:38:27.102 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
> web
> application directory [/opt/tomcat/webapps/examples] has finished in
> [140]
> ms
> 12-Jun-2020 17:38:27.103 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deploying web
> application directory [/opt/tomcat/webapps/metviewer_output]
> 12-Jun-2020 17:38:27.113 INFO [localhost-startStop-1]
> org.apache.catalina.startup.HostConfig.deployDirectory Deployment of
> web
> application directory [/opt/tomcat/webapps/metviewer_output] has
> finished
> in [10] ms
> 12-Jun-2020 17:38:27.116 INFO [main]
> org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
> ["http-nio-8080"]
> 12-Jun-2020 17:38:27.121 INFO [main]
> org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
> ["ajp-nio-8009"]
> 12-Jun-2020 17:38:27.124 INFO [main]
> org.apache.catalina.startup.Catalina.start Server startup in 1072 ms
>
> *Thanks,*
>
> *~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> *Dr. Xin Zhang
> *
> *Software Engineer
> 001-303-497-8652*
> *Joint Center for Satellite Data Assimilation
> xinzhang at ucar.edu <xinzhang at ucar.edu>*
>
>
>
> On Fri, Jun 12, 2020 at 11:25 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Clicking the "reload dataset" is the correct think to do after the
> > load...
> > You can try to restart the container and see if it helps. If not,
> > please
> > attache Tomcat log file to this ticket. You can find it in the
> > container in
> > /opt/tomcat/logs/catalina.out.
> > It looks like the web app has difficulties to connect to the
> > database.
> >
> > Tatiana
> >
> > On Fri Jun 12 11:08:55 2020, xinzhang at ucar.edu wrote:
> > > Hi Tatiana:
> > >
> > > * Yes, my mistake ! it works now. now the outputs is:*
> > >
> > > *Now, here is what I got:*
> > >
> > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > exec -it
> > > metviewer /scripts/common/metv_load_all.ksh mv_test
> > > mysql: [Warning] Using a password on the command line interface
can
> > > be
> > > insecure.
> > > mysql: [Warning] Using a password on the command line interface
can
> > > be
> > > insecure.
> > > mysql: [Warning] Using a password on the command line interface
can
> > > be
> > > insecure.
> > > ---- MVLoad ----
> > >
> > > Begin time: 2020-06-12 17:00:51
> > > Parsing: /data/load_mv_test.xml
> > >
> > > Permutation 1 of 4 - /data/grid_stat
> > > Permutation 2 of 4 - /data/point_stat
> > > /data/point_stat/point_stat_150000L_20200504_000000V.stat
> > > ** WARNING: file
> > > /data/point_stat/point_stat_360000L_20070331_120000V.stat is
empty
> > > and
> > > will
> > > be ignored
> > > /data/point_stat/point_stat_270000L_20190527_000000V.stat
> > > Permutation 2 of 4 complete - insert time: 0:00:00.040 stat
lines:
> > > 6
> > > mode
> > > lines: 0
> > > mtd lines: 0
> > >
> > > Permutation 3 of 4 - /data/ensemble_stat
> > > Permutation 4 of 4 - /data/mode
> > >
> > >
> >
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
> > >
> > >
> >
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
> > > Permutation 4 of 4 complete - insert time: 0:00:00.368 stat
lines:
> > > 0
> > > mode
> > > lines: 779
> > > mtd lines: 0
> > >
> > > ==== grid_stat ====
> > >
> > > stat_header table time total: 0:00:00.000
> > > stat header records: 6
> > > stat header inserts: 5
> > > line data records: 6
> > > line data inserts: 9
> > > stat group records: 0
> > > stat group inserts: 0
> > > var length records: 0
> > > var length inserts: 0
> > > total lines: 6
> > > insert size: 1
> > > lines / msec: 0.014
> > > num files: 2
> > >
> > > ==== mode ====
> > >
> > > mtd_header search time total: 0:00:00.000
> > > stat_header search time total: 0:00:00.004
> > > mode_header inserts: 1
> > > mode_cts inserts: 2
> > > mode_obj_single inserts: 163
> > > mode_obj_pair inserts: 612
> > > ==== mtd ====
> > >
> > > mtd_header inserts: 0
> > > mtd_3d_obj_single inserts: 0
> > > mtd_3d_obj_pair inserts: 0
> > > mtd_2d_obj inserts: 0
> > > total lines: 779
> > > num files: 2
> > > num files: 0
> > >
> > > ==== indexes ====creating
> > > Indexes creating 0:00:00.435
> > >
> > > End time: 2020-06-12 17:00:52
> > > Load total: 0:00:00.414
> > >
> > > ---- MVLoad Done ----
> > >
> > > *However, When I launch the METViewer GUI page, it does not have
> > > any
> > > dataset to plot.*
> > >
> > > [image: image.png]
> > >
> > >
> > > I* clicked the "reload dataset", it keep spins; I clicked the
"Load
> > > XML",
> > > it is not responding, I think I already load something in.*
> > >
> > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > container exec -it metviewer ls -la
> > > /opt/tomcat/webapps/metviewer_output/scripts
> > > total 8
> > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > container exec -it metviewer ls -la
> > > /opt/tomcat/webapps/metviewer_output/data
> > > total 8
> > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > container exec -it metviewer ls -la
> > > /opt/tomcat/webapps/metviewer_output/xml
> > > total 16
> > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
> > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > -rw-r----- 1 root root 4601 Jun 10 23:28
plot_20200610_232809.xml
> > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > container exec -it metviewer ls -la
> > > /opt/tomcat/webapps/metviewer_output/
> > > total 24
> > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
> > > drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
> > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
> > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
> > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
> > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
> > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > container exec -it metviewer ls -la
> > > /opt/tomcat/webapps/metviewer_output/plots
> > > total 8
> > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > >
> > >
> > > *Any hint is appreciated*
> > >
> > > *Have a nice weekend,*
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hello Xin,
> > > > in your XML you specified the data directory as
> > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > > > <load_val><field
> > > > name="met_tool"><val>point_stat</val></field></load_val>
> > > > During the execution METviewer replaces 'met_tool' with
> > > > 'point_stat'
> > > > and
> > > > looks for data files in /data/point_stat/ directory.
> > > > Your file is in /data/ directory and is invisible for
METviewer.
> > > > To
> > > > fix it
> > > > you need to create 'point_stat' directory and move the data
file
> > > > to
> > > > this
> > > > new directory. Try to run the loading script after that.
> > > >
> > > > Tatiana
> > > > On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
> > > > > Hello,
> > > > >
> > > > > I successfully built the docker image of METviewer 3.0. I
have
> > > > > a
> > > > > just
> > > > > one point_stat file under /data/point_stat/:
> > > > >
> > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls -la
> > > > > /data
> > > > > total 16
> > > > > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> > > > > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> > > > > -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> > > > > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> > > > > point_stat_270000L_20190527_000000V.stat
> > > > >
> > > > > *Here is the content of /data/load_mv_test.xml:*
> > > > >
> > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > > > /data/load_mv_test.xml
> > > > > <load_spec>
> > > > > <connection>
> > > > > <management_system>mysql</management_system>
> > > > > <host>mysql_mv:3306</host>
> > > > > <database>mv_test</database>
> > > > > <user>root</user>
> > > > > <password>mvuser</password>
> > > > > </connection>
> > > > >
> > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > > > >
> > > > > <met_version>V6.0</met_version>
> > > > >
> > > > > <verbose>true</verbose>
> > > > > <insert_size>1</insert_size>
> > > > > <mode_header_db_check>false</mode_header_db_check>
> > > > > <drop_indexes>false</drop_indexes>
> > > > > <apply_indexes>true</apply_indexes>
> > > > >
> > > > > <load_stat>true</load_stat>
> > > > > <load_mode>false</load_mode>
> > > > > <load_mpr>false</load_mpr>
> > > > > <load_orank>false</load_orank>
> > > > >
> > > > > <load_val>
> > > > > <field name="met_tool">
> > > > > <val>point_stat</val>
> > > > > </field>
> > > > > </load_val>
> > > > >
> > > > > </load_spec>
> > > > >
> > > > > *Here is the content of
> > > > > /data/point_stat_270000L_20190527_000000V.stat:*
> > > > >
> > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > > > /data/point_stat_270000L_20190527_000000V.stat
> > > > > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG FCST_VALID_END
> > > > > OBS_LEAD
> > > > > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS
FCST_LEV
> > > > > OBS_VAR
> > > > > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
> > > > > FCST_THRESH
> > > > > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> > > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
> > > > > 000000
> > > > > 20190526_223000 20190527_013000 TMP K P900-
750
> > > > > TMP
> > > > NA
> > > > > P900-750 ADPUPA FULL BILIN 4 NA
NA
> > > > > NA NA SL1L2 96 282.50359 282.95
80007.0758
> > > > > 79885.23007 80131.85659 1.37716
> > > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
> > > > > 000000
> > > > > 20190526_223000 20190527_013000 TMP K P900-
750
> > > > > TMP
> > > > NA
> > > > > P900-750 ADPSFC FULL BILIN 4 NA
NA
> > > > > NA NA SL1L2 175 285.56938 285.37171
> > > > > 81514.22934
> > > > > 81577.11951 81460.56417 2.37752
> > > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
> > > > > 000000
> > > > > 20190526_223000 20190527_013000 UGRD m/s Z10
> > > > > UGRD
> > > > NA
> > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
> > > > > NA NA SL1L2 1690 0.10631 -0.018225
> > > > > 2.12765
> > > > > 5.01565 4.63367 1.8043
> > > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
> > > > > 000000
> > > > > 20190526_223000 20190527_013000 VGRD m/s Z10
> > > > > VGRD
> > > > NA
> > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
> > > > > NA NA SL1L2 1690 0.57217 0.49876
> > > > > 8.77582
> > > > > 14.98303 10.41817 2.1663
> > > > > V9.0.1 WRF NA 270000 20190527_000000 20190527_000000
> > > > > 000000
> > > > > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
> > > > > UGRD_VGRD
> > > > NA
> > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
> > > > > NA NA VL1L2 1690 0.10631 0.57217
> > > > > -0.018225
> > > > > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
> > > > >
> > > > > *When I run docker exec -it metviewer
> > > > > /scripts/common/metv_load_all.ksh
> > > > > mv_test:*
> > > > >
> > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> > > > > /scripts/common/metv_load_all.ksh mv_test
> > > > > mysql: [Warning] Using a password on the command line
interface
> > > > > can
> > > > > be
> > > > > insecure.
> > > > > mysql: [Warning] Using a password on the command line
interface
> > > > > can
> > > > > be
> > > > > insecure.
> > > > > mysql: [Warning] Using a password on the command line
interface
> > > > > can
> > > > > be
> > > > > insecure.
> > > > > ---- MVLoad ----
> > > > >
> > > > > Begin time: 2020-06-11 00:23:23
> > > > > Parsing: /data/load_mv_test.xml
> > > > >
> > > > > Permutation 1 of 1 - /data/point_stat
> > > > > ==== grid_stat ====
> > > > >
> > > > > stat_header table time total: 0:00:00.000
> > > > > stat header records: 0
> > > > > stat header inserts: 0
> > > > > line data records: 0
> > > > > line data inserts: 0
> > > > > stat group records: 0
> > > > > stat group inserts: 0
> > > > > var length records: 0
> > > > > var length inserts: 0
> > > > > total lines: 0
> > > > > insert size: 1
> > > > > lines / msec: 0.000
> > > > > num files: 0
> > > > >
> > > > > ==== mode ====
> > > > >
> > > > > mtd_header search time total: 0:00:00.000
> > > > > stat_header search time total: 0:00:00.000
> > > > > mode_header inserts: 0
> > > > > mode_cts inserts: 0
> > > > > mode_obj_single inserts: 0
> > > > > mode_obj_pair inserts: 0
> > > > > ==== mtd ====
> > > > >
> > > > > mtd_header inserts: 0
> > > > > mtd_3d_obj_single inserts: 0
> > > > > mtd_3d_obj_pair inserts: 0
> > > > > mtd_2d_obj inserts: 0
> > > > > total lines: 0
> > > > > num files: 0
> > > > > num files: 0
> > > > >
> > > > > ==== indexes ====creating
> > > > > Indexes creating 0:00:00.454
> > > > >
> > > > > End time: 2020-06-11 00:23:23
> > > > > Load total: 0:00:00.003
> > > > >
> > > > > ---- MVLoad Done ----
> > > > >
> > > > > *No error ? but nothing is found under the dataset of
> > > > > METviewer
> > > > > GUI. I
> > > > am
> > > > > also wondering why it is processing the grid_stat, mod and
mtd
> > > > > which I
> > > > > don't have, not processing the point_stat I hope ?*
> > > > >
> > > > > Thanks,
> > > > >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> > > > > *Dr. Xin Zhang
> > > > > *
> > > > > *Software Engineer
> > > > > 001-303-497-8652*
> > > > > *Joint Center for Satellite Data Assimilation
> > > > > xinzhang at ucar.edu <xinzhang at ucar.edu>*
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Xin Zhang
Time: Fri Jun 12 12:30:14 2020
I observed this file.
After I docker-compose up, the log file is not changing no matter if I
"reload datasets" or not . The reload keeps spinning.
Yes, I still have the same issue.
Cheers,
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
*Dr. Xin Zhang
*
*Software Engineer
001-303-497-8652*
*Joint Center for Satellite Data Assimilation
xinzhang at ucar.edu <xinzhang at ucar.edu>*
On Fri, Jun 12, 2020 at 12:26 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> I don't see any errors in the log. Did you 'cat' it after you
refresh the
> page or before?
> Do you still expirience the same issue?
>
> Tatiana
>
> On Fri Jun 12 11:40:56 2020, xinzhang at ucar.edu wrote:
> > Hi Taniana:
> >
> > I restarted the docker composer, amd also click the "Reload the
> > databases", here is the log
> >
> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$ docker
> > container exec -it metviewer cat /opt/tomcat/logs/catalina.out
> > 12-Jun-2020 17:38:25.989 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Server
version:
> > Apache Tomcat/8.5.23
> > 12-Jun-2020 17:38:25.990 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Server
built:
> > Sep 28 2017 10:30:11 UTC
> > 12-Jun-2020 17:38:25.990 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Server
number:
> > 8.5.23.0
> > 12-Jun-2020 17:38:25.990 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log OS Name:
> > Linux
> > 12-Jun-2020 17:38:25.990 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log OS Version:
> > 5.3.0-59-generic
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log
Architecture:
> > amd64
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Java Home:
> > /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-2.el8_1.x86_64/jre
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log JVM Version:
> > 1.8.0_252-b09
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:
> > Oracle Corporation
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log
CATALINA_BASE:
> > /opt/tomcat
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log
CATALINA_HOME:
> > /opt/tomcat
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument:
> >
-Djava.util.logging.config.file=/opt/tomcat/conf/logging.properties
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument:
> > -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument: -Djdk.tls.ephemeralDHKeySize=2048
> > 12-Jun-2020 17:38:25.991 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument:
> > -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
> > 12-Jun-2020 17:38:25.992 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument: -Dcatalina.base=/opt/tomcat
> > 12-Jun-2020 17:38:25.992 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument: -Dcatalina.home=/opt/tomcat
> > 12-Jun-2020 17:38:25.992 INFO [main]
> > org.apache.catalina.startup.VersionLoggerListener.log Command line
> > argument: -Djava.io.tmpdir=/opt/tomcat/temp
> > 12-Jun-2020 17:38:25.992 INFO [main]
> > org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The
APR
> > based
> > Apache Tomcat Native library which allows optimal performance in
> > production
> > environments was not found on the java.library.path:
> > [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
> > 12-Jun-2020 17:38:26.038 INFO [main]
> > org.apache.coyote.AbstractProtocol.init Initializing
ProtocolHandler
> > ["http-nio-8080"]
> > 12-Jun-2020 17:38:26.048 INFO [main]
> > org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using
a
> > shared
> > selector for servlet write/read
> > 12-Jun-2020 17:38:26.050 INFO [main]
> > org.apache.coyote.AbstractProtocol.init Initializing
ProtocolHandler
> > ["ajp-nio-8009"]
> > 12-Jun-2020 17:38:26.051 INFO [main]
> > org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using
a
> > shared
> > selector for servlet write/read
> > 12-Jun-2020 17:38:26.051 INFO [main]
> > org.apache.catalina.startup.Catalina.load Initialization processed
in
> > 328 ms
> > 12-Jun-2020 17:38:26.066 INFO [main]
> > org.apache.catalina.core.StandardService.startInternal Starting
> > service
> > [Catalina]
> > 12-Jun-2020 17:38:26.066 INFO [main]
> > org.apache.catalina.core.StandardEngine.startInternal Starting
Servlet
> > Engine: Apache Tomcat/8.5.23
> > 12-Jun-2020 17:38:26.080 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployWAR Deploying web
> > application
> > archive [/opt/tomcat/webapps/metviewer.war]
> > 12-Jun-2020 17:38:26.884 INFO [localhost-startStop-1]
> > org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was
> > scanned
> > for TLDs yet contained no TLDs. Enable debug logging for this
logger
> > for a
> > complete list of JARs that were scanned but no TLDs were found in
> > them.
> > Skipping unneeded JARs during scanning can improve startup time
and
> > JSP
> > compilation time.
> > 12-Jun-2020 17:38:26.903 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployWAR Deployment of web
> > application archive [/opt/tomcat/webapps/metviewer.war] has
finished
> > in
> > [823] ms
> > 12-Jun-2020 17:38:26.904 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
> > application directory [/opt/tomcat/webapps/host-manager]
> > 12-Jun-2020 17:38:26.921 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
> > web
> > application directory [/opt/tomcat/webapps/host-manager] has
finished
> > in
> > [17] ms
> > 12-Jun-2020 17:38:26.922 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
> > application directory [/opt/tomcat/webapps/manager]
> > 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
> > web
> > application directory [/opt/tomcat/webapps/manager] has finished
in
> > [15] ms
> > 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
> > application directory [/opt/tomcat/webapps/ROOT]
> > 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
> > web
> > application directory [/opt/tomcat/webapps/ROOT] has finished in
[13]
> > ms
> > 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
> > application directory [/opt/tomcat/webapps/docs]
> > 12-Jun-2020 17:38:26.962 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
> > web
> > application directory [/opt/tomcat/webapps/docs] has finished in
[12]
> > ms
> > 12-Jun-2020 17:38:26.963 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
> > application directory [/opt/tomcat/webapps/examples]
> > 12-Jun-2020 17:38:27.102 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
> > web
> > application directory [/opt/tomcat/webapps/examples] has finished
in
> > [140]
> > ms
> > 12-Jun-2020 17:38:27.103 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
> > application directory [/opt/tomcat/webapps/metviewer_output]
> > 12-Jun-2020 17:38:27.113 INFO [localhost-startStop-1]
> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
> > web
> > application directory [/opt/tomcat/webapps/metviewer_output] has
> > finished
> > in [10] ms
> > 12-Jun-2020 17:38:27.116 INFO [main]
> > org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
> > ["http-nio-8080"]
> > 12-Jun-2020 17:38:27.121 INFO [main]
> > org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
> > ["ajp-nio-8009"]
> > 12-Jun-2020 17:38:27.124 INFO [main]
> > org.apache.catalina.startup.Catalina.start Server startup in 1072
ms
> >
> > *Thanks,*
> >
> >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> > *Dr. Xin Zhang
> > *
> > *Software Engineer
> > 001-303-497-8652*
> > *Joint Center for Satellite Data Assimilation
> > xinzhang at ucar.edu <xinzhang at ucar.edu>*
> >
> >
> >
> > On Fri, Jun 12, 2020 at 11:25 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Clicking the "reload dataset" is the correct think to do after
the
> > > load...
> > > You can try to restart the container and see if it helps. If
not,
> > > please
> > > attache Tomcat log file to this ticket. You can find it in the
> > > container in
> > > /opt/tomcat/logs/catalina.out.
> > > It looks like the web app has difficulties to connect to the
> > > database.
> > >
> > > Tatiana
> > >
> > > On Fri Jun 12 11:08:55 2020, xinzhang at ucar.edu wrote:
> > > > Hi Tatiana:
> > > >
> > > > * Yes, my mistake ! it works now. now the outputs is:*
> > > >
> > > > *Now, here is what I got:*
> > > >
> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > > exec -it
> > > > metviewer /scripts/common/metv_load_all.ksh mv_test
> > > > mysql: [Warning] Using a password on the command line
interface can
> > > > be
> > > > insecure.
> > > > mysql: [Warning] Using a password on the command line
interface can
> > > > be
> > > > insecure.
> > > > mysql: [Warning] Using a password on the command line
interface can
> > > > be
> > > > insecure.
> > > > ---- MVLoad ----
> > > >
> > > > Begin time: 2020-06-12 17:00:51
> > > > Parsing: /data/load_mv_test.xml
> > > >
> > > > Permutation 1 of 4 - /data/grid_stat
> > > > Permutation 2 of 4 - /data/point_stat
> > > > /data/point_stat/point_stat_150000L_20200504_000000V.stat
> > > > ** WARNING: file
> > > > /data/point_stat/point_stat_360000L_20070331_120000V.stat is
empty
> > > > and
> > > > will
> > > > be ignored
> > > > /data/point_stat/point_stat_270000L_20190527_000000V.stat
> > > > Permutation 2 of 4 complete - insert time: 0:00:00.040 stat
lines:
> > > > 6
> > > > mode
> > > > lines: 0
> > > > mtd lines: 0
> > > >
> > > > Permutation 3 of 4 - /data/ensemble_stat
> > > > Permutation 4 of 4 - /data/mode
> > > >
> > > >
> > >
>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
> > > >
> > > >
> > >
>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
> > > > Permutation 4 of 4 complete - insert time: 0:00:00.368 stat
lines:
> > > > 0
> > > > mode
> > > > lines: 779
> > > > mtd lines: 0
> > > >
> > > > ==== grid_stat ====
> > > >
> > > > stat_header table time total: 0:00:00.000
> > > > stat header records: 6
> > > > stat header inserts: 5
> > > > line data records: 6
> > > > line data inserts: 9
> > > > stat group records: 0
> > > > stat group inserts: 0
> > > > var length records: 0
> > > > var length inserts: 0
> > > > total lines: 6
> > > > insert size: 1
> > > > lines / msec: 0.014
> > > > num files: 2
> > > >
> > > > ==== mode ====
> > > >
> > > > mtd_header search time total: 0:00:00.000
> > > > stat_header search time total: 0:00:00.004
> > > > mode_header inserts: 1
> > > > mode_cts inserts: 2
> > > > mode_obj_single inserts: 163
> > > > mode_obj_pair inserts: 612
> > > > ==== mtd ====
> > > >
> > > > mtd_header inserts: 0
> > > > mtd_3d_obj_single inserts: 0
> > > > mtd_3d_obj_pair inserts: 0
> > > > mtd_2d_obj inserts: 0
> > > > total lines: 779
> > > > num files: 2
> > > > num files: 0
> > > >
> > > > ==== indexes ====creating
> > > > Indexes creating 0:00:00.435
> > > >
> > > > End time: 2020-06-12 17:00:52
> > > > Load total: 0:00:00.414
> > > >
> > > > ---- MVLoad Done ----
> > > >
> > > > *However, When I launch the METViewer GUI page, it does not
have
> > > > any
> > > > dataset to plot.*
> > > >
> > > > [image: image.png]
> > > >
> > > >
> > > > I* clicked the "reload dataset", it keep spins; I clicked the
"Load
> > > > XML",
> > > > it is not responding, I think I already load something in.*
> > > >
> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > > container exec -it metviewer ls -la
> > > > /opt/tomcat/webapps/metviewer_output/scripts
> > > > total 8
> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > > container exec -it metviewer ls -la
> > > > /opt/tomcat/webapps/metviewer_output/data
> > > > total 8
> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > > container exec -it metviewer ls -la
> > > > /opt/tomcat/webapps/metviewer_output/xml
> > > > total 16
> > > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > > -rw-r----- 1 root root 4601 Jun 10 23:28
plot_20200610_232809.xml
> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > > container exec -it metviewer ls -la
> > > > /opt/tomcat/webapps/metviewer_output/
> > > > total 24
> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
> > > > drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
> > > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
> > > > container exec -it metviewer ls -la
> > > > /opt/tomcat/webapps/metviewer_output/plots
> > > > total 8
> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
> > > >
> > > >
> > > > *Any hint is appreciated*
> > > >
> > > > *Have a nice weekend,*
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hello Xin,
> > > > > in your XML you specified the data directory as
> > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > > > > <load_val><field
> > > > > name="met_tool"><val>point_stat</val></field></load_val>
> > > > > During the execution METviewer replaces 'met_tool' with
> > > > > 'point_stat'
> > > > > and
> > > > > looks for data files in /data/point_stat/ directory.
> > > > > Your file is in /data/ directory and is invisible for
METviewer.
> > > > > To
> > > > > fix it
> > > > > you need to create 'point_stat' directory and move the data
file
> > > > > to
> > > > > this
> > > > > new directory. Try to run the loading script after that.
> > > > >
> > > > > Tatiana
> > > > > On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
> > > > > > Hello,
> > > > > >
> > > > > > I successfully built the docker image of METviewer 3.0. I
have
> > > > > > a
> > > > > > just
> > > > > > one point_stat file under /data/point_stat/:
> > > > > >
> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls
-la
> > > > > > /data
> > > > > > total 16
> > > > > > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
> > > > > > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
> > > > > > -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
> > > > > > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
> > > > > > point_stat_270000L_20190527_000000V.stat
> > > > > >
> > > > > > *Here is the content of /data/load_mv_test.xml:*
> > > > > >
> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > > > > /data/load_mv_test.xml
> > > > > > <load_spec>
> > > > > > <connection>
> > > > > > <management_system>mysql</management_system>
> > > > > > <host>mysql_mv:3306</host>
> > > > > > <database>mv_test</database>
> > > > > > <user>root</user>
> > > > > > <password>mvuser</password>
> > > > > > </connection>
> > > > > >
> > > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
> > > > > >
> > > > > > <met_version>V6.0</met_version>
> > > > > >
> > > > > > <verbose>true</verbose>
> > > > > > <insert_size>1</insert_size>
> > > > > > <mode_header_db_check>false</mode_header_db_check>
> > > > > > <drop_indexes>false</drop_indexes>
> > > > > > <apply_indexes>true</apply_indexes>
> > > > > >
> > > > > > <load_stat>true</load_stat>
> > > > > > <load_mode>false</load_mode>
> > > > > > <load_mpr>false</load_mpr>
> > > > > > <load_orank>false</load_orank>
> > > > > >
> > > > > > <load_val>
> > > > > > <field name="met_tool">
> > > > > > <val>point_stat</val>
> > > > > > </field>
> > > > > > </load_val>
> > > > > >
> > > > > > </load_spec>
> > > > > >
> > > > > > *Here is the content of
> > > > > > /data/point_stat_270000L_20190527_000000V.stat:*
> > > > > >
> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
> > > > > > /data/point_stat_270000L_20190527_000000V.stat
> > > > > > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
> > > > > > OBS_LEAD
> > > > > > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS
FCST_LEV
> > > > > > OBS_VAR
> > > > > > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
> > > > > > FCST_THRESH
> > > > > > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
> > > > > > 000000
> > > > > > 20190526_223000 20190527_013000 TMP K P900-
750
> > > > > > TMP
> > > > > NA
> > > > > > P900-750 ADPUPA FULL BILIN 4 NA
NA
> > > > > > NA NA SL1L2 96 282.50359 282.95
80007.0758
> > > > > > 79885.23007 80131.85659 1.37716
> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
> > > > > > 000000
> > > > > > 20190526_223000 20190527_013000 TMP K P900-
750
> > > > > > TMP
> > > > > NA
> > > > > > P900-750 ADPSFC FULL BILIN 4 NA
NA
> > > > > > NA NA SL1L2 175 285.56938 285.37171
> > > > > > 81514.22934
> > > > > > 81577.11951 81460.56417 2.37752
> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
> > > > > > 000000
> > > > > > 20190526_223000 20190527_013000 UGRD m/s Z10
> > > > > > UGRD
> > > > > NA
> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
> > > > > > NA NA SL1L2 1690 0.10631 -0.018225
> > > > > > 2.12765
> > > > > > 5.01565 4.63367 1.8043
> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
> > > > > > 000000
> > > > > > 20190526_223000 20190527_013000 VGRD m/s Z10
> > > > > > VGRD
> > > > > NA
> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
> > > > > > NA NA SL1L2 1690 0.57217 0.49876
> > > > > > 8.77582
> > > > > > 14.98303 10.41817 2.1663
> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
> > > > > > 000000
> > > > > > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
> > > > > > UGRD_VGRD
> > > > > NA
> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
> > > > > > NA NA VL1L2 1690 0.10631 0.57217
> > > > > > -0.018225
> > > > > > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
> > > > > >
> > > > > > *When I run docker exec -it metviewer
> > > > > > /scripts/common/metv_load_all.ksh
> > > > > > mv_test:*
> > > > > >
> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
> > > > > > /scripts/common/metv_load_all.ksh mv_test
> > > > > > mysql: [Warning] Using a password on the command line
interface
> > > > > > can
> > > > > > be
> > > > > > insecure.
> > > > > > mysql: [Warning] Using a password on the command line
interface
> > > > > > can
> > > > > > be
> > > > > > insecure.
> > > > > > mysql: [Warning] Using a password on the command line
interface
> > > > > > can
> > > > > > be
> > > > > > insecure.
> > > > > > ---- MVLoad ----
> > > > > >
> > > > > > Begin time: 2020-06-11 00:23:23
> > > > > > Parsing: /data/load_mv_test.xml
> > > > > >
> > > > > > Permutation 1 of 1 - /data/point_stat
> > > > > > ==== grid_stat ====
> > > > > >
> > > > > > stat_header table time total: 0:00:00.000
> > > > > > stat header records: 0
> > > > > > stat header inserts: 0
> > > > > > line data records: 0
> > > > > > line data inserts: 0
> > > > > > stat group records: 0
> > > > > > stat group inserts: 0
> > > > > > var length records: 0
> > > > > > var length inserts: 0
> > > > > > total lines: 0
> > > > > > insert size: 1
> > > > > > lines / msec: 0.000
> > > > > > num files: 0
> > > > > >
> > > > > > ==== mode ====
> > > > > >
> > > > > > mtd_header search time total: 0:00:00.000
> > > > > > stat_header search time total: 0:00:00.000
> > > > > > mode_header inserts: 0
> > > > > > mode_cts inserts: 0
> > > > > > mode_obj_single inserts: 0
> > > > > > mode_obj_pair inserts: 0
> > > > > > ==== mtd ====
> > > > > >
> > > > > > mtd_header inserts: 0
> > > > > > mtd_3d_obj_single inserts: 0
> > > > > > mtd_3d_obj_pair inserts: 0
> > > > > > mtd_2d_obj inserts: 0
> > > > > > total lines: 0
> > > > > > num files: 0
> > > > > > num files: 0
> > > > > >
> > > > > > ==== indexes ====creating
> > > > > > Indexes creating 0:00:00.454
> > > > > >
> > > > > > End time: 2020-06-11 00:23:23
> > > > > > Load total: 0:00:00.003
> > > > > >
> > > > > > ---- MVLoad Done ----
> > > > > >
> > > > > > *No error ? but nothing is found under the dataset of
> > > > > > METviewer
> > > > > > GUI. I
> > > > > am
> > > > > > also wondering why it is processing the grid_stat, mod and
mtd
> > > > > > which I
> > > > > > don't have, not processing the point_stat I hope ?*
> > > > > >
> > > > > > Thanks,
> > > > > >
> *~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> > > > > > *Dr. Xin Zhang
> > > > > > *
> > > > > > *Software Engineer
> > > > > > 001-303-497-8652*
> > > > > > *Joint Center for Satellite Data Assimilation
> > > > > > xinzhang at ucar.edu <xinzhang at ucar.edu>*
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Xin Zhang
Time: Fri Jun 12 12:34:57 2020
Can you send me some example workable datasets and I will load them
into the metviewer, I would like to see if my dataset has a problem.
Thanks,
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
*Dr. Xin Zhang
*
*Software Engineer
001-303-497-8652*
*Joint Center for Satellite Data Assimilation
xinzhang at ucar.edu <xinzhang at ucar.edu>*
On Fri, Jun 12, 2020 at 6:29 PM Xin Zhang <xinzhang at ucar.edu> wrote:
> I observed this file.
>
> After I docker-compose up, the log file is not changing no matter if
I
> "reload datasets" or not . The reload keeps spinning.
>
>
> Yes, I still have the same issue.
>
> Cheers,
>
> *~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> *Dr. Xin Zhang
> *
> *Software Engineer
> 001-303-497-8652*
> *Joint Center for Satellite Data Assimilation
> xinzhang at ucar.edu <xinzhang at ucar.edu>*
>
>
>
> On Fri, Jun 12, 2020 at 12:26 PM Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
>> I don't see any errors in the log. Did you 'cat' it after you
refresh the
>> page or before?
>> Do you still expirience the same issue?
>>
>> Tatiana
>>
>> On Fri Jun 12 11:40:56 2020, xinzhang at ucar.edu wrote:
>> > Hi Taniana:
>> >
>> > I restarted the docker composer, amd also click the "Reload the
>> > databases", here is the log
>> >
>> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > container exec -it metviewer cat /opt/tomcat/logs/catalina.out
>> > 12-Jun-2020 17:38:25.989 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Server
version:
>> > Apache Tomcat/8.5.23
>> > 12-Jun-2020 17:38:25.990 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Server
built:
>> > Sep 28 2017 10:30:11 UTC
>> > 12-Jun-2020 17:38:25.990 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Server
number:
>> > 8.5.23.0
>> > 12-Jun-2020 17:38:25.990 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log OS Name:
>> > Linux
>> > 12-Jun-2020 17:38:25.990 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log OS Version:
>> > 5.3.0-59-generic
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log
Architecture:
>> > amd64
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Java Home:
>> > /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-
2.el8_1.x86_64/jre
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log JVM
Version:
>> > 1.8.0_252-b09
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:
>> > Oracle Corporation
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log
CATALINA_BASE:
>> > /opt/tomcat
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log
CATALINA_HOME:
>> > /opt/tomcat
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument:
>> >
-Djava.util.logging.config.file=/opt/tomcat/conf/logging.properties
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument:
>> > -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument: -Djdk.tls.ephemeralDHKeySize=2048
>> > 12-Jun-2020 17:38:25.991 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument:
>> > -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
>> > 12-Jun-2020 17:38:25.992 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument: -Dcatalina.base=/opt/tomcat
>> > 12-Jun-2020 17:38:25.992 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument: -Dcatalina.home=/opt/tomcat
>> > 12-Jun-2020 17:38:25.992 INFO [main]
>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>> > argument: -Djava.io.tmpdir=/opt/tomcat/temp
>> > 12-Jun-2020 17:38:25.992 INFO [main]
>> > org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The
APR
>> > based
>> > Apache Tomcat Native library which allows optimal performance in
>> > production
>> > environments was not found on the java.library.path:
>> > [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
>> > 12-Jun-2020 17:38:26.038 INFO [main]
>> > org.apache.coyote.AbstractProtocol.init Initializing
ProtocolHandler
>> > ["http-nio-8080"]
>> > 12-Jun-2020 17:38:26.048 INFO [main]
>> > org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector
Using a
>> > shared
>> > selector for servlet write/read
>> > 12-Jun-2020 17:38:26.050 INFO [main]
>> > org.apache.coyote.AbstractProtocol.init Initializing
ProtocolHandler
>> > ["ajp-nio-8009"]
>> > 12-Jun-2020 17:38:26.051 INFO [main]
>> > org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector
Using a
>> > shared
>> > selector for servlet write/read
>> > 12-Jun-2020 17:38:26.051 INFO [main]
>> > org.apache.catalina.startup.Catalina.load Initialization
processed in
>> > 328 ms
>> > 12-Jun-2020 17:38:26.066 INFO [main]
>> > org.apache.catalina.core.StandardService.startInternal Starting
>> > service
>> > [Catalina]
>> > 12-Jun-2020 17:38:26.066 INFO [main]
>> > org.apache.catalina.core.StandardEngine.startInternal Starting
Servlet
>> > Engine: Apache Tomcat/8.5.23
>> > 12-Jun-2020 17:38:26.080 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployWAR Deploying web
>> > application
>> > archive [/opt/tomcat/webapps/metviewer.war]
>> > 12-Jun-2020 17:38:26.884 INFO [localhost-startStop-1]
>> > org.apache.jasper.servlet.TldScanner.scanJars At least one JAR
was
>> > scanned
>> > for TLDs yet contained no TLDs. Enable debug logging for this
logger
>> > for a
>> > complete list of JARs that were scanned but no TLDs were found in
>> > them.
>> > Skipping unneeded JARs during scanning can improve startup time
and
>> > JSP
>> > compilation time.
>> > 12-Jun-2020 17:38:26.903 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployWAR Deployment of
web
>> > application archive [/opt/tomcat/webapps/metviewer.war] has
finished
>> > in
>> > [823] ms
>> > 12-Jun-2020 17:38:26.904 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>> > application directory [/opt/tomcat/webapps/host-manager]
>> > 12-Jun-2020 17:38:26.921 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
>> > web
>> > application directory [/opt/tomcat/webapps/host-manager] has
finished
>> > in
>> > [17] ms
>> > 12-Jun-2020 17:38:26.922 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>> > application directory [/opt/tomcat/webapps/manager]
>> > 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
>> > web
>> > application directory [/opt/tomcat/webapps/manager] has finished
in
>> > [15] ms
>> > 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>> > application directory [/opt/tomcat/webapps/ROOT]
>> > 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
>> > web
>> > application directory [/opt/tomcat/webapps/ROOT] has finished in
[13]
>> > ms
>> > 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>> > application directory [/opt/tomcat/webapps/docs]
>> > 12-Jun-2020 17:38:26.962 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
>> > web
>> > application directory [/opt/tomcat/webapps/docs] has finished in
[12]
>> > ms
>> > 12-Jun-2020 17:38:26.963 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>> > application directory [/opt/tomcat/webapps/examples]
>> > 12-Jun-2020 17:38:27.102 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
>> > web
>> > application directory [/opt/tomcat/webapps/examples] has finished
in
>> > [140]
>> > ms
>> > 12-Jun-2020 17:38:27.103 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>> > application directory [/opt/tomcat/webapps/metviewer_output]
>> > 12-Jun-2020 17:38:27.113 INFO [localhost-startStop-1]
>> > org.apache.catalina.startup.HostConfig.deployDirectory Deployment
of
>> > web
>> > application directory [/opt/tomcat/webapps/metviewer_output] has
>> > finished
>> > in [10] ms
>> > 12-Jun-2020 17:38:27.116 INFO [main]
>> > org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
>> > ["http-nio-8080"]
>> > 12-Jun-2020 17:38:27.121 INFO [main]
>> > org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler
>> > ["ajp-nio-8009"]
>> > 12-Jun-2020 17:38:27.124 INFO [main]
>> > org.apache.catalina.startup.Catalina.start Server startup in 1072
ms
>> >
>> > *Thanks,*
>> >
>> >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
>> > *Dr. Xin Zhang
>> > *
>> > *Software Engineer
>> > 001-303-497-8652*
>> > *Joint Center for Satellite Data Assimilation
>> > xinzhang at ucar.edu <xinzhang at ucar.edu>*
>> >
>> >
>> >
>> > On Fri, Jun 12, 2020 at 11:25 AM Tatiana Burek via RT
>> > <met_help at ucar.edu>
>> > wrote:
>> >
>> > > Clicking the "reload dataset" is the correct think to do after
the
>> > > load...
>> > > You can try to restart the container and see if it helps. If
not,
>> > > please
>> > > attache Tomcat log file to this ticket. You can find it in the
>> > > container in
>> > > /opt/tomcat/logs/catalina.out.
>> > > It looks like the web app has difficulties to connect to the
>> > > database.
>> > >
>> > > Tatiana
>> > >
>> > > On Fri Jun 12 11:08:55 2020, xinzhang at ucar.edu wrote:
>> > > > Hi Tatiana:
>> > > >
>> > > > * Yes, my mistake ! it works now. now the outputs is:*
>> > > >
>> > > > *Now, here is what I got:*
>> > > >
>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > > > exec -it
>> > > > metviewer /scripts/common/metv_load_all.ksh mv_test
>> > > > mysql: [Warning] Using a password on the command line
interface can
>> > > > be
>> > > > insecure.
>> > > > mysql: [Warning] Using a password on the command line
interface can
>> > > > be
>> > > > insecure.
>> > > > mysql: [Warning] Using a password on the command line
interface can
>> > > > be
>> > > > insecure.
>> > > > ---- MVLoad ----
>> > > >
>> > > > Begin time: 2020-06-12 17:00:51
>> > > > Parsing: /data/load_mv_test.xml
>> > > >
>> > > > Permutation 1 of 4 - /data/grid_stat
>> > > > Permutation 2 of 4 - /data/point_stat
>> > > > /data/point_stat/point_stat_150000L_20200504_000000V.stat
>> > > > ** WARNING: file
>> > > > /data/point_stat/point_stat_360000L_20070331_120000V.stat is
empty
>> > > > and
>> > > > will
>> > > > be ignored
>> > > > /data/point_stat/point_stat_270000L_20190527_000000V.stat
>> > > > Permutation 2 of 4 complete - insert time: 0:00:00.040 stat
lines:
>> > > > 6
>> > > > mode
>> > > > lines: 0
>> > > > mtd lines: 0
>> > > >
>> > > > Permutation 3 of 4 - /data/ensemble_stat
>> > > > Permutation 4 of 4 - /data/mode
>> > > >
>> > > >
>> > >
>>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
>> > > >
>> > > >
>> > >
>>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
>> > > > Permutation 4 of 4 complete - insert time: 0:00:00.368 stat
lines:
>> > > > 0
>> > > > mode
>> > > > lines: 779
>> > > > mtd lines: 0
>> > > >
>> > > > ==== grid_stat ====
>> > > >
>> > > > stat_header table time total: 0:00:00.000
>> > > > stat header records: 6
>> > > > stat header inserts: 5
>> > > > line data records: 6
>> > > > line data inserts: 9
>> > > > stat group records: 0
>> > > > stat group inserts: 0
>> > > > var length records: 0
>> > > > var length inserts: 0
>> > > > total lines: 6
>> > > > insert size: 1
>> > > > lines / msec: 0.014
>> > > > num files: 2
>> > > >
>> > > > ==== mode ====
>> > > >
>> > > > mtd_header search time total: 0:00:00.000
>> > > > stat_header search time total: 0:00:00.004
>> > > > mode_header inserts: 1
>> > > > mode_cts inserts: 2
>> > > > mode_obj_single inserts: 163
>> > > > mode_obj_pair inserts: 612
>> > > > ==== mtd ====
>> > > >
>> > > > mtd_header inserts: 0
>> > > > mtd_3d_obj_single inserts: 0
>> > > > mtd_3d_obj_pair inserts: 0
>> > > > mtd_2d_obj inserts: 0
>> > > > total lines: 779
>> > > > num files: 2
>> > > > num files: 0
>> > > >
>> > > > ==== indexes ====creating
>> > > > Indexes creating 0:00:00.435
>> > > >
>> > > > End time: 2020-06-12 17:00:52
>> > > > Load total: 0:00:00.414
>> > > >
>> > > > ---- MVLoad Done ----
>> > > >
>> > > > *However, When I launch the METViewer GUI page, it does not
have
>> > > > any
>> > > > dataset to plot.*
>> > > >
>> > > > [image: image.png]
>> > > >
>> > > >
>> > > > I* clicked the "reload dataset", it keep spins; I clicked the
"Load
>> > > > XML",
>> > > > it is not responding, I think I already load something in.*
>> > > >
>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > > > container exec -it metviewer ls -la
>> > > > /opt/tomcat/webapps/metviewer_output/scripts
>> > > > total 8
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > > > container exec -it metviewer ls -la
>> > > > /opt/tomcat/webapps/metviewer_output/data
>> > > > total 8
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > > > container exec -it metviewer ls -la
>> > > > /opt/tomcat/webapps/metviewer_output/xml
>> > > > total 16
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>> > > > -rw-r----- 1 root root 4601 Jun 10 23:28
plot_20200610_232809.xml
>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > > > container exec -it metviewer ls -la
>> > > > /opt/tomcat/webapps/metviewer_output/
>> > > > total 24
>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
>> > > > drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>> > > > container exec -it metviewer ls -la
>> > > > /opt/tomcat/webapps/metviewer_output/plots
>> > > > total 8
>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>> > > >
>> > > >
>> > > > *Any hint is appreciated*
>> > > >
>> > > > *Have a nice weekend,*
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
>> > > > <met_help at ucar.edu>
>> > > > wrote:
>> > > >
>> > > > > Hello Xin,
>> > > > > in your XML you specified the data directory as
>> > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
>> > > > > <load_val><field
>> > > > > name="met_tool"><val>point_stat</val></field></load_val>
>> > > > > During the execution METviewer replaces 'met_tool' with
>> > > > > 'point_stat'
>> > > > > and
>> > > > > looks for data files in /data/point_stat/ directory.
>> > > > > Your file is in /data/ directory and is invisible for
METviewer.
>> > > > > To
>> > > > > fix it
>> > > > > you need to create 'point_stat' directory and move the data
file
>> > > > > to
>> > > > > this
>> > > > > new directory. Try to run the loading script after that.
>> > > > >
>> > > > > Tatiana
>> > > > > On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
>> > > > > > Hello,
>> > > > > >
>> > > > > > I successfully built the docker image of METviewer 3.0. I
have
>> > > > > > a
>> > > > > > just
>> > > > > > one point_stat file under /data/point_stat/:
>> > > > > >
>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls
-la
>> > > > > > /data
>> > > > > > total 16
>> > > > > > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
>> > > > > > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
>> > > > > > -rw-r--r-- 1 root root 693 Jun 11 00:17 load_mv_test.xml
>> > > > > > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
>> > > > > > point_stat_270000L_20190527_000000V.stat
>> > > > > >
>> > > > > > *Here is the content of /data/load_mv_test.xml:*
>> > > > > >
>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
>> > > > > > /data/load_mv_test.xml
>> > > > > > <load_spec>
>> > > > > > <connection>
>> > > > > > <management_system>mysql</management_system>
>> > > > > > <host>mysql_mv:3306</host>
>> > > > > > <database>mv_test</database>
>> > > > > > <user>root</user>
>> > > > > > <password>mvuser</password>
>> > > > > > </connection>
>> > > > > >
>> > > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
>> > > > > >
>> > > > > > <met_version>V6.0</met_version>
>> > > > > >
>> > > > > > <verbose>true</verbose>
>> > > > > > <insert_size>1</insert_size>
>> > > > > > <mode_header_db_check>false</mode_header_db_check>
>> > > > > > <drop_indexes>false</drop_indexes>
>> > > > > > <apply_indexes>true</apply_indexes>
>> > > > > >
>> > > > > > <load_stat>true</load_stat>
>> > > > > > <load_mode>false</load_mode>
>> > > > > > <load_mpr>false</load_mpr>
>> > > > > > <load_orank>false</load_orank>
>> > > > > >
>> > > > > > <load_val>
>> > > > > > <field name="met_tool">
>> > > > > > <val>point_stat</val>
>> > > > > > </field>
>> > > > > > </load_val>
>> > > > > >
>> > > > > > </load_spec>
>> > > > > >
>> > > > > > *Here is the content of
>> > > > > > /data/point_stat_270000L_20190527_000000V.stat:*
>> > > > > >
>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer cat
>> > > > > > /data/point_stat_270000L_20190527_000000V.stat
>> > > > > > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
>> > > > > > OBS_LEAD
>> > > > > > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS
FCST_LEV
>> > > > > > OBS_VAR
>> > > > > > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS
>> > > > > > FCST_THRESH
>> > > > > > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>> > > > > > 000000
>> > > > > > 20190526_223000 20190527_013000 TMP K
P900-750
>> > > > > > TMP
>> > > > > NA
>> > > > > > P900-750 ADPUPA FULL BILIN 4 NA
NA
>> > > > > > NA NA SL1L2 96 282.50359 282.95
80007.0758
>> > > > > > 79885.23007 80131.85659 1.37716
>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>> > > > > > 000000
>> > > > > > 20190526_223000 20190527_013000 TMP K
P900-750
>> > > > > > TMP
>> > > > > NA
>> > > > > > P900-750 ADPSFC FULL BILIN 4 NA
NA
>> > > > > > NA NA SL1L2 175 285.56938 285.37171
>> > > > > > 81514.22934
>> > > > > > 81577.11951 81460.56417 2.37752
>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>> > > > > > 000000
>> > > > > > 20190526_223000 20190527_013000 UGRD m/s Z10
>> > > > > > UGRD
>> > > > > NA
>> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
>> > > > > > NA NA SL1L2 1690 0.10631 -0.018225
>> > > > > > 2.12765
>> > > > > > 5.01565 4.63367 1.8043
>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>> > > > > > 000000
>> > > > > > 20190526_223000 20190527_013000 VGRD m/s Z10
>> > > > > > VGRD
>> > > > > NA
>> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
>> > > > > > NA NA SL1L2 1690 0.57217 0.49876
>> > > > > > 8.77582
>> > > > > > 14.98303 10.41817 2.1663
>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>> > > > > > 000000
>> > > > > > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
>> > > > > > UGRD_VGRD
>> > > > > NA
>> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
>> > > > > > NA NA VL1L2 1690 0.10631 0.57217
>> > > > > > -0.018225
>> > > > > > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
>> > > > > >
>> > > > > > *When I run docker exec -it metviewer
>> > > > > > /scripts/common/metv_load_all.ksh
>> > > > > > mv_test:*
>> > > > > >
>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
>> > > > > > /scripts/common/metv_load_all.ksh mv_test
>> > > > > > mysql: [Warning] Using a password on the command line
interface
>> > > > > > can
>> > > > > > be
>> > > > > > insecure.
>> > > > > > mysql: [Warning] Using a password on the command line
interface
>> > > > > > can
>> > > > > > be
>> > > > > > insecure.
>> > > > > > mysql: [Warning] Using a password on the command line
interface
>> > > > > > can
>> > > > > > be
>> > > > > > insecure.
>> > > > > > ---- MVLoad ----
>> > > > > >
>> > > > > > Begin time: 2020-06-11 00:23:23
>> > > > > > Parsing: /data/load_mv_test.xml
>> > > > > >
>> > > > > > Permutation 1 of 1 - /data/point_stat
>> > > > > > ==== grid_stat ====
>> > > > > >
>> > > > > > stat_header table time total: 0:00:00.000
>> > > > > > stat header records: 0
>> > > > > > stat header inserts: 0
>> > > > > > line data records: 0
>> > > > > > line data inserts: 0
>> > > > > > stat group records: 0
>> > > > > > stat group inserts: 0
>> > > > > > var length records: 0
>> > > > > > var length inserts: 0
>> > > > > > total lines: 0
>> > > > > > insert size: 1
>> > > > > > lines / msec: 0.000
>> > > > > > num files: 0
>> > > > > >
>> > > > > > ==== mode ====
>> > > > > >
>> > > > > > mtd_header search time total: 0:00:00.000
>> > > > > > stat_header search time total: 0:00:00.000
>> > > > > > mode_header inserts: 0
>> > > > > > mode_cts inserts: 0
>> > > > > > mode_obj_single inserts: 0
>> > > > > > mode_obj_pair inserts: 0
>> > > > > > ==== mtd ====
>> > > > > >
>> > > > > > mtd_header inserts: 0
>> > > > > > mtd_3d_obj_single inserts: 0
>> > > > > > mtd_3d_obj_pair inserts: 0
>> > > > > > mtd_2d_obj inserts: 0
>> > > > > > total lines: 0
>> > > > > > num files: 0
>> > > > > > num files: 0
>> > > > > >
>> > > > > > ==== indexes ====creating
>> > > > > > Indexes creating 0:00:00.454
>> > > > > >
>> > > > > > End time: 2020-06-11 00:23:23
>> > > > > > Load total: 0:00:00.003
>> > > > > >
>> > > > > > ---- MVLoad Done ----
>> > > > > >
>> > > > > > *No error ? but nothing is found under the dataset of
>> > > > > > METviewer
>> > > > > > GUI. I
>> > > > > am
>> > > > > > also wondering why it is processing the grid_stat, mod
and mtd
>> > > > > > which I
>> > > > > > don't have, not processing the point_stat I hope ?*
>> > > > > >
>> > > > > > Thanks,
>> > > > > >
>>
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
>> > > > > > *Dr. Xin Zhang
>> > > > > > *
>> > > > > > *Software Engineer
>> > > > > > 001-303-497-8652*
>> > > > > > *Joint Center for Satellite Data Assimilation
>> > > > > > xinzhang at ucar.edu <xinzhang at ucar.edu>*
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > >
>> > >
>> > >
>> > >
>>
>>
>>
>>
------------------------------------------------
Subject: Fail to load stat file into METviewer
From: Xin Zhang
Time: Fri Jun 12 12:52:26 2020
Hi Tatiana:
I use Firefox to launch the Metviewer, instead of Google Chrome,
it
works now !
Thank you very much, and have a nice weekend,
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
*Dr. Xin Zhang
*
*Software Engineer
001-303-497-8652*
*Joint Center for Satellite Data Assimilation
xinzhang at ucar.edu <xinzhang at ucar.edu>*
On Fri, Jun 12, 2020 at 12:34 PM Xin Zhang <xinzhang at ucar.edu> wrote:
> Can you send me some example workable datasets and I will load them
> into the metviewer, I would like to see if my dataset has a problem.
>
> Thanks,
> *~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
> *Dr. Xin Zhang
> *
> *Software Engineer
> 001-303-497-8652*
> *Joint Center for Satellite Data Assimilation
> xinzhang at ucar.edu <xinzhang at ucar.edu>*
>
>
>
> On Fri, Jun 12, 2020 at 6:29 PM Xin Zhang <xinzhang at ucar.edu> wrote:
>
>> I observed this file.
>>
>> After I docker-compose up, the log file is not changing no matter
if I
>> "reload datasets" or not . The reload keeps spinning.
>>
>>
>> Yes, I still have the same issue.
>>
>> Cheers,
>>
>>
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
>> *Dr. Xin Zhang
>> *
>> *Software Engineer
>> 001-303-497-8652*
>> *Joint Center for Satellite Data Assimilation
>> xinzhang at ucar.edu <xinzhang at ucar.edu>*
>>
>>
>>
>> On Fri, Jun 12, 2020 at 12:26 PM Tatiana Burek via RT
<met_help at ucar.edu>
>> wrote:
>>
>>> I don't see any errors in the log. Did you 'cat' it after you
refresh
>>> the page or before?
>>> Do you still expirience the same issue?
>>>
>>> Tatiana
>>>
>>> On Fri Jun 12 11:40:56 2020, xinzhang at ucar.edu wrote:
>>> > Hi Taniana:
>>> >
>>> > I restarted the docker composer, amd also click the "Reload the
>>> > databases", here is the log
>>> >
>>> > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > container exec -it metviewer cat /opt/tomcat/logs/catalina.out
>>> > 12-Jun-2020 17:38:25.989 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Server
version:
>>> > Apache Tomcat/8.5.23
>>> > 12-Jun-2020 17:38:25.990 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Server
built:
>>> > Sep 28 2017 10:30:11 UTC
>>> > 12-Jun-2020 17:38:25.990 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Server
number:
>>> > 8.5.23.0
>>> > 12-Jun-2020 17:38:25.990 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log OS Name:
>>> > Linux
>>> > 12-Jun-2020 17:38:25.990 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log OS
Version:
>>> > 5.3.0-59-generic
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log
Architecture:
>>> > amd64
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Java Home:
>>> > /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.252.b09-
2.el8_1.x86_64/jre
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log JVM
Version:
>>> > 1.8.0_252-b09
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log JVM
Vendor:
>>> > Oracle Corporation
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log
CATALINA_BASE:
>>> > /opt/tomcat
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log
CATALINA_HOME:
>>> > /opt/tomcat
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument:
>>> >
-Djava.util.logging.config.file=/opt/tomcat/conf/logging.properties
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument:
>>> >
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument: -Djdk.tls.ephemeralDHKeySize=2048
>>> > 12-Jun-2020 17:38:25.991 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument:
>>> > -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
>>> > 12-Jun-2020 17:38:25.992 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument: -Dcatalina.base=/opt/tomcat
>>> > 12-Jun-2020 17:38:25.992 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument: -Dcatalina.home=/opt/tomcat
>>> > 12-Jun-2020 17:38:25.992 INFO [main]
>>> > org.apache.catalina.startup.VersionLoggerListener.log Command
line
>>> > argument: -Djava.io.tmpdir=/opt/tomcat/temp
>>> > 12-Jun-2020 17:38:25.992 INFO [main]
>>> > org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The
APR
>>> > based
>>> > Apache Tomcat Native library which allows optimal performance in
>>> > production
>>> > environments was not found on the java.library.path:
>>> > [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
>>> > 12-Jun-2020 17:38:26.038 INFO [main]
>>> > org.apache.coyote.AbstractProtocol.init Initializing
ProtocolHandler
>>> > ["http-nio-8080"]
>>> > 12-Jun-2020 17:38:26.048 INFO [main]
>>> > org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector
Using a
>>> > shared
>>> > selector for servlet write/read
>>> > 12-Jun-2020 17:38:26.050 INFO [main]
>>> > org.apache.coyote.AbstractProtocol.init Initializing
ProtocolHandler
>>> > ["ajp-nio-8009"]
>>> > 12-Jun-2020 17:38:26.051 INFO [main]
>>> > org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector
Using a
>>> > shared
>>> > selector for servlet write/read
>>> > 12-Jun-2020 17:38:26.051 INFO [main]
>>> > org.apache.catalina.startup.Catalina.load Initialization
processed in
>>> > 328 ms
>>> > 12-Jun-2020 17:38:26.066 INFO [main]
>>> > org.apache.catalina.core.StandardService.startInternal Starting
>>> > service
>>> > [Catalina]
>>> > 12-Jun-2020 17:38:26.066 INFO [main]
>>> > org.apache.catalina.core.StandardEngine.startInternal Starting
Servlet
>>> > Engine: Apache Tomcat/8.5.23
>>> > 12-Jun-2020 17:38:26.080 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployWAR Deploying web
>>> > application
>>> > archive [/opt/tomcat/webapps/metviewer.war]
>>> > 12-Jun-2020 17:38:26.884 INFO [localhost-startStop-1]
>>> > org.apache.jasper.servlet.TldScanner.scanJars At least one JAR
was
>>> > scanned
>>> > for TLDs yet contained no TLDs. Enable debug logging for this
logger
>>> > for a
>>> > complete list of JARs that were scanned but no TLDs were found
in
>>> > them.
>>> > Skipping unneeded JARs during scanning can improve startup time
and
>>> > JSP
>>> > compilation time.
>>> > 12-Jun-2020 17:38:26.903 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployWAR Deployment of
web
>>> > application archive [/opt/tomcat/webapps/metviewer.war] has
finished
>>> > in
>>> > [823] ms
>>> > 12-Jun-2020 17:38:26.904 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>>> > application directory [/opt/tomcat/webapps/host-manager]
>>> > 12-Jun-2020 17:38:26.921 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory
Deployment of
>>> > web
>>> > application directory [/opt/tomcat/webapps/host-manager] has
finished
>>> > in
>>> > [17] ms
>>> > 12-Jun-2020 17:38:26.922 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>>> > application directory [/opt/tomcat/webapps/manager]
>>> > 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory
Deployment of
>>> > web
>>> > application directory [/opt/tomcat/webapps/manager] has finished
in
>>> > [15] ms
>>> > 12-Jun-2020 17:38:26.937 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>>> > application directory [/opt/tomcat/webapps/ROOT]
>>> > 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory
Deployment of
>>> > web
>>> > application directory [/opt/tomcat/webapps/ROOT] has finished in
[13]
>>> > ms
>>> > 12-Jun-2020 17:38:26.950 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>>> > application directory [/opt/tomcat/webapps/docs]
>>> > 12-Jun-2020 17:38:26.962 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory
Deployment of
>>> > web
>>> > application directory [/opt/tomcat/webapps/docs] has finished in
[12]
>>> > ms
>>> > 12-Jun-2020 17:38:26.963 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>>> > application directory [/opt/tomcat/webapps/examples]
>>> > 12-Jun-2020 17:38:27.102 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory
Deployment of
>>> > web
>>> > application directory [/opt/tomcat/webapps/examples] has
finished in
>>> > [140]
>>> > ms
>>> > 12-Jun-2020 17:38:27.103 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory Deploying
web
>>> > application directory [/opt/tomcat/webapps/metviewer_output]
>>> > 12-Jun-2020 17:38:27.113 INFO [localhost-startStop-1]
>>> > org.apache.catalina.startup.HostConfig.deployDirectory
Deployment of
>>> > web
>>> > application directory [/opt/tomcat/webapps/metviewer_output] has
>>> > finished
>>> > in [10] ms
>>> > 12-Jun-2020 17:38:27.116 INFO [main]
>>> > org.apache.coyote.AbstractProtocol.start Starting
ProtocolHandler
>>> > ["http-nio-8080"]
>>> > 12-Jun-2020 17:38:27.121 INFO [main]
>>> > org.apache.coyote.AbstractProtocol.start Starting
ProtocolHandler
>>> > ["ajp-nio-8009"]
>>> > 12-Jun-2020 17:38:27.124 INFO [main]
>>> > org.apache.catalina.startup.Catalina.start Server startup in
1072 ms
>>> >
>>> > *Thanks,*
>>> >
>>> >
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
>>> > *Dr. Xin Zhang
>>> > *
>>> > *Software Engineer
>>> > 001-303-497-8652*
>>> > *Joint Center for Satellite Data Assimilation
>>> > xinzhang at ucar.edu <xinzhang at ucar.edu>*
>>> >
>>> >
>>> >
>>> > On Fri, Jun 12, 2020 at 11:25 AM Tatiana Burek via RT
>>> > <met_help at ucar.edu>
>>> > wrote:
>>> >
>>> > > Clicking the "reload dataset" is the correct think to do after
the
>>> > > load...
>>> > > You can try to restart the container and see if it helps. If
not,
>>> > > please
>>> > > attache Tomcat log file to this ticket. You can find it in the
>>> > > container in
>>> > > /opt/tomcat/logs/catalina.out.
>>> > > It looks like the web app has difficulties to connect to the
>>> > > database.
>>> > >
>>> > > Tatiana
>>> > >
>>> > > On Fri Jun 12 11:08:55 2020, xinzhang at ucar.edu wrote:
>>> > > > Hi Tatiana:
>>> > > >
>>> > > > * Yes, my mistake ! it works now. now the outputs is:*
>>> > > >
>>> > > > *Now, here is what I got:*
>>> > > >
>>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > > > exec -it
>>> > > > metviewer /scripts/common/metv_load_all.ksh mv_test
>>> > > > mysql: [Warning] Using a password on the command line
interface can
>>> > > > be
>>> > > > insecure.
>>> > > > mysql: [Warning] Using a password on the command line
interface can
>>> > > > be
>>> > > > insecure.
>>> > > > mysql: [Warning] Using a password on the command line
interface can
>>> > > > be
>>> > > > insecure.
>>> > > > ---- MVLoad ----
>>> > > >
>>> > > > Begin time: 2020-06-12 17:00:51
>>> > > > Parsing: /data/load_mv_test.xml
>>> > > >
>>> > > > Permutation 1 of 4 - /data/grid_stat
>>> > > > Permutation 2 of 4 - /data/point_stat
>>> > > > /data/point_stat/point_stat_150000L_20200504_000000V.stat
>>> > > > ** WARNING: file
>>> > > > /data/point_stat/point_stat_360000L_20070331_120000V.stat is
empty
>>> > > > and
>>> > > > will
>>> > > > be ignored
>>> > > > /data/point_stat/point_stat_270000L_20190527_000000V.stat
>>> > > > Permutation 2 of 4 complete - insert time: 0:00:00.040 stat
lines:
>>> > > > 6
>>> > > > mode
>>> > > > lines: 0
>>> > > > mtd lines: 0
>>> > > >
>>> > > > Permutation 3 of 4 - /data/ensemble_stat
>>> > > > Permutation 4 of 4 - /data/mode
>>> > > >
>>> > > >
>>> > >
>>>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_cts.txt
>>> > > >
>>> > > >
>>> > >
>>>
/data/mode/mode_WRF_APCP_vs_WRF_APCP_A0_270000L_20190527_000000V_270000A_obj.txt
>>> > > > Permutation 4 of 4 complete - insert time: 0:00:00.368 stat
lines:
>>> > > > 0
>>> > > > mode
>>> > > > lines: 779
>>> > > > mtd lines: 0
>>> > > >
>>> > > > ==== grid_stat ====
>>> > > >
>>> > > > stat_header table time total: 0:00:00.000
>>> > > > stat header records: 6
>>> > > > stat header inserts: 5
>>> > > > line data records: 6
>>> > > > line data inserts: 9
>>> > > > stat group records: 0
>>> > > > stat group inserts: 0
>>> > > > var length records: 0
>>> > > > var length inserts: 0
>>> > > > total lines: 6
>>> > > > insert size: 1
>>> > > > lines / msec: 0.014
>>> > > > num files: 2
>>> > > >
>>> > > > ==== mode ====
>>> > > >
>>> > > > mtd_header search time total: 0:00:00.000
>>> > > > stat_header search time total: 0:00:00.004
>>> > > > mode_header inserts: 1
>>> > > > mode_cts inserts: 2
>>> > > > mode_obj_single inserts: 163
>>> > > > mode_obj_pair inserts: 612
>>> > > > ==== mtd ====
>>> > > >
>>> > > > mtd_header inserts: 0
>>> > > > mtd_3d_obj_single inserts: 0
>>> > > > mtd_3d_obj_pair inserts: 0
>>> > > > mtd_2d_obj inserts: 0
>>> > > > total lines: 779
>>> > > > num files: 2
>>> > > > num files: 0
>>> > > >
>>> > > > ==== indexes ====creating
>>> > > > Indexes creating 0:00:00.435
>>> > > >
>>> > > > End time: 2020-06-12 17:00:52
>>> > > > Load total: 0:00:00.414
>>> > > >
>>> > > > ---- MVLoad Done ----
>>> > > >
>>> > > > *However, When I launch the METViewer GUI page, it does not
have
>>> > > > any
>>> > > > dataset to plot.*
>>> > > >
>>> > > > [image: image.png]
>>> > > >
>>> > > >
>>> > > > I* clicked the "reload dataset", it keep spins; I clicked
the "Load
>>> > > > XML",
>>> > > > it is not responding, I think I already load something in.*
>>> > > >
>>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > > > container exec -it metviewer ls -la
>>> > > > /opt/tomcat/webapps/metviewer_output/scripts
>>> > > > total 8
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
>>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > > > container exec -it metviewer ls -la
>>> > > > /opt/tomcat/webapps/metviewer_output/data
>>> > > > total 8
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
>>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > > > container exec -it metviewer ls -la
>>> > > > /opt/tomcat/webapps/metviewer_output/xml
>>> > > > total 16
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 .
>>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>>> > > > -rw-r----- 1 root root 4601 Jun 10 23:28
plot_20200610_232809.xml
>>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > > > container exec -it metviewer ls -la
>>> > > > /opt/tomcat/webapps/metviewer_output/
>>> > > > total 24
>>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 .
>>> > > > drwxr-x--- 1 root root 4096 Jun 12 16:39 ..
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 data
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 plots
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 scripts
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 23:28 xml
>>> > > > xinzhang at xinLinux:~/container-dtc-nwp/components/metviewer$
docker
>>> > > > container exec -it metviewer ls -la
>>> > > > /opt/tomcat/webapps/metviewer_output/plots
>>> > > > total 8
>>> > > > drwxr-xr-x 2 root root 4096 Jun 10 21:40 .
>>> > > > drwxr-xr-x 6 root root 4096 Jun 12 16:39 ..
>>> > > >
>>> > > >
>>> > > > *Any hint is appreciated*
>>> > > >
>>> > > > *Have a nice weekend,*
>>> > > >
>>> > > >
>>> > > >
>>> > > >
>>> > > >
>>> > > >
>>> > > >
>>> > > > On Fri, Jun 12, 2020 at 10:11 AM Tatiana Burek via RT
>>> > > > <met_help at ucar.edu>
>>> > > > wrote:
>>> > > >
>>> > > > > Hello Xin,
>>> > > > > in your XML you specified the data directory as
>>> > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
>>> > > > > <load_val><field
>>> > > > > name="met_tool"><val>point_stat</val></field></load_val>
>>> > > > > During the execution METviewer replaces 'met_tool' with
>>> > > > > 'point_stat'
>>> > > > > and
>>> > > > > looks for data files in /data/point_stat/ directory.
>>> > > > > Your file is in /data/ directory and is invisible for
METviewer.
>>> > > > > To
>>> > > > > fix it
>>> > > > > you need to create 'point_stat' directory and move the
data file
>>> > > > > to
>>> > > > > this
>>> > > > > new directory. Try to run the loading script after that.
>>> > > > >
>>> > > > > Tatiana
>>> > > > > On Wed Jun 10 18:33:53 2020, xinzhang at ucar.edu wrote:
>>> > > > > > Hello,
>>> > > > > >
>>> > > > > > I successfully built the docker image of METviewer 3.0.
I have
>>> > > > > > a
>>> > > > > > just
>>> > > > > > one point_stat file under /data/point_stat/:
>>> > > > > >
>>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer ls
-la
>>> > > > > > /data
>>> > > > > > total 16
>>> > > > > > drwxr-xr-x 2 1000 1000 4096 Jun 11 00:15 .
>>> > > > > > drwxr-xr-x 1 root root 4096 Jun 11 00:08 ..
>>> > > > > > -rw-r--r-- 1 root root 693 Jun 11 00:17
load_mv_test.xml
>>> > > > > > -rw-r--r-- 1 1000 1000 1883 May 15 20:57
>>> > > > > > point_stat_270000L_20190527_000000V.stat
>>> > > > > >
>>> > > > > > *Here is the content of /data/load_mv_test.xml:*
>>> > > > > >
>>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
cat
>>> > > > > > /data/load_mv_test.xml
>>> > > > > > <load_spec>
>>> > > > > > <connection>
>>> > > > > > <management_system>mysql</management_system>
>>> > > > > > <host>mysql_mv:3306</host>
>>> > > > > > <database>mv_test</database>
>>> > > > > > <user>root</user>
>>> > > > > > <password>mvuser</password>
>>> > > > > > </connection>
>>> > > > > >
>>> > > > > > <folder_tmpl>/data/{met_tool}</folder_tmpl>
>>> > > > > >
>>> > > > > > <met_version>V6.0</met_version>
>>> > > > > >
>>> > > > > > <verbose>true</verbose>
>>> > > > > > <insert_size>1</insert_size>
>>> > > > > > <mode_header_db_check>false</mode_header_db_check>
>>> > > > > > <drop_indexes>false</drop_indexes>
>>> > > > > > <apply_indexes>true</apply_indexes>
>>> > > > > >
>>> > > > > > <load_stat>true</load_stat>
>>> > > > > > <load_mode>false</load_mode>
>>> > > > > > <load_mpr>false</load_mpr>
>>> > > > > > <load_orank>false</load_orank>
>>> > > > > >
>>> > > > > > <load_val>
>>> > > > > > <field name="met_tool">
>>> > > > > > <val>point_stat</val>
>>> > > > > > </field>
>>> > > > > > </load_val>
>>> > > > > >
>>> > > > > > </load_spec>
>>> > > > > >
>>> > > > > > *Here is the content of
>>> > > > > > /data/point_stat_270000L_20190527_000000V.stat:*
>>> > > > > >
>>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
cat
>>> > > > > > /data/point_stat_270000L_20190527_000000V.stat
>>> > > > > > VERSION MODEL DESC FCST_LEAD FCST_VALID_BEG
FCST_VALID_END
>>> > > > > > OBS_LEAD
>>> > > > > > OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_UNITS
FCST_LEV
>>> > > > > > OBS_VAR
>>> > > > > > OBS_UNITS OBS_LEV OBTYPE VX_MASK INTERP_MTHD
INTERP_PNTS
>>> > > > > > FCST_THRESH
>>> > > > > > OBS_THRESH COV_THRESH ALPHA LINE_TYPE
>>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>>> > > > > > 000000
>>> > > > > > 20190526_223000 20190527_013000 TMP K
P900-750
>>> > > > > > TMP
>>> > > > > NA
>>> > > > > > P900-750 ADPUPA FULL BILIN 4 NA
NA
>>> > > > > > NA NA SL1L2 96 282.50359 282.95
80007.0758
>>> > > > > > 79885.23007 80131.85659 1.37716
>>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>>> > > > > > 000000
>>> > > > > > 20190526_223000 20190527_013000 TMP K
P900-750
>>> > > > > > TMP
>>> > > > > NA
>>> > > > > > P900-750 ADPSFC FULL BILIN 4 NA
NA
>>> > > > > > NA NA SL1L2 175 285.56938 285.37171
>>> > > > > > 81514.22934
>>> > > > > > 81577.11951 81460.56417 2.37752
>>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>>> > > > > > 000000
>>> > > > > > 20190526_223000 20190527_013000 UGRD m/s Z10
>>> > > > > > UGRD
>>> > > > > NA
>>> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
>>> > > > > > NA NA SL1L2 1690 0.10631 -0.018225
>>> > > > > > 2.12765
>>> > > > > > 5.01565 4.63367 1.8043
>>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>>> > > > > > 000000
>>> > > > > > 20190526_223000 20190527_013000 VGRD m/s Z10
>>> > > > > > VGRD
>>> > > > > NA
>>> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
>>> > > > > > NA NA SL1L2 1690 0.57217 0.49876
>>> > > > > > 8.77582
>>> > > > > > 14.98303 10.41817 2.1663
>>> > > > > > V9.0.1 WRF NA 270000 20190527_000000
20190527_000000
>>> > > > > > 000000
>>> > > > > > 20190526_223000 20190527_013000 UGRD_VGRD m/s Z10
>>> > > > > > UGRD_VGRD
>>> > > > > NA
>>> > > > > > Z10 ADPSFC FULL BILIN 4 NA
NA
>>> > > > > > NA NA VL1L2 1690 0.10631 0.57217
>>> > > > > > -0.018225
>>> > > > > > 0.49876 10.90348 19.99868 15.05184 3.96441 2.82864
>>> > > > > >
>>> > > > > > *When I run docker exec -it metviewer
>>> > > > > > /scripts/common/metv_load_all.ksh
>>> > > > > > mv_test:*
>>> > > > > >
>>> > > > > > xinzhang at xinLinux:~/METout$ docker exec -it metviewer
>>> > > > > > /scripts/common/metv_load_all.ksh mv_test
>>> > > > > > mysql: [Warning] Using a password on the command line
interface
>>> > > > > > can
>>> > > > > > be
>>> > > > > > insecure.
>>> > > > > > mysql: [Warning] Using a password on the command line
interface
>>> > > > > > can
>>> > > > > > be
>>> > > > > > insecure.
>>> > > > > > mysql: [Warning] Using a password on the command line
interface
>>> > > > > > can
>>> > > > > > be
>>> > > > > > insecure.
>>> > > > > > ---- MVLoad ----
>>> > > > > >
>>> > > > > > Begin time: 2020-06-11 00:23:23
>>> > > > > > Parsing: /data/load_mv_test.xml
>>> > > > > >
>>> > > > > > Permutation 1 of 1 - /data/point_stat
>>> > > > > > ==== grid_stat ====
>>> > > > > >
>>> > > > > > stat_header table time total: 0:00:00.000
>>> > > > > > stat header records: 0
>>> > > > > > stat header inserts: 0
>>> > > > > > line data records: 0
>>> > > > > > line data inserts: 0
>>> > > > > > stat group records: 0
>>> > > > > > stat group inserts: 0
>>> > > > > > var length records: 0
>>> > > > > > var length inserts: 0
>>> > > > > > total lines: 0
>>> > > > > > insert size: 1
>>> > > > > > lines / msec: 0.000
>>> > > > > > num files: 0
>>> > > > > >
>>> > > > > > ==== mode ====
>>> > > > > >
>>> > > > > > mtd_header search time total: 0:00:00.000
>>> > > > > > stat_header search time total: 0:00:00.000
>>> > > > > > mode_header inserts: 0
>>> > > > > > mode_cts inserts: 0
>>> > > > > > mode_obj_single inserts: 0
>>> > > > > > mode_obj_pair inserts: 0
>>> > > > > > ==== mtd ====
>>> > > > > >
>>> > > > > > mtd_header inserts: 0
>>> > > > > > mtd_3d_obj_single inserts: 0
>>> > > > > > mtd_3d_obj_pair inserts: 0
>>> > > > > > mtd_2d_obj inserts: 0
>>> > > > > > total lines: 0
>>> > > > > > num files: 0
>>> > > > > > num files: 0
>>> > > > > >
>>> > > > > > ==== indexes ====creating
>>> > > > > > Indexes creating 0:00:00.454
>>> > > > > >
>>> > > > > > End time: 2020-06-11 00:23:23
>>> > > > > > Load total: 0:00:00.003
>>> > > > > >
>>> > > > > > ---- MVLoad Done ----
>>> > > > > >
>>> > > > > > *No error ? but nothing is found under the dataset of
>>> > > > > > METviewer
>>> > > > > > GUI. I
>>> > > > > am
>>> > > > > > also wondering why it is processing the grid_stat, mod
and mtd
>>> > > > > > which I
>>> > > > > > don't have, not processing the point_stat I hope ?*
>>> > > > > >
>>> > > > > > Thanks,
>>> > > > > >
>>>
*~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~*
>>> > > > > > *Dr. Xin Zhang
>>> > > > > > *
>>> > > > > > *Software Engineer
>>> > > > > > 001-303-497-8652*
>>> > > > > > *Joint Center for Satellite Data Assimilation
>>> > > > > > xinzhang at ucar.edu <xinzhang at ucar.edu>*
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > >
>>> > >
>>> > >
>>> > >
>>>
>>>
>>>
>>>
------------------------------------------------
More information about the Met_help
mailing list