[Met_help] [rt.rap.ucar.edu #89980] History for Loading to AWS METviewer server

Tatiana Burek via RT met_help at ucar.edu
Wed May 1 07:34:25 MDT 2019


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hello.  I tried loading some VSDBs from wcoss (Tide) to the AWS 
METviewer server (attached load_pcp_erly_new.xml), the load output 
(attached load.out) seems to be OK but after 3 hours and reloading 
database/reopening the browser, I'm still not seeing it on the database 
(under group test_ylin, database mv_ylin_erly_test).

The database was created with

     mv_create_db_on_aws.sh ying.lin mv_ylin_erly_test

and loading was done with

     mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/vsdb.erly 
load_pcp_erly_new.xml

I had previously created mv_ylin_metplus (in group test_ylin) and loaded 
with the attached load_metplus.xml, with no problem.

The main difference between the load_metplus.xml and the 
load_pcp_erly_new.xml is that in the latter I'm putting all the VSDBs 
for several models in the directory /ptmpp1/Ying.Lin/vsdb.erly, and in 
the <load_spec> block I had

<folder_tmpl>/ptmpp1/Ying.Lin/vsdb.erly</folder_tmpl>

In the past when loading to the old NCEP METviewer server, I had

  <folder_tmpl>/metviewer/staging/{username}/metplus.out</folder_tmpl>
   <load_val>
     <field name="username">
       <val>wd22yl</val>
     </field>
   </load_val>

to load grid_stat_*.stat from different models in the same directory 
(*/metplus.out/) and which seemed to work, and I was guessing that in 
today's vsdb.erly load_pcp_erly_new.xml, since I'm specifying the path 
explicitly (/ptmpp1/Ying.Lin/vsdb.erly) I wouldn't need the <field 
name="username"> bit.  Do I still need to specify the <load_val> (would 
it then be an empty field)?  I can't tell what, if anything, is wrong 
from the load.out.

Thank you for your help -

Ying


-- 
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov




----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Loading to AWS METviewer server
From: Tatiana Burek
Time: Tue Apr 30 11:30:44 2019

Ying

The XML file for AWS loading should have the same format. So yes, you
do need to specify <load_val>.

One difference between the old way and AWS is the definition of
"base_dir". In load_metplus.xml you replaced the actual directory with
base_dir and used the actual path when you call mv_load_to_aws.sh.
For load_pcp_erly_new.xml try to do the same with base_dir =
/ptmpp1/Ying.Lin/

 <folder_tmpl>/base_dir/{type}</folder_tmpl>
  <load_val>
     <field name="type">
       <val>vsdb.erly</val>
     </field>
   </load_val>

and than call the script like this:
mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/ load_pcp_erly_new.xml

I don't have an account on WCOSS and can't test it.
Let me know if this works.

Tatiana


On Mon Apr 29 21:05:54 2019, ying.lin at noaa.gov wrote:
> Hello.  I tried loading some VSDBs from wcoss (Tide) to the AWS
> METviewer server (attached load_pcp_erly_new.xml), the load output
> (attached load.out) seems to be OK but after 3 hours and reloading
> database/reopening the browser, I'm still not seeing it on the
database
> (under group test_ylin, database mv_ylin_erly_test).
>
> The database was created with
>
>      mv_create_db_on_aws.sh ying.lin mv_ylin_erly_test
>
> and loading was done with
>
>      mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/vsdb.erly
> load_pcp_erly_new.xml
>
> I had previously created mv_ylin_metplus (in group test_ylin) and
loaded
> with the attached load_metplus.xml, with no problem.
>
> The main difference between the load_metplus.xml and the
> load_pcp_erly_new.xml is that in the latter I'm putting all the
VSDBs
> for several models in the directory /ptmpp1/Ying.Lin/vsdb.erly, and
in
> the <load_spec> block I had
>
> <folder_tmpl>/ptmpp1/Ying.Lin/vsdb.erly</folder_tmpl>
>
> In the past when loading to the old NCEP METviewer server, I had
>
>
 <folder_tmpl>/metviewer/staging/{username}/metplus.out</folder_tmpl>
>    <load_val>
>      <field name="username">
>        <val>wd22yl</val>
>      </field>
>    </load_val>
>
> to load grid_stat_*.stat from different models in the same directory
> (*/metplus.out/) and which seemed to work, and I was guessing that
in
> today's vsdb.erly load_pcp_erly_new.xml, since I'm specifying the
path
> explicitly (/ptmpp1/Ying.Lin/vsdb.erly) I wouldn't need the <field
> name="username"> bit.  Do I still need to specify the <load_val>
(would
> it then be an empty field)?  I can't tell what, if anything, is
wrong
> from the load.out.
>
> Thank you for your help -
>
> Ying
>
>



------------------------------------------------
Subject: Loading to AWS METviewer server
From: Ying Lin
Time: Tue Apr 30 14:19:13 2019

Thanks very much Tatiana, that's very helpful.

I tried loading again with the modified load_pcp_erly_new.xml
(attached;
vsdb.erly/ moved to under /ptmpp1/Ying.Lin/awsload/) and got a string
of
err msgs (see attached load.out.mv_ylin_erly_test) that made me wonder
if the data were already loaded yesterday to mv_ylin_erly_test though
invisible on the web interface.  So I created a new database
mv_ylin_erly_test2, tried loading with load_pcp_erly_new.xml again. 
This time there were no err msgs, the output
(load.out.mv_ylin_erly_test2) looked rather like yesterday's
load.out. 
After over an hour, with refreshing/reloading the web page and opening
in a new browser window, the database is still not showing up on the
web
interface.

The loading is done with
     mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/awsload/vsdb.erly
load_pcp_erly_new.xml

I placed the tar'd up vsdb.erly directory in
ftp.emc.ncep.noaa.gov/mmb/precip/awsmv.question/awsload_vsdb.tar.gz
and
wonder if you wouldn't mind try loading it to the AWS server, to see
what's wrong with my set up?  The *.tar.gz contains 54 VSDB files (9
models, for 6 days) so the database is smallish.  If you can see in
the
xml something I should try myself, that'll be really great too. 
Thanks
again -

Ying

On 4/30/19 1:30 PM, Tatiana Burek via RT wrote:
> Ying
>
> The XML file for AWS loading should have the same format. So yes,
you do need to specify <load_val>.
>
> One difference between the old way and AWS is the definition of
"base_dir". In load_metplus.xml you replaced the actual directory with
base_dir and used the actual path when you call mv_load_to_aws.sh.
> For load_pcp_erly_new.xml try to do the same with base_dir =
/ptmpp1/Ying.Lin/
>
>   <folder_tmpl>/base_dir/{type}</folder_tmpl>
>    <load_val>
>       <field name="type">
>         <val>vsdb.erly</val>
>       </field>
>     </load_val>
>
> and than call the script like this:
> mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/ load_pcp_erly_new.xml
>
> I don't have an account on WCOSS and can't test it.
> Let me know if this works.
>
> Tatiana
>
>
> On Mon Apr 29 21:05:54 2019, ying.lin at noaa.gov wrote:
>> Hello.  I tried loading some VSDBs from wcoss (Tide) to the AWS
>> METviewer server (attached load_pcp_erly_new.xml), the load output
>> (attached load.out) seems to be OK but after 3 hours and reloading
>> database/reopening the browser, I'm still not seeing it on the
database
>> (under group test_ylin, database mv_ylin_erly_test).
>>
>> The database was created with
>>
>>       mv_create_db_on_aws.sh ying.lin mv_ylin_erly_test
>>
>> and loading was done with
>>
>>       mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/vsdb.erly
>> load_pcp_erly_new.xml
>>
>> I had previously created mv_ylin_metplus (in group test_ylin) and
loaded
>> with the attached load_metplus.xml, with no problem.
>>
>> The main difference between the load_metplus.xml and the
>> load_pcp_erly_new.xml is that in the latter I'm putting all the
VSDBs
>> for several models in the directory /ptmpp1/Ying.Lin/vsdb.erly, and
in
>> the <load_spec> block I had
>>
>> <folder_tmpl>/ptmpp1/Ying.Lin/vsdb.erly</folder_tmpl>
>>
>> In the past when loading to the old NCEP METviewer server, I had
>>
>>
 <folder_tmpl>/metviewer/staging/{username}/metplus.out</folder_tmpl>
>>     <load_val>
>>       <field name="username">
>>         <val>wd22yl</val>
>>       </field>
>>     </load_val>
>>
>> to load grid_stat_*.stat from different models in the same
directory
>> (*/metplus.out/) and which seemed to work, and I was guessing that
in
>> today's vsdb.erly load_pcp_erly_new.xml, since I'm specifying the
path
>> explicitly (/ptmpp1/Ying.Lin/vsdb.erly) I wouldn't need the <field
>> name="username"> bit.  Do I still need to specify the <load_val>
(would
>> it then be an empty field)?  I can't tell what, if anything, is
wrong
>> from the load.out.
>>
>> Thank you for your help -
>>
>> Ying
>>
>>
>
>

--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov



------------------------------------------------
Subject: Loading to AWS METviewer server
From: Ying Lin
Time: Tue Apr 30 14:19:13 2019

CALLING: cd /ptmpp1/Ying.Lin/awsload/vsdb.erly
CALLING: scp -r ./ ying.lin at 205.156.8.85://data/mv_data/ying.lin
CALLING: scp /meso/save/Ying.Lin/mvload/load_pcp_erly_new.xml
ying.lin at 205.156.8.85:~
----  MVLoad  ----

Begin time: 2019-04-30 18:51:21
Parsing: load_pcp_erly_new.xml

==== grid_stat ====

      stat_header table time total: 0:00:00.000
               stat header records: 0
               stat header inserts: 0
                 line data records: 0
                 line data inserts: 0
                stat group records: 0
                stat group inserts: 0
                var length records: 0
                var length inserts: 0
                       total lines: 0
                       insert size: 1
                      lines / msec: 0.000
                         num files: 0

    ==== mode ====

     mode_header search time total: 0:00:00.000
      mtd_header search time total: 0:00:00.000
     stat_header search time total: 0:00:00.000
               mode_header inserts: 0
                  mode_cts inserts: 0
           mode_obj_single inserts: 0
             mode_obj_pair inserts: 0
    ==== mtd ====

                mtd_header inserts: 0
         mtd_3d_obj_single inserts: 0
           mtd_3d_obj_pair inserts: 0
                mtd_2d_obj inserts: 0
                       total lines: 0
                         num files: 0
                         num files: 0

    ==== indexes ====

CREATE INDEX stat_header_model_idx ON stat_header (model);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_model_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'stat_header_model_idx'
             stat_header_model_idx: 0:00:00.008
CREATE INDEX stat_header_fcst_var_idx ON stat_header (fcst_var);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_fcst_var_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'stat_header_fcst_var_idx'
          stat_header_fcst_var_idx: 0:00:00.007
CREATE INDEX stat_header_fcst_lev_idx ON stat_header (fcst_lev);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_fcst_lev_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'stat_header_fcst_lev_idx'
          stat_header_fcst_lev_idx: 0:00:00.007
CREATE INDEX stat_header_obtype_idx ON stat_header (obtype);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_obtype_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'stat_header_obtype_idx'
            stat_header_obtype_idx: 0:00:00.007
CREATE INDEX stat_header_vx_mask_idx ON stat_header (vx_mask);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_vx_mask_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'stat_header_vx_mask_idx'
           stat_header_vx_mask_idx: 0:00:00.006
CREATE INDEX stat_header_interp_mthd_idx ON stat_header (interp_mthd);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_interp_mthd_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'stat_header_interp_mthd_idx'
       stat_header_interp_mthd_idx: 0:00:00.008
CREATE INDEX stat_header_interp_pnts_idx ON stat_header (interp_pnts);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_interp_pnts_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'stat_header_interp_pnts_idx'
       stat_header_interp_pnts_idx: 0:00:00.007
CREATE INDEX stat_header_fcst_thresh_idx ON stat_header (fcst_thresh);
  **  ERROR: caught class java.lang.Exception applying index
stat_header_fcst_thresh_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'stat_header_fcst_thresh_idx'
       stat_header_fcst_thresh_idx: 0:00:00.007
CREATE INDEX mode_header_model_idx ON mode_header (model);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_model_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_model_idx'
             mode_header_model_idx: 0:00:00.006
CREATE INDEX mode_header_fcst_lead_idx ON mode_header (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_lead_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_lead_idx'
         mode_header_fcst_lead_idx: 0:00:00.011
CREATE INDEX mode_header_fcst_valid_idx ON mode_header (fcst_valid);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_valid_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_valid_idx'
        mode_header_fcst_valid_idx: 0:00:00.007
CREATE INDEX mode_header_fcst_init_idx ON mode_header (fcst_init);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_init_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_init_idx'
         mode_header_fcst_init_idx: 0:00:00.006
CREATE INDEX mode_header_fcst_rad_idx ON mode_header (fcst_rad);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_rad_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_rad_idx'
          mode_header_fcst_rad_idx: 0:00:00.007
CREATE INDEX mode_header_fcst_thr_idx ON mode_header (fcst_thr);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_thr_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_thr_idx'
          mode_header_fcst_thr_idx: 0:00:00.007
CREATE INDEX mode_header_fcst_var_idx ON mode_header (fcst_var);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_var_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_var_idx'
          mode_header_fcst_var_idx: 0:00:00.007
CREATE INDEX mode_header_fcst_lev_idx ON mode_header (fcst_lev);
  **  ERROR: caught class java.lang.Exception applying index
mode_header_fcst_lev_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mode_header_fcst_lev_idx'
          mode_header_fcst_lev_idx: 0:00:00.007
CREATE INDEX mtd_header_model_idx ON mtd_header (model);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_model_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_model_idx'
              mtd_header_model_idx: 0:00:00.007
CREATE INDEX mtd_header_fcst_lead_idx ON mtd_header (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_lead_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_lead_idx'
          mtd_header_fcst_lead_idx: 0:00:00.007
CREATE INDEX mtd_header_fcst_valid_idx ON mtd_header (fcst_valid);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_valid_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_valid_idx'
         mtd_header_fcst_valid_idx: 0:00:00.007
CREATE INDEX mtd_header_fcst_init_idx ON mtd_header (fcst_init);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_init_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_init_idx'
          mtd_header_fcst_init_idx: 0:00:00.007
CREATE INDEX mtd_header_fcst_rad_idx ON mtd_header (fcst_rad);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_rad_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_rad_idx'
           mtd_header_fcst_rad_idx: 0:00:00.007
CREATE INDEX mtd_header_fcst_thr_idx ON mtd_header (fcst_thr);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_thr_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_thr_idx'
           mtd_header_fcst_thr_idx: 0:00:00.006
CREATE INDEX mtd_header_fcst_var_idx ON mtd_header (fcst_var);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_var_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_var_idx'
           mtd_header_fcst_var_idx: 0:00:00.007
CREATE INDEX mtd_header_fcst_lev_idx ON mtd_header (fcst_lev);
  **  ERROR: caught class java.lang.Exception applying index
mtd_header_fcst_lev_idx: caught SQLException calling executeUpdate:
(conn=82365) Duplicate key name 'mtd_header_fcst_lev_idx'
           mtd_header_fcst_lev_idx: 0:00:00.007
CREATE INDEX line_data_fho_fcst_lead_idx ON line_data_fho (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_fho_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_fho_fcst_lead_idx'
       line_data_fho_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_fho_fcst_valid_beg_idx ON line_data_fho
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_fho_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_fho_fcst_valid_beg_idx'
  line_data_fho_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_fho_fcst_init_beg_idx ON line_data_fho
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_fho_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_fho_fcst_init_beg_idx'
   line_data_fho_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_ctc_fcst_lead_idx ON line_data_ctc (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_ctc_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_ctc_fcst_lead_idx'
       line_data_ctc_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_ctc_fcst_valid_beg_idx ON line_data_ctc
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_ctc_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_ctc_fcst_valid_beg_idx'
  line_data_ctc_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_ctc_fcst_init_beg_idx ON line_data_ctc
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_ctc_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_ctc_fcst_init_beg_idx'
   line_data_ctc_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_cts_fcst_lead_idx ON line_data_cts (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_cts_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_cts_fcst_lead_idx'
       line_data_cts_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_cts_fcst_valid_beg_idx ON line_data_cts
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_cts_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_cts_fcst_valid_beg_idx'
  line_data_cts_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_cts_fcst_init_beg_idx ON line_data_cts
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_cts_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_cts_fcst_init_beg_idx'
   line_data_cts_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_cnt_fcst_lead_idx ON line_data_cnt (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_cnt_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_cnt_fcst_lead_idx'
       line_data_cnt_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_cnt_fcst_valid_beg_idx ON line_data_cnt
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_cnt_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_cnt_fcst_valid_beg_idx'
  line_data_cnt_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_cnt_fcst_init_beg_idx ON line_data_cnt
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_cnt_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_cnt_fcst_init_beg_idx'
   line_data_cnt_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_pct_fcst_lead_idx ON line_data_pct (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pct_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pct_fcst_lead_idx'
       line_data_pct_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_pct_fcst_valid_beg_idx ON line_data_pct
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pct_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pct_fcst_valid_beg_idx'
  line_data_pct_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_pct_fcst_init_beg_idx ON line_data_pct
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pct_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pct_fcst_init_beg_idx'
   line_data_pct_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_pstd_fcst_lead_idx ON line_data_pstd
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pstd_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pstd_fcst_lead_idx'
      line_data_pstd_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_pstd_fcst_valid_beg_idx ON line_data_pstd
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pstd_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pstd_fcst_valid_beg_idx'
 line_data_pstd_fcst_valid_beg_idx: 0:00:00.008
CREATE INDEX line_data_pstd_fcst_init_beg_idx ON line_data_pstd
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pstd_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pstd_fcst_init_beg_idx'
  line_data_pstd_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_pjc_fcst_lead_idx ON line_data_pjc (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pjc_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pjc_fcst_lead_idx'
       line_data_pjc_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_pjc_fcst_valid_beg_idx ON line_data_pjc
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pjc_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pjc_fcst_valid_beg_idx'
  line_data_pjc_fcst_valid_beg_idx: 0:00:00.008
CREATE INDEX line_data_pjc_fcst_init_beg_idx ON line_data_pjc
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_pjc_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_pjc_fcst_init_beg_idx'
   line_data_pjc_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_prc_fcst_lead_idx ON line_data_prc (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_prc_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_prc_fcst_lead_idx'
       line_data_prc_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_prc_fcst_valid_beg_idx ON line_data_prc
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_prc_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_prc_fcst_valid_beg_idx'
  line_data_prc_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_prc_fcst_init_beg_idx ON line_data_prc
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_prc_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_prc_fcst_init_beg_idx'
   line_data_prc_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_sl1l2_fcst_lead_idx ON line_data_sl1l2
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_sl1l2_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_sl1l2_fcst_lead_idx'
     line_data_sl1l2_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_sl1l2_fcst_valid_beg_idx ON line_data_sl1l2
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_sl1l2_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_sl1l2_fcst_valid_beg_idx'
line_data_sl1l2_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_sl1l2_fcst_init_beg_idx ON line_data_sl1l2
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_sl1l2_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_sl1l2_fcst_init_beg_idx'
 line_data_sl1l2_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_sal1l2_fcst_lead_idx ON line_data_sal1l2
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_sal1l2_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_sal1l2_fcst_lead_idx'
    line_data_sal1l2_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_sal1l2_fcst_valid_beg_idx ON line_data_sal1l2
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_sal1l2_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_sal1l2_fcst_valid_beg_idx'
line_data_sal1l2_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_sal1l2_fcst_init_beg_idx ON line_data_sal1l2
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_sal1l2_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_sal1l2_fcst_init_beg_idx'
line_data_sal1l2_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_vl1l2_fcst_lead_idx ON line_data_vl1l2
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_vl1l2_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_vl1l2_fcst_lead_idx'
     line_data_vl1l2_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_vl1l2_fcst_valid_beg_idx ON line_data_vl1l2
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_vl1l2_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_vl1l2_fcst_valid_beg_idx'
line_data_vl1l2_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_vl1l2_fcst_init_beg_idx ON line_data_vl1l2
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_vl1l2_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_vl1l2_fcst_init_beg_idx'
 line_data_vl1l2_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_val1l2_fcst_lead_idx ON line_data_val1l2
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_val1l2_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_val1l2_fcst_lead_idx'
    line_data_val1l2_fcst_lead_idx: 0:00:00.009
CREATE INDEX line_data_val1l2_fcst_valid_beg_idx ON line_data_val1l2
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_val1l2_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_val1l2_fcst_valid_beg_idx'
line_data_val1l2_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_val1l2_fcst_init_beg_idx ON line_data_val1l2
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_val1l2_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_val1l2_fcst_init_beg_idx'
line_data_val1l2_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_mpr_fcst_lead_idx ON line_data_mpr (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_mpr_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_mpr_fcst_lead_idx'
       line_data_mpr_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_mpr_fcst_valid_beg_idx ON line_data_mpr
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_mpr_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_mpr_fcst_valid_beg_idx'
  line_data_mpr_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_mpr_fcst_init_beg_idx ON line_data_mpr
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_mpr_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_mpr_fcst_init_beg_idx'
   line_data_mpr_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_nbrctc_fcst_lead_idx ON line_data_nbrctc
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrctc_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrctc_fcst_lead_idx'
    line_data_nbrctc_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_nbrctc_fcst_valid_beg_idx ON line_data_nbrctc
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrctc_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrctc_fcst_valid_beg_idx'
line_data_nbrctc_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_nbrctc_fcst_init_beg_idx ON line_data_nbrctc
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrctc_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrctc_fcst_init_beg_idx'
line_data_nbrctc_fcst_init_beg_idx: 0:00:00.008
CREATE INDEX line_data_nbrcts_fcst_lead_idx ON line_data_nbrcts
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrcts_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrcts_fcst_lead_idx'
    line_data_nbrcts_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_nbrcts_fcst_valid_beg_idx ON line_data_nbrcts
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrcts_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrcts_fcst_valid_beg_idx'
line_data_nbrcts_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_nbrcts_fcst_init_beg_idx ON line_data_nbrcts
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrcts_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrcts_fcst_init_beg_idx'
line_data_nbrcts_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_nbrcnt_fcst_lead_idx ON line_data_nbrcnt
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrcnt_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrcnt_fcst_lead_idx'
    line_data_nbrcnt_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_nbrcnt_fcst_valid_beg_idx ON line_data_nbrcnt
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrcnt_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrcnt_fcst_valid_beg_idx'
line_data_nbrcnt_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_nbrcnt_fcst_init_beg_idx ON line_data_nbrcnt
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_nbrcnt_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_nbrcnt_fcst_init_beg_idx'
line_data_nbrcnt_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_isc_fcst_lead_idx ON line_data_isc (fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_isc_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_isc_fcst_lead_idx'
       line_data_isc_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_isc_fcst_valid_beg_idx ON line_data_isc
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_isc_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_isc_fcst_valid_beg_idx'
  line_data_isc_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_isc_fcst_init_beg_idx ON line_data_isc
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_isc_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_isc_fcst_init_beg_idx'
   line_data_isc_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_mctc_fcst_lead_idx ON line_data_mctc
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_mctc_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_mctc_fcst_lead_idx'
      line_data_mctc_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_mctc_fcst_valid_beg_idx ON line_data_mctc
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_mctc_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_mctc_fcst_valid_beg_idx'
 line_data_mctc_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_mctc_fcst_init_beg_idx ON line_data_mctc
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_mctc_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_mctc_fcst_init_beg_idx'
  line_data_mctc_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_rhist_fcst_lead_idx ON line_data_rhist
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_rhist_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_rhist_fcst_lead_idx'
     line_data_rhist_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_rhist_fcst_valid_beg_idx ON line_data_rhist
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_rhist_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_rhist_fcst_valid_beg_idx'
line_data_rhist_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_rhist_fcst_init_beg_idx ON line_data_rhist
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_rhist_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_rhist_fcst_init_beg_idx'
 line_data_rhist_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_orank_fcst_lead_idx ON line_data_orank
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_orank_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_orank_fcst_lead_idx'
     line_data_orank_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_orank_fcst_valid_beg_idx ON line_data_orank
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_orank_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_orank_fcst_valid_beg_idx'
line_data_orank_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_orank_fcst_init_beg_idx ON line_data_orank
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_orank_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_orank_fcst_init_beg_idx'
 line_data_orank_fcst_init_beg_idx: 0:00:00.007
CREATE INDEX line_data_relp_fcst_lead_idx ON line_data_relp
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_relp_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_relp_fcst_lead_idx'
      line_data_relp_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_relp_fcst_valid_beg_idx ON line_data_relp
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_relp_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_relp_fcst_valid_beg_idx'
 line_data_relp_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_relp_fcst_init_beg_idx ON line_data_relp
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_relp_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_relp_fcst_init_beg_idx'
  line_data_relp_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_eclv_fcst_lead_idx ON line_data_eclv
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_eclv_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_eclv_fcst_lead_idx'
      line_data_eclv_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_eclv_fcst_valid_beg_idx ON line_data_eclv
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_eclv_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_eclv_fcst_valid_beg_idx'
 line_data_eclv_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_eclv_fcst_init_beg_idx ON line_data_eclv
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_eclv_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_eclv_fcst_init_beg_idx'
  line_data_eclv_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_ssvar_fcst_lead_idx ON line_data_ssvar
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_ssvar_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_ssvar_fcst_lead_idx'
     line_data_ssvar_fcst_lead_idx: 0:00:00.007
CREATE INDEX line_data_ssvar_fcst_valid_beg_idx ON line_data_ssvar
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_ssvar_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_ssvar_fcst_valid_beg_idx'
line_data_ssvar_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_ssvar_fcst_init_beg_idx ON line_data_ssvar
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_ssvar_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_ssvar_fcst_init_beg_idx'
 line_data_ssvar_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_enscnt_fcst_lead_idx ON line_data_enscnt
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_enscnt_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_enscnt_fcst_lead_idx'
    line_data_enscnt_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_enscnt_fcst_valid_beg_idx ON line_data_enscnt
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_enscnt_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_enscnt_fcst_valid_beg_idx'
line_data_enscnt_fcst_valid_beg_idx: 0:00:00.006
CREATE INDEX line_data_enscnt_fcst_init_beg_idx ON line_data_enscnt
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_enscnt_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_enscnt_fcst_init_beg_idx'
line_data_enscnt_fcst_init_beg_idx: 0:00:00.006
CREATE INDEX line_data_grad_fcst_lead_idx ON line_data_grad
(fcst_lead);
  **  ERROR: caught class java.lang.Exception applying index
line_data_grad_fcst_lead_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_grad_fcst_lead_idx'
      line_data_grad_fcst_lead_idx: 0:00:00.006
CREATE INDEX line_data_grad_fcst_valid_beg_idx ON line_data_grad
(fcst_valid_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_grad_fcst_valid_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_grad_fcst_valid_beg_idx'
 line_data_grad_fcst_valid_beg_idx: 0:00:00.007
CREATE INDEX line_data_grad_fcst_init_beg_idx ON line_data_grad
(fcst_init_beg);
  **  ERROR: caught class java.lang.Exception applying index
line_data_grad_fcst_init_beg_idx: caught SQLException calling
executeUpdate: (conn=82365) Duplicate key name
'line_data_grad_fcst_init_beg_idx'
  line_data_grad_fcst_init_beg_idx: 0:00:00.006

End time: 2019-04-30 18:51:22
Load total: 0:00:00.002

----  MVLoad Done  ----

------------------------------------------------
Subject: Loading to AWS METviewer server
From: Ying Lin
Time: Tue Apr 30 14:19:13 2019

CALLING: cd /ptmpp1/Ying.Lin/awsload/vsdb.erly
CALLING: scp -r ./ ying.lin at 205.156.8.85://data/mv_data/ying.lin
CALLING: scp /meso/save/Ying.Lin/mvload/load_pcp_erly_new.xml
ying.lin at 205.156.8.85:~
----  MVLoad  ----

Begin time: 2019-04-30 18:54:11
Parsing: load_pcp_erly_new.xml

==== grid_stat ====

      stat_header table time total: 0:00:00.000
               stat header records: 0
               stat header inserts: 0
                 line data records: 0
                 line data inserts: 0
                stat group records: 0
                stat group inserts: 0
                var length records: 0
                var length inserts: 0
                       total lines: 0
                       insert size: 1
                      lines / msec: 0.000
                         num files: 0

    ==== mode ====

     mode_header search time total: 0:00:00.000
      mtd_header search time total: 0:00:00.000
     stat_header search time total: 0:00:00.000
               mode_header inserts: 0
                  mode_cts inserts: 0
           mode_obj_single inserts: 0
             mode_obj_pair inserts: 0
    ==== mtd ====

                mtd_header inserts: 0
         mtd_3d_obj_single inserts: 0
           mtd_3d_obj_pair inserts: 0
                mtd_2d_obj inserts: 0
                       total lines: 0
                         num files: 0
                         num files: 0

    ==== indexes ====

             stat_header_model_idx: 0:00:00.051
          stat_header_fcst_var_idx: 0:00:00.039
          stat_header_fcst_lev_idx: 0:00:00.040
            stat_header_obtype_idx: 0:00:00.044
           stat_header_vx_mask_idx: 0:00:00.042
       stat_header_interp_mthd_idx: 0:00:00.041
       stat_header_interp_pnts_idx: 0:00:00.042
       stat_header_fcst_thresh_idx: 0:00:00.046
             mode_header_model_idx: 0:00:00.043
         mode_header_fcst_lead_idx: 0:00:00.043
        mode_header_fcst_valid_idx: 0:00:00.044
         mode_header_fcst_init_idx: 0:00:00.044
          mode_header_fcst_rad_idx: 0:00:00.237
          mode_header_fcst_thr_idx: 0:00:00.045
          mode_header_fcst_var_idx: 0:00:00.047
          mode_header_fcst_lev_idx: 0:00:00.043
              mtd_header_model_idx: 0:00:00.044
          mtd_header_fcst_lead_idx: 0:00:00.045
         mtd_header_fcst_valid_idx: 0:00:00.048
          mtd_header_fcst_init_idx: 0:00:00.050
           mtd_header_fcst_rad_idx: 0:00:00.049
           mtd_header_fcst_thr_idx: 0:00:00.048
           mtd_header_fcst_var_idx: 0:00:00.053
           mtd_header_fcst_lev_idx: 0:00:00.055
       line_data_fho_fcst_lead_idx: 0:00:00.052
  line_data_fho_fcst_valid_beg_idx: 0:00:00.042
   line_data_fho_fcst_init_beg_idx: 0:00:00.045
       line_data_ctc_fcst_lead_idx: 0:00:00.047
  line_data_ctc_fcst_valid_beg_idx: 0:00:00.042
   line_data_ctc_fcst_init_beg_idx: 0:00:00.044
       line_data_cts_fcst_lead_idx: 0:00:00.265
  line_data_cts_fcst_valid_beg_idx: 0:00:00.256
   line_data_cts_fcst_init_beg_idx: 0:00:00.263
       line_data_cnt_fcst_lead_idx: 0:00:00.062
  line_data_cnt_fcst_valid_beg_idx: 0:00:00.253
   line_data_cnt_fcst_init_beg_idx: 0:00:00.248
       line_data_pct_fcst_lead_idx: 0:00:00.048
  line_data_pct_fcst_valid_beg_idx: 0:00:00.045
   line_data_pct_fcst_init_beg_idx: 0:00:00.040
      line_data_pstd_fcst_lead_idx: 0:00:00.047
 line_data_pstd_fcst_valid_beg_idx: 0:00:00.053
  line_data_pstd_fcst_init_beg_idx: 0:00:00.045
       line_data_pjc_fcst_lead_idx: 0:00:00.050
  line_data_pjc_fcst_valid_beg_idx: 0:00:00.039
   line_data_pjc_fcst_init_beg_idx: 0:00:00.040
       line_data_prc_fcst_lead_idx: 0:00:00.039
  line_data_prc_fcst_valid_beg_idx: 0:00:00.039
   line_data_prc_fcst_init_beg_idx: 0:00:00.044
     line_data_sl1l2_fcst_lead_idx: 0:00:00.042
line_data_sl1l2_fcst_valid_beg_idx: 0:00:00.042
 line_data_sl1l2_fcst_init_beg_idx: 0:00:00.042
    line_data_sal1l2_fcst_lead_idx: 0:00:00.044
line_data_sal1l2_fcst_valid_beg_idx: 0:00:00.041
line_data_sal1l2_fcst_init_beg_idx: 0:00:00.045
     line_data_vl1l2_fcst_lead_idx: 0:00:00.049
line_data_vl1l2_fcst_valid_beg_idx: 0:00:00.041
 line_data_vl1l2_fcst_init_beg_idx: 0:00:00.044
    line_data_val1l2_fcst_lead_idx: 0:00:00.047
line_data_val1l2_fcst_valid_beg_idx: 0:00:00.048
line_data_val1l2_fcst_init_beg_idx: 0:00:00.045
       line_data_mpr_fcst_lead_idx: 0:00:00.045
  line_data_mpr_fcst_valid_beg_idx: 0:00:00.045
   line_data_mpr_fcst_init_beg_idx: 0:00:00.043
    line_data_nbrctc_fcst_lead_idx: 0:00:00.052
line_data_nbrctc_fcst_valid_beg_idx: 0:00:00.044
line_data_nbrctc_fcst_init_beg_idx: 0:00:00.041
    line_data_nbrcts_fcst_lead_idx: 0:00:00.261
line_data_nbrcts_fcst_valid_beg_idx: 0:00:00.254
line_data_nbrcts_fcst_init_beg_idx: 0:00:00.257
    line_data_nbrcnt_fcst_lead_idx: 0:00:00.048
line_data_nbrcnt_fcst_valid_beg_idx: 0:00:00.048
line_data_nbrcnt_fcst_init_beg_idx: 0:00:00.051
       line_data_isc_fcst_lead_idx: 0:00:00.045
  line_data_isc_fcst_valid_beg_idx: 0:00:00.044
   line_data_isc_fcst_init_beg_idx: 0:00:00.047
      line_data_mctc_fcst_lead_idx: 0:00:00.041
 line_data_mctc_fcst_valid_beg_idx: 0:00:00.041
  line_data_mctc_fcst_init_beg_idx: 0:00:00.040
     line_data_rhist_fcst_lead_idx: 0:00:00.045
line_data_rhist_fcst_valid_beg_idx: 0:00:00.044
 line_data_rhist_fcst_init_beg_idx: 0:00:00.040
     line_data_orank_fcst_lead_idx: 0:00:00.048
line_data_orank_fcst_valid_beg_idx: 0:00:00.049
 line_data_orank_fcst_init_beg_idx: 0:00:00.049
      line_data_relp_fcst_lead_idx: 0:00:00.050
 line_data_relp_fcst_valid_beg_idx: 0:00:00.042
  line_data_relp_fcst_init_beg_idx: 0:00:00.045
      line_data_eclv_fcst_lead_idx: 0:00:00.039
 line_data_eclv_fcst_valid_beg_idx: 0:00:00.043
  line_data_eclv_fcst_init_beg_idx: 0:00:00.043
     line_data_ssvar_fcst_lead_idx: 0:00:00.049
line_data_ssvar_fcst_valid_beg_idx: 0:00:00.050
 line_data_ssvar_fcst_init_beg_idx: 0:00:00.055
    line_data_enscnt_fcst_lead_idx: 0:00:00.054
line_data_enscnt_fcst_valid_beg_idx: 0:00:00.046
line_data_enscnt_fcst_init_beg_idx: 0:00:00.049
      line_data_grad_fcst_lead_idx: 0:00:00.047
 line_data_grad_fcst_valid_beg_idx: 0:00:00.044
  line_data_grad_fcst_init_beg_idx: 0:00:00.040

End time: 2019-04-30 18:54:18
Load total: 0:00:00.007

----  MVLoad Done  ----

------------------------------------------------
Subject: Loading to AWS METviewer server
From: Tatiana Burek
Time: Tue Apr 30 14:30:50 2019

Ying,
You need to use base_dir instead of the actual directory name in your
XML.
Please use this XML without changing in load_pcp_erly_new.xml :

<folder_tmpl>/base_dir/{type}</folder_tmpl>
<load_val>
<field name="type">
<val>vsdb.erly</val>
</field>
</load_val>

And run
 mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/awsload/
load_pcp_erly_new.xml

Tatiana

On Tue Apr 30 14:19:13 2019, ying.lin at noaa.gov wrote:
> Thanks very much Tatiana, that's very helpful.
>
> I tried loading again with the modified load_pcp_erly_new.xml
> (attached;
> vsdb.erly/ moved to under /ptmpp1/Ying.Lin/awsload/) and got a
string
> of
> err msgs (see attached load.out.mv_ylin_erly_test) that made me
wonder
> if the data were already loaded yesterday to mv_ylin_erly_test
though
> invisible on the web interface.  So I created a new database
>  mv_ylin_erly_test2, tried loading with load_pcp_erly_new.xml again.
> This time there were no err msgs, the output
>  (load.out.mv_ylin_erly_test2) looked rather like yesterday's
> load.out.
> After over an hour, with refreshing/reloading the web page and
opening
> in a new browser window, the database is still not showing up on the
> web
> interface.
>
> The loading is done with
>       mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/awsload/vsdb.erly
> load_pcp_erly_new.xml
>
> I placed the tar'd up vsdb.erly directory in
> ftp.emc.ncep.noaa.gov/mmb/precip/awsmv.question/awsload_vsdb.tar.gz
> and
> wonder if you wouldn't mind try loading it to the AWS server, to see
> what's wrong with my set up?  The *.tar.gz contains 54 VSDB files (9
> models, for 6 days) so the database is smallish.  If you can see in
> the
> xml something I should try myself, that'll be really great too. 
> Thanks
> again -
>
> Ying
>
> On 4/30/19 1:30 PM, Tatiana Burek via RT wrote:
> > Ying
> >
> > The XML file for AWS loading should have the same format. So yes,
you
> > do need to specify <load_val>.
> >
> > One difference between the old way and AWS is the definition of
> > "base_dir". In load_metplus.xml you replaced the actual directory
> > with base_dir and used the actual path when you call
> > mv_load_to_aws.sh.
> > For load_pcp_erly_new.xml try to do the same with base_dir =
> > /ptmpp1/Ying.Lin/
> >
> > <folder_tmpl>/base_dir/{type}</folder_tmpl>
> >  <load_val>
> >     <field name="type">
> >       <val>vsdb.erly</val>
> >     </field>
> >   </load_val>
> >
> > and than call the script like this:
> > mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/ load_pcp_erly_new.xml
> >
> > I don't have an account on WCOSS and can't test it.
> > Let me know if this works.
> >
> > Tatiana
> >
> >
> > On Mon Apr 29 21:05:54 2019, ying.lin at noaa.gov wrote:
> >> Hello.  I tried loading some VSDBs from wcoss (Tide) to the AWS
> >> METviewer server (attached load_pcp_erly_new.xml), the load
output
> >> (attached load.out) seems to be OK but after 3 hours and
reloading
> >> database/reopening the browser, I'm still not seeing it on the
> >> database
> >> (under group test_ylin, database mv_ylin_erly_test).
> >>
> >> The database was created with
> >>
> >>     mv_create_db_on_aws.sh ying.lin mv_ylin_erly_test
> >>
> >> and loading was done with
> >>
> >>     mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/vsdb.erly
> >> load_pcp_erly_new.xml
> >>
> >> I had previously created mv_ylin_metplus (in group test_ylin) and
> >> loaded
> >> with the attached load_metplus.xml, with no problem.
> >>
> >> The main difference between the load_metplus.xml and the
> >> load_pcp_erly_new.xml is that in the latter I'm putting all the
> >> VSDBs
> >> for several models in the directory /ptmpp1/Ying.Lin/vsdb.erly,
and
> >> in
> >> the <load_spec> block I had
> >>
> >> <folder_tmpl>/ptmpp1/Ying.Lin/vsdb.erly</folder_tmpl>
> >>
> >> In the past when loading to the old NCEP METviewer server, I had
> >>
> >>
 <folder_tmpl>/metviewer/staging/{username}/metplus.out</folder_tmpl>
> >>   <load_val>
> >>     <field name="username">
> >>       <val>wd22yl</val>
> >>     </field>
> >>   </load_val>
> >>
> >> to load grid_stat_*.stat from different models in the same
directory
> >> (*/metplus.out/) and which seemed to work, and I was guessing
that
> >> in
> >> today's vsdb.erly load_pcp_erly_new.xml, since I'm specifying the
> >> path
> >> explicitly (/ptmpp1/Ying.Lin/vsdb.erly) I wouldn't need the
<field
> >> name="username"> bit.  Do I still need to specify the <load_val>
> >> (would
> >> it then be an empty field)?  I can't tell what, if anything, is
> >> wrong
> >> from the load.out.
> >>
> >> Thank you for your help -
> >>
> >> Ying
> >>
> >>
> >
> >



------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #89980] Loading to AWS METviewer server
From: Ying Lin
Time: Tue Apr 30 17:54:36 2019

Hi Tatiana,

     Yes, when I used the "base_dir" rather than the actual directory
name in my xml and followed your other instructions exactly, I was
able
to load using load_pcp_erly_new.xml.   Thank you so much for your help
and your patience!

     Please feel free to close this ticket at your convenience.

Ying


On 4/30/19 4:30 PM, Tatiana Burek via RT wrote:
> Ying,
> You need to use base_dir instead of the actual directory name in
your XML.
> Please use this XML without changing in load_pcp_erly_new.xml :
>
> <folder_tmpl>/base_dir/{type}</folder_tmpl>
> <load_val>
> <field name="type">
> <val>vsdb.erly</val>
> </field>
> </load_val>
>
> And run
>   mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/awsload/
> load_pcp_erly_new.xml
>
> Tatiana
>
> On Tue Apr 30 14:19:13 2019, ying.lin at noaa.gov wrote:
>> Thanks very much Tatiana, that's very helpful.
>>
>> I tried loading again with the modified load_pcp_erly_new.xml
>> (attached;
>> vsdb.erly/ moved to under /ptmpp1/Ying.Lin/awsload/) and got a
string
>> of
>> err msgs (see attached load.out.mv_ylin_erly_test) that made me
wonder
>> if the data were already loaded yesterday to mv_ylin_erly_test
though
>> invisible on the web interface.  So I created a new database
>>   mv_ylin_erly_test2, tried loading with load_pcp_erly_new.xml
again.
>> This time there were no err msgs, the output
>>   (load.out.mv_ylin_erly_test2) looked rather like yesterday's
>> load.out.
>> After over an hour, with refreshing/reloading the web page and
opening
>> in a new browser window, the database is still not showing up on
the
>> web
>> interface.
>>
>> The loading is done with
>>        mv_load_to_aws.sh ying.lin
/ptmpp1/Ying.Lin/awsload/vsdb.erly
>> load_pcp_erly_new.xml
>>
>> I placed the tar'd up vsdb.erly directory in
>> ftp.emc.ncep.noaa.gov/mmb/precip/awsmv.question/awsload_vsdb.tar.gz
>> and
>> wonder if you wouldn't mind try loading it to the AWS server, to
see
>> what's wrong with my set up?  The *.tar.gz contains 54 VSDB files
(9
>> models, for 6 days) so the database is smallish.  If you can see in
>> the
>> xml something I should try myself, that'll be really great too.
>> Thanks
>> again -
>>
>> Ying
>>
>> On 4/30/19 1:30 PM, Tatiana Burek via RT wrote:
>>> Ying
>>>
>>> The XML file for AWS loading should have the same format. So yes,
you
>>> do need to specify <load_val>.
>>>
>>> One difference between the old way and AWS is the definition of
>>> "base_dir". In load_metplus.xml you replaced the actual directory
>>> with base_dir and used the actual path when you call
>>> mv_load_to_aws.sh.
>>> For load_pcp_erly_new.xml try to do the same with base_dir =
>>> /ptmpp1/Ying.Lin/
>>>
>>> <folder_tmpl>/base_dir/{type}</folder_tmpl>
>>>   <load_val>
>>>      <field name="type">
>>>        <val>vsdb.erly</val>
>>>      </field>
>>>    </load_val>
>>>
>>> and than call the script like this:
>>> mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/ load_pcp_erly_new.xml
>>>
>>> I don't have an account on WCOSS and can't test it.
>>> Let me know if this works.
>>>
>>> Tatiana
>>>
>>>
>>> On Mon Apr 29 21:05:54 2019, ying.lin at noaa.gov wrote:
>>>> Hello.  I tried loading some VSDBs from wcoss (Tide) to the AWS
>>>> METviewer server (attached load_pcp_erly_new.xml), the load
output
>>>> (attached load.out) seems to be OK but after 3 hours and
reloading
>>>> database/reopening the browser, I'm still not seeing it on the
>>>> database
>>>> (under group test_ylin, database mv_ylin_erly_test).
>>>>
>>>> The database was created with
>>>>
>>>>      mv_create_db_on_aws.sh ying.lin mv_ylin_erly_test
>>>>
>>>> and loading was done with
>>>>
>>>>      mv_load_to_aws.sh ying.lin /ptmpp1/Ying.Lin/vsdb.erly
>>>> load_pcp_erly_new.xml
>>>>
>>>> I had previously created mv_ylin_metplus (in group test_ylin) and
>>>> loaded
>>>> with the attached load_metplus.xml, with no problem.
>>>>
>>>> The main difference between the load_metplus.xml and the
>>>> load_pcp_erly_new.xml is that in the latter I'm putting all the
>>>> VSDBs
>>>> for several models in the directory /ptmpp1/Ying.Lin/vsdb.erly,
and
>>>> in
>>>> the <load_spec> block I had
>>>>
>>>> <folder_tmpl>/ptmpp1/Ying.Lin/vsdb.erly</folder_tmpl>
>>>>
>>>> In the past when loading to the old NCEP METviewer server, I had
>>>>
>>>>
 <folder_tmpl>/metviewer/staging/{username}/metplus.out</folder_tmpl>
>>>>    <load_val>
>>>>      <field name="username">
>>>>        <val>wd22yl</val>
>>>>      </field>
>>>>    </load_val>
>>>>
>>>> to load grid_stat_*.stat from different models in the same
directory
>>>> (*/metplus.out/) and which seemed to work, and I was guessing
that
>>>> in
>>>> today's vsdb.erly load_pcp_erly_new.xml, since I'm specifying the
>>>> path
>>>> explicitly (/ptmpp1/Ying.Lin/vsdb.erly) I wouldn't need the
<field
>>>> name="username"> bit.  Do I still need to specify the <load_val>
>>>> (would
>>>> it then be an empty field)?  I can't tell what, if anything, is
>>>> wrong
>>>> from the load.out.
>>>>
>>>> Thank you for your help -
>>>>
>>>> Ying
>>>>
>>>>
>>>
>
>

--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov



------------------------------------------------


More information about the Met_help mailing list