[Met_help] [rt.rap.ucar.edu #86509] History for Load grid_stat *.stat files to MetViewer w/o "{model}" sub-directories

[John Halley Gotway via RT]

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hello.  So far I've been loading VSDB or MET output (*.stat) files to 
MetViewer by putting them under a "model" sub-directory, e.g. on EMC 
MetViewer server,

/metviewer/staging/wd22yl/scripts/load_simple_test.xml, with

<folder_tmpl>/metviewer/staging/wd22yl/vsdb.simple.test/{model}</folder_tmpl>
   <load_val>
     <field name="model">
       <val>FV3GFS</val>
       <val>HRRR</val>
     </field>
   </load_val>

and with the grid_stat for FV3GFS and HRRR under subdirs FV3GFS and HRRR 
in directory /metviewer/staging/wd22yl/vsdb.simple.test (the 'vsdb' is a 
misnomer since these are grid_stat output, not FVS output).  This does 
work.

But is it necessary to put the *.stats for different models under 
sub-directories?  To test the "no sub-dir" possibility, I made an 
attempt with

/metviewer/staging/wd22yl/vsdb.simple.test/load_simple_test2.xml, with

<folder_tmpl>/metviewer/staging/wd22yl/met.out/{files}</folder_tmpl>
   <load_val>
     <field name="files">
       <val>grid_stat</val>
     </field>
   </load_val>

The *.stat files in /metviewer/staging/wd22yl/met.out/ are

grid_stat_FV3GFS_240000L_20180805_120000V.stat and

grid_stat_HRRR_240000L_20180805_120000V.stat)

I was just guessing with the <folder_tmpl> above, not surprisingly it 
did not work - output is in 
/metviewer/staging/wd22yl/tmp.out/load.simple2.out.  Is there a way to 
load the contents of /metviewer/staging/wd22yl/met.out/ (e.g. *.stat 
files from different models) into MetViewer database without putting 
them into ${MODEL}/ sub-directories?

Thank you -

Ying

-- 
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov




----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Load grid_stat *.stat files to MetViewer w/o "{model}" sub-directories
From: John Halley Gotway
Time: Tue Aug 07 15:57:15 2018

Hi Ying,

I see you have a question about loading data into METviewer.  There
are two
pieces of info you need to know:

(1) The <folder_tmpl> is used to specify the *directories* to be
processed,
not filenames.  All .stat or .vsdb files in those directories are
loaded.
(2) The <folder_tmpl> must contain at least one variable defined by a
<load_val> tag.

The reason why your setting did now work is that:
/metviewer/staging/wd22yl/met.out/grid_stat is not a directory.

Please try using the following:

<folder_tmpl>/metviewer/staging/{username}/met.out</folder_tmpl>
   <load_val>
     <field name="username">
       <val>wd22yl</val>
     </field>
   </load_val>

I had to define at least one <load_val> setting... so I just picked
your
username and defined that.

I think this is unnecessarily confusing and I've talked to Tatiana
about
ways to make what you're trying to do simpler.  For example, one idea
would
be:
   <load_recursive>
     <val>/metviewer/staging/wd22yl/met.out</val>
   </load_recursive>

This would use <load_recursive> to define one or more top-level
directories
that METviewer should recursively search for .stat and .vsdb files to
be
loaded.  That'd make your loading process much simpler.  But this
feature
doesn't exist yet.

Thanks,
John

On Tue, Aug 7, 2018 at 1:07 PM Ying Lin via RT <met_help at ucar.edu>
wrote:

>
> Tue Aug 07 13:06:56 2018: Request 86509 was acted upon.
> Transaction: Ticket created by ying.lin at noaa.gov
>        Queue: met_help
>      Subject: Load grid_stat *.stat files to MetViewer w/o "{model}"
> sub-directories
>        Owner: Nobody
>   Requestors: ying.lin at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=86509 >
>
>
> Hello.  So far I've been loading VSDB or MET output (*.stat) files
to
> MetViewer by putting them under a "model" sub-directory, e.g. on EMC
> MetViewer server,
>
> /metviewer/staging/wd22yl/scripts/load_simple_test.xml, with
>
>
>
<folder_tmpl>/metviewer/staging/wd22yl/vsdb.simple.test/{model}</folder_tmpl>
>    <load_val>
>      <field name="model">
>        <val>FV3GFS</val>
>        <val>HRRR</val>
>      </field>
>    </load_val>
>
> and with the grid_stat for FV3GFS and HRRR under subdirs FV3GFS and
HRRR
> in directory /metviewer/staging/wd22yl/vsdb.simple.test (the 'vsdb'
is a
> misnomer since these are grid_stat output, not FVS output).  This
does
> work.
>
> But is it necessary to put the *.stats for different models under
> sub-directories?  To test the "no sub-dir" possibility, I made an
> attempt with
>
> /metviewer/staging/wd22yl/vsdb.simple.test/load_simple_test2.xml,
with
>
> <folder_tmpl>/metviewer/staging/wd22yl/met.out/{files}</folder_tmpl>
>    <load_val>
>      <field name="files">
>        <val>grid_stat</val>
>      </field>
>    </load_val>
>
> The *.stat files in /metviewer/staging/wd22yl/met.out/ are
>
> grid_stat_FV3GFS_240000L_20180805_120000V.stat and
>
> grid_stat_HRRR_240000L_20180805_120000V.stat)
>
> I was just guessing with the <folder_tmpl> above, not surprisingly
it
> did not work - output is in
> /metviewer/staging/wd22yl/tmp.out/load.simple2.out.  Is there a way
to
> load the contents of /metviewer/staging/wd22yl/met.out/ (e.g. *.stat
> files from different models) into MetViewer database without putting
> them into ${MODEL}/ sub-directories?
>
> Thank you -
>
> Ying
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>

------------------------------------------------