[Met_help] [rt.rap.ucar.edu #85628] History for database prune details
John Halley Gotway via RT
met_help at ucar.edu
Wed Jul 10 16:43:17 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I'm trying to understand how best to scrub some data from a metviewer
database using this documentation
<http://www.dtcenter.org/met/metviewer/doc/database_scrubbing.html>, but
wanted to double check a detail. In the 1st example (pruning by describing
the data), do all of the criteria have to be met for data to be removed, or
are the criteria considered independently?
When attempting to delete some of my data for several models for a limited
period of time, it looked to remove everything for the models listed, so in
my experience seemed like they were being applied independently.
Thanks,
Matt
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: database prune details
From: Tatiana Burek
Time: Thu Jun 21 11:24:50 2018
Hi Mat,
During the scrubbing process all criteria that is described in XML
get applied to the database records.
Using the Example #1 from the help page, the record is deleted if
fcst_valid_beg is in the specified range AND model is NAM or GFS AND
fcst_var is APCP_03.
What is your database name and the location of XML file?
Tatiana
Tatiana
On Thu Jun 21 06:27:55 2018, Matthew.Pyle at noaa.gov wrote:
> Hi,
>
> I'm trying to understand how best to scrub some data from a
metviewer
> database using this documentation
> <http://www.dtcenter.org/met/metviewer/doc/database_scrubbing.html>,
but
> wanted to double check a detail. In the 1st example (pruning by
describing
> the data), do all of the criteria have to be met for data to be
removed, or
> are the criteria considered independently?
>
> When attempting to delete some of my data for several models for a
limited
> period of time, it looked to remove everything for the models
listed, so in
> my experience seemed like they were being applied independently.
>
> Thanks,
>
> Matt
------------------------------------------------
Subject: database prune details
From: "matthew.pyle at noaa.gov"
Time: Thu Jun 21 11:34:20 2018
I think the "mv_hrefv3" database has been scrubbed bare, but the XML
file I
was attempting to use is:
/usr1/metviewer/prune_db_spec_file_mpyle2_full
on
vm-lnx-metviewdev-process1.ncep.noaa.gov
Any hints on what I have wrong in it would be appreciated.
Thanks,
Matt
On Thu, Jun 21, 2018 at 1:24 PM, Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Hi Mat,
>
> During the scrubbing process all criteria that is described in XML
get
> applied to the database records.
> Using the Example #1 from the help page, the record is deleted if
> fcst_valid_beg is in the specified range AND model is NAM or GFS AND
> fcst_var is APCP_03.
>
> What is your database name and the location of XML file?
>
> Tatiana
>
> Tatiana
> On Thu Jun 21 06:27:55 2018, Matthew.Pyle at noaa.gov wrote:
> > Hi,
> >
> > I'm trying to understand how best to scrub some data from a
metviewer
> > database using this documentation
> >
<http://www.dtcenter.org/met/metviewer/doc/database_scrubbing.html>,
but
> > wanted to double check a detail. In the 1st example (pruning by
> describing
> > the data), do all of the criteria have to be met for data to be
removed,
> or
> > are the criteria considered independently?
> >
> > When attempting to delete some of my data for several models for a
> limited
> > period of time, it looked to remove everything for the models
listed, so
> in
> > my experience seemed like they were being applied independently.
> >
> > Thanks,
> >
> > Matt
>
>
>
>
------------------------------------------------
Subject: database prune details
From: Tatiana Burek
Time: Fri Jun 22 08:04:53 2018
Mat,
The XML file 'prune_db_spec_file_mpyle2_full' has invalid structure.
If you want to delete all records with init_date from2018052800 to
2018060812 and with the model name like in XML you should have file
like this:
<prune_spec>
<connection>
<management_system>mysql</management_system>
<host>vm-lnx-metviewdev-db1.ncep.noaa.gov:3306</host>
<database>mv_hrefv3</database>
<user>USER</user>
<password>PASSWORD</password>
</connection>
<info_only>false</info_only>
<fields>
<field name="fcst_valid_beg">
<value_range>
<start>2018-05-28 00:00:00</start>
<end>2018-06-08 12:00:00</end>
</value_range>
</field>
<field name="model">
<val>hrefhrrr1</val>
<val>hrefhrrr2</val>
<val>hrefarw1</val>
<val>hrefarw2</val>
<val>hrefnmmb1</val>
<val>hrefnmmb2</val>
<val>hrefmem2arw1</val>
<val>hrefmem2arw2</val>
<val>hrefnam1</val>
<val>hrefnam2</val>
<val>hrefmean</val>
<val>hrefv3mean</val>
<val>hrefeas</val>
<val>hrefv21eas</val>
<val>hrefpoint</val>
<val>hrefv21point</val>
<val>hrefnbrhd</val>
<val>hrefv21nbrhd</val>
<val>hreffrac</val>
</field>
</fields>
</prune_spec>
Tatiana
On Thu Jun 21 11:34:20 2018, Matthew.Pyle at noaa.gov wrote:
> I think the "mv_hrefv3" database has been scrubbed bare, but the XML
file I
> was attempting to use is:
>
> /usr1/metviewer/prune_db_spec_file_mpyle2_full
>
> on
>
> vm-lnx-metviewdev-process1.ncep.noaa.gov
>
> Any hints on what I have wrong in it would be appreciated.
>
> Thanks,
>
> Matt
>
> On Thu, Jun 21, 2018 at 1:24 PM, Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Mat,
> >
> > During the scrubbing process all criteria that is described in
XML get
> > applied to the database records.
> > Using the Example #1 from the help page, the record is deleted if
> > fcst_valid_beg is in the specified range AND model is NAM or GFS
AND
> > fcst_var is APCP_03.
> >
> > What is your database name and the location of XML file?
> >
> > Tatiana
> >
> > Tatiana
> > On Thu Jun 21 06:27:55 2018, Matthew.Pyle at noaa.gov wrote:
> > > Hi,
> > >
> > > I'm trying to understand how best to scrub some data from a
metviewer
> > > database using this documentation
> > >
<http://www.dtcenter.org/met/metviewer/doc/database_scrubbing.html>,
but
> > > wanted to double check a detail. In the 1st example (pruning by
> > describing
> > > the data), do all of the criteria have to be met for data to be
removed,
> > or
> > > are the criteria considered independently?
> > >
> > > When attempting to delete some of my data for several models for
a
> > limited
> > > period of time, it looked to remove everything for the models
listed, so
> > in
> > > my experience seemed like they were being applied independently.
> > >
> > > Thanks,
> > >
> > > Matt
> >
> >
> >
> >
------------------------------------------------
Subject: database prune details
From: "matthew.pyle at noaa.gov"
Time: Fri Jun 22 08:44:03 2018
Thanks! I had a feeling I had things a bit out of order.
-Matt
On Fri, Jun 22, 2018 at 10:04 AM, Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Mat,
> The XML file 'prune_db_spec_file_mpyle2_full' has invalid
structure.
> If you want to delete all records with init_date from2018052800 to
> 2018060812 and with the model name like in XML you should have file
like
> this:
> <prune_spec>
> <connection>
> <management_system>mysql</management_system>
> <host>vm-lnx-metviewdev-db1.ncep.noaa.gov:3306</host>
> <database>mv_hrefv3</database>
> <user>USER</user>
> <password>PASSWORD</password>
> </connection>
>
> <info_only>false</info_only>
>
> <fields>
> <field name="fcst_valid_beg">
> <value_range>
> <start>2018-05-28 00:00:00</start>
> <end>2018-06-08 12:00:00</end>
> </value_range>
> </field>
> <field name="model">
> <val>hrefhrrr1</val>
> <val>hrefhrrr2</val>
> <val>hrefarw1</val>
> <val>hrefarw2</val>
> <val>hrefnmmb1</val>
> <val>hrefnmmb2</val>
> <val>hrefmem2arw1</val>
> <val>hrefmem2arw2</val>
> <val>hrefnam1</val>
> <val>hrefnam2</val>
> <val>hrefmean</val>
> <val>hrefv3mean</val>
> <val>hrefeas</val>
> <val>hrefv21eas</val>
> <val>hrefpoint</val>
> <val>hrefv21point</val>
> <val>hrefnbrhd</val>
> <val>hrefv21nbrhd</val>
> <val>hreffrac</val>
> </field>
>
> </fields>
> </prune_spec>
>
> Tatiana
>
> On Thu Jun 21 11:34:20 2018, Matthew.Pyle at noaa.gov wrote:
> > I think the "mv_hrefv3" database has been scrubbed bare, but the
XML
> file I
> > was attempting to use is:
> >
> > /usr1/metviewer/prune_db_spec_file_mpyle2_full
> >
> > on
> >
> > vm-lnx-metviewdev-process1.ncep.noaa.gov
> >
> > Any hints on what I have wrong in it would be appreciated.
> >
> > Thanks,
> >
> > Matt
> >
> > On Thu, Jun 21, 2018 at 1:24 PM, Tatiana Burek via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> > > Hi Mat,
> > >
> > > During the scrubbing process all criteria that is described in
XML get
> > > applied to the database records.
> > > Using the Example #1 from the help page, the record is deleted
if
> > > fcst_valid_beg is in the specified range AND model is NAM or GFS
AND
> > > fcst_var is APCP_03.
> > >
> > > What is your database name and the location of XML file?
> > >
> > > Tatiana
> > >
> > > Tatiana
> > > On Thu Jun 21 06:27:55 2018, Matthew.Pyle at noaa.gov wrote:
> > > > Hi,
> > > >
> > > > I'm trying to understand how best to scrub some data from a
metviewer
> > > > database using this documentation
> > > >
<http://www.dtcenter.org/met/metviewer/doc/database_scrubbing.html>,
> but
> > > > wanted to double check a detail. In the 1st example (pruning
by
> > > describing
> > > > the data), do all of the criteria have to be met for data to
be
> removed,
> > > or
> > > > are the criteria considered independently?
> > > >
> > > > When attempting to delete some of my data for several models
for a
> > > limited
> > > > period of time, it looked to remove everything for the models
> listed, so
> > > in
> > > > my experience seemed like they were being applied
independently.
> > > >
> > > > Thanks,
> > > >
> > > > Matt
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list