[Met_help] [rt.rap.ucar.edu #95668] History for PyEmbed Input File Config Option
George McCabe via RT
met_help at ucar.edu
Mon Jun 22 17:56:16 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I'm working on putting a PyEmbed section into a METplus use case. Is there
an input file template option for this tool? I don't see anything that
looks like a valid option for that in the documentation. I'm thinking
something along the lines of "FCST_GRID_STAT_INPUT_TEMPLATE". I need to run
python scripts iteratively over multiple files. Best, Lindsay
--
Lindsay R. Blank
Associate Scientist
Joint Numerical Testbed Program
National Center for Atmospheric Research
+1 (303)-497-2772
*My working day may not be your working day. Please do not feel obliged to
reply to this email outside of your normal working hours.*
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: PyEmbed Input File Config Option
From: Minna Win
Time: Thu Jun 18 16:59:57 2020
Hi Lindsay,
I don't know if there is a template for what you are attempting to
create.
I'm going to assign this ticket to George McCabe.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
On Thu, Jun 18, 2020 at 4:57 PM Lindsay Blank via RT
<met_help at ucar.edu>
wrote:
>
> Thu Jun 18 16:51:10 2020: Request 95668 was acted upon.
> Transaction: Ticket created by lblank at ucar.edu
> Queue: met_help
> Subject: PyEmbed Input File Config Option
> Owner: Nobody
> Requestors: lblank at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668 >
>
>
> Hello,
>
> I'm working on putting a PyEmbed section into a METplus use case. Is
there
> an input file template option for this tool? I don't see anything
that
> looks like a valid option for that in the documentation. I'm
thinking
> something along the lines of "FCST_GRID_STAT_INPUT_TEMPLATE". I need
to run
> python scripts iteratively over multiple files. Best, Lindsay
>
> --
> Lindsay R. Blank
> Associate Scientist
> Joint Numerical Testbed Program
> National Center for Atmospheric Research
> +1 (303)-497-2772
>
> *My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.*
>
>
------------------------------------------------
Subject: PyEmbed Input File Config Option
From: George McCabe
Time: Thu Jun 18 18:56:25 2020
HI Lindsay,
Here is the list of possible variables for PyEmbed:
https://ncar.github.io/METplus/Users_Guide/wrappers.html#pyembedingest
The variable to define the python script to call supports filename
template
syntax so you can pass in arguments to the script that vary for each
runtime. More information on that variable is here:
https://ncar.github.io/METplus/Users_Guide/glossary.html#term-py-
embed-ingest-n-script
This has made me realize that the use case for the PyEmbed wrapper
does not
utilize filename templates, so it is not clear from the example that
you
can do this:
https://ncar.github.io/METplus/Users_Guide/met_tool_wrapper/PyEmbedIngest/PyEmbedIngest.html#sphx-
glr-users-guide-met-tool-wrapper-pyembedingest-pyembedingest-py
We really should update this use case to show an example of this so it
is
clear how you would use it in a real situation. Thanks for bringing
this to
our attention! Let me know if you have any issues getting your case
set up.
-George
On Thu, Jun 18, 2020 at 4:59 PM Minna Win-Gildenmeister
<minnawin at ucar.edu>
wrote:
> Hi Lindsay,
>
> I don't know if there is a template for what you are attempting to
> create. I'm going to assign this ticket to George McCabe.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
>
>
>
> On Thu, Jun 18, 2020 at 4:57 PM Lindsay Blank via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> Thu Jun 18 16:51:10 2020: Request 95668 was acted upon.
>> Transaction: Ticket created by lblank at ucar.edu
>> Queue: met_help
>> Subject: PyEmbed Input File Config Option
>> Owner: Nobody
>> Requestors: lblank at ucar.edu
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668 >
>>
>>
>> Hello,
>>
>> I'm working on putting a PyEmbed section into a METplus use case.
Is there
>> an input file template option for this tool? I don't see anything
that
>> looks like a valid option for that in the documentation. I'm
thinking
>> something along the lines of "FCST_GRID_STAT_INPUT_TEMPLATE". I
need to
>> run
>> python scripts iteratively over multiple files. Best, Lindsay
>>
>> --
>> Lindsay R. Blank
>> Associate Scientist
>> Joint Numerical Testbed Program
>> National Center for Atmospheric Research
>> +1 (303)-497-2772
>>
>> *My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.*
>>
>>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: PyEmbed Input File Config Option
From: Lindsay Blank
Time: Mon Jun 22 09:12:49 2020
Hi George,
Thank you for the information. I am still confused, however. Is there
a PY_EMBED_INGEST_<n>_INPUT_TEMPLATE option? I only see an
OUTPUT_TEMPLATE
option.
Best,
Lindsay
On Thu, Jun 18, 2020 at 6:56 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> HI Lindsay,
>
> Here is the list of possible variables for PyEmbed:
>
>
https://ncar.github.io/METplus/Users_Guide/wrappers.html#pyembedingest
>
> The variable to define the python script to call supports filename
template
> syntax so you can pass in arguments to the script that vary for each
> runtime. More information on that variable is here:
>
>
> https://ncar.github.io/METplus/Users_Guide/glossary.html#term-py-
embed-ingest-n-script
>
> This has made me realize that the use case for the PyEmbed wrapper
does not
> utilize filename templates, so it is not clear from the example that
you
> can do this:
>
>
>
https://ncar.github.io/METplus/Users_Guide/met_tool_wrapper/PyEmbedIngest/PyEmbedIngest.html#sphx-
glr-users-guide-met-tool-wrapper-pyembedingest-pyembedingest-py
>
> We really should update this use case to show an example of this so
it is
> clear how you would use it in a real situation. Thanks for bringing
this to
> our attention! Let me know if you have any issues getting your case
set up.
>
> -George
>
> On Thu, Jun 18, 2020 at 4:59 PM Minna Win-Gildenmeister
<minnawin at ucar.edu
> >
> wrote:
>
> > Hi Lindsay,
> >
> > I don't know if there is a template for what you are attempting to
> > create. I'm going to assign this ticket to George McCabe.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> >
> >
> >
> > On Thu, Jun 18, 2020 at 4:57 PM Lindsay Blank via RT
<met_help at ucar.edu>
> > wrote:
> >
> >>
> >> Thu Jun 18 16:51:10 2020: Request 95668 was acted upon.
> >> Transaction: Ticket created by lblank at ucar.edu
> >> Queue: met_help
> >> Subject: PyEmbed Input File Config Option
> >> Owner: Nobody
> >> Requestors: lblank at ucar.edu
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668 >
> >>
> >>
> >> Hello,
> >>
> >> I'm working on putting a PyEmbed section into a METplus use case.
Is
> there
> >> an input file template option for this tool? I don't see anything
that
> >> looks like a valid option for that in the documentation. I'm
thinking
> >> something along the lines of "FCST_GRID_STAT_INPUT_TEMPLATE". I
need to
> >> run
> >> python scripts iteratively over multiple files. Best, Lindsay
> >>
> >> --
> >> Lindsay R. Blank
> >> Associate Scientist
> >> Joint Numerical Testbed Program
> >> National Center for Atmospheric Research
> >> +1 (303)-497-2772
> >>
> >> *My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.*
> >>
> >>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Lindsay R. Blank
Associate Scientist
Joint Numerical Testbed Program
National Center for Atmospheric Research
+1 (303)-497-2772
*My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.*
------------------------------------------------
Subject: PyEmbed Input File Config Option
From: George McCabe
Time: Mon Jun 22 09:35:36 2020
There is not an input template option, but PY_EMBED_INGEST_<n>_SCRIPT
supports filename template tags. So you can set something like this:
PY_EMBED_INGEST_1_SCRIPT = /some/dir/my_python_script.py
/data/dir/path/{valid?fmt=%Y%m%d%H}.nc {lead?fmt=%H}
For each runtime, it will call the script with the command line
arguments
substituted. Does that make sense?
On Mon, Jun 22, 2020 at 9:12 AM Lindsay Blank via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668 >
>
> Hi George,
>
> Thank you for the information. I am still confused, however. Is
there
> a PY_EMBED_INGEST_<n>_INPUT_TEMPLATE option? I only see an
OUTPUT_TEMPLATE
> option.
>
> Best,
> Lindsay
>
>
> On Thu, Jun 18, 2020 at 6:56 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > HI Lindsay,
> >
> > Here is the list of possible variables for PyEmbed:
> >
> >
https://ncar.github.io/METplus/Users_Guide/wrappers.html#pyembedingest
> >
> > The variable to define the python script to call supports filename
> template
> > syntax so you can pass in arguments to the script that vary for
each
> > runtime. More information on that variable is here:
> >
> >
> >
> https://ncar.github.io/METplus/Users_Guide/glossary.html#term-py-
embed-ingest-n-script
> >
> > This has made me realize that the use case for the PyEmbed wrapper
does
> not
> > utilize filename templates, so it is not clear from the example
that you
> > can do this:
> >
> >
> >
>
https://ncar.github.io/METplus/Users_Guide/met_tool_wrapper/PyEmbedIngest/PyEmbedIngest.html#sphx-
glr-users-guide-met-tool-wrapper-pyembedingest-pyembedingest-py
> >
> > We really should update this use case to show an example of this
so it is
> > clear how you would use it in a real situation. Thanks for
bringing this
> to
> > our attention! Let me know if you have any issues getting your
case set
> up.
> >
> > -George
> >
> > On Thu, Jun 18, 2020 at 4:59 PM Minna Win-Gildenmeister <
> minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hi Lindsay,
> > >
> > > I don't know if there is a template for what you are attempting
to
> > > create. I'm going to assign this ticket to George McCabe.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research
> > > Developmental Testbed Center
> > > Phone: 303-497-8423
> > > Fax: 303-497-8401
> > >
> > >
> > >
> > > On Thu, Jun 18, 2020 at 4:57 PM Lindsay Blank via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > >>
> > >> Thu Jun 18 16:51:10 2020: Request 95668 was acted upon.
> > >> Transaction: Ticket created by lblank at ucar.edu
> > >> Queue: met_help
> > >> Subject: PyEmbed Input File Config Option
> > >> Owner: Nobody
> > >> Requestors: lblank at ucar.edu
> > >> Status: new
> > >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668
> >
> > >>
> > >>
> > >> Hello,
> > >>
> > >> I'm working on putting a PyEmbed section into a METplus use
case. Is
> > there
> > >> an input file template option for this tool? I don't see
anything that
> > >> looks like a valid option for that in the documentation. I'm
thinking
> > >> something along the lines of "FCST_GRID_STAT_INPUT_TEMPLATE". I
need
> to
> > >> run
> > >> python scripts iteratively over multiple files. Best, Lindsay
> > >>
> > >> --
> > >> Lindsay R. Blank
> > >> Associate Scientist
> > >> Joint Numerical Testbed Program
> > >> National Center for Atmospheric Research
> > >> +1 (303)-497-2772
> > >>
> > >> *My working day may not be your working day. Please do not feel
> obliged
> > to
> > >> reply to this email outside of your normal working hours.*
> > >>
> > >>
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Lindsay R. Blank
> Associate Scientist
> Joint Numerical Testbed Program
> National Center for Atmospheric Research
> +1 (303)-497-2772
>
> *My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.*
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: PyEmbed Input File Config Option
From: Lindsay Blank
Time: Mon Jun 22 17:18:06 2020
Hi George,
Ah, yes! That makes sense. I was able to get that functionality
working in
my use case. Thank you!
Best,
Lindsay
On Mon, Jun 22, 2020 at 9:36 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> There is not an input template option, but
PY_EMBED_INGEST_<n>_SCRIPT
> supports filename template tags. So you can set something like this:
>
> PY_EMBED_INGEST_1_SCRIPT = /some/dir/my_python_script.py
> /data/dir/path/{valid?fmt=%Y%m%d%H}.nc {lead?fmt=%H}
>
> For each runtime, it will call the script with the command line
arguments
> substituted. Does that make sense?
>
> On Mon, Jun 22, 2020 at 9:12 AM Lindsay Blank via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668 >
> >
> > Hi George,
> >
> > Thank you for the information. I am still confused, however. Is
there
> > a PY_EMBED_INGEST_<n>_INPUT_TEMPLATE option? I only see an
> OUTPUT_TEMPLATE
> > option.
> >
> > Best,
> > Lindsay
> >
> >
> > On Thu, Jun 18, 2020 at 6:56 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > HI Lindsay,
> > >
> > > Here is the list of possible variables for PyEmbed:
> > >
> > >
https://ncar.github.io/METplus/Users_Guide/wrappers.html#pyembedingest
> > >
> > > The variable to define the python script to call supports
filename
> > template
> > > syntax so you can pass in arguments to the script that vary for
each
> > > runtime. More information on that variable is here:
> > >
> > >
> > >
> >
> https://ncar.github.io/METplus/Users_Guide/glossary.html#term-py-
embed-ingest-n-script
> > >
> > > This has made me realize that the use case for the PyEmbed
wrapper does
> > not
> > > utilize filename templates, so it is not clear from the example
that
> you
> > > can do this:
> > >
> > >
> > >
> >
>
https://ncar.github.io/METplus/Users_Guide/met_tool_wrapper/PyEmbedIngest/PyEmbedIngest.html#sphx-
glr-users-guide-met-tool-wrapper-pyembedingest-pyembedingest-py
> > >
> > > We really should update this use case to show an example of this
so it
> is
> > > clear how you would use it in a real situation. Thanks for
bringing
> this
> > to
> > > our attention! Let me know if you have any issues getting your
case set
> > up.
> > >
> > > -George
> > >
> > > On Thu, Jun 18, 2020 at 4:59 PM Minna Win-Gildenmeister <
> > minnawin at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hi Lindsay,
> > > >
> > > > I don't know if there is a template for what you are
attempting to
> > > > create. I'm going to assign this ticket to George McCabe.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research
> > > > Developmental Testbed Center
> > > > Phone: 303-497-8423
> > > > Fax: 303-497-8401
> > > >
> > > >
> > > >
> > > > On Thu, Jun 18, 2020 at 4:57 PM Lindsay Blank via RT <
> > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > >>
> > > >> Thu Jun 18 16:51:10 2020: Request 95668 was acted upon.
> > > >> Transaction: Ticket created by lblank at ucar.edu
> > > >> Queue: met_help
> > > >> Subject: PyEmbed Input File Config Option
> > > >> Owner: Nobody
> > > >> Requestors: lblank at ucar.edu
> > > >> Status: new
> > > >> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95668
> > >
> > > >>
> > > >>
> > > >> Hello,
> > > >>
> > > >> I'm working on putting a PyEmbed section into a METplus use
case. Is
> > > there
> > > >> an input file template option for this tool? I don't see
anything
> that
> > > >> looks like a valid option for that in the documentation. I'm
> thinking
> > > >> something along the lines of "FCST_GRID_STAT_INPUT_TEMPLATE".
I need
> > to
> > > >> run
> > > >> python scripts iteratively over multiple files. Best, Lindsay
> > > >>
> > > >> --
> > > >> Lindsay R. Blank
> > > >> Associate Scientist
> > > >> Joint Numerical Testbed Program
> > > >> National Center for Atmospheric Research
> > > >> +1 (303)-497-2772
> > > >>
> > > >> *My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > >> reply to this email outside of your normal working hours.*
> > > >>
> > > >>
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Lindsay R. Blank
> > Associate Scientist
> > Joint Numerical Testbed Program
> > National Center for Atmospheric Research
> > +1 (303)-497-2772
> >
> > *My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.*
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Lindsay R. Blank
Associate Scientist
Joint Numerical Testbed Program
National Center for Atmospheric Research
+1 (303)-497-2772
*My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.*
------------------------------------------------
More information about the Met_help
mailing list