[Met_help] [rt.rap.ucar.edu #97100] History for Formatting my mode config file for METplus usage

Thu Dec 17 11:15:24 MST 2020

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

MET Helpdesk,

According to the METplus User's Guide (https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-fcst-mode-input-template) if I wish to use python embedding I need to set the following variables as such:

FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY

[
Template used to specify forecast input filenames for the MET tool mode. A corresponding variable exists for observation data called OBS_MODE_INPUT_TEMPLATE<https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-obs-mode-input-template>. To utilize Python Embedding as input to the MET tools, set this value to PYTHON_NUMPY or PYTHON_XARRAY.
Used by: MODE
Family: [filename_templates]
Default: Varies

]

After running: master_metplus.py -c mode.conf I got the following error for each iteration, 36 in total.

10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR: (compare_gridded_wrapper.py:206) No input fields were specified. You must set [FCST/OBS]_VAR<n>_[NAME/LEVELS].

In the tutorial files for MET 2.2 I saw that for the use_cases/mode scenario, the METplus config file dealt with these variables in the following manner:

FCST_MODE_INPUT_TEMPLATE = {valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
OBS_MODE_INPUT_TEMPLATE = {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc

My variables are all in this format:

lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld

Can you help me figure out how to get my formatting correct so I can use METplus?

Thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Thu Oct 15 18:01:05 2020

Hello Wesley,

Can you provide your Python script that generates the 2D numpy array
representation of your data in addition to the METplus configuration
file
you are using?  Please follow the instructions at the bottom of this
page,
under 'How to send us data':

https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
>        Queue: met_help
>      Subject: Formatting my mode config file for METplus usage
>        Owner: Nobody
>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
>
> MET Helpdesk,
>
> According to the METplus User's Guide (
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
fcst-mode-input-template)
> if I wish to use python embedding I need to set the following
variables as
> such:
>
> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> [
> Template used to specify forecast input filenames for the MET tool
mode. A
> corresponding variable exists for observation data called
> OBS_MODE_INPUT_TEMPLATE<
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
obs-mode-input-template>.
> To utilize Python Embedding as input to the MET tools, set this
value to
> PYTHON_NUMPY or PYTHON_XARRAY.
> Used by: MODE
> Family: [filename_templates]
> Default: Varies
>
> ]
>
> After running: master_metplus.py -c mode.conf I got the following
error
> for each iteration, 36 in total.
>
> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> (compare_gridded_wrapper.py:206) No input fields were specified. You
must
> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
>
> In the tutorial files for MET 2.2 I saw that for the use_cases/mode
> scenario, the METplus config file dealt with these variables in the
> following manner:
>
> FCST_MODE_INPUT_TEMPLATE =
> {valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
> OBS_MODE_INPUT_TEMPLATE =
> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
>
> My variables are all in this format:
>
> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
>
> Can you help me figure out how to get my formatting correct so I can
use
> METplus?
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Thu Oct 15 18:02:12 2020

Hi Wesley,

Could you also provide a sample data file that you use as input to
your
Python script, too?

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
<minnawin at ucar.edu>
wrote:

> Hello Wesley,
>
> Can you provide your Python script that generates the 2D numpy array
> representation of your data in addition to the METplus configuration
file
> you are using?  Please follow the instructions at the bottom of this
page,
> under 'How to send us data':
>
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
>>
>> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
>> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
>>        Queue: met_help
>>      Subject: Formatting my mode config file for METplus usage
>>        Owner: Nobody
>>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
>>       Status: new
>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>>
>>
>> MET Helpdesk,
>>
>> According to the METplus User's Guide (
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
fcst-mode-input-template)
>> if I wish to use python embedding I need to set the following
variables as
>> such:
>>
>> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>>
>> [
>> Template used to specify forecast input filenames for the MET tool
mode.
>> A corresponding variable exists for observation data called
>> OBS_MODE_INPUT_TEMPLATE<
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
obs-mode-input-template>.
>> To utilize Python Embedding as input to the MET tools, set this
value to
>> PYTHON_NUMPY or PYTHON_XARRAY.
>> Used by: MODE
>> Family: [filename_templates]
>> Default: Varies
>>
>> ]
>>
>> After running: master_metplus.py -c mode.conf I got the following
error
>> for each iteration, 36 in total.
>>
>> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
>> (compare_gridded_wrapper.py:206) No input fields were specified.
You must
>> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
>>
>> In the tutorial files for MET 2.2 I saw that for the use_cases/mode
>> scenario, the METplus config file dealt with these variables in the
>> following manner:
>>
>> FCST_MODE_INPUT_TEMPLATE =
>>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
>> OBS_MODE_INPUT_TEMPLATE =
>> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
>>
>> My variables are all in this format:
>>
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
>>
>> Can you help me figure out how to get my formatting correct so I
can use
>> METplus?
>>
>> Thank you!
>>
>> Sincerely,
>>
>> Wesley Davis
>> Data Analyst
>> DeVine Consulting
>> 831-641-7661 (work)
>> 808-780-9977 (cell)
>> wesley.davis.ctr at nrlmry.navy.mil
>>
>>
>>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Thu Oct 15 18:05:48 2020

Minna,

No problem!  I'll hop on that now.

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Thursday, October 15, 2020 5:02 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

Could you also provide a sample data file that you use as input to
your Python script, too?

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
<minnawin at ucar.edu>
wrote:

> Hello Wesley,
>
> Can you provide your Python script that generates the 2D numpy array
> representation of your data in addition to the METplus configuration
> file you are using?  Please follow the instructions at the bottom of
> this page, under 'How to send us data':
>
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
hel
> p-desk
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
>>
>> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
>> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
>>        Queue: met_help
>>      Subject: Formatting my mode config file for METplus usage
>>        Owner: Nobody
>>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
>>       Status: new
>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>>
>>
>> MET Helpdesk,
>>
>> According to the METplus User's Guide (
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
fcst-mode-input-template)
>> if I wish to use python embedding I need to set the following
variables as
>> such:
>>
>> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>>
>> [
>> Template used to specify forecast input filenames for the MET tool
mode.
>> A corresponding variable exists for observation data called
>> OBS_MODE_INPUT_TEMPLATE<
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
obs-mode-input-template>.
>> To utilize Python Embedding as input to the MET tools, set this
value to
>> PYTHON_NUMPY or PYTHON_XARRAY.
>> Used by: MODE
>> Family: [filename_templates]
>> Default: Varies
>>
>> ]
>>
>> After running: master_metplus.py -c mode.conf I got the following
error
>> for each iteration, 36 in total.
>>
>> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
>> (compare_gridded_wrapper.py:206) No input fields were specified.
You must
>> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
>>
>> In the tutorial files for MET 2.2 I saw that for the use_cases/mode
>> scenario, the METplus config file dealt with these variables in the
>> following manner:
>>
>> FCST_MODE_INPUT_TEMPLATE =
>>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
>> OBS_MODE_INPUT_TEMPLATE =
>> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
>>
>> My variables are all in this format:
>>
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
>>
>> Can you help me figure out how to get my formatting correct so I
can use
>> METplus?
>>
>> Thank you!
>>
>> Sincerely,
>>
>> Wesley Davis
>> Data Analyst
>> DeVine Consulting
>> 831-641-7661 (work)
>> 808-780-9977 (cell)
>> wesley.davis.ctr at nrlmry.navy.mil
>>
>>
>>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Thu Oct 15 18:50:13 2020

I'm getting a lot of "operation not permitted" errors when I try to
upload the files.  Can you reply with whether or not the files made it
over when you get a chance?  Thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Thursday, October 15, 2020 5:02 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

Could you also provide a sample data file that you use as input to
your Python script, too?

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
<minnawin at ucar.edu>
wrote:

> Hello Wesley,
>
> Can you provide your Python script that generates the 2D numpy array
> representation of your data in addition to the METplus configuration
> file you are using?  Please follow the instructions at the bottom of
> this page, under 'How to send us data':
>
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
hel
> p-desk
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
>>
>> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
>> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
>>        Queue: met_help
>>      Subject: Formatting my mode config file for METplus usage
>>        Owner: Nobody
>>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
>>       Status: new
>>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>>
>>
>> MET Helpdesk,
>>
>> According to the METplus User's Guide (
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
fcst-mode-input-template)
>> if I wish to use python embedding I need to set the following
variables as
>> such:
>>
>> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>>
>> [
>> Template used to specify forecast input filenames for the MET tool
mode.
>> A corresponding variable exists for observation data called
>> OBS_MODE_INPUT_TEMPLATE<
>>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
obs-mode-input-template>.
>> To utilize Python Embedding as input to the MET tools, set this
value to
>> PYTHON_NUMPY or PYTHON_XARRAY.
>> Used by: MODE
>> Family: [filename_templates]
>> Default: Varies
>>
>> ]
>>
>> After running: master_metplus.py -c mode.conf I got the following
error
>> for each iteration, 36 in total.
>>
>> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
>> (compare_gridded_wrapper.py:206) No input fields were specified.
You must
>> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
>>
>> In the tutorial files for MET 2.2 I saw that for the use_cases/mode
>> scenario, the METplus config file dealt with these variables in the
>> following manner:
>>
>> FCST_MODE_INPUT_TEMPLATE =
>>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
>> OBS_MODE_INPUT_TEMPLATE =
>> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
>>
>> My variables are all in this format:
>>
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
>>
>> Can you help me figure out how to get my formatting correct so I
can use
>> METplus?
>>
>> Thank you!
>>
>> Sincerely,
>>
>> Wesley Davis
>> Data Analyst
>> DeVine Consulting
>> 831-641-7661 (work)
>> 808-780-9977 (cell)
>> wesley.davis.ctr at nrlmry.navy.mil
>>
>>
>>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 16 09:51:47 2020

Hi Wesley,

The directory is empty.  Can you try again, using binary mode perhaps?
I
haven't had anyone experience difficulty with the ftp site.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> I'm getting a lot of "operation not permitted" errors when I try to
upload
> the files.  Can you reply with whether or not the files made it over
when
> you get a chance?  Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Thursday, October 15, 2020 5:02 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> Could you also provide a sample data file that you use as input to
your
> Python script, too?
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
<minnawin at ucar.edu
> >
> wrote:
>
> > Hello Wesley,
> >
> > Can you provide your Python script that generates the 2D numpy
array
> > representation of your data in addition to the METplus
configuration
> > file you are using?  Please follow the instructions at the bottom
of
> > this page, under 'How to send us data':
> >
> >
> > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-hel
> > p-desk
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
Code 7531
> > via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> >>        Queue: met_help
> >>      Subject: Formatting my mode config file for METplus usage
> >>        Owner: Nobody
> >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> >>       Status: new
> >>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >>
> >>
> >> MET Helpdesk,
> >>
> >> According to the METplus User's Guide (
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
fcst-mode-input-template
> )
> >> if I wish to use python embedding I need to set the following
variables
> as
> >> such:
> >>
> >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >>
> >> [
> >> Template used to specify forecast input filenames for the MET
tool mode.
> >> A corresponding variable exists for observation data called
> >> OBS_MODE_INPUT_TEMPLATE<
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
obs-mode-input-template
> >.
> >> To utilize Python Embedding as input to the MET tools, set this
value to
> >> PYTHON_NUMPY or PYTHON_XARRAY.
> >> Used by: MODE
> >> Family: [filename_templates]
> >> Default: Varies
> >>
> >> ]
> >>
> >> After running: master_metplus.py -c mode.conf I got the following
error
> >> for each iteration, 36 in total.
> >>
> >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> >> (compare_gridded_wrapper.py:206) No input fields were specified.
You
> must
> >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> >>
> >> In the tutorial files for MET 2.2 I saw that for the
use_cases/mode
> >> scenario, the METplus config file dealt with these variables in
the
> >> following manner:
> >>
> >> FCST_MODE_INPUT_TEMPLATE =
> >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
> >> OBS_MODE_INPUT_TEMPLATE =
> >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> >>
> >> My variables are all in this format:
> >>
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> >>
> >> Can you help me figure out how to get my formatting correct so I
can use
> >> METplus?
> >>
> >> Thank you!
> >>
> >> Sincerely,
> >>
> >> Wesley Davis
> >> Data Analyst
> >> DeVine Consulting
> >> 831-641-7661 (work)
> >> 808-780-9977 (cell)
> >> wesley.davis.ctr at nrlmry.navy.mil
> >>
> >>
> >>
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 16 10:04:27 2020

Hi Wesley,

I asked our IT for suggestions, since I don't know what else to try.
I'll
let you know if I get any suggestions.

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> I'm getting a lot of "operation not permitted" errors when I try to
upload
> the files.  Can you reply with whether or not the files made it over
when
> you get a chance?  Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Thursday, October 15, 2020 5:02 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> Could you also provide a sample data file that you use as input to
your
> Python script, too?
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
<minnawin at ucar.edu
> >
> wrote:
>
> > Hello Wesley,
> >
> > Can you provide your Python script that generates the 2D numpy
array
> > representation of your data in addition to the METplus
configuration
> > file you are using?  Please follow the instructions at the bottom
of
> > this page, under 'How to send us data':
> >
> >
> > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-hel
> > p-desk
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
Code 7531
> > via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> >>        Queue: met_help
> >>      Subject: Formatting my mode config file for METplus usage
> >>        Owner: Nobody
> >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> >>       Status: new
> >>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >>
> >>
> >> MET Helpdesk,
> >>
> >> According to the METplus User's Guide (
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
fcst-mode-input-template
> )
> >> if I wish to use python embedding I need to set the following
variables
> as
> >> such:
> >>
> >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >>
> >> [
> >> Template used to specify forecast input filenames for the MET
tool mode.
> >> A corresponding variable exists for observation data called
> >> OBS_MODE_INPUT_TEMPLATE<
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#term-
obs-mode-input-template
> >.
> >> To utilize Python Embedding as input to the MET tools, set this
value to
> >> PYTHON_NUMPY or PYTHON_XARRAY.
> >> Used by: MODE
> >> Family: [filename_templates]
> >> Default: Varies
> >>
> >> ]
> >>
> >> After running: master_metplus.py -c mode.conf I got the following
error
> >> for each iteration, 36 in total.
> >>
> >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> >> (compare_gridded_wrapper.py:206) No input fields were specified.
You
> must
> >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> >>
> >> In the tutorial files for MET 2.2 I saw that for the
use_cases/mode
> >> scenario, the METplus config file dealt with these variables in
the
> >> following manner:
> >>
> >> FCST_MODE_INPUT_TEMPLATE =
> >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.nc
> >> OBS_MODE_INPUT_TEMPLATE =
> >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> >>
> >> My variables are all in this format:
> >>
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> >>
> >> Can you help me figure out how to get my formatting correct so I
can use
> >> METplus?
> >>
> >> Thank you!
> >>
> >> Sincerely,
> >>
> >> Wesley Davis
> >> Data Analyst
> >> DeVine Consulting
> >> 831-641-7661 (work)
> >> 808-780-9977 (cell)
> >> wesley.davis.ctr at nrlmry.navy.mil
> >>
> >>
> >>
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 16 10:10:35 2020

I'm 99% sure this is user error since I'm very brand new to linux.  I
probably just messed something up

Let me give it another shot and let's see what happens.

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, October 16, 2020 9:04 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I asked our IT for suggestions, since I don't know what else to try.
I'll let you know if I get any suggestions.

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> I'm getting a lot of "operation not permitted" errors when I try to
> upload the files.  Can you reply with whether or not the files made
it
> over when you get a chance?  Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Thursday, October 15, 2020 5:02 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> Could you also provide a sample data file that you use as input to
> your Python script, too?
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> <minnawin at ucar.edu
> >
> wrote:
>
> > Hello Wesley,
> >
> > Can you provide your Python script that generates the 2D numpy
array
> > representation of your data in addition to the METplus
configuration
> > file you are using?  Please follow the instructions at the bottom
of
> > this page, under 'How to send us data':
> >
> >
> > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-h
> > el
> > p-desk
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> >>        Queue: met_help
> >>      Subject: Formatting my mode config file for METplus usage
> >>        Owner: Nobody
> >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> >>       Status: new
> >>  Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >>
> >>
> >> MET Helpdesk,
> >>
> >> According to the METplus User's Guide (
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> rm-fcst-mode-input-template
> )
> >> if I wish to use python embedding I need to set the following
> >> variables
> as
> >> such:
> >>
> >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY OBS_MODE_INPUT_TEMPLATE =
> >> PYTHON_NUMPY
> >>
> >> [
> >> Template used to specify forecast input filenames for the MET
tool mode.
> >> A corresponding variable exists for observation data called
> >> OBS_MODE_INPUT_TEMPLATE<
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> rm-obs-mode-input-template
> >.
> >> To utilize Python Embedding as input to the MET tools, set this
> >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> >> Used by: MODE
> >> Family: [filename_templates]
> >> Default: Varies
> >>
> >> ]
> >>
> >> After running: master_metplus.py -c mode.conf I got the following
> >> error for each iteration, 36 in total.
> >>
> >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> >> (compare_gridded_wrapper.py:206) No input fields were specified.
> >> You
> must
> >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> >>
> >> In the tutorial files for MET 2.2 I saw that for the
use_cases/mode
> >> scenario, the METplus config file dealt with these variables in
the
> >> following manner:
> >>
> >> FCST_MODE_INPUT_TEMPLATE =
> >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.n
> >> c
> >> OBS_MODE_INPUT_TEMPLATE =
> >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> >>
> >> My variables are all in this format:
> >>
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> >>
> >> Can you help me figure out how to get my formatting correct so I
> >> can use METplus?
> >>
> >> Thank you!
> >>
> >> Sincerely,
> >>
> >> Wesley Davis
> >> Data Analyst
> >> DeVine Consulting
> >> 831-641-7661 (work)
> >> 808-780-9977 (cell)
> >> wesley.davis.ctr at nrlmry.navy.mil
> >>
> >>
> >>
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 16 10:52:53 2020

Here's what I'm getting when I try to drop my files off.

ftp> put /users/davis/testWrappers/mode.conf
local: /users/davis/testWrappers/mode.conf remote:
/users/davis/testWrappers/mode.conf
227 Entering Passive Mode (128,117,14,132,196,234).
550 /users/davis/testWrappers/mode.conf: Operation not permitted
ftp> put /users/davis/testWrappers/mode.conf .
local: /users/davis/testWrappers/mode.conf remote: .
227 Entering Passive Mode (128,117,14,132,196,227).
550 .: Overwrite permission denied

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, October 16, 2020 9:04 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I asked our IT for suggestions, since I don't know what else to try.
I'll let you know if I get any suggestions.

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> I'm getting a lot of "operation not permitted" errors when I try to
> upload the files.  Can you reply with whether or not the files made
it
> over when you get a chance?  Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Thursday, October 15, 2020 5:02 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> Could you also provide a sample data file that you use as input to
> your Python script, too?
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> <minnawin at ucar.edu
> >
> wrote:
>
> > Hello Wesley,
> >
> > Can you provide your Python script that generates the 2D numpy
array
> > representation of your data in addition to the METplus
configuration
> > file you are using?  Please follow the instructions at the bottom
of
> > this page, under 'How to send us data':
> >
> >
> > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-h
> > el
> > p-desk
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> >>        Queue: met_help
> >>      Subject: Formatting my mode config file for METplus usage
> >>        Owner: Nobody
> >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> >>       Status: new
> >>  Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >>
> >>
> >> MET Helpdesk,
> >>
> >> According to the METplus User's Guide (
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> rm-fcst-mode-input-template
> )
> >> if I wish to use python embedding I need to set the following
> >> variables
> as
> >> such:
> >>
> >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY OBS_MODE_INPUT_TEMPLATE =
> >> PYTHON_NUMPY
> >>
> >> [
> >> Template used to specify forecast input filenames for the MET
tool mode.
> >> A corresponding variable exists for observation data called
> >> OBS_MODE_INPUT_TEMPLATE<
> >>
>
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> rm-obs-mode-input-template
> >.
> >> To utilize Python Embedding as input to the MET tools, set this
> >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> >> Used by: MODE
> >> Family: [filename_templates]
> >> Default: Varies
> >>
> >> ]
> >>
> >> After running: master_metplus.py -c mode.conf I got the following
> >> error for each iteration, 36 in total.
> >>
> >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> >> (compare_gridded_wrapper.py:206) No input fields were specified.
> >> You
> must
> >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> >>
> >> In the tutorial files for MET 2.2 I saw that for the
use_cases/mode
> >> scenario, the METplus config file dealt with these variables in
the
> >> following manner:
> >>
> >> FCST_MODE_INPUT_TEMPLATE =
> >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.n
> >> c
> >> OBS_MODE_INPUT_TEMPLATE =
> >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> >>
> >> My variables are all in this format:
> >>
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> >>
> >> Can you help me figure out how to get my formatting correct so I
> >> can use METplus?
> >>
> >> Thank you!
> >>
> >> Sincerely,
> >>
> >> Wesley Davis
> >> Data Analyst
> >> DeVine Consulting
> >> 831-641-7661 (work)
> >> 808-780-9977 (cell)
> >> wesley.davis.ctr at nrlmry.navy.mil
> >>
> >>
> >>
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 16 10:53:44 2020

Hi Wesley,

If you are still experiencing issues downloading your code and data,
can
you capture your commands and email them?  Our IT folks would also
need to
know your IP address to troubleshoot...

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 16, 2020 at 10:11 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> I'm 99% sure this is user error since I'm very brand new to linux.
I
> probably just messed something up
>
> Let me give it another shot and let's see what happens.
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 16, 2020 9:04 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I asked our IT for suggestions, since I don't know what else to try.
I'll
> let you know if I get any suggestions.
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > I'm getting a lot of "operation not permitted" errors when I try
to
> > upload the files.  Can you reply with whether or not the files
made it
> > over when you get a chance?  Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Thursday, October 15, 2020 5:02 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > Could you also provide a sample data file that you use as input to
> > your Python script, too?
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > <minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hello Wesley,
> > >
> > > Can you provide your Python script that generates the 2D numpy
array
> > > representation of your data in addition to the METplus
configuration
> > > file you are using?  Please follow the instructions at the
bottom of
> > > this page, under 'How to send us data':
> > >
> > >
> > > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-h
> > > el
> > > p-desk
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> > >>        Queue: met_help
> > >>      Subject: Formatting my mode config file for METplus usage
> > >>        Owner: Nobody
> > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > >>       Status: new
> > >>  Ticket <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >>
> > >>
> > >> MET Helpdesk,
> > >>
> > >> According to the METplus User's Guide (
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> > rm-fcst-mode-input-template
> > )
> > >> if I wish to use python embedding I need to set the following
> > >> variables
> > as
> > >> such:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY OBS_MODE_INPUT_TEMPLATE
=
> > >> PYTHON_NUMPY
> > >>
> > >> [
> > >> Template used to specify forecast input filenames for the MET
tool
> mode.
> > >> A corresponding variable exists for observation data called
> > >> OBS_MODE_INPUT_TEMPLATE<
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> > rm-obs-mode-input-template
> > >.
> > >> To utilize Python Embedding as input to the MET tools, set this
> > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > >> Used by: MODE
> > >> Family: [filename_templates]
> > >> Default: Varies
> > >>
> > >> ]
> > >>
> > >> After running: master_metplus.py -c mode.conf I got the
following
> > >> error for each iteration, 36 in total.
> > >>
> > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > >> You
> > must
> > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > >>
> > >> In the tutorial files for MET 2.2 I saw that for the
use_cases/mode
> > >> scenario, the METplus config file dealt with these variables in
the
> > >> following manner:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE =
> > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.n
> > >> c
> > >> OBS_MODE_INPUT_TEMPLATE =
> > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > >>
> > >> My variables are all in this format:
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> > >>
> > >> Can you help me figure out how to get my formatting correct so
I
> > >> can use METplus?
> > >>
> > >> Thank you!
> > >>
> > >> Sincerely,
> > >>
> > >> Wesley Davis
> > >> Data Analyst
> > >> DeVine Consulting
> > >> 831-641-7661 (work)
> > >> 808-780-9977 (cell)
> > >> wesley.davis.ctr at nrlmry.navy.mil
> > >>
> > >>
> > >>
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 16 11:05:30 2020

Okay, I figured it out.  Totally user error, I didn't give your server
a name for the files.  I assumed the name would carry over like a cp
command.

I sent you my mode.conf, a sample forecast file, a sample observation
file, and our python script for reading NRL binaries.

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, October 16, 2020 9:54 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

If you are still experiencing issues downloading your code and data,
can you capture your commands and email them?  Our IT folks would also
need to know your IP address to troubleshoot...

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 16, 2020 at 10:11 AM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> I'm 99% sure this is user error since I'm very brand new to linux.
I
> probably just messed something up
>
> Let me give it another shot and let's see what happens.
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 16, 2020 9:04 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I asked our IT for suggestions, since I don't know what else to try.
> I'll let you know if I get any suggestions.
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > I'm getting a lot of "operation not permitted" errors when I try
to
> > upload the files.  Can you reply with whether or not the files
made
> > it over when you get a chance?  Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Thursday, October 15, 2020 5:02 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > Could you also provide a sample data file that you use as input to
> > your Python script, too?
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > <minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hello Wesley,
> > >
> > > Can you provide your Python script that generates the 2D numpy
> > > array representation of your data in addition to the METplus
> > > configuration file you are using?  Please follow the
instructions
> > > at the bottom of this page, under 'How to send us data':
> > >
> > >
> > > https://dtcenter.org/community-code/model-evaluation-tools-
met/met
> > > -h
> > > el
> > > p-desk
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> > >>        Queue: met_help
> > >>      Subject: Formatting my mode config file for METplus usage
> > >>        Owner: Nobody
> > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > >>       Status: new
> > >>  Ticket <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >>
> > >>
> > >> MET Helpdesk,
> > >>
> > >> According to the METplus User's Guide (
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#
> > te
> > rm-fcst-mode-input-template
> > )
> > >> if I wish to use python embedding I need to set the following
> > >> variables
> > as
> > >> such:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY OBS_MODE_INPUT_TEMPLATE
=
> > >> PYTHON_NUMPY
> > >>
> > >> [
> > >> Template used to specify forecast input filenames for the MET
> > >> tool
> mode.
> > >> A corresponding variable exists for observation data called
> > >> OBS_MODE_INPUT_TEMPLATE<
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#
> > te
> > rm-obs-mode-input-template
> > >.
> > >> To utilize Python Embedding as input to the MET tools, set this
> > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > >> Used by: MODE
> > >> Family: [filename_templates]
> > >> Default: Varies
> > >>
> > >> ]
> > >>
> > >> After running: master_metplus.py -c mode.conf I got the
following
> > >> error for each iteration, 36 in total.
> > >>
> > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > >> You
> > must
> > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > >>
> > >> In the tutorial files for MET 2.2 I saw that for the
> > >> use_cases/mode scenario, the METplus config file dealt with
these
> > >> variables in the following manner:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE =
> > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}
> > >> .n
> > >> c
> > >> OBS_MODE_INPUT_TEMPLATE =
> > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > >>
> > >> My variables are all in this format:
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> > >>
> > >> Can you help me figure out how to get my formatting correct so
I
> > >> can use METplus?
> > >>
> > >> Thank you!
> > >>
> > >> Sincerely,
> > >>
> > >> Wesley Davis
> > >> Data Analyst
> > >> DeVine Consulting
> > >> 831-641-7661 (work)
> > >> 808-780-9977 (cell)
> > >> wesley.davis.ctr at nrlmry.navy.mil
> > >>
> > >>
> > >>
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 16 12:48:45 2020

Hi Wesley,

I just checked your data directory in the ftp site, whatever you did
worked.  I'll take a look and see if I can get things working without
the
wrappers and then see what's going on.  This will probably take a
while.
Thanks for your patience while we troubleshoot your issue.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Here's what I'm getting when I try to drop my files off.
>
> ftp> put /users/davis/testWrappers/mode.conf
> local: /users/davis/testWrappers/mode.conf remote:
> /users/davis/testWrappers/mode.conf
> 227 Entering Passive Mode (128,117,14,132,196,234).
> 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> ftp> put /users/davis/testWrappers/mode.conf .
> local: /users/davis/testWrappers/mode.conf remote: .
> 227 Entering Passive Mode (128,117,14,132,196,227).
> 550 .: Overwrite permission denied
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 16, 2020 9:04 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I asked our IT for suggestions, since I don't know what else to try.
I'll
> let you know if I get any suggestions.
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > I'm getting a lot of "operation not permitted" errors when I try
to
> > upload the files.  Can you reply with whether or not the files
made it
> > over when you get a chance?  Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Thursday, October 15, 2020 5:02 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > Could you also provide a sample data file that you use as input to
> > your Python script, too?
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > <minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hello Wesley,
> > >
> > > Can you provide your Python script that generates the 2D numpy
array
> > > representation of your data in addition to the METplus
configuration
> > > file you are using?  Please follow the instructions at the
bottom of
> > > this page, under 'How to send us data':
> > >
> > >
> > > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-h
> > > el
> > > p-desk
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> > >>        Queue: met_help
> > >>      Subject: Formatting my mode config file for METplus usage
> > >>        Owner: Nobody
> > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > >>       Status: new
> > >>  Ticket <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >>
> > >>
> > >> MET Helpdesk,
> > >>
> > >> According to the METplus User's Guide (
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> > rm-fcst-mode-input-template
> > )
> > >> if I wish to use python embedding I need to set the following
> > >> variables
> > as
> > >> such:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY OBS_MODE_INPUT_TEMPLATE
=
> > >> PYTHON_NUMPY
> > >>
> > >> [
> > >> Template used to specify forecast input filenames for the MET
tool
> mode.
> > >> A corresponding variable exists for observation data called
> > >> OBS_MODE_INPUT_TEMPLATE<
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#te
> > rm-obs-mode-input-template
> > >.
> > >> To utilize Python Embedding as input to the MET tools, set this
> > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > >> Used by: MODE
> > >> Family: [filename_templates]
> > >> Default: Varies
> > >>
> > >> ]
> > >>
> > >> After running: master_metplus.py -c mode.conf I got the
following
> > >> error for each iteration, 36 in total.
> > >>
> > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > >> You
> > must
> > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > >>
> > >> In the tutorial files for MET 2.2 I saw that for the
use_cases/mode
> > >> scenario, the METplus config file dealt with these variables in
the
> > >> following manner:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE =
> > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}.n
> > >> c
> > >> OBS_MODE_INPUT_TEMPLATE =
> > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > >>
> > >> My variables are all in this format:
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> > >>
> > >> Can you help me figure out how to get my formatting correct so
I
> > >> can use METplus?
> > >>
> > >> Thank you!
> > >>
> > >> Sincerely,
> > >>
> > >> Wesley Davis
> > >> Data Analyst
> > >> DeVine Consulting
> > >> 831-641-7661 (work)
> > >> 808-780-9977 (cell)
> > >> wesley.davis.ctr at nrlmry.navy.mil
> > >>
> > >>
> > >>
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 16 12:49:45 2020

Thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, October 16, 2020 11:49 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I just checked your data directory in the ftp site, whatever you did
worked.  I'll take a look and see if I can get things working without
the wrappers and then see what's going on.  This will probably take a
while.
Thanks for your patience while we troubleshoot your issue.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Here's what I'm getting when I try to drop my files off.
>
> ftp> put /users/davis/testWrappers/mode.conf
> local: /users/davis/testWrappers/mode.conf remote:
> /users/davis/testWrappers/mode.conf
> 227 Entering Passive Mode (128,117,14,132,196,234).
> 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> ftp> put /users/davis/testWrappers/mode.conf .
> local: /users/davis/testWrappers/mode.conf remote: .
> 227 Entering Passive Mode (128,117,14,132,196,227).
> 550 .: Overwrite permission denied
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 16, 2020 9:04 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I asked our IT for suggestions, since I don't know what else to try.
> I'll let you know if I get any suggestions.
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > I'm getting a lot of "operation not permitted" errors when I try
to
> > upload the files.  Can you reply with whether or not the files
made
> > it over when you get a chance?  Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Thursday, October 15, 2020 5:02 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > Could you also provide a sample data file that you use as input to
> > your Python script, too?
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > <minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hello Wesley,
> > >
> > > Can you provide your Python script that generates the 2D numpy
> > > array representation of your data in addition to the METplus
> > > configuration file you are using?  Please follow the
instructions
> > > at the bottom of this page, under 'How to send us data':
> > >
> > >
> > > https://dtcenter.org/community-code/model-evaluation-tools-
met/met
> > > -h
> > > el
> > > p-desk
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > >> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> > >>        Queue: met_help
> > >>      Subject: Formatting my mode config file for METplus usage
> > >>        Owner: Nobody
> > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > >>       Status: new
> > >>  Ticket <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >>
> > >>
> > >> MET Helpdesk,
> > >>
> > >> According to the METplus User's Guide (
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#
> > te
> > rm-fcst-mode-input-template
> > )
> > >> if I wish to use python embedding I need to set the following
> > >> variables
> > as
> > >> such:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY OBS_MODE_INPUT_TEMPLATE
=
> > >> PYTHON_NUMPY
> > >>
> > >> [
> > >> Template used to specify forecast input filenames for the MET
> > >> tool
> mode.
> > >> A corresponding variable exists for observation data called
> > >> OBS_MODE_INPUT_TEMPLATE<
> > >>
> >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#
> > te
> > rm-obs-mode-input-template
> > >.
> > >> To utilize Python Embedding as input to the MET tools, set this
> > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > >> Used by: MODE
> > >> Family: [filename_templates]
> > >> Default: Varies
> > >>
> > >> ]
> > >>
> > >> After running: master_metplus.py -c mode.conf I got the
following
> > >> error for each iteration, 36 in total.
> > >>
> > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122) ERROR:
> > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > >> You
> > must
> > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > >>
> > >> In the tutorial files for MET 2.2 I saw that for the
> > >> use_cases/mode scenario, the METplus config file dealt with
these
> > >> variables in the following manner:
> > >>
> > >> FCST_MODE_INPUT_TEMPLATE =
> > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}
> > >> .n
> > >> c
> > >> OBS_MODE_INPUT_TEMPLATE =
> > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > >>
> > >> My variables are all in this format:
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> > >>
> > >> Can you help me figure out how to get my formatting correct so
I
> > >> can use METplus?
> > >>
> > >> Thank you!
> > >>
> > >> Sincerely,
> > >>
> > >> Wesley Davis
> > >> Data Analyst
> > >> DeVine Consulting
> > >> 831-641-7661 (work)
> > >> 808-780-9977 (cell)
> > >> wesley.davis.ctr at nrlmry.navy.mil
> > >>
> > >>
> > >>
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Tue Oct 20 15:07:13 2020

Hi Wesley,

I ran your Python script on your sample data as a sanity check and
that
output looks correct.

1) Upon closer inspection of the mode.conf file, it looks like you are
missing these entries under the [config] section:

# list of variables to compareFCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG FCST
OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG OBS
FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY

where you replace the
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the path
to your read_NRL_binary.py script.

2)  Under the [filename_template] section,

 you've set:

FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY

OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY

and you need to set them to something like this example for converting
ASCII to netCDF:

# Template to look for input to ASCII2NC relative to
ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
"{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
{INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
# Template to use to write output from
ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
{OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc

where you replace the full path to read_ascii_point.py to the full
path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you
would replace what you

currently have with the full path to your output files, in the
filename structure you want to use:

e.g.

OBS_MODE_OUTPUT_TEMPLATE =
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld.nc

I hope that will at least get you past the "No input fields were
specified..." errors.  We'll see what new errors we'll encounter after
this....

Regards,

Minna

---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 16, 2020 11:49 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I just checked your data directory in the ftp site, whatever you did
> worked.  I'll take a look and see if I can get things working
without the
> wrappers and then see what's going on.  This will probably take a
while.
> Thanks for your patience while we troubleshoot your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Here's what I'm getting when I try to drop my files off.
> >
> > ftp> put /users/davis/testWrappers/mode.conf
> > local: /users/davis/testWrappers/mode.conf remote:
> > /users/davis/testWrappers/mode.conf
> > 227 Entering Passive Mode (128,117,14,132,196,234).
> > 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> > ftp> put /users/davis/testWrappers/mode.conf .
> > local: /users/davis/testWrappers/mode.conf remote: .
> > 227 Entering Passive Mode (128,117,14,132,196,227).
> > 550 .: Overwrite permission denied
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 16, 2020 9:04 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I asked our IT for suggestions, since I don't know what else to
try.
> > I'll let you know if I get any suggestions.
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > I'm getting a lot of "operation not permitted" errors when I try
to
> > > upload the files.  Can you reply with whether or not the files
made
> > > it over when you get a chance?  Thank you!
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Thursday, October 15, 2020 5:02 PM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > Could you also provide a sample data file that you use as input
to
> > > your Python script, too?
> > >
> > > Thanks,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > <minnawin at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hello Wesley,
> > > >
> > > > Can you provide your Python script that generates the 2D numpy
> > > > array representation of your data in addition to the METplus
> > > > configuration file you are using?  Please follow the
instructions
> > > > at the bottom of this page, under 'How to send us data':
> > > >
> > > >
> > > > https://dtcenter.org/community-code/model-evaluation-tools-
met/met
> > > > -h
> > > > el
> > > > p-desk
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > >>        Queue: met_help
> > > >>      Subject: Formatting my mode config file for METplus
usage
> > > >>        Owner: Nobody
> > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > >>       Status: new
> > > >>  Ticket <URL:
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > >>
> > > >>
> > > >> MET Helpdesk,
> > > >>
> > > >> According to the METplus User's Guide (
> > > >>
> > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#
> > > te
> > > rm-fcst-mode-input-template
> > > )
> > > >> if I wish to use python embedding I need to set the following
> > > >> variables
> > > as
> > > >> such:
> > > >>
> > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
OBS_MODE_INPUT_TEMPLATE =
> > > >> PYTHON_NUMPY
> > > >>
> > > >> [
> > > >> Template used to specify forecast input filenames for the MET
> > > >> tool
> > mode.
> > > >> A corresponding variable exists for observation data called
> > > >> OBS_MODE_INPUT_TEMPLATE<
> > > >>
> > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.html#
> > > te
> > > rm-obs-mode-input-template
> > > >.
> > > >> To utilize Python Embedding as input to the MET tools, set
this
> > > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > >> Used by: MODE
> > > >> Family: [filename_templates]
> > > >> Default: Varies
> > > >>
> > > >> ]
> > > >>
> > > >> After running: master_metplus.py -c mode.conf I got the
following
> > > >> error for each iteration, 36 in total.
> > > >>
> > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > >> You
> > > must
> > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > >>
> > > >> In the tutorial files for MET 2.2 I saw that for the
> > > >> use_cases/mode scenario, the METplus config file dealt with
these
> > > >> variables in the following manner:
> > > >>
> > > >> FCST_MODE_INPUT_TEMPLATE =
> > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%HH}
> > > >> .n
> > > >> c
> > > >> OBS_MODE_INPUT_TEMPLATE =
> > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > >>
> > > >> My variables are all in this format:
> > > >>
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfld
> > > >>
> > > >> Can you help me figure out how to get my formatting correct
so I
> > > >> can use METplus?
> > > >>
> > > >> Thank you!
> > > >>
> > > >> Sincerely,
> > > >>
> > > >> Wesley Davis
> > > >> Data Analyst
> > > >> DeVine Consulting
> > > >> 831-641-7661 (work)
> > > >> 808-780-9977 (cell)
> > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > >>
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Thu Oct 22 11:21:01 2020

Minna,

# list of variables to compareFCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG FCST
OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG OBS

These lines are confusing to me.
----------------------------------------------
Do they go like this:
# list of variables to compare
FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG FCST
OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG OBS
--------------------------------------
Or like this:
# list of variables to compare

FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py

MET_PYTHON_INPUT_ARG FCST

OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py

MET_PYTHON_INPUT_ARG OBS
--------------------------------------

Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
Are these environment variables that have been set somewhere else in
the code?

Thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Tuesday, October 20, 2020 2:07 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I ran your Python script on your sample data as a sanity check and
that output looks correct.

1) Upon closer inspection of the mode.conf file, it looks like you are
missing these entries under the [config] section:

# list of variables to compareFCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG FCST
OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG OBS
FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY

where you replace the
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the path
to your read_NRL_binary.py script.

2)  Under the [filename_template] section,

 you've set:

FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY

OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY

and you need to set them to something like this example for converting
ASCII to netCDF:

# Template to look for input to ASCII2NC relative to
ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
"{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
{INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
# Template to use to write output from
ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
{OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc

where you replace the full path to read_ascii_point.py to the full
path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you
would replace what you

currently have with the full path to your output files, in the
filename structure you want to use:

e.g.

OBS_MODE_OUTPUT_TEMPLATE =
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld.nc

I hope that will at least get you past the "No input fields were
specified..." errors.  We'll see what new errors we'll encounter after
this....

Regards,

Minna

---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 16, 2020 11:49 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I just checked your data directory in the ftp site, whatever you did
> worked.  I'll take a look and see if I can get things working
without
> the wrappers and then see what's going on.  This will probably take
a while.
> Thanks for your patience while we troubleshoot your issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Here's what I'm getting when I try to drop my files off.
> >
> > ftp> put /users/davis/testWrappers/mode.conf
> > local: /users/davis/testWrappers/mode.conf remote:
> > /users/davis/testWrappers/mode.conf
> > 227 Entering Passive Mode (128,117,14,132,196,234).
> > 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> > ftp> put /users/davis/testWrappers/mode.conf .
> > local: /users/davis/testWrappers/mode.conf remote: .
> > 227 Entering Passive Mode (128,117,14,132,196,227).
> > 550 .: Overwrite permission denied
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 16, 2020 9:04 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I asked our IT for suggestions, since I don't know what else to
try.
> > I'll let you know if I get any suggestions.
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > I'm getting a lot of "operation not permitted" errors when I try
> > > to upload the files.  Can you reply with whether or not the
files
> > > made it over when you get a chance?  Thank you!
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Thursday, October 15, 2020 5:02 PM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > file for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > Could you also provide a sample data file that you use as input
to
> > > your Python script, too?
> > >
> > > Thanks,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > <minnawin at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hello Wesley,
> > > >
> > > > Can you provide your Python script that generates the 2D numpy
> > > > array representation of your data in addition to the METplus
> > > > configuration file you are using?  Please follow the
> > > > instructions at the bottom of this page, under 'How to send us
data':
> > > >
> > > >
> > > > https://dtcenter.org/community-code/model-evaluation-tools-
met/m
> > > > et
> > > > -h
> > > > el
> > > > p-desk
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley, Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > >>        Queue: met_help
> > > >>      Subject: Formatting my mode config file for METplus
usage
> > > >>        Owner: Nobody
> > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > >>       Status: new
> > > >>  Ticket <URL:
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > >>
> > > >>
> > > >> MET Helpdesk,
> > > >>
> > > >> According to the METplus User's Guide (
> > > >>
> > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.htm
> > > l#
> > > te
> > > rm-fcst-mode-input-template
> > > )
> > > >> if I wish to use python embedding I need to set the following
> > > >> variables
> > > as
> > > >> such:
> > > >>
> > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
OBS_MODE_INPUT_TEMPLATE
> > > >> = PYTHON_NUMPY
> > > >>
> > > >> [
> > > >> Template used to specify forecast input filenames for the MET
> > > >> tool
> > mode.
> > > >> A corresponding variable exists for observation data called
> > > >> OBS_MODE_INPUT_TEMPLATE<
> > > >>
> > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.htm
> > > l#
> > > te
> > > rm-obs-mode-input-template
> > > >.
> > > >> To utilize Python Embedding as input to the MET tools, set
this
> > > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > >> Used by: MODE
> > > >> Family: [filename_templates]
> > > >> Default: Varies
> > > >>
> > > >> ]
> > > >>
> > > >> After running: master_metplus.py -c mode.conf I got the
> > > >> following error for each iteration, 36 in total.
> > > >>
> > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > >> You
> > > must
> > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > >>
> > > >> In the tutorial files for MET 2.2 I saw that for the
> > > >> use_cases/mode scenario, the METplus config file dealt with
> > > >> these variables in the following manner:
> > > >>
> > > >> FCST_MODE_INPUT_TEMPLATE =
> > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%H
> > > >> H}
> > > >> .n
> > > >> c
> > > >> OBS_MODE_INPUT_TEMPLATE =
> > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > >>
> > > >> My variables are all in this format:
> > > >>
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfl
> > > >> d
> > > >>
> > > >> Can you help me figure out how to get my formatting correct
so
> > > >> I can use METplus?
> > > >>
> > > >> Thank you!
> > > >>
> > > >> Sincerely,
> > > >>
> > > >> Wesley Davis
> > > >> Data Analyst
> > > >> DeVine Consulting
> > > >> 831-641-7661 (work)
> > > >> 808-780-9977 (cell)
> > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > >>
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Thu Oct 22 11:58:06 2020

Hi Wesley,

I won't be able to look at this until next week.  We are busy getting
some
internal code releases out.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
>
> These lines are confusing to me.
> ----------------------------------------------
> Do they go like this:
> # list of variables to compare
> FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
> Or like this:
> # list of variables to compare
>
> FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG FCST
>
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
>
> Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
Are
> these environment variables that have been set somewhere else in the
code?
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 20, 2020 2:07 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I ran your Python script on your sample data as a sanity check and
that
> output looks correct.
>
> 1) Upon closer inspection of the mode.conf file, it looks like you
are
> missing these entries under the [config] section:
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
> OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY
>
>
> where you replace the
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the path
to
> your read_NRL_binary.py script.
>
>
> 2)  Under the [filename_template] section,
>
>  you've set:
>
> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> and you need to set them to something like this example for
converting
> ASCII to netCDF:
>
> # Template to look for input to ASCII2NC relative to
> ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> {INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> # Template to use to write output from
> ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
>
>
> where you replace the full path to read_ascii_point.py to the full
path to
> read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you would
replace
> what you
>
> currently have with the full path to your output files, in the
filename
> structure you want to use:
>
> e.g.
>
> OBS_MODE_OUTPUT_TEMPLATE =
>
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_
> 00000000_fcstfld.nc
>
>
> I hope that will at least get you past the "No input fields were
> specified..." errors.  We'll see what new errors we'll encounter
after
> this....
>
>
> Regards,
>
> Minna
>
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 16, 2020 11:49 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I just checked your data directory in the ftp site, whatever you
did
> > worked.  I'll take a look and see if I can get things working
without
> > the wrappers and then see what's going on.  This will probably
take a
> while.
> > Thanks for your patience while we troubleshoot your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Here's what I'm getting when I try to drop my files off.
> > >
> > > ftp> put /users/davis/testWrappers/mode.conf
> > > local: /users/davis/testWrappers/mode.conf remote:
> > > /users/davis/testWrappers/mode.conf
> > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> > > ftp> put /users/davis/testWrappers/mode.conf .
> > > local: /users/davis/testWrappers/mode.conf remote: .
> > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > 550 .: Overwrite permission denied
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 16, 2020 9:04 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I asked our IT for suggestions, since I don't know what else to
try.
> > > I'll let you know if I get any suggestions.
> > >
> > > Thanks,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > I'm getting a lot of "operation not permitted" errors when I
try
> > > > to upload the files.  Can you reply with whether or not the
files
> > > > made it over when you get a chance?  Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > Could you also provide a sample data file that you use as
input to
> > > > your Python script, too?
> > > >
> > > > Thanks,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > <minnawin at ucar.edu
> > > > >
> > > > wrote:
> > > >
> > > > > Hello Wesley,
> > > > >
> > > > > Can you provide your Python script that generates the 2D
numpy
> > > > > array representation of your data in addition to the METplus
> > > > > configuration file you are using?  Please follow the
> > > > > instructions at the bottom of this page, under 'How to send
us
> data':
> > > > >
> > > > >
> > > > > https://dtcenter.org/community-code/model-evaluation-tools-
met/m
> > > > > et
> > > > > -h
> > > > > el
> > > > > p-desk
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > > >>        Queue: met_help
> > > > >>      Subject: Formatting my mode config file for METplus
usage
> > > > >>        Owner: Nobody
> > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > >>       Status: new
> > > > >>  Ticket <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >>
> > > > >>
> > > > >> MET Helpdesk,
> > > > >>
> > > > >> According to the METplus User's Guide (
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.htm
> > > > l#
> > > > te
> > > > rm-fcst-mode-input-template
> > > > )
> > > > >> if I wish to use python embedding I need to set the
following
> > > > >> variables
> > > > as
> > > > >> such:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
OBS_MODE_INPUT_TEMPLATE
> > > > >> = PYTHON_NUMPY
> > > > >>
> > > > >> [
> > > > >> Template used to specify forecast input filenames for the
MET
> > > > >> tool
> > > mode.
> > > > >> A corresponding variable exists for observation data called
> > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.htm
> > > > l#
> > > > te
> > > > rm-obs-mode-input-template
> > > > >.
> > > > >> To utilize Python Embedding as input to the MET tools, set
this
> > > > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > >> Used by: MODE
> > > > >> Family: [filename_templates]
> > > > >> Default: Varies
> > > > >>
> > > > >> ]
> > > > >>
> > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > >> following error for each iteration, 36 in total.
> > > > >>
> > > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > > >> You
> > > > must
> > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > >>
> > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > >> use_cases/mode scenario, the METplus config file dealt with
> > > > >> these variables in the following manner:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%H
> > > > >> H}
> > > > >> .n
> > > > >> c
> > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > >>
> > > > >> My variables are all in this format:
> > > > >>
> > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfl
> > > > >> d
> > > > >>
> > > > >> Can you help me figure out how to get my formatting correct
so
> > > > >> I can use METplus?
> > > > >>
> > > > >> Thank you!
> > > > >>
> > > > >> Sincerely,
> > > > >>
> > > > >> Wesley Davis
> > > > >> Data Analyst
> > > > >> DeVine Consulting
> > > > >> 831-641-7661 (work)
> > > > >> 808-780-9977 (cell)
> > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > >>
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Thu Oct 22 13:00:22 2020

No worries, just get back to me when you can, thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Thursday, October 22, 2020 10:58 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I won't be able to look at this until next week.  We are busy getting
some internal code releases out.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
>
> These lines are confusing to me.
> ----------------------------------------------
> Do they go like this:
> # list of variables to compare
> FCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
> Or like this:
> # list of variables to compare
>
> FCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG FCST
>
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
>
> Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
> Are these environment variables that have been set somewhere else in
the code?
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 20, 2020 2:07 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I ran your Python script on your sample data as a sanity check and
> that output looks correct.
>
> 1) Upon closer inspection of the mode.conf file, it looks like you
are
> missing these entries under the [config] section:
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> PYTHON_NUMPY
>
>
> where you replace the
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the path
> to your read_NRL_binary.py script.
>
>
> 2)  Under the [filename_template] section,
>
>  you've set:
>
> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> and you need to set them to something like this example for
converting
> ASCII to netCDF:
>
> # Template to look for input to ASCII2NC relative to
> ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> {INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> # Template to use to write output from
> ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
>
>
> where you replace the full path to read_ascii_point.py to the full
> path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you
> would replace what you
>
> currently have with the full path to your output files, in the
> filename structure you want to use:
>
> e.g.
>
> OBS_MODE_OUTPUT_TEMPLATE =
>
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H
> }_
> 00000000_fcstfld.nc
>
>
> I hope that will at least get you past the "No input fields were
> specified..." errors.  We'll see what new errors we'll encounter
after
> this....
>
>
> Regards,
>
> Minna
>
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 16, 2020 11:49 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I just checked your data directory in the ftp site, whatever you
did
> > worked.  I'll take a look and see if I can get things working
> > without the wrappers and then see what's going on.  This will
> > probably take a
> while.
> > Thanks for your patience while we troubleshoot your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Here's what I'm getting when I try to drop my files off.
> > >
> > > ftp> put /users/davis/testWrappers/mode.conf
> > > local: /users/davis/testWrappers/mode.conf remote:
> > > /users/davis/testWrappers/mode.conf
> > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> > > ftp> put /users/davis/testWrappers/mode.conf .
> > > local: /users/davis/testWrappers/mode.conf remote: .
> > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > 550 .: Overwrite permission denied
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 16, 2020 9:04 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > file for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I asked our IT for suggestions, since I don't know what else to
try.
> > > I'll let you know if I get any suggestions.
> > >
> > > Thanks,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > I'm getting a lot of "operation not permitted" errors when I
try
> > > > to upload the files.  Can you reply with whether or not the
> > > > files made it over when you get a chance?  Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > Could you also provide a sample data file that you use as
input
> > > > to your Python script, too?
> > > >
> > > > Thanks,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > <minnawin at ucar.edu
> > > > >
> > > > wrote:
> > > >
> > > > > Hello Wesley,
> > > > >
> > > > > Can you provide your Python script that generates the 2D
numpy
> > > > > array representation of your data in addition to the METplus
> > > > > configuration file you are using?  Please follow the
> > > > > instructions at the bottom of this page, under 'How to send
us
> data':
> > > > >
> > > > >
> > > > > https://dtcenter.org/community-code/model-evaluation-tools-
met
> > > > > /m
> > > > > et
> > > > > -h
> > > > > el
> > > > > p-desk
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > > >>        Queue: met_help
> > > > >>      Subject: Formatting my mode config file for METplus
usage
> > > > >>        Owner: Nobody
> > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > >>       Status: new
> > > > >>  Ticket <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >>
> > > > >>
> > > > >> MET Helpdesk,
> > > > >>
> > > > >> According to the METplus User's Guide (
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.h
> > > > tm
> > > > l#
> > > > te
> > > > rm-fcst-mode-input-template
> > > > )
> > > > >> if I wish to use python embedding I need to set the
following
> > > > >> variables
> > > > as
> > > > >> such:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > >>
> > > > >> [
> > > > >> Template used to specify forecast input filenames for the
MET
> > > > >> tool
> > > mode.
> > > > >> A corresponding variable exists for observation data called
> > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.h
> > > > tm
> > > > l#
> > > > te
> > > > rm-obs-mode-input-template
> > > > >.
> > > > >> To utilize Python Embedding as input to the MET tools, set
> > > > >> this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > >> Used by: MODE
> > > > >> Family: [filename_templates]
> > > > >> Default: Varies
> > > > >>
> > > > >> ]
> > > > >>
> > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > >> following error for each iteration, 36 in total.
> > > > >>
> > > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > > >> You
> > > > must
> > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > >>
> > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > >> use_cases/mode scenario, the METplus config file dealt with
> > > > >> these variables in the following manner:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=
> > > > >> %H
> > > > >> H}
> > > > >> .n
> > > > >> c
> > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > >>
> > > > >> My variables are all in this format:
> > > > >>
> > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcst
> > > > >> fl
> > > > >> d
> > > > >>
> > > > >> Can you help me figure out how to get my formatting correct
> > > > >> so I can use METplus?
> > > > >>
> > > > >> Thank you!
> > > > >>
> > > > >> Sincerely,
> > > > >>
> > > > >> Wesley Davis
> > > > >> Data Analyst
> > > > >> DeVine Consulting
> > > > >> 831-641-7661 (work)
> > > > >> 808-780-9977 (cell)
> > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > >>
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 23 12:02:03 2020

Hi Wesley,

I also forgot one more thing, here is a (hopefully) useful link to the
MTD
Python embedding example (from which I used to compare against your
mode.conf file, just replaced the MTD with MODE in the config file):

https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper/MTD/MTD_python_embedding.html?highlight=python%20embedding

And based on the sample METplus config file, you should set these in
your
config files this way (my apologies for my incorrect initial
response):

MET_PYTHON_INPUT_ARG FCST
OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG
OBS
FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG
FCST
FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY

Where there is whitespace between the
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
, MET_PYTHON_INPUT_ARG, and  OBS/FCST.

The MET_PYTHON_INPUT_ARG is a constant that is used by the MET Python
embedding code, so it is not an environment variable that you need to
set.

Hopefully this clarifies your confusion.  Please let me know how it
goes.

Regards,
Minna

---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
>
> These lines are confusing to me.
> ----------------------------------------------
> Do they go like this:
> # list of variables to compare
> FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
> Or like this:
> # list of variables to compare
>
> FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG FCST
>
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
>
> Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
Are
> these environment variables that have been set somewhere else in the
code?
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 20, 2020 2:07 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I ran your Python script on your sample data as a sanity check and
that
> output looks correct.
>
> 1) Upon closer inspection of the mode.conf file, it looks like you
are
> missing these entries under the [config] section:
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
> OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY
>
>
> where you replace the
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the path
to
> your read_NRL_binary.py script.
>
>
> 2)  Under the [filename_template] section,
>
>  you've set:
>
> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> and you need to set them to something like this example for
converting
> ASCII to netCDF:
>
> # Template to look for input to ASCII2NC relative to
> ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> {INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> # Template to use to write output from
> ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
>
>
> where you replace the full path to read_ascii_point.py to the full
path to
> read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you would
replace
> what you
>
> currently have with the full path to your output files, in the
filename
> structure you want to use:
>
> e.g.
>
> OBS_MODE_OUTPUT_TEMPLATE =
>
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_
> 00000000_fcstfld.nc
>
>
> I hope that will at least get you past the "No input fields were
> specified..." errors.  We'll see what new errors we'll encounter
after
> this....
>
>
> Regards,
>
> Minna
>
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 16, 2020 11:49 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I just checked your data directory in the ftp site, whatever you
did
> > worked.  I'll take a look and see if I can get things working
without
> > the wrappers and then see what's going on.  This will probably
take a
> while.
> > Thanks for your patience while we troubleshoot your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Here's what I'm getting when I try to drop my files off.
> > >
> > > ftp> put /users/davis/testWrappers/mode.conf
> > > local: /users/davis/testWrappers/mode.conf remote:
> > > /users/davis/testWrappers/mode.conf
> > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> > > ftp> put /users/davis/testWrappers/mode.conf .
> > > local: /users/davis/testWrappers/mode.conf remote: .
> > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > 550 .: Overwrite permission denied
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 16, 2020 9:04 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I asked our IT for suggestions, since I don't know what else to
try.
> > > I'll let you know if I get any suggestions.
> > >
> > > Thanks,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > I'm getting a lot of "operation not permitted" errors when I
try
> > > > to upload the files.  Can you reply with whether or not the
files
> > > > made it over when you get a chance?  Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > Could you also provide a sample data file that you use as
input to
> > > > your Python script, too?
> > > >
> > > > Thanks,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > <minnawin at ucar.edu
> > > > >
> > > > wrote:
> > > >
> > > > > Hello Wesley,
> > > > >
> > > > > Can you provide your Python script that generates the 2D
numpy
> > > > > array representation of your data in addition to the METplus
> > > > > configuration file you are using?  Please follow the
> > > > > instructions at the bottom of this page, under 'How to send
us
> data':
> > > > >
> > > > >
> > > > > https://dtcenter.org/community-code/model-evaluation-tools-
met/m
> > > > > et
> > > > > -h
> > > > > el
> > > > > p-desk
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > > >>        Queue: met_help
> > > > >>      Subject: Formatting my mode config file for METplus
usage
> > > > >>        Owner: Nobody
> > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > >>       Status: new
> > > > >>  Ticket <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >>
> > > > >>
> > > > >> MET Helpdesk,
> > > > >>
> > > > >> According to the METplus User's Guide (
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.htm
> > > > l#
> > > > te
> > > > rm-fcst-mode-input-template
> > > > )
> > > > >> if I wish to use python embedding I need to set the
following
> > > > >> variables
> > > > as
> > > > >> such:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
OBS_MODE_INPUT_TEMPLATE
> > > > >> = PYTHON_NUMPY
> > > > >>
> > > > >> [
> > > > >> Template used to specify forecast input filenames for the
MET
> > > > >> tool
> > > mode.
> > > > >> A corresponding variable exists for observation data called
> > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.htm
> > > > l#
> > > > te
> > > > rm-obs-mode-input-template
> > > > >.
> > > > >> To utilize Python Embedding as input to the MET tools, set
this
> > > > >> value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > >> Used by: MODE
> > > > >> Family: [filename_templates]
> > > > >> Default: Varies
> > > > >>
> > > > >> ]
> > > > >>
> > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > >> following error for each iteration, 36 in total.
> > > > >>
> > > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > > >> You
> > > > must
> > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > >>
> > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > >> use_cases/mode scenario, the METplus config file dealt with
> > > > >> these variables in the following manner:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=%H
> > > > >> H}
> > > > >> .n
> > > > >> c
> > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > >>
> > > > >> My variables are all in this format:
> > > > >>
> > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcstfl
> > > > >> d
> > > > >>
> > > > >> Can you help me figure out how to get my formatting correct
so
> > > > >> I can use METplus?
> > > > >>
> > > > >> Thank you!
> > > > >>
> > > > >> Sincerely,
> > > > >>
> > > > >> Wesley Davis
> > > > >> Data Analyst
> > > > >> DeVine Consulting
> > > > >> 831-641-7661 (work)
> > > > >> 808-780-9977 (cell)
> > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > >>
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 23 14:10:10 2020

Minna,

I attached the portion of my configuration file that I edited as well
as the error it threw.

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, October 23, 2020 11:02 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I also forgot one more thing, here is a (hopefully) useful link to the
MTD Python embedding example (from which I used to compare against
your mode.conf file, just replaced the MTD with MODE in the config
file):

https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper/MTD/MTD_python_embedding.html?highlight=python%20embedding

And based on the sample METplus config file, you should set these in
your config files this way (my apologies for my incorrect initial
response):

MET_PYTHON_INPUT_ARG FCST
OBS_VAR1_NAME = {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG
OBS
FCST_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
MET_PYTHON_INPUT_ARG
FCST
FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY

Where there is whitespace between the
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
, MET_PYTHON_INPUT_ARG, and  OBS/FCST.

The MET_PYTHON_INPUT_ARG is a constant that is used by the MET Python
embedding code, so it is not an environment variable that you need to
set.

Hopefully this clarifies your confusion.  Please let me know how it
goes.

Regards,
Minna

---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
>
> These lines are confusing to me.
> ----------------------------------------------
> Do they go like this:
> # list of variables to compare
> FCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
> Or like this:
> # list of variables to compare
>
> FCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG FCST
>
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
>
> MET_PYTHON_INPUT_ARG OBS
> --------------------------------------
>
> Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
> Are these environment variables that have been set somewhere else in
the code?
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 20, 2020 2:07 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I ran your Python script on your sample data as a sanity check and
> that output looks correct.
>
> 1) Upon closer inspection of the mode.conf file, it looks like you
are
> missing these entries under the [config] section:
>
> # list of variables to compareFCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG OBS
> FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> PYTHON_NUMPY
>
>
> where you replace the
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the path
> to your read_NRL_binary.py script.
>
>
> 2)  Under the [filename_template] section,
>
>  you've set:
>
> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
>
> and you need to set them to something like this example for
converting
> ASCII to netCDF:
>
> # Template to look for input to ASCII2NC relative to
> ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> {INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> # Template to use to write output from
> ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
>
>
> where you replace the full path to read_ascii_point.py to the full
> path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you
> would replace what you
>
> currently have with the full path to your output files, in the
> filename structure you want to use:
>
> e.g.
>
> OBS_MODE_OUTPUT_TEMPLATE =
>
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H
> }_
> 00000000_fcstfld.nc
>
>
> I hope that will at least get you past the "No input fields were
> specified..." errors.  We'll see what new errors we'll encounter
after
> this....
>
>
> Regards,
>
> Minna
>
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 16, 2020 11:49 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I just checked your data directory in the ftp site, whatever you
did
> > worked.  I'll take a look and see if I can get things working
> > without the wrappers and then see what's going on.  This will
> > probably take a
> while.
> > Thanks for your patience while we troubleshoot your issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Here's what I'm getting when I try to drop my files off.
> > >
> > > ftp> put /users/davis/testWrappers/mode.conf
> > > local: /users/davis/testWrappers/mode.conf remote:
> > > /users/davis/testWrappers/mode.conf
> > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > 550 /users/davis/testWrappers/mode.conf: Operation not permitted
> > > ftp> put /users/davis/testWrappers/mode.conf .
> > > local: /users/davis/testWrappers/mode.conf remote: .
> > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > 550 .: Overwrite permission denied
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 16, 2020 9:04 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > file for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I asked our IT for suggestions, since I don't know what else to
try.
> > > I'll let you know if I get any suggestions.
> > >
> > > Thanks,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > I'm getting a lot of "operation not permitted" errors when I
try
> > > > to upload the files.  Can you reply with whether or not the
> > > > files made it over when you get a chance?  Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > Could you also provide a sample data file that you use as
input
> > > > to your Python script, too?
> > > >
> > > > Thanks,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > <minnawin at ucar.edu
> > > > >
> > > > wrote:
> > > >
> > > > > Hello Wesley,
> > > > >
> > > > > Can you provide your Python script that generates the 2D
numpy
> > > > > array representation of your data in addition to the METplus
> > > > > configuration file you are using?  Please follow the
> > > > > instructions at the bottom of this page, under 'How to send
us
> data':
> > > > >
> > > > >
> > > > > https://dtcenter.org/community-code/model-evaluation-tools-
met
> > > > > /m
> > > > > et
> > > > > -h
> > > > > el
> > > > > p-desk
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > > >>        Queue: met_help
> > > > >>      Subject: Formatting my mode config file for METplus
usage
> > > > >>        Owner: Nobody
> > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > >>       Status: new
> > > > >>  Ticket <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >>
> > > > >>
> > > > >> MET Helpdesk,
> > > > >>
> > > > >> According to the METplus User's Guide (
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.h
> > > > tm
> > > > l#
> > > > te
> > > > rm-fcst-mode-input-template
> > > > )
> > > > >> if I wish to use python embedding I need to set the
following
> > > > >> variables
> > > > as
> > > > >> such:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > >>
> > > > >> [
> > > > >> Template used to specify forecast input filenames for the
MET
> > > > >> tool
> > > mode.
> > > > >> A corresponding variable exists for observation data called
> > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > >>
> > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.h
> > > > tm
> > > > l#
> > > > te
> > > > rm-obs-mode-input-template
> > > > >.
> > > > >> To utilize Python Embedding as input to the MET tools, set
> > > > >> this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > >> Used by: MODE
> > > > >> Family: [filename_templates]
> > > > >> Default: Varies
> > > > >>
> > > > >> ]
> > > > >>
> > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > >> following error for each iteration, 36 in total.
> > > > >>
> > > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > > >> You
> > > > must
> > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > >>
> > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > >> use_cases/mode scenario, the METplus config file dealt with
> > > > >> these variables in the following manner:
> > > > >>
> > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=
> > > > >> %H
> > > > >> H}
> > > > >> .n
> > > > >> c
> > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > >>
> > > > >> My variables are all in this format:
> > > > >>
> > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcst
> > > > >> fl
> > > > >> d
> > > > >>
> > > > >> Can you help me figure out how to get my formatting correct
> > > > >> so I can use METplus?
> > > > >>
> > > > >> Thank you!
> > > > >>
> > > > >> Sincerely,
> > > > >>
> > > > >> Wesley Davis
> > > > >> Data Analyst
> > > > >> DeVine Consulting
> > > > >> 831-641-7661 (work)
> > > > >> 808-780-9977 (cell)
> > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > >>
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 23 14:10:10 2020

[davis at lorenz testWrappers]$ master_metplus.py -c testConfig.conf >
whatHappened
10/23 12:48:35.059 jlog (master_metplus.py:62) CRITICAL:
master_metplus  failed: Source contains p'
        [line 62]: 'MET_PYTHON_INPUT_ARG FCST\n'
Traceback (most recent call last):
  File "/users/davis/METplus-3.1/METplus-3.1/ush/master_metplus.py",
line 59, in <module>
    main()
  File "/users/davis/METplus-3.1/METplus-3.1/ush/master_metplus.py",
line 41, in main
    config = pre_run_setup(__file__, 'METplus')
  File "/users/davis/METplus-3.1/METplus-
3.1/metplus/util/met_util.py", line 101, in pre_run_setup
    filename=filebasename)
  File "/users/davis/METplus-3.1/METplus-
3.1/metplus/util/config/config_metplus.py", line 141, in p
    conf = config_launcher.launch(infiles, moreopt, cycle=cycle)
  File "/users/davis/METplus-3.1/METplus-
3.1/metplus/util/config/config_launcher.py", line 203, inh
    conf.read(filename)
  File "/users/davis/METplus-3.1/METplus-3.1/produtil/config.py", line
725, in read
    self._conf.read(source)
  File "/usr/local/Anaconda3-2020.02/lib/python3.7/configparser.py",
line 696, in read
    self._read(fp, filename)
  File "/usr/local/Anaconda3-2020.02/lib/python3.7/configparser.py",
line 1110, in _read
    raise e
configparser.ParsingError: Source contains parsing errors:
'testConfig.conf'
        [line 62]: 'MET_PYTHON_INPUT_ARG FCST\n'
10/23 12:48:35Z run-METplus-CRITICAL:  master_metplus  failed: Source
contains parsing errors: 'te'
        [line 62]: 'MET_PYTHON_INPUT_ARG FCST\n'

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 23 14:10:10 2020

MET_PYTHON_INPUT_ARG FCST

FCST_VAR1_NAME = /path/to/read_NRL_binary.py MET_PYTHON_INPUT_ARG
{INPUT_BASE}
/g{init?fmt=%Y%m%d%H}/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_0{lead?fm
t=%HHH}0000_fcstfld

FCST_VAR1_LEVELS = pre_0000.0

OBS_VAR1_NAME = /path/to/read_NRL_binary.py MET_PYTHON_INPUT_ARG
{INPUT_BASE}/
July2_wind_case/g{init?fmt=%Y%m%d%H}/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%
m%d%H}_00000000_fcstfld

OBS_VAR1_LEVELS = pre_0000.0

FCST_MODE_FILE_WINDOW_BEGIN = 0
FCST_MODE_FILE_WINDOW_END = 0
OBS_MODE_FILE_WINDOW_BEGIN = 0
OBS_MODE_FILE_WINDOW_END = 0

FCST_IS_PROB = false

OBS_IS_PROB = false

FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Tue Oct 27 15:30:58 2020

Hi Wesley,

I'm verifying with another engineer on the METplus config file.
Although I
looked at the output from your read_NRL_binary.py file, I'd also like
to
run it directly from the command line (outside of using the METplus
wrapper).  In order to do so, I'm going to need the MET config file
you
have for running MODE.  Could you please put that in the RAL ftp site?
Instructions are here (at the bottom of the page):

https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 23, 2020 at 2:10 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> I attached the portion of my configuration file that I edited as
well as
> the error it threw.
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 23, 2020 11:02 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I also forgot one more thing, here is a (hopefully) useful link to
the MTD
> Python embedding example (from which I used to compare against your
> mode.conf file, just replaced the MTD with MODE in the config file):
>
>
>
https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper/MTD/MTD_python_embedding.html?highlight=python%20embedding
>
> And based on the sample METplus config file, you should set these in
your
> config files this way (my apologies for my incorrect initial
response):
>
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG
> OBS
> FCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG
> FCST
> FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
> OBS_MODE_INPUT_DATATYPE = PYTHON_NUMPY
>
> Where there is whitespace between the
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> , MET_PYTHON_INPUT_ARG, and  OBS/FCST.
>
> The MET_PYTHON_INPUT_ARG is a constant that is used by the MET
Python
> embedding code, so it is not an environment variable that you need
to set.
>
> Hopefully this clarifies your confusion.  Please let me know how it
goes.
>
> Regards,
> Minna
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Minna,
> >
> > # list of variables to compareFCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG OBS
> >
> > These lines are confusing to me.
> > ----------------------------------------------
> > Do they go like this:
> > # list of variables to compare
> > FCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG OBS
> > --------------------------------------
> > Or like this:
> > # list of variables to compare
> >
> > FCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> >
> > MET_PYTHON_INPUT_ARG FCST
> >
> > OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> >
> > MET_PYTHON_INPUT_ARG OBS
> > --------------------------------------
> >
> > Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
> > Are these environment variables that have been set somewhere else
in the
> code?
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Tuesday, October 20, 2020 2:07 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I ran your Python script on your sample data as a sanity check and
> > that output looks correct.
> >
> > 1) Upon closer inspection of the mode.conf file, it looks like you
are
> > missing these entries under the [config] section:
> >
> > # list of variables to compareFCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG OBS
> > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> > PYTHON_NUMPY
> >
> >
> > where you replace the
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the
path
> > to your read_NRL_binary.py script.
> >
> >
> > 2)  Under the [filename_template] section,
> >
> >  you've set:
> >
> > FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >
> > OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >
> > and you need to set them to something like this example for
converting
> > ASCII to netCDF:
> >
> > # Template to look for input to ASCII2NC relative to
> > ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> > "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> > {INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> > # Template to use to write output from
> > ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> > {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
> >
> >
> > where you replace the full path to read_ascii_point.py to the full
> > path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you
> > would replace what you
> >
> > currently have with the full path to your output files, in the
> > filename structure you want to use:
> >
> > e.g.
> >
> > OBS_MODE_OUTPUT_TEMPLATE =
> >
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H
> > }_
> > 00000000_fcstfld.nc
> >
> >
> > I hope that will at least get you past the "No input fields were
> > specified..." errors.  We'll see what new errors we'll encounter
after
> > this....
> >
> >
> > Regards,
> >
> > Minna
> >
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Thank you!
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 16, 2020 11:49 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I just checked your data directory in the ftp site, whatever you
did
> > > worked.  I'll take a look and see if I can get things working
> > > without the wrappers and then see what's going on.  This will
> > > probably take a
> > while.
> > > Thanks for your patience while we troubleshoot your issue.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > Here's what I'm getting when I try to drop my files off.
> > > >
> > > > ftp> put /users/davis/testWrappers/mode.conf
> > > > local: /users/davis/testWrappers/mode.conf remote:
> > > > /users/davis/testWrappers/mode.conf
> > > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > > 550 /users/davis/testWrappers/mode.conf: Operation not
permitted
> > > > ftp> put /users/davis/testWrappers/mode.conf .
> > > > local: /users/davis/testWrappers/mode.conf remote: .
> > > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > > 550 .: Overwrite permission denied
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Friday, October 16, 2020 9:04 AM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > I asked our IT for suggestions, since I don't know what else
to try.
> > > > I'll let you know if I get any suggestions.
> > > >
> > > > Thanks,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >
> > > > > I'm getting a lot of "operation not permitted" errors when I
try
> > > > > to upload the files.  Can you reply with whether or not the
> > > > > files made it over when you get a chance?  Thank you!
> > > > >
> > > > > Sincerely,
> > > > >
> > > > > Wesley Davis
> > > > > Data Analyst
> > > > > DeVine Consulting
> > > > > 831-641-7661 (work)
> > > > > 808-780-9977 (cell)
> > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > > file for METplus usage
> > > > >
> > > > > Hi Wesley,
> > > > >
> > > > > Could you also provide a sample data file that you use as
input
> > > > > to your Python script, too?
> > > > >
> > > > > Thanks,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > > <minnawin at ucar.edu
> > > > > >
> > > > > wrote:
> > > > >
> > > > > > Hello Wesley,
> > > > > >
> > > > > > Can you provide your Python script that generates the 2D
numpy
> > > > > > array representation of your data in addition to the
METplus
> > > > > > configuration file you are using?  Please follow the
> > > > > > instructions at the bottom of this page, under 'How to
send us
> > data':
> > > > > >
> > > > > >
> > > > > > https://dtcenter.org/community-code/model-evaluation-
tools-met
> > > > > > /m
> > > > > > et
> > > > > > -h
> > > > > > el
> > > > > > p-desk
> > > > > >
> > > > > > Regards,
> > > > > > Minna
> > > > > > ---------------
> > > > > > Minna Win
> > > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > > Center
> > > > > > Phone: 303-497-8423
> > > > > > Fax:   303-497-8401
> > > > > > ---------------
> > > > > > Pronouns: she/her
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
Contractor,
> > > > > > Code
> > > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > > >
> > > > > >>
> > > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > > > >>        Queue: met_help
> > > > > >>      Subject: Formatting my mode config file for METplus
usage
> > > > > >>        Owner: Nobody
> > > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > > >>       Status: new
> > > > > >>  Ticket <URL:
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > > >>
> > > > > >>
> > > > > >> MET Helpdesk,
> > > > > >>
> > > > > >> According to the METplus User's Guide (
> > > > > >>
> > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.h
> > > > > tm
> > > > > l#
> > > > > te
> > > > > rm-fcst-mode-input-template
> > > > > )
> > > > > >> if I wish to use python embedding I need to set the
following
> > > > > >> variables
> > > > > as
> > > > > >> such:
> > > > > >>
> > > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > >>
> > > > > >> [
> > > > > >> Template used to specify forecast input filenames for the
MET
> > > > > >> tool
> > > > mode.
> > > > > >> A corresponding variable exists for observation data
called
> > > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > > >>
> > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary.h
> > > > > tm
> > > > > l#
> > > > > te
> > > > > rm-obs-mode-input-template
> > > > > >.
> > > > > >> To utilize Python Embedding as input to the MET tools,
set
> > > > > >> this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > > >> Used by: MODE
> > > > > >> Family: [filename_templates]
> > > > > >> Default: Varies
> > > > > >>
> > > > > >> ]
> > > > > >>
> > > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > > >> following error for each iteration, 36 in total.
> > > > > >>
> > > > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > > > >> You
> > > > > must
> > > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > > >>
> > > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > > >> use_cases/mode scenario, the METplus config file dealt
with
> > > > > >> these variables in the following manner:
> > > > > >>
> > > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fmt=
> > > > > >> %H
> > > > > >> H}
> > > > > >> .n
> > > > > >> c
> > > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > > >>
> > > > > >> My variables are all in this format:
> > > > > >>
> > > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fcst
> > > > > >> fl
> > > > > >> d
> > > > > >>
> > > > > >> Can you help me figure out how to get my formatting
correct
> > > > > >> so I can use METplus?
> > > > > >>
> > > > > >> Thank you!
> > > > > >>
> > > > > >> Sincerely,
> > > > > >>
> > > > > >> Wesley Davis
> > > > > >> Data Analyst
> > > > > >> DeVine Consulting
> > > > > >> 831-641-7661 (work)
> > > > > >> 808-780-9977 (cell)
> > > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > > >>
> > > > > >>
> > > > > >>
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Tue Oct 27 16:03:17 2020

The config file should be there now.  Just let me know if not though.

Thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Tuesday, October 27, 2020 2:31 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

I'm verifying with another engineer on the METplus config file.
Although I looked at the output from your read_NRL_binary.py file, I'd
also like to run it directly from the command line (outside of using
the METplus wrapper).  In order to do so, I'm going to need the MET
config file you have for running MODE.  Could you please put that in
the RAL ftp site?
Instructions are here (at the bottom of the page):

https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 23, 2020 at 2:10 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> I attached the portion of my configuration file that I edited as
well
> as the error it threw.
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 23, 2020 11:02 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I also forgot one more thing, here is a (hopefully) useful link to
the
> MTD Python embedding example (from which I used to compare against
> your mode.conf file, just replaced the MTD with MODE in the config
file):
>
>
>
https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper/M
> TD/MTD_python_embedding.html?highlight=python%20embedding
>
> And based on the sample METplus config file, you should set these in
> your config files this way (my apologies for my incorrect initial
response):
>
> MET_PYTHON_INPUT_ARG FCST
> OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG
> OBS
> FCST_VAR1_NAME =
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> MET_PYTHON_INPUT_ARG
> FCST
> FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> PYTHON_NUMPY
>
> Where there is whitespace between the
> {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> , MET_PYTHON_INPUT_ARG, and  OBS/FCST.
>
> The MET_PYTHON_INPUT_ARG is a constant that is used by the MET
Python
> embedding code, so it is not an environment variable that you need
to set.
>
> Hopefully this clarifies your confusion.  Please let me know how it
goes.
>
> Regards,
> Minna
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Minna,
> >
> > # list of variables to compareFCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG OBS
> >
> > These lines are confusing to me.
> > ----------------------------------------------
> > Do they go like this:
> > # list of variables to compare
> > FCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG OBS
> > --------------------------------------
> > Or like this:
> > # list of variables to compare
> >
> > FCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> >
> > MET_PYTHON_INPUT_ARG FCST
> >
> > OBS_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> >
> > MET_PYTHON_INPUT_ARG OBS
> > --------------------------------------
> >
> > Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as is?
> > Are these environment variables that have been set somewhere else
in
> > the
> code?
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Tuesday, October 20, 2020 2:07 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I ran your Python script on your sample data as a sanity check and
> > that output looks correct.
> >
> > 1) Upon closer inspection of the mode.conf file, it looks like you
> > are missing these entries under the [config] section:
> >
> > # list of variables to compareFCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG OBS
> > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> > PYTHON_NUMPY
> >
> >
> > where you replace the
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the
path
> > to your read_NRL_binary.py script.
> >
> >
> > 2)  Under the [filename_template] section,
> >
> >  you've set:
> >
> > FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >
> > OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> >
> > and you need to set them to something like this example for
> > converting ASCII to netCDF:
> >
> > # Template to look for input to ASCII2NC relative to
> > ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> > "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> > {INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> > # Template to use to write output from
> > ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> > {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
> >
> >
> > where you replace the full path to read_ascii_point.py to the full
> > path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE, you
> > would replace what you
> >
> > currently have with the full path to your output files, in the
> > filename structure you want to use:
> >
> > e.g.
> >
> > OBS_MODE_OUTPUT_TEMPLATE =
> >
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d
> > %H
> > }_
> > 00000000_fcstfld.nc
> >
> >
> > I hope that will at least get you past the "No input fields were
> > specified..." errors.  We'll see what new errors we'll encounter
> > after this....
> >
> >
> > Regards,
> >
> > Minna
> >
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Thank you!
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 16, 2020 11:49 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > file for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I just checked your data directory in the ftp site, whatever you
> > > did worked.  I'll take a look and see if I can get things
working
> > > without the wrappers and then see what's going on.  This will
> > > probably take a
> > while.
> > > Thanks for your patience while we troubleshoot your issue.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > Here's what I'm getting when I try to drop my files off.
> > > >
> > > > ftp> put /users/davis/testWrappers/mode.conf
> > > > local: /users/davis/testWrappers/mode.conf remote:
> > > > /users/davis/testWrappers/mode.conf
> > > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > > 550 /users/davis/testWrappers/mode.conf: Operation not
permitted
> > > > ftp> put /users/davis/testWrappers/mode.conf .
> > > > local: /users/davis/testWrappers/mode.conf remote: .
> > > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > > 550 .: Overwrite permission denied
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Friday, October 16, 2020 9:04 AM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > I asked our IT for suggestions, since I don't know what else
to try.
> > > > I'll let you know if I get any suggestions.
> > > >
> > > > Thanks,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley, Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
> > > > > >
> > > > >
> > > > > I'm getting a lot of "operation not permitted" errors when I
> > > > > try to upload the files.  Can you reply with whether or not
> > > > > the files made it over when you get a chance?  Thank you!
> > > > >
> > > > > Sincerely,
> > > > >
> > > > > Wesley Davis
> > > > > Data Analyst
> > > > > DeVine Consulting
> > > > > 831-641-7661 (work)
> > > > > 808-780-9977 (cell)
> > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
> > > > > config file for METplus usage
> > > > >
> > > > > Hi Wesley,
> > > > >
> > > > > Could you also provide a sample data file that you use as
> > > > > input to your Python script, too?
> > > > >
> > > > > Thanks,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > > <minnawin at ucar.edu
> > > > > >
> > > > > wrote:
> > > > >
> > > > > > Hello Wesley,
> > > > > >
> > > > > > Can you provide your Python script that generates the 2D
> > > > > > numpy array representation of your data in addition to the
> > > > > > METplus configuration file you are using?  Please follow
the
> > > > > > instructions at the bottom of this page, under 'How to
send
> > > > > > us
> > data':
> > > > > >
> > > > > >
> > > > > > https://dtcenter.org/community-code/model-evaluation-
tools-m
> > > > > > et
> > > > > > /m
> > > > > > et
> > > > > > -h
> > > > > > el
> > > > > > p-desk
> > > > > >
> > > > > > Regards,
> > > > > > Minna
> > > > > > ---------------
> > > > > > Minna Win
> > > > > > National Center for Atmospheric Research Developmental
> > > > > > Testbed Center
> > > > > > Phone: 303-497-8423
> > > > > > Fax:   303-497-8401
> > > > > > ---------------
> > > > > > Pronouns: she/her
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
> > > > > > Contractor, Code
> > > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > > >
> > > > > >>
> > > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > > >> Transaction: Ticket created by
wesley.davis.ctr at nrlmry.navy.mil
> > > > > >>        Queue: met_help
> > > > > >>      Subject: Formatting my mode config file for METplus
usage
> > > > > >>        Owner: Nobody
> > > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > > >>       Status: new
> > > > > >>  Ticket <URL:
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > > >>
> > > > > >>
> > > > > >> MET Helpdesk,
> > > > > >>
> > > > > >> According to the METplus User's Guide (
> > > > > >>
> > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary
> > > > > .h
> > > > > tm
> > > > > l#
> > > > > te
> > > > > rm-fcst-mode-input-template
> > > > > )
> > > > > >> if I wish to use python embedding I need to set the
> > > > > >> following variables
> > > > > as
> > > > > >> such:
> > > > > >>
> > > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > >>
> > > > > >> [
> > > > > >> Template used to specify forecast input filenames for the
> > > > > >> MET tool
> > > > mode.
> > > > > >> A corresponding variable exists for observation data
called
> > > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > > >>
> > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary
> > > > > .h
> > > > > tm
> > > > > l#
> > > > > te
> > > > > rm-obs-mode-input-template
> > > > > >.
> > > > > >> To utilize Python Embedding as input to the MET tools,
set
> > > > > >> this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > > >> Used by: MODE
> > > > > >> Family: [filename_templates]
> > > > > >> Default: Varies
> > > > > >>
> > > > > >> ]
> > > > > >>
> > > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > > >> following error for each iteration, 36 in total.
> > > > > >>
> > > > > >> 10/15 14:41:38.704 metplus.MODE (command_builder.py:122)
ERROR:
> > > > > >> (compare_gridded_wrapper.py:206) No input fields were
specified.
> > > > > >> You
> > > > > must
> > > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > > >>
> > > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > > >> use_cases/mode scenario, the METplus config file dealt
with
> > > > > >> these variables in the following manner:
> > > > > >>
> > > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fm
> > > > > >> t=
> > > > > >> %H
> > > > > >> H}
> > > > > >> .n
> > > > > >> c
> > > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > > >>
> > > > > >> My variables are all in this format:
> > > > > >>
> > > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fc
> > > > > >> st
> > > > > >> fl
> > > > > >> d
> > > > > >>
> > > > > >> Can you help me figure out how to get my formatting
correct
> > > > > >> so I can use METplus?
> > > > > >>
> > > > > >> Thank you!
> > > > > >>
> > > > > >> Sincerely,
> > > > > >>
> > > > > >> Wesley Davis
> > > > > >> Data Analyst
> > > > > >> DeVine Consulting
> > > > > >> 831-641-7661 (work)
> > > > > >> 808-780-9977 (cell)
> > > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > > >>
> > > > > >>
> > > > > >>
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Tue Oct 27 17:11:32 2020

Hi Wesley,

It looks like the ftp didn't work, the directory is empty.  Can you
please
try again?

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Tue, Oct 27, 2020 at 4:03 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> The config file should be there now.  Just let me know if not
though.
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 27, 2020 2:31 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> I'm verifying with another engineer on the METplus config file.
Although
> I looked at the output from your read_NRL_binary.py file, I'd also
like to
> run it directly from the command line (outside of using the METplus
> wrapper).  In order to do so, I'm going to need the MET config file
you
> have for running MODE.  Could you please put that in the RAL ftp
site?
> Instructions are here (at the bottom of the page):
>
>
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 23, 2020 at 2:10 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Minna,
> >
> > I attached the portion of my configuration file that I edited as
well
> > as the error it threw.
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 23, 2020 11:02 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I also forgot one more thing, here is a (hopefully) useful link to
the
> > MTD Python embedding example (from which I used to compare against
> > your mode.conf file, just replaced the MTD with MODE in the config
file):
> >
> >
> >
https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper/M
> > TD/MTD_python_embedding.html?highlight=python%20embedding
> >
> > And based on the sample METplus config file, you should set these
in
> > your config files this way (my apologies for my incorrect initial
> response):
> >
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
{MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG
> > OBS
> > FCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG
> > FCST
> > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> > PYTHON_NUMPY
> >
> > Where there is whitespace between the
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > , MET_PYTHON_INPUT_ARG, and  OBS/FCST.
> >
> > The MET_PYTHON_INPUT_ARG is a constant that is used by the MET
Python
> > embedding code, so it is not an environment variable that you need
to
> set.
> >
> > Hopefully this clarifies your confusion.  Please let me know how
it goes.
> >
> > Regards,
> > Minna
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Minna,
> > >
> > > # list of variables to compareFCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG OBS
> > >
> > > These lines are confusing to me.
> > > ----------------------------------------------
> > > Do they go like this:
> > > # list of variables to compare
> > > FCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG OBS
> > > --------------------------------------
> > > Or like this:
> > > # list of variables to compare
> > >
> > > FCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > >
> > > MET_PYTHON_INPUT_ARG FCST
> > >
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > >
> > > MET_PYTHON_INPUT_ARG OBS
> > > --------------------------------------
> > >
> > > Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as
is?
> > > Are these environment variables that have been set somewhere
else in
> > > the
> > code?
> > >
> > > Thank you!
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Tuesday, October 20, 2020 2:07 PM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I ran your Python script on your sample data as a sanity check
and
> > > that output looks correct.
> > >
> > > 1) Upon closer inspection of the mode.conf file, it looks like
you
> > > are missing these entries under the [config] section:
> > >
> > > # list of variables to compareFCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG OBS
> > > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE
=
> > > PYTHON_NUMPY
> > >
> > >
> > > where you replace the
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the
path
> > > to your read_NRL_binary.py script.
> > >
> > >
> > > 2)  Under the [filename_template] section,
> > >
> > >  you've set:
> > >
> > > FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > >
> > > OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > >
> > > and you need to set them to something like this example for
> > > converting ASCII to netCDF:
> > >
> > > # Template to look for input to ASCII2NC relative to
> > > ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> > > "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> > >
{INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> > > # Template to use to write output from
> > > ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> > > {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
> > >
> > >
> > > where you replace the full path to read_ascii_point.py to the
full
> > > path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE,
you
> > > would replace what you
> > >
> > > currently have with the full path to your output files, in the
> > > filename structure you want to use:
> > >
> > > e.g.
> > >
> > > OBS_MODE_OUTPUT_TEMPLATE =
> > >
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d
> > > %H
> > > }_
> > > 00000000_fcstfld.nc
> > >
> > >
> > > I hope that will at least get you past the "No input fields were
> > > specified..." errors.  We'll see what new errors we'll encounter
> > > after this....
> > >
> > >
> > > Regards,
> > >
> > > Minna
> > >
> > >
> > >
> > >
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Friday, October 16, 2020 11:49 AM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > I just checked your data directory in the ftp site, whatever
you
> > > > did worked.  I'll take a look and see if I can get things
working
> > > > without the wrappers and then see what's going on.  This will
> > > > probably take a
> > > while.
> > > > Thanks for your patience while we troubleshoot your issue.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley,
Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >
> > > > > Here's what I'm getting when I try to drop my files off.
> > > > >
> > > > > ftp> put /users/davis/testWrappers/mode.conf
> > > > > local: /users/davis/testWrappers/mode.conf remote:
> > > > > /users/davis/testWrappers/mode.conf
> > > > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > > > 550 /users/davis/testWrappers/mode.conf: Operation not
permitted
> > > > > ftp> put /users/davis/testWrappers/mode.conf .
> > > > > local: /users/davis/testWrappers/mode.conf remote: .
> > > > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > > > 550 .: Overwrite permission denied
> > > > >
> > > > > Sincerely,
> > > > >
> > > > > Wesley Davis
> > > > > Data Analyst
> > > > > DeVine Consulting
> > > > > 831-641-7661 (work)
> > > > > 808-780-9977 (cell)
> > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > Sent: Friday, October 16, 2020 9:04 AM
> > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > > file for METplus usage
> > > > >
> > > > > Hi Wesley,
> > > > >
> > > > > I asked our IT for suggestions, since I don't know what else
to
> try.
> > > > > I'll let you know if I get any suggestions.
> > > > >
> > > > > Thanks,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
> > > > > > >
> > > > > >
> > > > > > I'm getting a lot of "operation not permitted" errors when
I
> > > > > > try to upload the files.  Can you reply with whether or
not
> > > > > > the files made it over when you get a chance?  Thank you!
> > > > > >
> > > > > > Sincerely,
> > > > > >
> > > > > > Wesley Davis
> > > > > > Data Analyst
> > > > > > DeVine Consulting
> > > > > > 831-641-7661 (work)
> > > > > > 808-780-9977 (cell)
> > > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
> > > > > > config file for METplus usage
> > > > > >
> > > > > > Hi Wesley,
> > > > > >
> > > > > > Could you also provide a sample data file that you use as
> > > > > > input to your Python script, too?
> > > > > >
> > > > > > Thanks,
> > > > > > Minna
> > > > > > ---------------
> > > > > > Minna Win
> > > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > > Center
> > > > > > Phone: 303-497-8423
> > > > > > Fax:   303-497-8401
> > > > > > ---------------
> > > > > > Pronouns: she/her
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > > > <minnawin at ucar.edu
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hello Wesley,
> > > > > > >
> > > > > > > Can you provide your Python script that generates the 2D
> > > > > > > numpy array representation of your data in addition to
the
> > > > > > > METplus configuration file you are using?  Please follow
the
> > > > > > > instructions at the bottom of this page, under 'How to
send
> > > > > > > us
> > > data':
> > > > > > >
> > > > > > >
> > > > > > > https://dtcenter.org/community-code/model-evaluation-
tools-m
> > > > > > > et
> > > > > > > /m
> > > > > > > et
> > > > > > > -h
> > > > > > > el
> > > > > > > p-desk
> > > > > > >
> > > > > > > Regards,
> > > > > > > Minna
> > > > > > > ---------------
> > > > > > > Minna Win
> > > > > > > National Center for Atmospheric Research Developmental
> > > > > > > Testbed Center
> > > > > > > Phone: 303-497-8423
> > > > > > > Fax:   303-497-8401
> > > > > > > ---------------
> > > > > > > Pronouns: she/her
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
> > > > > > > Contractor, Code
> > > > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >>
> > > > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > > > >> Transaction: Ticket created by
> wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >>        Queue: met_help
> > > > > > >>      Subject: Formatting my mode config file for
METplus usage
> > > > > > >>        Owner: Nobody
> > > > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >>       Status: new
> > > > > > >>  Ticket <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > > > > >>
> > > > > > >>
> > > > > > >> MET Helpdesk,
> > > > > > >>
> > > > > > >> According to the METplus User's Guide (
> > > > > > >>
> > > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary
> > > > > > .h
> > > > > > tm
> > > > > > l#
> > > > > > te
> > > > > > rm-fcst-mode-input-template
> > > > > > )
> > > > > > >> if I wish to use python embedding I need to set the
> > > > > > >> following variables
> > > > > > as
> > > > > > >> such:
> > > > > > >>
> > > > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > > >>
> > > > > > >> [
> > > > > > >> Template used to specify forecast input filenames for
the
> > > > > > >> MET tool
> > > > > mode.
> > > > > > >> A corresponding variable exists for observation data
called
> > > > > > >> OBS_MODE_INPUT_TEMPLATE<
> > > > > > >>
> > > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossary
> > > > > > .h
> > > > > > tm
> > > > > > l#
> > > > > > te
> > > > > > rm-obs-mode-input-template
> > > > > > >.
> > > > > > >> To utilize Python Embedding as input to the MET tools,
set
> > > > > > >> this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > > > >> Used by: MODE
> > > > > > >> Family: [filename_templates]
> > > > > > >> Default: Varies
> > > > > > >>
> > > > > > >> ]
> > > > > > >>
> > > > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > > > >> following error for each iteration, 36 in total.
> > > > > > >>
> > > > > > >> 10/15 14:41:38.704 metplus.MODE
(command_builder.py:122)
> ERROR:
> > > > > > >> (compare_gridded_wrapper.py:206) No input fields were
> specified.
> > > > > > >> You
> > > > > > must
> > > > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > > > >>
> > > > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > > > >> use_cases/mode scenario, the METplus config file dealt
with
> > > > > > >> these variables in the following manner:
> > > > > > >>
> > > > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?fm
> > > > > > >> t=
> > > > > > >> %H
> > > > > > >> H}
> > > > > > >> .n
> > > > > > >> c
> > > > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > > > >>
> > > > > > >> My variables are all in this format:
> > > > > > >>
> > > > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_fc
> > > > > > >> st
> > > > > > >> fl
> > > > > > >> d
> > > > > > >>
> > > > > > >> Can you help me figure out how to get my formatting
correct
> > > > > > >> so I can use METplus?
> > > > > > >>
> > > > > > >> Thank you!
> > > > > > >>
> > > > > > >> Sincerely,
> > > > > > >>
> > > > > > >> Wesley Davis
> > > > > > >> Data Analyst
> > > > > > >> DeVine Consulting
> > > > > > >> 831-641-7661 (work)
> > > > > > >> 808-780-9977 (cell)
> > > > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Wed Oct 28 10:23:30 2020

Minna,

Sorry about that, the file should be there now.  Thank you!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Tuesday, October 27, 2020 4:12 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

It looks like the ftp didn't work, the directory is empty.  Can you
please try again?

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Tue, Oct 27, 2020 at 4:03 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> The config file should be there now.  Just let me know if not
though.
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 27, 2020 2:31 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> I'm verifying with another engineer on the METplus config file.
> Although I looked at the output from your read_NRL_binary.py file,
I'd
> also like to run it directly from the command line (outside of using
> the METplus wrapper).  In order to do so, I'm going to need the MET
> config file you have for running MODE.  Could you please put that in
the RAL ftp site?
> Instructions are here (at the bottom of the page):
>
>
>
> https://dtcenter.org/community-code/model-evaluation-tools-met/met-
hel
> p-desk
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 23, 2020 at 2:10 PM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Minna,
> >
> > I attached the portion of my configuration file that I edited as
> > well as the error it threw.
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, October 23, 2020 11:02 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I also forgot one more thing, here is a (hopefully) useful link to
> > the MTD Python embedding example (from which I used to compare
> > against your mode.conf file, just replaced the MTD with MODE in
the config file):
> >
> >
> >
https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper
> > /M TD/MTD_python_embedding.html?highlight=python%20embedding
> >
> > And based on the sample METplus config file, you should set these
in
> > your config files this way (my apologies for my incorrect initial
> response):
> >
> > MET_PYTHON_INPUT_ARG FCST
> > OBS_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG
> > OBS
> > FCST_VAR1_NAME =
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > MET_PYTHON_INPUT_ARG
> > FCST
> > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE =
> > PYTHON_NUMPY
> >
> > Where there is whitespace between the
> > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > , MET_PYTHON_INPUT_ARG, and  OBS/FCST.
> >
> > The MET_PYTHON_INPUT_ARG is a constant that is used by the MET
> > Python embedding code, so it is not an environment variable that
you
> > need to
> set.
> >
> > Hopefully this clarifies your confusion.  Please let me know how
it goes.
> >
> > Regards,
> > Minna
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Minna,
> > >
> > > # list of variables to compareFCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG OBS
> > >
> > > These lines are confusing to me.
> > > ----------------------------------------------
> > > Do they go like this:
> > > # list of variables to compare
> > > FCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG OBS
> > > --------------------------------------
> > > Or like this:
> > > # list of variables to compare
> > >
> > > FCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > >
> > > MET_PYTHON_INPUT_ARG FCST
> > >
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > >
> > > MET_PYTHON_INPUT_ARG OBS
> > > --------------------------------------
> > >
> > > Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as
is?
> > > Are these environment variables that have been set somewhere
else
> > > in the
> > code?
> > >
> > > Thank you!
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Tuesday, October 20, 2020 2:07 PM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > file for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I ran your Python script on your sample data as a sanity check
and
> > > that output looks correct.
> > >
> > > 1) Upon closer inspection of the mode.conf file, it looks like
you
> > > are missing these entries under the [config] section:
> > >
> > > # list of variables to compareFCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG OBS
> > > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE
=
> > > PYTHON_NUMPY
> > >
> > >
> > > where you replace the
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with the
> > > path to your read_NRL_binary.py script.
> > >
> > >
> > > 2)  Under the [filename_template] section,
> > >
> > >  you've set:
> > >
> > > FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > >
> > > OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > >
> > > and you need to set them to something like this example for
> > > converting ASCII to netCDF:
> > >
> > > # Template to look for input to ASCII2NC relative to
> > > ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> > > "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> > >
{INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> > > # Template to use to write output from
> > > ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> > > {OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
> > >
> > >
> > > where you replace the full path to read_ascii_point.py to the
full
> > > path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE,
you
> > > would replace what you
> > >
> > > currently have with the full path to your output files, in the
> > > filename structure you want to use:
> > >
> > > e.g.
> > >
> > > OBS_MODE_OUTPUT_TEMPLATE =
> > >
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m
> > > %d
> > > %H
> > > }_
> > > 00000000_fcstfld.nc
> > >
> > >
> > > I hope that will at least get you past the "No input fields were
> > > specified..." errors.  We'll see what new errors we'll encounter
> > > after this....
> > >
> > >
> > > Regards,
> > >
> > > Minna
> > >
> > >
> > >
> > >
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Friday, October 16, 2020 11:49 AM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > I just checked your data directory in the ftp site, whatever
you
> > > > did worked.  I'll take a look and see if I can get things
> > > > working without the wrappers and then see what's going on.
This
> > > > will probably take a
> > > while.
> > > > Thanks for your patience while we troubleshoot your issue.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley,
Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
> > > > > >
> > > > >
> > > > > Here's what I'm getting when I try to drop my files off.
> > > > >
> > > > > ftp> put /users/davis/testWrappers/mode.conf
> > > > > local: /users/davis/testWrappers/mode.conf remote:
> > > > > /users/davis/testWrappers/mode.conf
> > > > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > > > 550 /users/davis/testWrappers/mode.conf: Operation not
> > > > > permitted
> > > > > ftp> put /users/davis/testWrappers/mode.conf .
> > > > > local: /users/davis/testWrappers/mode.conf remote: .
> > > > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > > > 550 .: Overwrite permission denied
> > > > >
> > > > > Sincerely,
> > > > >
> > > > > Wesley Davis
> > > > > Data Analyst
> > > > > DeVine Consulting
> > > > > 831-641-7661 (work)
> > > > > 808-780-9977 (cell)
> > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > Sent: Friday, October 16, 2020 9:04 AM
> > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
> > > > > config file for METplus usage
> > > > >
> > > > > Hi Wesley,
> > > > >
> > > > > I asked our IT for suggestions, since I don't know what else
> > > > > to
> try.
> > > > > I'll let you know if I get any suggestions.
> > > > >
> > > > > Thanks,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
> > > > > > >
> > > > > >
> > > > > > I'm getting a lot of "operation not permitted" errors when
I
> > > > > > try to upload the files.  Can you reply with whether or
not
> > > > > > the files made it over when you get a chance?  Thank you!
> > > > > >
> > > > > > Sincerely,
> > > > > >
> > > > > > Wesley Davis
> > > > > > Data Analyst
> > > > > > DeVine Consulting
> > > > > > 831-641-7661 (work)
> > > > > > 808-780-9977 (cell)
> > > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
> > > > > > config file for METplus usage
> > > > > >
> > > > > > Hi Wesley,
> > > > > >
> > > > > > Could you also provide a sample data file that you use as
> > > > > > input to your Python script, too?
> > > > > >
> > > > > > Thanks,
> > > > > > Minna
> > > > > > ---------------
> > > > > > Minna Win
> > > > > > National Center for Atmospheric Research Developmental
> > > > > > Testbed Center
> > > > > > Phone: 303-497-8423
> > > > > > Fax:   303-497-8401
> > > > > > ---------------
> > > > > > Pronouns: she/her
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > > > <minnawin at ucar.edu
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hello Wesley,
> > > > > > >
> > > > > > > Can you provide your Python script that generates the 2D
> > > > > > > numpy array representation of your data in addition to
the
> > > > > > > METplus configuration file you are using?  Please follow
> > > > > > > the instructions at the bottom of this page, under 'How
to
> > > > > > > send us
> > > data':
> > > > > > >
> > > > > > >
> > > > > > > https://dtcenter.org/community-code/model-evaluation-
tools
> > > > > > > -m
> > > > > > > et
> > > > > > > /m
> > > > > > > et
> > > > > > > -h
> > > > > > > el
> > > > > > > p-desk
> > > > > > >
> > > > > > > Regards,
> > > > > > > Minna
> > > > > > > ---------------
> > > > > > > Minna Win
> > > > > > > National Center for Atmospheric Research Developmental
> > > > > > > Testbed Center
> > > > > > > Phone: 303-497-8423
> > > > > > > Fax:   303-497-8401
> > > > > > > ---------------
> > > > > > > Pronouns: she/her
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
> > > > > > > Contractor, Code
> > > > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >>
> > > > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted upon.
> > > > > > >> Transaction: Ticket created by
> wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >>        Queue: met_help
> > > > > > >>      Subject: Formatting my mode config file for
METplus usage
> > > > > > >>        Owner: Nobody
> > > > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >>       Status: new
> > > > > > >>  Ticket <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > > > > >>
> > > > > > >>
> > > > > > >> MET Helpdesk,
> > > > > > >>
> > > > > > >> According to the METplus User's Guide (
> > > > > > >>
> > > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossa
> > > > > > ry
> > > > > > .h
> > > > > > tm
> > > > > > l#
> > > > > > te
> > > > > > rm-fcst-mode-input-template
> > > > > > )
> > > > > > >> if I wish to use python embedding I need to set the
> > > > > > >> following variables
> > > > > > as
> > > > > > >> such:
> > > > > > >>
> > > > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > > >>
> > > > > > >> [
> > > > > > >> Template used to specify forecast input filenames for
the
> > > > > > >> MET tool
> > > > > mode.
> > > > > > >> A corresponding variable exists for observation data
> > > > > > >> called OBS_MODE_INPUT_TEMPLATE<
> > > > > > >>
> > > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossa
> > > > > > ry
> > > > > > .h
> > > > > > tm
> > > > > > l#
> > > > > > te
> > > > > > rm-obs-mode-input-template
> > > > > > >.
> > > > > > >> To utilize Python Embedding as input to the MET tools,
> > > > > > >> set this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > > > >> Used by: MODE
> > > > > > >> Family: [filename_templates]
> > > > > > >> Default: Varies
> > > > > > >>
> > > > > > >> ]
> > > > > > >>
> > > > > > >> After running: master_metplus.py -c mode.conf I got the
> > > > > > >> following error for each iteration, 36 in total.
> > > > > > >>
> > > > > > >> 10/15 14:41:38.704 metplus.MODE
(command_builder.py:122)
> ERROR:
> > > > > > >> (compare_gridded_wrapper.py:206) No input fields were
> specified.
> > > > > > >> You
> > > > > > must
> > > > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > > > >>
> > > > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > > > >> use_cases/mode scenario, the METplus config file dealt
> > > > > > >> with these variables in the following manner:
> > > > > > >>
> > > > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?
> > > > > > >> fm
> > > > > > >> t=
> > > > > > >> %H
> > > > > > >> H}
> > > > > > >> .n
> > > > > > >> c
> > > > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > > > >>
> > > > > > >> My variables are all in this format:
> > > > > > >>
> > > > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_
> > > > > > >> fc
> > > > > > >> st
> > > > > > >> fl
> > > > > > >> d
> > > > > > >>
> > > > > > >> Can you help me figure out how to get my formatting
> > > > > > >> correct so I can use METplus?
> > > > > > >>
> > > > > > >> Thank you!
> > > > > > >>
> > > > > > >> Sincerely,
> > > > > > >>
> > > > > > >> Wesley Davis
> > > > > > >> Data Analyst
> > > > > > >> DeVine Consulting
> > > > > > >> 831-641-7661 (work)
> > > > > > >> 808-780-9977 (cell)
> > > > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Wed Oct 28 11:22:00 2020

Got it, I'll resume troubleshooting.

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Wed, Oct 28, 2020 at 10:38 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> Sorry about that, the file should be there now.  Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, October 27, 2020 4:12 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> It looks like the ftp didn't work, the directory is empty.  Can you
please
> try again?
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Tue, Oct 27, 2020 at 4:03 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > The config file should be there now.  Just let me know if not
though.
> >
> > Thank you!
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Tuesday, October 27, 2020 2:31 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > I'm verifying with another engineer on the METplus config file.
> > Although I looked at the output from your read_NRL_binary.py file,
I'd
> > also like to run it directly from the command line (outside of
using
> > the METplus wrapper).  In order to do so, I'm going to need the
MET
> > config file you have for running MODE.  Could you please put that
in the
> RAL ftp site?
> > Instructions are here (at the bottom of the page):
> >
> >
> >
> > https://dtcenter.org/community-code/model-evaluation-tools-
met/met-hel
> > p-desk
> >
> > Thanks,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 23, 2020 at 2:10 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Minna,
> > >
> > > I attached the portion of my configuration file that I edited as
> > > well as the error it threw.
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, October 23, 2020 11:02 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > I also forgot one more thing, here is a (hopefully) useful link
to
> > > the MTD Python embedding example (from which I used to compare
> > > against your mode.conf file, just replaced the MTD with MODE in
the
> config file):
> > >
> > >
> > >
https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper
> > > /M TD/MTD_python_embedding.html?highlight=python%20embedding
> > >
> > > And based on the sample METplus config file, you should set
these in
> > > your config files this way (my apologies for my incorrect
initial
> > response):
> > >
> > > MET_PYTHON_INPUT_ARG FCST
> > > OBS_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG
> > > OBS
> > > FCST_VAR1_NAME =
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > MET_PYTHON_INPUT_ARG
> > > FCST
> > > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY OBS_MODE_INPUT_DATATYPE
=
> > > PYTHON_NUMPY
> > >
> > > Where there is whitespace between the
> > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > , MET_PYTHON_INPUT_ARG, and  OBS/FCST.
> > >
> > > The MET_PYTHON_INPUT_ARG is a constant that is used by the MET
> > > Python embedding code, so it is not an environment variable that
you
> > > need to
> > set.
> > >
> > > Hopefully this clarifies your confusion.  Please let me know how
it
> goes.
> > >
> > > Regards,
> > > Minna
> > >
> > >
> > >
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, Oct 22, 2020 at 11:21 AM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >
> > > > Minna,
> > > >
> > > > # list of variables to compareFCST_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > > MET_PYTHON_INPUT_ARG FCST
> > > > OBS_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > > MET_PYTHON_INPUT_ARG OBS
> > > >
> > > > These lines are confusing to me.
> > > > ----------------------------------------------
> > > > Do they go like this:
> > > > # list of variables to compare
> > > > FCST_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > > MET_PYTHON_INPUT_ARG FCST
> > > > OBS_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > > MET_PYTHON_INPUT_ARG OBS
> > > > --------------------------------------
> > > > Or like this:
> > > > # list of variables to compare
> > > >
> > > > FCST_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > >
> > > > MET_PYTHON_INPUT_ARG FCST
> > > >
> > > > OBS_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > >
> > > > MET_PYTHON_INPUT_ARG OBS
> > > > --------------------------------------
> > > >
> > > > Also, should MET_PYTHON_INPUT_ARG FCST/OBS be just typed in as
is?
> > > > Are these environment variables that have been set somewhere
else
> > > > in the
> > > code?
> > > >
> > > > Thank you!
> > > >
> > > > Sincerely,
> > > >
> > > > Wesley Davis
> > > > Data Analyst
> > > > DeVine Consulting
> > > > 831-641-7661 (work)
> > > > 808-780-9977 (cell)
> > > > wesley.davis.ctr at nrlmry.navy.mil
> > > >
> > > > -----Original Message-----
> > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > Sent: Tuesday, October 20, 2020 2:07 PM
> > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > file for METplus usage
> > > >
> > > > Hi Wesley,
> > > >
> > > > I ran your Python script on your sample data as a sanity check
and
> > > > that output looks correct.
> > > >
> > > > 1) Upon closer inspection of the mode.conf file, it looks like
you
> > > > are missing these entries under the [config] section:
> > > >
> > > > # list of variables to compareFCST_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > > MET_PYTHON_INPUT_ARG FCST
> > > > OBS_VAR1_NAME =
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py
> > > > MET_PYTHON_INPUT_ARG OBS
> > > > FCST_MODE_INPUT_DATATYPE = PYTHON_NUMPY
OBS_MODE_INPUT_DATATYPE =
> > > > PYTHON_NUMPY
> > > >
> > > >
> > > > where you replace the
> > > > {MET_INSTALL_DIR}/share/met/python/read_ascii_numpy.py with
the
> > > > path to your read_NRL_binary.py script.
> > > >
> > > >
> > > > 2)  Under the [filename_template] section,
> > > >
> > > >  you've set:
> > > >
> > > > FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > >
> > > > OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > >
> > > > and you need to set them to something like this example for
> > > > converting ASCII to netCDF:
> > > >
> > > > # Template to look for input to ASCII2NC relative to
> > > > ASCII2NC_INPUT_DIRASCII2NC_INPUT_TEMPLATE =
> > > > "{MET_INSTALL_DIR}/share/met/python/read_ascii_point.py
> > > >
{INPUT_BASE}/met_test/data/sample_obs/ascii/sample_ascii_obs.txt"
> > > > # Template to use to write output from
> > > > ASCII2NCASCII2NC_OUTPUT_TEMPLATE =
> > > >
{OUTPUT_BASE}/met_tool_wrapper/ASCII2NC/ascii2nc_python_user.nc
> > > >
> > > >
> > > > where you replace the full path to read_ascii_point.py to the
full
> > > > path to read_NRL_binary.py. For the OBS_MODE_OUTPUT_TEMPLATE,
you
> > > > would replace what you
> > > >
> > > > currently have with the full path to your output files, in the
> > > > filename structure you want to use:
> > > >
> > > > e.g.
> > > >
> > > > OBS_MODE_OUTPUT_TEMPLATE =
> > > >
{OUTPUT_BASE}/lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m
> > > > %d
> > > > %H
> > > > }_
> > > > 00000000_fcstfld.nc
> > > >
> > > >
> > > > I hope that will at least get you past the "No input fields
were
> > > > specified..." errors.  We'll see what new errors we'll
encounter
> > > > after this....
> > > >
> > > >
> > > > Regards,
> > > >
> > > > Minna
> > > >
> > > >
> > > >
> > > >
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Fri, Oct 16, 2020 at 12:50 PM Davis, Mr. Wesley,
Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > >
> > > > > Thank you!
> > > > >
> > > > > Sincerely,
> > > > >
> > > > > Wesley Davis
> > > > > Data Analyst
> > > > > DeVine Consulting
> > > > > 831-641-7661 (work)
> > > > > 808-780-9977 (cell)
> > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > Sent: Friday, October 16, 2020 11:49 AM
> > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
config
> > > > > file for METplus usage
> > > > >
> > > > > Hi Wesley,
> > > > >
> > > > > I just checked your data directory in the ftp site, whatever
you
> > > > > did worked.  I'll take a look and see if I can get things
> > > > > working without the wrappers and then see what's going on.
This
> > > > > will probably take a
> > > > while.
> > > > > Thanks for your patience while we troubleshoot your issue.
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > Center
> > > > > Phone: 303-497-8423
> > > > > Fax:   303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Fri, Oct 16, 2020 at 10:53 AM Davis, Mr. Wesley,
Contractor,
> > > > > Code
> > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
> > > > > > >
> > > > > >
> > > > > > Here's what I'm getting when I try to drop my files off.
> > > > > >
> > > > > > ftp> put /users/davis/testWrappers/mode.conf
> > > > > > local: /users/davis/testWrappers/mode.conf remote:
> > > > > > /users/davis/testWrappers/mode.conf
> > > > > > 227 Entering Passive Mode (128,117,14,132,196,234).
> > > > > > 550 /users/davis/testWrappers/mode.conf: Operation not
> > > > > > permitted
> > > > > > ftp> put /users/davis/testWrappers/mode.conf .
> > > > > > local: /users/davis/testWrappers/mode.conf remote: .
> > > > > > 227 Entering Passive Mode (128,117,14,132,196,227).
> > > > > > 550 .: Overwrite permission denied
> > > > > >
> > > > > > Sincerely,
> > > > > >
> > > > > > Wesley Davis
> > > > > > Data Analyst
> > > > > > DeVine Consulting
> > > > > > 831-641-7661 (work)
> > > > > > 808-780-9977 (cell)
> > > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > > Sent: Friday, October 16, 2020 9:04 AM
> > > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
> > > > > > config file for METplus usage
> > > > > >
> > > > > > Hi Wesley,
> > > > > >
> > > > > > I asked our IT for suggestions, since I don't know what
else
> > > > > > to
> > try.
> > > > > > I'll let you know if I get any suggestions.
> > > > > >
> > > > > > Thanks,
> > > > > > Minna
> > > > > > ---------------
> > > > > > Minna Win
> > > > > > National Center for Atmospheric Research Developmental
Testbed
> > > > > > Center
> > > > > > Phone: 303-497-8423
> > > > > > Fax:   303-497-8401
> > > > > > ---------------
> > > > > > Pronouns: she/her
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 15, 2020 at 6:50 PM Davis, Mr. Wesley,
Contractor,
> > > > > > Code
> > > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
> > > > > > > >
> > > > > > >
> > > > > > > I'm getting a lot of "operation not permitted" errors
when I
> > > > > > > try to upload the files.  Can you reply with whether or
not
> > > > > > > the files made it over when you get a chance?  Thank
you!
> > > > > > >
> > > > > > > Sincerely,
> > > > > > >
> > > > > > > Wesley Davis
> > > > > > > Data Analyst
> > > > > > > DeVine Consulting
> > > > > > > 831-641-7661 (work)
> > > > > > > 808-780-9977 (cell)
> > > > > > > wesley.davis.ctr at nrlmry.navy.mil
> > > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Minna Win via RT <met_help at ucar.edu>
> > > > > > > Sent: Thursday, October 15, 2020 5:02 PM
> > > > > > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > > > > > wesley.davis.ctr at nrlmry.navy.mil>
> > > > > > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode
> > > > > > > config file for METplus usage
> > > > > > >
> > > > > > > Hi Wesley,
> > > > > > >
> > > > > > > Could you also provide a sample data file that you use
as
> > > > > > > input to your Python script, too?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Minna
> > > > > > > ---------------
> > > > > > > Minna Win
> > > > > > > National Center for Atmospheric Research Developmental
> > > > > > > Testbed Center
> > > > > > > Phone: 303-497-8423
> > > > > > > Fax:   303-497-8401
> > > > > > > ---------------
> > > > > > > Pronouns: she/her
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Oct 15, 2020 at 6:00 PM Minna Win-Gildenmeister
> > > > > > > <minnawin at ucar.edu
> > > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hello Wesley,
> > > > > > > >
> > > > > > > > Can you provide your Python script that generates the
2D
> > > > > > > > numpy array representation of your data in addition to
the
> > > > > > > > METplus configuration file you are using?  Please
follow
> > > > > > > > the instructions at the bottom of this page, under
'How to
> > > > > > > > send us
> > > > data':
> > > > > > > >
> > > > > > > >
> > > > > > > > https://dtcenter.org/community-code/model-evaluation-
tools
> > > > > > > > -m
> > > > > > > > et
> > > > > > > > /m
> > > > > > > > et
> > > > > > > > -h
> > > > > > > > el
> > > > > > > > p-desk
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Minna
> > > > > > > > ---------------
> > > > > > > > Minna Win
> > > > > > > > National Center for Atmospheric Research Developmental
> > > > > > > > Testbed Center
> > > > > > > > Phone: 303-497-8423
> > > > > > > > Fax:   303-497-8401
> > > > > > > > ---------------
> > > > > > > > Pronouns: she/her
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thu, Oct 15, 2020 at 5:29 PM Davis, Mr. Wesley,
> > > > > > > > Contractor, Code
> > > > > > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > >>
> > > > > > > >> Thu Oct 15 17:29:33 2020: Request 97100 was acted
upon.
> > > > > > > >> Transaction: Ticket created by
> > wesley.davis.ctr at nrlmry.navy.mil
> > > > > > > >>        Queue: met_help
> > > > > > > >>      Subject: Formatting my mode config file for
METplus
> usage
> > > > > > > >>        Owner: Nobody
> > > > > > > >>   Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > > > > > > >>       Status: new
> > > > > > > >>  Ticket <URL:
> > > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> MET Helpdesk,
> > > > > > > >>
> > > > > > > >> According to the METplus User's Guide (
> > > > > > > >>
> > > > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossa
> > > > > > > ry
> > > > > > > .h
> > > > > > > tm
> > > > > > > l#
> > > > > > > te
> > > > > > > rm-fcst-mode-input-template
> > > > > > > )
> > > > > > > >> if I wish to use python embedding I need to set the
> > > > > > > >> following variables
> > > > > > > as
> > > > > > > >> such:
> > > > > > > >>
> > > > > > > >> FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > > > >> OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
> > > > > > > >>
> > > > > > > >> [
> > > > > > > >> Template used to specify forecast input filenames for
the
> > > > > > > >> MET tool
> > > > > > mode.
> > > > > > > >> A corresponding variable exists for observation data
> > > > > > > >> called OBS_MODE_INPUT_TEMPLATE<
> > > > > > > >>
> > > > > > >
https://dtcenter.github.io/METplus/latest/Users_Guide/glossa
> > > > > > > ry
> > > > > > > .h
> > > > > > > tm
> > > > > > > l#
> > > > > > > te
> > > > > > > rm-obs-mode-input-template
> > > > > > > >.
> > > > > > > >> To utilize Python Embedding as input to the MET
tools,
> > > > > > > >> set this value to PYTHON_NUMPY or PYTHON_XARRAY.
> > > > > > > >> Used by: MODE
> > > > > > > >> Family: [filename_templates]
> > > > > > > >> Default: Varies
> > > > > > > >>
> > > > > > > >> ]
> > > > > > > >>
> > > > > > > >> After running: master_metplus.py -c mode.conf I got
the
> > > > > > > >> following error for each iteration, 36 in total.
> > > > > > > >>
> > > > > > > >> 10/15 14:41:38.704 metplus.MODE
(command_builder.py:122)
> > ERROR:
> > > > > > > >> (compare_gridded_wrapper.py:206) No input fields were
> > specified.
> > > > > > > >> You
> > > > > > > must
> > > > > > > >> set [FCST/OBS]_VAR<n>_[NAME/LEVELS].
> > > > > > > >>
> > > > > > > >> In the tutorial files for MET 2.2 I saw that for the
> > > > > > > >> use_cases/mode scenario, the METplus config file
dealt
> > > > > > > >> with these variables in the following manner:
> > > > > > > >>
> > > > > > > >> FCST_MODE_INPUT_TEMPLATE =
> > > > > > > >>
{valid?fmt=%Y%m%d}/hrefmean_{valid?fmt=%Y%m%d%H}_A{level?
> > > > > > > >> fm
> > > > > > > >> t=
> > > > > > > >> %H
> > > > > > > >> H}
> > > > > > > >> .n
> > > > > > > >> c
> > > > > > > >> OBS_MODE_INPUT_TEMPLATE =
> > > > > > > >> {valid?fmt=%Y%m%d}/mrms_qpe_{valid?fmt=%Y%m%d%H}.nc
> > > > > > > >>
> > > > > > > >> My variables are all in this format:
> > > > > > > >>
> > > > > > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070306_00000000_
> > > > > > > >> fc
> > > > > > > >> st
> > > > > > > >> fl
> > > > > > > >> d
> > > > > > > >>
> > > > > > > >> Can you help me figure out how to get my formatting
> > > > > > > >> correct so I can use METplus?
> > > > > > > >>
> > > > > > > >> Thank you!
> > > > > > > >>
> > > > > > > >> Sincerely,
> > > > > > > >>
> > > > > > > >> Wesley Davis
> > > > > > > >> Data Analyst
> > > > > > > >> DeVine Consulting
> > > > > > > >> 831-641-7661 (work)
> > > > > > > >> 808-780-9977 (cell)
> > > > > > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 30 17:17:26 2020

Hi Wesley,

I took your METplus config file and modified it to run in my
environment.  I got a little farther, and now need to figure out how
to get the filename templates.  I've attached the config file I've
used, debug_mode.conf.  I modified paths and values, look for the
comments with !!!DEBUG to locate these.

My current issue is with the input fcst/obs files you provided:
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld

Here is the filename template I tried (I was assuming that the second
block of values after the YMD were hours-minutes-seconds):
 lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemplate

I don't think the 01200000 is an Hour-minute-second, is it?  We
support valid and init times in the filename template in METplus so I
may need to get some help from someone else in the group.

Can you try incorporating the changes I made to the config file and
see if you get to this error message in the log file:
  ERROR: (command_builder.py:539) Could not find FCST_INPUT file
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0600M00S_fcstfld
using template
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%MM%SS}_fcstfld

If so, then we are on the "same page" and can focus on the filename
templates.

Thanks for your patience in solving this problem.

Regards,
Minna

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Oct 30 17:24:29 2020

Minna,

Thanks for digging deeper into this!  I translated our filename
template below, if that helps.

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld

I'll see what I can do as far as troubleshooting goes and I should be
able to get you my feedback before Monday if that's okay.

Happy Halloween!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, October 30, 2020 4:17 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: [rt.rap.ucar.edu #97100] Formatting my mode config file for
METplus usage

Hi Wesley,

I took your METplus config file and modified it to run in my
environment.  I got a little farther, and now need to figure out how
to get the filename templates.  I've attached the config file I've
used, debug_mode.conf.  I modified paths and values, look for the
comments with !!!DEBUG to locate these.

My current issue is with the input fcst/obs files you provided:
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld

Here is the filename template I tried (I was assuming that the second
block of values after the YMD were hours-minutes-seconds):
 lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemplate

I don't think the 01200000 is an Hour-minute-second, is it?  We
support valid and init times in the filename template in METplus so I
may need to get some help from someone else in the group.

Can you try incorporating the changes I made to the config file and
see if you get to this error message in the log file:
  ERROR: (command_builder.py:539) Could not find FCST_INPUT file
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0600M00S_fcstfld
using template
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%MM%SS}_fcstfld

If so, then we are on the "same page" and can focus on the filename
templates.

Thanks for your patience in solving this problem.

Regards,
Minna

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Oct 30 17:27:40 2020

Hi Wesley,

I am out of the office on Mondays, so no need to hurry.   I assumed
HHHHMMSS and that didn't work.  I think I'll need to consult the
engineer
who worked on the string template code to see what can be done.
Thanks for your assistance.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> Thanks for digging deeper into this!  I translated our filename
template
> below, if that helps.
>
> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld
>
> I'll see what I can do as far as troubleshooting goes and I should
be able
> to get you my feedback before Monday if that's okay.
>
> Happy Halloween!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, October 30, 2020 4:17 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config file for
> METplus usage
>
> Hi Wesley,
>
> I took your METplus config file and modified it to run in my
environment.
> I got a little farther, and now need to figure out how to get the
filename
> templates.  I've attached the config file I've used,
debug_mode.conf.  I
> modified paths and values, look for the comments with !!!DEBUG to
locate
> these.
>
> My current issue is with the input fcst/obs files you provided:
> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>
> Here is the filename template I tried (I was assuming that the
second
> block of values after the YMD were hours-minutes-seconds):
>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemplate
>
> I don't think the 01200000 is an Hour-minute-second, is it?  We
support
> valid and init times in the filename template in METplus so I may
need to
> get some help from someone else in the group.
>
> Can you try incorporating the changes I made to the config file and
see if
> you get to this error message in the log file:
>   ERROR: (command_builder.py:539) Could not find FCST_INPUT file
>
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0600M00S_fcstfld
> using template
>
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%MM%SS}_fcstfld
>
> If so, then we are on the "same page" and can focus on the filename
> templates.
>
> Thanks for your patience in solving this problem.
>
> Regards,
> Minna
>
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Tue Nov 03 14:26:00 2020

Hi Wesley,

I got a little farther with your python embedding.  I got some help
with formatting the file template and now the code is correctly
looking for your sample files.  Here is what it looks like:

(These go under the [filename_templates] section):
FCST_MODE_INPUT_TEMPLATE =
lowcld_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_{lead?fmt=%3H}00000_fcstfld
OBS_MODE_INPUT_TEMPLATE =
lowcld_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld
MODE_OUTPUT_TEMPLATE =

I am now getting an error message that indicates that the python
embedding isn't getting called. I'm going to need to dig deeper in the
config file to see what's missing.

Regards,
Minna

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Wed Nov 04 08:22:36 2020

Hi Wesley,

I consulted with another engineer and the mode.conf file should have
the following set (which you had originally done correctly and I had
mistakenly instructed you to use the MTD setting):

FCST_MODE_INPUT_TEMPLATE = PYTHON_NUMPY
OBS_MODE_INPUT_TEMPLATE = PYTHON_NUMPY

It looks like there may be some issues with the actual Python
embedding portion. I'll need to see if it is a bug or if there is
still something amiss in the METplus config file.

Thank you for your patience.

Regards,
Minna

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Nov 06 11:08:07 2020

Hi Wesley,

We are trying to run MODE with the modified mode.conf METplus config
file
and are now getting an error with the plot_data_plane call that is
made by
MET.  We are stepping back and trying to run plot_data_plane with
Python
enabling (Python embedding) using your script, read_NRL_binary.py and
one
of your input files

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld

Can you try running something like this from your command line:

plot_data_plane PYTHON_NUMPY output_plot.ps
'name="./read_NRL_binary.py
./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v 10'

This indicates that the output plot should be named output_plot.ps,
using
the lowcld input file and run with a log level of 10.  Hopefully it
won't
generate any error messages.

Regards,

Minna

---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
<minnawin at ucar.edu>
wrote:

> Hi Wesley,
>
> I am out of the office on Mondays, so no need to hurry.   I assumed
> HHHHMMSS and that didn't work.  I think I'll need to consult the
engineer
> who worked on the string template code to see what can be done.
> Thanks for your assistance.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>>
>> Minna,
>>
>> Thanks for digging deeper into this!  I translated our filename
template
>> below, if that helps.
>>
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>> variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld
>>
>> I'll see what I can do as far as troubleshooting goes and I should
be
>> able to get you my feedback before Monday if that's okay.
>>
>> Happy Halloween!
>>
>> Sincerely,
>>
>> Wesley Davis
>> Data Analyst
>> DeVine Consulting
>> 831-641-7661 (work)
>> 808-780-9977 (cell)
>> wesley.davis.ctr at nrlmry.navy.mil
>>
>>
>> -----Original Message-----
>> From: Minna Win via RT <met_help at ucar.edu>
>> Sent: Friday, October 30, 2020 4:17 PM
>> To: Davis, Mr. Wesley, Contractor, Code 7531 <
>> wesley.davis.ctr at nrlmry.navy.mil>
>> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
>> METplus usage
>>
>> Hi Wesley,
>>
>> I took your METplus config file and modified it to run in my
>> environment.  I got a little farther, and now need to figure out
how to get
>> the filename templates.  I've attached the config file I've used,
>> debug_mode.conf.  I modified paths and values, look for the
comments with
>> !!!DEBUG to locate these.
>>
>> My current issue is with the input fcst/obs files you provided:
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>>
>> Here is the filename template I tried (I was assuming that the
second
>> block of values after the YMD were hours-minutes-seconds):
>>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemplate
>>
>> I don't think the 01200000 is an Hour-minute-second, is it?  We
support
>> valid and init times in the filename template in METplus so I may
need to
>> get some help from someone else in the group.
>>
>> Can you try incorporating the changes I made to the config file and
see
>> if you get to this error message in the log file:
>>   ERROR: (command_builder.py:539) Could not find FCST_INPUT file
>>
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0600M00S_fcstfld
>> using template
>>
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%MM%SS}_fcstfld
>>
>> If so, then we are on the "same page" and can focus on the filename
>> templates.
>>
>> Thanks for your patience in solving this problem.
>>
>> Regards,
>> Minna
>>
>>
>>
>>
>>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Nov 06 15:59:35 2020

Sorry, I JUST saw this.  I'll get you an answer ASAP

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, November 6, 2020 10:08 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

We are trying to run MODE with the modified mode.conf METplus config
file and are now getting an error with the plot_data_plane call that
is made by MET.  We are stepping back and trying to run
plot_data_plane with Python enabling (Python embedding) using your
script, read_NRL_binary.py and one of your input files

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld

Can you try running something like this from your command line:

plot_data_plane PYTHON_NUMPY output_plot.ps
'name="./read_NRL_binary.py
./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v 10'

This indicates that the output plot should be named output_plot.ps,
using the lowcld input file and run with a log level of 10.  Hopefully
it won't generate any error messages.

Regards,

Minna

---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
<minnawin at ucar.edu>
wrote:

> Hi Wesley,
>
> I am out of the office on Mondays, so no need to hurry.   I assumed
> HHHHMMSS and that didn't work.  I think I'll need to consult the
> engineer who worked on the string template code to see what can be
done.
> Thanks for your assistance.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>>
>> Minna,
>>
>> Thanks for digging deeper into this!  I translated our filename
template
>> below, if that helps.
>>
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>> variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld
>>
>> I'll see what I can do as far as troubleshooting goes and I should
be
>> able to get you my feedback before Monday if that's okay.
>>
>> Happy Halloween!
>>
>> Sincerely,
>>
>> Wesley Davis
>> Data Analyst
>> DeVine Consulting
>> 831-641-7661 (work)
>> 808-780-9977 (cell)
>> wesley.davis.ctr at nrlmry.navy.mil
>>
>>
>> -----Original Message-----
>> From: Minna Win via RT <met_help at ucar.edu>
>> Sent: Friday, October 30, 2020 4:17 PM
>> To: Davis, Mr. Wesley, Contractor, Code 7531 <
>> wesley.davis.ctr at nrlmry.navy.mil>
>> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
>> METplus usage
>>
>> Hi Wesley,
>>
>> I took your METplus config file and modified it to run in my
>> environment.  I got a little farther, and now need to figure out
how to get
>> the filename templates.  I've attached the config file I've used,
>> debug_mode.conf.  I modified paths and values, look for the
comments with
>> !!!DEBUG to locate these.
>>
>> My current issue is with the input fcst/obs files you provided:
>> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>>
>> Here is the filename template I tried (I was assuming that the
second
>> block of values after the YMD were hours-minutes-seconds):
>>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemplate
>>
>> I don't think the 01200000 is an Hour-minute-second, is it?  We
support
>> valid and init times in the filename template in METplus so I may
need to
>> get some help from someone else in the group.
>>
>> Can you try incorporating the changes I made to the config file and
see
>> if you get to this error message in the log file:
>>   ERROR: (command_builder.py:539) Could not find FCST_INPUT file
>>
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0600M00S_fcstfld
>> using template
>>
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%MM%SS}_fcstfld
>>
>> If so, then we are on the "same page" and can focus on the filename
>> templates.
>>
>> Thanks for your patience in solving this problem.
>>
>> Regards,
>> Minna
>>
>>
>>
>>
>>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Fri Nov 06 16:59:33 2020

Hi Wesley,

FYI, I noticed in the METplus log that there is an out-of-index error
encountered in the read_NRL_binary.py script:

Write Pickle: /d1/mwin/MET_HELP_davis/tmp/tmp_met_pickle_18381_0
> Traceback (most recent call last):
>   File
> "/d3/projects/MET/MET_releases/met-
9.1/share/met/wrappers/write_pickle_dataplane.py",
> line 32, in <module>
>     spec.loader.exec_module(met_in)
>   File "<frozen importlib._bootstrap_external>", line 728, in
exec_module
>   File "<frozen importlib._bootstrap>", line 219, in
> _call_with_frames_removed
>   File "/d1/mwin/MET_HELP_davis/read_NRL_binary.py", line 77, in
<module>
>     nlons = int(tokens[4][4:7])  # Usually 360

IndexError: list index out of range

Which is why we were interested in running plot_data_plane from the
command
line.  Trying to isolate where the problem lies...

Thanks for your assistance and patience.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Nov 6, 2020 at 4:00 PM Davis, Mr. Wesley, Contractor, Code
7531 via
RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Sorry, I JUST saw this.  I'll get you an answer ASAP
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, November 6, 2020 10:08 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> We are trying to run MODE with the modified mode.conf METplus config
file
> and are now getting an error with the plot_data_plane call that is
made by
> MET.  We are stepping back and trying to run plot_data_plane with
Python
> enabling (Python embedding) using your script, read_NRL_binary.py
and one
> of your input files
>
> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>
>
>
> Can you try running something like this from your command line:
>
>
> plot_data_plane PYTHON_NUMPY output_plot.ps
'name="./read_NRL_binary.py
> ./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v 10'
>
>
> This indicates that the output plot should be named output_plot.ps,
using
> the lowcld input file and run with a log level of 10.  Hopefully it
won't
> generate any error messages.
>
>
> Regards,
>
> Minna
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
<minnawin at ucar.edu
> >
> wrote:
>
> > Hi Wesley,
> >
> > I am out of the office on Mondays, so no need to hurry.   I
assumed
> > HHHHMMSS and that didn't work.  I think I'll need to consult the
> > engineer who worked on the string template code to see what can be
done.
> > Thanks for your assistance.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor,
Code 7531
> > via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >>
> >> Minna,
> >>
> >> Thanks for digging deeper into this!  I translated our filename
template
> >> below, if that helps.
> >>
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> >>
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld
> >>
> >> I'll see what I can do as far as troubleshooting goes and I
should be
> >> able to get you my feedback before Monday if that's okay.
> >>
> >> Happy Halloween!
> >>
> >> Sincerely,
> >>
> >> Wesley Davis
> >> Data Analyst
> >> DeVine Consulting
> >> 831-641-7661 (work)
> >> 808-780-9977 (cell)
> >> wesley.davis.ctr at nrlmry.navy.mil
> >>
> >>
> >> -----Original Message-----
> >> From: Minna Win via RT <met_help at ucar.edu>
> >> Sent: Friday, October 30, 2020 4:17 PM
> >> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> >> wesley.davis.ctr at nrlmry.navy.mil>
> >> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> >> METplus usage
> >>
> >> Hi Wesley,
> >>
> >> I took your METplus config file and modified it to run in my
> >> environment.  I got a little farther, and now need to figure out
how to
> get
> >> the filename templates.  I've attached the config file I've used,
> >> debug_mode.conf.  I modified paths and values, look for the
comments
> with
> >> !!!DEBUG to locate these.
> >>
> >> My current issue is with the input fcst/obs files you provided:
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> >>
> >> Here is the filename template I tried (I was assuming that the
second
> >> block of values after the YMD were hours-minutes-seconds):
> >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemplate
> >>
> >> I don't think the 01200000 is an Hour-minute-second, is it?  We
support
> >> valid and init times in the filename template in METplus so I may
need
> to
> >> get some help from someone else in the group.
> >>
> >> Can you try incorporating the changes I made to the config file
and see
> >> if you get to this error message in the log file:
> >>   ERROR: (command_builder.py:539) Could not find FCST_INPUT file
> >>
>
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0600M00S_fcstfld
> >> using template
> >>
>
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%MM%SS}_fcstfld
> >>
> >> If so, then we are on the "same page" and can focus on the
filename
> >> templates.
> >>
> >> Thanks for your patience in solving this problem.
> >>
> >> Regards,
> >> Minna
> >>
> >>
> >>
> >>
> >>
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Tue Nov 10 11:45:58 2020

Minna,

Running plot_data_plane in the way you described results in a hung
shell.  Nothing happens.  I put the python script and the forecast
file in the same directory I'm running from too.

On the plus side, I did get a bash script working that does the same
thing as the python wrapper, so I am actually able to process bulk
data with MODE now, just not using the python wrappers.

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Friday, November 6, 2020 4:00 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

FYI, I noticed in the METplus log that there is an out-of-index error
encountered in the read_NRL_binary.py script:

Write Pickle: /d1/mwin/MET_HELP_davis/tmp/tmp_met_pickle_18381_0
> Traceback (most recent call last):
>   File
> "/d3/projects/MET/MET_releases/met-
9.1/share/met/wrappers/write_pickle
> _dataplane.py",
> line 32, in <module>
>     spec.loader.exec_module(met_in)
>   File "<frozen importlib._bootstrap_external>", line 728, in
exec_module
>   File "<frozen importlib._bootstrap>", line 219, in
> _call_with_frames_removed
>   File "/d1/mwin/MET_HELP_davis/read_NRL_binary.py", line 77, in
<module>
>     nlons = int(tokens[4][4:7])  # Usually 360

IndexError: list index out of range

Which is why we were interested in running plot_data_plane from the
command line.  Trying to isolate where the problem lies...

Thanks for your assistance and patience.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Fri, Nov 6, 2020 at 4:00 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Sorry, I JUST saw this.  I'll get you an answer ASAP
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, November 6, 2020 10:08 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> We are trying to run MODE with the modified mode.conf METplus config
> file and are now getting an error with the plot_data_plane call that
> is made by MET.  We are stepping back and trying to run
> plot_data_plane with Python enabling (Python embedding) using your
> script, read_NRL_binary.py and one of your input files
>
> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
>
>
>
> Can you try running something like this from your command line:
>
>
> plot_data_plane PYTHON_NUMPY output_plot.ps
> 'name="./read_NRL_binary.py
./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v 10'
>
>
> This indicates that the output plot should be named output_plot.ps,
> using the lowcld input file and run with a log level of 10.
Hopefully
> it won't generate any error messages.
>
>
> Regards,
>
> Minna
>
>
>
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
> <minnawin at ucar.edu
> >
> wrote:
>
> > Hi Wesley,
> >
> > I am out of the office on Mondays, so no need to hurry.   I
assumed
> > HHHHMMSS and that didn't work.  I think I'll need to consult the
> > engineer who worked on the string template code to see what can be
done.
> > Thanks for your assistance.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor,
Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >>
> >> Minna,
> >>
> >> Thanks for digging deeper into this!  I translated our filename
> >> template below, if that helps.
> >>
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> >>
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld
> >>
> >> I'll see what I can do as far as troubleshooting goes and I
should
> >> be able to get you my feedback before Monday if that's okay.
> >>
> >> Happy Halloween!
> >>
> >> Sincerely,
> >>
> >> Wesley Davis
> >> Data Analyst
> >> DeVine Consulting
> >> 831-641-7661 (work)
> >> 808-780-9977 (cell)
> >> wesley.davis.ctr at nrlmry.navy.mil
> >>
> >>
> >> -----Original Message-----
> >> From: Minna Win via RT <met_help at ucar.edu>
> >> Sent: Friday, October 30, 2020 4:17 PM
> >> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> >> wesley.davis.ctr at nrlmry.navy.mil>
> >> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config file
> >> for METplus usage
> >>
> >> Hi Wesley,
> >>
> >> I took your METplus config file and modified it to run in my
> >> environment.  I got a little farther, and now need to figure out
> >> how to
> get
> >> the filename templates.  I've attached the config file I've used,
> >> debug_mode.conf.  I modified paths and values, look for the
> >> comments
> with
> >> !!!DEBUG to locate these.
> >>
> >> My current issue is with the input fcst/obs files you provided:
> >> lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> >>
> >> Here is the filename template I tried (I was assuming that the
> >> second block of values after the YMD were hours-minutes-seconds):
> >>
> >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemp
> >> late
> >>
> >> I don't think the 01200000 is an Hour-minute-second, is it?  We
> >> support valid and init times in the filename template in METplus
so
> >> I may need
> to
> >> get some help from someone else in the group.
> >>
> >> Can you try incorporating the changes I made to the config file
and
> >> see if you get to this error message in the log file:
> >>   ERROR: (command_builder.py:539) Could not find FCST_INPUT file
> >>
>
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0
> 600M00S_fcstfld
> >> using template
> >>
>
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%M
> M%SS}_fcstfld
> >>
> >> If so, then we are on the "same page" and can focus on the
filename
> >> templates.
> >>
> >> Thanks for your patience in solving this problem.
> >>
> >> Regards,
> >> Minna
> >>
> >>
> >>
> >>
> >>
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Tue Nov 10 17:57:11 2020

Hi Wesley,

George finally got things to work using the attached METplus config
file and command that looks like this:

master_metplus.py \
-c /d3/personal/mccabe/nrl/mode.conf \
config.LOG_LEVEL=DEBUG \
dir.INPUT_BASE=/d1/mwin/MET_HELP_davis \
dir.OUTPUT_BASE=/d3/personal/mccabe/nrl/out \
dir.MET_INSTALL_DIR=/usr/local/met

Does this config file work?  I know Bri Nelson gave you her config
file to run on your setup.

Thanks,
Minna

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: Minna Win
Time: Tue Nov 10 18:01:53 2020

Hi Wesley,

George finally got things to work using the attached METplus config
file
and command that looks like this:

master_metplus.py \
-c /d3/personal/mccabe/nrl/mode.conf \
config.LOG_LEVEL=DEBUG \
dir.INPUT_BASE=/d1/mwin/MET_HELP_davis \
dir.OUTPUT_BASE=/d3/personal/mccabe/nrl/out \
dir.MET_INSTALL_DIR=/usr/local/met

Does this config file work? I know Bri Nelson gave you her config file
to
run on your setup.

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Tue, Nov 10, 2020 at 11:46 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> Running plot_data_plane in the way you described results in a hung
shell.
> Nothing happens.  I put the python script and the forecast file in
the same
> directory I'm running from too.
>
> On the plus side, I did get a bash script working that does the same
thing
> as the python wrapper, so I am actually able to process bulk data
with MODE
> now, just not using the python wrappers.
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, November 6, 2020 4:00 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> FYI, I noticed in the METplus log that there is an out-of-index
error
> encountered in the read_NRL_binary.py script:
>
>
> Write Pickle: /d1/mwin/MET_HELP_davis/tmp/tmp_met_pickle_18381_0
> > Traceback (most recent call last):
> >   File
> > "/d3/projects/MET/MET_releases/met-
9.1/share/met/wrappers/write_pickle
> > _dataplane.py",
> > line 32, in <module>
> >     spec.loader.exec_module(met_in)
> >   File "<frozen importlib._bootstrap_external>", line 728, in
exec_module
> >   File "<frozen importlib._bootstrap>", line 219, in
> > _call_with_frames_removed
> >   File "/d1/mwin/MET_HELP_davis/read_NRL_binary.py", line 77, in
<module>
> >     nlons = int(tokens[4][4:7])  # Usually 360
>
> IndexError: list index out of range
>
>
> Which is why we were interested in running plot_data_plane from the
> command line.  Trying to isolate where the problem lies...
>
> Thanks for your assistance and patience.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Nov 6, 2020 at 4:00 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Sorry, I JUST saw this.  I'll get you an answer ASAP
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, November 6, 2020 10:08 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > We are trying to run MODE with the modified mode.conf METplus
config
> > file and are now getting an error with the plot_data_plane call
that
> > is made by MET.  We are stepping back and trying to run
> > plot_data_plane with Python enabling (Python embedding) using your
> > script, read_NRL_binary.py and one of your input files
> >
> > lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> >
> >
> >
> > Can you try running something like this from your command line:
> >
> >
> > plot_data_plane PYTHON_NUMPY output_plot.ps
> > 'name="./read_NRL_binary.py
> ./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v 10'
> >
> >
> > This indicates that the output plot should be named
output_plot.ps,
> > using the lowcld input file and run with a log level of 10.
Hopefully
> > it won't generate any error messages.
> >
> >
> > Regards,
> >
> > Minna
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
> > <minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hi Wesley,
> > >
> > > I am out of the office on Mondays, so no need to hurry.   I
assumed
> > > HHHHMMSS and that didn't work.  I think I'll need to consult the
> > > engineer who worked on the string template code to see what can
be
> done.
> > > Thanks for your assistance.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor,
Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >>
> > >> Minna,
> > >>
> > >> Thanks for digging deeper into this!  I translated our filename
> > >> template below, if that helps.
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > >>
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfld
> > >>
> > >> I'll see what I can do as far as troubleshooting goes and I
should
> > >> be able to get you my feedback before Monday if that's okay.
> > >>
> > >> Happy Halloween!
> > >>
> > >> Sincerely,
> > >>
> > >> Wesley Davis
> > >> Data Analyst
> > >> DeVine Consulting
> > >> 831-641-7661 (work)
> > >> 808-780-9977 (cell)
> > >> wesley.davis.ctr at nrlmry.navy.mil
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: Minna Win via RT <met_help at ucar.edu>
> > >> Sent: Friday, October 30, 2020 4:17 PM
> > >> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > >> wesley.davis.ctr at nrlmry.navy.mil>
> > >> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > >> for METplus usage
> > >>
> > >> Hi Wesley,
> > >>
> > >> I took your METplus config file and modified it to run in my
> > >> environment.  I got a little farther, and now need to figure
out
> > >> how to
> > get
> > >> the filename templates.  I've attached the config file I've
used,
> > >> debug_mode.conf.  I modified paths and values, look for the
> > >> comments
> > with
> > >> !!!DEBUG to locate these.
> > >>
> > >> My current issue is with the input fcst/obs files you provided:
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > >>
> > >> Here is the filename template I tried (I was assuming that the
> > >> second block of values after the YMD were hours-minutes-
seconds):
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfldemp
> > >> late
> > >>
> > >> I don't think the 01200000 is an Hour-minute-second, is it?  We
> > >> support valid and init times in the filename template in
METplus so
> > >> I may need
> > to
> > >> get some help from someone else in the group.
> > >>
> > >> Can you try incorporating the changes I made to the config file
and
> > >> see if you get to this error message in the log file:
> > >>   ERROR: (command_builder.py:539) Could not find FCST_INPUT
file
> > >>
> >
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704_0
> > 600M00S_fcstfld
> > >> using template
> > >>
> >
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H%M
> > M%SS}_fcstfld
> > >>
> > >> If so, then we are on the "same page" and can focus on the
filename
> > >> templates.
> > >>
> > >> Thanks for your patience in solving this problem.
> > >>
> > >> Regards,
> > >> Minna
> > >>
> > >>
> > >>
> > >>
> > >>
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Fri Nov 13 15:42:49 2020

Minna,

Progress, but still a bit buggy.  METplus runs, which is a win. It
creates all the correct directories, but it's not altering the config
file between iterations.

So, it'll take my initial time and iterate it correctly and then
create directories based upon that. It then populates those
directories with the exact same mode run, as defined in my default
configuration file.

Below is a sample of the log file ouput from one of the runs.

DEBUG 1: Default Config File: /software/depot/met-9.1/met-
9.1/share/met/config/MODEConfig_default
DEBUG 1: Match Config File:
/users/davis/testWrappers/configs/MODEConfig_MEAN
DEBUG 1: Merge Config File:
/users/davis/testWrappers/configs/MODEConfig_MEAN
DEBUG 1: Forecast File: PYTHON_NUMPY
DEBUG 1: Observation File: PYTHON_NUMPY
DEBUG 1: Forecast Field: lowcld at pre_0000.0
DEBUG 1: Observation Field: lowcld at pre_0000.0
DEBUG 2: Processing masking regions.
DEBUG 2: Identifying objects in the forecast and observation fields...
DEBUG 2: Computing contingency table statistics...
DEBUG 2: Identified: 2 forecast objects and 2 observation objects.
DEBUG 2: Performing merging (BOTH) in the forecast field.
DEBUG 2: Performing merging (BOTH) in the observation field.
DEBUG 2: Remaining: 2 forecast objects and 2 observation objects.
DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
observation fields.
DEBUG 1: Creating Fcst-Obs Object Statistics file:
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_obj.txt

**

As you can see here, the directory is showing the right initial time,
but the output is for the time set in the mode config file by default

**

DEBUG 1: Creating Fcst-Fcst Object Statistics file:
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_fcst_merge.txt
DEBUG 1: Creating Obs-Obs Object Statistics file:
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_obs_merge.txt
DEBUG 1: Creating Contingency Table Statistics file:
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_cts.txt
DEBUG 1: Creating Object NetCDF file:
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_obj.nc

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: Minna Win via RT <met_help at ucar.edu>
Sent: Tuesday, November 10, 2020 5:02 PM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

George finally got things to work using the attached METplus config
file and command that looks like this:

master_metplus.py \
-c /d3/personal/mccabe/nrl/mode.conf \
config.LOG_LEVEL=DEBUG \
dir.INPUT_BASE=/d1/mwin/MET_HELP_davis \
dir.OUTPUT_BASE=/d3/personal/mccabe/nrl/out \
dir.MET_INSTALL_DIR=/usr/local/met

Does this config file work? I know Bri Nelson gave you her config file
to run on your setup.

Thanks,
Minna
---------------
Minna Win
National Center for Atmospheric Research Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401
---------------
Pronouns: she/her

On Tue, Nov 10, 2020 at 11:46 AM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> Running plot_data_plane in the way you described results in a hung
shell.
> Nothing happens.  I put the python script and the forecast file in
the
> same directory I'm running from too.
>
> On the plus side, I did get a bash script working that does the same
> thing as the python wrapper, so I am actually able to process bulk
> data with MODE now, just not using the python wrappers.
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Friday, November 6, 2020 4:00 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> FYI, I noticed in the METplus log that there is an out-of-index
error
> encountered in the read_NRL_binary.py script:
>
>
> Write Pickle: /d1/mwin/MET_HELP_davis/tmp/tmp_met_pickle_18381_0
> > Traceback (most recent call last):
> >   File
> > "/d3/projects/MET/MET_releases/met-
9.1/share/met/wrappers/write_pick
> > le
> > _dataplane.py",
> > line 32, in <module>
> >     spec.loader.exec_module(met_in)
> >   File "<frozen importlib._bootstrap_external>", line 728, in
exec_module
> >   File "<frozen importlib._bootstrap>", line 219, in
> > _call_with_frames_removed
> >   File "/d1/mwin/MET_HELP_davis/read_NRL_binary.py", line 77, in
<module>
> >     nlons = int(tokens[4][4:7])  # Usually 360
>
> IndexError: list index out of range
>
>
> Which is why we were interested in running plot_data_plane from the
> command line.  Trying to isolate where the problem lies...
>
> Thanks for your assistance and patience.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, Nov 6, 2020 at 4:00 PM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Sorry, I JUST saw this.  I'll get you an answer ASAP
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, November 6, 2020 10:08 AM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > We are trying to run MODE with the modified mode.conf METplus
config
> > file and are now getting an error with the plot_data_plane call
that
> > is made by MET.  We are stepping back and trying to run
> > plot_data_plane with Python enabling (Python embedding) using your
> > script, read_NRL_binary.py and one of your input files
> >
> > lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> >
> >
> >
> > Can you try running something like this from your command line:
> >
> >
> > plot_data_plane PYTHON_NUMPY output_plot.ps
> > 'name="./read_NRL_binary.py
> ./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v 10'
> >
> >
> > This indicates that the output plot should be named
output_plot.ps,
> > using the lowcld input file and run with a log level of 10.
> > Hopefully it won't generate any error messages.
> >
> >
> > Regards,
> >
> > Minna
> >
> >
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
> > <minnawin at ucar.edu
> > >
> > wrote:
> >
> > > Hi Wesley,
> > >
> > > I am out of the office on Mondays, so no need to hurry.   I
assumed
> > > HHHHMMSS and that didn't work.  I think I'll need to consult the
> > > engineer who worked on the string template code to see what can
be
> done.
> > > Thanks for your assistance.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor,
> > > Code
> > > 7531 via RT <met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >>
> > >> Minna,
> > >>
> > >> Thanks for digging deeper into this!  I translated our filename
> > >> template below, if that helps.
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > >>
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfl
> > >> d
> > >>
> > >> I'll see what I can do as far as troubleshooting goes and I
> > >> should be able to get you my feedback before Monday if that's
okay.
> > >>
> > >> Happy Halloween!
> > >>
> > >> Sincerely,
> > >>
> > >> Wesley Davis
> > >> Data Analyst
> > >> DeVine Consulting
> > >> 831-641-7661 (work)
> > >> 808-780-9977 (cell)
> > >> wesley.davis.ctr at nrlmry.navy.mil
> > >>
> > >>
> > >> -----Original Message-----
> > >> From: Minna Win via RT <met_help at ucar.edu>
> > >> Sent: Friday, October 30, 2020 4:17 PM
> > >> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > >> wesley.davis.ctr at nrlmry.navy.mil>
> > >> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > >> for METplus usage
> > >>
> > >> Hi Wesley,
> > >>
> > >> I took your METplus config file and modified it to run in my
> > >> environment.  I got a little farther, and now need to figure
out
> > >> how to
> > get
> > >> the filename templates.  I've attached the config file I've
used,
> > >> debug_mode.conf.  I modified paths and values, look for the
> > >> comments
> > with
> > >> !!!DEBUG to locate these.
> > >>
> > >> My current issue is with the input fcst/obs files you provided:
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > >>
> > >> Here is the filename template I tried (I was assuming that the
> > >> second block of values after the YMD were hours-minutes-
seconds):
> > >>
> > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstflde
> > >> mp
> > >> late
> > >>
> > >> I don't think the 01200000 is an Hour-minute-second, is it?  We
> > >> support valid and init times in the filename template in
METplus
> > >> so I may need
> > to
> > >> get some help from someone else in the group.
> > >>
> > >> Can you try incorporating the changes I made to the config file
> > >> and see if you get to this error message in the log file:
> > >>   ERROR: (command_builder.py:539) Could not find FCST_INPUT
file
> > >>
> >
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704
> > _0
> > 600M00S_fcstfld
> > >> using template
> > >>
> >
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H
> > %M
> > M%SS}_fcstfld
> > >>
> > >> If so, then we are on the "same page" and can focus on the
> > >> filename templates.
> > >>
> > >> Thanks for your patience in solving this problem.
> > >>
> > >> Regards,
> > >> Minna
> > >>
> > >>
> > >>
> > >>
> > >>
> >
> >
> >
> >
>
>
>
>

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: George McCabe
Time: Mon Nov 16 07:53:51 2020

Hi Wesley,

There seems to be a disconnect between the forecast lead time in your
configuration and the python script. If you run the python script that
is
called in FCST_VAR1_NAME, you will see the following output:

*python3 /d3/personal/mccabe/nrl/read_NRL_binary.py
/d3/personal/mccabe/nrl/input*
/lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
Input File:
'/d3/personal/mccabe/nrl/input/lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld'
Data Shape: (181, 360)
Data Type:  dtype('float64')
Data Range: 0.0 to 100.0 percent
Attributes: {'valid': '*20200706_120000*', 'init': '20200701_120000',
'lead': '*120*', 'accum': '00', 'name': 'lowcld', 'long_name': 'Low
Cloud',
'level': 'pre_0000.0', 'units': 'percent', 'grid': {'name': 'Global 1
Degree', 'type': 'LatLon', 'lat_ll': -90.0, 'lon_ll': 0.0,
'delta_lat':
1.0, 'delta_lon': 1.0, 'Nlat': 181, 'Nlon': 360}}

I see in a previous email that you described the filename format as:

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_*0120*0000_fcstfld
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_*HHHH*MMSS_fcstfld

If this is the case, then the forecast lead for this case is 120
hours.
Previously I didn't see this description of the filenames. Based on
the
files that were provided, I assumed that the forecast lead you were
trying
to process is 12 hours:

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld (I
thought
this contained data initialized at July 1 @12Z, forecast lead 12 H,
valid
at July 2 @ 0Z)

lowcld_pre_0000.0_0000.0_glob360x181_2020070200_00000000_fcstfld (I
thought
this contained data valid at July 2 @ 0Z)

The configuration file I sent you was processing these files based on
this
assumption. However, it looks like the python embedding script
(read_NRL_binary.py) considers the forecast file to contain 120 hour
forecast data.

If you could confirm what the actual contents of these files are, I
can
help figure out what needs to change. If the files indeed contain 120
hour
forecast data, then I think I will need a different observation file
that
corresponds to the appropriate valid time. If the data actually
contains 12
hour forecast data, then the read_NRL_binary.py script needs to be
adjusted
to extract the correct forecast lead from the data.

Thanks,
George

On Fri, Nov 13, 2020 at 3:43 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> Progress, but still a bit buggy.  METplus runs, which is a win. It
creates
> all the correct directories, but it's not altering the config file
between
> iterations.
>
> So, it'll take my initial time and iterate it correctly and then
create
> directories based upon that. It then populates those directories
with the
> exact same mode run, as defined in my default configuration file.
>
> Below is a sample of the log file ouput from one of the runs.
>
> DEBUG 1: Default Config File:
> /software/depot/met-9.1/met-9.1/share/met/config/MODEConfig_default
> DEBUG 1: Match Config File:
> /users/davis/testWrappers/configs/MODEConfig_MEAN
> DEBUG 1: Merge Config File:
> /users/davis/testWrappers/configs/MODEConfig_MEAN
> DEBUG 1: Forecast File: PYTHON_NUMPY
> DEBUG 1: Observation File: PYTHON_NUMPY
> DEBUG 1: Forecast Field: lowcld at pre_0000.0
> DEBUG 1: Observation Field: lowcld at pre_0000.0
> DEBUG 2: Processing masking regions.
> DEBUG 2: Identifying objects in the forecast and observation
fields...
> DEBUG 2: Computing contingency table statistics...
> DEBUG 2: Identified: 2 forecast objects and 2 observation objects.
> DEBUG 2: Performing merging (BOTH) in the forecast field.
> DEBUG 2: Performing merging (BOTH) in the observation field.
> DEBUG 2: Remaining: 2 forecast objects and 2 observation objects.
> DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
> observation fields.
> DEBUG 1: Creating Fcst-Obs Object Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_obj.txt
>
> **
>
> As you can see here, the directory is showing the right initial
time, but
> the output is for the time set in the mode config file by default
>
> **
>
> DEBUG 1: Creating Fcst-Fcst Object Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_fcst_merge.txt
> DEBUG 1: Creating Obs-Obs Object Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_obs_merge.txt
> DEBUG 1: Creating Contingency Table Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_cts.txt
> DEBUG 1: Creating Object NetCDF file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_20200703_060000V_000000A_R1_T1_obj.nc
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, November 10, 2020 5:02 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> George finally got things to work using the attached METplus config
file
> and command that looks like this:
>
> master_metplus.py \
> -c /d3/personal/mccabe/nrl/mode.conf \
> config.LOG_LEVEL=DEBUG \
> dir.INPUT_BASE=/d1/mwin/MET_HELP_davis \
> dir.OUTPUT_BASE=/d3/personal/mccabe/nrl/out \
> dir.MET_INSTALL_DIR=/usr/local/met
>
> Does this config file work? I know Bri Nelson gave you her config
file to
> run on your setup.
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Tue, Nov 10, 2020 at 11:46 AM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Minna,
> >
> > Running plot_data_plane in the way you described results in a hung
shell.
> > Nothing happens.  I put the python script and the forecast file in
the
> > same directory I'm running from too.
> >
> > On the plus side, I did get a bash script working that does the
same
> > thing as the python wrapper, so I am actually able to process bulk
> > data with MODE now, just not using the python wrappers.
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, November 6, 2020 4:00 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > FYI, I noticed in the METplus log that there is an out-of-index
error
> > encountered in the read_NRL_binary.py script:
> >
> >
> > Write Pickle: /d1/mwin/MET_HELP_davis/tmp/tmp_met_pickle_18381_0
> > > Traceback (most recent call last):
> > >   File
> > > "/d3/projects/MET/MET_releases/met-
9.1/share/met/wrappers/write_pick
> > > le
> > > _dataplane.py",
> > > line 32, in <module>
> > >     spec.loader.exec_module(met_in)
> > >   File "<frozen importlib._bootstrap_external>", line 728, in
> exec_module
> > >   File "<frozen importlib._bootstrap>", line 219, in
> > > _call_with_frames_removed
> > >   File "/d1/mwin/MET_HELP_davis/read_NRL_binary.py", line 77, in
> <module>
> > >     nlons = int(tokens[4][4:7])  # Usually 360
> >
> > IndexError: list index out of range
> >
> >
> > Which is why we were interested in running plot_data_plane from
the
> > command line.  Trying to isolate where the problem lies...
> >
> > Thanks for your assistance and patience.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Nov 6, 2020 at 4:00 PM Davis, Mr. Wesley, Contractor, Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Sorry, I JUST saw this.  I'll get you an answer ASAP
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, November 6, 2020 10:08 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > We are trying to run MODE with the modified mode.conf METplus
config
> > > file and are now getting an error with the plot_data_plane call
that
> > > is made by MET.  We are stepping back and trying to run
> > > plot_data_plane with Python enabling (Python embedding) using
your
> > > script, read_NRL_binary.py and one of your input files
> > >
> > > lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > >
> > >
> > >
> > > Can you try running something like this from your command line:
> > >
> > >
> > > plot_data_plane PYTHON_NUMPY output_plot.ps
> > > 'name="./read_NRL_binary.py
> >
./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
-v
> 10'
> > >
> > >
> > > This indicates that the output plot should be named
output_plot.ps,
> > > using the lowcld input file and run with a log level of 10.
> > > Hopefully it won't generate any error messages.
> > >
> > >
> > > Regards,
> > >
> > > Minna
> > >
> > >
> > >
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
> > > <minnawin at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hi Wesley,
> > > >
> > > > I am out of the office on Mondays, so no need to hurry.   I
assumed
> > > > HHHHMMSS and that didn't work.  I think I'll need to consult
the
> > > > engineer who worked on the string template code to see what
can be
> > done.
> > > > Thanks for your assistance.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >>
> > > >> Minna,
> > > >>
> > > >> Thanks for digging deeper into this!  I translated our
filename
> > > >> template below, if that helps.
> > > >>
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > > >>
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcstfl
> > > >> d
> > > >>
> > > >> I'll see what I can do as far as troubleshooting goes and I
> > > >> should be able to get you my feedback before Monday if that's
okay.
> > > >>
> > > >> Happy Halloween!
> > > >>
> > > >> Sincerely,
> > > >>
> > > >> Wesley Davis
> > > >> Data Analyst
> > > >> DeVine Consulting
> > > >> 831-641-7661 (work)
> > > >> 808-780-9977 (cell)
> > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > >>
> > > >>
> > > >> -----Original Message-----
> > > >> From: Minna Win via RT <met_help at ucar.edu>
> > > >> Sent: Friday, October 30, 2020 4:17 PM
> > > >> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > >> wesley.davis.ctr at nrlmry.navy.mil>
> > > >> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > > >> for METplus usage
> > > >>
> > > >> Hi Wesley,
> > > >>
> > > >> I took your METplus config file and modified it to run in my
> > > >> environment.  I got a little farther, and now need to figure
out
> > > >> how to
> > > get
> > > >> the filename templates.  I've attached the config file I've
used,
> > > >> debug_mode.conf.  I modified paths and values, look for the
> > > >> comments
> > > with
> > > >> !!!DEBUG to locate these.
> > > >>
> > > >> My current issue is with the input fcst/obs files you
provided:
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > > >>
> > > >> Here is the filename template I tried (I was assuming that
the
> > > >> second block of values after the YMD were hours-minutes-
seconds):
> > > >>
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstflde
> > > >> mp
> > > >> late
> > > >>
> > > >> I don't think the 01200000 is an Hour-minute-second, is it?
We
> > > >> support valid and init times in the filename template in
METplus
> > > >> so I may need
> > > to
> > > >> get some help from someone else in the group.
> > > >>
> > > >> Can you try incorporating the changes I made to the config
file
> > > >> and see if you get to this error message in the log file:
> > > >>   ERROR: (command_builder.py:539) Could not find FCST_INPUT
file
> > > >>
> > >
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_20200704
> > > _0
> > > 600M00S_fcstfld
> > > >> using template
> > > >>
> > >
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=%H
> > > %M
> > > M%SS}_fcstfld
> > > >>
> > > >> If so, then we are on the "same page" and can focus on the
> > > >> filename templates.
> > > >>
> > > >> Thanks for your patience in solving this problem.
> > > >>
> > > >> Regards,
> > > >> Minna
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Mon Nov 16 11:47:49 2020

George,

I see what you're saying about the formatting.  Yes, you have the
correct understanding of it, it's supposed to be doing a 12 hour lead.
That was probably a formatting error or something on my part.

This is what I currently have as my FCST/OBS_VAR1_NAME

FCST_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
{INPUT_BASE}/fcst/{custom?fmt=s}_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_0{lead?fmt=%HHH}0000_fcstfld

OBS_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
{INPUT_BASE}/obs/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld

I'm pointing the two variable at two different directories.  One of
them has only lead time == 0 (observation files) and the other
contains lead times 6 - 30/120, depending on if it's 06/18 or 00/12 z
runs.

I have a question about how the mode script reads in the files, if you
don't mind.  I see in the config files I've been getting sent that the
FCST/OBS_MODE_INPUT_DIR are both pointed to the same folder.
Are all of the files supposed to be in one directory?  Because here,
by default we separate files by initial time.  So, any forecast files
in one initial time won't be able to compare with a file in the same
directory it's from.
Does that make sense the way I explained it?

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: George McCabe via RT <met_help at ucar.edu>
Sent: Monday, November 16, 2020 6:54 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

There seems to be a disconnect between the forecast lead time in your
configuration and the python script. If you run the python script that
is called in FCST_VAR1_NAME, you will see the following output:

*python3 /d3/personal/mccabe/nrl/read_NRL_binary.py
/d3/personal/mccabe/nrl/input*
/lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
Input File:
'/d3/personal/mccabe/nrl/input/lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld'
Data Shape: (181, 360)
Data Type:  dtype('float64')
Data Range: 0.0 to 100.0 percent
Attributes: {'valid': '*20200706_120000*', 'init': '20200701_120000',
'lead': '*120*', 'accum': '00', 'name': 'lowcld', 'long_name': 'Low
Cloud',
'level': 'pre_0000.0', 'units': 'percent', 'grid': {'name': 'Global 1
Degree', 'type': 'LatLon', 'lat_ll': -90.0, 'lon_ll': 0.0,
'delta_lat':
1.0, 'delta_lon': 1.0, 'Nlat': 181, 'Nlon': 360}}

I see in a previous email that you described the filename format as:

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_*0120*0000_fcstfld
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_*HHHH*MMSS_fcstfld

If this is the case, then the forecast lead for this case is 120
hours.
Previously I didn't see this description of the filenames. Based on
the files that were provided, I assumed that the forecast lead you
were trying to process is 12 hours:

lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld (I
thought this contained data initialized at July 1 @12Z, forecast lead
12 H, valid at July 2 @ 0Z)

lowcld_pre_0000.0_0000.0_glob360x181_2020070200_00000000_fcstfld (I
thought this contained data valid at July 2 @ 0Z)

The configuration file I sent you was processing these files based on
this assumption. However, it looks like the python embedding script
(read_NRL_binary.py) considers the forecast file to contain 120 hour
forecast data.

If you could confirm what the actual contents of these files are, I
can help figure out what needs to change. If the files indeed contain
120 hour forecast data, then I think I will need a different
observation file that corresponds to the appropriate valid time. If
the data actually contains 12 hour forecast data, then the
read_NRL_binary.py script needs to be adjusted to extract the correct
forecast lead from the data.

Thanks,
George

On Fri, Nov 13, 2020 at 3:43 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> Minna,
>
> Progress, but still a bit buggy.  METplus runs, which is a win. It
> creates all the correct directories, but it's not altering the
config
> file between iterations.
>
> So, it'll take my initial time and iterate it correctly and then
> create directories based upon that. It then populates those
> directories with the exact same mode run, as defined in my default
configuration file.
>
> Below is a sample of the log file ouput from one of the runs.
>
> DEBUG 1: Default Config File:
> /software/depot/met-9.1/met-9.1/share/met/config/MODEConfig_default
> DEBUG 1: Match Config File:
> /users/davis/testWrappers/configs/MODEConfig_MEAN
> DEBUG 1: Merge Config File:
> /users/davis/testWrappers/configs/MODEConfig_MEAN
> DEBUG 1: Forecast File: PYTHON_NUMPY
> DEBUG 1: Observation File: PYTHON_NUMPY DEBUG 1: Forecast Field:
> lowcld at pre_0000.0 DEBUG 1: Observation Field: lowcld at
pre_0000.0
> DEBUG 2: Processing masking regions.
> DEBUG 2: Identifying objects in the forecast and observation
fields...
> DEBUG 2: Computing contingency table statistics...
> DEBUG 2: Identified: 2 forecast objects and 2 observation objects.
> DEBUG 2: Performing merging (BOTH) in the forecast field.
> DEBUG 2: Performing merging (BOTH) in the observation field.
> DEBUG 2: Remaining: 2 forecast objects and 2 observation objects.
> DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
> observation fields.
> DEBUG 1: Creating Fcst-Obs Object Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_2020
> 0703_060000V_000000A_R1_T1_obj.txt
>
> **
>
> As you can see here, the directory is showing the right initial
time,
> but the output is for the time set in the mode config file by
default
>
> **
>
> DEBUG 1: Creating Fcst-Fcst Object Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_2020
> 0703_060000V_000000A_R1_T1_fcst_merge.txt
> DEBUG 1: Creating Obs-Obs Object Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_2020
> 0703_060000V_000000A_R1_T1_obs_merge.txt
> DEBUG 1: Creating Contingency Table Statistics file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_2020
> 0703_060000V_000000A_R1_T1_cts.txt
> DEBUG 1: Creating Object NetCDF file:
>
/users/davis/testWrappers/tmp/mode/202007010600/mode/mode_060000L_2020
> 0703_060000V_000000A_R1_T1_obj.nc
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: Minna Win via RT <met_help at ucar.edu>
> Sent: Tuesday, November 10, 2020 5:02 PM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
> for METplus usage
>
> Hi Wesley,
>
> George finally got things to work using the attached METplus config
> file and command that looks like this:
>
> master_metplus.py \
> -c /d3/personal/mccabe/nrl/mode.conf \ config.LOG_LEVEL=DEBUG \
> dir.INPUT_BASE=/d1/mwin/MET_HELP_davis \
> dir.OUTPUT_BASE=/d3/personal/mccabe/nrl/out \
> dir.MET_INSTALL_DIR=/usr/local/met
>
> Does this config file work? I know Bri Nelson gave you her config
file
> to run on your setup.
>
> Thanks,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research Developmental Testbed
Center
> Phone: 303-497-8423
> Fax:   303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Tue, Nov 10, 2020 at 11:46 AM Davis, Mr. Wesley, Contractor, Code
> 7531 via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > Minna,
> >
> > Running plot_data_plane in the way you described results in a hung
shell.
> > Nothing happens.  I put the python script and the forecast file in
> > the same directory I'm running from too.
> >
> > On the plus side, I did get a bash script working that does the
same
> > thing as the python wrapper, so I am actually able to process bulk
> > data with MODE now, just not using the python wrappers.
> >
> > Sincerely,
> >
> > Wesley Davis
> > Data Analyst
> > DeVine Consulting
> > 831-641-7661 (work)
> > 808-780-9977 (cell)
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> > -----Original Message-----
> > From: Minna Win via RT <met_help at ucar.edu>
> > Sent: Friday, November 6, 2020 4:00 PM
> > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > wesley.davis.ctr at nrlmry.navy.mil>
> > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
file
> > for METplus usage
> >
> > Hi Wesley,
> >
> > FYI, I noticed in the METplus log that there is an out-of-index
> > error encountered in the read_NRL_binary.py script:
> >
> >
> > Write Pickle: /d1/mwin/MET_HELP_davis/tmp/tmp_met_pickle_18381_0
> > > Traceback (most recent call last):
> > >   File
> > > "/d3/projects/MET/MET_releases/met-
9.1/share/met/wrappers/write_pi
> > > ck
> > > le
> > > _dataplane.py",
> > > line 32, in <module>
> > >     spec.loader.exec_module(met_in)
> > >   File "<frozen importlib._bootstrap_external>", line 728, in
> exec_module
> > >   File "<frozen importlib._bootstrap>", line 219, in
> > > _call_with_frames_removed
> > >   File "/d1/mwin/MET_HELP_davis/read_NRL_binary.py", line 77, in
> <module>
> > >     nlons = int(tokens[4][4:7])  # Usually 360
> >
> > IndexError: list index out of range
> >
> >
> > Which is why we were interested in running plot_data_plane from
the
> > command line.  Trying to isolate where the problem lies...
> >
> > Thanks for your assistance and patience.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research Developmental Testbed
> > Center
> > Phone: 303-497-8423
> > Fax:   303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Fri, Nov 6, 2020 at 4:00 PM Davis, Mr. Wesley, Contractor, Code
> > 7531 via RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> > >
> > > Sorry, I JUST saw this.  I'll get you an answer ASAP
> > >
> > > Sincerely,
> > >
> > > Wesley Davis
> > > Data Analyst
> > > DeVine Consulting
> > > 831-641-7661 (work)
> > > 808-780-9977 (cell)
> > > wesley.davis.ctr at nrlmry.navy.mil
> > >
> > > -----Original Message-----
> > > From: Minna Win via RT <met_help at ucar.edu>
> > > Sent: Friday, November 6, 2020 10:08 AM
> > > To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > wesley.davis.ctr at nrlmry.navy.mil>
> > > Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > file for METplus usage
> > >
> > > Hi Wesley,
> > >
> > > We are trying to run MODE with the modified mode.conf METplus
> > > config file and are now getting an error with the
plot_data_plane
> > > call that is made by MET.  We are stepping back and trying to
run
> > > plot_data_plane with Python enabling (Python embedding) using
your
> > > script, read_NRL_binary.py and one of your input files
> > >
> > > lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld
> > >
> > >
> > >
> > > Can you try running something like this from your command line:
> > >
> > >
> > > plot_data_plane PYTHON_NUMPY output_plot.ps
> > > 'name="./read_NRL_binary.py
> >
./lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfld";
> > -v
> 10'
> > >
> > >
> > > This indicates that the output plot should be named
> > > output_plot.ps, using the lowcld input file and run with a log
level of 10.
> > > Hopefully it won't generate any error messages.
> > >
> > >
> > > Regards,
> > >
> > > Minna
> > >
> > >
> > >
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research Developmental Testbed
> > > Center
> > > Phone: 303-497-8423
> > > Fax:   303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Fri, Oct 30, 2020 at 5:26 PM Minna Win-Gildenmeister
> > > <minnawin at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hi Wesley,
> > > >
> > > > I am out of the office on Mondays, so no need to hurry.   I
assumed
> > > > HHHHMMSS and that didn't work.  I think I'll need to consult
the
> > > > engineer who worked on the string template code to see what
can
> > > > be
> > done.
> > > > Thanks for your assistance.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research Developmental Testbed
> > > > Center
> > > > Phone: 303-497-8423
> > > > Fax:   303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Fri, Oct 30, 2020 at 5:24 PM Davis, Mr. Wesley, Contractor,
> > > > Code
> > > > 7531 via RT <met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100
>
> > > >>
> > > >> Minna,
> > > >>
> > > >> Thanks for digging deeper into this!  I translated our
filename
> > > >> template below, if that helps.
> > > >>
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfl
> > > >> d
> > > >>
variable_unit_level_0000.0_glob360x181_YYYYMMDDHH_HHHHMMSS_fcst
> > > >> fl
> > > >> d
> > > >>
> > > >> I'll see what I can do as far as troubleshooting goes and I
> > > >> should be able to get you my feedback before Monday if that's
okay.
> > > >>
> > > >> Happy Halloween!
> > > >>
> > > >> Sincerely,
> > > >>
> > > >> Wesley Davis
> > > >> Data Analyst
> > > >> DeVine Consulting
> > > >> 831-641-7661 (work)
> > > >> 808-780-9977 (cell)
> > > >> wesley.davis.ctr at nrlmry.navy.mil
> > > >>
> > > >>
> > > >> -----Original Message-----
> > > >> From: Minna Win via RT <met_help at ucar.edu>
> > > >> Sent: Friday, October 30, 2020 4:17 PM
> > > >> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> > > >> wesley.davis.ctr at nrlmry.navy.mil>
> > > >> Subject: [rt.rap.ucar.edu #97100] Formatting my mode config
> > > >> file for METplus usage
> > > >>
> > > >> Hi Wesley,
> > > >>
> > > >> I took your METplus config file and modified it to run in my
> > > >> environment.  I got a little farther, and now need to figure
> > > >> out how to
> > > get
> > > >> the filename templates.  I've attached the config file I've
> > > >> used, debug_mode.conf.  I modified paths and values, look for
> > > >> the comments
> > > with
> > > >> !!!DEBUG to locate these.
> > > >>
> > > >> My current issue is with the input fcst/obs files you
provided:
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfl
> > > >> d
> > > >>
> > > >> Here is the filename template I tried (I was assuming that
the
> > > >> second block of values after the YMD were hours-minutes-
seconds):
> > > >>
> > > >>
lowcld_pre_0000.0_0000.0_glob360x181_2020070112_01200000_fcstfl
> > > >> de
> > > >> mp
> > > >> late
> > > >>
> > > >> I don't think the 01200000 is an Hour-minute-second, is it?
We
> > > >> support valid and init times in the filename template in
> > > >> METplus so I may need
> > > to
> > > >> get some help from someone else in the group.
> > > >>
> > > >> Can you try incorporating the changes I made to the config
file
> > > >> and see if you get to this error message in the log file:
> > > >>   ERROR: (command_builder.py:539) Could not find FCST_INPUT
> > > >> file
> > > >>
> > >
/d1/mwin/MET_HELP_davis/lowcld_pre_0000.0_000.0_glob360x181_202007
> > > 04
> > > _0
> > > 600M00S_fcstfld
> > > >> using template
> > > >>
> > >
lowcld_pre_0000.0_000.0_glob360x181_{valid?fmt=%Y%m%d}_{valid?fmt=
> > > %H
> > > %M
> > > M%SS}_fcstfld
> > > >>
> > > >> If so, then we are on the "same page" and can focus on the
> > > >> filename templates.
> > > >>
> > > >> Thanks for your patience in solving this problem.
> > > >>
> > > >> Regards,
> > > >> Minna
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > >
> > >
> > >
> > >
> >
> >
> >
> >
>
>
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research Research Applications
Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to reply to this email outside of your normal working hours.

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Mon Nov 16 12:01:54 2020

George,

I went back and looked and they came out to look like this:

12 hr lead
0012

120 hour lead
0120

So, yea you were totally right on that, sorry to introduce any
confusion.

Wesley

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: George McCabe
Time: Mon Nov 16 12:15:37 2020

Hi Wesley,

No, the input files do not have to be in the same directory. That is
just
the case for my testing environment. I would recommend setting the
values
for the input directories, then referencing them in the
FCST/OBS_VAR<n>_NAME value, i.e. something similar to:

FCST_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
*{FCST_MODE_INPUT_DIR}*
/{custom?fmt=s}_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_0{lead?fmt=%HHH}0000_fcstfld

OBS_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
*{OBS_MODE_INPUT_DIR}*/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld

[dir]
*FCST_MODE_INPUT_DIR *= {INPUT_BASE}/fcst

*OBS_MODE_INPUT_DIR *= {INPUT_BASE}/obs

- George

On Mon, Nov 16, 2020 at 12:02 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> George,
>
> I went back and looked and they came out to look like this:
>
> 12 hr lead
> 0012
>
> 120 hour lead
> 0120
>
> So, yea you were totally right on that, sorry to introduce any
confusion.
>
> Wesley
>
>
>
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.

------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #97100] Formatting my mode config file for METplus usage
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Mon Nov 16 15:07:17 2020

George,

So, our directory structure for the forecast files are as such:

/g2020060100/lowcld_*_*_*_*_*2020060100_0HHH0000_fcstfld

In this case, every directory would contain forecast field who's ob
fields are in a different directory.

Does this program allow for bulk running of mode on that type of
directory structure? I ask, because in our case I'm not going to have
just one directory to point at for my input and output fields.  The
target is going to keep moving.

Thanks!

Sincerely,

Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil

-----Original Message-----
From: George McCabe via RT <met_help at ucar.edu>
Sent: Monday, November 16, 2020 11:16 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for METplus usage

Hi Wesley,

No, the input files do not have to be in the same directory. That is
just the case for my testing environment. I would recommend setting
the values for the input directories, then referencing them in the
FCST/OBS_VAR<n>_NAME value, i.e. something similar to:

FCST_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
*{FCST_MODE_INPUT_DIR}*
/{custom?fmt=s}_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_0{lead?fmt=%HHH}0000_fcstfld

OBS_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
*{OBS_MODE_INPUT_DIR}*/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld

[dir]
*FCST_MODE_INPUT_DIR *= {INPUT_BASE}/fcst

*OBS_MODE_INPUT_DIR *= {INPUT_BASE}/obs

- George

On Mon, Nov 16, 2020 at 12:02 PM Davis, Mr. Wesley, Contractor, Code
7531 via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> George,
>
> I went back and looked and they came out to look like this:
>
> 12 hr lead
> 0012
>
> 120 hour lead
> 0120
>
> So, yea you were totally right on that, sorry to introduce any
confusion.
>
> Wesley
>
>
>
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research Research Applications
Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to reply to this email outside of your normal working hours.

------------------------------------------------
Subject: Formatting my mode config file for METplus usage
From: George McCabe
Time: Mon Nov 16 15:38:22 2020

Hi Wesley,

If I understand correctly, you need to include a dated subdirectory
for
each fcst and obs. You can use the init and valid filename template
tags in
the path to your file to find the correct file. I think it should be
something like this:

FCST_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
 {FCST_MODE_INPUT_DIR}/g{init?fmt=%Y%m%d%H}/
/{custom?fmt=s}_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_0{lead?fmt=%HHH}0000_fcstfld

OBS_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
 {OBS_MODE_INPUT_DIR}/g{valid?fmt=%Y%m%d%H}/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld

I believe you would refer to init in the forecast files and valid in
the
observation files.

On Mon, Nov 16, 2020 at 3:07 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
>
> George,
>
> So, our directory structure for the forecast files are as such:
>
> /g2020060100/lowcld_*_*_*_*_*2020060100_0HHH0000_fcstfld
>
> In this case, every directory would contain forecast field who's ob
fields
> are in a different directory.
>
> Does this program allow for bulk running of mode on that type of
directory
> structure? I ask, because in our case I'm not going to have just one
> directory to point at for my input and output fields.  The target is
going
> to keep moving.
>
> Thanks!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
>
> -----Original Message-----
> From: George McCabe via RT <met_help at ucar.edu>
> Sent: Monday, November 16, 2020 11:16 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531 <
> wesley.davis.ctr at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #97100] Formatting my mode config file
for
> METplus usage
>
> Hi Wesley,
>
> No, the input files do not have to be in the same directory. That is
just
> the case for my testing environment. I would recommend setting the
values
> for the input directories, then referencing them in the
> FCST/OBS_VAR<n>_NAME value, i.e. something similar to:
>
> FCST_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
> *{FCST_MODE_INPUT_DIR}*
>
>
/{custom?fmt=s}_pre_0000.0_0000.0_glob360x181_{init?fmt=%Y%m%d%H}_0{lead?fmt=%HHH}0000_fcstfld
>
> OBS_VAR1_NAME = /users/davis/scripts/python/read_NRL_binary.py
>
>
*{OBS_MODE_INPUT_DIR}*/{custom?fmt=%s}_pre_0000.0_0000.0_glob360x181_{valid?fmt=%Y%m%d%H}_00000000_fcstfld
>
>
> [dir]
> *FCST_MODE_INPUT_DIR *= {INPUT_BASE}/fcst
>
> *OBS_MODE_INPUT_DIR *= {INPUT_BASE}/obs
>
> - George
>
> On Mon, Nov 16, 2020 at 12:02 PM Davis, Mr. Wesley, Contractor, Code
7531
> via RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=97100 >
> >
> > George,
> >
> > I went back and looked and they came out to look like this:
> >
> > 12 hr lead
> > 0012
> >
> > 120 hour lead
> > 0120
> >
> > So, yea you were totally right on that, sorry to introduce any
confusion.
> >
> > Wesley
> >
> >
> >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research Research Applications
Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
>
>

--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.

------------------------------------------------