[Met_help] [rt.rap.ucar.edu #95600] History for METplus practice Failed

Julie Prestopnik via RT met_help at ucar.edu
Mon Jun 15 09:44:29 MDT 2020


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Dear Sir/Madam,
     I am working through the METplus Practical Session Guide. In Session
1: METplus Use Case: GRIDSTAT, I can't produce the data listed in the
tutorial web page. I use the following command:

1.  cd ${METPLUS_TUTORIAL_DIR}
     by the way, the directory:
        METPLUS_TUTORIAL_DIR=
         /scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
         METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0

2. run the case
       master_metplus.py \
       -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
       -c
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf

I got the following message:

.............
06/12 19:12:39.539 metplus (met_util.py:726) INFO:
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
write metplus.conf here
06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has successfully
finished running.
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
  File "/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py", line
480, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory:
'/tmp/matplotlib-8gug8iq8'

The directory: ls
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
is empty. The run does not produce the three files listed in the tutorial.

What causes the problem?
Thank you very much.
QIngfu


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: METplus practice Failed
From: John Halley Gotway
Time: Fri Jun 12 17:45:03 2020

QIngfu,

I see you're having trouble with the METplus online tutorial
exercises.

I'm going to assign this ticket to Julie Prestopnik. Please give her a
couple of days to respond.

Thanks,
John

On Fri, Jun 12, 2020 at 1:26 PM Qingfu Liu - NOAA Federal via RT <
met_help at ucar.edu> wrote:

>
> Fri Jun 12 13:26:08 2020: Request 95600 was acted upon.
> Transaction: Ticket created by qingfu.liu at noaa.gov
>        Queue: met_help
>      Subject: METplus practice Failed
>        Owner: Nobody
>   Requestors: qingfu.liu at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600 >
>
>
> Dear Sir/Madam,
>      I am working through the METplus Practical Session Guide. In
Session
> 1: METplus Use Case: GRIDSTAT, I can't produce the data listed in
the
> tutorial web page. I use the following command:
>
> 1.  cd ${METPLUS_TUTORIAL_DIR}
>      by the way, the directory:
>         METPLUS_TUTORIAL_DIR=
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
>          METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0
>
> 2. run the case
>        master_metplus.py \
>        -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
>        -c
>
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>
> I got the following message:
>
> .............
> 06/12 19:12:39.539 metplus (met_util.py:726) INFO:
>
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
> write metplus.conf here
> 06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has
successfully
> finished running.
> Error in atexit._run_exitfuncs:
> Traceback (most recent call last):
>   File "/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
line
> 480, in rmtree
>     orig_st = os.lstat(path)
> FileNotFoundError: [Errno 2] No such file or directory:
> '/tmp/matplotlib-8gug8iq8'
>
> The directory: ls
>
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
> is empty. The run does not produce the three files listed in the
tutorial.
>
> What causes the problem?
> Thank you very much.
> QIngfu
>
>

------------------------------------------------
Subject: METplus practice Failed
From: Julie Prestopnik
Time: Sat Jun 13 15:23:49 2020

Hi Qingfu.

I see that you are having trouble running the GridStat case in the
METplus
Practical Session Guide.  I think this may have to do with the recent
change to the location of modulefiles on Hera, which required us to
update
the module commands on our Existing Builds webpage.  It seems we also
needed to update the modules loaded in TutorialSetup.hera.sh. I
updated the
commands in TutorialSetup.hera.sh and ran the following commands and
was
able to get a successful run:

Specific to me for my set up:

> mkdir
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
> setenv METPLUS_TUTORIAL_DIR
> /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
> cp /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/
> TutorialSetup.hera.sh ${METPLUS_TUTORIAL_DIR}
> cp
>
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/tutorial.conf
> ${METPLUS_TUTORIAL_DIR}


For you to run also:

> module use -a /contrib/anaconda/modulefiles
> module load anaconda/latest
> module load intel/18.0.5.274
> module use -a /contrib/met/modulefiles
> module load met/9.0_anacondal
> module load nco
> module load wgrib
> module load wgrib2
> module load R
> setenv METPLUS_BUILD_BASE /contrib/METplus/METplus-3.0
> setenv MET_BUILD_BASE /contrib/met/9.0_anacondal
> setenv METPLUS_DATA
> /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus-3.0_sample_data
> setenv PATH ${METPLUS_BUILD_BASE}/ush:${PATH}
> master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> ls
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700


Please get a fresh shell and try again with the new module loads in
this
email and now in TutorialSetup.hera.sh.  Please let me know how it
goes.

Thanks!

Julie


On Fri, Jun 12, 2020 at 1:26 PM Qingfu Liu - NOAA Federal via RT <
met_help at ucar.edu> wrote:

>
> Fri Jun 12 13:26:08 2020: Request 95600 was acted upon.
> Transaction: Ticket created by qingfu.liu at noaa.gov
>        Queue: met_help
>      Subject: METplus practice Failed
>        Owner: Nobody
>   Requestors: qingfu.liu at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600 >
>
>
> Dear Sir/Madam,
>      I am working through the METplus Practical Session Guide. In
Session
> 1: METplus Use Case: GRIDSTAT, I can't produce the data listed in
the
> tutorial web page. I use the following command:
>
> 1.  cd ${METPLUS_TUTORIAL_DIR}
>      by the way, the directory:
>         METPLUS_TUTORIAL_DIR=
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
>          METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0
>
> 2. run the case
>        master_metplus.py \
>        -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
>        -c
>
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>
> I got the following message:
>
> .............
> 06/12 19:12:39.539 metplus (met_util.py:726) INFO:
>
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
> write metplus.conf here
> 06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has
successfully
> finished running.
> Error in atexit._run_exitfuncs:
> Traceback (most recent call last):
>   File "/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
line
> 480, in rmtree
>     orig_st = os.lstat(path)
> FileNotFoundError: [Errno 2] No such file or directory:
> '/tmp/matplotlib-8gug8iq8'
>
> The directory: ls
>
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
> is empty. The run does not produce the three files listed in the
tutorial.
>
> What causes the problem?
> Thank you very much.
> QIngfu
>
>

--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu

My working day may not be your working day.  Please do not feel
obliged to
reply to this email outside of your normal working hours.

------------------------------------------------
Subject: METplus practice Failed
From: Qingfu Liu - NOAA Federal
Time: Sun Jun 14 18:00:17 2020

Hi Julie,
   Thank you very much for the fix. I will continue to work through
the
practice sessions Monday.
Qingfu

On Sat, Jun 13, 2020 at 5:23 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:

> Hi Qingfu.
>
> I see that you are having trouble running the GridStat case in the
METplus
> Practical Session Guide.  I think this may have to do with the
recent
> change to the location of modulefiles on Hera, which required us to
update
> the module commands on our Existing Builds webpage.  It seems we
also
> needed to update the modules loaded in TutorialSetup.hera.sh. I
updated
> the
> commands in TutorialSetup.hera.sh and ran the following commands and
was
> able to get a successful run:
>
> Specific to me for my set up:
>
> > mkdir
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
> > setenv METPLUS_TUTORIAL_DIR
> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
> > cp /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/
> > TutorialSetup.hera.sh ${METPLUS_TUTORIAL_DIR}
> > cp
> >
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/tutorial.conf
> > ${METPLUS_TUTORIAL_DIR}
>
>
> For you to run also:
>
> > module use -a /contrib/anaconda/modulefiles
> > module load anaconda/latest
> > module load intel/18.0.5.274
> > module use -a /contrib/met/modulefiles
> > module load met/9.0_anacondal
> > module load nco
> > module load wgrib
> > module load wgrib2
> > module load R
> > setenv METPLUS_BUILD_BASE /contrib/METplus/METplus-3.0
> > setenv MET_BUILD_BASE /contrib/met/9.0_anacondal
> > setenv METPLUS_DATA
> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus-3.0_sample_data
> > setenv PATH ${METPLUS_BUILD_BASE}/ush:${PATH}
> > master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
> >
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > ls
> >
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
>
>
> Please get a fresh shell and try again with the new module loads in
this
> email and now in TutorialSetup.hera.sh.  Please let me know how it
goes.
>
> Thanks!
>
> Julie
>
>
> On Fri, Jun 12, 2020 at 1:26 PM Qingfu Liu - NOAA Federal via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Fri Jun 12 13:26:08 2020: Request 95600 was acted upon.
> > Transaction: Ticket created by qingfu.liu at noaa.gov
> >        Queue: met_help
> >      Subject: METplus practice Failed
> >        Owner: Nobody
> >   Requestors: qingfu.liu at noaa.gov
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600 >
> >
> >
> > Dear Sir/Madam,
> >      I am working through the METplus Practical Session Guide. In
Session
> > 1: METplus Use Case: GRIDSTAT, I can't produce the data listed in
the
> > tutorial web page. I use the following command:
> >
> > 1.  cd ${METPLUS_TUTORIAL_DIR}
> >      by the way, the directory:
> >         METPLUS_TUTORIAL_DIR=
> >
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
> >          METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0
> >
> > 2. run the case
> >        master_metplus.py \
> >        -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
> >        -c
> >
> >
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> >
> > I got the following message:
> >
> > .............
> > 06/12 19:12:39.539 metplus (met_util.py:726) INFO:
> >
> >
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
> > write metplus.conf here
> > 06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has
> successfully
> > finished running.
> > Error in atexit._run_exitfuncs:
> > Traceback (most recent call last):
> >   File
"/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py", line
> > 480, in rmtree
> >     orig_st = os.lstat(path)
> > FileNotFoundError: [Errno 2] No such file or directory:
> > '/tmp/matplotlib-8gug8iq8'
> >
> > The directory: ls
> >
> >
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
> > is empty. The run does not produce the three files listed in the
> tutorial.
> >
> > What causes the problem?
> > Thank you very much.
> > QIngfu
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day.  Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>

------------------------------------------------
Subject: METplus practice Failed
From: Qingfu Liu - NOAA Federal
Time: Mon Jun 15 07:48:51 2020

Hi Julie,
   I still have the same problem. I am using .cshrc in my login (I
also
tried bash, and have the same problem). Some environment variables
might be
set up incorrectly, the python utility may have a wrong path. I copied
both METplus-3.0 and METplus_Tutorial from your home
directory:  /scratch1/BMC/dtc/Julie.Prestopnik/METplus/
The log file:
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/logs
shows that the python scripts look for the file:
/contrib/METplus/METplus-3.0/bin/grid_stat
which does not exist. I did not find the bin directory inside the
METplus
directory.
Can you take a look again at what is wrong with my setup?
   Thank you very much.
Qingfu

The error message: ( I can't produce the three files)

master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf

.............
06/15 13:30:15.807 metplus (met_util.py:216) INFO: METplus has
successfully
finished running.
Error in atexit._run_exitfuncs:
Traceback (most recent call last):
  File "/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
line
480, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory:
'/tmp/matplotlib-gf8kaul3'


The log files are here:
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/logs

On Sun, Jun 14, 2020 at 7:59 PM Qingfu Liu - NOAA Federal <
qingfu.liu at noaa.gov> wrote:

> Hi Julie,
>    Thank you very much for the fix. I will continue to work through
the
> practice sessions Monday.
> Qingfu
>
> On Sat, Jun 13, 2020 at 5:23 PM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Qingfu.
>>
>> I see that you are having trouble running the GridStat case in the
METplus
>> Practical Session Guide.  I think this may have to do with the
recent
>> change to the location of modulefiles on Hera, which required us to
update
>> the module commands on our Existing Builds webpage.  It seems we
also
>> needed to update the modules loaded in TutorialSetup.hera.sh. I
updated
>> the
>> commands in TutorialSetup.hera.sh and ran the following commands
and was
>> able to get a successful run:
>>
>> Specific to me for my set up:
>>
>> > mkdir
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
>> > setenv METPLUS_TUTORIAL_DIR
>> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
>> > cp /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/
>> > TutorialSetup.hera.sh ${METPLUS_TUTORIAL_DIR}
>> > cp
>> >
>>
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/tutorial.conf
>> > ${METPLUS_TUTORIAL_DIR}
>>
>>
>> For you to run also:
>>
>> > module use -a /contrib/anaconda/modulefiles
>> > module load anaconda/latest
>> > module load intel/18.0.5.274
>> > module use -a /contrib/met/modulefiles
>> > module load met/9.0_anacondal
>> > module load nco
>> > module load wgrib
>> > module load wgrib2
>> > module load R
>> > setenv METPLUS_BUILD_BASE /contrib/METplus/METplus-3.0
>> > setenv MET_BUILD_BASE /contrib/met/9.0_anacondal
>> > setenv METPLUS_DATA
>> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus-
3.0_sample_data
>> > setenv PATH ${METPLUS_BUILD_BASE}/ush:${PATH}
>> > master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
>> >
>>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>> > ls
>> >
>>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
>>
>>
>> Please get a fresh shell and try again with the new module loads in
this
>> email and now in TutorialSetup.hera.sh.  Please let me know how it
goes.
>>
>> Thanks!
>>
>> Julie
>>
>>
>> On Fri, Jun 12, 2020 at 1:26 PM Qingfu Liu - NOAA Federal via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > Fri Jun 12 13:26:08 2020: Request 95600 was acted upon.
>> > Transaction: Ticket created by qingfu.liu at noaa.gov
>> >        Queue: met_help
>> >      Subject: METplus practice Failed
>> >        Owner: Nobody
>> >   Requestors: qingfu.liu at noaa.gov
>> >       Status: new
>> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600 >
>> >
>> >
>> > Dear Sir/Madam,
>> >      I am working through the METplus Practical Session Guide. In
>> Session
>> > 1: METplus Use Case: GRIDSTAT, I can't produce the data listed in
the
>> > tutorial web page. I use the following command:
>> >
>> > 1.  cd ${METPLUS_TUTORIAL_DIR}
>> >      by the way, the directory:
>> >         METPLUS_TUTORIAL_DIR=
>> >
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
>> >          METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0
>> >
>> > 2. run the case
>> >        master_metplus.py \
>> >        -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
>> >        -c
>> >
>> >
>>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>> >
>> > I got the following message:
>> >
>> > .............
>> > 06/12 19:12:39.539 metplus (met_util.py:726) INFO:
>> >
>> >
>>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
>> > write metplus.conf here
>> > 06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has
>> successfully
>> > finished running.
>> > Error in atexit._run_exitfuncs:
>> > Traceback (most recent call last):
>> >   File
"/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
>> line
>> > 480, in rmtree
>> >     orig_st = os.lstat(path)
>> > FileNotFoundError: [Errno 2] No such file or directory:
>> > '/tmp/matplotlib-8gug8iq8'
>> >
>> > The directory: ls
>> >
>> >
>>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
>> > is empty. The run does not produce the three files listed in the
>> tutorial.
>> >
>> > What causes the problem?
>> > Thank you very much.
>> > QIngfu
>> >
>> >
>>
>> --
>> Julie Prestopnik
>> Software Engineer
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> My working day may not be your working day.  Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>

------------------------------------------------
Subject: METplus practice Failed
From: Qingfu Liu - NOAA Federal
Time: Mon Jun 15 08:01:31 2020

Hi Julie,
   I just ran this successfully and created the three files listed on
the
Tutorial page.  I hardwired the MET_INSTALL_DIR which caused the
problem.
You can discard this request. Thank you very much.
QIngfu

On Mon, Jun 15, 2020 at 9:48 AM Qingfu Liu - NOAA Federal <
qingfu.liu at noaa.gov> wrote:

> Hi Julie,
>    I still have the same problem. I am using .cshrc in my login (I
also
> tried bash, and have the same problem). Some environment variables
might be
> set up incorrectly, the python utility may have a wrong path. I
copied
> both METplus-3.0 and METplus_Tutorial from your home
> directory:  /scratch1/BMC/dtc/Julie.Prestopnik/METplus/
> The log file:
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/logs
> shows that the python scripts look for the file:
> /contrib/METplus/METplus-3.0/bin/grid_stat
> which does not exist. I did not find the bin directory inside the
METplus
> directory.
> Can you take a look again at what is wrong with my setup?
>    Thank you very much.
> Qingfu
>
> The error message: ( I can't produce the three files)
>
> master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>
> .............
> 06/15 13:30:15.807 metplus (met_util.py:216) INFO: METplus has
> successfully finished running.
> Error in atexit._run_exitfuncs:
> Traceback (most recent call last):
>   File "/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
line
> 480, in rmtree
>     orig_st = os.lstat(path)
> FileNotFoundError: [Errno 2] No such file or directory:
> '/tmp/matplotlib-gf8kaul3'
>
>
> The log files are here:
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/logs
>
> On Sun, Jun 14, 2020 at 7:59 PM Qingfu Liu - NOAA Federal <
> qingfu.liu at noaa.gov> wrote:
>
>> Hi Julie,
>>    Thank you very much for the fix. I will continue to work through
the
>> practice sessions Monday.
>> Qingfu
>>
>> On Sat, Jun 13, 2020 at 5:23 PM Julie Prestopnik via RT <
>> met_help at ucar.edu> wrote:
>>
>>> Hi Qingfu.
>>>
>>> I see that you are having trouble running the GridStat case in the
>>> METplus
>>> Practical Session Guide.  I think this may have to do with the
recent
>>> change to the location of modulefiles on Hera, which required us
to
>>> update
>>> the module commands on our Existing Builds webpage.  It seems we
also
>>> needed to update the modules loaded in TutorialSetup.hera.sh. I
updated
>>> the
>>> commands in TutorialSetup.hera.sh and ran the following commands
and was
>>> able to get a successful run:
>>>
>>> Specific to me for my set up:
>>>
>>> > mkdir
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
>>> > setenv METPLUS_TUTORIAL_DIR
>>> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
>>> > cp /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/
>>> > TutorialSetup.hera.sh ${METPLUS_TUTORIAL_DIR}
>>> > cp
>>> >
>>>
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/tutorial.conf
>>> > ${METPLUS_TUTORIAL_DIR}
>>>
>>>
>>> For you to run also:
>>>
>>> > module use -a /contrib/anaconda/modulefiles
>>> > module load anaconda/latest
>>> > module load intel/18.0.5.274
>>> > module use -a /contrib/met/modulefiles
>>> > module load met/9.0_anacondal
>>> > module load nco
>>> > module load wgrib
>>> > module load wgrib2
>>> > module load R
>>> > setenv METPLUS_BUILD_BASE /contrib/METplus/METplus-3.0
>>> > setenv MET_BUILD_BASE /contrib/met/9.0_anacondal
>>> > setenv METPLUS_DATA
>>> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus-
3.0_sample_data
>>> > setenv PATH ${METPLUS_BUILD_BASE}/ush:${PATH}
>>> > master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
>>> >
>>>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>>> > ls
>>> >
>>>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
>>>
>>>
>>> Please get a fresh shell and try again with the new module loads
in this
>>> email and now in TutorialSetup.hera.sh.  Please let me know how it
goes.
>>>
>>> Thanks!
>>>
>>> Julie
>>>
>>>
>>> On Fri, Jun 12, 2020 at 1:26 PM Qingfu Liu - NOAA Federal via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>> >
>>> > Fri Jun 12 13:26:08 2020: Request 95600 was acted upon.
>>> > Transaction: Ticket created by qingfu.liu at noaa.gov
>>> >        Queue: met_help
>>> >      Subject: METplus practice Failed
>>> >        Owner: Nobody
>>> >   Requestors: qingfu.liu at noaa.gov
>>> >       Status: new
>>> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600
>>> >
>>> >
>>> >
>>> > Dear Sir/Madam,
>>> >      I am working through the METplus Practical Session Guide.
In
>>> Session
>>> > 1: METplus Use Case: GRIDSTAT, I can't produce the data listed
in the
>>> > tutorial web page. I use the following command:
>>> >
>>> > 1.  cd ${METPLUS_TUTORIAL_DIR}
>>> >      by the way, the directory:
>>> >         METPLUS_TUTORIAL_DIR=
>>> >
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
>>> >          METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0
>>> >
>>> > 2. run the case
>>> >        master_metplus.py \
>>> >        -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
>>> >        -c
>>> >
>>> >
>>>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>>> >
>>> > I got the following message:
>>> >
>>> > .............
>>> > 06/12 19:12:39.539 metplus (met_util.py:726) INFO:
>>> >
>>> >
>>>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
>>> > write metplus.conf here
>>> > 06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has
>>> successfully
>>> > finished running.
>>> > Error in atexit._run_exitfuncs:
>>> > Traceback (most recent call last):
>>> >   File
"/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
>>> line
>>> > 480, in rmtree
>>> >     orig_st = os.lstat(path)
>>> > FileNotFoundError: [Errno 2] No such file or directory:
>>> > '/tmp/matplotlib-8gug8iq8'
>>> >
>>> > The directory: ls
>>> >
>>> >
>>>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
>>> > is empty. The run does not produce the three files listed in the
>>> tutorial.
>>> >
>>> > What causes the problem?
>>> > Thank you very much.
>>> > QIngfu
>>> >
>>> >
>>>
>>> --
>>> Julie Prestopnik
>>> Software Engineer
>>> National Center for Atmospheric Research
>>> Research Applications Laboratory
>>> Phone: 303.497.8399
>>> Email: jpresto at ucar.edu
>>>
>>> My working day may not be your working day.  Please do not feel
obliged
>>> to
>>> reply to this email outside of your normal working hours.
>>>
>>>

------------------------------------------------
Subject: METplus practice Failed
From: Julie Prestopnik
Time: Mon Jun 15 09:43:43 2020

Great, Qingfu!  Thank you for letting us know.  I'll go ahead and
close
this ticket.  Please feel free to start a new ticket if you have any
other
questions.

Julie

On Mon, Jun 15, 2020 at 8:01 AM Qingfu Liu - NOAA Federal via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600 >
>
> Hi Julie,
>    I just ran this successfully and created the three files listed
on the
> Tutorial page.  I hardwired the MET_INSTALL_DIR which caused the
problem.
> You can discard this request. Thank you very much.
> QIngfu
>
> On Mon, Jun 15, 2020 at 9:48 AM Qingfu Liu - NOAA Federal <
> qingfu.liu at noaa.gov> wrote:
>
> > Hi Julie,
> >    I still have the same problem. I am using .cshrc in my login (I
also
> > tried bash, and have the same problem). Some environment variables
might
> be
> > set up incorrectly, the python utility may have a wrong path. I
copied
> > both METplus-3.0 and METplus_Tutorial from your home
> > directory:  /scratch1/BMC/dtc/Julie.Prestopnik/METplus/
> > The log file:
> >
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/logs
> > shows that the python scripts look for the file:
> > /contrib/METplus/METplus-3.0/bin/grid_stat
> > which does not exist. I did not find the bin directory inside the
METplus
> > directory.
> > Can you take a look again at what is wrong with my setup?
> >    Thank you very much.
> > Qingfu
> >
> > The error message: ( I can't produce the three files)
> >
> > master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
> >
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> >
> > .............
> > 06/15 13:30:15.807 metplus (met_util.py:216) INFO: METplus has
> > successfully finished running.
> > Error in atexit._run_exitfuncs:
> > Traceback (most recent call last):
> >   File
"/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py", line
> > 480, in rmtree
> >     orig_st = os.lstat(path)
> > FileNotFoundError: [Errno 2] No such file or directory:
> > '/tmp/matplotlib-gf8kaul3'
> >
> >
> > The log files are here:
> >
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/logs
> >
> > On Sun, Jun 14, 2020 at 7:59 PM Qingfu Liu - NOAA Federal <
> > qingfu.liu at noaa.gov> wrote:
> >
> >> Hi Julie,
> >>    Thank you very much for the fix. I will continue to work
through the
> >> practice sessions Monday.
> >> Qingfu
> >>
> >> On Sat, Jun 13, 2020 at 5:23 PM Julie Prestopnik via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>> Hi Qingfu.
> >>>
> >>> I see that you are having trouble running the GridStat case in
the
> >>> METplus
> >>> Practical Session Guide.  I think this may have to do with the
recent
> >>> change to the location of modulefiles on Hera, which required us
to
> >>> update
> >>> the module commands on our Existing Builds webpage.  It seems we
also
> >>> needed to update the modules loaded in TutorialSetup.hera.sh. I
> updated
> >>> the
> >>> commands in TutorialSetup.hera.sh and ran the following commands
and
> was
> >>> able to get a successful run:
> >>>
> >>> Specific to me for my set up:
> >>>
> >>> > mkdir
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
> >>> > setenv METPLUS_TUTORIAL_DIR
> >>> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial_jp
> >>> > cp
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/
> >>> > TutorialSetup.hera.sh ${METPLUS_TUTORIAL_DIR}
> >>> > cp
> >>> >
> >>>
>
/scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus_Tutorial/tutorial.conf
> >>> > ${METPLUS_TUTORIAL_DIR}
> >>>
> >>>
> >>> For you to run also:
> >>>
> >>> > module use -a /contrib/anaconda/modulefiles
> >>> > module load anaconda/latest
> >>> > module load intel/18.0.5.274
> >>> > module use -a /contrib/met/modulefiles
> >>> > module load met/9.0_anacondal
> >>> > module load nco
> >>> > module load wgrib
> >>> > module load wgrib2
> >>> > module load R
> >>> > setenv METPLUS_BUILD_BASE /contrib/METplus/METplus-3.0
> >>> > setenv MET_BUILD_BASE /contrib/met/9.0_anacondal
> >>> > setenv METPLUS_DATA
> >>> > /scratch1/BMC/dtc/Julie.Prestopnik/METplus/METplus-
3.0_sample_data
> >>> > setenv PATH ${METPLUS_BUILD_BASE}/ush:${PATH}
> >>> > master_metplus.py -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf -c
> >>> >
> >>>
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> >>> > ls
> >>> >
> >>>
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
> >>>
> >>>
> >>> Please get a fresh shell and try again with the new module loads
in
> this
> >>> email and now in TutorialSetup.hera.sh.  Please let me know how
it
> goes.
> >>>
> >>> Thanks!
> >>>
> >>> Julie
> >>>
> >>>
> >>> On Fri, Jun 12, 2020 at 1:26 PM Qingfu Liu - NOAA Federal via RT
<
> >>> met_help at ucar.edu> wrote:
> >>>
> >>> >
> >>> > Fri Jun 12 13:26:08 2020: Request 95600 was acted upon.
> >>> > Transaction: Ticket created by qingfu.liu at noaa.gov
> >>> >        Queue: met_help
> >>> >      Subject: METplus practice Failed
> >>> >        Owner: Nobody
> >>> >   Requestors: qingfu.liu at noaa.gov
> >>> >       Status: new
> >>> >  Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95600
> >>> >
> >>> >
> >>> >
> >>> > Dear Sir/Madam,
> >>> >      I am working through the METplus Practical Session Guide.
In
> >>> Session
> >>> > 1: METplus Use Case: GRIDSTAT, I can't produce the data listed
in the
> >>> > tutorial web page. I use the following command:
> >>> >
> >>> > 1.  cd ${METPLUS_TUTORIAL_DIR}
> >>> >      by the way, the directory:
> >>> >         METPLUS_TUTORIAL_DIR=
> >>> >
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial
> >>> >          METPLUS_BUILD_BASE=/contrib/METplus/METplus-3.0
> >>> >
> >>> > 2. run the case
> >>> >        master_metplus.py \
> >>> >        -c ${METPLUS_TUTORIAL_DIR}/tutorial.conf \
> >>> >        -c
> >>> >
> >>> >
> >>>
>
${METPLUS_BUILD_BASE}/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> >>> >
> >>> > I got the following message:
> >>> >
> >>> > .............
> >>> > 06/12 19:12:39.539 metplus (met_util.py:726) INFO:
> >>> >
> >>> >
> >>>
>
/scratch1/NCEPDEV/global/Qingfu.Liu/METplus/METplus_Tutorial/output/metplus_final.conf:
> >>> > write metplus.conf here
> >>> > 06/12 19:12:39.541 metplus (met_util.py:216) INFO: METplus has
> >>> successfully
> >>> > finished running.
> >>> > Error in atexit._run_exitfuncs:
> >>> > Traceback (most recent call last):
> >>> >   File
"/contrib/anaconda/anaconda3/latest/lib/python3.7/shutil.py",
> >>> line
> >>> > 480, in rmtree
> >>> >     orig_st = os.lstat(path)
> >>> > FileNotFoundError: [Errno 2] No such file or directory:
> >>> > '/tmp/matplotlib-8gug8iq8'
> >>> >
> >>> > The directory: ls
> >>> >
> >>> >
> >>>
>
${METPLUS_TUTORIAL_DIR}/output/met_tool_wrapper/GridStat/GridStat/2005080700
> >>> > is empty. The run does not produce the three files listed in
the
> >>> tutorial.
> >>> >
> >>> > What causes the problem?
> >>> > Thank you very much.
> >>> > QIngfu
> >>> >
> >>> >
> >>>
> >>> --
> >>> Julie Prestopnik
> >>> Software Engineer
> >>> National Center for Atmospheric Research
> >>> Research Applications Laboratory
> >>> Phone: 303.497.8399
> >>> Email: jpresto at ucar.edu
> >>>
> >>> My working day may not be your working day.  Please do not feel
obliged
> >>> to
> >>> reply to this email outside of your normal working hours.
> >>>
> >>>
>
>

--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu

My working day may not be your working day.  Please do not feel
obliged to
reply to this email outside of your normal working hours.

------------------------------------------------


More information about the Met_help mailing list