[Met_help] [rt.rap.ucar.edu #95144] History for Complaints when running master_metplus.py
Julie Prestopnik via RT
met_help at ucar.edu
Mon May 4 14:38:12 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good afternoon,
I'm trying to learn MetPlus and am following all the steps in the user's
guide. When going through the user guide, I experienced an issue testing
the following command:
master_metplus.py -c parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
I received the following:
[Edward.Strobach at v71a3 ush]$ master_metplus.py -c
use_cases/met_tool_wrapper/GridStat/GridStat.conf
Traceback (most recent call last):
File "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-packages/matplotlib/backends/backend_webagg.py",
line 26, in <module>
import tornado
ModuleNotFoundError: No module named 'tornado'
During handling of the above exception, another exception occurred:
*Traceback (most recent call last): File
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-3.0/ush/master_metplus.py",
line 64, in <module> from cyclone_plotter_wrapper import
CyclonePlotterWrapper File
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-3.0/ush/cyclone_plotter_wrapper.py",
line 20, in <module> import matplotlib.pyplot as plt File
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-packages/matplotlib/pyplot.py",
line 2355, in <module> switch_backend(rcParams["backend"]) File
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-packages/matplotlib/pyplot.py",
line 221, in switch_backend backend_mod =
importlib.import_module(backend_name) File
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/importlib/__init__.py",
line 126, in import_module return
_bootstrap._gcd_import(name[level:], package, level) File
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-packages/matplotlib/backends/backend_webagg.py",
line 28, in <module> raise RuntimeError("The WebAgg backend
requires Tornado.")RuntimeError: The WebAgg backend requires Tornado.*
You can see that I'm using python3.6.3 on the dell and that my path
has been set in bash to Julie's directory path for metplus-3.0.
The WebAgg error is something I've encountered before related to
plotting, but I assumed that this would have been detected before.
This issue comes up when running a python program outside of the
python command prompt. To remedy this I put the following line in my
own scripts; I do this because I run my own python scripts in batch
mode.
#!/usr/bin/python
import matplotlib as mpl
mpl.use("Agg")
I'm intending to use Metplus to do some airquality verification with
airnow obs, and perhaps other data sources. Eventually I want to run
metplus in cron mode if possible
Thanks!
--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Complaints when running master_metplus.py
From: John Halley Gotway
Time: Mon May 04 11:06:29 2020
Hello Ed,
Sorry to hear you're running into these issues with METplus. As we
discussed on the METplus telecon, it's like environment issues we'll
just
need to sort out. I'm assigning this ticket to Julie Prestopnik who
does
the installations on WCOSS and is best suited to debug it.
Thanks,
John Halley Gotway
On Mon, May 4, 2020 at 10:55 AM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> Mon May 04 10:55:21 2020: Request 95144 was acted upon.
> Transaction: Ticket created by edward.strobach at noaa.gov
> Queue: met_help
> Subject: Complaints when running master_metplus.py
> Owner: Nobody
> Requestors: edward.strobach at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95144 >
>
>
> Good afternoon,
>
> I'm trying to learn MetPlus and am following all the steps in the
user's
> guide. When going through the user guide, I experienced an issue
testing
> the following command:
>
> master_metplus.py -c
parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>
> I received the following:
>
> [Edward.Strobach at v71a3 ush]$ master_metplus.py -c
> use_cases/met_tool_wrapper/GridStat/GridStat.conf
> Traceback (most recent call last):
> File
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> line 26, in <module>
> import tornado
> ModuleNotFoundError: No module named 'tornado'
>
> During handling of the above exception, another exception occurred:
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *Traceback (most recent call last): File
>
>
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/master_metplus.py",
> line 64, in <module> from cyclone_plotter_wrapper import
> CyclonePlotterWrapper File
>
>
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/cyclone_plotter_wrapper.py",
> line 20, in <module> import matplotlib.pyplot as plt File
>
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/pyplot.py",
> line 2355, in <module> switch_backend(rcParams["backend"]) File
>
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/pyplot.py",
> line 221, in switch_backend backend_mod =
> importlib.import_module(backend_name) File
>
>
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/importlib/__init__.py",
> line 126, in import_module return
> _bootstrap._gcd_import(name[level:], package, level) File
>
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> line 28, in <module> raise RuntimeError("The WebAgg backend
> requires Tornado.")RuntimeError: The WebAgg backend requires
Tornado.*
>
> You can see that I'm using python3.6.3 on the dell and that my path
> has been set in bash to Julie's directory path for metplus-3.0.
>
> The WebAgg error is something I've encountered before related to
> plotting, but I assumed that this would have been detected before.
>
> This issue comes up when running a python program outside of the
> python command prompt. To remedy this I put the following line in
my
> own scripts; I do this because I run my own python scripts in batch
> mode.
> #!/usr/bin/python
> import matplotlib as mpl
> mpl.use("Agg")
>
> I'm intending to use Metplus to do some airquality verification with
> airnow obs, and perhaps other data sources. Eventually I want to
run
> metplus in cron mode if possible
>
> Thanks!
>
>
>
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>
------------------------------------------------
Subject: Complaints when running master_metplus.py
From: Julie Prestopnik
Time: Mon May 04 12:09:30 2020
Hi Ed.
Unfortunately, I am unable to reproduce the issue you are
experiencing. I
will walk you through the process of what I did so that you can see if
there are any differences.
First, I logged on to venus and set up my environment by running:
>
> - module use
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/modulefiles/
> - module load met/9.0
> - module load NCO/4.7.0
> - module load grib_util/1.1.1
> - export PATH=
>
${PATH}:/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush
>
>
Then, I copied your METplus command, adding in the full path to the
configuration file, since I wasn't at a location relative to parm. I
also
added the full path to my venus.jpresto.conf file so that my
OUTPUT_BASE
would be set correctly and got a successful run.
[Julie.Prestopnik at v71a1 ~]$ master_metplus.py -c
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> -c
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/venus.jpresto.conf
>
> 05/04 17:59:05.972 METplus (met_util.py:79) INFO: Starting METplus
v3.0
>
> 05/04 17:59:05.972 metplus (config_metplus.py:77) INFO: Starting
METplus
> configuration setup.
>
> 05/04 17:59:05.993 metplus (config_launcher.py:200) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_system.conf:
> Parsed this file
>
> 05/04 17:59:06.020 metplus (config_launcher.py:200) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_data.conf:
> Parsed this file
>
> 05/04 17:59:06.030 metplus (config_launcher.py:200) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_runtime.conf:
> Parsed this file
>
> 05/04 17:59:06.060 metplus (config_launcher.py:200) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_logging.conf:
> Parsed this file
>
> 05/04 17:59:06.076 metplus (config_launcher.py:200) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf:
> Parsed this file
>
> 05/04 17:59:06.077 metplus (config_launcher.py:200) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/venus.jpresto.conf:
> Parsed this file
>
> 05/04 17:59:06.079 metplus (config_launcher.py:393) INFO: Adding:
> config.LOG_TIMESTAMP='20200504175906'
>
> 05/04 17:59:06.079 metplus (config_launcher.py:399) INFO: Replace
[config]
> LOG_METPLUS with
>
'/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/logs/master_metplus.log.20200504175906'
>
> 05/04 17:59:06.081 metplus (config_launcher.py:268) INFO: Setting
[dir]
> METPLUS_BASE to
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0
>
> 05/04 17:59:06.081 metplus (config_launcher.py:268) INFO: Setting
[dir]
> PARM_BASE to
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm
>
> 05/04 17:59:06.081 metplus (config_launcher.py:275) INFO:
METPLUS_CONF:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/metplus_final.conf
> written here.
>
> 05/04 17:59:06.082 metplus (config_metplus.py:148) INFO: Completed
METplus
> configuration setup.
>
> 05/04 17:59:06.082 metplus (met_util.py:89) INFO: Running METplus
v3.0
> called with command:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/master_metplus.py
> -c
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> -c
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/venus.jpresto.conf
>
> 05/04 17:59:06.111 metplus (met_util.py:815) INFO:
> ****************************************
>
> 05/04 17:59:06.111 metplus (met_util.py:816) INFO: * Running METplus
>
> 05/04 17:59:06.111 metplus (met_util.py:818) INFO: * at init time:
> 200508070000
>
> 05/04 17:59:06.112 metplus (met_util.py:821) INFO:
> ****************************************
>
> 05/04 17:59:06.112 metplus.GridStat (compare_gridded_wrapper.py:170)
INFO:
> Processing forecast lead 12 hours
>
> 05/04 17:59:06.122 metplus.GridStat (command_runner.py:90) INFO:
COMMAND:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.0/bin/grid_stat
> -v 2
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0_sample_data/met_test/data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0_sample_data/met_test/new/ST2ml2005080712_A03h.nc
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/met_config/GridStatConfig_wrapped
> -outdir
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/met_tool_wrapper/GridStat/GridStat/2005080700
>
> 05/04 17:59:06.974 metplus (met_util.py:726) INFO:
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/metplus_final.conf:
> write metplus.conf here
>
> 05/04 17:59:06.976 metplus (met_util.py:216) INFO: METplus has
> successfully finished running.
>
> [Julie.Prestopnik at v71a1 ~]$
>
Are you using the GridStat.conf file from the release:
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
or have you made changes in a different area and are using a different
GridStat.conf? If so, please send along the full path to that config
file.
Also, you said you received this error:
> [Edward.Strobach at v71a3 ush]$ master_metplus.py -c
> use_cases/met_tool_wrapper/GridStat/GridStat.conf
> Traceback (most recent call last):
> File
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> line 26, in <module>
> import tornado
> ModuleNotFoundError: No module named 'tornado'
>
I tried simply loading python and importing "tornado", but received
the
following error:
> [Julie.Prestopnik at v72a2 ~]$ which python
>
> /usrx/local/prod/packages/python/3.6.3/bin/python
>
> [Julie.Prestopnik at v72a2 ~]$ python
>
> Python 3.6.3 (default, Feb 25 2019, 15:56:15)
>
> [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux
>
> Type "help", "copyright", "credits" or "license" for more
information.
>
> >>> import tornado
>
> Traceback (most recent call last):
>
> File "<stdin>", line 1, in <module>
>
> ModuleNotFoundError: No module named 'tornado'
>
I am not familiar with matplotlib, but I thought maybe I needed to run
those commands first and then try importing tornado, but that also did
not
work:
> >>> import matplotlib as mpl
>
> >>> mpl.use("Agg")
>
> >>> import tornado
>
> Traceback (most recent call last):
>
> File "<stdin>", line 1, in <module>
>
> ModuleNotFoundError: No module named 'tornado'
>
> >>>
>
As far as I can tell, this issue seems unrelated to the default
GridStat.conf file, which is why I was wondering if you're using a
different file. Otherwise, it seems like that this is an issue being
caused by the environment.
Julie
On Mon, May 4, 2020 at 11:07 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95144 >
>
> Hello Ed,
>
> Sorry to hear you're running into these issues with METplus. As we
> discussed on the METplus telecon, it's like environment issues we'll
just
> need to sort out. I'm assigning this ticket to Julie Prestopnik who
does
> the installations on WCOSS and is best suited to debug it.
>
> Thanks,
> John Halley Gotway
>
> On Mon, May 4, 2020 at 10:55 AM Edward Strobach - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > Mon May 04 10:55:21 2020: Request 95144 was acted upon.
> > Transaction: Ticket created by edward.strobach at noaa.gov
> > Queue: met_help
> > Subject: Complaints when running master_metplus.py
> > Owner: Nobody
> > Requestors: edward.strobach at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95144 >
> >
> >
> > Good afternoon,
> >
> > I'm trying to learn MetPlus and am following all the steps in the
user's
> > guide. When going through the user guide, I experienced an issue
testing
> > the following command:
> >
> > master_metplus.py -c
> parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> >
> > I received the following:
> >
> > [Edward.Strobach at v71a3 ush]$ master_metplus.py -c
> > use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > Traceback (most recent call last):
> > File
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> > line 26, in <module>
> > import tornado
> > ModuleNotFoundError: No module named 'tornado'
> >
> > During handling of the above exception, another exception
occurred:
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > *Traceback (most recent call last): File
> >
> >
>
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/master_metplus.py",
> > line 64, in <module> from cyclone_plotter_wrapper import
> > CyclonePlotterWrapper File
> >
> >
>
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/cyclone_plotter_wrapper.py",
> > line 20, in <module> import matplotlib.pyplot as plt File
> >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/pyplot.py",
> > line 2355, in <module> switch_backend(rcParams["backend"])
File
> >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/pyplot.py",
> > line 221, in switch_backend backend_mod =
> > importlib.import_module(backend_name) File
> >
> >
>
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/importlib/__init__.py",
> > line 126, in import_module return
> > _bootstrap._gcd_import(name[level:], package, level) File
> >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> > line 28, in <module> raise RuntimeError("The WebAgg backend
> > requires Tornado.")RuntimeError: The WebAgg backend requires
Tornado.*
> >
> > You can see that I'm using python3.6.3 on the dell and that my
path
> > has been set in bash to Julie's directory path for metplus-3.0.
> >
> > The WebAgg error is something I've encountered before related to
> > plotting, but I assumed that this would have been detected before.
> >
> > This issue comes up when running a python program outside of the
> > python command prompt. To remedy this I put the following line in
my
> > own scripts; I do this because I run my own python scripts in
batch
> > mode.
> > #!/usr/bin/python
> > import matplotlib as mpl
> > mpl.use("Agg")
> >
> > I'm intending to use Metplus to do some airquality verification
with
> > airnow obs, and perhaps other data sources. Eventually I want to
run
> > metplus in cron mode if possible
> >
> > Thanks!
> >
> >
> >
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
> >
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Complaints when running master_metplus.py
From: Edward Strobach - NOAA Affiliate
Time: Mon May 04 12:32:05 2020
Hi Julie, thanks for your help. I first ran your command as a test
and it
turned out to be successful. Afterwards I copied over your
venus*.conf
file to my MetPlus directory and reissued the command with my
MetPlus/ush/master*py script instead of your, and that worked.
Perhaps I'm
using the wrong python version. I thought that I was using the same
one as
you until I saw a reference to python3.6.3. I was using some other
python
3 version. After using 3.6.3, the other issues related to cartopy
cleared
up. I'll continue to go through the manual. It may take some time
getting
used to metplus, and I may send a ticket from time to time if things
aren't
quite clear. I think I'm okay for now.
On Mon, May 4, 2020 at 2:09 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Ed.
>
> Unfortunately, I am unable to reproduce the issue you are
experiencing. I
> will walk you through the process of what I did so that you can see
if
> there are any differences.
>
> First, I logged on to venus and set up my environment by running:
>
> >
> > - module use
> >
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/modulefiles/
> > - module load met/9.0
> > - module load NCO/4.7.0
> > - module load grib_util/1.1.1
> > - export PATH=
> >
>
${PATH}:/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush
> >
> >
> Then, I copied your METplus command, adding in the full path to the
> configuration file, since I wasn't at a location relative to parm.
I also
> added the full path to my venus.jpresto.conf file so that my
OUTPUT_BASE
> would be set correctly and got a successful run.
>
> [Julie.Prestopnik at v71a1 ~]$ master_metplus.py -c
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > -c
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/venus.jpresto.conf
> >
> > 05/04 17:59:05.972 METplus (met_util.py:79) INFO: Starting METplus
v3.0
> >
> > 05/04 17:59:05.972 metplus (config_metplus.py:77) INFO: Starting
METplus
> > configuration setup.
> >
> > 05/04 17:59:05.993 metplus (config_launcher.py:200) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_system.conf:
> > Parsed this file
> >
> > 05/04 17:59:06.020 metplus (config_launcher.py:200) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_data.conf:
> > Parsed this file
> >
> > 05/04 17:59:06.030 metplus (config_launcher.py:200) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_runtime.conf:
> > Parsed this file
> >
> > 05/04 17:59:06.060 metplus (config_launcher.py:200) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/metplus_config/metplus_logging.conf:
> > Parsed this file
> >
> > 05/04 17:59:06.076 metplus (config_launcher.py:200) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf:
> > Parsed this file
> >
> > 05/04 17:59:06.077 metplus (config_launcher.py:200) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/venus.jpresto.conf:
> > Parsed this file
> >
> > 05/04 17:59:06.079 metplus (config_launcher.py:393) INFO: Adding:
> > config.LOG_TIMESTAMP='20200504175906'
> >
> > 05/04 17:59:06.079 metplus (config_launcher.py:399) INFO: Replace
> [config]
> > LOG_METPLUS with
> >
>
'/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/logs/master_metplus.log.20200504175906'
> >
> > 05/04 17:59:06.081 metplus (config_launcher.py:268) INFO: Setting
[dir]
> > METPLUS_BASE to
> >
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0
> >
> > 05/04 17:59:06.081 metplus (config_launcher.py:268) INFO: Setting
[dir]
> > PARM_BASE to
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm
> >
> > 05/04 17:59:06.081 metplus (config_launcher.py:275) INFO:
METPLUS_CONF:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/metplus_final.conf
> > written here.
> >
> > 05/04 17:59:06.082 metplus (config_metplus.py:148) INFO: Completed
> METplus
> > configuration setup.
> >
> > 05/04 17:59:06.082 metplus (met_util.py:89) INFO: Running METplus
v3.0
> > called with command:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/master_metplus.py
> > -c
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > -c
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/venus.jpresto.conf
> >
> > 05/04 17:59:06.111 metplus (met_util.py:815) INFO:
> > ****************************************
> >
> > 05/04 17:59:06.111 metplus (met_util.py:816) INFO: * Running
METplus
> >
> > 05/04 17:59:06.111 metplus (met_util.py:818) INFO: * at init
time:
> > 200508070000
> >
> > 05/04 17:59:06.112 metplus (met_util.py:821) INFO:
> > ****************************************
> >
> > 05/04 17:59:06.112 metplus.GridStat
(compare_gridded_wrapper.py:170)
> INFO:
> > Processing forecast lead 12 hours
> >
> > 05/04 17:59:06.122 metplus.GridStat (command_runner.py:90) INFO:
COMMAND:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.0/bin/grid_stat
> > -v 2
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0_sample_data/met_test/data/sample_fcst/2005080700/wrfprs_ruc13_12.tm00_G212
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0_sample_data/met_test/new/ST2ml2005080712_A03h.nc
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/met_config/GridStatConfig_wrapped
> > -outdir
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/met_tool_wrapper/GridStat/GridStat/2005080700
> >
> > 05/04 17:59:06.974 metplus (met_util.py:726) INFO:
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/output/metplus_final.conf:
> > write metplus.conf here
> >
> > 05/04 17:59:06.976 metplus (met_util.py:216) INFO: METplus has
> > successfully finished running.
> >
> > [Julie.Prestopnik at v71a1 ~]$
> >
>
> Are you using the GridStat.conf file from the release:
>
>
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
>
> or have you made changes in a different area and are using a
different
> GridStat.conf? If so, please send along the full path to that
config file.
>
> Also, you said you received this error:
>
> > [Edward.Strobach at v71a3 ush]$ master_metplus.py -c
> > use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > Traceback (most recent call last):
> > File
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> > line 26, in <module>
> > import tornado
> > ModuleNotFoundError: No module named 'tornado'
> >
>
> I tried simply loading python and importing "tornado", but received
the
> following error:
>
> > [Julie.Prestopnik at v72a2 ~]$ which python
> >
> > /usrx/local/prod/packages/python/3.6.3/bin/python
> >
> > [Julie.Prestopnik at v72a2 ~]$ python
> >
> > Python 3.6.3 (default, Feb 25 2019, 15:56:15)
> >
> > [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux
> >
> > Type "help", "copyright", "credits" or "license" for more
information.
> >
> > >>> import tornado
> >
> > Traceback (most recent call last):
> >
> > File "<stdin>", line 1, in <module>
> >
> > ModuleNotFoundError: No module named 'tornado'
> >
>
> I am not familiar with matplotlib, but I thought maybe I needed to
run
> those commands first and then try importing tornado, but that also
did not
> work:
>
> > >>> import matplotlib as mpl
> >
> > >>> mpl.use("Agg")
> >
> > >>> import tornado
> >
> > Traceback (most recent call last):
> >
> > File "<stdin>", line 1, in <module>
> >
> > ModuleNotFoundError: No module named 'tornado'
> >
> > >>>
> >
>
> As far as I can tell, this issue seems unrelated to the default
> GridStat.conf file, which is why I was wondering if you're using a
> different file. Otherwise, it seems like that this is an issue
being
> caused by the environment.
>
> Julie
>
>
> On Mon, May 4, 2020 at 11:07 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95144 >
> >
> > Hello Ed,
> >
> > Sorry to hear you're running into these issues with METplus. As
we
> > discussed on the METplus telecon, it's like environment issues
we'll just
> > need to sort out. I'm assigning this ticket to Julie Prestopnik
who does
> > the installations on WCOSS and is best suited to debug it.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Mon, May 4, 2020 at 10:55 AM Edward Strobach - NOAA Affiliate
via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Mon May 04 10:55:21 2020: Request 95144 was acted upon.
> > > Transaction: Ticket created by edward.strobach at noaa.gov
> > > Queue: met_help
> > > Subject: Complaints when running master_metplus.py
> > > Owner: Nobody
> > > Requestors: edward.strobach at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95144
> >
> > >
> > >
> > > Good afternoon,
> > >
> > > I'm trying to learn MetPlus and am following all the steps in
the
> user's
> > > guide. When going through the user guide, I experienced an
issue
> testing
> > > the following command:
> > >
> > > master_metplus.py -c
> > parm/use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > >
> > > I received the following:
> > >
> > > [Edward.Strobach at v71a3 ush]$ master_metplus.py -c
> > > use_cases/met_tool_wrapper/GridStat/GridStat.conf
> > > Traceback (most recent call last):
> > > File
> > >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> > > line 26, in <module>
> > > import tornado
> > > ModuleNotFoundError: No module named 'tornado'
> > >
> > > During handling of the above exception, another exception
occurred:
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > *Traceback (most recent call last): File
> > >
> > >
> >
>
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/master_metplus.py",
> > > line 64, in <module> from cyclone_plotter_wrapper import
> > > CyclonePlotterWrapper File
> > >
> > >
> >
>
"/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/cyclone_plotter_wrapper.py",
> > > line 20, in <module> import matplotlib.pyplot as plt File
> > >
> > >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/pyplot.py",
> > > line 2355, in <module> switch_backend(rcParams["backend"])
File
> > >
> > >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/pyplot.py",
> > > line 221, in switch_backend backend_mod =
> > > importlib.import_module(backend_name) File
> > >
> > >
> >
>
"/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/importlib/__init__.py",
> > > line 126, in import_module return
> > > _bootstrap._gcd_import(name[level:], package, level) File
> > >
> > >
> >
> "/usrx/local/prod/intel/2019UP05/intelpython3/lib/python3.6/site-
packages/matplotlib/backends/backend_webagg.py",
> > > line 28, in <module> raise RuntimeError("The WebAgg backend
> > > requires Tornado.")RuntimeError: The WebAgg backend requires
Tornado.*
> > >
> > > You can see that I'm using python3.6.3 on the dell and that my
path
> > > has been set in bash to Julie's directory path for metplus-3.0.
> > >
> > > The WebAgg error is something I've encountered before related to
> > > plotting, but I assumed that this would have been detected
before.
> > >
> > > This issue comes up when running a python program outside of the
> > > python command prompt. To remedy this I put the following line
in my
> > > own scripts; I do this because I run my own python scripts in
batch
> > > mode.
> > > #!/usr/bin/python
> > > import matplotlib as mpl
> > > mpl.use("Agg")
> > >
> > > I'm intending to use Metplus to do some airquality verification
with
> > > airnow obs, and perhaps other data sources. Eventually I want
to run
> > > metplus in cron mode if possible
> > >
> > > Thanks!
> > >
> > >
> > >
> > >
> > > --
> > > Edward Strobach
> > > EMC/NCEP/NWS/
> > > IMSG Contractor
> > > Cubicle#: 2029
> > > 301-683-3717
> > >
> > >
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717
------------------------------------------------
Subject: Complaints when running master_metplus.py
From: Julie Prestopnik
Time: Mon May 04 13:34:47 2020
Hi Ed. You're welcome! I'm glad you were able to get it working.
We're happy to help you troubleshoot and answer any questions you
have, so
please submit a ticket whenever you need help or have questions that
are
left unanswered after reading the documentation. That will also help
us
know how we can improve our documentation.
I'll go ahead and close this ticket.
Thanks!
Julie
On Mon, May 4, 2020 at 12:32 PM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95144 >
>
> Hi Julie, thanks for your help. I first ran your command as a test
and it
> turned out to be successful. Afterwards I copied over your
venus*.conf
> file to my MetPlus directory and reissued the command with my
> MetPlus/ush/master*py script instead of your, and that worked.
Perhaps I'm
> using the wrong python version. I thought that I was using the same
one as
> you until I saw a reference to python3.6.3. I was using some other
python
> 3 version. After using 3.6.3, the other issues related to cartopy
cleared
> up. I'll continue to go through the manual. It may take some time
getting
> used to metplus, and I may send a ticket from time to time if things
aren't
> quite clear. I think I'm okay for now.
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
More information about the Met_help
mailing list