[Met_help] [rt.rap.ucar.edu #87801] History for Running METplus use case (wcoss)
John Halley Gotway via RT
met_help at ucar.edu
Wed Jul 10 16:39:13 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello. I've been trying to get started on METplus by running a use
case on wcoss ... Had trouble earlier on Tide to set path, setenv etc in
.cshrc (I do interactive c-shell, but run mostly ksh in scripts) as
described in P21-22 of the METplus v2.0 manual (Sept 2018 version), so
to keep things simple I created
/gpfs/gp1/u/Ying.Lin/dot.for.metplus
so that in ksh, I can simply do a ". ~/dot.for.metplus" to set up path,
exports, etc..
This is what my dot.for.metplus looks like on Gyre (between the '----')
------------------------------
. /usrx/local/Modules/default/init/ksh
module purge
module use /global/noscrub/Julie.Prestopnik/modulefiles
module load met/8.0
module load nco
module load grib_util
module use /usrx/local/dev/modulefiles
export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
# tide METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
# gyre set up is below:
METPLUS=/global/noscrub/Julie.Prestopnik/METplus
export PATH=${METPLUS}/ush:$PATH
export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
export JLOGFILE=${METPLUS_PATH}/jlogfile
------------------------------------------------------
I have a simple test script in
/gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
Running either the master_met_plus.py alone, or actual test case (Dan's
"ruc-vs-s2grib" at last month's METplus tutorial), as in
lead to err msg like this:
--------------------------------------
11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
master_metplus failed: [Errno 13] Permission denied: '/path'
Traceback (most recent call last):
File
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py", line
191, in <module>
main()
File
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py", line
96, in main
p = config_launcher.launch(infiles, moreopt)
File
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
line 262, in launch
produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'), logger=logger)
File
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
line 239, in makedirs
os.makedirs(filename)
File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 150, in
makedirs
makedirs(head, mode)
File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 157, in
makedirs
mkdir(name, mode)
OSError: [Errno 13] Permission denied: '/path'
------------------------------------------
Can you tell from the above what I did wrong (in both the
/gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
/gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on gyre is a
more recent version than the one on Tide? (more recent modification
date; Tide has "METplus-2.0", gyre doesn't; Tide has master_metplus.py,
vs. master_metplus.py). I was trying unsuccessfully on Tide earlier.
Thanks very much!
Ying
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Running METplus use case (wcoss)
From: Minna Win
Time: Wed Nov 14 10:38:02 2018
Hi Ying,
I will take a look at your test script as soon as I can log into tide.
Regards,
Minna
---------------
Minna Win
NCAR
Research Applications Lab
Phone: 303-497-8423
Fax: 303-497-8401
On Tue, Nov 13, 2018 at 10:38 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
> Transaction: Ticket created by ying.lin at noaa.gov
> Queue: met_help
> Subject: Running METplus use case (wcoss)
> Owner: Nobody
> Requestors: ying.lin at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>
>
> Hello. I've been trying to get started on METplus by running a use
> case on wcoss ... Had trouble earlier on Tide to set path, setenv
etc in
> .cshrc (I do interactive c-shell, but run mostly ksh in scripts) as
> described in P21-22 of the METplus v2.0 manual (Sept 2018 version),
so
> to keep things simple I created
>
> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
>
> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set up
path,
> exports, etc..
>
> This is what my dot.for.metplus looks like on Gyre (between the
'----')
>
> ------------------------------
>
> . /usrx/local/Modules/default/init/ksh
> module purge
> module use /global/noscrub/Julie.Prestopnik/modulefiles
> module load met/8.0
> module load nco
> module load grib_util
> module use /usrx/local/dev/modulefiles
>
> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
>
> # tide METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
> # gyre set up is below:
> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
> export PATH=${METPLUS}/ush:$PATH
> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
> export JLOGFILE=${METPLUS_PATH}/jlogfile
>
> ------------------------------------------------------
>
> I have a simple test script in
> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
>
> Running either the master_met_plus.py alone, or actual test case
(Dan's
> "ruc-vs-s2grib" at last month's METplus tutorial), as in
>
> lead to err msg like this:
>
> --------------------------------------
>
> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
> master_metplus failed: [Errno 13] Permission denied: '/path'
> Traceback (most recent call last):
> File
> "/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
> 191, in <module>
> main()
> File
> "/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
> 96, in main
> p = config_launcher.launch(infiles, moreopt)
> File
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
>
> line 262, in launch
> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
logger=logger)
> File
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
>
> line 239, in makedirs
> os.makedirs(filename)
> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 150,
in
> makedirs
> makedirs(head, mode)
> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 157,
in
> makedirs
> mkdir(name, mode)
> OSError: [Errno 13] Permission denied: '/path'
>
> ------------------------------------------
>
> Can you tell from the above what I did wrong (in both the
> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
>
> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on gyre is
a
> more recent version than the one on Tide? (more recent modification
> date; Tide has "METplus-2.0", gyre doesn't; Tide has
master_metplus.py,
> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
>
> Thanks very much!
>
> Ying
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: Running METplus use case (wcoss)
From: Julie Prestopnik
Time: Wed Nov 14 10:43:19 2018
Hi Ying. I just sat down to type up a response and saw that MInna
wrote as
well. I am currently at NCEP and have meetings today. I wanted to
let you
know that METplus-2.0 is actually not currently on "gyre" however, I
have
started uploading the METplus-2.0 release and the sample data, so that
you
can use the most current release. We do not currently have access to
"tide" because we do not have devonprod access, so we can only access
"gyre" at this time. Once I get the package and the data unpacked, I
will
need to set up some files and the environment.
My schedule is pretty full here but I, or Minna, will try to help as
soon
as we can. Thank you for your patience in advance.
Julie
On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
> Transaction: Ticket created by ying.lin at noaa.gov
> Queue: met_help
> Subject: Running METplus use case (wcoss)
> Owner: Nobody
> Requestors: ying.lin at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>
>
> Hello. I've been trying to get started on METplus by running a use
> case on wcoss ... Had trouble earlier on Tide to set path, setenv
etc in
> .cshrc (I do interactive c-shell, but run mostly ksh in scripts) as
> described in P21-22 of the METplus v2.0 manual (Sept 2018 version),
so
> to keep things simple I created
>
> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
>
> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set up
path,
> exports, etc..
>
> This is what my dot.for.metplus looks like on Gyre (between the
'----')
>
> ------------------------------
>
> . /usrx/local/Modules/default/init/ksh
> module purge
> module use /global/noscrub/Julie.Prestopnik/modulefiles
> module load met/8.0
> module load nco
> module load grib_util
> module use /usrx/local/dev/modulefiles
>
> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
>
> # tide METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
> # gyre set up is below:
> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
> export PATH=${METPLUS}/ush:$PATH
> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
> export JLOGFILE=${METPLUS_PATH}/jlogfile
>
> ------------------------------------------------------
>
> I have a simple test script in
> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
>
> Running either the master_met_plus.py alone, or actual test case
(Dan's
> "ruc-vs-s2grib" at last month's METplus tutorial), as in
>
> lead to err msg like this:
>
> --------------------------------------
>
> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
> master_metplus failed: [Errno 13] Permission denied: '/path'
> Traceback (most recent call last):
> File
> "/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
> 191, in <module>
> main()
> File
> "/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
> 96, in main
> p = config_launcher.launch(infiles, moreopt)
> File
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
>
> line 262, in launch
> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
logger=logger)
> File
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
>
> line 239, in makedirs
> os.makedirs(filename)
> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 150,
in
> makedirs
> makedirs(head, mode)
> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 157,
in
> makedirs
> mkdir(name, mode)
> OSError: [Errno 13] Permission denied: '/path'
>
> ------------------------------------------
>
> Can you tell from the above what I did wrong (in both the
> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
>
> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on gyre is
a
> more recent version than the one on Tide? (more recent modification
> date; Tide has "METplus-2.0", gyre doesn't; Tide has
master_metplus.py,
> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
>
> Thanks very much!
>
> Ying
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #87801] Running METplus use case (wcoss)
From: Ying Lin
Time: Wed Nov 14 10:56:00 2018
Thanks Minna and Julie. I figured Julie would be pretty busy here and
sending a request to met_help for the MET team would work better than
trying to drop in on you in rm 2795.
The script, err msg etc. in my request were all on gyre, though I
encountered similar issues on Tide earlier as well. Most likely
something wrong in my set up.
Ying
On 11/14/18 12:43 PM, Julie Prestopnik via RT wrote:
> Hi Ying. I just sat down to type up a response and saw that MInna
wrote as
> well. I am currently at NCEP and have meetings today. I wanted to
let you
> know that METplus-2.0 is actually not currently on "gyre" however, I
have
> started uploading the METplus-2.0 release and the sample data, so
that you
> can use the most current release. We do not currently have access
to
> "tide" because we do not have devonprod access, so we can only
access
> "gyre" at this time. Once I get the package and the data unpacked,
I will
> need to set up some files and the environment.
>
> My schedule is pretty full here but I, or Minna, will try to help as
soon
> as we can. Thank you for your patience in advance.
>
>
> Julie
>
> On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
>> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
>> Transaction: Ticket created by ying.lin at noaa.gov
>> Queue: met_help
>> Subject: Running METplus use case (wcoss)
>> Owner: Nobody
>> Requestors: ying.lin at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>>
>>
>> Hello. I've been trying to get started on METplus by running a
use
>> case on wcoss ... Had trouble earlier on Tide to set path, setenv
etc in
>> .cshrc (I do interactive c-shell, but run mostly ksh in scripts) as
>> described in P21-22 of the METplus v2.0 manual (Sept 2018 version),
so
>> to keep things simple I created
>>
>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
>>
>> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set up
path,
>> exports, etc..
>>
>> This is what my dot.for.metplus looks like on Gyre (between the
'----')
>>
>> ------------------------------
>>
>> . /usrx/local/Modules/default/init/ksh
>> module purge
>> module use /global/noscrub/Julie.Prestopnik/modulefiles
>> module load met/8.0
>> module load nco
>> module load grib_util
>> module use /usrx/local/dev/modulefiles
>>
>> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
>> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
>>
>> # tide METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0/
>> # gyre set up is below:
>> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
>> export PATH=${METPLUS}/ush:$PATH
>> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
>> export JLOGFILE=${METPLUS_PATH}/jlogfile
>>
>> ------------------------------------------------------
>>
>> I have a simple test script in
>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
>>
>> Running either the master_met_plus.py alone, or actual test case
(Dan's
>> "ruc-vs-s2grib" at last month's METplus tutorial), as in
>>
>> lead to err msg like this:
>>
>> --------------------------------------
>>
>> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
>> master_metplus failed: [Errno 13] Permission denied: '/path'
>> Traceback (most recent call last):
>> File
>> "/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
>> 191, in <module>
>> main()
>> File
>> "/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
>> 96, in main
>> p = config_launcher.launch(infiles, moreopt)
>> File
>>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
>>
>> line 262, in launch
>> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
logger=logger)
>> File
>>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
>>
>> line 239, in makedirs
>> os.makedirs(filename)
>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 150,
in
>> makedirs
>> makedirs(head, mode)
>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line 157,
in
>> makedirs
>> mkdir(name, mode)
>> OSError: [Errno 13] Permission denied: '/path'
>>
>> ------------------------------------------
>>
>> Can you tell from the above what I did wrong (in both the
>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
>>
>> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on gyre is
a
>> more recent version than the one on Tide? (more recent
modification
>> date; Tide has "METplus-2.0", gyre doesn't; Tide has
master_metplus.py,
>> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
>>
>> Thanks very much!
>>
>> Ying
>>
>> --
>> Ying Lin
>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>> NCWCP Cubicle No. 2015
>> Ying.Lin at noaa.gov
>>
>>
>>
>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: Running METplus use case (wcoss)
From: Minna Win
Time: Wed Nov 14 14:20:47 2018
Hi Ying,
In looking at your error messages, the 'Permission denied: '/path'
looks
like a very common mistake that users make when setting up their
config
files. It looks like there is a /path/to in one or more of your
config
files that needs to be replaced with a valid path. You can do one of
two
things when you encounter this problem. Take a look at the
master_metplus.conf file that is generated in your project/output
directory
(if it got generated). Look for any instances of '/path/to' and :
1) Find the METplus config file to which this corresponds, such as the
metplus_system.conf file in the $METplus_HOME/parm/metplus_config
directory, and replace the /path/to with a valid path
or
2) Create a 'custom' config file e.g. my_custom.conf, and from the
master_metplus.conf file, find the family/header and add the key-value
For example, if you forgot to replace METPLUS_BASE = /path/to, which
is
under the [dir] header/family, in your custom config file you can do
the
following:
[dir]
METPLUS_BASE = /usr/local/metplus
I hope you find that useful when METplus is available to use on gyre.
If
you want me to look at your config files before you attempt to run
METplus
on gyre (phase 1 or phase 2), I have access to those hosts and would
be
happy to take a look.
Regards,
Minna
---------------
Minna Win
NCAR
Research Applications Lab
Phone: 303-497-8423
Fax: 303-497-8401
On Wed, Nov 14, 2018 at 5:56 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>
> Thanks Minna and Julie. I figured Julie would be pretty busy here
and
> sending a request to met_help for the MET team would work better
than
> trying to drop in on you in rm 2795.
>
> The script, err msg etc. in my request were all on gyre, though I
> encountered similar issues on Tide earlier as well. Most likely
> something wrong in my set up.
>
> Ying
>
> On 11/14/18 12:43 PM, Julie Prestopnik via RT wrote:
> > Hi Ying. I just sat down to type up a response and saw that MInna
wrote
> as
> > well. I am currently at NCEP and have meetings today. I wanted
to let
> you
> > know that METplus-2.0 is actually not currently on "gyre" however,
I have
> > started uploading the METplus-2.0 release and the sample data, so
that
> you
> > can use the most current release. We do not currently have access
to
> > "tide" because we do not have devonprod access, so we can only
access
> > "gyre" at this time. Once I get the package and the data
unpacked, I
> will
> > need to set up some files and the environment.
> >
> > My schedule is pretty full here but I, or Minna, will try to help
as soon
> > as we can. Thank you for your patience in advance.
> >
> >
> > Julie
> >
> > On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT
<met_help at ucar.edu>
> wrote:
> >
> >> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
> >> Transaction: Ticket created by ying.lin at noaa.gov
> >> Queue: met_help
> >> Subject: Running METplus use case (wcoss)
> >> Owner: Nobody
> >> Requestors: ying.lin at noaa.gov
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801
> >
> >>
> >>
> >> Hello. I've been trying to get started on METplus by running a
use
> >> case on wcoss ... Had trouble earlier on Tide to set path, setenv
etc in
> >> .cshrc (I do interactive c-shell, but run mostly ksh in scripts)
as
> >> described in P21-22 of the METplus v2.0 manual (Sept 2018
version), so
> >> to keep things simple I created
> >>
> >> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
> >>
> >> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set up
path,
> >> exports, etc..
> >>
> >> This is what my dot.for.metplus looks like on Gyre (between the
'----')
> >>
> >> ------------------------------
> >>
> >> . /usrx/local/Modules/default/init/ksh
> >> module purge
> >> module use /global/noscrub/Julie.Prestopnik/modulefiles
> >> module load met/8.0
> >> module load nco
> >> module load grib_util
> >> module use /usrx/local/dev/modulefiles
> >>
> >> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> >> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
> >>
> >> # tide METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0/
> >> # gyre set up is below:
> >> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
> >> export PATH=${METPLUS}/ush:$PATH
> >> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
> >> export JLOGFILE=${METPLUS_PATH}/jlogfile
> >>
> >> ------------------------------------------------------
> >>
> >> I have a simple test script in
> >> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
> >>
> >> Running either the master_met_plus.py alone, or actual test case
(Dan's
> >> "ruc-vs-s2grib" at last month's METplus tutorial), as in
> >>
> >> lead to err msg like this:
> >>
> >> --------------------------------------
> >>
> >> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
> >> master_metplus failed: [Errno 13] Permission denied: '/path'
> >> Traceback (most recent call last):
> >> File
> >>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
> >> 191, in <module>
> >> main()
> >> File
> >>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
line
> >> 96, in main
> >> p = config_launcher.launch(infiles, moreopt)
> >> File
> >>
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
> >>
> >> line 262, in launch
> >> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
> logger=logger)
> >> File
> >>
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
> >>
> >> line 239, in makedirs
> >> os.makedirs(filename)
> >> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
150, in
> >> makedirs
> >> makedirs(head, mode)
> >> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
157, in
> >> makedirs
> >> mkdir(name, mode)
> >> OSError: [Errno 13] Permission denied: '/path'
> >>
> >> ------------------------------------------
> >>
> >> Can you tell from the above what I did wrong (in both the
> >> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
> >> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
> >>
> >> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on gyre
is a
> >> more recent version than the one on Tide? (more recent
modification
> >> date; Tide has "METplus-2.0", gyre doesn't; Tide has
master_metplus.py,
> >> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
> >>
> >> Thanks very much!
> >>
> >> Ying
> >>
> >> --
> >> Ying Lin
> >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >> NCWCP Cubicle No. 2015
> >> Ying.Lin at noaa.gov
> >>
> >>
> >>
> >>
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
Subject: Running METplus use case (wcoss)
From: Julie Prestopnik
Time: Thu Nov 15 08:16:29 2018
Hi Ying.
I was able to get METplus-2.0 set up on gyre and was able to run Dan's
"ruc-vs-s2grib" use case from last month's METplus tutorial
successfully.
I'd like to have you start fresh with using METplus-2.0 and will
provide
detailed instructions for what you should do.
Copy the METplus Scripting package into your own area. For example:
*cp -r /global/noscrub/Julie.Prestopnik/METplus/METplus-2.0
/meso/save/Ying.Lin*
This will create a METplus-2.0 directory with all its subdirectories
for
you at /meso/save/Ying.Lin.
Now change directories into the METplus-2.0 parm subdirectory:
cd */meso/save/Ying.Lin/METplus-2.0/parm*
Now you can create your own top level configuration file that contains
information specific to this machine and overrides some configuration
options.
*mv jpresto.system.conf.gyre ylin.system.conf.gyre*
Edit the file ylin.system.conf.gyre, changing the following:
OUTPUT_BASE = /global/noscrub/Julie.Prestopnik/METplus/data/output
METPLUS_BASE = /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0/
Please change OUTPUT_BASE to where ever you'd like the output to be
written
in your own area. Please change METPLUS_BASE to point to your
METPLUS_BASE, for example, */meso/save/Ying.Lin/METplus-2.0/.*
Now, I'll have you set up your environment. You'll need to run the
following, changing only METPLUS_PATH (to
*/meso/save/Ying.Lin/METplus-2.0/ *for example) below:
module use /global/noscrub/Julie.Prestopnik/modulefiles
module load met/8.0
module load nco
module load grib_util
export
METPLUS_PATH="/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0"
export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
export JLOGFILE="${METPLUS_PATH}/logs/metplus_jlogfile"
export PYTHONPATH="${METPLUS_PATH}/ush:${METPLUS_PATH}/parm"
export PATH="${PATH}:${METPLUS_PATH}/ush:."
Once you have done that, you should be able to run Dan's test case as
follows:
master_metplus.py
-c /meso/save/Ying.Lin/METplus-2.0/parm/use_cases/qpf/examples/ruc-vs-
s2grib.conf
-c /meso/save/Ying.Lin//METplus-2.0/parm/ylin.system.conf.gyre
Then, please check on your output and check in your log file
in {OUTPUT_BASE}/logs for errors. Please give that a try and let me
know
how it goes!
Thank you for your patience.
Julie
On Wed, Nov 14, 2018 at 2:20 PM Minna Win via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>
> Hi Ying,
>
> In looking at your error messages, the 'Permission denied: '/path'
looks
> like a very common mistake that users make when setting up their
config
> files. It looks like there is a /path/to in one or more of your
config
> files that needs to be replaced with a valid path. You can do one
of two
> things when you encounter this problem. Take a look at the
> master_metplus.conf file that is generated in your project/output
directory
> (if it got generated). Look for any instances of '/path/to' and :
>
> 1) Find the METplus config file to which this corresponds, such as
the
> metplus_system.conf file in the $METplus_HOME/parm/metplus_config
> directory, and replace the /path/to with a valid path
>
> or
>
> 2) Create a 'custom' config file e.g. my_custom.conf, and from the
> master_metplus.conf file, find the family/header and add the key-
value
> For example, if you forgot to replace METPLUS_BASE = /path/to, which
is
> under the [dir] header/family, in your custom config file you can do
the
> following:
>
> [dir]
> METPLUS_BASE = /usr/local/metplus
>
>
> I hope you find that useful when METplus is available to use on
gyre. If
> you want me to look at your config files before you attempt to run
METplus
> on gyre (phase 1 or phase 2), I have access to those hosts and would
be
> happy to take a look.
>
> Regards,
> Minna
> ---------------
> Minna Win
> NCAR
> Research Applications Lab
> Phone: 303-497-8423
> Fax: 303-497-8401
>
>
>
> On Wed, Nov 14, 2018 at 5:56 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
> >
> > Thanks Minna and Julie. I figured Julie would be pretty busy here
and
> > sending a request to met_help for the MET team would work better
than
> > trying to drop in on you in rm 2795.
> >
> > The script, err msg etc. in my request were all on gyre, though I
> > encountered similar issues on Tide earlier as well. Most likely
> > something wrong in my set up.
> >
> > Ying
> >
> > On 11/14/18 12:43 PM, Julie Prestopnik via RT wrote:
> > > Hi Ying. I just sat down to type up a response and saw that
MInna
> wrote
> > as
> > > well. I am currently at NCEP and have meetings today. I wanted
to let
> > you
> > > know that METplus-2.0 is actually not currently on "gyre"
however, I
> have
> > > started uploading the METplus-2.0 release and the sample data,
so that
> > you
> > > can use the most current release. We do not currently have
access to
> > > "tide" because we do not have devonprod access, so we can only
access
> > > "gyre" at this time. Once I get the package and the data
unpacked, I
> > will
> > > need to set up some files and the environment.
> > >
> > > My schedule is pretty full here but I, or Minna, will try to
help as
> soon
> > > as we can. Thank you for your patience in advance.
> > >
> > >
> > > Julie
> > >
> > > On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT
<met_help at ucar.edu>
> > wrote:
> > >
> > >> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
> > >> Transaction: Ticket created by ying.lin at noaa.gov
> > >> Queue: met_help
> > >> Subject: Running METplus use case (wcoss)
> > >> Owner: Nobody
> > >> Requestors: ying.lin at noaa.gov
> > >> Status: new
> > >> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801
> > >
> > >>
> > >>
> > >> Hello. I've been trying to get started on METplus by running
a use
> > >> case on wcoss ... Had trouble earlier on Tide to set path,
setenv etc
> in
> > >> .cshrc (I do interactive c-shell, but run mostly ksh in
scripts) as
> > >> described in P21-22 of the METplus v2.0 manual (Sept 2018
version), so
> > >> to keep things simple I created
> > >>
> > >> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
> > >>
> > >> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set
up
> path,
> > >> exports, etc..
> > >>
> > >> This is what my dot.for.metplus looks like on Gyre (between the
> '----')
> > >>
> > >> ------------------------------
> > >>
> > >> . /usrx/local/Modules/default/init/ksh
> > >> module purge
> > >> module use /global/noscrub/Julie.Prestopnik/modulefiles
> > >> module load met/8.0
> > >> module load nco
> > >> module load grib_util
> > >> module use /usrx/local/dev/modulefiles
> > >>
> > >> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> > >> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
> > >>
> > >> # tide
METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
> > >> # gyre set up is below:
> > >> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
> > >> export PATH=${METPLUS}/ush:$PATH
> > >> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
> > >> export JLOGFILE=${METPLUS_PATH}/jlogfile
> > >>
> > >> ------------------------------------------------------
> > >>
> > >> I have a simple test script in
> > >> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
> > >>
> > >> Running either the master_met_plus.py alone, or actual test
case
> (Dan's
> > >> "ruc-vs-s2grib" at last month's METplus tutorial), as in
> > >>
> > >> lead to err msg like this:
> > >>
> > >> --------------------------------------
> > >>
> > >> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
> > >> master_metplus failed: [Errno 13] Permission denied: '/path'
> > >> Traceback (most recent call last):
> > >> File
> > >>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
> line
> > >> 191, in <module>
> > >> main()
> > >> File
> > >>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
> line
> > >> 96, in main
> > >> p = config_launcher.launch(infiles, moreopt)
> > >> File
> > >>
> >
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
> > >>
> > >> line 262, in launch
> > >> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
> > logger=logger)
> > >> File
> > >>
> >
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
> > >>
> > >> line 239, in makedirs
> > >> os.makedirs(filename)
> > >> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
150, in
> > >> makedirs
> > >> makedirs(head, mode)
> > >> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
157, in
> > >> makedirs
> > >> mkdir(name, mode)
> > >> OSError: [Errno 13] Permission denied: '/path'
> > >>
> > >> ------------------------------------------
> > >>
> > >> Can you tell from the above what I did wrong (in both the
> > >> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
> > >> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
> > >>
> > >> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on
gyre is a
> > >> more recent version than the one on Tide? (more recent
modification
> > >> date; Tide has "METplus-2.0", gyre doesn't; Tide has
> master_metplus.py,
> > >> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
> > >>
> > >> Thanks very much!
> > >>
> > >> Ying
> > >>
> > >> --
> > >> Ying Lin
> > >> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> > >> NCWCP Cubicle No. 2015
> > >> Ying.Lin at noaa.gov
> > >>
> > >>
> > >>
> > >>
> >
> > --
> > Ying Lin
> > NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> > NCWCP Cubicle No. 2015
> > Ying.Lin at noaa.gov
> >
> >
> >
> >
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #87801] Running METplus use case (wcoss)
From: Ying Lin
Time: Thu Nov 15 10:23:55 2018
Thank you very much Julie! Yesterday after seeing Minna’s reply I
realized there was more I should have done with confs before running
Dan’s example, made some stabs on Tide but didn’t get things right.
I’m on leave today, will follow your detailed instructions (thanks!!)
on gyre tomorrow.
I hope your trip back home this afternoon will go smoothly.
Ying
> On Nov 15, 2018, at 10:16 AM, Julie Prestopnik via RT
<met_help at ucar.edu> wrote:
>
> Hi Ying.
>
> I was able to get METplus-2.0 set up on gyre and was able to run
Dan's
> "ruc-vs-s2grib" use case from last month's METplus tutorial
successfully.
>
> I'd like to have you start fresh with using METplus-2.0 and will
provide
> detailed instructions for what you should do.
>
> Copy the METplus Scripting package into your own area. For example:
>
> *cp -r /global/noscrub/Julie.Prestopnik/METplus/METplus-2.0
> /meso/save/Ying.Lin*
>
> This will create a METplus-2.0 directory with all its subdirectories
for
> you at /meso/save/Ying.Lin.
>
> Now change directories into the METplus-2.0 parm subdirectory:
>
> cd */meso/save/Ying.Lin/METplus-2.0/parm*
>
> Now you can create your own top level configuration file that
contains
> information specific to this machine and overrides some
configuration
> options.
>
> *mv jpresto.system.conf.gyre ylin.system.conf.gyre*
>
> Edit the file ylin.system.conf.gyre, changing the following:
>
> OUTPUT_BASE = /global/noscrub/Julie.Prestopnik/METplus/data/output
> METPLUS_BASE = /global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0/
>
> Please change OUTPUT_BASE to where ever you'd like the output to be
written
> in your own area. Please change METPLUS_BASE to point to your
> METPLUS_BASE, for example, */meso/save/Ying.Lin/METplus-2.0/.*
>
> Now, I'll have you set up your environment. You'll need to run the
> following, changing only METPLUS_PATH (to
> */meso/save/Ying.Lin/METplus-2.0/ *for example) below:
>
> module use /global/noscrub/Julie.Prestopnik/modulefiles
> module load met/8.0
> module load nco
> module load grib_util
> export
METPLUS_PATH="/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0"
> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> export JLOGFILE="${METPLUS_PATH}/logs/metplus_jlogfile"
> export PYTHONPATH="${METPLUS_PATH}/ush:${METPLUS_PATH}/parm"
> export PATH="${PATH}:${METPLUS_PATH}/ush:."
>
> Once you have done that, you should be able to run Dan's test case
as
> follows:
>
> master_metplus.py
> -c /meso/save/Ying.Lin/METplus-2.0/parm/use_cases/qpf/examples/ruc-
vs-s2grib.conf
> -c /meso/save/Ying.Lin//METplus-2.0/parm/ylin.system.conf.gyre
>
> Then, please check on your output and check in your log file
> in {OUTPUT_BASE}/logs for errors. Please give that a try and let
me know
> how it goes!
>
> Thank you for your patience.
>
> Julie
>
> On Wed, Nov 14, 2018 at 2:20 PM Minna Win via RT <met_help at ucar.edu>
wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>>
>> Hi Ying,
>>
>> In looking at your error messages, the 'Permission denied: '/path'
looks
>> like a very common mistake that users make when setting up their
config
>> files. It looks like there is a /path/to in one or more of your
config
>> files that needs to be replaced with a valid path. You can do one
of two
>> things when you encounter this problem. Take a look at the
>> master_metplus.conf file that is generated in your project/output
directory
>> (if it got generated). Look for any instances of '/path/to' and :
>>
>> 1) Find the METplus config file to which this corresponds, such as
the
>> metplus_system.conf file in the $METplus_HOME/parm/metplus_config
>> directory, and replace the /path/to with a valid path
>>
>> or
>>
>> 2) Create a 'custom' config file e.g. my_custom.conf, and from the
>> master_metplus.conf file, find the family/header and add the key-
value
>> For example, if you forgot to replace METPLUS_BASE = /path/to,
which is
>> under the [dir] header/family, in your custom config file you can
do the
>> following:
>>
>> [dir]
>> METPLUS_BASE = /usr/local/metplus
>>
>>
>> I hope you find that useful when METplus is available to use on
gyre. If
>> you want me to look at your config files before you attempt to run
METplus
>> on gyre (phase 1 or phase 2), I have access to those hosts and
would be
>> happy to take a look.
>>
>> Regards,
>> Minna
>> ---------------
>> Minna Win
>> NCAR
>> Research Applications Lab
>> Phone: 303-497-8423
>> Fax: 303-497-8401
>>
>>
>>
>> On Wed, Nov 14, 2018 at 5:56 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>>
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>>>
>>> Thanks Minna and Julie. I figured Julie would be pretty busy here
and
>>> sending a request to met_help for the MET team would work better
than
>>> trying to drop in on you in rm 2795.
>>>
>>> The script, err msg etc. in my request were all on gyre, though I
>>> encountered similar issues on Tide earlier as well. Most likely
>>> something wrong in my set up.
>>>
>>> Ying
>>>
>>> On 11/14/18 12:43 PM, Julie Prestopnik via RT wrote:
>>>> Hi Ying. I just sat down to type up a response and saw that
MInna
>> wrote
>>> as
>>>> well. I am currently at NCEP and have meetings today. I wanted
to let
>>> you
>>>> know that METplus-2.0 is actually not currently on "gyre"
however, I
>> have
>>>> started uploading the METplus-2.0 release and the sample data, so
that
>>> you
>>>> can use the most current release. We do not currently have
access to
>>>> "tide" because we do not have devonprod access, so we can only
access
>>>> "gyre" at this time. Once I get the package and the data
unpacked, I
>>> will
>>>> need to set up some files and the environment.
>>>>
>>>> My schedule is pretty full here but I, or Minna, will try to help
as
>> soon
>>>> as we can. Thank you for your patience in advance.
>>>>
>>>>
>>>> Julie
>>>>
>>>> On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT
<met_help at ucar.edu>
>>> wrote:
>>>>
>>>>> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>>>>> Queue: met_help
>>>>> Subject: Running METplus use case (wcoss)
>>>>> Owner: Nobody
>>>>> Requestors: ying.lin at noaa.gov
>>>>> Status: new
>>>>> Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801
>>>>
>>>>>
>>>>>
>>>>> Hello. I've been trying to get started on METplus by running a
use
>>>>> case on wcoss ... Had trouble earlier on Tide to set path,
setenv etc
>> in
>>>>> .cshrc (I do interactive c-shell, but run mostly ksh in scripts)
as
>>>>> described in P21-22 of the METplus v2.0 manual (Sept 2018
version), so
>>>>> to keep things simple I created
>>>>>
>>>>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
>>>>>
>>>>> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set
up
>> path,
>>>>> exports, etc..
>>>>>
>>>>> This is what my dot.for.metplus looks like on Gyre (between the
>> '----')
>>>>>
>>>>> ------------------------------
>>>>>
>>>>> . /usrx/local/Modules/default/init/ksh
>>>>> module purge
>>>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
>>>>> module load met/8.0
>>>>> module load nco
>>>>> module load grib_util
>>>>> module use /usrx/local/dev/modulefiles
>>>>>
>>>>> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
>>>>> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
>>>>>
>>>>> # tide METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-
2.0/
>>>>> # gyre set up is below:
>>>>> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
>>>>> export PATH=${METPLUS}/ush:$PATH
>>>>> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
>>>>> export JLOGFILE=${METPLUS_PATH}/jlogfile
>>>>>
>>>>> ------------------------------------------------------
>>>>>
>>>>> I have a simple test script in
>>>>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
>>>>>
>>>>> Running either the master_met_plus.py alone, or actual test
case
>> (Dan's
>>>>> "ruc-vs-s2grib" at last month's METplus tutorial), as in
>>>>>
>>>>> lead to err msg like this:
>>>>>
>>>>> --------------------------------------
>>>>>
>>>>> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
>>>>> master_metplus failed: [Errno 13] Permission denied: '/path'
>>>>> Traceback (most recent call last):
>>>>> File
>>>>>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
>> line
>>>>> 191, in <module>
>>>>> main()
>>>>> File
>>>>>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
>> line
>>>>> 96, in main
>>>>> p = config_launcher.launch(infiles, moreopt)
>>>>> File
>>>>>
>>>
>>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
>>>>>
>>>>> line 262, in launch
>>>>> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
>>> logger=logger)
>>>>> File
>>>>>
>>>
>>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
>>>>>
>>>>> line 239, in makedirs
>>>>> os.makedirs(filename)
>>>>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
150, in
>>>>> makedirs
>>>>> makedirs(head, mode)
>>>>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
157, in
>>>>> makedirs
>>>>> mkdir(name, mode)
>>>>> OSError: [Errno 13] Permission denied: '/path'
>>>>>
>>>>> ------------------------------------------
>>>>>
>>>>> Can you tell from the above what I did wrong (in both the
>>>>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
>>>>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
>>>>>
>>>>> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on gyre
is a
>>>>> more recent version than the one on Tide? (more recent
modification
>>>>> date; Tide has "METplus-2.0", gyre doesn't; Tide has
>> master_metplus.py,
>>>>> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
>>>>>
>>>>> Thanks very much!
>>>>>
>>>>> Ying
>>>>>
>>>>> --
>>>>> Ying Lin
>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>> NCWCP Cubicle No. 2015
>>>>> Ying.Lin at noaa.gov
>>>>>
>>>>>
>>>>>
>>>>>
>>>
>>> --
>>> Ying Lin
>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>> NCWCP Cubicle No. 2015
>>> Ying.Lin at noaa.gov
>>>
>>>
>>>
>>>
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #87801] Running METplus use case (wcoss)
From: Ying Lin
Time: Fri Nov 16 13:20:35 2018
Hi Julie,
I followed your email below and was able to produce the *.stat
etc.
The log file and output seems to be OK. Thank you again for the
very
clear step-by-step instructions for a METplus beginner!
Ying
On 11/15/18 12:23 PM, Ying Lin - NOAA Federal wrote:
> Thank you very much Julie! Yesterday after seeing Minna’s reply I
realized there was more I should have done with confs before running
Dan’s example, made some stabs on Tide but didn’t get things right.
I’m on leave today, will follow your detailed instructions (thanks!!)
on gyre tomorrow.
>
> I hope your trip back home this afternoon will go smoothly.
>
> Ying
>
>> On Nov 15, 2018, at 10:16 AM, Julie Prestopnik via RT
<met_help at ucar.edu> wrote:
>>
>> Hi Ying.
>>
>> I was able to get METplus-2.0 set up on gyre and was able to run
Dan's
>> "ruc-vs-s2grib" use case from last month's METplus tutorial
successfully.
>>
>> I'd like to have you start fresh with using METplus-2.0 and will
provide
>> detailed instructions for what you should do.
>>
>> Copy the METplus Scripting package into your own area. For
example:
>>
>> *cp -r /global/noscrub/Julie.Prestopnik/METplus/METplus-2.0
>> /meso/save/Ying.Lin*
>>
>> This will create a METplus-2.0 directory with all its
subdirectories for
>> you at /meso/save/Ying.Lin.
>>
>> Now change directories into the METplus-2.0 parm subdirectory:
>>
>> cd */meso/save/Ying.Lin/METplus-2.0/parm*
>>
>> Now you can create your own top level configuration file that
contains
>> information specific to this machine and overrides some
configuration
>> options.
>>
>> *mv jpresto.system.conf.gyre ylin.system.conf.gyre*
>>
>> Edit the file ylin.system.conf.gyre, changing the following:
>>
>> OUTPUT_BASE =
/global/noscrub/Julie.Prestopnik/METplus/data/output
>> METPLUS_BASE =
/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
>>
>> Please change OUTPUT_BASE to where ever you'd like the output to be
written
>> in your own area. Please change METPLUS_BASE to point to your
>> METPLUS_BASE, for example, */meso/save/Ying.Lin/METplus-2.0/.*
>>
>> Now, I'll have you set up your environment. You'll need to run the
>> following, changing only METPLUS_PATH (to
>> */meso/save/Ying.Lin/METplus-2.0/ *for example) below:
>>
>> module use /global/noscrub/Julie.Prestopnik/modulefiles
>> module load met/8.0
>> module load nco
>> module load grib_util
>> export
METPLUS_PATH="/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0"
>> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
>> export JLOGFILE="${METPLUS_PATH}/logs/metplus_jlogfile"
>> export PYTHONPATH="${METPLUS_PATH}/ush:${METPLUS_PATH}/parm"
>> export PATH="${PATH}:${METPLUS_PATH}/ush:."
>>
>> Once you have done that, you should be able to run Dan's test case
as
>> follows:
>>
>> master_metplus.py
>> -c /meso/save/Ying.Lin/METplus-2.0/parm/use_cases/qpf/examples/ruc-
vs-s2grib.conf
>> -c /meso/save/Ying.Lin//METplus-2.0/parm/ylin.system.conf.gyre
>>
>> Then, please check on your output and check in your log file
>> in {OUTPUT_BASE}/logs for errors. Please give that a try and let
me know
>> how it goes!
>>
>> Thank you for your patience.
>>
>> Julie
>>
>> On Wed, Nov 14, 2018 at 2:20 PM Minna Win via RT
<met_help at ucar.edu> wrote:
>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>>>
>>> Hi Ying,
>>>
>>> In looking at your error messages, the 'Permission denied: '/path'
looks
>>> like a very common mistake that users make when setting up their
config
>>> files. It looks like there is a /path/to in one or more of your
config
>>> files that needs to be replaced with a valid path. You can do one
of two
>>> things when you encounter this problem. Take a look at the
>>> master_metplus.conf file that is generated in your project/output
directory
>>> (if it got generated). Look for any instances of '/path/to' and :
>>>
>>> 1) Find the METplus config file to which this corresponds, such as
the
>>> metplus_system.conf file in the $METplus_HOME/parm/metplus_config
>>> directory, and replace the /path/to with a valid path
>>>
>>> or
>>>
>>> 2) Create a 'custom' config file e.g. my_custom.conf, and from the
>>> master_metplus.conf file, find the family/header and add the key-
value
>>> For example, if you forgot to replace METPLUS_BASE = /path/to,
which is
>>> under the [dir] header/family, in your custom config file you can
do the
>>> following:
>>>
>>> [dir]
>>> METPLUS_BASE = /usr/local/metplus
>>>
>>>
>>> I hope you find that useful when METplus is available to use on
gyre. If
>>> you want me to look at your config files before you attempt to run
METplus
>>> on gyre (phase 1 or phase 2), I have access to those hosts and
would be
>>> happy to take a look.
>>>
>>> Regards,
>>> Minna
>>> ---------------
>>> Minna Win
>>> NCAR
>>> Research Applications Lab
>>> Phone: 303-497-8423
>>> Fax: 303-497-8401
>>>
>>>
>>>
>>> On Wed, Nov 14, 2018 at 5:56 PM Ying Lin via RT
<met_help at ucar.edu> wrote:
>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>>>>
>>>> Thanks Minna and Julie. I figured Julie would be pretty busy
here and
>>>> sending a request to met_help for the MET team would work better
than
>>>> trying to drop in on you in rm 2795.
>>>>
>>>> The script, err msg etc. in my request were all on gyre, though I
>>>> encountered similar issues on Tide earlier as well. Most likely
>>>> something wrong in my set up.
>>>>
>>>> Ying
>>>>
>>>> On 11/14/18 12:43 PM, Julie Prestopnik via RT wrote:
>>>>> Hi Ying. I just sat down to type up a response and saw that
MInna
>>> wrote
>>>> as
>>>>> well. I am currently at NCEP and have meetings today. I wanted
to let
>>>> you
>>>>> know that METplus-2.0 is actually not currently on "gyre"
however, I
>>> have
>>>>> started uploading the METplus-2.0 release and the sample data,
so that
>>>> you
>>>>> can use the most current release. We do not currently have
access to
>>>>> "tide" because we do not have devonprod access, so we can only
access
>>>>> "gyre" at this time. Once I get the package and the data
unpacked, I
>>>> will
>>>>> need to set up some files and the environment.
>>>>>
>>>>> My schedule is pretty full here but I, or Minna, will try to
help as
>>> soon
>>>>> as we can. Thank you for your patience in advance.
>>>>>
>>>>>
>>>>> Julie
>>>>>
>>>>> On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT
<met_help at ucar.edu>
>>>> wrote:
>>>>>> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
>>>>>> Transaction: Ticket created by ying.lin at noaa.gov
>>>>>> Queue: met_help
>>>>>> Subject: Running METplus use case (wcoss)
>>>>>> Owner: Nobody
>>>>>> Requestors: ying.lin at noaa.gov
>>>>>> Status: new
>>>>>> Ticket <URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801
>>>>>>
>>>>>> Hello. I've been trying to get started on METplus by running
a use
>>>>>> case on wcoss ... Had trouble earlier on Tide to set path,
setenv etc
>>> in
>>>>>> .cshrc (I do interactive c-shell, but run mostly ksh in
scripts) as
>>>>>> described in P21-22 of the METplus v2.0 manual (Sept 2018
version), so
>>>>>> to keep things simple I created
>>>>>>
>>>>>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
>>>>>>
>>>>>> so that in ksh, I can simply do a ". ~/dot.for.metplus" to set
up
>>> path,
>>>>>> exports, etc..
>>>>>>
>>>>>> This is what my dot.for.metplus looks like on Gyre (between the
>>> '----')
>>>>>> ------------------------------
>>>>>>
>>>>>> . /usrx/local/Modules/default/init/ksh
>>>>>> module purge
>>>>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
>>>>>> module load met/8.0
>>>>>> module load nco
>>>>>> module load grib_util
>>>>>> module use /usrx/local/dev/modulefiles
>>>>>>
>>>>>> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
>>>>>> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
>>>>>>
>>>>>> # tide
METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
>>>>>> # gyre set up is below:
>>>>>> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
>>>>>> export PATH=${METPLUS}/ush:$PATH
>>>>>> export PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
>>>>>> export JLOGFILE=${METPLUS_PATH}/jlogfile
>>>>>>
>>>>>> ------------------------------------------------------
>>>>>>
>>>>>> I have a simple test script in
>>>>>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
>>>>>>
>>>>>> Running either the master_met_plus.py alone, or actual test
case
>>> (Dan's
>>>>>> "ruc-vs-s2grib" at last month's METplus tutorial), as in
>>>>>>
>>>>>> lead to err msg like this:
>>>>>>
>>>>>> --------------------------------------
>>>>>>
>>>>>> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
>>>>>> master_metplus failed: [Errno 13] Permission denied: '/path'
>>>>>> Traceback (most recent call last):
>>>>>> File
>>>>>>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
>>> line
>>>>>> 191, in <module>
>>>>>> main()
>>>>>> File
>>>>>>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
>>> line
>>>>>> 96, in main
>>>>>> p = config_launcher.launch(infiles, moreopt)
>>>>>> File
>>>>>>
>>>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
>>>>>> line 262, in launch
>>>>>> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
>>>> logger=logger)
>>>>>> File
>>>>>>
>>>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
>>>>>> line 239, in makedirs
>>>>>> os.makedirs(filename)
>>>>>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
150, in
>>>>>> makedirs
>>>>>> makedirs(head, mode)
>>>>>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py", line
157, in
>>>>>> makedirs
>>>>>> mkdir(name, mode)
>>>>>> OSError: [Errno 13] Permission denied: '/path'
>>>>>>
>>>>>> ------------------------------------------
>>>>>>
>>>>>> Can you tell from the above what I did wrong (in both the
>>>>>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
>>>>>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
>>>>>>
>>>>>> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on
gyre is a
>>>>>> more recent version than the one on Tide? (more recent
modification
>>>>>> date; Tide has "METplus-2.0", gyre doesn't; Tide has
>>> master_metplus.py,
>>>>>> vs. master_metplus.py). I was trying unsuccessfully on Tide
earlier.
>>>>>>
>>>>>> Thanks very much!
>>>>>>
>>>>>> Ying
>>>>>>
>>>>>> --
>>>>>> Ying Lin
>>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>>>> NCWCP Cubicle No. 2015
>>>>>> Ying.Lin at noaa.gov
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>> --
>>>> Ying Lin
>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
>>>> NCWCP Cubicle No. 2015
>>>> Ying.Lin at noaa.gov
>>>>
>>>>
>>>>
>>>>
>>>
--
Ying Lin
NCEP/EMC/Verification, Post-processing and Product Generation Branch
NCWCP Cubicle No. 2015
Ying.Lin at noaa.gov
------------------------------------------------
Subject: Running METplus use case (wcoss)
From: Julie Prestopnik
Time: Mon Nov 19 12:16:56 2018
Great! I'm so glad you were able to get things to work well! I'll
close
this ticket. Please feel free to submit a new one if you have any
other
questions.
Julie
On Fri, Nov 16, 2018 at 1:21 PM Ying Lin via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
>
> Hi Julie,
>
> I followed your email below and was able to produce the *.stat
etc.
> The log file and output seems to be OK. Thank you again for the
very
> clear step-by-step instructions for a METplus beginner!
>
> Ying
>
> On 11/15/18 12:23 PM, Ying Lin - NOAA Federal wrote:
> > Thank you very much Julie! Yesterday after seeing Minna’s reply I
> realized there was more I should have done with confs before running
Dan’s
> example, made some stabs on Tide but didn’t get things right. I’m
on leave
> today, will follow your detailed instructions (thanks!!) on gyre
tomorrow.
> >
> > I hope your trip back home this afternoon will go smoothly.
> >
> > Ying
> >
> >> On Nov 15, 2018, at 10:16 AM, Julie Prestopnik via RT <
> met_help at ucar.edu> wrote:
> >>
> >> Hi Ying.
> >>
> >> I was able to get METplus-2.0 set up on gyre and was able to run
Dan's
> >> "ruc-vs-s2grib" use case from last month's METplus tutorial
> successfully.
> >>
> >> I'd like to have you start fresh with using METplus-2.0 and will
provide
> >> detailed instructions for what you should do.
> >>
> >> Copy the METplus Scripting package into your own area. For
example:
> >>
> >> *cp -r /global/noscrub/Julie.Prestopnik/METplus/METplus-2.0
> >> /meso/save/Ying.Lin*
> >>
> >> This will create a METplus-2.0 directory with all its
subdirectories for
> >> you at /meso/save/Ying.Lin.
> >>
> >> Now change directories into the METplus-2.0 parm subdirectory:
> >>
> >> cd */meso/save/Ying.Lin/METplus-2.0/parm*
> >>
> >> Now you can create your own top level configuration file that
contains
> >> information specific to this machine and overrides some
configuration
> >> options.
> >>
> >> *mv jpresto.system.conf.gyre ylin.system.conf.gyre*
> >>
> >> Edit the file ylin.system.conf.gyre, changing the following:
> >>
> >> OUTPUT_BASE =
/global/noscrub/Julie.Prestopnik/METplus/data/output
> >> METPLUS_BASE =
/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
> >>
> >> Please change OUTPUT_BASE to where ever you'd like the output to
be
> written
> >> in your own area. Please change METPLUS_BASE to point to your
> >> METPLUS_BASE, for example, */meso/save/Ying.Lin/METplus-2.0/.*
> >>
> >> Now, I'll have you set up your environment. You'll need to run
the
> >> following, changing only METPLUS_PATH (to
> >> */meso/save/Ying.Lin/METplus-2.0/ *for example) below:
> >>
> >> module use /global/noscrub/Julie.Prestopnik/modulefiles
> >> module load met/8.0
> >> module load nco
> >> module load grib_util
> >> export
> METPLUS_PATH="/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0"
> >> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> >> export JLOGFILE="${METPLUS_PATH}/logs/metplus_jlogfile"
> >> export PYTHONPATH="${METPLUS_PATH}/ush:${METPLUS_PATH}/parm"
> >> export PATH="${PATH}:${METPLUS_PATH}/ush:."
> >>
> >> Once you have done that, you should be able to run Dan's test
case as
> >> follows:
> >>
> >> master_metplus.py
> >> -c
> /meso/save/Ying.Lin/METplus-2.0/parm/use_cases/qpf/examples/ruc-vs-
s2grib.conf
> >> -c /meso/save/Ying.Lin//METplus-2.0/parm/ylin.system.conf.gyre
> >>
> >> Then, please check on your output and check in your log file
> >> in {OUTPUT_BASE}/logs for errors. Please give that a try and
let me
> know
> >> how it goes!
> >>
> >> Thank you for your patience.
> >>
> >> Julie
> >>
> >> On Wed, Nov 14, 2018 at 2:20 PM Minna Win via RT
<met_help at ucar.edu>
> wrote:
> >>
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
> >>>
> >>> Hi Ying,
> >>>
> >>> In looking at your error messages, the 'Permission denied:
'/path'
> looks
> >>> like a very common mistake that users make when setting up their
config
> >>> files. It looks like there is a /path/to in one or more of your
config
> >>> files that needs to be replaced with a valid path. You can do
one of
> two
> >>> things when you encounter this problem. Take a look at the
> >>> master_metplus.conf file that is generated in your
project/output
> directory
> >>> (if it got generated). Look for any instances of '/path/to' and
:
> >>>
> >>> 1) Find the METplus config file to which this corresponds, such
as the
> >>> metplus_system.conf file in the
$METplus_HOME/parm/metplus_config
> >>> directory, and replace the /path/to with a valid path
> >>>
> >>> or
> >>>
> >>> 2) Create a 'custom' config file e.g. my_custom.conf, and from
the
> >>> master_metplus.conf file, find the family/header and add the
key-value
> >>> For example, if you forgot to replace METPLUS_BASE = /path/to,
which is
> >>> under the [dir] header/family, in your custom config file you
can do
> the
> >>> following:
> >>>
> >>> [dir]
> >>> METPLUS_BASE = /usr/local/metplus
> >>>
> >>>
> >>> I hope you find that useful when METplus is available to use on
gyre.
> If
> >>> you want me to look at your config files before you attempt to
run
> METplus
> >>> on gyre (phase 1 or phase 2), I have access to those hosts and
would be
> >>> happy to take a look.
> >>>
> >>> Regards,
> >>> Minna
> >>> ---------------
> >>> Minna Win
> >>> NCAR
> >>> Research Applications Lab
> >>> Phone: 303-497-8423
> >>> Fax: 303-497-8401
> >>>
> >>>
> >>>
> >>> On Wed, Nov 14, 2018 at 5:56 PM Ying Lin via RT
<met_help at ucar.edu>
> wrote:
> >>>
> >>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801 >
> >>>>
> >>>> Thanks Minna and Julie. I figured Julie would be pretty busy
here and
> >>>> sending a request to met_help for the MET team would work
better than
> >>>> trying to drop in on you in rm 2795.
> >>>>
> >>>> The script, err msg etc. in my request were all on gyre, though
I
> >>>> encountered similar issues on Tide earlier as well. Most
likely
> >>>> something wrong in my set up.
> >>>>
> >>>> Ying
> >>>>
> >>>> On 11/14/18 12:43 PM, Julie Prestopnik via RT wrote:
> >>>>> Hi Ying. I just sat down to type up a response and saw that
MInna
> >>> wrote
> >>>> as
> >>>>> well. I am currently at NCEP and have meetings today. I
wanted to
> let
> >>>> you
> >>>>> know that METplus-2.0 is actually not currently on "gyre"
however, I
> >>> have
> >>>>> started uploading the METplus-2.0 release and the sample data,
so
> that
> >>>> you
> >>>>> can use the most current release. We do not currently have
access to
> >>>>> "tide" because we do not have devonprod access, so we can only
access
> >>>>> "gyre" at this time. Once I get the package and the data
unpacked, I
> >>>> will
> >>>>> need to set up some files and the environment.
> >>>>>
> >>>>> My schedule is pretty full here but I, or Minna, will try to
help as
> >>> soon
> >>>>> as we can. Thank you for your patience in advance.
> >>>>>
> >>>>>
> >>>>> Julie
> >>>>>
> >>>>> On Tue, Nov 13, 2018 at 3:38 PM Ying Lin via RT
<met_help at ucar.edu>
> >>>> wrote:
> >>>>>> Tue Nov 13 15:32:17 2018: Request 87801 was acted upon.
> >>>>>> Transaction: Ticket created by ying.lin at noaa.gov
> >>>>>> Queue: met_help
> >>>>>> Subject: Running METplus use case (wcoss)
> >>>>>> Owner: Nobody
> >>>>>> Requestors: ying.lin at noaa.gov
> >>>>>> Status: new
> >>>>>> Ticket <URL:
> >>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87801
> >>>>>>
> >>>>>> Hello. I've been trying to get started on METplus by
running a use
> >>>>>> case on wcoss ... Had trouble earlier on Tide to set path,
setenv
> etc
> >>> in
> >>>>>> .cshrc (I do interactive c-shell, but run mostly ksh in
scripts) as
> >>>>>> described in P21-22 of the METplus v2.0 manual (Sept 2018
version),
> so
> >>>>>> to keep things simple I created
> >>>>>>
> >>>>>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus
> >>>>>>
> >>>>>> so that in ksh, I can simply do a ". ~/dot.for.metplus" to
set up
> >>> path,
> >>>>>> exports, etc..
> >>>>>>
> >>>>>> This is what my dot.for.metplus looks like on Gyre (between
the
> >>> '----')
> >>>>>> ------------------------------
> >>>>>>
> >>>>>> . /usrx/local/Modules/default/init/ksh
> >>>>>> module purge
> >>>>>> module use /global/noscrub/Julie.Prestopnik/modulefiles
> >>>>>> module load met/8.0
> >>>>>> module load nco
> >>>>>> module load grib_util
> >>>>>> module use /usrx/local/dev/modulefiles
> >>>>>>
> >>>>>> export MET_PATH="/global/noscrub/Julie.Prestopnik/met/8.0"
> >>>>>> export METPLUS_PATH="/meso/save/Ying.Lin/METplus"
> >>>>>>
> >>>>>> # tide
METPLUS=/global/noscrub/Julie.Prestopnik/METplus/METplus-2.0/
> >>>>>> # gyre set up is below:
> >>>>>> METPLUS=/global/noscrub/Julie.Prestopnik/METplus
> >>>>>> export PATH=${METPLUS}/ush:$PATH
> >>>>>> export
PYTHONPATH="${METPLUS}/ush:${METPLUS}/parm:$PYTHONPATH"
> >>>>>> export JLOGFILE=${METPLUS_PATH}/jlogfile
> >>>>>>
> >>>>>> ------------------------------------------------------
> >>>>>>
> >>>>>> I have a simple test script in
> >>>>>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh.
> >>>>>>
> >>>>>> Running either the master_met_plus.py alone, or actual test
case
> >>> (Dan's
> >>>>>> "ruc-vs-s2grib" at last month's METplus tutorial), as in
> >>>>>>
> >>>>>> lead to err msg like this:
> >>>>>>
> >>>>>> --------------------------------------
> >>>>>>
> >>>>>> 11/13 22:13:46.388 jlog (master_met_plus.py:195) CRITICAL:
> >>>>>> master_metplus failed: [Errno 13] Permission denied: '/path'
> >>>>>> Traceback (most recent call last):
> >>>>>> File
> >>>>>>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
> >>> line
> >>>>>> 191, in <module>
> >>>>>> main()
> >>>>>> File
> >>>>>>
"/global/noscrub/Julie.Prestopnik/METplus/ush/master_met_plus.py",
> >>> line
> >>>>>> 96, in main
> >>>>>> p = config_launcher.launch(infiles, moreopt)
> >>>>>> File
> >>>>>>
> >>>
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/config_launcher.py",
> >>>>>> line 262, in launch
> >>>>>> produtil.fileop.makedirs(conf.getdir('OUTPUT_BASE'),
> >>>> logger=logger)
> >>>>>> File
> >>>>>>
> >>>
>
"/gpfs/gd1/emc/global/noscrub/Julie.Prestopnik/METplus/ush/produtil/fileop.py",
> >>>>>> line 239, in makedirs
> >>>>>> os.makedirs(filename)
> >>>>>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py",
line 150,
> in
> >>>>>> makedirs
> >>>>>> makedirs(head, mode)
> >>>>>> File "/usrx/local/python/2.7.13/lib/python2.7/os.py",
line 157,
> in
> >>>>>> makedirs
> >>>>>> mkdir(name, mode)
> >>>>>> OSError: [Errno 13] Permission denied: '/path'
> >>>>>>
> >>>>>> ------------------------------------------
> >>>>>>
> >>>>>> Can you tell from the above what I did wrong (in both the
> >>>>>> /gpfs/gp1/u/Ying.Lin/dot.for.metplus and the
> >>>>>> /gpfs/gd1/emc/meso/save/Ying.Lin/metplus/test/testit.ksh)?
> >>>>>>
> >>>>>> Also, I assume /global/noscrub/Julie.Prestopnik/METplus/ on
gyre is
> a
> >>>>>> more recent version than the one on Tide? (more recent
modification
> >>>>>> date; Tide has "METplus-2.0", gyre doesn't; Tide has
> >>> master_metplus.py,
> >>>>>> vs. master_metplus.py). I was trying unsuccessfully on Tide
> earlier.
> >>>>>>
> >>>>>> Thanks very much!
> >>>>>>
> >>>>>> Ying
> >>>>>>
> >>>>>> --
> >>>>>> Ying Lin
> >>>>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>>>>> NCWCP Cubicle No. 2015
> >>>>>> Ying.Lin at noaa.gov
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>> --
> >>>> Ying Lin
> >>>> NCEP/EMC/Verification, Post-processing and Product Generation
Branch
> >>>> NCWCP Cubicle No. 2015
> >>>> Ying.Lin at noaa.gov
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
>
> --
> Ying Lin
> NCEP/EMC/Verification, Post-processing and Product Generation Branch
> NCWCP Cubicle No. 2015
> Ying.Lin at noaa.gov
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list