[Met_help] [rt.rap.ucar.edu #99737] History for MET code looks for bin directory
George McCabe via RT
met_help at ucar.edu
Mon May 3 15:51:45 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi, all,
Perhaps this is a simple answer. I am running METplus in the UFS Regional
Workflow, and in the current run I am working on in WCOSS, for some reason
when pb2nc is being called, it is looking for a file in the bin directory,
when I thought the bin directory was removed several versions ago, with
programs in the exec directory. Here is a snippet of the output:
04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc -v 2
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
prepbufr.ndas.2021020112.nc
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123) DEBUG: app_name
is: pb2nc, output sent to:
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
MET OUTPUT:
04/29 13:57:44.758
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
(pipeline.py:287) ERROR:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc: could
not exec: [Errno 2] No such file or directory:
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
Traceback (most recent call last):
File
"/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-3.1/produtil/pipeline.py",
line 285, in launch
os.execvpe(cmd[0],cmd,env)
File "/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py", line
568, in execvpe
_execvpe(file, args, env)
File "/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py", line
583, in _execvpe
exec_func(file, *argrest)
FileNotFoundError: [Errno 2] No such file or directory:
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
The module file is set
to: /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
But the module is set to met/9.1.3, which apparently isn't in the
emc.metplus module file. Could this be causing the problem? I thought I
had reset it to met/9.1, but apparently I didn't and I might need to run
again (which would make it a workflow problem, not a MET problem), but I
can't find another reason for the code to actually look for a file in the
bin directory.
Thanks!
Perry
--
Perry C. Shafran
Verification/MEG Group Leader for IMSG
VPPPG Branch of EMC/NCEP/NOAA/NWS
Office: 301-683-3765
Cell: 301-717-6454
(he/him/his)
perry.shafran at noaa.gov
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: MET code looks for bin directory
From: George McCabe
Time: Thu Apr 29 08:40:11 2021
Hi Perry,
In METplus, the path to the MET executables is defined by
MET_INSTALL_DIR
and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where MET is
installed and the default value of MET_BIN_DIR is
{MET_INSTALL_DIR}/bin.
Part of the installation process for METplus on machines like WCOSS is
to
set these values appropriately in the defaults of that METplus
version, so
MET_INSTALL_DIR should already be set to the appropriate directory and
MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
executables.
However, it is possible to override those values in your METplus
configuration files. I would check the metplus_final.conf file that is
generated in your output directory when you run METplus and see what
value
is set for MET_BIN_DIR. You can also check what is set in the METplus
default settings by running:
grep MET_INSTALL_DIR
/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
grep MET_BIN_DIR
/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
If MET_BIN_DIR uses the exec directory in the system configuration but
it
is not in your final conf, then one of your conf files is changing the
value to the incorrect one.
Let me know what you find. I don't have WCOSS access yet so I am
unable to
log in and take a look, but I can find someone else to poke around for
me
if necessary.
Thanks,
George
On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> Transaction: Ticket created by perry.shafran at noaa.gov
> Queue: met_help
> Subject: MET code looks for bin directory
> Owner: Nobody
> Requestors: perry.shafran at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
>
>
> Hi, all,
>
> Perhaps this is a simple answer. I am running METplus in the UFS
Regional
> Workflow, and in the current run I am working on in WCOSS, for some
reason
> when pb2nc is being called, it is looking for a file in the bin
directory,
> when I thought the bin directory was removed several versions ago,
with
> programs in the exec directory. Here is a snippet of the output:
>
> 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
-v 2
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
>
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> prepbufr.ndas.2021020112.nc
>
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123) DEBUG:
app_name
> is: pb2nc, output sent to:
>
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> MET OUTPUT:
> 04/29 13:57:44.758
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> (pipeline.py:287) ERROR:
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
could
> not exec: [Errno 2] No such file or directory:
> '/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> Traceback (most recent call last):
> File
>
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> line 285, in launch
> os.execvpe(cmd[0],cmd,env)
> File "/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
line
> 568, in execvpe
> _execvpe(file, args, env)
> File "/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
line
> 583, in _execvpe
> exec_func(file, *argrest)
> FileNotFoundError: [Errno 2] No such file or directory:
> '/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
>
> The module file is set
> to: /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
>
> But the module is set to met/9.1.3, which apparently isn't in the
> emc.metplus module file. Could this be causing the problem? I
thought I
> had reset it to met/9.1, but apparently I didn't and I might need to
run
> again (which would make it a workflow problem, not a MET problem),
but I
> can't find another reason for the code to actually look for a file
in the
> bin directory.
>
> Thanks!
>
> Perry
>
> --
> Perry C. Shafran
> Verification/MEG Group Leader for IMSG
> VPPPG Branch of EMC/NCEP/NOAA/NWS
> Office: 301-683-3765
> Cell: 301-717-6454
> (he/him/his)
> perry.shafran at noaa.gov
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MET code looks for bin directory
From: perry.shafran at noaa.gov
Time: Thu Apr 29 08:41:54 2021
Hi, George,
Thanks, I'll take a look at this and see what I get.
Thanks!
Perry
On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Perry,
>
> In METplus, the path to the MET executables is defined by
MET_INSTALL_DIR
> and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where MET is
> installed and the default value of MET_BIN_DIR is
{MET_INSTALL_DIR}/bin.
> Part of the installation process for METplus on machines like WCOSS
is to
> set these values appropriately in the defaults of that METplus
version, so
> MET_INSTALL_DIR should already be set to the appropriate directory
and
> MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
> executables.
>
> However, it is possible to override those values in your METplus
> configuration files. I would check the metplus_final.conf file that
is
> generated in your output directory when you run METplus and see what
value
> is set for MET_BIN_DIR. You can also check what is set in the
METplus
> default settings by running:
>
> grep MET_INSTALL_DIR
>
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> grep MET_BIN_DIR
>
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
>
> If MET_BIN_DIR uses the exec directory in the system configuration
but it
> is not in your final conf, then one of your conf files is changing
the
> value to the incorrect one.
>
> Let me know what you find. I don't have WCOSS access yet so I am
unable to
> log in and take a look, but I can find someone else to poke around
for me
> if necessary.
>
> Thanks,
> George
>
> On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > Transaction: Ticket created by perry.shafran at noaa.gov
> > Queue: met_help
> > Subject: MET code looks for bin directory
> > Owner: Nobody
> > Requestors: perry.shafran at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
> >
> >
> > Hi, all,
> >
> > Perhaps this is a simple answer. I am running METplus in the UFS
> Regional
> > Workflow, and in the current run I am working on in WCOSS, for
some
> reason
> > when pb2nc is being called, it is looking for a file in the bin
> directory,
> > when I thought the bin directory was removed several versions ago,
with
> > programs in the exec directory. Here is a snippet of the output:
> >
> > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
-v 2
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > prepbufr.ndas.2021020112.nc
> >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123) DEBUG:
app_name
> > is: pb2nc, output sent to:
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > MET OUTPUT:
> > 04/29 13:57:44.758
> > /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > (pipeline.py:287) ERROR:
> >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
could
> > not exec: [Errno 2] No such file or directory:
> >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > Traceback (most recent call last):
> > File
> >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > line 285, in launch
> > os.execvpe(cmd[0],cmd,env)
> > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py", line
> > 568, in execvpe
> > _execvpe(file, args, env)
> > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py", line
> > 583, in _execvpe
> > exec_func(file, *argrest)
> > FileNotFoundError: [Errno 2] No such file or directory:
> >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> >
> > The module file is set
> > to: /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> >
> > But the module is set to met/9.1.3, which apparently isn't in the
> > emc.metplus module file. Could this be causing the problem? I
thought I
> > had reset it to met/9.1, but apparently I didn't and I might need
to run
> > again (which would make it a workflow problem, not a MET problem),
but I
> > can't find another reason for the code to actually look for a file
in the
> > bin directory.
> >
> > Thanks!
> >
> > Perry
> >
> > --
> > Perry C. Shafran
> > Verification/MEG Group Leader for IMSG
> > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > Office: 301-683-3765
> > Cell: 301-717-6454
> > (he/him/his)
> > perry.shafran at noaa.gov
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Perry C. Shafran
Verification/MEG Group Leader for IMSG
VPPPG Branch of EMC/NCEP/NOAA/NWS
Office: 301-683-3765
Cell: 301-717-6454
(he/him/his)
perry.shafran at noaa.gov
------------------------------------------------
Subject: MET code looks for bin directory
From: perry.shafran at noaa.gov
Time: Thu Apr 29 08:51:30 2021
Hi, George,
Well I got this. I guess I'll need to correct in my configuration
file?
100 (v71a1)
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> grep MET_INSTALL_DIR
/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
MET_INSTALL_DIR =
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1
MET_BIN_DIR = {MET_INSTALL_DIR}/bin
101 (v71a1)
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
Perry
On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Perry,
>
> In METplus, the path to the MET executables is defined by
MET_INSTALL_DIR
> and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where MET is
> installed and the default value of MET_BIN_DIR is
{MET_INSTALL_DIR}/bin.
> Part of the installation process for METplus on machines like WCOSS
is to
> set these values appropriately in the defaults of that METplus
version, so
> MET_INSTALL_DIR should already be set to the appropriate directory
and
> MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
> executables.
>
> However, it is possible to override those values in your METplus
> configuration files. I would check the metplus_final.conf file that
is
> generated in your output directory when you run METplus and see what
value
> is set for MET_BIN_DIR. You can also check what is set in the
METplus
> default settings by running:
>
> grep MET_INSTALL_DIR
>
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> grep MET_BIN_DIR
>
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
>
> If MET_BIN_DIR uses the exec directory in the system configuration
but it
> is not in your final conf, then one of your conf files is changing
the
> value to the incorrect one.
>
> Let me know what you find. I don't have WCOSS access yet so I am
unable to
> log in and take a look, but I can find someone else to poke around
for me
> if necessary.
>
> Thanks,
> George
>
> On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > Transaction: Ticket created by perry.shafran at noaa.gov
> > Queue: met_help
> > Subject: MET code looks for bin directory
> > Owner: Nobody
> > Requestors: perry.shafran at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
> >
> >
> > Hi, all,
> >
> > Perhaps this is a simple answer. I am running METplus in the UFS
> Regional
> > Workflow, and in the current run I am working on in WCOSS, for
some
> reason
> > when pb2nc is being called, it is looking for a file in the bin
> directory,
> > when I thought the bin directory was removed several versions ago,
with
> > programs in the exec directory. Here is a snippet of the output:
> >
> > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
-v 2
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > prepbufr.ndas.2021020112.nc
> >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123) DEBUG:
app_name
> > is: pb2nc, output sent to:
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > MET OUTPUT:
> > 04/29 13:57:44.758
> > /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > (pipeline.py:287) ERROR:
> >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
could
> > not exec: [Errno 2] No such file or directory:
> >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > Traceback (most recent call last):
> > File
> >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > line 285, in launch
> > os.execvpe(cmd[0],cmd,env)
> > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py", line
> > 568, in execvpe
> > _execvpe(file, args, env)
> > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py", line
> > 583, in _execvpe
> > exec_func(file, *argrest)
> > FileNotFoundError: [Errno 2] No such file or directory:
> >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> >
> > The module file is set
> > to: /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> >
> > But the module is set to met/9.1.3, which apparently isn't in the
> > emc.metplus module file. Could this be causing the problem? I
thought I
> > had reset it to met/9.1, but apparently I didn't and I might need
to run
> > again (which would make it a workflow problem, not a MET problem),
but I
> > can't find another reason for the code to actually look for a file
in the
> > bin directory.
> >
> > Thanks!
> >
> > Perry
> >
> > --
> > Perry C. Shafran
> > Verification/MEG Group Leader for IMSG
> > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > Office: 301-683-3765
> > Cell: 301-717-6454
> > (he/him/his)
> > perry.shafran at noaa.gov
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Perry C. Shafran
Verification/MEG Group Leader for IMSG
VPPPG Branch of EMC/NCEP/NOAA/NWS
Office: 301-683-3765
Cell: 301-717-6454
(he/him/his)
perry.shafran at noaa.gov
------------------------------------------------
Subject: MET code looks for bin directory
From: Julie Prestopnik
Time: Thu Apr 29 09:07:56 2021
It looks like you two have this all worked out. I just wanted to add
a
reminder that it would be good to switch over to using the official
installation on WCOSS when you have a chance. The Existing Builds
page for
the 3.1.1 installation is updated here:
https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
As a quick reference, for METplus you would use:
module use
/gpfs/dell1/nco/ops/nwprod/modulefiles/compiler_prod/ips/18.0.1
module load metplus/3.1.1
Julie
On Thu, Apr 29, 2021 at 8:51 AM perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
>
> Hi, George,
>
> Well I got this. I guess I'll need to correct in my configuration
file?
>
> 100 (v71a1)
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> > grep MET_INSTALL_DIR
>
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> MET_INSTALL_DIR =
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1
> MET_BIN_DIR = {MET_INSTALL_DIR}/bin
> 101 (v71a1)
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
>
> Perry
>
> On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Perry,
> >
> > In METplus, the path to the MET executables is defined by
MET_INSTALL_DIR
> > and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where MET
is
> > installed and the default value of MET_BIN_DIR is
{MET_INSTALL_DIR}/bin.
> > Part of the installation process for METplus on machines like
WCOSS is to
> > set these values appropriately in the defaults of that METplus
version,
> so
> > MET_INSTALL_DIR should already be set to the appropriate directory
and
> > MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
> > executables.
> >
> > However, it is possible to override those values in your METplus
> > configuration files. I would check the metplus_final.conf file
that is
> > generated in your output directory when you run METplus and see
what
> value
> > is set for MET_BIN_DIR. You can also check what is set in the
METplus
> > default settings by running:
> >
> > grep MET_INSTALL_DIR
> >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > grep MET_BIN_DIR
> >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> >
> > If MET_BIN_DIR uses the exec directory in the system configuration
but it
> > is not in your final conf, then one of your conf files is changing
the
> > value to the incorrect one.
> >
> > Let me know what you find. I don't have WCOSS access yet so I am
unable
> to
> > log in and take a look, but I can find someone else to poke around
for me
> > if necessary.
> >
> > Thanks,
> > George
> >
> > On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > Queue: met_help
> > > Subject: MET code looks for bin directory
> > > Owner: Nobody
> > > Requestors: perry.shafran at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737
> >
> > >
> > >
> > > Hi, all,
> > >
> > > Perhaps this is a simple answer. I am running METplus in the
UFS
> > Regional
> > > Workflow, and in the current run I am working on in WCOSS, for
some
> > reason
> > > when pb2nc is being called, it is looking for a file in the bin
> > directory,
> > > when I thought the bin directory was removed several versions
ago, with
> > > programs in the exec directory. Here is a snippet of the
output:
> > >
> > > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc -v
2
> > >
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > > prepbufr.ndas.2021020112.nc
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123) DEBUG:
> app_name
> > > is: pb2nc, output sent to:
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > > MET OUTPUT:
> > > 04/29 13:57:44.758
> > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > > (pipeline.py:287) ERROR:
> > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
> could
> > > not exec: [Errno 2] No such file or directory:
> > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > Traceback (most recent call last):
> > > File
> > >
> > >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > > line 285, in launch
> > > os.execvpe(cmd[0],cmd,env)
> > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> line
> > > 568, in execvpe
> > > _execvpe(file, args, env)
> > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> line
> > > 583, in _execvpe
> > > exec_func(file, *argrest)
> > > FileNotFoundError: [Errno 2] No such file or directory:
> > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > >
> > > The module file is set
> > > to:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > >
> > > But the module is set to met/9.1.3, which apparently isn't in
the
> > > emc.metplus module file. Could this be causing the problem? I
> thought I
> > > had reset it to met/9.1, but apparently I didn't and I might
need to
> run
> > > again (which would make it a workflow problem, not a MET
problem), but
> I
> > > can't find another reason for the code to actually look for a
file in
> the
> > > bin directory.
> > >
> > > Thanks!
> > >
> > > Perry
> > >
> > > --
> > > Perry C. Shafran
> > > Verification/MEG Group Leader for IMSG
> > > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > > Office: 301-683-3765
> > > Cell: 301-717-6454
> > > (he/him/his)
> > > perry.shafran at noaa.gov
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Perry C. Shafran
> Verification/MEG Group Leader for IMSG
> VPPPG Branch of EMC/NCEP/NOAA/NWS
> Office: 301-683-3765
> Cell: 301-717-6454
> (he/him/his)
> perry.shafran at noaa.gov
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MET code looks for bin directory
From: George McCabe
Time: Thu Apr 29 09:10:28 2021
Thanks for the info, Perry and Julie. It sounds like there is a more
up-to-date version to 3.1 that can be used that should resolve this
issue.
If for some reason you must use the old version, you can set
MET_BIN_DIR to
{MET_INSTALL_DIR}/exec in your user config file and it should fix the
issue
there.
On Thu, Apr 29, 2021 at 9:08 AM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
>
> It looks like you two have this all worked out. I just wanted to
add a
> reminder that it would be good to switch over to using the official
> installation on WCOSS when you have a chance. The Existing Builds
page for
> the 3.1.1 installation is updated here:
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
>
> As a quick reference, for METplus you would use:
> module use
/gpfs/dell1/nco/ops/nwprod/modulefiles/compiler_prod/ips/18.0.1
> module load metplus/3.1.1
>
> Julie
>
> On Thu, Apr 29, 2021 at 8:51 AM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
> >
> > Hi, George,
> >
> > Well I got this. I guess I'll need to correct in my configuration
file?
> >
> > 100 (v71a1)
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> > > grep MET_INSTALL_DIR
> >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > MET_INSTALL_DIR =
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1
> > MET_BIN_DIR = {MET_INSTALL_DIR}/bin
> > 101 (v71a1)
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> >
> > Perry
> >
> > On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> > > Hi Perry,
> > >
> > > In METplus, the path to the MET executables is defined by
> MET_INSTALL_DIR
> > > and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where
MET is
> > > installed and the default value of MET_BIN_DIR is
> {MET_INSTALL_DIR}/bin.
> > > Part of the installation process for METplus on machines like
WCOSS is
> to
> > > set these values appropriately in the defaults of that METplus
version,
> > so
> > > MET_INSTALL_DIR should already be set to the appropriate
directory and
> > > MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
> > > executables.
> > >
> > > However, it is possible to override those values in your METplus
> > > configuration files. I would check the metplus_final.conf file
that is
> > > generated in your output directory when you run METplus and see
what
> > value
> > > is set for MET_BIN_DIR. You can also check what is set in the
METplus
> > > default settings by running:
> > >
> > > grep MET_INSTALL_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > > grep MET_BIN_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > >
> > > If MET_BIN_DIR uses the exec directory in the system
configuration but
> it
> > > is not in your final conf, then one of your conf files is
changing the
> > > value to the incorrect one.
> > >
> > > Let me know what you find. I don't have WCOSS access yet so I am
unable
> > to
> > > log in and take a look, but I can find someone else to poke
around for
> me
> > > if necessary.
> > >
> > > Thanks,
> > > George
> > >
> > > On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > > Queue: met_help
> > > > Subject: MET code looks for bin directory
> > > > Owner: Nobody
> > > > Requestors: perry.shafran at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737
> > >
> > > >
> > > >
> > > > Hi, all,
> > > >
> > > > Perhaps this is a simple answer. I am running METplus in the
UFS
> > > Regional
> > > > Workflow, and in the current run I am working on in WCOSS, for
some
> > > reason
> > > > when pb2nc is being called, it is looking for a file in the
bin
> > > directory,
> > > > when I thought the bin directory was removed several versions
ago,
> with
> > > > programs in the exec directory. Here is a snippet of the
output:
> > > >
> > > > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> -v 2
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > > > prepbufr.ndas.2021020112.nc
> > > >
> > > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > > > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123)
DEBUG:
> > app_name
> > > > is: pb2nc, output sent to:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > > > MET OUTPUT:
> > > > 04/29 13:57:44.758
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > > > (pipeline.py:287) ERROR:
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
> > could
> > > > not exec: [Errno 2] No such file or directory:
> > > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > > Traceback (most recent call last):
> > > > File
> > > >
> > > >
> > >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > > > line 285, in launch
> > > > os.execvpe(cmd[0],cmd,env)
> > > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > line
> > > > 568, in execvpe
> > > > _execvpe(file, args, env)
> > > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > line
> > > > 583, in _execvpe
> > > > exec_func(file, *argrest)
> > > > FileNotFoundError: [Errno 2] No such file or directory:
> > > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > >
> > > > The module file is set
> > > > to:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > >
> > > > But the module is set to met/9.1.3, which apparently isn't in
the
> > > > emc.metplus module file. Could this be causing the problem?
I
> > thought I
> > > > had reset it to met/9.1, but apparently I didn't and I might
need to
> > run
> > > > again (which would make it a workflow problem, not a MET
problem),
> but
> > I
> > > > can't find another reason for the code to actually look for a
file in
> > the
> > > > bin directory.
> > > >
> > > > Thanks!
> > > >
> > > > Perry
> > > >
> > > > --
> > > > Perry C. Shafran
> > > > Verification/MEG Group Leader for IMSG
> > > > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > > > Office: 301-683-3765
> > > > Cell: 301-717-6454
> > > > (he/him/his)
> > > > perry.shafran at noaa.gov
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Perry C. Shafran
> > Verification/MEG Group Leader for IMSG
> > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > Office: 301-683-3765
> > Cell: 301-717-6454
> > (he/him/his)
> > perry.shafran at noaa.gov
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MET code looks for bin directory
From: perry.shafran at noaa.gov
Time: Thu Apr 29 09:12:23 2021
Thanks! It's not worked out yet, but perhaps using the official
version
might help as well.
Perry
On Thu, Apr 29, 2021 at 11:08 AM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> It looks like you two have this all worked out. I just wanted to
add a
> reminder that it would be good to switch over to using the official
> installation on WCOSS when you have a chance. The Existing Builds
page for
> the 3.1.1 installation is updated here:
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
>
> As a quick reference, for METplus you would use:
> module use
/gpfs/dell1/nco/ops/nwprod/modulefiles/compiler_prod/ips/18.0.1
> module load metplus/3.1.1
>
> Julie
>
> On Thu, Apr 29, 2021 at 8:51 AM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
> >
> > Hi, George,
> >
> > Well I got this. I guess I'll need to correct in my configuration
file?
> >
> > 100 (v71a1)
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> > > grep MET_INSTALL_DIR
> >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > MET_INSTALL_DIR =
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1
> > MET_BIN_DIR = {MET_INSTALL_DIR}/bin
> > 101 (v71a1)
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> >
> > Perry
> >
> > On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> > > Hi Perry,
> > >
> > > In METplus, the path to the MET executables is defined by
> MET_INSTALL_DIR
> > > and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where
MET is
> > > installed and the default value of MET_BIN_DIR is
> {MET_INSTALL_DIR}/bin.
> > > Part of the installation process for METplus on machines like
WCOSS is
> to
> > > set these values appropriately in the defaults of that METplus
version,
> > so
> > > MET_INSTALL_DIR should already be set to the appropriate
directory and
> > > MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
> > > executables.
> > >
> > > However, it is possible to override those values in your METplus
> > > configuration files. I would check the metplus_final.conf file
that is
> > > generated in your output directory when you run METplus and see
what
> > value
> > > is set for MET_BIN_DIR. You can also check what is set in the
METplus
> > > default settings by running:
> > >
> > > grep MET_INSTALL_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > > grep MET_BIN_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > >
> > > If MET_BIN_DIR uses the exec directory in the system
configuration but
> it
> > > is not in your final conf, then one of your conf files is
changing the
> > > value to the incorrect one.
> > >
> > > Let me know what you find. I don't have WCOSS access yet so I am
unable
> > to
> > > log in and take a look, but I can find someone else to poke
around for
> me
> > > if necessary.
> > >
> > > Thanks,
> > > George
> > >
> > > On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > > Queue: met_help
> > > > Subject: MET code looks for bin directory
> > > > Owner: Nobody
> > > > Requestors: perry.shafran at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737
> > >
> > > >
> > > >
> > > > Hi, all,
> > > >
> > > > Perhaps this is a simple answer. I am running METplus in the
UFS
> > > Regional
> > > > Workflow, and in the current run I am working on in WCOSS, for
some
> > > reason
> > > > when pb2nc is being called, it is looking for a file in the
bin
> > > directory,
> > > > when I thought the bin directory was removed several versions
ago,
> with
> > > > programs in the exec directory. Here is a snippet of the
output:
> > > >
> > > > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> -v 2
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > > > prepbufr.ndas.2021020112.nc
> > > >
> > > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > > > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123)
DEBUG:
> > app_name
> > > > is: pb2nc, output sent to:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > > > MET OUTPUT:
> > > > 04/29 13:57:44.758
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > > > (pipeline.py:287) ERROR:
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
> > could
> > > > not exec: [Errno 2] No such file or directory:
> > > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > > Traceback (most recent call last):
> > > > File
> > > >
> > > >
> > >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > > > line 285, in launch
> > > > os.execvpe(cmd[0],cmd,env)
> > > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > line
> > > > 568, in execvpe
> > > > _execvpe(file, args, env)
> > > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > line
> > > > 583, in _execvpe
> > > > exec_func(file, *argrest)
> > > > FileNotFoundError: [Errno 2] No such file or directory:
> > > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > >
> > > > The module file is set
> > > > to:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > >
> > > > But the module is set to met/9.1.3, which apparently isn't in
the
> > > > emc.metplus module file. Could this be causing the problem?
I
> > thought I
> > > > had reset it to met/9.1, but apparently I didn't and I might
need to
> > run
> > > > again (which would make it a workflow problem, not a MET
problem),
> but
> > I
> > > > can't find another reason for the code to actually look for a
file in
> > the
> > > > bin directory.
> > > >
> > > > Thanks!
> > > >
> > > > Perry
> > > >
> > > > --
> > > > Perry C. Shafran
> > > > Verification/MEG Group Leader for IMSG
> > > > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > > > Office: 301-683-3765
> > > > Cell: 301-717-6454
> > > > (he/him/his)
> > > > perry.shafran at noaa.gov
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Perry C. Shafran
> > Verification/MEG Group Leader for IMSG
> > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > Office: 301-683-3765
> > Cell: 301-717-6454
> > (he/him/his)
> > perry.shafran at noaa.gov
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Perry C. Shafran
Verification/MEG Group Leader for IMSG
VPPPG Branch of EMC/NCEP/NOAA/NWS
Office: 301-683-3765
Cell: 301-717-6454
(he/him/his)
perry.shafran at noaa.gov
------------------------------------------------
Subject: MET code looks for bin directory
From: perry.shafran at noaa.gov
Time: Thu Apr 29 09:58:35 2021
Hi, Julie,
Would you tell me if these two settings are correct? This is for an
input
script where these variables will be input into METplus.
METPLUS_PATH="/gpfs/dell1/nco/ops/nwprod/metplus.v3.1.1/METplus-3.1"
MET_INSTALL_DIR="/gpfs/dell1/nco/ops/nwprod/met.v9.1.3/met-9.1.3"
Thanks!
Perry
On Thu, Apr 29, 2021 at 11:08 AM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> It looks like you two have this all worked out. I just wanted to
add a
> reminder that it would be good to switch over to using the official
> installation on WCOSS when you have a chance. The Existing Builds
page for
> the 3.1.1 installation is updated here:
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
>
> As a quick reference, for METplus you would use:
> module use
/gpfs/dell1/nco/ops/nwprod/modulefiles/compiler_prod/ips/18.0.1
> module load metplus/3.1.1
>
> Julie
>
> On Thu, Apr 29, 2021 at 8:51 AM perry.shafran at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
> >
> > Hi, George,
> >
> > Well I got this. I guess I'll need to correct in my configuration
file?
> >
> > 100 (v71a1)
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> > > grep MET_INSTALL_DIR
> >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > MET_INSTALL_DIR =
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1
> > MET_BIN_DIR = {MET_INSTALL_DIR}/bin
> > 101 (v71a1)
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> >
> > Perry
> >
> > On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> > > Hi Perry,
> > >
> > > In METplus, the path to the MET executables is defined by
> MET_INSTALL_DIR
> > > and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where
MET is
> > > installed and the default value of MET_BIN_DIR is
> {MET_INSTALL_DIR}/bin.
> > > Part of the installation process for METplus on machines like
WCOSS is
> to
> > > set these values appropriately in the defaults of that METplus
version,
> > so
> > > MET_INSTALL_DIR should already be set to the appropriate
directory and
> > > MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find the
> > > executables.
> > >
> > > However, it is possible to override those values in your METplus
> > > configuration files. I would check the metplus_final.conf file
that is
> > > generated in your output directory when you run METplus and see
what
> > value
> > > is set for MET_BIN_DIR. You can also check what is set in the
METplus
> > > default settings by running:
> > >
> > > grep MET_INSTALL_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > > grep MET_BIN_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > >
> > > If MET_BIN_DIR uses the exec directory in the system
configuration but
> it
> > > is not in your final conf, then one of your conf files is
changing the
> > > value to the incorrect one.
> > >
> > > Let me know what you find. I don't have WCOSS access yet so I am
unable
> > to
> > > log in and take a look, but I can find someone else to poke
around for
> me
> > > if necessary.
> > >
> > > Thanks,
> > > George
> > >
> > > On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > > Queue: met_help
> > > > Subject: MET code looks for bin directory
> > > > Owner: Nobody
> > > > Requestors: perry.shafran at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737
> > >
> > > >
> > > >
> > > > Hi, all,
> > > >
> > > > Perhaps this is a simple answer. I am running METplus in the
UFS
> > > Regional
> > > > Workflow, and in the current run I am working on in WCOSS, for
some
> > > reason
> > > > when pb2nc is being called, it is looking for a file in the
bin
> > > directory,
> > > > when I thought the bin directory was removed several versions
ago,
> with
> > > > programs in the exec directory. Here is a snippet of the
output:
> > > >
> > > > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> -v 2
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > > > prepbufr.ndas.2021020112.nc
> > > >
> > > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > > > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123)
DEBUG:
> > app_name
> > > > is: pb2nc, output sent to:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > > > MET OUTPUT:
> > > > 04/29 13:57:44.758
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > > > (pipeline.py:287) ERROR:
> > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
> > could
> > > > not exec: [Errno 2] No such file or directory:
> > > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > > Traceback (most recent call last):
> > > > File
> > > >
> > > >
> > >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > > > line 285, in launch
> > > > os.execvpe(cmd[0],cmd,env)
> > > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > line
> > > > 568, in execvpe
> > > > _execvpe(file, args, env)
> > > > File
"/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > line
> > > > 583, in _execvpe
> > > > exec_func(file, *argrest)
> > > > FileNotFoundError: [Errno 2] No such file or directory:
> > > >
'/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > >
> > > > The module file is set
> > > > to:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > >
> > > > But the module is set to met/9.1.3, which apparently isn't in
the
> > > > emc.metplus module file. Could this be causing the problem?
I
> > thought I
> > > > had reset it to met/9.1, but apparently I didn't and I might
need to
> > run
> > > > again (which would make it a workflow problem, not a MET
problem),
> but
> > I
> > > > can't find another reason for the code to actually look for a
file in
> > the
> > > > bin directory.
> > > >
> > > > Thanks!
> > > >
> > > > Perry
> > > >
> > > > --
> > > > Perry C. Shafran
> > > > Verification/MEG Group Leader for IMSG
> > > > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > > > Office: 301-683-3765
> > > > Cell: 301-717-6454
> > > > (he/him/his)
> > > > perry.shafran at noaa.gov
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Perry C. Shafran
> > Verification/MEG Group Leader for IMSG
> > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > Office: 301-683-3765
> > Cell: 301-717-6454
> > (he/him/his)
> > perry.shafran at noaa.gov
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Perry C. Shafran
Verification/MEG Group Leader for IMSG
VPPPG Branch of EMC/NCEP/NOAA/NWS
Office: 301-683-3765
Cell: 301-717-6454
(he/him/his)
perry.shafran at noaa.gov
------------------------------------------------
Subject: MET code looks for bin directory
From: Julie Prestopnik
Time: Thu Apr 29 11:45:44 2021
Hi Perry.
That's not quite right.
You're missing a ".1" at the end of METPLUS_PATH.
[Julie.Prestopnik at v71a2 ~]$ ls
> /gpfs/dell1/nco/ops/nwprod/metplus.v3.1.1/METplus-3.1
> ls: cannot access /gpfs/dell1/nco/ops/nwprod/metplus.v3.1.1/METplus-
3.1:
> No such file or directory
>
but you can see the correct location here:
[Julie.Prestopnik at v71a2 ~]$ ls
> /gpfs/dell1/nco/ops/nwprod/metplus.v3.1.1/METplus-3.1.1
> build_components ci docs environment.yml internal_tests
> manage_externals metplus parm produtil README.md
requirements.txt
> ush
For MET_INSTALL_DIR, you've added an extra directory "met-9.1.3" at
the
end. MET_INSTALL_DIR should point to the directory that contains the
"exec"
and "share" subdirectories which is
"/gpfs/dell1/nco/ops/nwprod/met.v9.1.3/".
[Julie.Prestopnik at v71a2 ~]$ ls /gpfs/dell1/nco/ops/nwprod/met.v9.1.3/
> compilationsteps compile_MET_all.sh exec external_libs fonts
> install_MET_env.dell met-9.1.3 share tar_files
So, in summary, here is what you should have:
METPLUS_PATH="/gpfs/dell1/nco/ops/nwprod/metplus.v3.1.1/METplus-3.1.1"
MET_INSTALL_DIR="/gpfs/dell1/nco/ops/nwprod/met.v9.1.3"
I hope that helps! Please let us know how it goes.
Julie
On Thu, Apr 29, 2021 at 9:59 AM perry.shafran at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
>
> Hi, Julie,
>
> Would you tell me if these two settings are correct? This is for an
input
> script where these variables will be input into METplus.
>
> METPLUS_PATH="/gpfs/dell1/nco/ops/nwprod/metplus.v3.1.1/METplus-3.1"
> MET_INSTALL_DIR="/gpfs/dell1/nco/ops/nwprod/met.v9.1.3/met-9.1.3"
>
> Thanks!
>
> Perry
>
> On Thu, Apr 29, 2021 at 11:08 AM Julie Prestopnik via RT <
> met_help at ucar.edu>
> wrote:
>
> > It looks like you two have this all worked out. I just wanted to
add a
> > reminder that it would be good to switch over to using the
official
> > installation on WCOSS when you have a chance. The Existing Builds
page
> for
> > the 3.1.1 installation is updated here:
> > https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> >
> > As a quick reference, for METplus you would use:
> > module use
> /gpfs/dell1/nco/ops/nwprod/modulefiles/compiler_prod/ips/18.0.1
> > module load metplus/3.1.1
> >
> > Julie
> >
> > On Thu, Apr 29, 2021 at 8:51 AM perry.shafran at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737 >
> > >
> > > Hi, George,
> > >
> > > Well I got this. I guess I'll need to correct in my
configuration
> file?
> > >
> > > 100 (v71a1)
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> > > > grep MET_INSTALL_DIR
> > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > > MET_INSTALL_DIR =
> > /gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1
> > > MET_BIN_DIR = {MET_INSTALL_DIR}/bin
> > > 101 (v71a1)
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community
> > >
> > > Perry
> > >
> > > On Thu, Apr 29, 2021 at 10:40 AM George McCabe via RT <
> met_help at ucar.edu
> > >
> > > wrote:
> > >
> > > > Hi Perry,
> > > >
> > > > In METplus, the path to the MET executables is defined by
> > MET_INSTALL_DIR
> > > > and MET_BIN_DIR. MET_INSTALL_DIR is set to the location where
MET is
> > > > installed and the default value of MET_BIN_DIR is
> > {MET_INSTALL_DIR}/bin.
> > > > Part of the installation process for METplus on machines like
WCOSS
> is
> > to
> > > > set these values appropriately in the defaults of that METplus
> version,
> > > so
> > > > MET_INSTALL_DIR should already be set to the appropriate
directory
> and
> > > > MET_BIN_DIR should be set to {MET_INSTALL_DIR}/exec to find
the
> > > > executables.
> > > >
> > > > However, it is possible to override those values in your
METplus
> > > > configuration files. I would check the metplus_final.conf file
that
> is
> > > > generated in your output directory when you run METplus and
see what
> > > value
> > > > is set for MET_BIN_DIR. You can also check what is set in the
METplus
> > > > default settings by running:
> > > >
> > > > grep MET_INSTALL_DIR
> > > >
> > > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > > > grep MET_BIN_DIR
> > > >
> > > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/parm/metplus_config/metplus_system.conf
> > > >
> > > > If MET_BIN_DIR uses the exec directory in the system
configuration
> but
> > it
> > > > is not in your final conf, then one of your conf files is
changing
> the
> > > > value to the incorrect one.
> > > >
> > > > Let me know what you find. I don't have WCOSS access yet so I
am
> unable
> > > to
> > > > log in and take a look, but I can find someone else to poke
around
> for
> > me
> > > > if necessary.
> > > >
> > > > Thanks,
> > > > George
> > > >
> > > > On Thu, Apr 29, 2021 at 8:15 AM perry.shafran at noaa.gov via RT
<
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Thu Apr 29 08:15:29 2021: Request 99737 was acted upon.
> > > > > Transaction: Ticket created by perry.shafran at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: MET code looks for bin directory
> > > > > Owner: Nobody
> > > > > Requestors: perry.shafran at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99737
> > > >
> > > > >
> > > > >
> > > > > Hi, all,
> > > > >
> > > > > Perhaps this is a simple answer. I am running METplus in
the UFS
> > > > Regional
> > > > > Workflow, and in the current run I am working on in WCOSS,
for some
> > > > reason
> > > > > when pb2nc is being called, it is looking for a file in the
bin
> > > > directory,
> > > > > when I thought the bin directory was removed several
versions ago,
> > with
> > > > > programs in the exec directory. Here is a snippet of the
output:
> > > > >
> > > > > 04/29 13:57:44.719 metplus.PB2NC INFO: COMMAND:
> > > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > -v 2
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Perry.Shafran/HIWT/obs/ndas/proc/prepbufr.ndas.2021020112
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/2021020112/metprd/pb2nc/
> > > > > prepbufr.ndas.2021020112.nc
> > > > >
> > > > >
> > > >
> > >
> >
> /gpfs/dell2/emc/verification/noscrub/Perry.Shafran/ufs-srweather-
app/regional_workflow/ush/templates/parm/met/PB2NCConfig_conus_sfc
> > > > > 04/29 13:57:44.720 metplus.PB2NC (command_runner.py:123)
DEBUG:
> > > app_name
> > > > > is: pb2nc, output sent to:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Perry.Shafran/expt_dirs/test_community/log/master_metplus.log.20210429135741
> > > > > MET OUTPUT:
> > > > > 04/29 13:57:44.758
> > > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc
> > > > > (pipeline.py:287) ERROR:
> > > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc:
> > > could
> > > > > not exec: [Errno 2] No such file or directory:
> > > > >
> '/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > > > Traceback (most recent call last):
> > > > > File
> > > > >
> > > > >
> > > >
> > >
> >
> "/gpfs/dell2/emc/verification/noscrub/emc.metplus/METplus/METplus-
3.1/produtil/pipeline.py",
> > > > > line 285, in launch
> > > > > os.execvpe(cmd[0],cmd,env)
> > > > > File
> "/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > > line
> > > > > 568, in execvpe
> > > > > _execvpe(file, args, env)
> > > > > File
> "/usrx/local/prod/packages/python/3.6.3/lib/python3.6/os.py",
> > > line
> > > > > 583, in _execvpe
> > > > > exec_func(file, *argrest)
> > > > > FileNotFoundError: [Errno 2] No such file or directory:
> > > > >
> '/gpfs/dell2/emc/verification/noscrub/emc.metplus/met/9.1/bin/pb2nc'
> > > > >
> > > > > The module file is set
> > > > > to:
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > >
> > > > > But the module is set to met/9.1.3, which apparently isn't
in the
> > > > > emc.metplus module file. Could this be causing the problem?
I
> > > thought I
> > > > > had reset it to met/9.1, but apparently I didn't and I might
need
> to
> > > run
> > > > > again (which would make it a workflow problem, not a MET
problem),
> > but
> > > I
> > > > > can't find another reason for the code to actually look for
a file
> in
> > > the
> > > > > bin directory.
> > > > >
> > > > > Thanks!
> > > > >
> > > > > Perry
> > > > >
> > > > > --
> > > > > Perry C. Shafran
> > > > > Verification/MEG Group Leader for IMSG
> > > > > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > > > > Office: 301-683-3765
> > > > > Cell: 301-717-6454
> > > > > (he/him/his)
> > > > > perry.shafran at noaa.gov
> > > > >
> > > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > > --
> > > Perry C. Shafran
> > > Verification/MEG Group Leader for IMSG
> > > VPPPG Branch of EMC/NCEP/NOAA/NWS
> > > Office: 301-683-3765
> > > Cell: 301-717-6454
> > > (he/him/his)
> > > perry.shafran at noaa.gov
> > >
> > >
> >
> > --
> > Julie Prestopnik (she/her)
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Perry C. Shafran
> Verification/MEG Group Leader for IMSG
> VPPPG Branch of EMC/NCEP/NOAA/NWS
> Office: 301-683-3765
> Cell: 301-717-6454
> (he/him/his)
> perry.shafran at noaa.gov
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
More information about the Met_help
mailing list