[Met_help] [rt.rap.ucar.edu #99338] History for error with write_pickle_dataplane.py
John Halley Gotway via RT
met_help at ucar.edu
Mon Apr 5 11:56:23 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
MET team,
I need some help troubleshooting the below error:
+ /usr/bin/singularity exec /unified_verif/shared/singularity_build/met.simg
grid_stat PYTHON_NUMPY PYTHON_NUMPY
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTUNE_201
9010200 -outdir
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/stats_out/NEPTUNE_test -v
2
DEBUG 1: Default Config File:
/software/depot/met-9.1/met-9.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File:
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTUNE_201
9010200
Python Script:
/software/depot/met-9.1/met-9.1/share/met/wrappers/write_pickle_dataplane.py
User Command: ['/unified_verif/work/workwesley/uv/scripts/lib/met_test',
'-f',
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/n
eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5', '-l',
'85000', '-lt', 'pressure', '-v', 'meridional_wind']
Write Pickle: /tmp/tmp_met_pickle_13346_0
Traceback (most recent call last):
File
"/software/depot/met-9.1/met-9.1/share/met/wrappers/write_pickle_dataplane.p
y", line 32, in <module>
spec.loader.exec_module(met_in)
File "<frozen importlib._bootstrap_external>", line 724, in exec_module
File "<frozen importlib._bootstrap_external>", line 859, in get_code
File "<frozen importlib._bootstrap_external>", line 916, in get_data
FileNotFoundError: [Errno 2] No such file or directory:
'/unified_verif/work/workwesley/uv/scripts/lib/met_test.py'
ERROR :
ERROR : pickle_dataplane() -> command
"/users/davis/.conda/envs/xnrl/bin/python
/software/depot/met-9.1/met-9.1/share/met/wrappers/write_pickle_dataplane.py
/tmp/tmp_met_pickle_13346_0
/unified_verif/work/workwesley/uv/scripts/lib/met_test -f
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/ne
ptune_quartdeg_E0096
ERROR :
In particular, the write_pickle_dataplane.py programs is telling me "
FileNotFoundError: [Errno 2] No such file or directory:
'/unified_verif/work/workwesley/uv/scripts/lib/met_test.py' ". This file
does indeed exist in the place that it's telling me that it does not exist.
Any assistance in troubleshooting would be appreciated.
Some background:
/unified_verif/work/workwesley/uv/scripts/lib/met_test.py : A script that
uses an internally developed python library to parse model files and return
requested data
-f',
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/n
eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5' : -f for
filename, followed by a filename
'-l', '85000' : -l for level, followed by a level
'-lt', 'pressure' : -lt for level type, followed by a level type
'-v', 'meridional_wind' : -v for variable, followed by a variable
That script (met_test.py) and it's arguments will return a 2d array to be
ready by MET utilities. For some reason though, the script itself isn't
being recognized. I've already changed its permissions using the command:
chmod 755 met_test.py, so there shouldn't be a permissions issue.
Thank you for any insights you might have.
Sincerely,
Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: error with write_pickle_dataplane.py
From: John Halley Gotway
Time: Mon Apr 05 11:31:16 2021
Wesley,
I apologize for the delay in responding. I see you're experiencing a
problem related to running the python pickle logic.
Thanks for describing the logic of the script. I understand the
approach.
Unfortunately I don't see any obvious smoking guns that would explain
the
problem you describe.
I see that the python pickling logic is being employed here. And I
presume
you know the details here, but the pickling logic is invoked only when
the
MET_PYTHON_EXE environment variable is defined and points to the
version of
python 3 that you'd like to run. Judging by your log messages, I
assume you
have:
MET_PYTHON_EXE=/users/davis/.conda/envs/xnrl/bin/python
Here's the command that's failing:
*/users/davis/.conda/envs/xnrl/bin/python
/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
/tmp/tmp_met_pickle_13346_0
/unified_verif/work/workwesley/uv/scripts/lib/met_test -f
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/neptune_quartdeg_E0096*
When you copy/paste this command and run it in a shell, does that
work? Or
does it fail on the command line as well?
If it fails, does it succeed if you add the ".py" suffix to met_test,
like
this?
*/users/davis/.conda/envs/xnrl/bin/python
/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
/tmp/tmp_met_pickle_13346_0
/unified_verif/work/workwesley/uv/scripts/lib/met_test.py -f
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/neptune_quartdeg_E0096*
Here's the list of all the issues that have been fixed since the met-
9.1
release and were included in bugfix releases (met-9.1.3 is the
latest):
https://github.com/dtcenter/MET/issues?q=is%3Aissue+project%3Adtcenter%2F2+is%3Aclosed
I scanned those to see if any obvious matches. So perhaps this is a
new
undiagnosed problem? Or perhaps it's an issue that can be fixed by a
change
in your environment.
Please let me know what you find.
Also, I wanted to tell you about development for met-10.0.0. We are
switching from writing temp files in the pickle format to using ascii
(for
point data) or NetCDF (for gridded data). We found that the pickle
format
is very sensitive to python version. In general, a pickle file written
by
one version of python cannot be read by another version. The switch to
a
different temp file format will hopefully fix this version dependency.
The
only downside is that the netCDF4 python package will now be required
for
this to work.
Thanks,
John Halley Gotway
On Wed, Mar 31, 2021 at 6:16 PM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:
>
> Wed Mar 31 18:15:59 2021: Request 99338 was acted upon.
> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: error with write_pickle_dataplane.py
> Owner: Nobody
> Requestors: wesley.davis.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99338 >
>
>
> MET team,
>
>
>
> I need some help troubleshooting the below error:
>
>
>
> + /usr/bin/singularity exec
> /unified_verif/shared/singularity_build/met.simg
> grid_stat PYTHON_NUMPY PYTHON_NUMPY
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTUNE_201
> 9010200 -outdir
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/stats_out/NEPTUNE_test
-v
> 2
>
> DEBUG 1: Default Config File:
> /software/depot/met-9.1/met-
9.1/share/met/config/GridStatConfig_default
>
> DEBUG 1: User Config File:
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTUNE_201
> 9010200
>
> Python Script:
>
> /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
>
> User Command:
['/unified_verif/work/workwesley/uv/scripts/lib/met_test',
> '-f',
>
>
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/n
> eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5', '-l',
> '85000', '-lt', 'pressure', '-v', 'meridional_wind']
>
> Write Pickle: /tmp/tmp_met_pickle_13346_0
>
> Traceback (most recent call last):
>
> File
>
> "/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.p
> y", line 32, in <module>
>
> spec.loader.exec_module(met_in)
>
> File "<frozen importlib._bootstrap_external>", line 724, in
exec_module
>
> File "<frozen importlib._bootstrap_external>", line 859, in
get_code
>
> File "<frozen importlib._bootstrap_external>", line 916, in
get_data
>
> FileNotFoundError: [Errno 2] No such file or directory:
> '/unified_verif/work/workwesley/uv/scripts/lib/met_test.py'
>
> ERROR :
>
> ERROR : pickle_dataplane() -> command
> "/users/davis/.conda/envs/xnrl/bin/python
>
> /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
> /tmp/tmp_met_pickle_13346_0
> /unified_verif/work/workwesley/uv/scripts/lib/met_test -f
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/ne
> ptune_quartdeg_E0096
>
> ERROR :
>
>
>
> In particular, the write_pickle_dataplane.py programs is telling me
"
> FileNotFoundError: [Errno 2] No such file or directory:
> '/unified_verif/work/workwesley/uv/scripts/lib/met_test.py' ". This
file
> does indeed exist in the place that it's telling me that it does not
exist.
> Any assistance in troubleshooting would be appreciated.
>
>
>
> Some background:
>
>
>
> /unified_verif/work/workwesley/uv/scripts/lib/met_test.py : A script
that
> uses an internally developed python library to parse model files and
return
> requested data
>
> -f',
>
>
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/n
> eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5' : -f
for
> filename, followed by a filename
>
> '-l', '85000' : -l for level, followed by a level
>
> '-lt', 'pressure' : -lt for level type, followed by a level type
>
> '-v', 'meridional_wind' : -v for variable, followed by a variable
>
>
>
> That script (met_test.py) and it's arguments will return a 2d array
to be
> ready by MET utilities. For some reason though, the script itself
isn't
> being recognized. I've already changed its permissions using the
command:
> chmod 755 met_test.py, so there shouldn't be a permissions issue.
>
>
>
> Thank you for any insights you might have.
>
>
>
> Sincerely,
>
>
>
> Wesley Davis
>
> Data Analyst
>
> DeVine Consulting
>
> 831-641-7661 (work)
>
> 808-780-9977 (cell)
>
> wesley.davis.ctr at nrlmry.navy.mil
>
>
>
>
>
------------------------------------------------
Subject: error with write_pickle_dataplane.py
From: Davis, Mr. Wesley, Contractor, Code 7531
Time: Mon Apr 05 11:37:50 2021
John,
Hey thanks for responding, don't worry about the delay. I figured it
out. I
was using a singularity container and didn't include all of the links
that I
needed to in the singularity call. Once I did that, everything started
working
again. I think we can consider this one done and closed.
Thank you!
Sincerely,
Wesley Davis
Data Analyst
DeVine Consulting
831-641-7661 (work)
808-780-9977 (cell)
wesley.davis.ctr at nrlmry.navy.mil
-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, April 5, 2021 10:31 AM
To: Davis, Mr. Wesley, Contractor, Code 7531
<wesley.davis.ctr at nrlmry.navy.mil>
Cc: Satterfield, Dr. Elizabeth <Elizabeth.Satterfield at nrlmry.navy.mil>
Subject: Re: [rt.rap.ucar.edu #99338] error with
write_pickle_dataplane.py
Wesley,
I apologize for the delay in responding. I see you're experiencing a
problem
related to running the python pickle logic.
Thanks for describing the logic of the script. I understand the
approach.
Unfortunately I don't see any obvious smoking guns that would explain
the
problem you describe.
I see that the python pickling logic is being employed here. And I
presume you
know the details here, but the pickling logic is invoked only when the
MET_PYTHON_EXE environment variable is defined and points to the
version of
python 3 that you'd like to run. Judging by your log messages, I
assume you
have:
MET_PYTHON_EXE=/users/davis/.conda/envs/xnrl/bin/python
Here's the command that's failing:
*/users/davis/.conda/envs/xnrl/bin/python
/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
/tmp/tmp_met_pickle_13346_0
/unified_verif/work/workwesley/uv/scripts/lib/met_test -f
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/neptune_quartdeg_E0096*
When you copy/paste this command and run it in a shell, does that
work? Or
does it fail on the command line as well?
If it fails, does it succeed if you add the ".py" suffix to met_test,
like
this?
*/users/davis/.conda/envs/xnrl/bin/python
/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
/tmp/tmp_met_pickle_13346_0
/unified_verif/work/workwesley/uv/scripts/lib/met_test.py -f
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/neptune_quartdeg_E0096*
Here's the list of all the issues that have been fixed since the met-
9.1
release and were included in bugfix releases (met-9.1.3 is the
latest):
https://github.com/dtcenter/MET/issues?q=is%3Aissue+project%3Adtcenter%2F2+is%3Aclosed
I scanned those to see if any obvious matches. So perhaps this is a
new
undiagnosed problem? Or perhaps it's an issue that can be fixed by a
change in
your environment.
Please let me know what you find.
Also, I wanted to tell you about development for met-10.0.0. We are
switching
from writing temp files in the pickle format to using ascii (for point
data)
or NetCDF (for gridded data). We found that the pickle format is very
sensitive to python version. In general, a pickle file written by one
version
of python cannot be read by another version. The switch to a different
temp
file format will hopefully fix this version dependency. The only
downside is
that the netCDF4 python package will now be required for this to work.
Thanks,
John Halley Gotway
On Wed, Mar 31, 2021 at 6:16 PM Davis, Mr. Wesley, Contractor, Code
7531 via
RT <met_help at ucar.edu> wrote:
>
> Wed Mar 31 18:15:59 2021: Request 99338 was acted upon.
> Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> Queue: met_help
> Subject: error with write_pickle_dataplane.py
> Owner: Nobody
> Requestors: wesley.davis.ctr at nrlmry.navy.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99338
> >
>
>
> MET team,
>
>
>
> I need some help troubleshooting the below error:
>
>
>
> + /usr/bin/singularity exec
> /unified_verif/shared/singularity_build/met.simg
> grid_stat PYTHON_NUMPY PYTHON_NUMPY
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTU
> NE_201
> 9010200 -outdir
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/stats_out/NEPTUNE_te
> st -v
> 2
>
> DEBUG 1: Default Config File:
> /software/depot/met-9.1/met-
9.1/share/met/config/GridStatConfig_defaul
> t
>
> DEBUG 1: User Config File:
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTU
> NE_201
> 9010200
>
> Python Script:
>
> /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_datapl
> ane.py
>
> User Command:
['/unified_verif/work/workwesley/uv/scripts/lib/met_test',
> '-f',
>
>
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/201901
> 0200/n
eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5',
> '-l', '85000', '-lt', 'pressure', '-v', 'meridional_wind']
>
> Write Pickle: /tmp/tmp_met_pickle_13346_0
>
> Traceback (most recent call last):
>
> File
>
> "/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_datap
> lane.p
> y", line 32, in <module>
>
> spec.loader.exec_module(met_in)
>
> File "<frozen importlib._bootstrap_external>", line 724, in
> exec_module
>
> File "<frozen importlib._bootstrap_external>", line 859, in
get_code
>
> File "<frozen importlib._bootstrap_external>", line 916, in
get_data
>
> FileNotFoundError: [Errno 2] No such file or directory:
> '/unified_verif/work/workwesley/uv/scripts/lib/met_test.py'
>
> ERROR :
>
> ERROR : pickle_dataplane() -> command
> "/users/davis/.conda/envs/xnrl/bin/python
>
> /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_datapl
> ane.py
> /tmp/tmp_met_pickle_13346_0
> /unified_verif/work/workwesley/uv/scripts/lib/met_test -f
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010
> 200/ne
> ptune_quartdeg_E0096
>
> ERROR :
>
>
>
> In particular, the write_pickle_dataplane.py programs is telling me
"
> FileNotFoundError: [Errno 2] No such file or directory:
> '/unified_verif/work/workwesley/uv/scripts/lib/met_test.py' ". This
> file does indeed exist in the place that it's telling me that it
does not
> exist.
> Any assistance in troubleshooting would be appreciated.
>
>
>
> Some background:
>
>
>
> /unified_verif/work/workwesley/uv/scripts/lib/met_test.py : A script
> that uses an internally developed python library to parse model
files
> and return requested data
>
> -f',
>
>
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/201901
> 0200/n eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5'
:
> -f for filename, followed by a filename
>
> '-l', '85000' : -l for level, followed by a level
>
> '-lt', 'pressure' : -lt for level type, followed by a level type
>
> '-v', 'meridional_wind' : -v for variable, followed by a variable
>
>
>
> That script (met_test.py) and it's arguments will return a 2d array
to
> be ready by MET utilities. For some reason though, the script itself
> isn't being recognized. I've already changed its permissions using
the
> command:
> chmod 755 met_test.py, so there shouldn't be a permissions issue.
>
>
>
> Thank you for any insights you might have.
>
>
>
> Sincerely,
>
>
>
> Wesley Davis
>
> Data Analyst
>
> DeVine Consulting
>
> 831-641-7661 (work)
>
> 808-780-9977 (cell)
>
> wesley.davis.ctr at nrlmry.navy.mil
>
>
>
>
>
------------------------------------------------
Subject: error with write_pickle_dataplane.py
From: John Halley Gotway
Time: Mon Apr 05 11:44:36 2021
Wesley,
Excellent! Thanks for confirming.
Please be aware of the change we're planning for met-10.0.0, avoiding
the
pickle file format. Ideally, it'll be totally transparent to your
processing logic. But if you do run into problems, that's the first
place
I'd look.
Thank,
John
On Mon, Apr 5, 2021 at 11:38 AM Davis, Mr. Wesley, Contractor, Code
7531
via RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99338 >
>
> John,
>
> Hey thanks for responding, don't worry about the delay. I figured it
out.
> I
> was using a singularity container and didn't include all of the
links that
> I
> needed to in the singularity call. Once I did that, everything
started
> working
> again. I think we can consider this one done and closed.
>
> Thank you!
>
> Sincerely,
>
> Wesley Davis
> Data Analyst
> DeVine Consulting
> 831-641-7661 (work)
> 808-780-9977 (cell)
> wesley.davis.ctr at nrlmry.navy.mil
>
> -----Original Message-----
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, April 5, 2021 10:31 AM
> To: Davis, Mr. Wesley, Contractor, Code 7531
> <wesley.davis.ctr at nrlmry.navy.mil>
> Cc: Satterfield, Dr. Elizabeth
<Elizabeth.Satterfield at nrlmry.navy.mil>
> Subject: Re: [rt.rap.ucar.edu #99338] error with
write_pickle_dataplane.py
>
> Wesley,
>
> I apologize for the delay in responding. I see you're experiencing a
> problem
> related to running the python pickle logic.
> Thanks for describing the logic of the script. I understand the
approach.
> Unfortunately I don't see any obvious smoking guns that would
explain the
> problem you describe.
>
> I see that the python pickling logic is being employed here. And I
presume
> you
> know the details here, but the pickling logic is invoked only when
the
> MET_PYTHON_EXE environment variable is defined and points to the
version
> of
> python 3 that you'd like to run. Judging by your log messages, I
assume you
> have:
>
> MET_PYTHON_EXE=/users/davis/.conda/envs/xnrl/bin/python
>
> Here's the command that's failing:
>
> */users/davis/.conda/envs/xnrl/bin/python
>
> /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
> /tmp/tmp_met_pickle_13346_0
> /unified_verif/work/workwesley/uv/scripts/lib/met_test -f
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/neptune_quartdeg_E0096*
>
> When you copy/paste this command and run it in a shell, does that
work? Or
> does it fail on the command line as well?
>
> If it fails, does it succeed if you add the ".py" suffix to
met_test, like
> this?
>
> */users/davis/.conda/envs/xnrl/bin/python
>
> /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_dataplane.py
> /tmp/tmp_met_pickle_13346_0
> /unified_verif/work/workwesley/uv/scripts/lib/met_test.py -f
>
>
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010200/neptune_quartdeg_E0096*
>
> Here's the list of all the issues that have been fixed since the
met-9.1
> release and were included in bugfix releases (met-9.1.3 is the
latest):
>
>
https://github.com/dtcenter/MET/issues?q=is%3Aissue+project%3Adtcenter%2F2+is%3Aclosed
>
> I scanned those to see if any obvious matches. So perhaps this is a
new
> undiagnosed problem? Or perhaps it's an issue that can be fixed by a
> change in
> your environment.
>
> Please let me know what you find.
>
> Also, I wanted to tell you about development for met-10.0.0. We are
> switching
> from writing temp files in the pickle format to using ascii (for
point
> data)
> or NetCDF (for gridded data). We found that the pickle format is
very
> sensitive to python version. In general, a pickle file written by
one
> version
> of python cannot be read by another version. The switch to a
different
> temp
> file format will hopefully fix this version dependency. The only
downside
> is
> that the netCDF4 python package will now be required for this to
work.
>
> Thanks,
> John Halley Gotway
>
>
> On Wed, Mar 31, 2021 at 6:16 PM Davis, Mr. Wesley, Contractor, Code
7531
> via
> RT <met_help at ucar.edu> wrote:
>
> >
> > Wed Mar 31 18:15:59 2021: Request 99338 was acted upon.
> > Transaction: Ticket created by wesley.davis.ctr at nrlmry.navy.mil
> > Queue: met_help
> > Subject: error with write_pickle_dataplane.py
> > Owner: Nobody
> > Requestors: wesley.davis.ctr at nrlmry.navy.mil
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99338
> > >
> >
> >
> > MET team,
> >
> >
> >
> > I need some help troubleshooting the below error:
> >
> >
> >
> > + /usr/bin/singularity exec
> > /unified_verif/shared/singularity_build/met.simg
> > grid_stat PYTHON_NUMPY PYTHON_NUMPY
> >
> >
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTU
> > NE_201
> > 9010200 -outdir
> >
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/stats_out/NEPTUNE_te
> > st -v
> > 2
> >
> > DEBUG 1: Default Config File:
> > /software/depot/met-9.1/met-
9.1/share/met/config/GridStatConfig_defaul
> > t
> >
> > DEBUG 1: User Config File:
> >
> >
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/GridStatConfig_NEPTU
> > NE_201
> > 9010200
> >
> > Python Script:
> >
> > /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_datapl
> > ane.py
> >
> > User Command:
> ['/unified_verif/work/workwesley/uv/scripts/lib/met_test',
> > '-f',
> >
> >
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/201901
> > 0200/n
eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5',
> > '-l', '85000', '-lt', 'pressure', '-v', 'meridional_wind']
> >
> > Write Pickle: /tmp/tmp_met_pickle_13346_0
> >
> > Traceback (most recent call last):
> >
> > File
> >
> > "/software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_datap
> > lane.p
> > y", line 32, in <module>
> >
> > spec.loader.exec_module(met_in)
> >
> > File "<frozen importlib._bootstrap_external>", line 724, in
> > exec_module
> >
> > File "<frozen importlib._bootstrap_external>", line 859, in
get_code
> >
> > File "<frozen importlib._bootstrap_external>", line 916, in
get_data
> >
> > FileNotFoundError: [Errno 2] No such file or directory:
> > '/unified_verif/work/workwesley/uv/scripts/lib/met_test.py'
> >
> > ERROR :
> >
> > ERROR : pickle_dataplane() -> command
> > "/users/davis/.conda/envs/xnrl/bin/python
> >
> > /software/depot/met-9.1/met-
9.1/share/met/wrappers/write_pickle_datapl
> > ane.py
> > /tmp/tmp_met_pickle_13346_0
> > /unified_verif/work/workwesley/uv/scripts/lib/met_test -f
> >
> >
/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/2019010
> > 200/ne
> > ptune_quartdeg_E0096
> >
> > ERROR :
> >
> >
> >
> > In particular, the write_pickle_dataplane.py programs is telling
me "
> > FileNotFoundError: [Errno 2] No such file or directory:
> > '/unified_verif/work/workwesley/uv/scripts/lib/met_test.py' ".
This
> > file does indeed exist in the place that it's telling me that it
does
> not
> > exist.
> > Any assistance in troubleshooting would be appreciated.
> >
> >
> >
> > Some background:
> >
> >
> >
> > /unified_verif/work/workwesley/uv/scripts/lib/met_test.py : A
script
> > that uses an internally developed python library to parse model
files
> > and return requested data
> >
> > -f',
> >
> >
'/unified_verif/work/workwesley/uv/scripts/NEPTUNE/tmp_dir/fcst/201901
> > 0200/n
eptune_quartdeg_E0096P4L125_20190102T00_PT000000H00M00S.hdf5' :
> > -f for filename, followed by a filename
> >
> > '-l', '85000' : -l for level, followed by a level
> >
> > '-lt', 'pressure' : -lt for level type, followed by a level type
> >
> > '-v', 'meridional_wind' : -v for variable, followed by a variable
> >
> >
> >
> > That script (met_test.py) and it's arguments will return a 2d
array to
> > be ready by MET utilities. For some reason though, the script
itself
> > isn't being recognized. I've already changed its permissions using
the
> > command:
> > chmod 755 met_test.py, so there shouldn't be a permissions issue.
> >
> >
> >
> > Thank you for any insights you might have.
> >
> >
> >
> > Sincerely,
> >
> >
> >
> > Wesley Davis
> >
> > Data Analyst
> >
> > DeVine Consulting
> >
> > 831-641-7661 (work)
> >
> > 808-780-9977 (cell)
> >
> > wesley.davis.ctr at nrlmry.navy.mil
> >
> >
> >
> >
> >
>
>
>
------------------------------------------------
More information about the Met_help
mailing list