[Met_help] [rt.rap.ucar.edu #96154] History for Issues processing CF compliant netcdf files

Wed Aug 19 09:53:26 MDT 2020

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Good morning,

Recent discussions with the air quality group has led to the desire to
process *aqm.t12z.metcro2d.ncf* and *aqm.t12z.grdcro2d.ncf* instead of
*aqm.t12.nmmXX.tm00.*  The reason for using the *.ncf file over the the
*tm00 files is because the *.ncf are on the same grid as the chemistry
output, which are stored in  *aqm.t12z.pm25.fXX.148.grib2*; file examples
can be found here (/gpfs/hps/nco/ops/com/aqm/prod/aqm.20200803/) for a
reference.

The *aqm.t12z.metcro2d.ncf* files contain all the time records for fields
such as PBL height, 2m-temperature, dominant land use (similar to
vegetation type), etc.  However, these files are not CF-compliant, which I
learned is critical for processing in met.  To resolve this issue I used
some scripts Logan Dawson has been using to rewrite both *aqm.t12z.metcro2d.ncf
*and * aqm.t12z.grdcro2d.ncf *into compliant form.  Also, I merged fields
from both these files into a single file, but separated these files based
on forecast hour instead of lumping all time records into a single file.
An example of that can be found here:
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MetPlus/METplus/data/prod/aqm.20200803.

Although met does not have a problem reading this file, it does have an
issue <https://github.com/NCAR/MET/issues/1139> that may sound familiar.
One thing that caught my eye in the posted issue was this statement:  *Updated
met_file.cc to search for lat/lon dimensions using strings instead of const
char * in the hopes of fixing the intermittent netCDF::exceptions::NcEdge
runtime error.*

I saw something that appears similar in the log file located here: *
/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ_Meteorology/logs/master_metplus.log.20200807014453.*

The error is nearly identical to the posted issue:

*DEBUG 1: Observation File:
/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ_Meteorology/aqm/conus_sfc/prod/prepbufr.nam.2020080400.nc
<http://prepbufr.nam.2020080400.nc>terminate called after throwing an
instance of 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
metplus.PointStat (command_runner.py:191) DEBUG: Finished running
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
(command_builder.py:100) ERROR: (command_builder.py:733) M*

I found some of the information above this ERROR rather suspect; see below
for example:

*DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object of
type "FileType_NcMet".DEBUG 5: Parsed forecast field:VarInfo::dump():
MagicStr     = TMPZ2  ReqName      = TMP  Name         = TMP  LongName
= TMP(*,*)  Units        = NA  PFlag        = 0  PName        = (nul)
PUnits       = (nul)  PAsScalar    = 0  UVIndex      = -1  Init         =
19700101_000000 (0)  Valid        = 19700101_000000 (0)  Ensemble     =
(nul)  Lead         = NA (-9999)  ConvertFx    = (nul)  CensorThresh = NA
CensorVal    =  nBins        = 0  Range        =  Regrid       =
NEARESTLevelInfo::dump():  Type      = LevelType_None  TypeNum   = -9999
ReqName   = *,*  Name      = *,*  Units     = (nul)  Upper     = 0
Increment = 0*

Thinking that something might be wrong in how I wrote the netcdf files, I
compared an example of Logan's ncdump content with mine.  I'm attaching
both below.  The first is mine while the second is Logans.  The structure
is more or less identical.  As a side note, I used gen_vx_mask to get some
of the attributes out such as projection, nx, ny, etc.  However, I'm
finding a hard time moving forward because of the similar appearance
between my files and Logan's files, and the rather obscure error related to
this message.  Since this seems to have been an issue experienced in met
before, I'm wondering what I could try based on your experience.  If
there's additional information that you need, please let me know.  Thanks

-- 
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Issues processing CF compliant netcdf files
From: Minna Win
Time: Fri Aug 07 09:21:50 2020

Hi Edward,

I'll pass this along to John Halley Gotway, who is the engineer
working on
the GitHub issue.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401

On Thu, Aug 6, 2020 at 8:20 PM Edward Strobach - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:

>
> Thu Aug 06 20:20:16 2020: Request 96154 was acted upon.
> Transaction: Ticket created by edward.strobach at noaa.gov
>        Queue: met_help
>      Subject: Issues processing CF compliant netcdf files
>        Owner: Nobody
>   Requestors: edward.strobach at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
>
> Good morning,
>
> Recent discussions with the air quality group has led to the desire
to
> process *aqm.t12z.metcro2d.ncf* and *aqm.t12z.grdcro2d.ncf* instead
of
> *aqm.t12.nmmXX.tm00.*  The reason for using the *.ncf file over the
the
> *tm00 files is because the *.ncf are on the same grid as the
chemistry
> output, which are stored in  *aqm.t12z.pm25.fXX.148.grib2*; file
examples
> can be found here (/gpfs/hps/nco/ops/com/aqm/prod/aqm.20200803/) for
a
> reference.
>
> The *aqm.t12z.metcro2d.ncf* files contain all the time records for
fields
> such as PBL height, 2m-temperature, dominant land use (similar to
> vegetation type), etc.  However, these files are not CF-compliant,
which I
> learned is critical for processing in met.  To resolve this issue I
used
> some scripts Logan Dawson has been using to rewrite both
> *aqm.t12z.metcro2d.ncf
> *and * aqm.t12z.grdcro2d.ncf *into compliant form.  Also, I merged
fields
> from both these files into a single file, but separated these files
based
> on forecast hour instead of lumping all time records into a single
file.
> An example of that can be found here:
>
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MetPlus/METplus/data/prod/aqm.20200803.
>
>
> Although met does not have a problem reading this file, it does have
an
> issue <https://github.com/NCAR/MET/issues/1139> that may sound
familiar.
> One thing that caught my eye in the posted issue was this statement:
> *Updated
> met_file.cc to search for lat/lon dimensions using strings instead
of const
> char * in the hopes of fixing the intermittent
netCDF::exceptions::NcEdge
> runtime error.*
>
> I saw something that appears similar in the log file located here: *
>
>
/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ_Meteorology/logs/master_metplus.log.20200807014453.*
>
> The error is nearly identical to the posted issue:
>
>
>
>
>
>
> *DEBUG 1: Observation File:
>
>
/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ_Meteorology/aqm/conus_sfc/prod/
> prepbufr.nam.2020080400.nc
> <http://prepbufr.nam.2020080400.nc>terminate called after throwing
an
> instance of 'netCDF::exceptions::NcEdge'  what():  NetCDF:
Start+count
> exceeds dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
> metplus.PointStat (command_runner.py:191) DEBUG: Finished running
>
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> (command_builder.py:100) ERROR: (command_builder.py:733) M*
>
> I found some of the information above this ERROR rather suspect; see
below
> for example:
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo
object of
> type "FileType_NcMet".DEBUG 5: Parsed forecast
field:VarInfo::dump():
> MagicStr     = TMPZ2  ReqName      = TMP  Name         = TMP
LongName
> = TMP(*,*)  Units        = NA  PFlag        = 0  PName        =
(nul)
> PUnits       = (nul)  PAsScalar    = 0  UVIndex      = -1  Init
=
> 19700101_000000 (0)  Valid        = 19700101_000000 (0)  Ensemble
=
> (nul)  Lead         = NA (-9999)  ConvertFx    = (nul)  CensorThresh
= NA
> CensorVal    =  nBins        = 0  Range        =  Regrid       =
> NEARESTLevelInfo::dump():  Type      = LevelType_None  TypeNum   =
-9999
> ReqName   = *,*  Name      = *,*  Units     = (nul)  Upper     = 0
> Increment = 0*
>
> Thinking that something might be wrong in how I wrote the netcdf
files, I
> compared an example of Logan's ncdump content with mine.  I'm
attaching
> both below.  The first is mine while the second is Logans.  The
structure
> is more or less identical.  As a side note, I used gen_vx_mask to
get some
> of the attributes out such as projection, nx, ny, etc.  However, I'm
> finding a hard time moving forward because of the similar appearance
> between my files and Logan's files, and the rather obscure error
related to
> this message.  Since this seems to have been an issue experienced in
met
> before, I'm wondering what I could try based on your experience.  If
> there's additional information that you need, please let me know.
Thanks
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: John Halley Gotway
Time: Tue Aug 11 16:46:12 2020

Ed,

Sorry for the delay in getting to this issue. We were busy preparing
for
the met-9.1 release. I see you are running a script from Logan to
reformat
some NetCDF data for use in MET... but are running into some sporadic
issues.

I believe that WCOSS is unavailable this week, so I'm not able to go
take a
closer look at your data right now.

But I'm wondering if you'd consider using python embedding to solve
this
issue instead of reformatting these files? With this approach, we
write a
python script to tell MET how to read data from these native NetCDF
files
rather than reformatting them and essentially duplicating the data.
But
it's up to you... I'm sure these problems could be solved with either
approach. Python-embedding has the advantage of not duplicating the
data on
disk.

Just let me know how you'd like to proceed. If you are able to gain
access
to WCOSS and pull a sample data file, as well as your reformatting
script,
please post them to our anonymous ftp site following these
instructions:
http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp

Thanks,
John

On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <met_help at ucar.edu>
wrote:

>
> Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
> Transaction: Given to johnhg (John Halley Gotway) by minnawin
>        Queue: met_help
>      Subject: Issues processing CF compliant netcdf files
>        Owner: johnhg
>   Requestors: edward.strobach at noaa.gov
>       Status: open
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
>
> This transaction appears to have no content
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Tue Aug 11 17:15:43 2020

Hi John,

I imagine you guys are pretty swamped, especially with so many more
people
now using met and metplus.

The option that you are proposing sounds better to me.  I might be
able to
regain access by Thursday.  I'll make sure to post those items then.
I'll
stand by to receive your instructions whenever you get some time.
Thanks a
lot!

On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:

> Ed,
>
> Sorry for the delay in getting to this issue. We were busy preparing
for
> the met-9.1 release. I see you are running a script from Logan to
reformat
> some NetCDF data for use in MET... but are running into some
sporadic
> issues.
>
> I believe that WCOSS is unavailable this week, so I'm not able to go
take a
> closer look at your data right now.
>
> But I'm wondering if you'd consider using python embedding to solve
this
> issue instead of reformatting these files? With this approach, we
write a
> python script to tell MET how to read data from these native NetCDF
files
> rather than reformatting them and essentially duplicating the data.
But
> it's up to you... I'm sure these problems could be solved with
either
> approach. Python-embedding has the advantage of not duplicating the
data on
> disk.
>
> Just let me know how you'd like to proceed. If you are able to gain
access
> to WCOSS and pull a sample data file, as well as your reformatting
script,
> please post them to our anonymous ftp site following these
instructions:
>
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>
> Thanks,
> John
>
> On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <met_help at ucar.edu>
wrote:
>
> >
> > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
> > Transaction: Given to johnhg (John Halley Gotway) by minnawin
> >        Queue: met_help
> >      Subject: Issues processing CF compliant netcdf files
> >        Owner: johnhg
> >   Requestors: edward.strobach at noaa.gov
> >       Status: open
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> >
> > This transaction appears to have no content
> >
>
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: John Halley Gotway
Time: Wed Aug 12 09:45:28 2020

Ed,

Sounds great. FYI, here are some examples of using python embedding:
http://dtcenter.org/community-code/model-evaluation-tools-met/sample-
analysis-scripts

All these examples are for calling the plot_data_plane tool since
that's a
great way to get started. Plot the data to make sure that its what you
expect and oriented correctly. I imagine we'll want a python script
that
takes at least 2 arguments... the name of the NetCDF file and the
variable
you want from it. Something like this example from that page:

Plot the PSFC variable from a post-processed WRF output file on a
Lambert
Conformal projection:
plot_data_plane PYTHON_NUMPY psfc.ps
<http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png>
 'name="read_PostProcessed_WRF.py
<http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt>
  2004-09-01_04-00-00.nc
<http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc>
 PSFC";'

Hopefully it won't be too difficult to adapt one of these scripts to
work
with your particular dataset. I'd encourage you to try yourself, but
if you
run into issues or don't know where to start, we can help too.

Thanks,
John

On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
> Hi John,
>
> I imagine you guys are pretty swamped, especially with so many more
people
> now using met and metplus.
>
> The option that you are proposing sounds better to me.  I might be
able to
> regain access by Thursday.  I'll make sure to post those items then.
I'll
> stand by to receive your instructions whenever you get some time.
Thanks a
> lot!
>
> On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Ed,
> >
> > Sorry for the delay in getting to this issue. We were busy
preparing for
> > the met-9.1 release. I see you are running a script from Logan to
> reformat
> > some NetCDF data for use in MET... but are running into some
sporadic
> > issues.
> >
> > I believe that WCOSS is unavailable this week, so I'm not able to
go
> take a
> > closer look at your data right now.
> >
> > But I'm wondering if you'd consider using python embedding to
solve this
> > issue instead of reformatting these files? With this approach, we
write a
> > python script to tell MET how to read data from these native
NetCDF files
> > rather than reformatting them and essentially duplicating the
data. But
> > it's up to you... I'm sure these problems could be solved with
either
> > approach. Python-embedding has the advantage of not duplicating
the data
> on
> > disk.
> >
> > Just let me know how you'd like to proceed. If you are able to
gain
> access
> > to WCOSS and pull a sample data file, as well as your reformatting
> script,
> > please post them to our anonymous ftp site following these
instructions:
> >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> >
> > Thanks,
> > John
> >
> > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT
<met_help at ucar.edu>
> wrote:
> >
> > >
> > > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
> > > Transaction: Given to johnhg (John Halley Gotway) by minnawin
> > >        Queue: met_help
> > >      Subject: Issues processing CF compliant netcdf files
> > >        Owner: johnhg
> > >   Requestors: edward.strobach at noaa.gov
> > >       Status: open
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >
> > >
> > >
> > > This transaction appears to have no content
> > >
> >
> >
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Thu Aug 13 07:26:05 2020

Thanks John, I'll go ahead take a look at those resources

On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Ed,
>
> Sounds great. FYI, here are some examples of using python embedding:
>
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
>
> All these examples are for calling the plot_data_plane tool since
that's a
> great way to get started. Plot the data to make sure that its what
you
> expect and oriented correctly. I imagine we'll want a python script
that
> takes at least 2 arguments... the name of the NetCDF file and the
variable
> you want from it. Something like this example from that page:
>
> Plot the PSFC variable from a post-processed WRF output file on a
Lambert
> Conformal projection:
> plot_data_plane PYTHON_NUMPY psfc.ps
> <
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> >
>  'name="read_PostProcessed_WRF.py
> <
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> >
>   2004-09-01_04-00-00.nc
> <
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> >
>  PSFC";'
>
> Hopefully it won't be too difficult to adapt one of these scripts to
work
> with your particular dataset. I'd encourage you to try yourself, but
if you
> run into issues or don't know where to start, we can help too.
>
> Thanks,
> John
>
>
> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> > Hi John,
> >
> > I imagine you guys are pretty swamped, especially with so many
more
> people
> > now using met and metplus.
> >
> > The option that you are proposing sounds better to me.  I might be
able
> to
> > regain access by Thursday.  I'll make sure to post those items
then.
> I'll
> > stand by to receive your instructions whenever you get some time.
> Thanks a
> > lot!
> >
> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Ed,
> > >
> > > Sorry for the delay in getting to this issue. We were busy
preparing
> for
> > > the met-9.1 release. I see you are running a script from Logan
to
> > reformat
> > > some NetCDF data for use in MET... but are running into some
sporadic
> > > issues.
> > >
> > > I believe that WCOSS is unavailable this week, so I'm not able
to go
> > take a
> > > closer look at your data right now.
> > >
> > > But I'm wondering if you'd consider using python embedding to
solve
> this
> > > issue instead of reformatting these files? With this approach,
we
> write a
> > > python script to tell MET how to read data from these native
NetCDF
> files
> > > rather than reformatting them and essentially duplicating the
data. But
> > > it's up to you... I'm sure these problems could be solved with
either
> > > approach. Python-embedding has the advantage of not duplicating
the
> data
> > on
> > > disk.
> > >
> > > Just let me know how you'd like to proceed. If you are able to
gain
> > access
> > > to WCOSS and pull a sample data file, as well as your
reformatting
> > script,
> > > please post them to our anonymous ftp site following these
> instructions:
> > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT
<met_help at ucar.edu>
> > wrote:
> > >
> > > >
> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
> > > > Transaction: Given to johnhg (John Halley Gotway) by minnawin
> > > >        Queue: met_help
> > > >      Subject: Issues processing CF compliant netcdf files
> > > >        Owner: johnhg
> > > >   Requestors: edward.strobach at noaa.gov
> > > >       Status: open
> > > >  Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > >
> > > >
> > > >
> > > > This transaction appears to have no content
> > > >
> > >
> > >
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
> >
>
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Thu Aug 13 09:11:00 2020

I did have one follow up question.  I copied the contents of the
read_PostProcessed_WRF.py file and adjusted to match what I needed for
my
purpose.  When I run plot_data_plane I get an indication that it was
successful:

[Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane PYTHON_NUMPY
hpbl.ps
'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
DEBUG 1: Opening data file: PYTHON_NUMPY
Input File: 'aqm.t12z.metcro2d.19.nc'
Variable: 'PBL'
Data Shape: (265, 442)
Data Type:  dtype('float64')
*Attributes: {'valid': '20200804_070000', 'init': '20200803_120000',
'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name': 'PBL',
'level':
'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert Conformal', 'name':
'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0, 'scale_lat_2':
45.0,
'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0, 'y_pin': 0.0,
'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx': 442, 'ny':
265}}*
*DEBUG 1: Creating postscript file: hpbl.ps <http://hpbl.ps>*

You can see that the postscript file has been created.  I had to
adjust the
read_PostProcessed.py contents upon copying it over.  I originally did
not
have the "accum", "hemisphere", or "name" attributes.  After adding
those
in plot_data_plane was successful.  Those added attributes are not
part of
the attribute list in the netcdf file.  My netcdf file only includes
these
attributes:

*root group (NETCDF4 data model, file format HDF5):    FileOrigins: NA
MET_version: V9.1    MET_tool: gen_vx_mask    Projection: Lambert
Conformal    scale_lat_1: 33.000000    scale_lat_2: 45.000000
lat_pin:
21.821000    lon_pin: -120.628000    x_pin: 0.000000    y_pin:
0.000000
lon_orient: -97.000000    d_km: 12.000000    r_km: 6371.200000    nx:
442
  ny: 265 grid_points    dimensions(sizes): lon(265), lat(442)
variables(dimensions): float32 LAT(lon,lat), float32 LON(lon,lat),
float32
DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)    groups:
*

You can see that most of them are there.  My understanding is that the
postscript file contains the contents used for the postscript image.
I
thought that an image would have been generated as well.  Should there
be a
.png file generated as well?  Does this exercise of running
plot_data_plane
indicate what might be missing in my attribute list that would need to
be
included (e.g. does name, accum, and hemisphere need to be included?)?
Also I had to change how valid and initial times were extracted.  They
are
being written in this way instead:

*>>> f.variables[var_name]<class 'netCDF4._netCDF4.Variable'>float32
PBL(lon, lat)    long_name: PBL    standard_name: Planetary Boundary
Layer
Height    units: m    level: L0    init_time: 20200804_060000
init_time_ut: 1596520800    valid_time: 20200805_170000
valid_time_ut:
1596646800*

Do I need to adjust my attribute meta data to include the initial and
valid
times rather than lumping them under the field name?

On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA Affiliate <
edward.strobach at noaa.gov> wrote:

> Thanks John, I'll go ahead take a look at those resources
>
> On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Ed,
>>
>> Sounds great. FYI, here are some examples of using python
embedding:
>>
>> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
>>
>> All these examples are for calling the plot_data_plane tool since
that's a
>> great way to get started. Plot the data to make sure that its what
you
>> expect and oriented correctly. I imagine we'll want a python script
that
>> takes at least 2 arguments... the name of the NetCDF file and the
variable
>> you want from it. Something like this example from that page:
>>
>> Plot the PSFC variable from a post-processed WRF output file on a
Lambert
>> Conformal projection:
>> plot_data_plane PYTHON_NUMPY psfc.ps
>> <
>> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
>> >
>>  'name="read_PostProcessed_WRF.py
>> <
>> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
>> >
>>   2004-09-01_04-00-00.nc
>> <
>> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
>> >
>>  PSFC";'
>>
>> Hopefully it won't be too difficult to adapt one of these scripts
to work
>> with your particular dataset. I'd encourage you to try yourself,
but if
>> you
>> run into issues or don't know where to start, we can help too.
>>
>> Thanks,
>> John
>>
>>
>> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA Affiliate
via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>> >
>> > Hi John,
>> >
>> > I imagine you guys are pretty swamped, especially with so many
more
>> people
>> > now using met and metplus.
>> >
>> > The option that you are proposing sounds better to me.  I might
be able
>> to
>> > regain access by Thursday.  I'll make sure to post those items
then.
>> I'll
>> > stand by to receive your instructions whenever you get some time.
>> Thanks a
>> > lot!
>> >
>> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT <
>> > met_help at ucar.edu>
>> > wrote:
>> >
>> > > Ed,
>> > >
>> > > Sorry for the delay in getting to this issue. We were busy
preparing
>> for
>> > > the met-9.1 release. I see you are running a script from Logan
to
>> > reformat
>> > > some NetCDF data for use in MET... but are running into some
sporadic
>> > > issues.
>> > >
>> > > I believe that WCOSS is unavailable this week, so I'm not able
to go
>> > take a
>> > > closer look at your data right now.
>> > >
>> > > But I'm wondering if you'd consider using python embedding to
solve
>> this
>> > > issue instead of reformatting these files? With this approach,
we
>> write a
>> > > python script to tell MET how to read data from these native
NetCDF
>> files
>> > > rather than reformatting them and essentially duplicating the
data.
>> But
>> > > it's up to you... I'm sure these problems could be solved with
either
>> > > approach. Python-embedding has the advantage of not duplicating
the
>> data
>> > on
>> > > disk.
>> > >
>> > > Just let me know how you'd like to proceed. If you are able to
gain
>> > access
>> > > to WCOSS and pull a sample data file, as well as your
reformatting
>> > script,
>> > > please post them to our anonymous ftp site following these
>> instructions:
>> > >
>> > >
>> >
>> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT
<met_help at ucar.edu>
>> > wrote:
>> > >
>> > > >
>> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
>> > > > Transaction: Given to johnhg (John Halley Gotway) by minnawin
>> > > >        Queue: met_help
>> > > >      Subject: Issues processing CF compliant netcdf files
>> > > >        Owner: johnhg
>> > > >   Requestors: edward.strobach at noaa.gov
>> > > >       Status: open
>> > > >  Ticket <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>> > >
>> > > >
>> > > >
>> > > > This transaction appears to have no content
>> > > >
>> > >
>> > >
>> >
>> > --
>> > Edward Strobach
>> > EMC/NCEP/NWS/
>> > IMSG Contractor
>> > Cubicle#: 2029
>> > 301-683-3717
>> >
>> >
>>
>>
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Minna Win
Time: Thu Aug 13 09:50:36 2020

Hi Ed,
John is out of the office today and tomorrow.  He'll be back in the
office
on Monday, so please allow a few more business days for a full
response.

Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax:   303-497-8401

On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
> I did have one follow up question.  I copied the contents of the
> read_PostProcessed_WRF.py file and adjusted to match what I needed
for my
> purpose.  When I run plot_data_plane I get an indication that it was
> successful:
>
> [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane PYTHON_NUMPY
hpbl.ps
> 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
> DEBUG 1: Opening data file: PYTHON_NUMPY
> Input File: 'aqm.t12z.metcro2d.19.nc'
> Variable: 'PBL'
> Data Shape: (265, 442)
> Data Type:  dtype('float64')
> *Attributes: {'valid': '20200804_070000', 'init': '20200803_120000',
> 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name': 'PBL',
'level':
> 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert Conformal',
'name':
> 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
'scale_lat_2': 45.0,
> 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0, 'y_pin': 0.0,
> 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx': 442, 'ny':
265}}*
> *DEBUG 1: Creating postscript file: hpbl.ps <http://hpbl.ps>*
>
>
> You can see that the postscript file has been created.  I had to
adjust the
> read_PostProcessed.py contents upon copying it over.  I originally
did not
> have the "accum", "hemisphere", or "name" attributes.  After adding
those
> in plot_data_plane was successful.  Those added attributes are not
part of
> the attribute list in the netcdf file.  My netcdf file only includes
these
> attributes:
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *root group (NETCDF4 data model, file format HDF5):    FileOrigins:
NA
> MET_version: V9.1    MET_tool: gen_vx_mask    Projection: Lambert
> Conformal    scale_lat_1: 33.000000    scale_lat_2: 45.000000
lat_pin:
> 21.821000    lon_pin: -120.628000    x_pin: 0.000000    y_pin:
0.000000
> lon_orient: -97.000000    d_km: 12.000000    r_km: 6371.200000
nx: 442
>   ny: 265 grid_points    dimensions(sizes): lon(265), lat(442)
> variables(dimensions): float32 LAT(lon,lat), float32 LON(lon,lat),
float32
> DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)
groups: *
>
> You can see that most of them are there.  My understanding is that
the
> postscript file contains the contents used for the postscript image.
I
> thought that an image would have been generated as well.  Should
there be a
> .png file generated as well?  Does this exercise of running
plot_data_plane
> indicate what might be missing in my attribute list that would need
to be
> included (e.g. does name, accum, and hemisphere need to be
included?)?
> Also I had to change how valid and initial times were extracted.
They are
> being written in this way instead:
>
>
>
>
>
>
>
>
>
>
>
> *>>> f.variables[var_name]<class 'netCDF4._netCDF4.Variable'>float32
> PBL(lon, lat)    long_name: PBL    standard_name: Planetary Boundary
Layer
> Height    units: m    level: L0    init_time: 20200804_060000
> init_time_ut: 1596520800    valid_time: 20200805_170000
valid_time_ut:
> 1596646800*
>
> Do I need to adjust my attribute meta data to include the initial
and valid
> times rather than lumping them under the field name?
>
> On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA Affiliate <
> edward.strobach at noaa.gov> wrote:
>
> > Thanks John, I'll go ahead take a look at those resources
> >
> > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Ed,
> >>
> >> Sounds great. FYI, here are some examples of using python
embedding:
> >>
> >>
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> >>
> >> All these examples are for calling the plot_data_plane tool since
> that's a
> >> great way to get started. Plot the data to make sure that its
what you
> >> expect and oriented correctly. I imagine we'll want a python
script that
> >> takes at least 2 arguments... the name of the NetCDF file and the
> variable
> >> you want from it. Something like this example from that page:
> >>
> >> Plot the PSFC variable from a post-processed WRF output file on a
> Lambert
> >> Conformal projection:
> >> plot_data_plane PYTHON_NUMPY psfc.ps
> >> <
> >>
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> >> >
> >>  'name="read_PostProcessed_WRF.py
> >> <
> >>
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> >> >
> >>   2004-09-01_04-00-00.nc
> >> <
> >>
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> >> >
> >>  PSFC";'
> >>
> >> Hopefully it won't be too difficult to adapt one of these scripts
to
> work
> >> with your particular dataset. I'd encourage you to try yourself,
but if
> >> you
> >> run into issues or don't know where to start, we can help too.
> >>
> >> Thanks,
> >> John
> >>
> >>
> >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA Affiliate
via RT
> <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >> >
> >> > Hi John,
> >> >
> >> > I imagine you guys are pretty swamped, especially with so many
more
> >> people
> >> > now using met and metplus.
> >> >
> >> > The option that you are proposing sounds better to me.  I might
be
> able
> >> to
> >> > regain access by Thursday.  I'll make sure to post those items
then.
> >> I'll
> >> > stand by to receive your instructions whenever you get some
time.
> >> Thanks a
> >> > lot!
> >> >
> >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT <
> >> > met_help at ucar.edu>
> >> > wrote:
> >> >
> >> > > Ed,
> >> > >
> >> > > Sorry for the delay in getting to this issue. We were busy
preparing
> >> for
> >> > > the met-9.1 release. I see you are running a script from
Logan to
> >> > reformat
> >> > > some NetCDF data for use in MET... but are running into some
> sporadic
> >> > > issues.
> >> > >
> >> > > I believe that WCOSS is unavailable this week, so I'm not
able to go
> >> > take a
> >> > > closer look at your data right now.
> >> > >
> >> > > But I'm wondering if you'd consider using python embedding to
solve
> >> this
> >> > > issue instead of reformatting these files? With this
approach, we
> >> write a
> >> > > python script to tell MET how to read data from these native
NetCDF
> >> files
> >> > > rather than reformatting them and essentially duplicating the
data.
> >> But
> >> > > it's up to you... I'm sure these problems could be solved
with
> either
> >> > > approach. Python-embedding has the advantage of not
duplicating the
> >> data
> >> > on
> >> > > disk.
> >> > >
> >> > > Just let me know how you'd like to proceed. If you are able
to gain
> >> > access
> >> > > to WCOSS and pull a sample data file, as well as your
reformatting
> >> > script,
> >> > > please post them to our anonymous ftp site following these
> >> instructions:
> >> > >
> >> > >
> >> >
> >>
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> >> > >
> >> > > Thanks,
> >> > > John
> >> > >
> >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT
<met_help at ucar.edu>
> >> > wrote:
> >> > >
> >> > > >
> >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
> >> > > > Transaction: Given to johnhg (John Halley Gotway) by
minnawin
> >> > > >        Queue: met_help
> >> > > >      Subject: Issues processing CF compliant netcdf files
> >> > > >        Owner: johnhg
> >> > > >   Requestors: edward.strobach at noaa.gov
> >> > > >       Status: open
> >> > > >  Ticket <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >> > >
> >> > > >
> >> > > >
> >> > > > This transaction appears to have no content
> >> > > >
> >> > >
> >> > >
> >> >
> >> > --
> >> > Edward Strobach
> >> > EMC/NCEP/NWS/
> >> > IMSG Contractor
> >> > Cubicle#: 2029
> >> > 301-683-3717
> >> >
> >> >
> >>
> >>
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
>
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: John Halley Gotway
Time: Thu Aug 13 10:27:28 2020

Ed,

The plot_data_plane tool generates a Postscript output file. That is
an
image. It does not generate PNG output. However it’s pretty easy to
convert
.ps to .png. I always do so prior to sending them as attachments via
met_help just because the png files are so much smaller.

I use the ImageMagick convert command:

convert -rotate 90 -background white image.ps image.png

As for hemisphere, accum, and name. I don’t think they are required...
without hemisphere I believe the code assumes North (only applies to
polar
stereo and Lambert conf grids I believe). If you’re using those
projections, I would recommend adding it.

John

On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT <met_help at ucar.edu>
wrote:

>
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
>
>
> Hi Ed,
>
> John is out of the office today and tomorrow.  He'll be back in the
office
>
> on Monday, so please allow a few more business days for a full
response.
>
>
>
> Regards,
>
> Minna
>
> ---------------
>
> Minna Win
>
> National Center for Atmospheric Research
>
> Developmental Testbed Center
>
> Phone: 303-497-8423
>
> Fax:   303-497-8401
>
>
>
>
>
>
>
> On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA Affiliate via
RT <
>
> met_help at ucar.edu> wrote:
>
>
>
> >
>
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
> >
>
> > I did have one follow up question.  I copied the contents of the
>
> > read_PostProcessed_WRF.py file and adjusted to match what I needed
for my
>
> > purpose.  When I run plot_data_plane I get an indication that it
was
>
> > successful:
>
> >
>
> > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane PYTHON_NUMPY
> hpbl.ps
>
> > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
>
> > DEBUG 1: Opening data file: PYTHON_NUMPY
>
> > Input File: 'aqm.t12z.metcro2d.19.nc'
>
> > Variable: 'PBL'
>
> > Data Shape: (265, 442)
>
> > Data Type:  dtype('float64')
>
> > *Attributes: {'valid': '20200804_070000', 'init':
'20200803_120000',
>
> > 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name': 'PBL',
'level':
>
> > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert Conformal',
'name':
>
> > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
'scale_lat_2':
> 45.0,
>
> > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0, 'y_pin':
0.0,
>
> > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx': 442,
'ny':
> 265}}*
>
> > *DEBUG 1: Creating postscript file: hpbl.ps <http://hpbl.ps>*
>
> >
>
> >
>
> > You can see that the postscript file has been created.  I had to
adjust
> the
>
> > read_PostProcessed.py contents upon copying it over.  I originally
did
> not
>
> > have the "accum", "hemisphere", or "name" attributes.  After
adding those
>
> > in plot_data_plane was successful.  Those added attributes are not
part
> of
>
> > the attribute list in the netcdf file.  My netcdf file only
includes
> these
>
> > attributes:
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> > *root group (NETCDF4 data model, file format HDF5):
FileOrigins: NA
>
> > MET_version: V9.1    MET_tool: gen_vx_mask    Projection: Lambert
>
> > Conformal    scale_lat_1: 33.000000    scale_lat_2: 45.000000
lat_pin:
>
> > 21.821000    lon_pin: -120.628000    x_pin: 0.000000    y_pin:
0.000000
>
> > lon_orient: -97.000000    d_km: 12.000000    r_km: 6371.200000
nx: 442
>
> >   ny: 265 grid_points    dimensions(sizes): lon(265), lat(442)
>
> > variables(dimensions): float32 LAT(lon,lat), float32 LON(lon,lat),
> float32
>
> > DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)
groups: *
>
> >
>
> > You can see that most of them are there.  My understanding is that
the
>
> > postscript file contains the contents used for the postscript
image.  I
>
> > thought that an image would have been generated as well.  Should
there
> be a
>
> > .png file generated as well?  Does this exercise of running
> plot_data_plane
>
> > indicate what might be missing in my attribute list that would
need to be
>
> > included (e.g. does name, accum, and hemisphere need to be
included?)?
>
> > Also I had to change how valid and initial times were extracted.
They
> are
>
> > being written in this way instead:
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> >
>
> > *>>> f.variables[var_name]<class
'netCDF4._netCDF4.Variable'>float32
>
> > PBL(lon, lat)    long_name: PBL    standard_name: Planetary
Boundary
> Layer
>
> > Height    units: m    level: L0    init_time: 20200804_060000
>
> > init_time_ut: 1596520800    valid_time: 20200805_170000
valid_time_ut:
>
> > 1596646800*
>
> >
>
> > Do I need to adjust my attribute meta data to include the initial
and
> valid
>
> > times rather than lumping them under the field name?
>
> >
>
> > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA Affiliate <
>
> > edward.strobach at noaa.gov> wrote:
>
> >
>
> > > Thanks John, I'll go ahead take a look at those resources
>
> > >
>
> > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT <
>
> > > met_help at ucar.edu> wrote:
>
> > >
>
> > >> Ed,
>
> > >>
>
> > >> Sounds great. FYI, here are some examples of using python
embedding:
>
> > >>
>
> > >>
>
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
>
> > >>
>
> > >> All these examples are for calling the plot_data_plane tool
since
>
> > that's a
>
> > >> great way to get started. Plot the data to make sure that its
what you
>
> > >> expect and oriented correctly. I imagine we'll want a python
script
> that
>
> > >> takes at least 2 arguments... the name of the NetCDF file and
the
>
> > variable
>
> > >> you want from it. Something like this example from that page:
>
> > >>
>
> > >> Plot the PSFC variable from a post-processed WRF output file on
a
>
> > Lambert
>
> > >> Conformal projection:
>
> > >> plot_data_plane PYTHON_NUMPY psfc.ps
>
> > >> <
>
> > >>
>
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
>
> > >> >
>
> > >>  'name="read_PostProcessed_WRF.py
>
> > >> <
>
> > >>
>
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
>
> > >> >
>
> > >>   2004-09-01_04-00-00.nc
>
> > >> <
>
> > >>
>
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
>
> > >> >
>
> > >>  PSFC";'
>
> > >>
>
> > >> Hopefully it won't be too difficult to adapt one of these
scripts to
>
> > work
>
> > >> with your particular dataset. I'd encourage you to try
yourself, but
> if
>
> > >> you
>
> > >> run into issues or don't know where to start, we can help too.
>
> > >>
>
> > >> Thanks,
>
> > >> John
>
> > >>
>
> > >>
>
> > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA
Affiliate via
> RT
>
> > <
>
> > >> met_help at ucar.edu> wrote:
>
> > >>
>
> > >> >
>
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
>
> > >> >
>
> > >> > Hi John,
>
> > >> >
>
> > >> > I imagine you guys are pretty swamped, especially with so
many more
>
> > >> people
>
> > >> > now using met and metplus.
>
> > >> >
>
> > >> > The option that you are proposing sounds better to me.  I
might be
>
> > able
>
> > >> to
>
> > >> > regain access by Thursday.  I'll make sure to post those
items then.
>
> > >> I'll
>
> > >> > stand by to receive your instructions whenever you get some
time.
>
> > >> Thanks a
>
> > >> > lot!
>
> > >> >
>
> > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT <
>
> > >> > met_help at ucar.edu>
>
> > >> > wrote:
>
> > >> >
>
> > >> > > Ed,
>
> > >> > >
>
> > >> > > Sorry for the delay in getting to this issue. We were busy
> preparing
>
> > >> for
>
> > >> > > the met-9.1 release. I see you are running a script from
Logan to
>
> > >> > reformat
>
> > >> > > some NetCDF data for use in MET... but are running into
some
>
> > sporadic
>
> > >> > > issues.
>
> > >> > >
>
> > >> > > I believe that WCOSS is unavailable this week, so I'm not
able to
> go
>
> > >> > take a
>
> > >> > > closer look at your data right now.
>
> > >> > >
>
> > >> > > But I'm wondering if you'd consider using python embedding
to
> solve
>
> > >> this
>
> > >> > > issue instead of reformatting these files? With this
approach, we
>
> > >> write a
>
> > >> > > python script to tell MET how to read data from these
native
> NetCDF
>
> > >> files
>
> > >> > > rather than reformatting them and essentially duplicating
the
> data.
>
> > >> But
>
> > >> > > it's up to you... I'm sure these problems could be solved
with
>
> > either
>
> > >> > > approach. Python-embedding has the advantage of not
duplicating
> the
>
> > >> data
>
> > >> > on
>
> > >> > > disk.
>
> > >> > >
>
> > >> > > Just let me know how you'd like to proceed. If you are able
to
> gain
>
> > >> > access
>
> > >> > > to WCOSS and pull a sample data file, as well as your
reformatting
>
> > >> > script,
>
> > >> > > please post them to our anonymous ftp site following these
>
> > >> instructions:
>
> > >> > >
>
> > >> > >
>
> > >> >
>
> > >>
>
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>
> > >> > >
>
> > >> > > Thanks,
>
> > >> > > John
>
> > >> > >
>
> > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <
> met_help at ucar.edu>
>
> > >> > wrote:
>
> > >> > >
>
> > >> > > >
>
> > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
>
> > >> > > > Transaction: Given to johnhg (John Halley Gotway) by
minnawin
>
> > >> > > >        Queue: met_help
>
> > >> > > >      Subject: Issues processing CF compliant netcdf files
>
> > >> > > >        Owner: johnhg
>
> > >> > > >   Requestors: edward.strobach at noaa.gov
>
> > >> > > >       Status: open
>
> > >> > > >  Ticket <URL:
>
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
> > >> > >
>
> > >> > > >
>
> > >> > > >
>
> > >> > > > This transaction appears to have no content
>
> > >> > > >
>
> > >> > >
>
> > >> > >
>
> > >> >
>
> > >> > --
>
> > >> > Edward Strobach
>
> > >> > EMC/NCEP/NWS/
>
> > >> > IMSG Contractor
>
> > >> > Cubicle#: 2029
>
> > >> > 301-683-3717
>
> > >> >
>
> > >> >
>
> > >>
>
> > >>
>
> > >
>
> > > --
>
> > > Edward Strobach
>
> > > EMC/NCEP/NWS/
>
> > > IMSG Contractor
>
> > > Cubicle#: 2029
>
> > > 301-683-3717
>
> > >
>
> >
>
> >
>
> > --
>
> > Edward Strobach
>
> > EMC/NCEP/NWS/
>
> > IMSG Contractor
>
> > Cubicle#: 2029
>
> > 301-683-3717
>
> >
>
> >
>
>
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Thu Aug 13 10:47:17 2020

Thanks.  I do get an image when running that step.  The PBL height has
reasonable values and is enhanced in regions of convection.  It's nice
to
know that I can process the data from the netcdf files I generated
using
plot_data_plane and that the results are reasonable; however, I'm
wondering
how this resolves issue I'm having related to the original error:

*terminate called after throwing an instance of
'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count exceeds
dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
metplus.PointStat (command_runner.py:191) DEBUG: Finished running
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
(command_builder.py:100) ERROR: (command_builder.py:733) M*

I wasn't able to interpret much from this error when reading about it
online
<https://github.com/NCAR/MET/issues/1139>.  Is the point of the
exercise to
show that my files could be processed, but that there's something
potentially wrong with the attribute settings in the netcdf file that
is
preventing me from moving beyond the error listed above?  Forgive me,
I'm
just trying to connect the two.

On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Ed,
>
> The plot_data_plane tool generates a Postscript output file. That is
an
> image. It does not generate PNG output. However it’s pretty easy to
convert
> .ps to .png. I always do so prior to sending them as attachments via
> met_help just because the png files are so much smaller.
>
> I use the ImageMagick convert command:
>
> convert -rotate 90 -background white image.ps image.png
>
> As for hemisphere, accum, and name. I don’t think they are
required...
> without hemisphere I believe the code assumes North (only applies to
polar
> stereo and Lambert conf grids I believe). If you’re using those
> projections, I would recommend adding it.
>
> John
>
> On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT <met_help at ucar.edu>
> wrote:
>
> >
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> >
> >
> > Hi Ed,
> >
> > John is out of the office today and tomorrow.  He'll be back in
the
> office
> >
> > on Monday, so please allow a few more business days for a full
response.
> >
> >
> >
> > Regards,
> >
> > Minna
> >
> > ---------------
> >
> > Minna Win
> >
> > National Center for Atmospheric Research
> >
> > Developmental Testbed Center
> >
> > Phone: 303-497-8423
> >
> > Fax:   303-497-8401
> >
> >
> >
> >
> >
> >
> >
> > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA Affiliate
via RT <
> >
> > met_help at ucar.edu> wrote:
> >
> >
> >
> > >
> >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> > >
> >
> > > I did have one follow up question.  I copied the contents of the
> >
> > > read_PostProcessed_WRF.py file and adjusted to match what I
needed for
> my
> >
> > > purpose.  When I run plot_data_plane I get an indication that it
was
> >
> > > successful:
> >
> > >
> >
> > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
PYTHON_NUMPY
> > hpbl.ps
> >
> > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
> >
> > > DEBUG 1: Opening data file: PYTHON_NUMPY
> >
> > > Input File: 'aqm.t12z.metcro2d.19.nc'
> >
> > > Variable: 'PBL'
> >
> > > Data Shape: (265, 442)
> >
> > > Data Type:  dtype('float64')
> >
> > > *Attributes: {'valid': '20200804_070000', 'init':
'20200803_120000',
> >
> > > 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name': 'PBL',
> 'level':
> >
> > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert Conformal',
'name':
> >
> > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
'scale_lat_2':
> > 45.0,
> >
> > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0, 'y_pin':
0.0,
> >
> > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx': 442,
'ny':
> > 265}}*
> >
> > > *DEBUG 1: Creating postscript file: hpbl.ps <http://hpbl.ps>*
> >
> > >
> >
> > >
> >
> > > You can see that the postscript file has been created.  I had to
adjust
> > the
> >
> > > read_PostProcessed.py contents upon copying it over.  I
originally did
> > not
> >
> > > have the "accum", "hemisphere", or "name" attributes.  After
adding
> those
> >
> > > in plot_data_plane was successful.  Those added attributes are
not part
> > of
> >
> > > the attribute list in the netcdf file.  My netcdf file only
includes
> > these
> >
> > > attributes:
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > > *root group (NETCDF4 data model, file format HDF5):
FileOrigins: NA
> >
> > > MET_version: V9.1    MET_tool: gen_vx_mask    Projection:
Lambert
> >
> > > Conformal    scale_lat_1: 33.000000    scale_lat_2: 45.000000
> lat_pin:
> >
> > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000    y_pin:
0.000000
> >
> > > lon_orient: -97.000000    d_km: 12.000000    r_km: 6371.200000
nx:
> 442
> >
> > >   ny: 265 grid_points    dimensions(sizes): lon(265), lat(442)
> >
> > > variables(dimensions): float32 LAT(lon,lat), float32
LON(lon,lat),
> > float32
> >
> > > DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)
groups: *
> >
> > >
> >
> > > You can see that most of them are there.  My understanding is
that the
> >
> > > postscript file contains the contents used for the postscript
image.  I
> >
> > > thought that an image would have been generated as well.  Should
there
> > be a
> >
> > > .png file generated as well?  Does this exercise of running
> > plot_data_plane
> >
> > > indicate what might be missing in my attribute list that would
need to
> be
> >
> > > included (e.g. does name, accum, and hemisphere need to be
included?)?
> >
> > > Also I had to change how valid and initial times were extracted.
They
> > are
> >
> > > being written in this way instead:
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > >
> >
> > > *>>> f.variables[var_name]<class
'netCDF4._netCDF4.Variable'>float32
> >
> > > PBL(lon, lat)    long_name: PBL    standard_name: Planetary
Boundary
> > Layer
> >
> > > Height    units: m    level: L0    init_time: 20200804_060000
> >
> > > init_time_ut: 1596520800    valid_time: 20200805_170000
> valid_time_ut:
> >
> > > 1596646800*
> >
> > >
> >
> > > Do I need to adjust my attribute meta data to include the
initial and
> > valid
> >
> > > times rather than lumping them under the field name?
> >
> > >
> >
> > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA Affiliate
<
> >
> > > edward.strobach at noaa.gov> wrote:
> >
> > >
> >
> > > > Thanks John, I'll go ahead take a look at those resources
> >
> > > >
> >
> > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT <
> >
> > > > met_help at ucar.edu> wrote:
> >
> > > >
> >
> > > >> Ed,
> >
> > > >>
> >
> > > >> Sounds great. FYI, here are some examples of using python
embedding:
> >
> > > >>
> >
> > > >>
> >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> >
> > > >>
> >
> > > >> All these examples are for calling the plot_data_plane tool
since
> >
> > > that's a
> >
> > > >> great way to get started. Plot the data to make sure that its
what
> you
> >
> > > >> expect and oriented correctly. I imagine we'll want a python
script
> > that
> >
> > > >> takes at least 2 arguments... the name of the NetCDF file and
the
> >
> > > variable
> >
> > > >> you want from it. Something like this example from that page:
> >
> > > >>
> >
> > > >> Plot the PSFC variable from a post-processed WRF output file
on a
> >
> > > Lambert
> >
> > > >> Conformal projection:
> >
> > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> >
> > > >> <
> >
> > > >>
> >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> >
> > > >> >
> >
> > > >>  'name="read_PostProcessed_WRF.py
> >
> > > >> <
> >
> > > >>
> >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> >
> > > >> >
> >
> > > >>   2004-09-01_04-00-00.nc
> >
> > > >> <
> >
> > > >>
> >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> >
> > > >> >
> >
> > > >>  PSFC";'
> >
> > > >>
> >
> > > >> Hopefully it won't be too difficult to adapt one of these
scripts to
> >
> > > work
> >
> > > >> with your particular dataset. I'd encourage you to try
yourself, but
> > if
> >
> > > >> you
> >
> > > >> run into issues or don't know where to start, we can help
too.
> >
> > > >>
> >
> > > >> Thanks,
> >
> > > >> John
> >
> > > >>
> >
> > > >>
> >
> > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA
Affiliate via
> > RT
> >
> > > <
> >
> > > >> met_help at ucar.edu> wrote:
> >
> > > >>
> >
> > > >> >
> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> > > >> >
> >
> > > >> > Hi John,
> >
> > > >> >
> >
> > > >> > I imagine you guys are pretty swamped, especially with so
many
> more
> >
> > > >> people
> >
> > > >> > now using met and metplus.
> >
> > > >> >
> >
> > > >> > The option that you are proposing sounds better to me.  I
might be
> >
> > > able
> >
> > > >> to
> >
> > > >> > regain access by Thursday.  I'll make sure to post those
items
> then.
> >
> > > >> I'll
> >
> > > >> > stand by to receive your instructions whenever you get some
time.
> >
> > > >> Thanks a
> >
> > > >> > lot!
> >
> > > >> >
> >
> > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT <
> >
> > > >> > met_help at ucar.edu>
> >
> > > >> > wrote:
> >
> > > >> >
> >
> > > >> > > Ed,
> >
> > > >> > >
> >
> > > >> > > Sorry for the delay in getting to this issue. We were
busy
> > preparing
> >
> > > >> for
> >
> > > >> > > the met-9.1 release. I see you are running a script from
Logan
> to
> >
> > > >> > reformat
> >
> > > >> > > some NetCDF data for use in MET... but are running into
some
> >
> > > sporadic
> >
> > > >> > > issues.
> >
> > > >> > >
> >
> > > >> > > I believe that WCOSS is unavailable this week, so I'm not
able
> to
> > go
> >
> > > >> > take a
> >
> > > >> > > closer look at your data right now.
> >
> > > >> > >
> >
> > > >> > > But I'm wondering if you'd consider using python
embedding to
> > solve
> >
> > > >> this
> >
> > > >> > > issue instead of reformatting these files? With this
approach,
> we
> >
> > > >> write a
> >
> > > >> > > python script to tell MET how to read data from these
native
> > NetCDF
> >
> > > >> files
> >
> > > >> > > rather than reformatting them and essentially duplicating
the
> > data.
> >
> > > >> But
> >
> > > >> > > it's up to you... I'm sure these problems could be solved
with
> >
> > > either
> >
> > > >> > > approach. Python-embedding has the advantage of not
duplicating
> > the
> >
> > > >> data
> >
> > > >> > on
> >
> > > >> > > disk.
> >
> > > >> > >
> >
> > > >> > > Just let me know how you'd like to proceed. If you are
able to
> > gain
> >
> > > >> > access
> >
> > > >> > > to WCOSS and pull a sample data file, as well as your
> reformatting
> >
> > > >> > script,
> >
> > > >> > > please post them to our anonymous ftp site following
these
> >
> > > >> instructions:
> >
> > > >> > >
> >
> > > >> > >
> >
> > > >> >
> >
> > > >>
> >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> >
> > > >> > >
> >
> > > >> > > Thanks,
> >
> > > >> > > John
> >
> > > >> > >
> >
> > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <
> > met_help at ucar.edu>
> >
> > > >> > wrote:
> >
> > > >> > >
> >
> > > >> > > >
> >
> > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted upon.
> >
> > > >> > > > Transaction: Given to johnhg (John Halley Gotway) by
minnawin
> >
> > > >> > > >        Queue: met_help
> >
> > > >> > > >      Subject: Issues processing CF compliant netcdf
files
> >
> > > >> > > >        Owner: johnhg
> >
> > > >> > > >   Requestors: edward.strobach at noaa.gov
> >
> > > >> > > >       Status: open
> >
> > > >> > > >  Ticket <URL:
> >
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >
> > > >> > >
> >
> > > >> > > >
> >
> > > >> > > >
> >
> > > >> > > > This transaction appears to have no content
> >
> > > >> > > >
> >
> > > >> > >
> >
> > > >> > >
> >
> > > >> >
> >
> > > >> > --
> >
> > > >> > Edward Strobach
> >
> > > >> > EMC/NCEP/NWS/
> >
> > > >> > IMSG Contractor
> >
> > > >> > Cubicle#: 2029
> >
> > > >> > 301-683-3717
> >
> > > >> >
> >
> > > >> >
> >
> > > >>
> >
> > > >>
> >
> > > >
> >
> > > > --
> >
> > > > Edward Strobach
> >
> > > > EMC/NCEP/NWS/
> >
> > > > IMSG Contractor
> >
> > > > Cubicle#: 2029
> >
> > > > 301-683-3717
> >
> > > >
> >
> > >
> >
> > >
> >
> > > --
> >
> > > Edward Strobach
> >
> > > EMC/NCEP/NWS/
> >
> > > IMSG Contractor
> >
> > > Cubicle#: 2029
> >
> > > 301-683-3717
> >
> > >
> >
> > >
> >
> >
> >
> >
>
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: John Halley Gotway
Time: Thu Aug 13 11:52:31 2020

Ed,

OK, and we'll need that NetCDF file for testing. Hopefully, WCOSS will
be
accessible on Monday, and I can take a look then when I get back in
town.

Thanks,
John

On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
> Thanks.  I do get an image when running that step.  The PBL height
has
> reasonable values and is enhanced in regions of convection.  It's
nice to
> know that I can process the data from the netcdf files I generated
using
> plot_data_plane and that the results are reasonable; however, I'm
wondering
> how this resolves issue I'm having related to the original error:
>
>
>
>
>
> *terminate called after throwing an instance of
> 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count exceeds
> dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
> metplus.PointStat (command_runner.py:191) DEBUG: Finished running
>
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> (command_builder.py:100) ERROR: (command_builder.py:733) M*
>
>
> I wasn't able to interpret much from this error when reading about
it
> online
> <https://github.com/NCAR/MET/issues/1139>.  Is the point of the
exercise
> to
> show that my files could be processed, but that there's something
> potentially wrong with the attribute settings in the netcdf file
that is
> preventing me from moving beyond the error listed above?  Forgive
me, I'm
> just trying to connect the two.
>
> On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Ed,
> >
> > The plot_data_plane tool generates a Postscript output file. That
is an
> > image. It does not generate PNG output. However it’s pretty easy
to
> convert
> > .ps to .png. I always do so prior to sending them as attachments
via
> > met_help just because the png files are so much smaller.
> >
> > I use the ImageMagick convert command:
> >
> > convert -rotate 90 -background white image.ps image.png
> >
> > As for hemisphere, accum, and name. I don’t think they are
required...
> > without hemisphere I believe the code assumes North (only applies
to
> polar
> > stereo and Lambert conf grids I believe). If you’re using those
> > projections, I would recommend adding it.
> >
> > John
> >
> > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > >
> > >
> > >
> > > Hi Ed,
> > >
> > > John is out of the office today and tomorrow.  He'll be back in
the
> > office
> > >
> > > on Monday, so please allow a few more business days for a full
> response.
> > >
> > >
> > >
> > > Regards,
> > >
> > > Minna
> > >
> > > ---------------
> > >
> > > Minna Win
> > >
> > > National Center for Atmospheric Research
> > >
> > > Developmental Testbed Center
> > >
> > > Phone: 303-497-8423
> > >
> > > Fax:   303-497-8401
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA Affiliate
via
> RT <
> > >
> > > met_help at ucar.edu> wrote:
> > >
> > >
> > >
> > > >
> > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
> > >
> > > >
> > >
> > > > I did have one follow up question.  I copied the contents of
the
> > >
> > > > read_PostProcessed_WRF.py file and adjusted to match what I
needed
> for
> > my
> > >
> > > > purpose.  When I run plot_data_plane I get an indication that
it was
> > >
> > > > successful:
> > >
> > > >
> > >
> > > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
PYTHON_NUMPY
> > > hpbl.ps
> > >
> > > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
> > >
> > > > DEBUG 1: Opening data file: PYTHON_NUMPY
> > >
> > > > Input File: 'aqm.t12z.metcro2d.19.nc'
> > >
> > > > Variable: 'PBL'
> > >
> > > > Data Shape: (265, 442)
> > >
> > > > Data Type:  dtype('float64')
> > >
> > > > *Attributes: {'valid': '20200804_070000', 'init':
'20200803_120000',
> > >
> > > > 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name':
'PBL',
> > 'level':
> > >
> > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert Conformal',
> 'name':
> > >
> > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
'scale_lat_2':
> > > 45.0,
> > >
> > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0, 'y_pin':
0.0,
> > >
> > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx': 442,
'ny':
> > > 265}}*
> > >
> > > > *DEBUG 1: Creating postscript file: hpbl.ps <http://hpbl.ps>*
> > >
> > > >
> > >
> > > >
> > >
> > > > You can see that the postscript file has been created.  I had
to
> adjust
> > > the
> > >
> > > > read_PostProcessed.py contents upon copying it over.  I
originally
> did
> > > not
> > >
> > > > have the "accum", "hemisphere", or "name" attributes.  After
adding
> > those
> > >
> > > > in plot_data_plane was successful.  Those added attributes are
not
> part
> > > of
> > >
> > > > the attribute list in the netcdf file.  My netcdf file only
includes
> > > these
> > >
> > > > attributes:
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > > *root group (NETCDF4 data model, file format HDF5):
FileOrigins:
> NA
> > >
> > > > MET_version: V9.1    MET_tool: gen_vx_mask    Projection:
Lambert
> > >
> > > > Conformal    scale_lat_1: 33.000000    scale_lat_2: 45.000000
> > lat_pin:
> > >
> > > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000    y_pin:
> 0.000000
> > >
> > > > lon_orient: -97.000000    d_km: 12.000000    r_km: 6371.200000
nx:
> > 442
> > >
> > > >   ny: 265 grid_points    dimensions(sizes): lon(265), lat(442)
> > >
> > > > variables(dimensions): float32 LAT(lon,lat), float32
LON(lon,lat),
> > > float32
> > >
> > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)
> groups: *
> > >
> > > >
> > >
> > > > You can see that most of them are there.  My understanding is
that
> the
> > >
> > > > postscript file contains the contents used for the postscript
> image.  I
> > >
> > > > thought that an image would have been generated as well.
Should
> there
> > > be a
> > >
> > > > .png file generated as well?  Does this exercise of running
> > > plot_data_plane
> > >
> > > > indicate what might be missing in my attribute list that would
need
> to
> > be
> > >
> > > > included (e.g. does name, accum, and hemisphere need to be
> included?)?
> > >
> > > > Also I had to change how valid and initial times were
extracted.
> They
> > > are
> > >
> > > > being written in this way instead:
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > >
> > >
> > > > *>>> f.variables[var_name]<class
'netCDF4._netCDF4.Variable'>float32
> > >
> > > > PBL(lon, lat)    long_name: PBL    standard_name: Planetary
Boundary
> > > Layer
> > >
> > > > Height    units: m    level: L0    init_time: 20200804_060000
> > >
> > > > init_time_ut: 1596520800    valid_time: 20200805_170000
> > valid_time_ut:
> > >
> > > > 1596646800*
> > >
> > > >
> > >
> > > > Do I need to adjust my attribute meta data to include the
initial and
> > > valid
> > >
> > > > times rather than lumping them under the field name?
> > >
> > > >
> > >
> > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA
Affiliate <
> > >
> > > > edward.strobach at noaa.gov> wrote:
> > >
> > > >
> > >
> > > > > Thanks John, I'll go ahead take a look at those resources
> > >
> > > > >
> > >
> > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT <
> > >
> > > > > met_help at ucar.edu> wrote:
> > >
> > > > >
> > >
> > > > >> Ed,
> > >
> > > > >>
> > >
> > > > >> Sounds great. FYI, here are some examples of using python
> embedding:
> > >
> > > > >>
> > >
> > > > >>
> > >
> > > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> > >
> > > > >>
> > >
> > > > >> All these examples are for calling the plot_data_plane tool
since
> > >
> > > > that's a
> > >
> > > > >> great way to get started. Plot the data to make sure that
its what
> > you
> > >
> > > > >> expect and oriented correctly. I imagine we'll want a
python
> script
> > > that
> > >
> > > > >> takes at least 2 arguments... the name of the NetCDF file
and the
> > >
> > > > variable
> > >
> > > > >> you want from it. Something like this example from that
page:
> > >
> > > > >>
> > >
> > > > >> Plot the PSFC variable from a post-processed WRF output
file on a
> > >
> > > > Lambert
> > >
> > > > >> Conformal projection:
> > >
> > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> > >
> > > > >> <
> > >
> > > > >>
> > >
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> > >
> > > > >> >
> > >
> > > > >>  'name="read_PostProcessed_WRF.py
> > >
> > > > >> <
> > >
> > > > >>
> > >
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> > >
> > > > >> >
> > >
> > > > >>   2004-09-01_04-00-00.nc
> > >
> > > > >> <
> > >
> > > > >>
> > >
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> > >
> > > > >> >
> > >
> > > > >>  PSFC";'
> > >
> > > > >>
> > >
> > > > >> Hopefully it won't be too difficult to adapt one of these
scripts
> to
> > >
> > > > work
> > >
> > > > >> with your particular dataset. I'd encourage you to try
yourself,
> but
> > > if
> > >
> > > > >> you
> > >
> > > > >> run into issues or don't know where to start, we can help
too.
> > >
> > > > >>
> > >
> > > > >> Thanks,
> > >
> > > > >> John
> > >
> > > > >>
> > >
> > > > >>
> > >
> > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA
Affiliate
> via
> > > RT
> > >
> > > > <
> > >
> > > > >> met_help at ucar.edu> wrote:
> > >
> > > > >>
> > >
> > > > >> >
> > >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > >
> > > > >> >
> > >
> > > > >> > Hi John,
> > >
> > > > >> >
> > >
> > > > >> > I imagine you guys are pretty swamped, especially with so
many
> > more
> > >
> > > > >> people
> > >
> > > > >> > now using met and metplus.
> > >
> > > > >> >
> > >
> > > > >> > The option that you are proposing sounds better to me.  I
might
> be
> > >
> > > > able
> > >
> > > > >> to
> > >
> > > > >> > regain access by Thursday.  I'll make sure to post those
items
> > then.
> > >
> > > > >> I'll
> > >
> > > > >> > stand by to receive your instructions whenever you get
some
> time.
> > >
> > > > >> Thanks a
> > >
> > > > >> > lot!
> > >
> > > > >> >
> > >
> > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via RT
<
> > >
> > > > >> > met_help at ucar.edu>
> > >
> > > > >> > wrote:
> > >
> > > > >> >
> > >
> > > > >> > > Ed,
> > >
> > > > >> > >
> > >
> > > > >> > > Sorry for the delay in getting to this issue. We were
busy
> > > preparing
> > >
> > > > >> for
> > >
> > > > >> > > the met-9.1 release. I see you are running a script
from Logan
> > to
> > >
> > > > >> > reformat
> > >
> > > > >> > > some NetCDF data for use in MET... but are running into
some
> > >
> > > > sporadic
> > >
> > > > >> > > issues.
> > >
> > > > >> > >
> > >
> > > > >> > > I believe that WCOSS is unavailable this week, so I'm
not able
> > to
> > > go
> > >
> > > > >> > take a
> > >
> > > > >> > > closer look at your data right now.
> > >
> > > > >> > >
> > >
> > > > >> > > But I'm wondering if you'd consider using python
embedding to
> > > solve
> > >
> > > > >> this
> > >
> > > > >> > > issue instead of reformatting these files? With this
approach,
> > we
> > >
> > > > >> write a
> > >
> > > > >> > > python script to tell MET how to read data from these
native
> > > NetCDF
> > >
> > > > >> files
> > >
> > > > >> > > rather than reformatting them and essentially
duplicating the
> > > data.
> > >
> > > > >> But
> > >
> > > > >> > > it's up to you... I'm sure these problems could be
solved with
> > >
> > > > either
> > >
> > > > >> > > approach. Python-embedding has the advantage of not
> duplicating
> > > the
> > >
> > > > >> data
> > >
> > > > >> > on
> > >
> > > > >> > > disk.
> > >
> > > > >> > >
> > >
> > > > >> > > Just let me know how you'd like to proceed. If you are
able to
> > > gain
> > >
> > > > >> > access
> > >
> > > > >> > > to WCOSS and pull a sample data file, as well as your
> > reformatting
> > >
> > > > >> > script,
> > >
> > > > >> > > please post them to our anonymous ftp site following
these
> > >
> > > > >> instructions:
> > >
> > > > >> > >
> > >
> > > > >> > >
> > >
> > > > >> >
> > >
> > > > >>
> > >
> > > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > >
> > > > >> > >
> > >
> > > > >> > > Thanks,
> > >
> > > > >> > > John
> > >
> > > > >> > >
> > >
> > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <
> > > met_help at ucar.edu>
> > >
> > > > >> > wrote:
> > >
> > > > >> > >
> > >
> > > > >> > > >
> > >
> > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted
upon.
> > >
> > > > >> > > > Transaction: Given to johnhg (John Halley Gotway) by
> minnawin
> > >
> > > > >> > > >        Queue: met_help
> > >
> > > > >> > > >      Subject: Issues processing CF compliant netcdf
files
> > >
> > > > >> > > >        Owner: johnhg
> > >
> > > > >> > > >   Requestors: edward.strobach at noaa.gov
> > >
> > > > >> > > >       Status: open
> > >
> > > > >> > > >  Ticket <URL:
> > >
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > >
> > > > >> > >
> > >
> > > > >> > > >
> > >
> > > > >> > > >
> > >
> > > > >> > > > This transaction appears to have no content
> > >
> > > > >> > > >
> > >
> > > > >> > >
> > >
> > > > >> > >
> > >
> > > > >> >
> > >
> > > > >> > --
> > >
> > > > >> > Edward Strobach
> > >
> > > > >> > EMC/NCEP/NWS/
> > >
> > > > >> > IMSG Contractor
> > >
> > > > >> > Cubicle#: 2029
> > >
> > > > >> > 301-683-3717
> > >
> > > > >> >
> > >
> > > > >> >
> > >
> > > > >>
> > >
> > > > >>
> > >
> > > > >
> > >
> > > > > --
> > >
> > > > > Edward Strobach
> > >
> > > > > EMC/NCEP/NWS/
> > >
> > > > > IMSG Contractor
> > >
> > > > > Cubicle#: 2029
> > >
> > > > > 301-683-3717
> > >
> > > > >
> > >
> > > >
> > >
> > > >
> > >
> > > > --
> > >
> > > > Edward Strobach
> > >
> > > > EMC/NCEP/NWS/
> > >
> > > > IMSG Contractor
> > >
> > > > Cubicle#: 2029
> > >
> > > > 301-683-3717
> > >
> > > >
> > >
> > > >
> > >
> > >
> > >
> > >
> >
> >
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Thu Aug 13 11:54:55 2020

Sounds good.  Enjoy your time off.  I may try a couple of things in
the
meantime

On Thu, Aug 13, 2020 at 1:52 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:

> Ed,
>
> OK, and we'll need that NetCDF file for testing. Hopefully, WCOSS
will be
> accessible on Monday, and I can take a look then when I get back in
town.
>
> Thanks,
> John
>
> On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA Affiliate
via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> > Thanks.  I do get an image when running that step.  The PBL height
has
> > reasonable values and is enhanced in regions of convection.  It's
nice to
> > know that I can process the data from the netcdf files I generated
using
> > plot_data_plane and that the results are reasonable; however, I'm
> wondering
> > how this resolves issue I'm having related to the original error:
> >
> >
> >
> >
> >
> > *terminate called after throwing an instance of
> > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count exceeds
> > dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
> > metplus.PointStat (command_runner.py:191) DEBUG: Finished running
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> > in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> > (command_builder.py:100) ERROR: (command_builder.py:733) M*
> >
> >
> > I wasn't able to interpret much from this error when reading about
it
> > online
> > <https://github.com/NCAR/MET/issues/1139>.  Is the point of the
exercise
> > to
> > show that my files could be processed, but that there's something
> > potentially wrong with the attribute settings in the netcdf file
that is
> > preventing me from moving beyond the error listed above?  Forgive
me, I'm
> > just trying to connect the two.
> >
> > On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Ed,
> > >
> > > The plot_data_plane tool generates a Postscript output file.
That is an
> > > image. It does not generate PNG output. However it’s pretty easy
to
> > convert
> > > .ps to .png. I always do so prior to sending them as attachments
via
> > > met_help just because the png files are so much smaller.
> > >
> > > I use the ImageMagick convert command:
> > >
> > > convert -rotate 90 -background white image.ps image.png
> > >
> > > As for hemisphere, accum, and name. I don’t think they are
required...
> > > without hemisphere I believe the code assumes North (only
applies to
> > polar
> > > stereo and Lambert conf grids I believe). If you’re using those
> > > projections, I would recommend adding it.
> > >
> > > John
> > >
> > > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
> > > >
> > > >
> > > >
> > > > Hi Ed,
> > > >
> > > > John is out of the office today and tomorrow.  He'll be back
in the
> > > office
> > > >
> > > > on Monday, so please allow a few more business days for a full
> > response.
> > > >
> > > >
> > > >
> > > > Regards,
> > > >
> > > > Minna
> > > >
> > > > ---------------
> > > >
> > > > Minna Win
> > > >
> > > > National Center for Atmospheric Research
> > > >
> > > > Developmental Testbed Center
> > > >
> > > > Phone: 303-497-8423
> > > >
> > > > Fax:   303-497-8401
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA
Affiliate via
> > RT <
> > > >
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >
> > > >
> > > > >
> > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > > >
> > > > >
> > > >
> > > > > I did have one follow up question.  I copied the contents of
the
> > > >
> > > > > read_PostProcessed_WRF.py file and adjusted to match what I
needed
> > for
> > > my
> > > >
> > > > > purpose.  When I run plot_data_plane I get an indication
that it
> was
> > > >
> > > > > successful:
> > > >
> > > > >
> > > >
> > > > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
PYTHON_NUMPY
> > > > hpbl.ps
> > > >
> > > > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
> > > >
> > > > > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > >
> > > > > Input File: 'aqm.t12z.metcro2d.19.nc'
> > > >
> > > > > Variable: 'PBL'
> > > >
> > > > > Data Shape: (265, 442)
> > > >
> > > > > Data Type:  dtype('float64')
> > > >
> > > > > *Attributes: {'valid': '20200804_070000', 'init':
> '20200803_120000',
> > > >
> > > > > 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name':
'PBL',
> > > 'level':
> > > >
> > > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert
Conformal',
> > 'name':
> > > >
> > > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
> 'scale_lat_2':
> > > > 45.0,
> > > >
> > > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0,
'y_pin': 0.0,
> > > >
> > > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx':
442, 'ny':
> > > > 265}}*
> > > >
> > > > > *DEBUG 1: Creating postscript file: hpbl.ps
<http://hpbl.ps>*
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > > You can see that the postscript file has been created.  I
had to
> > adjust
> > > > the
> > > >
> > > > > read_PostProcessed.py contents upon copying it over.  I
originally
> > did
> > > > not
> > > >
> > > > > have the "accum", "hemisphere", or "name" attributes.  After
adding
> > > those
> > > >
> > > > > in plot_data_plane was successful.  Those added attributes
are not
> > part
> > > > of
> > > >
> > > > > the attribute list in the netcdf file.  My netcdf file only
> includes
> > > > these
> > > >
> > > > > attributes:
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > > *root group (NETCDF4 data model, file format HDF5):
FileOrigins:
> > NA
> > > >
> > > > > MET_version: V9.1    MET_tool: gen_vx_mask    Projection:
Lambert
> > > >
> > > > > Conformal    scale_lat_1: 33.000000    scale_lat_2:
45.000000
> > > lat_pin:
> > > >
> > > > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000
y_pin:
> > 0.000000
> > > >
> > > > > lon_orient: -97.000000    d_km: 12.000000    r_km:
6371.200000
> nx:
> > > 442
> > > >
> > > > >   ny: 265 grid_points    dimensions(sizes): lon(265),
lat(442)
> > > >
> > > > > variables(dimensions): float32 LAT(lon,lat), float32
LON(lon,lat),
> > > > float32
> > > >
> > > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)
> > groups: *
> > > >
> > > > >
> > > >
> > > > > You can see that most of them are there.  My understanding
is that
> > the
> > > >
> > > > > postscript file contains the contents used for the
postscript
> > image.  I
> > > >
> > > > > thought that an image would have been generated as well.
Should
> > there
> > > > be a
> > > >
> > > > > .png file generated as well?  Does this exercise of running
> > > > plot_data_plane
> > > >
> > > > > indicate what might be missing in my attribute list that
would need
> > to
> > > be
> > > >
> > > > > included (e.g. does name, accum, and hemisphere need to be
> > included?)?
> > > >
> > > > > Also I had to change how valid and initial times were
extracted.
> > They
> > > > are
> > > >
> > > > > being written in this way instead:
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > > *>>> f.variables[var_name]<class
> 'netCDF4._netCDF4.Variable'>float32
> > > >
> > > > > PBL(lon, lat)    long_name: PBL    standard_name: Planetary
> Boundary
> > > > Layer
> > > >
> > > > > Height    units: m    level: L0    init_time:
20200804_060000
> > > >
> > > > > init_time_ut: 1596520800    valid_time: 20200805_170000
> > > valid_time_ut:
> > > >
> > > > > 1596646800*
> > > >
> > > > >
> > > >
> > > > > Do I need to adjust my attribute meta data to include the
initial
> and
> > > > valid
> > > >
> > > > > times rather than lumping them under the field name?
> > > >
> > > > >
> > > >
> > > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA
Affiliate <
> > > >
> > > > > edward.strobach at noaa.gov> wrote:
> > > >
> > > > >
> > > >
> > > > > > Thanks John, I'll go ahead take a look at those resources
> > > >
> > > > > >
> > > >
> > > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via RT
<
> > > >
> > > > > > met_help at ucar.edu> wrote:
> > > >
> > > > > >
> > > >
> > > > > >> Ed,
> > > >
> > > > > >>
> > > >
> > > > > >> Sounds great. FYI, here are some examples of using python
> > embedding:
> > > >
> > > > > >>
> > > >
> > > > > >>
> > > >
> > > > >
> > > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> > > >
> > > > > >>
> > > >
> > > > > >> All these examples are for calling the plot_data_plane
tool
> since
> > > >
> > > > > that's a
> > > >
> > > > > >> great way to get started. Plot the data to make sure that
its
> what
> > > you
> > > >
> > > > > >> expect and oriented correctly. I imagine we'll want a
python
> > script
> > > > that
> > > >
> > > > > >> takes at least 2 arguments... the name of the NetCDF file
and
> the
> > > >
> > > > > variable
> > > >
> > > > > >> you want from it. Something like this example from that
page:
> > > >
> > > > > >>
> > > >
> > > > > >> Plot the PSFC variable from a post-processed WRF output
file on
> a
> > > >
> > > > > Lambert
> > > >
> > > > > >> Conformal projection:
> > > >
> > > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> > > >
> > > > > >> <
> > > >
> > > > > >>
> > > >
> > > > >
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> > > >
> > > > > >> >
> > > >
> > > > > >>  'name="read_PostProcessed_WRF.py
> > > >
> > > > > >> <
> > > >
> > > > > >>
> > > >
> > > > >
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> > > >
> > > > > >> >
> > > >
> > > > > >>   2004-09-01_04-00-00.nc
> > > >
> > > > > >> <
> > > >
> > > > > >>
> > > >
> > > > >
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> > > >
> > > > > >> >
> > > >
> > > > > >>  PSFC";'
> > > >
> > > > > >>
> > > >
> > > > > >> Hopefully it won't be too difficult to adapt one of these
> scripts
> > to
> > > >
> > > > > work
> > > >
> > > > > >> with your particular dataset. I'd encourage you to try
yourself,
> > but
> > > > if
> > > >
> > > > > >> you
> > > >
> > > > > >> run into issues or don't know where to start, we can help
too.
> > > >
> > > > > >>
> > > >
> > > > > >> Thanks,
> > > >
> > > > > >> John
> > > >
> > > > > >>
> > > >
> > > > > >>
> > > >
> > > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA
Affiliate
> > via
> > > > RT
> > > >
> > > > > <
> > > >
> > > > > >> met_help at ucar.edu> wrote:
> > > >
> > > > > >>
> > > >
> > > > > >> >
> > > >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >
> > > >
> > > > > >> >
> > > >
> > > > > >> > Hi John,
> > > >
> > > > > >> >
> > > >
> > > > > >> > I imagine you guys are pretty swamped, especially with
so many
> > > more
> > > >
> > > > > >> people
> > > >
> > > > > >> > now using met and metplus.
> > > >
> > > > > >> >
> > > >
> > > > > >> > The option that you are proposing sounds better to me.
I
> might
> > be
> > > >
> > > > > able
> > > >
> > > > > >> to
> > > >
> > > > > >> > regain access by Thursday.  I'll make sure to post
those items
> > > then.
> > > >
> > > > > >> I'll
> > > >
> > > > > >> > stand by to receive your instructions whenever you get
some
> > time.
> > > >
> > > > > >> Thanks a
> > > >
> > > > > >> > lot!
> > > >
> > > > > >> >
> > > >
> > > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via
RT <
> > > >
> > > > > >> > met_help at ucar.edu>
> > > >
> > > > > >> > wrote:
> > > >
> > > > > >> >
> > > >
> > > > > >> > > Ed,
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > Sorry for the delay in getting to this issue. We were
busy
> > > > preparing
> > > >
> > > > > >> for
> > > >
> > > > > >> > > the met-9.1 release. I see you are running a script
from
> Logan
> > > to
> > > >
> > > > > >> > reformat
> > > >
> > > > > >> > > some NetCDF data for use in MET... but are running
into some
> > > >
> > > > > sporadic
> > > >
> > > > > >> > > issues.
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > I believe that WCOSS is unavailable this week, so I'm
not
> able
> > > to
> > > > go
> > > >
> > > > > >> > take a
> > > >
> > > > > >> > > closer look at your data right now.
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > But I'm wondering if you'd consider using python
embedding
> to
> > > > solve
> > > >
> > > > > >> this
> > > >
> > > > > >> > > issue instead of reformatting these files? With this
> approach,
> > > we
> > > >
> > > > > >> write a
> > > >
> > > > > >> > > python script to tell MET how to read data from these
native
> > > > NetCDF
> > > >
> > > > > >> files
> > > >
> > > > > >> > > rather than reformatting them and essentially
duplicating
> the
> > > > data.
> > > >
> > > > > >> But
> > > >
> > > > > >> > > it's up to you... I'm sure these problems could be
solved
> with
> > > >
> > > > > either
> > > >
> > > > > >> > > approach. Python-embedding has the advantage of not
> > duplicating
> > > > the
> > > >
> > > > > >> data
> > > >
> > > > > >> > on
> > > >
> > > > > >> > > disk.
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > Just let me know how you'd like to proceed. If you
are able
> to
> > > > gain
> > > >
> > > > > >> > access
> > > >
> > > > > >> > > to WCOSS and pull a sample data file, as well as your
> > > reformatting
> > > >
> > > > > >> > script,
> > > >
> > > > > >> > > please post them to our anonymous ftp site following
these
> > > >
> > > > > >> instructions:
> > > >
> > > > > >> > >
> > > >
> > > > > >> > >
> > > >
> > > > > >> >
> > > >
> > > > > >>
> > > >
> > > > >
> > > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > Thanks,
> > > >
> > > > > >> > > John
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <
> > > > met_help at ucar.edu>
> > > >
> > > > > >> > wrote:
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > >
> > > >
> > > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted
upon.
> > > >
> > > > > >> > > > Transaction: Given to johnhg (John Halley Gotway)
by
> > minnawin
> > > >
> > > > > >> > > >        Queue: met_help
> > > >
> > > > > >> > > >      Subject: Issues processing CF compliant netcdf
files
> > > >
> > > > > >> > > >        Owner: johnhg
> > > >
> > > > > >> > > >   Requestors: edward.strobach at noaa.gov
> > > >
> > > > > >> > > >       Status: open
> > > >
> > > > > >> > > >  Ticket <URL:
> > > >
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > > >
> > > > > >> > >
> > > >
> > > > > >> > > >
> > > >
> > > > > >> > > >
> > > >
> > > > > >> > > > This transaction appears to have no content
> > > >
> > > > > >> > > >
> > > >
> > > > > >> > >
> > > >
> > > > > >> > >
> > > >
> > > > > >> >
> > > >
> > > > > >> > --
> > > >
> > > > > >> > Edward Strobach
> > > >
> > > > > >> > EMC/NCEP/NWS/
> > > >
> > > > > >> > IMSG Contractor
> > > >
> > > > > >> > Cubicle#: 2029
> > > >
> > > > > >> > 301-683-3717
> > > >
> > > > > >> >
> > > >
> > > > > >> >
> > > >
> > > > > >>
> > > >
> > > > > >>
> > > >
> > > > > >
> > > >
> > > > > > --
> > > >
> > > > > > Edward Strobach
> > > >
> > > > > > EMC/NCEP/NWS/
> > > >
> > > > > > IMSG Contractor
> > > >
> > > > > > Cubicle#: 2029
> > > >
> > > > > > 301-683-3717
> > > >
> > > > > >
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > > > --
> > > >
> > > > > Edward Strobach
> > > >
> > > > > EMC/NCEP/NWS/
> > > >
> > > > > IMSG Contractor
> > > >
> > > > > Cubicle#: 2029
> > > >
> > > > > 301-683-3717
> > > >
> > > > >
> > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
> >
>
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Fri Aug 14 04:44:49 2020

Hi John,

I managed to resolve the issue and was able to make some positive
changes
through studying this error closely online:

*terminate called after throwing an instance of
'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count exceeds
dimension bound*

Although not clear from the outset, the "Start+count exceeds dimension
bound" stood out in particular such that I decided to change around my
nx
and ny values within the meta data script.  Now I have populated stat
files
being generated.  I plan to add fields into this step with the hope of
storing all the fields I need to process for verification.

On Thu, Aug 13, 2020 at 1:54 PM Edward Strobach - NOAA Affiliate <
edward.strobach at noaa.gov> wrote:

> Sounds good.  Enjoy your time off.  I may try a couple of things in
the
> meantime
>
> On Thu, Aug 13, 2020 at 1:52 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Ed,
>>
>> OK, and we'll need that NetCDF file for testing. Hopefully, WCOSS
will be
>> accessible on Monday, and I can take a look then when I get back in
town.
>>
>> Thanks,
>> John
>>
>> On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA Affiliate
via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>> >
>> > Thanks.  I do get an image when running that step.  The PBL
height has
>> > reasonable values and is enhanced in regions of convection.  It's
nice
>> to
>> > know that I can process the data from the netcdf files I
generated using
>> > plot_data_plane and that the results are reasonable; however, I'm
>> wondering
>> > how this resolves issue I'm having related to the original error:
>> >
>> >
>> >
>> >
>> >
>> > *terminate called after throwing an instance of
>> > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds
>> > dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
>> > metplus.PointStat (command_runner.py:191) DEBUG: Finished running
>> >
>> >
>>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
>> > in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
>> > (command_builder.py:100) ERROR: (command_builder.py:733) M*
>> >
>> >
>> > I wasn't able to interpret much from this error when reading
about it
>> > online
>> > <https://github.com/NCAR/MET/issues/1139>.  Is the point of the
>> exercise
>> > to
>> > show that my files could be processed, but that there's something
>> > potentially wrong with the attribute settings in the netcdf file
that is
>> > preventing me from moving beyond the error listed above?  Forgive
me,
>> I'm
>> > just trying to connect the two.
>> >
>> > On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > > Ed,
>> > >
>> > > The plot_data_plane tool generates a Postscript output file.
That is
>> an
>> > > image. It does not generate PNG output. However it’s pretty
easy to
>> > convert
>> > > .ps to .png. I always do so prior to sending them as
attachments via
>> > > met_help just because the png files are so much smaller.
>> > >
>> > > I use the ImageMagick convert command:
>> > >
>> > > convert -rotate 90 -background white image.ps image.png
>> > >
>> > > As for hemisphere, accum, and name. I don’t think they are
required...
>> > > without hemisphere I believe the code assumes North (only
applies to
>> > polar
>> > > stereo and Lambert conf grids I believe). If you’re using those
>> > > projections, I would recommend adding it.
>> > >
>> > > John
>> > >
>> > > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT
<met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
>> > > >
>> > > >
>> > > >
>> > > > Hi Ed,
>> > > >
>> > > > John is out of the office today and tomorrow.  He'll be back
in the
>> > > office
>> > > >
>> > > > on Monday, so please allow a few more business days for a
full
>> > response.
>> > > >
>> > > >
>> > > >
>> > > > Regards,
>> > > >
>> > > > Minna
>> > > >
>> > > > ---------------
>> > > >
>> > > > Minna Win
>> > > >
>> > > > National Center for Atmospheric Research
>> > > >
>> > > > Developmental Testbed Center
>> > > >
>> > > > Phone: 303-497-8423
>> > > >
>> > > > Fax:   303-497-8401
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA
Affiliate via
>> > RT <
>> > > >
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > >
>> > > >
>> > > > >
>> > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>> > > >
>> > > > >
>> > > >
>> > > > > I did have one follow up question.  I copied the contents
of the
>> > > >
>> > > > > read_PostProcessed_WRF.py file and adjusted to match what I
needed
>> > for
>> > > my
>> > > >
>> > > > > purpose.  When I run plot_data_plane I get an indication
that it
>> was
>> > > >
>> > > > > successful:
>> > > >
>> > > > >
>> > > >
>> > > > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
>> PYTHON_NUMPY
>> > > > hpbl.ps
>> > > >
>> > > > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc PBL";'
>> > > >
>> > > > > DEBUG 1: Opening data file: PYTHON_NUMPY
>> > > >
>> > > > > Input File: 'aqm.t12z.metcro2d.19.nc'
>> > > >
>> > > > > Variable: 'PBL'
>> > > >
>> > > > > Data Shape: (265, 442)
>> > > >
>> > > > > Data Type:  dtype('float64')
>> > > >
>> > > > > *Attributes: {'valid': '20200804_070000', 'init':
>> '20200803_120000',
>> > > >
>> > > > > 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name':
'PBL',
>> > > 'level':
>> > > >
>> > > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert
Conformal',
>> > 'name':
>> > > >
>> > > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
>> 'scale_lat_2':
>> > > > 45.0,
>> > > >
>> > > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0,
'y_pin':
>> 0.0,
>> > > >
>> > > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx':
442,
>> 'ny':
>> > > > 265}}*
>> > > >
>> > > > > *DEBUG 1: Creating postscript file: hpbl.ps
<http://hpbl.ps>*
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > > You can see that the postscript file has been created.  I
had to
>> > adjust
>> > > > the
>> > > >
>> > > > > read_PostProcessed.py contents upon copying it over.  I
originally
>> > did
>> > > > not
>> > > >
>> > > > > have the "accum", "hemisphere", or "name" attributes.
After
>> adding
>> > > those
>> > > >
>> > > > > in plot_data_plane was successful.  Those added attributes
are not
>> > part
>> > > > of
>> > > >
>> > > > > the attribute list in the netcdf file.  My netcdf file only
>> includes
>> > > > these
>> > > >
>> > > > > attributes:
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > > *root group (NETCDF4 data model, file format HDF5):
>> FileOrigins:
>> > NA
>> > > >
>> > > > > MET_version: V9.1    MET_tool: gen_vx_mask    Projection:
Lambert
>> > > >
>> > > > > Conformal    scale_lat_1: 33.000000    scale_lat_2:
45.000000
>> > > lat_pin:
>> > > >
>> > > > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000
y_pin:
>> > 0.000000
>> > > >
>> > > > > lon_orient: -97.000000    d_km: 12.000000    r_km:
6371.200000
>> nx:
>> > > 442
>> > > >
>> > > > >   ny: 265 grid_points    dimensions(sizes): lon(265),
lat(442)
>> > > >
>> > > > > variables(dimensions): float32 LAT(lon,lat), float32
LON(lon,lat),
>> > > > float32
>> > > >
>> > > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32 PBL(lon,lat)
>> > groups: *
>> > > >
>> > > > >
>> > > >
>> > > > > You can see that most of them are there.  My understanding
is that
>> > the
>> > > >
>> > > > > postscript file contains the contents used for the
postscript
>> > image.  I
>> > > >
>> > > > > thought that an image would have been generated as well.
Should
>> > there
>> > > > be a
>> > > >
>> > > > > .png file generated as well?  Does this exercise of running
>> > > > plot_data_plane
>> > > >
>> > > > > indicate what might be missing in my attribute list that
would
>> need
>> > to
>> > > be
>> > > >
>> > > > > included (e.g. does name, accum, and hemisphere need to be
>> > included?)?
>> > > >
>> > > > > Also I had to change how valid and initial times were
extracted.
>> > They
>> > > > are
>> > > >
>> > > > > being written in this way instead:
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > > *>>> f.variables[var_name]<class
>> 'netCDF4._netCDF4.Variable'>float32
>> > > >
>> > > > > PBL(lon, lat)    long_name: PBL    standard_name: Planetary
>> Boundary
>> > > > Layer
>> > > >
>> > > > > Height    units: m    level: L0    init_time:
20200804_060000
>> > > >
>> > > > > init_time_ut: 1596520800    valid_time: 20200805_170000
>> > > valid_time_ut:
>> > > >
>> > > > > 1596646800*
>> > > >
>> > > > >
>> > > >
>> > > > > Do I need to adjust my attribute meta data to include the
initial
>> and
>> > > > valid
>> > > >
>> > > > > times rather than lumping them under the field name?
>> > > >
>> > > > >
>> > > >
>> > > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA
Affiliate <
>> > > >
>> > > > > edward.strobach at noaa.gov> wrote:
>> > > >
>> > > > >
>> > > >
>> > > > > > Thanks John, I'll go ahead take a look at those resources
>> > > >
>> > > > > >
>> > > >
>> > > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via
RT <
>> > > >
>> > > > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > > >
>> > > >
>> > > > > >> Ed,
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> Sounds great. FYI, here are some examples of using
python
>> > embedding:
>> > > >
>> > > > > >>
>> > > >
>> > > > > >>
>> > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> All these examples are for calling the plot_data_plane
tool
>> since
>> > > >
>> > > > > that's a
>> > > >
>> > > > > >> great way to get started. Plot the data to make sure
that its
>> what
>> > > you
>> > > >
>> > > > > >> expect and oriented correctly. I imagine we'll want a
python
>> > script
>> > > > that
>> > > >
>> > > > > >> takes at least 2 arguments... the name of the NetCDF
file and
>> the
>> > > >
>> > > > > variable
>> > > >
>> > > > > >> you want from it. Something like this example from that
page:
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> Plot the PSFC variable from a post-processed WRF output
file
>> on a
>> > > >
>> > > > > Lambert
>> > > >
>> > > > > >> Conformal projection:
>> > > >
>> > > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
>> > > >
>> > > > > >> <
>> > > >
>> > > > > >>
>> > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >>  'name="read_PostProcessed_WRF.py
>> > > >
>> > > > > >> <
>> > > >
>> > > > > >>
>> > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >>   2004-09-01_04-00-00.nc
>> > > >
>> > > > > >> <
>> > > >
>> > > > > >>
>> > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >>  PSFC";'
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> Hopefully it won't be too difficult to adapt one of
these
>> scripts
>> > to
>> > > >
>> > > > > work
>> > > >
>> > > > > >> with your particular dataset. I'd encourage you to try
>> yourself,
>> > but
>> > > > if
>> > > >
>> > > > > >> you
>> > > >
>> > > > > >> run into issues or don't know where to start, we can
help too.
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> Thanks,
>> > > >
>> > > > > >> John
>> > > >
>> > > > > >>
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA
>> Affiliate
>> > via
>> > > > RT
>> > > >
>> > > > > <
>> > > >
>> > > > > >> met_help at ucar.edu> wrote:
>> > > >
>> > > > > >>
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > Hi John,
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > I imagine you guys are pretty swamped, especially with
so
>> many
>> > > more
>> > > >
>> > > > > >> people
>> > > >
>> > > > > >> > now using met and metplus.
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > The option that you are proposing sounds better to me.
I
>> might
>> > be
>> > > >
>> > > > > able
>> > > >
>> > > > > >> to
>> > > >
>> > > > > >> > regain access by Thursday.  I'll make sure to post
those
>> items
>> > > then.
>> > > >
>> > > > > >> I'll
>> > > >
>> > > > > >> > stand by to receive your instructions whenever you get
some
>> > time.
>> > > >
>> > > > > >> Thanks a
>> > > >
>> > > > > >> > lot!
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway via
RT <
>> > > >
>> > > > > >> > met_help at ucar.edu>
>> > > >
>> > > > > >> > wrote:
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > > Ed,
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > Sorry for the delay in getting to this issue. We
were busy
>> > > > preparing
>> > > >
>> > > > > >> for
>> > > >
>> > > > > >> > > the met-9.1 release. I see you are running a script
from
>> Logan
>> > > to
>> > > >
>> > > > > >> > reformat
>> > > >
>> > > > > >> > > some NetCDF data for use in MET... but are running
into
>> some
>> > > >
>> > > > > sporadic
>> > > >
>> > > > > >> > > issues.
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > I believe that WCOSS is unavailable this week, so
I'm not
>> able
>> > > to
>> > > > go
>> > > >
>> > > > > >> > take a
>> > > >
>> > > > > >> > > closer look at your data right now.
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > But I'm wondering if you'd consider using python
embedding
>> to
>> > > > solve
>> > > >
>> > > > > >> this
>> > > >
>> > > > > >> > > issue instead of reformatting these files? With this
>> approach,
>> > > we
>> > > >
>> > > > > >> write a
>> > > >
>> > > > > >> > > python script to tell MET how to read data from
these
>> native
>> > > > NetCDF
>> > > >
>> > > > > >> files
>> > > >
>> > > > > >> > > rather than reformatting them and essentially
duplicating
>> the
>> > > > data.
>> > > >
>> > > > > >> But
>> > > >
>> > > > > >> > > it's up to you... I'm sure these problems could be
solved
>> with
>> > > >
>> > > > > either
>> > > >
>> > > > > >> > > approach. Python-embedding has the advantage of not
>> > duplicating
>> > > > the
>> > > >
>> > > > > >> data
>> > > >
>> > > > > >> > on
>> > > >
>> > > > > >> > > disk.
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > Just let me know how you'd like to proceed. If you
are
>> able to
>> > > > gain
>> > > >
>> > > > > >> > access
>> > > >
>> > > > > >> > > to WCOSS and pull a sample data file, as well as
your
>> > > reformatting
>> > > >
>> > > > > >> > script,
>> > > >
>> > > > > >> > > please post them to our anonymous ftp site following
these
>> > > >
>> > > > > >> instructions:
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >>
>> > > >
>> > > > >
>> > > >
>> > >
>> >
>> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > Thanks,
>> > > >
>> > > > > >> > > John
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <
>> > > > met_help at ucar.edu>
>> > > >
>> > > > > >> > wrote:
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > >
>> > > >
>> > > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was acted
upon.
>> > > >
>> > > > > >> > > > Transaction: Given to johnhg (John Halley Gotway)
by
>> > minnawin
>> > > >
>> > > > > >> > > >        Queue: met_help
>> > > >
>> > > > > >> > > >      Subject: Issues processing CF compliant
netcdf files
>> > > >
>> > > > > >> > > >        Owner: johnhg
>> > > >
>> > > > > >> > > >   Requestors: edward.strobach at noaa.gov
>> > > >
>> > > > > >> > > >       Status: open
>> > > >
>> > > > > >> > > >  Ticket <URL:
>> > > >
>> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > > >
>> > > >
>> > > > > >> > > >
>> > > >
>> > > > > >> > > > This transaction appears to have no content
>> > > >
>> > > > > >> > > >
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> > >
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> > --
>> > > >
>> > > > > >> > Edward Strobach
>> > > >
>> > > > > >> > EMC/NCEP/NWS/
>> > > >
>> > > > > >> > IMSG Contractor
>> > > >
>> > > > > >> > Cubicle#: 2029
>> > > >
>> > > > > >> > 301-683-3717
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >> >
>> > > >
>> > > > > >>
>> > > >
>> > > > > >>
>> > > >
>> > > > > >
>> > > >
>> > > > > > --
>> > > >
>> > > > > > Edward Strobach
>> > > >
>> > > > > > EMC/NCEP/NWS/
>> > > >
>> > > > > > IMSG Contractor
>> > > >
>> > > > > > Cubicle#: 2029
>> > > >
>> > > > > > 301-683-3717
>> > > >
>> > > > > >
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > > > --
>> > > >
>> > > > > Edward Strobach
>> > > >
>> > > > > EMC/NCEP/NWS/
>> > > >
>> > > > > IMSG Contractor
>> > > >
>> > > > > Cubicle#: 2029
>> > > >
>> > > > > 301-683-3717
>> > > >
>> > > > >
>> > > >
>> > > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> > --
>> > Edward Strobach
>> > EMC/NCEP/NWS/
>> > IMSG Contractor
>> > Cubicle#: 2029
>> > 301-683-3717
>> >
>> >
>>
>>
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: John Halley Gotway
Time: Mon Aug 17 15:42:08 2020

Ed,

Great, glad you were able to make progress. Are there any issues
remaining
on this ticket, or should I go ahead and resolve it?

Thanks,
John

On Fri, Aug 14, 2020 at 4:45 AM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
> Hi John,
>
> I managed to resolve the issue and was able to make some positive
changes
> through studying this error closely online:
>
>
> *terminate called after throwing an instance of
> 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count exceeds
> dimension bound*
>
> Although not clear from the outset, the "Start+count exceeds
dimension
> bound" stood out in particular such that I decided to change around
my nx
> and ny values within the meta data script.  Now I have populated
stat files
> being generated.  I plan to add fields into this step with the hope
of
> storing all the fields I need to process for verification.
>
>
> On Thu, Aug 13, 2020 at 1:54 PM Edward Strobach - NOAA Affiliate <
> edward.strobach at noaa.gov> wrote:
>
> > Sounds good.  Enjoy your time off.  I may try a couple of things
in the
> > meantime
> >
> > On Thu, Aug 13, 2020 at 1:52 PM John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Ed,
> >>
> >> OK, and we'll need that NetCDF file for testing. Hopefully, WCOSS
will
> be
> >> accessible on Monday, and I can take a look then when I get back
in
> town.
> >>
> >> Thanks,
> >> John
> >>
> >> On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA Affiliate
via
> RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >> >
> >> > Thanks.  I do get an image when running that step.  The PBL
height has
> >> > reasonable values and is enhanced in regions of convection.
It's nice
> >> to
> >> > know that I can process the data from the netcdf files I
generated
> using
> >> > plot_data_plane and that the results are reasonable; however,
I'm
> >> wondering
> >> > how this resolves issue I'm having related to the original
error:
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > *terminate called after throwing an instance of
> >> > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds
> >> > dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
> >> > metplus.PointStat (command_runner.py:191) DEBUG: Finished
running
> >> >
> >> >
> >>
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> >> > in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> >> > (command_builder.py:100) ERROR: (command_builder.py:733) M*
> >> >
> >> >
> >> > I wasn't able to interpret much from this error when reading
about it
> >> > online
> >> > <https://github.com/NCAR/MET/issues/1139>.  Is the point of the
> >> exercise
> >> > to
> >> > show that my files could be processed, but that there's
something
> >> > potentially wrong with the attribute settings in the netcdf
file that
> is
> >> > preventing me from moving beyond the error listed above?
Forgive me,
> >> I'm
> >> > just trying to connect the two.
> >> >
> >> > On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > > Ed,
> >> > >
> >> > > The plot_data_plane tool generates a Postscript output file.
That is
> >> an
> >> > > image. It does not generate PNG output. However it’s pretty
easy to
> >> > convert
> >> > > .ps to .png. I always do so prior to sending them as
attachments via
> >> > > met_help just because the png files are so much smaller.
> >> > >
> >> > > I use the ImageMagick convert command:
> >> > >
> >> > > convert -rotate 90 -background white image.ps image.png
> >> > >
> >> > > As for hemisphere, accum, and name. I don’t think they are
> required...
> >> > > without hemisphere I believe the code assumes North (only
applies to
> >> > polar
> >> > > stereo and Lambert conf grids I believe). If you’re using
those
> >> > > projections, I would recommend adding it.
> >> > >
> >> > > John
> >> > >
> >> > > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT
<met_help at ucar.edu
> >
> >> > > wrote:
> >> > >
> >> > > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >> > > >
> >> > > >
> >> > > >
> >> > > > Hi Ed,
> >> > > >
> >> > > > John is out of the office today and tomorrow.  He'll be
back in
> the
> >> > > office
> >> > > >
> >> > > > on Monday, so please allow a few more business days for a
full
> >> > response.
> >> > > >
> >> > > >
> >> > > >
> >> > > > Regards,
> >> > > >
> >> > > > Minna
> >> > > >
> >> > > > ---------------
> >> > > >
> >> > > > Minna Win
> >> > > >
> >> > > > National Center for Atmospheric Research
> >> > > >
> >> > > > Developmental Testbed Center
> >> > > >
> >> > > > Phone: 303-497-8423
> >> > > >
> >> > > > Fax:   303-497-8401
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA
Affiliate
> via
> >> > RT <
> >> > > >
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > I did have one follow up question.  I copied the contents
of the
> >> > > >
> >> > > > > read_PostProcessed_WRF.py file and adjusted to match what
I
> needed
> >> > for
> >> > > my
> >> > > >
> >> > > > > purpose.  When I run plot_data_plane I get an indication
that it
> >> was
> >> > > >
> >> > > > > successful:
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
> >> PYTHON_NUMPY
> >> > > > hpbl.ps
> >> > > >
> >> > > > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc
PBL";'
> >> > > >
> >> > > > > DEBUG 1: Opening data file: PYTHON_NUMPY
> >> > > >
> >> > > > > Input File: 'aqm.t12z.metcro2d.19.nc'
> >> > > >
> >> > > > > Variable: 'PBL'
> >> > > >
> >> > > > > Data Shape: (265, 442)
> >> > > >
> >> > > > > Data Type:  dtype('float64')
> >> > > >
> >> > > > > *Attributes: {'valid': '20200804_070000', 'init':
> >> '20200803_120000',
> >> > > >
> >> > > > > 'lead': '19', 'accum': '00', 'name': 'PBL', 'long_name':
'PBL',
> >> > > 'level':
> >> > > >
> >> > > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert
Conformal',
> >> > 'name':
> >> > > >
> >> > > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
> >> 'scale_lat_2':
> >> > > > 45.0,
> >> > > >
> >> > > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0,
'y_pin':
> >> 0.0,
> >> > > >
> >> > > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2, 'nx':
442,
> >> 'ny':
> >> > > > 265}}*
> >> > > >
> >> > > > > *DEBUG 1: Creating postscript file: hpbl.ps
<http://hpbl.ps>*
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > You can see that the postscript file has been created.  I
had to
> >> > adjust
> >> > > > the
> >> > > >
> >> > > > > read_PostProcessed.py contents upon copying it over.  I
> originally
> >> > did
> >> > > > not
> >> > > >
> >> > > > > have the "accum", "hemisphere", or "name" attributes.
After
> >> adding
> >> > > those
> >> > > >
> >> > > > > in plot_data_plane was successful.  Those added
attributes are
> not
> >> > part
> >> > > > of
> >> > > >
> >> > > > > the attribute list in the netcdf file.  My netcdf file
only
> >> includes
> >> > > > these
> >> > > >
> >> > > > > attributes:
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > *root group (NETCDF4 data model, file format HDF5):
> >> FileOrigins:
> >> > NA
> >> > > >
> >> > > > > MET_version: V9.1    MET_tool: gen_vx_mask    Projection:
> Lambert
> >> > > >
> >> > > > > Conformal    scale_lat_1: 33.000000    scale_lat_2:
45.000000
> >> > > lat_pin:
> >> > > >
> >> > > > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000
y_pin:
> >> > 0.000000
> >> > > >
> >> > > > > lon_orient: -97.000000    d_km: 12.000000    r_km:
6371.200000
> >> nx:
> >> > > 442
> >> > > >
> >> > > > >   ny: 265 grid_points    dimensions(sizes): lon(265),
lat(442)
> >> > > >
> >> > > > > variables(dimensions): float32 LAT(lon,lat), float32
> LON(lon,lat),
> >> > > > float32
> >> > > >
> >> > > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32
PBL(lon,lat)
> >> > groups: *
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > You can see that most of them are there.  My
understanding is
> that
> >> > the
> >> > > >
> >> > > > > postscript file contains the contents used for the
postscript
> >> > image.  I
> >> > > >
> >> > > > > thought that an image would have been generated as well.
Should
> >> > there
> >> > > > be a
> >> > > >
> >> > > > > .png file generated as well?  Does this exercise of
running
> >> > > > plot_data_plane
> >> > > >
> >> > > > > indicate what might be missing in my attribute list that
would
> >> need
> >> > to
> >> > > be
> >> > > >
> >> > > > > included (e.g. does name, accum, and hemisphere need to
be
> >> > included?)?
> >> > > >
> >> > > > > Also I had to change how valid and initial times were
extracted.
> >> > They
> >> > > > are
> >> > > >
> >> > > > > being written in this way instead:
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > *>>> f.variables[var_name]<class
> >> 'netCDF4._netCDF4.Variable'>float32
> >> > > >
> >> > > > > PBL(lon, lat)    long_name: PBL    standard_name:
Planetary
> >> Boundary
> >> > > > Layer
> >> > > >
> >> > > > > Height    units: m    level: L0    init_time:
20200804_060000
> >> > > >
> >> > > > > init_time_ut: 1596520800    valid_time: 20200805_170000
> >> > > valid_time_ut:
> >> > > >
> >> > > > > 1596646800*
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > Do I need to adjust my attribute meta data to include the
> initial
> >> and
> >> > > > valid
> >> > > >
> >> > > > > times rather than lumping them under the field name?
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA
> Affiliate <
> >> > > >
> >> > > > > edward.strobach at noaa.gov> wrote:
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > > Thanks John, I'll go ahead take a look at those
resources
> >> > > >
> >> > > > > >
> >> > > >
> >> > > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway via
RT <
> >> > > >
> >> > > > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > > >
> >> > > >
> >> > > > > >> Ed,
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> Sounds great. FYI, here are some examples of using
python
> >> > embedding:
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> All these examples are for calling the plot_data_plane
tool
> >> since
> >> > > >
> >> > > > > that's a
> >> > > >
> >> > > > > >> great way to get started. Plot the data to make sure
that its
> >> what
> >> > > you
> >> > > >
> >> > > > > >> expect and oriented correctly. I imagine we'll want a
python
> >> > script
> >> > > > that
> >> > > >
> >> > > > > >> takes at least 2 arguments... the name of the NetCDF
file and
> >> the
> >> > > >
> >> > > > > variable
> >> > > >
> >> > > > > >> you want from it. Something like this example from
that page:
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> Plot the PSFC variable from a post-processed WRF
output file
> >> on a
> >> > > >
> >> > > > > Lambert
> >> > > >
> >> > > > > >> Conformal projection:
> >> > > >
> >> > > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> >> > > >
> >> > > > > >> <
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >>  'name="read_PostProcessed_WRF.py
> >> > > >
> >> > > > > >> <
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >>   2004-09-01_04-00-00.nc
> >> > > >
> >> > > > > >> <
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >>  PSFC";'
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> Hopefully it won't be too difficult to adapt one of
these
> >> scripts
> >> > to
> >> > > >
> >> > > > > work
> >> > > >
> >> > > > > >> with your particular dataset. I'd encourage you to try
> >> yourself,
> >> > but
> >> > > > if
> >> > > >
> >> > > > > >> you
> >> > > >
> >> > > > > >> run into issues or don't know where to start, we can
help
> too.
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> Thanks,
> >> > > >
> >> > > > > >> John
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach - NOAA
> >> Affiliate
> >> > via
> >> > > > RT
> >> > > >
> >> > > > > <
> >> > > >
> >> > > > > >> met_help at ucar.edu> wrote:
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > Hi John,
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > I imagine you guys are pretty swamped, especially
with so
> >> many
> >> > > more
> >> > > >
> >> > > > > >> people
> >> > > >
> >> > > > > >> > now using met and metplus.
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > The option that you are proposing sounds better to
me.  I
> >> might
> >> > be
> >> > > >
> >> > > > > able
> >> > > >
> >> > > > > >> to
> >> > > >
> >> > > > > >> > regain access by Thursday.  I'll make sure to post
those
> >> items
> >> > > then.
> >> > > >
> >> > > > > >> I'll
> >> > > >
> >> > > > > >> > stand by to receive your instructions whenever you
get some
> >> > time.
> >> > > >
> >> > > > > >> Thanks a
> >> > > >
> >> > > > > >> > lot!
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway
via RT <
> >> > > >
> >> > > > > >> > met_help at ucar.edu>
> >> > > >
> >> > > > > >> > wrote:
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > > Ed,
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > Sorry for the delay in getting to this issue. We
were
> busy
> >> > > > preparing
> >> > > >
> >> > > > > >> for
> >> > > >
> >> > > > > >> > > the met-9.1 release. I see you are running a
script from
> >> Logan
> >> > > to
> >> > > >
> >> > > > > >> > reformat
> >> > > >
> >> > > > > >> > > some NetCDF data for use in MET... but are running
into
> >> some
> >> > > >
> >> > > > > sporadic
> >> > > >
> >> > > > > >> > > issues.
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > I believe that WCOSS is unavailable this week, so
I'm not
> >> able
> >> > > to
> >> > > > go
> >> > > >
> >> > > > > >> > take a
> >> > > >
> >> > > > > >> > > closer look at your data right now.
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > But I'm wondering if you'd consider using python
> embedding
> >> to
> >> > > > solve
> >> > > >
> >> > > > > >> this
> >> > > >
> >> > > > > >> > > issue instead of reformatting these files? With
this
> >> approach,
> >> > > we
> >> > > >
> >> > > > > >> write a
> >> > > >
> >> > > > > >> > > python script to tell MET how to read data from
these
> >> native
> >> > > > NetCDF
> >> > > >
> >> > > > > >> files
> >> > > >
> >> > > > > >> > > rather than reformatting them and essentially
duplicating
> >> the
> >> > > > data.
> >> > > >
> >> > > > > >> But
> >> > > >
> >> > > > > >> > > it's up to you... I'm sure these problems could be
solved
> >> with
> >> > > >
> >> > > > > either
> >> > > >
> >> > > > > >> > > approach. Python-embedding has the advantage of
not
> >> > duplicating
> >> > > > the
> >> > > >
> >> > > > > >> data
> >> > > >
> >> > > > > >> > on
> >> > > >
> >> > > > > >> > > disk.
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > Just let me know how you'd like to proceed. If you
are
> >> able to
> >> > > > gain
> >> > > >
> >> > > > > >> > access
> >> > > >
> >> > > > > >> > > to WCOSS and pull a sample data file, as well as
your
> >> > > reformatting
> >> > > >
> >> > > > > >> > script,
> >> > > >
> >> > > > > >> > > please post them to our anonymous ftp site
following
> these
> >> > > >
> >> > > > > >> instructions:
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > Thanks,
> >> > > >
> >> > > > > >> > > John
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT <
> >> > > > met_help at ucar.edu>
> >> > > >
> >> > > > > >> > wrote:
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > >
> >> > > >
> >> > > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was
acted upon.
> >> > > >
> >> > > > > >> > > > Transaction: Given to johnhg (John Halley
Gotway) by
> >> > minnawin
> >> > > >
> >> > > > > >> > > >        Queue: met_help
> >> > > >
> >> > > > > >> > > >      Subject: Issues processing CF compliant
netcdf
> files
> >> > > >
> >> > > > > >> > > >        Owner: johnhg
> >> > > >
> >> > > > > >> > > >   Requestors: edward.strobach at noaa.gov
> >> > > >
> >> > > > > >> > > >       Status: open
> >> > > >
> >> > > > > >> > > >  Ticket <URL:
> >> > > >
> >> > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > > >
> >> > > >
> >> > > > > >> > > >
> >> > > >
> >> > > > > >> > > > This transaction appears to have no content
> >> > > >
> >> > > > > >> > > >
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> > >
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> > --
> >> > > >
> >> > > > > >> > Edward Strobach
> >> > > >
> >> > > > > >> > EMC/NCEP/NWS/
> >> > > >
> >> > > > > >> > IMSG Contractor
> >> > > >
> >> > > > > >> > Cubicle#: 2029
> >> > > >
> >> > > > > >> > 301-683-3717
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >> >
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >>
> >> > > >
> >> > > > > >
> >> > > >
> >> > > > > > --
> >> > > >
> >> > > > > > Edward Strobach
> >> > > >
> >> > > > > > EMC/NCEP/NWS/
> >> > > >
> >> > > > > > IMSG Contractor
> >> > > >
> >> > > > > > Cubicle#: 2029
> >> > > >
> >> > > > > > 301-683-3717
> >> > > >
> >> > > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > > > --
> >> > > >
> >> > > > > Edward Strobach
> >> > > >
> >> > > > > EMC/NCEP/NWS/
> >> > > >
> >> > > > > IMSG Contractor
> >> > > >
> >> > > > > Cubicle#: 2029
> >> > > >
> >> > > > > 301-683-3717
> >> > > >
> >> > > > >
> >> > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> > --
> >> > Edward Strobach
> >> > EMC/NCEP/NWS/
> >> > IMSG Contractor
> >> > Cubicle#: 2029
> >> > 301-683-3717
> >> >
> >> >
> >>
> >>
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
>
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Mon Aug 17 15:49:13 2020

Hi John,

I think I'm fine, so you can close the ticket.  However, I do have one
question about writing pressure levels out in a netcdf file. In the
metadata structure, can I write the *.level for a variable like so:
[P1000, P950, P900,.....,P200]?  I just want to make sure that Met
would be
able to pick out these levels when specifying which levels I want to
process in the configuration file. Thanks!

On Mon, Aug 17, 2020 at 5:42 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:

> Ed,
>
> Great, glad you were able to make progress. Are there any issues
remaining
> on this ticket, or should I go ahead and resolve it?
>
> Thanks,
> John
>
> On Fri, Aug 14, 2020 at 4:45 AM Edward Strobach - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> > Hi John,
> >
> > I managed to resolve the issue and was able to make some positive
changes
> > through studying this error closely online:
> >
> >
> > *terminate called after throwing an instance of
> > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count exceeds
> > dimension bound*
> >
> > Although not clear from the outset, the "Start+count exceeds
dimension
> > bound" stood out in particular such that I decided to change
around my nx
> > and ny values within the meta data script.  Now I have populated
stat
> files
> > being generated.  I plan to add fields into this step with the
hope of
> > storing all the fields I need to process for verification.
> >
> >
> > On Thu, Aug 13, 2020 at 1:54 PM Edward Strobach - NOAA Affiliate <
> > edward.strobach at noaa.gov> wrote:
> >
> > > Sounds good.  Enjoy your time off.  I may try a couple of things
in the
> > > meantime
> > >
> > > On Thu, Aug 13, 2020 at 1:52 PM John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Ed,
> > >>
> > >> OK, and we'll need that NetCDF file for testing. Hopefully,
WCOSS will
> > be
> > >> accessible on Monday, and I can take a look then when I get
back in
> > town.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA
Affiliate via
> > RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
> > >> >
> > >> > Thanks.  I do get an image when running that step.  The PBL
height
> has
> > >> > reasonable values and is enhanced in regions of convection.
It's
> nice
> > >> to
> > >> > know that I can process the data from the netcdf files I
generated
> > using
> > >> > plot_data_plane and that the results are reasonable; however,
I'm
> > >> wondering
> > >> > how this resolves issue I'm having related to the original
error:
> > >> >
> > >> >
> > >> >
> > >> >
> > >> >
> > >> > *terminate called after throwing an instance of
> > >> > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds
> > >> > dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
> > >> > metplus.PointStat (command_runner.py:191) DEBUG: Finished
running
> > >> >
> > >> >
> > >>
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> > >> > in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> > >> > (command_builder.py:100) ERROR: (command_builder.py:733) M*
> > >> >
> > >> >
> > >> > I wasn't able to interpret much from this error when reading
about
> it
> > >> > online
> > >> > <https://github.com/NCAR/MET/issues/1139>.  Is the point of
the
> > >> exercise
> > >> > to
> > >> > show that my files could be processed, but that there's
something
> > >> > potentially wrong with the attribute settings in the netcdf
file
> that
> > is
> > >> > preventing me from moving beyond the error listed above?
Forgive
> me,
> > >> I'm
> > >> > just trying to connect the two.
> > >> >
> > >> > On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > > Ed,
> > >> > >
> > >> > > The plot_data_plane tool generates a Postscript output
file. That
> is
> > >> an
> > >> > > image. It does not generate PNG output. However it’s pretty
easy
> to
> > >> > convert
> > >> > > .ps to .png. I always do so prior to sending them as
attachments
> via
> > >> > > met_help just because the png files are so much smaller.
> > >> > >
> > >> > > I use the ImageMagick convert command:
> > >> > >
> > >> > > convert -rotate 90 -background white image.ps image.png
> > >> > >
> > >> > > As for hemisphere, accum, and name. I don’t think they are
> > required...
> > >> > > without hemisphere I believe the code assumes North (only
applies
> to
> > >> > polar
> > >> > > stereo and Lambert conf grids I believe). If you’re using
those
> > >> > > projections, I would recommend adding it.
> > >> > >
> > >> > > John
> > >> > >
> > >> > > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT <
> met_help at ucar.edu
> > >
> > >> > > wrote:
> > >> > >
> > >> > > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > Hi Ed,
> > >> > > >
> > >> > > > John is out of the office today and tomorrow.  He'll be
back in
> > the
> > >> > > office
> > >> > > >
> > >> > > > on Monday, so please allow a few more business days for a
full
> > >> > response.
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > Regards,
> > >> > > >
> > >> > > > Minna
> > >> > > >
> > >> > > > ---------------
> > >> > > >
> > >> > > > Minna Win
> > >> > > >
> > >> > > > National Center for Atmospheric Research
> > >> > > >
> > >> > > > Developmental Testbed Center
> > >> > > >
> > >> > > > Phone: 303-497-8423
> > >> > > >
> > >> > > > Fax:   303-497-8401
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA
Affiliate
> > via
> > >> > RT <
> > >> > > >
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > I did have one follow up question.  I copied the
contents of
> the
> > >> > > >
> > >> > > > > read_PostProcessed_WRF.py file and adjusted to match
what I
> > needed
> > >> > for
> > >> > > my
> > >> > > >
> > >> > > > > purpose.  When I run plot_data_plane I get an
indication that
> it
> > >> was
> > >> > > >
> > >> > > > > successful:
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
> > >> PYTHON_NUMPY
> > >> > > > hpbl.ps
> > >> > > >
> > >> > > > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc
PBL";'
> > >> > > >
> > >> > > > > DEBUG 1: Opening data file: PYTHON_NUMPY
> > >> > > >
> > >> > > > > Input File: 'aqm.t12z.metcro2d.19.nc'
> > >> > > >
> > >> > > > > Variable: 'PBL'
> > >> > > >
> > >> > > > > Data Shape: (265, 442)
> > >> > > >
> > >> > > > > Data Type:  dtype('float64')
> > >> > > >
> > >> > > > > *Attributes: {'valid': '20200804_070000', 'init':
> > >> '20200803_120000',
> > >> > > >
> > >> > > > > 'lead': '19', 'accum': '00', 'name': 'PBL',
'long_name':
> 'PBL',
> > >> > > 'level':
> > >> > > >
> > >> > > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert
Conformal',
> > >> > 'name':
> > >> > > >
> > >> > > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1': 33.0,
> > >> 'scale_lat_2':
> > >> > > > 45.0,
> > >> > > >
> > >> > > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0,
'y_pin':
> > >> 0.0,
> > >> > > >
> > >> > > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2,
'nx': 442,
> > >> 'ny':
> > >> > > > 265}}*
> > >> > > >
> > >> > > > > *DEBUG 1: Creating postscript file: hpbl.ps
<http://hpbl.ps>*
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > You can see that the postscript file has been created.
I had
> to
> > >> > adjust
> > >> > > > the
> > >> > > >
> > >> > > > > read_PostProcessed.py contents upon copying it over.  I
> > originally
> > >> > did
> > >> > > > not
> > >> > > >
> > >> > > > > have the "accum", "hemisphere", or "name" attributes.
After
> > >> adding
> > >> > > those
> > >> > > >
> > >> > > > > in plot_data_plane was successful.  Those added
attributes are
> > not
> > >> > part
> > >> > > > of
> > >> > > >
> > >> > > > > the attribute list in the netcdf file.  My netcdf file
only
> > >> includes
> > >> > > > these
> > >> > > >
> > >> > > > > attributes:
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > *root group (NETCDF4 data model, file format HDF5):
> > >> FileOrigins:
> > >> > NA
> > >> > > >
> > >> > > > > MET_version: V9.1    MET_tool: gen_vx_mask
Projection:
> > Lambert
> > >> > > >
> > >> > > > > Conformal    scale_lat_1: 33.000000    scale_lat_2:
45.000000
> > >> > > lat_pin:
> > >> > > >
> > >> > > > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000
y_pin:
> > >> > 0.000000
> > >> > > >
> > >> > > > > lon_orient: -97.000000    d_km: 12.000000    r_km:
6371.200000
> > >> nx:
> > >> > > 442
> > >> > > >
> > >> > > > >   ny: 265 grid_points    dimensions(sizes): lon(265),
lat(442)
> > >> > > >
> > >> > > > > variables(dimensions): float32 LAT(lon,lat), float32
> > LON(lon,lat),
> > >> > > > float32
> > >> > > >
> > >> > > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32
PBL(lon,lat)
> > >> > groups: *
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > You can see that most of them are there.  My
understanding is
> > that
> > >> > the
> > >> > > >
> > >> > > > > postscript file contains the contents used for the
postscript
> > >> > image.  I
> > >> > > >
> > >> > > > > thought that an image would have been generated as
well.
> Should
> > >> > there
> > >> > > > be a
> > >> > > >
> > >> > > > > .png file generated as well?  Does this exercise of
running
> > >> > > > plot_data_plane
> > >> > > >
> > >> > > > > indicate what might be missing in my attribute list
that would
> > >> need
> > >> > to
> > >> > > be
> > >> > > >
> > >> > > > > included (e.g. does name, accum, and hemisphere need to
be
> > >> > included?)?
> > >> > > >
> > >> > > > > Also I had to change how valid and initial times were
> extracted.
> > >> > They
> > >> > > > are
> > >> > > >
> > >> > > > > being written in this way instead:
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > *>>> f.variables[var_name]<class
> > >> 'netCDF4._netCDF4.Variable'>float32
> > >> > > >
> > >> > > > > PBL(lon, lat)    long_name: PBL    standard_name:
Planetary
> > >> Boundary
> > >> > > > Layer
> > >> > > >
> > >> > > > > Height    units: m    level: L0    init_time:
20200804_060000
> > >> > > >
> > >> > > > > init_time_ut: 1596520800    valid_time: 20200805_170000
> > >> > > valid_time_ut:
> > >> > > >
> > >> > > > > 1596646800*
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > Do I need to adjust my attribute meta data to include
the
> > initial
> > >> and
> > >> > > > valid
> > >> > > >
> > >> > > > > times rather than lumping them under the field name?
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach - NOAA
> > Affiliate <
> > >> > > >
> > >> > > > > edward.strobach at noaa.gov> wrote:
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > > Thanks John, I'll go ahead take a look at those
resources
> > >> > > >
> > >> > > > > >
> > >> > > >
> > >> > > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway
via RT <
> > >> > > >
> > >> > > > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > > >
> > >> > > >
> > >> > > > > >> Ed,
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> Sounds great. FYI, here are some examples of using
python
> > >> > embedding:
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> All these examples are for calling the
plot_data_plane tool
> > >> since
> > >> > > >
> > >> > > > > that's a
> > >> > > >
> > >> > > > > >> great way to get started. Plot the data to make sure
that
> its
> > >> what
> > >> > > you
> > >> > > >
> > >> > > > > >> expect and oriented correctly. I imagine we'll want
a
> python
> > >> > script
> > >> > > > that
> > >> > > >
> > >> > > > > >> takes at least 2 arguments... the name of the NetCDF
file
> and
> > >> the
> > >> > > >
> > >> > > > > variable
> > >> > > >
> > >> > > > > >> you want from it. Something like this example from
that
> page:
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> Plot the PSFC variable from a post-processed WRF
output
> file
> > >> on a
> > >> > > >
> > >> > > > > Lambert
> > >> > > >
> > >> > > > > >> Conformal projection:
> > >> > > >
> > >> > > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> > >> > > >
> > >> > > > > >> <
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >>  'name="read_PostProcessed_WRF.py
> > >> > > >
> > >> > > > > >> <
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >>   2004-09-01_04-00-00.nc
> > >> > > >
> > >> > > > > >> <
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >>  PSFC";'
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> Hopefully it won't be too difficult to adapt one of
these
> > >> scripts
> > >> > to
> > >> > > >
> > >> > > > > work
> > >> > > >
> > >> > > > > >> with your particular dataset. I'd encourage you to
try
> > >> yourself,
> > >> > but
> > >> > > > if
> > >> > > >
> > >> > > > > >> you
> > >> > > >
> > >> > > > > >> run into issues or don't know where to start, we can
help
> > too.
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> Thanks,
> > >> > > >
> > >> > > > > >> John
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach -
NOAA
> > >> Affiliate
> > >> > via
> > >> > > > RT
> > >> > > >
> > >> > > > > <
> > >> > > >
> > >> > > > > >> met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > Hi John,
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > I imagine you guys are pretty swamped, especially
with so
> > >> many
> > >> > > more
> > >> > > >
> > >> > > > > >> people
> > >> > > >
> > >> > > > > >> > now using met and metplus.
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > The option that you are proposing sounds better to
me.  I
> > >> might
> > >> > be
> > >> > > >
> > >> > > > > able
> > >> > > >
> > >> > > > > >> to
> > >> > > >
> > >> > > > > >> > regain access by Thursday.  I'll make sure to post
those
> > >> items
> > >> > > then.
> > >> > > >
> > >> > > > > >> I'll
> > >> > > >
> > >> > > > > >> > stand by to receive your instructions whenever you
get
> some
> > >> > time.
> > >> > > >
> > >> > > > > >> Thanks a
> > >> > > >
> > >> > > > > >> > lot!
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley Gotway
via
> RT <
> > >> > > >
> > >> > > > > >> > met_help at ucar.edu>
> > >> > > >
> > >> > > > > >> > wrote:
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > > Ed,
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > Sorry for the delay in getting to this issue. We
were
> > busy
> > >> > > > preparing
> > >> > > >
> > >> > > > > >> for
> > >> > > >
> > >> > > > > >> > > the met-9.1 release. I see you are running a
script
> from
> > >> Logan
> > >> > > to
> > >> > > >
> > >> > > > > >> > reformat
> > >> > > >
> > >> > > > > >> > > some NetCDF data for use in MET... but are
running into
> > >> some
> > >> > > >
> > >> > > > > sporadic
> > >> > > >
> > >> > > > > >> > > issues.
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > I believe that WCOSS is unavailable this week,
so I'm
> not
> > >> able
> > >> > > to
> > >> > > > go
> > >> > > >
> > >> > > > > >> > take a
> > >> > > >
> > >> > > > > >> > > closer look at your data right now.
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > But I'm wondering if you'd consider using python
> > embedding
> > >> to
> > >> > > > solve
> > >> > > >
> > >> > > > > >> this
> > >> > > >
> > >> > > > > >> > > issue instead of reformatting these files? With
this
> > >> approach,
> > >> > > we
> > >> > > >
> > >> > > > > >> write a
> > >> > > >
> > >> > > > > >> > > python script to tell MET how to read data from
these
> > >> native
> > >> > > > NetCDF
> > >> > > >
> > >> > > > > >> files
> > >> > > >
> > >> > > > > >> > > rather than reformatting them and essentially
> duplicating
> > >> the
> > >> > > > data.
> > >> > > >
> > >> > > > > >> But
> > >> > > >
> > >> > > > > >> > > it's up to you... I'm sure these problems could
be
> solved
> > >> with
> > >> > > >
> > >> > > > > either
> > >> > > >
> > >> > > > > >> > > approach. Python-embedding has the advantage of
not
> > >> > duplicating
> > >> > > > the
> > >> > > >
> > >> > > > > >> data
> > >> > > >
> > >> > > > > >> > on
> > >> > > >
> > >> > > > > >> > > disk.
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > Just let me know how you'd like to proceed. If
you are
> > >> able to
> > >> > > > gain
> > >> > > >
> > >> > > > > >> > access
> > >> > > >
> > >> > > > > >> > > to WCOSS and pull a sample data file, as well as
your
> > >> > > reformatting
> > >> > > >
> > >> > > > > >> > script,
> > >> > > >
> > >> > > > > >> > > please post them to our anonymous ftp site
following
> > these
> > >> > > >
> > >> > > > > >> instructions:
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > Thanks,
> > >> > > >
> > >> > > > > >> > > John
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via RT
<
> > >> > > > met_help at ucar.edu>
> > >> > > >
> > >> > > > > >> > wrote:
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > >
> > >> > > >
> > >> > > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was
acted
> upon.
> > >> > > >
> > >> > > > > >> > > > Transaction: Given to johnhg (John Halley
Gotway) by
> > >> > minnawin
> > >> > > >
> > >> > > > > >> > > >        Queue: met_help
> > >> > > >
> > >> > > > > >> > > >      Subject: Issues processing CF compliant
netcdf
> > files
> > >> > > >
> > >> > > > > >> > > >        Owner: johnhg
> > >> > > >
> > >> > > > > >> > > >   Requestors: edward.strobach at noaa.gov
> > >> > > >
> > >> > > > > >> > > >       Status: open
> > >> > > >
> > >> > > > > >> > > >  Ticket <URL:
> > >> > > >
> > >> > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > > >
> > >> > > >
> > >> > > > > >> > > >
> > >> > > >
> > >> > > > > >> > > > This transaction appears to have no content
> > >> > > >
> > >> > > > > >> > > >
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> > >
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> > --
> > >> > > >
> > >> > > > > >> > Edward Strobach
> > >> > > >
> > >> > > > > >> > EMC/NCEP/NWS/
> > >> > > >
> > >> > > > > >> > IMSG Contractor
> > >> > > >
> > >> > > > > >> > Cubicle#: 2029
> > >> > > >
> > >> > > > > >> > 301-683-3717
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >> >
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >>
> > >> > > >
> > >> > > > > >
> > >> > > >
> > >> > > > > > --
> > >> > > >
> > >> > > > > > Edward Strobach
> > >> > > >
> > >> > > > > > EMC/NCEP/NWS/
> > >> > > >
> > >> > > > > > IMSG Contractor
> > >> > > >
> > >> > > > > > Cubicle#: 2029
> > >> > > >
> > >> > > > > > 301-683-3717
> > >> > > >
> > >> > > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > > --
> > >> > > >
> > >> > > > > Edward Strobach
> > >> > > >
> > >> > > > > EMC/NCEP/NWS/
> > >> > > >
> > >> > > > > IMSG Contractor
> > >> > > >
> > >> > > > > Cubicle#: 2029
> > >> > > >
> > >> > > > > 301-683-3717
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> > --
> > >> > Edward Strobach
> > >> > EMC/NCEP/NWS/
> > >> > IMSG Contractor
> > >> > Cubicle#: 2029
> > >> > 301-683-3717
> > >> >
> > >> >
> > >>
> > >>
> > >
> > > --
> > > Edward Strobach
> > > EMC/NCEP/NWS/
> > > IMSG Contractor
> > > Cubicle#: 2029
> > > 301-683-3717
> > >
> >
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
> >
>
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: John Halley Gotway
Time: Mon Aug 17 17:18:01 2020

Ed,

I think the answer is yes. In the MET configuration files, you can
specify
that multiple levels be processed like this:

name = "TMP";
level = [ "P1000", "P950", "P900" ]; // and so on

The code automatically expands this to 3 fields: TMP at 1000mb, TMP at
950
mb, and TMP at 900mb.

Is that what you were asking?

Thanks,
John

On Mon, Aug 17, 2020 at 3:49 PM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
>
> Hi John,
>
> I think I'm fine, so you can close the ticket.  However, I do have
one
> question about writing pressure levels out in a netcdf file. In the
> metadata structure, can I write the *.level for a variable like so:
> [P1000, P950, P900,.....,P200]?  I just want to make sure that Met
would be
> able to pick out these levels when specifying which levels I want to
> process in the configuration file. Thanks!
>
> On Mon, Aug 17, 2020 at 5:42 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Ed,
> >
> > Great, glad you were able to make progress. Are there any issues
> remaining
> > on this ticket, or should I go ahead and resolve it?
> >
> > Thanks,
> > John
> >
> > On Fri, Aug 14, 2020 at 4:45 AM Edward Strobach - NOAA Affiliate
via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > >
> > > Hi John,
> > >
> > > I managed to resolve the issue and was able to make some
positive
> changes
> > > through studying this error closely online:
> > >
> > >
> > > *terminate called after throwing an instance of
> > > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds
> > > dimension bound*
> > >
> > > Although not clear from the outset, the "Start+count exceeds
dimension
> > > bound" stood out in particular such that I decided to change
around my
> nx
> > > and ny values within the meta data script.  Now I have populated
stat
> > files
> > > being generated.  I plan to add fields into this step with the
hope of
> > > storing all the fields I need to process for verification.
> > >
> > >
> > > On Thu, Aug 13, 2020 at 1:54 PM Edward Strobach - NOAA Affiliate
<
> > > edward.strobach at noaa.gov> wrote:
> > >
> > > > Sounds good.  Enjoy your time off.  I may try a couple of
things in
> the
> > > > meantime
> > > >
> > > > On Thu, Aug 13, 2020 at 1:52 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Ed,
> > > >>
> > > >> OK, and we'll need that NetCDF file for testing. Hopefully,
WCOSS
> will
> > > be
> > > >> accessible on Monday, and I can take a look then when I get
back in
> > > town.
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA
Affiliate
> via
> > > RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > > >> >
> > > >> > Thanks.  I do get an image when running that step.  The PBL
height
> > has
> > > >> > reasonable values and is enhanced in regions of convection.
It's
> > nice
> > > >> to
> > > >> > know that I can process the data from the netcdf files I
generated
> > > using
> > > >> > plot_data_plane and that the results are reasonable;
however, I'm
> > > >> wondering
> > > >> > how this resolves issue I'm having related to the original
error:
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> > *terminate called after throwing an instance of
> > > >> > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds
> > > >> > dimension boundfile: ncVar.cpp  line:161408/07 01:44:55.554
> > > >> > metplus.PointStat (command_runner.py:191) DEBUG: Finished
running
> > > >> >
> > > >> >
> > > >>
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> > > >> > in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> > > >> > (command_builder.py:100) ERROR: (command_builder.py:733) M*
> > > >> >
> > > >> >
> > > >> > I wasn't able to interpret much from this error when
reading about
> > it
> > > >> > online
> > > >> > <https://github.com/NCAR/MET/issues/1139>.  Is the point of
the
> > > >> exercise
> > > >> > to
> > > >> > show that my files could be processed, but that there's
something
> > > >> > potentially wrong with the attribute settings in the netcdf
file
> > that
> > > is
> > > >> > preventing me from moving beyond the error listed above?
Forgive
> > me,
> > > >> I'm
> > > >> > just trying to connect the two.
> > > >> >
> > > >> > On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via RT
<
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> > > Ed,
> > > >> > >
> > > >> > > The plot_data_plane tool generates a Postscript output
file.
> That
> > is
> > > >> an
> > > >> > > image. It does not generate PNG output. However it’s
pretty easy
> > to
> > > >> > convert
> > > >> > > .ps to .png. I always do so prior to sending them as
attachments
> > via
> > > >> > > met_help just because the png files are so much smaller.
> > > >> > >
> > > >> > > I use the ImageMagick convert command:
> > > >> > >
> > > >> > > convert -rotate 90 -background white image.ps image.png
> > > >> > >
> > > >> > > As for hemisphere, accum, and name. I don’t think they
are
> > > required...
> > > >> > > without hemisphere I believe the code assumes North (only
> applies
> > to
> > > >> > polar
> > > >> > > stereo and Lambert conf grids I believe). If you’re using
those
> > > >> > > projections, I would recommend adding it.
> > > >> > >
> > > >> > > John
> > > >> > >
> > > >> > > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT <
> > met_help at ucar.edu
> > > >
> > > >> > > wrote:
> > > >> > >
> > > >> > > >
> > > >> > > >
> > > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > Hi Ed,
> > > >> > > >
> > > >> > > > John is out of the office today and tomorrow.  He'll be
back
> in
> > > the
> > > >> > > office
> > > >> > > >
> > > >> > > > on Monday, so please allow a few more business days for
a full
> > > >> > response.
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > Regards,
> > > >> > > >
> > > >> > > > Minna
> > > >> > > >
> > > >> > > > ---------------
> > > >> > > >
> > > >> > > > Minna Win
> > > >> > > >
> > > >> > > > National Center for Atmospheric Research
> > > >> > > >
> > > >> > > > Developmental Testbed Center
> > > >> > > >
> > > >> > > > Phone: 303-497-8423
> > > >> > > >
> > > >> > > > Fax:   303-497-8401
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach - NOAA
> Affiliate
> > > via
> > > >> > RT <
> > > >> > > >
> > > >> > > > met_help at ucar.edu> wrote:
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > I did have one follow up question.  I copied the
contents of
> > the
> > > >> > > >
> > > >> > > > > read_PostProcessed_WRF.py file and adjusted to match
what I
> > > needed
> > > >> > for
> > > >> > > my
> > > >> > > >
> > > >> > > > > purpose.  When I run plot_data_plane I get an
indication
> that
> > it
> > > >> was
> > > >> > > >
> > > >> > > > > successful:
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > [Edward.Strobach at m71a2 aqm.20200803]$ plot_data_plane
> > > >> PYTHON_NUMPY
> > > >> > > > hpbl.ps
> > > >> > > >
> > > >> > > > > 'name="read_PostProcessed.py aqm.t12z.metcro2d.19.nc
PBL";'
> > > >> > > >
> > > >> > > > > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > >> > > >
> > > >> > > > > Input File: 'aqm.t12z.metcro2d.19.nc'
> > > >> > > >
> > > >> > > > > Variable: 'PBL'
> > > >> > > >
> > > >> > > > > Data Shape: (265, 442)
> > > >> > > >
> > > >> > > > > Data Type:  dtype('float64')
> > > >> > > >
> > > >> > > > > *Attributes: {'valid': '20200804_070000', 'init':
> > > >> '20200803_120000',
> > > >> > > >
> > > >> > > > > 'lead': '19', 'accum': '00', 'name': 'PBL',
'long_name':
> > 'PBL',
> > > >> > > 'level':
> > > >> > > >
> > > >> > > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert
> Conformal',
> > > >> > 'name':
> > > >> > > >
> > > >> > > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1':
33.0,
> > > >> 'scale_lat_2':
> > > >> > > > 45.0,
> > > >> > > >
> > > >> > > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin': 0.0,
> 'y_pin':
> > > >> 0.0,
> > > >> > > >
> > > >> > > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2,
'nx':
> 442,
> > > >> 'ny':
> > > >> > > > 265}}*
> > > >> > > >
> > > >> > > > > *DEBUG 1: Creating postscript file: hpbl.ps
<http://hpbl.ps
> >*
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > You can see that the postscript file has been
created.  I
> had
> > to
> > > >> > adjust
> > > >> > > > the
> > > >> > > >
> > > >> > > > > read_PostProcessed.py contents upon copying it over.
I
> > > originally
> > > >> > did
> > > >> > > > not
> > > >> > > >
> > > >> > > > > have the "accum", "hemisphere", or "name" attributes.
After
> > > >> adding
> > > >> > > those
> > > >> > > >
> > > >> > > > > in plot_data_plane was successful.  Those added
attributes
> are
> > > not
> > > >> > part
> > > >> > > > of
> > > >> > > >
> > > >> > > > > the attribute list in the netcdf file.  My netcdf
file only
> > > >> includes
> > > >> > > > these
> > > >> > > >
> > > >> > > > > attributes:
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > *root group (NETCDF4 data model, file format HDF5):
> > > >> FileOrigins:
> > > >> > NA
> > > >> > > >
> > > >> > > > > MET_version: V9.1    MET_tool: gen_vx_mask
Projection:
> > > Lambert
> > > >> > > >
> > > >> > > > > Conformal    scale_lat_1: 33.000000    scale_lat_2:
> 45.000000
> > > >> > > lat_pin:
> > > >> > > >
> > > >> > > > > 21.821000    lon_pin: -120.628000    x_pin: 0.000000
> y_pin:
> > > >> > 0.000000
> > > >> > > >
> > > >> > > > > lon_orient: -97.000000    d_km: 12.000000    r_km:
> 6371.200000
> > > >> nx:
> > > >> > > 442
> > > >> > > >
> > > >> > > > >   ny: 265 grid_points    dimensions(sizes): lon(265),
> lat(442)
> > > >> > > >
> > > >> > > > > variables(dimensions): float32 LAT(lon,lat), float32
> > > LON(lon,lat),
> > > >> > > > float32
> > > >> > > >
> > > >> > > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32
PBL(lon,lat)
> > > >> > groups: *
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > You can see that most of them are there.  My
understanding
> is
> > > that
> > > >> > the
> > > >> > > >
> > > >> > > > > postscript file contains the contents used for the
> postscript
> > > >> > image.  I
> > > >> > > >
> > > >> > > > > thought that an image would have been generated as
well.
> > Should
> > > >> > there
> > > >> > > > be a
> > > >> > > >
> > > >> > > > > .png file generated as well?  Does this exercise of
running
> > > >> > > > plot_data_plane
> > > >> > > >
> > > >> > > > > indicate what might be missing in my attribute list
that
> would
> > > >> need
> > > >> > to
> > > >> > > be
> > > >> > > >
> > > >> > > > > included (e.g. does name, accum, and hemisphere need
to be
> > > >> > included?)?
> > > >> > > >
> > > >> > > > > Also I had to change how valid and initial times were
> > extracted.
> > > >> > They
> > > >> > > > are
> > > >> > > >
> > > >> > > > > being written in this way instead:
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > *>>> f.variables[var_name]<class
> > > >> 'netCDF4._netCDF4.Variable'>float32
> > > >> > > >
> > > >> > > > > PBL(lon, lat)    long_name: PBL    standard_name:
Planetary
> > > >> Boundary
> > > >> > > > Layer
> > > >> > > >
> > > >> > > > > Height    units: m    level: L0    init_time:
> 20200804_060000
> > > >> > > >
> > > >> > > > > init_time_ut: 1596520800    valid_time:
20200805_170000
> > > >> > > valid_time_ut:
> > > >> > > >
> > > >> > > > > 1596646800*
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > Do I need to adjust my attribute meta data to include
the
> > > initial
> > > >> and
> > > >> > > > valid
> > > >> > > >
> > > >> > > > > times rather than lumping them under the field name?
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach -
NOAA
> > > Affiliate <
> > > >> > > >
> > > >> > > > > edward.strobach at noaa.gov> wrote:
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > > Thanks John, I'll go ahead take a look at those
resources
> > > >> > > >
> > > >> > > > > >
> > > >> > > >
> > > >> > > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley Gotway
via
> RT <
> > > >> > > >
> > > >> > > > > > met_help at ucar.edu> wrote:
> > > >> > > >
> > > >> > > > > >
> > > >> > > >
> > > >> > > > > >> Ed,
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> Sounds great. FYI, here are some examples of using
python
> > > >> > embedding:
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> All these examples are for calling the
plot_data_plane
> tool
> > > >> since
> > > >> > > >
> > > >> > > > > that's a
> > > >> > > >
> > > >> > > > > >> great way to get started. Plot the data to make
sure that
> > its
> > > >> what
> > > >> > > you
> > > >> > > >
> > > >> > > > > >> expect and oriented correctly. I imagine we'll
want a
> > python
> > > >> > script
> > > >> > > > that
> > > >> > > >
> > > >> > > > > >> takes at least 2 arguments... the name of the
NetCDF file
> > and
> > > >> the
> > > >> > > >
> > > >> > > > > variable
> > > >> > > >
> > > >> > > > > >> you want from it. Something like this example from
that
> > page:
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> Plot the PSFC variable from a post-processed WRF
output
> > file
> > > >> on a
> > > >> > > >
> > > >> > > > > Lambert
> > > >> > > >
> > > >> > > > > >> Conformal projection:
> > > >> > > >
> > > >> > > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> > > >> > > >
> > > >> > > > > >> <
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >>  'name="read_PostProcessed_WRF.py
> > > >> > > >
> > > >> > > > > >> <
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >>   2004-09-01_04-00-00.nc
> > > >> > > >
> > > >> > > > > >> <
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >>  PSFC";'
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> Hopefully it won't be too difficult to adapt one
of these
> > > >> scripts
> > > >> > to
> > > >> > > >
> > > >> > > > > work
> > > >> > > >
> > > >> > > > > >> with your particular dataset. I'd encourage you to
try
> > > >> yourself,
> > > >> > but
> > > >> > > > if
> > > >> > > >
> > > >> > > > > >> you
> > > >> > > >
> > > >> > > > > >> run into issues or don't know where to start, we
can help
> > > too.
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> Thanks,
> > > >> > > >
> > > >> > > > > >> John
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach -
NOAA
> > > >> Affiliate
> > > >> > via
> > > >> > > > RT
> > > >> > > >
> > > >> > > > > <
> > > >> > > >
> > > >> > > > > >> met_help at ucar.edu> wrote:
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > <URL:
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > Hi John,
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > I imagine you guys are pretty swamped,
especially with
> so
> > > >> many
> > > >> > > more
> > > >> > > >
> > > >> > > > > >> people
> > > >> > > >
> > > >> > > > > >> > now using met and metplus.
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > The option that you are proposing sounds better
to
> me.  I
> > > >> might
> > > >> > be
> > > >> > > >
> > > >> > > > > able
> > > >> > > >
> > > >> > > > > >> to
> > > >> > > >
> > > >> > > > > >> > regain access by Thursday.  I'll make sure to
post
> those
> > > >> items
> > > >> > > then.
> > > >> > > >
> > > >> > > > > >> I'll
> > > >> > > >
> > > >> > > > > >> > stand by to receive your instructions whenever
you get
> > some
> > > >> > time.
> > > >> > > >
> > > >> > > > > >> Thanks a
> > > >> > > >
> > > >> > > > > >> > lot!
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley
Gotway via
> > RT <
> > > >> > > >
> > > >> > > > > >> > met_help at ucar.edu>
> > > >> > > >
> > > >> > > > > >> > wrote:
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > > Ed,
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > Sorry for the delay in getting to this issue.
We were
> > > busy
> > > >> > > > preparing
> > > >> > > >
> > > >> > > > > >> for
> > > >> > > >
> > > >> > > > > >> > > the met-9.1 release. I see you are running a
script
> > from
> > > >> Logan
> > > >> > > to
> > > >> > > >
> > > >> > > > > >> > reformat
> > > >> > > >
> > > >> > > > > >> > > some NetCDF data for use in MET... but are
running
> into
> > > >> some
> > > >> > > >
> > > >> > > > > sporadic
> > > >> > > >
> > > >> > > > > >> > > issues.
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > I believe that WCOSS is unavailable this week,
so I'm
> > not
> > > >> able
> > > >> > > to
> > > >> > > > go
> > > >> > > >
> > > >> > > > > >> > take a
> > > >> > > >
> > > >> > > > > >> > > closer look at your data right now.
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > But I'm wondering if you'd consider using
python
> > > embedding
> > > >> to
> > > >> > > > solve
> > > >> > > >
> > > >> > > > > >> this
> > > >> > > >
> > > >> > > > > >> > > issue instead of reformatting these files?
With this
> > > >> approach,
> > > >> > > we
> > > >> > > >
> > > >> > > > > >> write a
> > > >> > > >
> > > >> > > > > >> > > python script to tell MET how to read data
from these
> > > >> native
> > > >> > > > NetCDF
> > > >> > > >
> > > >> > > > > >> files
> > > >> > > >
> > > >> > > > > >> > > rather than reformatting them and essentially
> > duplicating
> > > >> the
> > > >> > > > data.
> > > >> > > >
> > > >> > > > > >> But
> > > >> > > >
> > > >> > > > > >> > > it's up to you... I'm sure these problems
could be
> > solved
> > > >> with
> > > >> > > >
> > > >> > > > > either
> > > >> > > >
> > > >> > > > > >> > > approach. Python-embedding has the advantage
of not
> > > >> > duplicating
> > > >> > > > the
> > > >> > > >
> > > >> > > > > >> data
> > > >> > > >
> > > >> > > > > >> > on
> > > >> > > >
> > > >> > > > > >> > > disk.
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > Just let me know how you'd like to proceed. If
you
> are
> > > >> able to
> > > >> > > > gain
> > > >> > > >
> > > >> > > > > >> > access
> > > >> > > >
> > > >> > > > > >> > > to WCOSS and pull a sample data file, as well
as your
> > > >> > > reformatting
> > > >> > > >
> > > >> > > > > >> > script,
> > > >> > > >
> > > >> > > > > >> > > please post them to our anonymous ftp site
following
> > > these
> > > >> > > >
> > > >> > > > > >> instructions:
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > Thanks,
> > > >> > > >
> > > >> > > > > >> > > John
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via
RT <
> > > >> > > > met_help at ucar.edu>
> > > >> > > >
> > > >> > > > > >> > wrote:
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > >
> > > >> > > >
> > > >> > > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154 was
acted
> > upon.
> > > >> > > >
> > > >> > > > > >> > > > Transaction: Given to johnhg (John Halley
Gotway)
> by
> > > >> > minnawin
> > > >> > > >
> > > >> > > > > >> > > >        Queue: met_help
> > > >> > > >
> > > >> > > > > >> > > >      Subject: Issues processing CF compliant
netcdf
> > > files
> > > >> > > >
> > > >> > > > > >> > > >        Owner: johnhg
> > > >> > > >
> > > >> > > > > >> > > >   Requestors: edward.strobach at noaa.gov
> > > >> > > >
> > > >> > > > > >> > > >       Status: open
> > > >> > > >
> > > >> > > > > >> > > >  Ticket <URL:
> > > >> > > >
> > > >> > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > > >
> > > >> > > >
> > > >> > > > > >> > > >
> > > >> > > >
> > > >> > > > > >> > > > This transaction appears to have no content
> > > >> > > >
> > > >> > > > > >> > > >
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> > >
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> > --
> > > >> > > >
> > > >> > > > > >> > Edward Strobach
> > > >> > > >
> > > >> > > > > >> > EMC/NCEP/NWS/
> > > >> > > >
> > > >> > > > > >> > IMSG Contractor
> > > >> > > >
> > > >> > > > > >> > Cubicle#: 2029
> > > >> > > >
> > > >> > > > > >> > 301-683-3717
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >> >
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >>
> > > >> > > >
> > > >> > > > > >
> > > >> > > >
> > > >> > > > > > --
> > > >> > > >
> > > >> > > > > > Edward Strobach
> > > >> > > >
> > > >> > > > > > EMC/NCEP/NWS/
> > > >> > > >
> > > >> > > > > > IMSG Contractor
> > > >> > > >
> > > >> > > > > > Cubicle#: 2029
> > > >> > > >
> > > >> > > > > > 301-683-3717
> > > >> > > >
> > > >> > > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > > --
> > > >> > > >
> > > >> > > > > Edward Strobach
> > > >> > > >
> > > >> > > > > EMC/NCEP/NWS/
> > > >> > > >
> > > >> > > > > IMSG Contractor
> > > >> > > >
> > > >> > > > > Cubicle#: 2029
> > > >> > > >
> > > >> > > > > 301-683-3717
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >> > --
> > > >> > Edward Strobach
> > > >> > EMC/NCEP/NWS/
> > > >> > IMSG Contractor
> > > >> > Cubicle#: 2029
> > > >> > 301-683-3717
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > > --
> > > > Edward Strobach
> > > > EMC/NCEP/NWS/
> > > > IMSG Contractor
> > > > Cubicle#: 2029
> > > > 301-683-3717
> > > >
> > >
> > >
> > > --
> > > Edward Strobach
> > > EMC/NCEP/NWS/
> > > IMSG Contractor
> > > Cubicle#: 2029
> > > 301-683-3717
> > >
> > >
> >
> >
>
> --
> Edward Strobach
> EMC/NCEP/NWS/
> IMSG Contractor
> Cubicle#: 2029
> 301-683-3717
>
>

------------------------------------------------
Subject: Issues processing CF compliant netcdf files
From: Edward Strobach - NOAA Affiliate
Time: Mon Aug 17 17:48:29 2020

Great!  Yes. thanks for confirming.

On Mon, Aug 17, 2020 at 7:18 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:

> Ed,
>
> I think the answer is yes. In the MET configuration files, you can
specify
> that multiple levels be processed like this:
>
> name = "TMP";
> level = [ "P1000", "P950", "P900" ]; // and so on
>
> The code automatically expands this to 3 fields: TMP at 1000mb, TMP
at 950
> mb, and TMP at 900mb.
>
> Is that what you were asking?
>
> Thanks,
> John
>
> On Mon, Aug 17, 2020 at 3:49 PM Edward Strobach - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> >
> > Hi John,
> >
> > I think I'm fine, so you can close the ticket.  However, I do have
one
> > question about writing pressure levels out in a netcdf file. In
the
> > metadata structure, can I write the *.level for a variable like
so:
> > [P1000, P950, P900,.....,P200]?  I just want to make sure that Met
would
> be
> > able to pick out these levels when specifying which levels I want
to
> > process in the configuration file. Thanks!
> >
> > On Mon, Aug 17, 2020 at 5:42 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Ed,
> > >
> > > Great, glad you were able to make progress. Are there any issues
> > remaining
> > > on this ticket, or should I go ahead and resolve it?
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Aug 14, 2020 at 4:45 AM Edward Strobach - NOAA Affiliate
via
> RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
>
> > > >
> > > > Hi John,
> > > >
> > > > I managed to resolve the issue and was able to make some
positive
> > changes
> > > > through studying this error closely online:
> > > >
> > > >
> > > > *terminate called after throwing an instance of
> > > > 'netCDF::exceptions::NcEdge'  what():  NetCDF: Start+count
exceeds
> > > > dimension bound*
> > > >
> > > > Although not clear from the outset, the "Start+count exceeds
> dimension
> > > > bound" stood out in particular such that I decided to change
around
> my
> > nx
> > > > and ny values within the meta data script.  Now I have
populated stat
> > > files
> > > > being generated.  I plan to add fields into this step with the
hope
> of
> > > > storing all the fields I need to process for verification.
> > > >
> > > >
> > > > On Thu, Aug 13, 2020 at 1:54 PM Edward Strobach - NOAA
Affiliate <
> > > > edward.strobach at noaa.gov> wrote:
> > > >
> > > > > Sounds good.  Enjoy your time off.  I may try a couple of
things in
> > the
> > > > > meantime
> > > > >
> > > > > On Thu, Aug 13, 2020 at 1:52 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Ed,
> > > > >>
> > > > >> OK, and we'll need that NetCDF file for testing. Hopefully,
WCOSS
> > will
> > > > be
> > > > >> accessible on Monday, and I can take a look then when I get
back
> in
> > > > town.
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Thu, Aug 13, 2020 at 10:47 AM Edward Strobach - NOAA
Affiliate
> > via
> > > > RT <
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > > > >> >
> > > > >> > Thanks.  I do get an image when running that step.  The
PBL
> height
> > > has
> > > > >> > reasonable values and is enhanced in regions of
convection.
> It's
> > > nice
> > > > >> to
> > > > >> > know that I can process the data from the netcdf files I
> generated
> > > > using
> > > > >> > plot_data_plane and that the results are reasonable;
however,
> I'm
> > > > >> wondering
> > > > >> > how this resolves issue I'm having related to the
original
> error:
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > *terminate called after throwing an instance of
> > > > >> > 'netCDF::exceptions::NcEdge'  what():  NetCDF:
Start+count
> exceeds
> > > > >> > dimension boundfile: ncVar.cpp  line:161408/07
01:44:55.554
> > > > >> > metplus.PointStat (command_runner.py:191) DEBUG: Finished
> running
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1_beta2/bin/point_stat
> > > > >> > in 0:00:01.80815508/07 01:44:56.011 metplus.PointStat
> > > > >> > (command_builder.py:100) ERROR: (command_builder.py:733)
M*
> > > > >> >
> > > > >> >
> > > > >> > I wasn't able to interpret much from this error when
reading
> about
> > > it
> > > > >> > online
> > > > >> > <https://github.com/NCAR/MET/issues/1139>.  Is the point
of the
> > > > >> exercise
> > > > >> > to
> > > > >> > show that my files could be processed, but that there's
> something
> > > > >> > potentially wrong with the attribute settings in the
netcdf file
> > > that
> > > > is
> > > > >> > preventing me from moving beyond the error listed above?
> Forgive
> > > me,
> > > > >> I'm
> > > > >> > just trying to connect the two.
> > > > >> >
> > > > >> > On Thu, Aug 13, 2020 at 12:27 PM John Halley Gotway via
RT <
> > > > >> > met_help at ucar.edu> wrote:
> > > > >> >
> > > > >> > > Ed,
> > > > >> > >
> > > > >> > > The plot_data_plane tool generates a Postscript output
file.
> > That
> > > is
> > > > >> an
> > > > >> > > image. It does not generate PNG output. However it’s
pretty
> easy
> > > to
> > > > >> > convert
> > > > >> > > .ps to .png. I always do so prior to sending them as
> attachments
> > > via
> > > > >> > > met_help just because the png files are so much
smaller.
> > > > >> > >
> > > > >> > > I use the ImageMagick convert command:
> > > > >> > >
> > > > >> > > convert -rotate 90 -background white image.ps image.png
> > > > >> > >
> > > > >> > > As for hemisphere, accum, and name. I don’t think they
are
> > > > required...
> > > > >> > > without hemisphere I believe the code assumes North
(only
> > applies
> > > to
> > > > >> > polar
> > > > >> > > stereo and Lambert conf grids I believe). If you’re
using
> those
> > > > >> > > projections, I would recommend adding it.
> > > > >> > >
> > > > >> > > John
> > > > >> > >
> > > > >> > > On Thu, Aug 13, 2020 at 9:51 AM Minna Win via RT <
> > > met_help at ucar.edu
> > > > >
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > Hi Ed,
> > > > >> > > >
> > > > >> > > > John is out of the office today and tomorrow.  He'll
be back
> > in
> > > > the
> > > > >> > > office
> > > > >> > > >
> > > > >> > > > on Monday, so please allow a few more business days
for a
> full
> > > > >> > response.
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > Regards,
> > > > >> > > >
> > > > >> > > > Minna
> > > > >> > > >
> > > > >> > > > ---------------
> > > > >> > > >
> > > > >> > > > Minna Win
> > > > >> > > >
> > > > >> > > > National Center for Atmospheric Research
> > > > >> > > >
> > > > >> > > > Developmental Testbed Center
> > > > >> > > >
> > > > >> > > > Phone: 303-497-8423
> > > > >> > > >
> > > > >> > > > Fax:   303-497-8401
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > On Thu, Aug 13, 2020 at 9:11 AM Edward Strobach -
NOAA
> > Affiliate
> > > > via
> > > > >> > RT <
> > > > >> > > >
> > > > >> > > > met_help at ucar.edu> wrote:
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > I did have one follow up question.  I copied the
contents
> of
> > > the
> > > > >> > > >
> > > > >> > > > > read_PostProcessed_WRF.py file and adjusted to
match what
> I
> > > > needed
> > > > >> > for
> > > > >> > > my
> > > > >> > > >
> > > > >> > > > > purpose.  When I run plot_data_plane I get an
indication
> > that
> > > it
> > > > >> was
> > > > >> > > >
> > > > >> > > > > successful:
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > [Edward.Strobach at m71a2 aqm.20200803]$
plot_data_plane
> > > > >> PYTHON_NUMPY
> > > > >> > > > hpbl.ps
> > > > >> > > >
> > > > >> > > > > 'name="read_PostProcessed.py
aqm.t12z.metcro2d.19.nc
> PBL";'
> > > > >> > > >
> > > > >> > > > > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > > >> > > >
> > > > >> > > > > Input File: 'aqm.t12z.metcro2d.19.nc'
> > > > >> > > >
> > > > >> > > > > Variable: 'PBL'
> > > > >> > > >
> > > > >> > > > > Data Shape: (265, 442)
> > > > >> > > >
> > > > >> > > > > Data Type:  dtype('float64')
> > > > >> > > >
> > > > >> > > > > *Attributes: {'valid': '20200804_070000', 'init':
> > > > >> '20200803_120000',
> > > > >> > > >
> > > > >> > > > > 'lead': '19', 'accum': '00', 'name': 'PBL',
'long_name':
> > > 'PBL',
> > > > >> > > 'level':
> > > > >> > > >
> > > > >> > > > > 'SURFACE', 'units': 'm', 'grid': {'type': 'Lambert
> > Conformal',
> > > > >> > 'name':
> > > > >> > > >
> > > > >> > > > > 'CMAQ Domain', 'hemisphere': 'N', 'scale_lat_1':
33.0,
> > > > >> 'scale_lat_2':
> > > > >> > > > 45.0,
> > > > >> > > >
> > > > >> > > > > 'lat_pin': 21.821, 'lon_pin': -120.628, 'x_pin':
0.0,
> > 'y_pin':
> > > > >> 0.0,
> > > > >> > > >
> > > > >> > > > > 'lon_orient': -97.0, 'd_km': 12.0, 'r_km': 6371.2,
'nx':
> > 442,
> > > > >> 'ny':
> > > > >> > > > 265}}*
> > > > >> > > >
> > > > >> > > > > *DEBUG 1: Creating postscript file: hpbl.ps <
> http://hpbl.ps
> > >*
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > You can see that the postscript file has been
created.  I
> > had
> > > to
> > > > >> > adjust
> > > > >> > > > the
> > > > >> > > >
> > > > >> > > > > read_PostProcessed.py contents upon copying it
over.  I
> > > > originally
> > > > >> > did
> > > > >> > > > not
> > > > >> > > >
> > > > >> > > > > have the "accum", "hemisphere", or "name"
attributes.
> After
> > > > >> adding
> > > > >> > > those
> > > > >> > > >
> > > > >> > > > > in plot_data_plane was successful.  Those added
attributes
> > are
> > > > not
> > > > >> > part
> > > > >> > > > of
> > > > >> > > >
> > > > >> > > > > the attribute list in the netcdf file.  My netcdf
file
> only
> > > > >> includes
> > > > >> > > > these
> > > > >> > > >
> > > > >> > > > > attributes:
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > *root group (NETCDF4 data model, file format HDF5):
> > > > >> FileOrigins:
> > > > >> > NA
> > > > >> > > >
> > > > >> > > > > MET_version: V9.1    MET_tool: gen_vx_mask
Projection:
> > > > Lambert
> > > > >> > > >
> > > > >> > > > > Conformal    scale_lat_1: 33.000000    scale_lat_2:
> > 45.000000
> > > > >> > > lat_pin:
> > > > >> > > >
> > > > >> > > > > 21.821000    lon_pin: -120.628000    x_pin:
0.000000
> > y_pin:
> > > > >> > 0.000000
> > > > >> > > >
> > > > >> > > > > lon_orient: -97.000000    d_km: 12.000000    r_km:
> > 6371.200000
> > > > >> nx:
> > > > >> > > 442
> > > > >> > > >
> > > > >> > > > >   ny: 265 grid_points    dimensions(sizes):
lon(265),
> > lat(442)
> > > > >> > > >
> > > > >> > > > > variables(dimensions): float32 LAT(lon,lat),
float32
> > > > LON(lon,lat),
> > > > >> > > > float32
> > > > >> > > >
> > > > >> > > > > DLUSE(lon,lat), float32 TMP(lon,lat), float32
PBL(lon,lat)
> > > > >> > groups: *
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > You can see that most of them are there.  My
understanding
> > is
> > > > that
> > > > >> > the
> > > > >> > > >
> > > > >> > > > > postscript file contains the contents used for the
> > postscript
> > > > >> > image.  I
> > > > >> > > >
> > > > >> > > > > thought that an image would have been generated as
well.
> > > Should
> > > > >> > there
> > > > >> > > > be a
> > > > >> > > >
> > > > >> > > > > .png file generated as well?  Does this exercise of
> running
> > > > >> > > > plot_data_plane
> > > > >> > > >
> > > > >> > > > > indicate what might be missing in my attribute list
that
> > would
> > > > >> need
> > > > >> > to
> > > > >> > > be
> > > > >> > > >
> > > > >> > > > > included (e.g. does name, accum, and hemisphere
need to be
> > > > >> > included?)?
> > > > >> > > >
> > > > >> > > > > Also I had to change how valid and initial times
were
> > > extracted.
> > > > >> > They
> > > > >> > > > are
> > > > >> > > >
> > > > >> > > > > being written in this way instead:
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > *>>> f.variables[var_name]<class
> > > > >> 'netCDF4._netCDF4.Variable'>float32
> > > > >> > > >
> > > > >> > > > > PBL(lon, lat)    long_name: PBL    standard_name:
> Planetary
> > > > >> Boundary
> > > > >> > > > Layer
> > > > >> > > >
> > > > >> > > > > Height    units: m    level: L0    init_time:
> > 20200804_060000
> > > > >> > > >
> > > > >> > > > > init_time_ut: 1596520800    valid_time:
20200805_170000
> > > > >> > > valid_time_ut:
> > > > >> > > >
> > > > >> > > > > 1596646800*
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > Do I need to adjust my attribute meta data to
include the
> > > > initial
> > > > >> and
> > > > >> > > > valid
> > > > >> > > >
> > > > >> > > > > times rather than lumping them under the field
name?
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > On Thu, Aug 13, 2020 at 9:25 AM Edward Strobach -
NOAA
> > > > Affiliate <
> > > > >> > > >
> > > > >> > > > > edward.strobach at noaa.gov> wrote:
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > > Thanks John, I'll go ahead take a look at those
> resources
> > > > >> > > >
> > > > >> > > > > >
> > > > >> > > >
> > > > >> > > > > > On Wed, Aug 12, 2020 at 11:45 AM John Halley
Gotway via
> > RT <
> > > > >> > > >
> > > > >> > > > > > met_help at ucar.edu> wrote:
> > > > >> > > >
> > > > >> > > > > >
> > > > >> > > >
> > > > >> > > > > >> Ed,
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> Sounds great. FYI, here are some examples of
using
> python
> > > > >> > embedding:
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-
met/sample-analysis-scripts
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> All these examples are for calling the
plot_data_plane
> > tool
> > > > >> since
> > > > >> > > >
> > > > >> > > > > that's a
> > > > >> > > >
> > > > >> > > > > >> great way to get started. Plot the data to make
sure
> that
> > > its
> > > > >> what
> > > > >> > > you
> > > > >> > > >
> > > > >> > > > > >> expect and oriented correctly. I imagine we'll
want a
> > > python
> > > > >> > script
> > > > >> > > > that
> > > > >> > > >
> > > > >> > > > > >> takes at least 2 arguments... the name of the
NetCDF
> file
> > > and
> > > > >> the
> > > > >> > > >
> > > > >> > > > > variable
> > > > >> > > >
> > > > >> > > > > >> you want from it. Something like this example
from that
> > > page:
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> Plot the PSFC variable from a post-processed WRF
output
> > > file
> > > > >> on a
> > > > >> > > >
> > > > >> > > > > Lambert
> > > > >> > > >
> > > > >> > > > > >> Conformal projection:
> > > > >> > > >
> > > > >> > > > > >> plot_data_plane PYTHON_NUMPY psfc.ps
> > > > >> > > >
> > > > >> > > > > >> <
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/psfc.png
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >>  'name="read_PostProcessed_WRF.py
> > > > >> > > >
> > > > >> > > > > >> <
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/read_PostProcessed_WRF.py.txt
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >>   2004-09-01_04-00-00.nc
> > > > >> > > >
> > > > >> > > > > >> <
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://dtcenter.org/sites/default/files/community-code/met/python-
scripts/2004-09-01_04-00-00.nc
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >>  PSFC";'
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> Hopefully it won't be too difficult to adapt one
of
> these
> > > > >> scripts
> > > > >> > to
> > > > >> > > >
> > > > >> > > > > work
> > > > >> > > >
> > > > >> > > > > >> with your particular dataset. I'd encourage you
to try
> > > > >> yourself,
> > > > >> > but
> > > > >> > > > if
> > > > >> > > >
> > > > >> > > > > >> you
> > > > >> > > >
> > > > >> > > > > >> run into issues or don't know where to start, we
can
> help
> > > > too.
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> Thanks,
> > > > >> > > >
> > > > >> > > > > >> John
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> On Tue, Aug 11, 2020 at 5:16 PM Edward Strobach
- NOAA
> > > > >> Affiliate
> > > > >> > via
> > > > >> > > > RT
> > > > >> > > >
> > > > >> > > > > <
> > > > >> > > >
> > > > >> > > > > >> met_help at ucar.edu> wrote:
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154 >
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > Hi John,
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > I imagine you guys are pretty swamped,
especially
> with
> > so
> > > > >> many
> > > > >> > > more
> > > > >> > > >
> > > > >> > > > > >> people
> > > > >> > > >
> > > > >> > > > > >> > now using met and metplus.
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > The option that you are proposing sounds
better to
> > me.  I
> > > > >> might
> > > > >> > be
> > > > >> > > >
> > > > >> > > > > able
> > > > >> > > >
> > > > >> > > > > >> to
> > > > >> > > >
> > > > >> > > > > >> > regain access by Thursday.  I'll make sure to
post
> > those
> > > > >> items
> > > > >> > > then.
> > > > >> > > >
> > > > >> > > > > >> I'll
> > > > >> > > >
> > > > >> > > > > >> > stand by to receive your instructions whenever
you
> get
> > > some
> > > > >> > time.
> > > > >> > > >
> > > > >> > > > > >> Thanks a
> > > > >> > > >
> > > > >> > > > > >> > lot!
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > On Tue, Aug 11, 2020 at 6:46 PM John Halley
Gotway
> via
> > > RT <
> > > > >> > > >
> > > > >> > > > > >> > met_help at ucar.edu>
> > > > >> > > >
> > > > >> > > > > >> > wrote:
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > > Ed,
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > Sorry for the delay in getting to this
issue. We
> were
> > > > busy
> > > > >> > > > preparing
> > > > >> > > >
> > > > >> > > > > >> for
> > > > >> > > >
> > > > >> > > > > >> > > the met-9.1 release. I see you are running a
script
> > > from
> > > > >> Logan
> > > > >> > > to
> > > > >> > > >
> > > > >> > > > > >> > reformat
> > > > >> > > >
> > > > >> > > > > >> > > some NetCDF data for use in MET... but are
running
> > into
> > > > >> some
> > > > >> > > >
> > > > >> > > > > sporadic
> > > > >> > > >
> > > > >> > > > > >> > > issues.
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > I believe that WCOSS is unavailable this
week, so
> I'm
> > > not
> > > > >> able
> > > > >> > > to
> > > > >> > > > go
> > > > >> > > >
> > > > >> > > > > >> > take a
> > > > >> > > >
> > > > >> > > > > >> > > closer look at your data right now.
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > But I'm wondering if you'd consider using
python
> > > > embedding
> > > > >> to
> > > > >> > > > solve
> > > > >> > > >
> > > > >> > > > > >> this
> > > > >> > > >
> > > > >> > > > > >> > > issue instead of reformatting these files?
With
> this
> > > > >> approach,
> > > > >> > > we
> > > > >> > > >
> > > > >> > > > > >> write a
> > > > >> > > >
> > > > >> > > > > >> > > python script to tell MET how to read data
from
> these
> > > > >> native
> > > > >> > > > NetCDF
> > > > >> > > >
> > > > >> > > > > >> files
> > > > >> > > >
> > > > >> > > > > >> > > rather than reformatting them and
essentially
> > > duplicating
> > > > >> the
> > > > >> > > > data.
> > > > >> > > >
> > > > >> > > > > >> But
> > > > >> > > >
> > > > >> > > > > >> > > it's up to you... I'm sure these problems
could be
> > > solved
> > > > >> with
> > > > >> > > >
> > > > >> > > > > either
> > > > >> > > >
> > > > >> > > > > >> > > approach. Python-embedding has the advantage
of not
> > > > >> > duplicating
> > > > >> > > > the
> > > > >> > > >
> > > > >> > > > > >> data
> > > > >> > > >
> > > > >> > > > > >> > on
> > > > >> > > >
> > > > >> > > > > >> > > disk.
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > Just let me know how you'd like to proceed.
If you
> > are
> > > > >> able to
> > > > >> > > > gain
> > > > >> > > >
> > > > >> > > > > >> > access
> > > > >> > > >
> > > > >> > > > > >> > > to WCOSS and pull a sample data file, as
well as
> your
> > > > >> > > reformatting
> > > > >> > > >
> > > > >> > > > > >> > script,
> > > > >> > > >
> > > > >> > > > > >> > > please post them to our anonymous ftp site
> following
> > > > these
> > > > >> > > >
> > > > >> > > > > >> instructions:
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://dtcenter.org/community-code/model-evaluation-tools-met/met-
help-desk#ftp
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > Thanks,
> > > > >> > > >
> > > > >> > > > > >> > > John
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > On Fri, Aug 7, 2020 at 9:26 AM Minna Win via
RT <
> > > > >> > > > met_help at ucar.edu>
> > > > >> > > >
> > > > >> > > > > >> > wrote:
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > >
> > > > >> > > >
> > > > >> > > > > >> > > > Fri Aug 07 09:23:50 2020: Request 96154
was acted
> > > upon.
> > > > >> > > >
> > > > >> > > > > >> > > > Transaction: Given to johnhg (John Halley
Gotway)
> > by
> > > > >> > minnawin
> > > > >> > > >
> > > > >> > > > > >> > > >        Queue: met_help
> > > > >> > > >
> > > > >> > > > > >> > > >      Subject: Issues processing CF
compliant
> netcdf
> > > > files
> > > > >> > > >
> > > > >> > > > > >> > > >        Owner: johnhg
> > > > >> > > >
> > > > >> > > > > >> > > >   Requestors: edward.strobach at noaa.gov
> > > > >> > > >
> > > > >> > > > > >> > > >       Status: open
> > > > >> > > >
> > > > >> > > > > >> > > >  Ticket <URL:
> > > > >> > > >
> > > > >> > > > > >>
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96154
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > > >
> > > > >> > > >
> > > > >> > > > > >> > > >
> > > > >> > > >
> > > > >> > > > > >> > > > This transaction appears to have no
content
> > > > >> > > >
> > > > >> > > > > >> > > >
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> > >
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> > --
> > > > >> > > >
> > > > >> > > > > >> > Edward Strobach
> > > > >> > > >
> > > > >> > > > > >> > EMC/NCEP/NWS/
> > > > >> > > >
> > > > >> > > > > >> > IMSG Contractor
> > > > >> > > >
> > > > >> > > > > >> > Cubicle#: 2029
> > > > >> > > >
> > > > >> > > > > >> > 301-683-3717
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >> >
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >>
> > > > >> > > >
> > > > >> > > > > >
> > > > >> > > >
> > > > >> > > > > > --
> > > > >> > > >
> > > > >> > > > > > Edward Strobach
> > > > >> > > >
> > > > >> > > > > > EMC/NCEP/NWS/
> > > > >> > > >
> > > > >> > > > > > IMSG Contractor
> > > > >> > > >
> > > > >> > > > > > Cubicle#: 2029
> > > > >> > > >
> > > > >> > > > > > 301-683-3717
> > > > >> > > >
> > > > >> > > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > > --
> > > > >> > > >
> > > > >> > > > > Edward Strobach
> > > > >> > > >
> > > > >> > > > > EMC/NCEP/NWS/
> > > > >> > > >
> > > > >> > > > > IMSG Contractor
> > > > >> > > >
> > > > >> > > > > Cubicle#: 2029
> > > > >> > > >
> > > > >> > > > > 301-683-3717
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> > --
> > > > >> > Edward Strobach
> > > > >> > EMC/NCEP/NWS/
> > > > >> > IMSG Contractor
> > > > >> > Cubicle#: 2029
> > > > >> > 301-683-3717
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > > > --
> > > > > Edward Strobach
> > > > > EMC/NCEP/NWS/
> > > > > IMSG Contractor
> > > > > Cubicle#: 2029
> > > > > 301-683-3717
> > > > >
> > > >
> > > >
> > > > --
> > > > Edward Strobach
> > > > EMC/NCEP/NWS/
> > > > IMSG Contractor
> > > > Cubicle#: 2029
> > > > 301-683-3717
> > > >
> > > >
> > >
> > >
> >
> > --
> > Edward Strobach
> > EMC/NCEP/NWS/
> > IMSG Contractor
> > Cubicle#: 2029
> > 301-683-3717
> >
> >
>
>

--
Edward Strobach
EMC/NCEP/NWS/
IMSG Contractor
Cubicle#: 2029
301-683-3717

------------------------------------------------