[Met_help] [rt.rap.ucar.edu #85542] History for Error code

John Halley Gotway via RT met_help at ucar.edu
Tue Jul 9 12:03:32 MDT 2019


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

This is Brianne. I'm working with Pedro and Amanda on the MADWRF project
this summer. I recently got this error from running the lidar2nc tool. Here
is what it said:

get_hdf_var_info() -> failed to get index for "Opacity_Flag"

What should I do?

-- 
Best,
*Brianne R. Andersen*
Student of Meteorology, Metropolitan State University of Denver
720-289-6477


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Error code
From: John Halley Gotway
Time: Thu Jun 14 12:29:34 2018

Hi Brianne,

Can you please send us (or point us to) a sample data file so that we
can
replicate the behavior?  If you're running on kiowa, I can just log on
and
grab it.  Please just send me the exact command line you're running
that
results in this error.

Thanks,
John

On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT
<met_help at ucar.edu>
wrote:

>
> Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
> Transaction: Ticket created by brianne at ucar.edu
>        Queue: met_help
>      Subject: Error code
>        Owner: Nobody
>   Requestors: brianne at ucar.edu
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>
>
> This is Brianne. I'm working with Pedro and Amanda on the MADWRF
project
> this summer. I recently got this error from running the lidar2nc
tool. Here
> is what it said:
>
> get_hdf_var_info() -> failed to get index for "Opacity_Flag"
>
> What should I do?
>
> --
> Best,
> *Brianne R. Andersen*
> Student of Meteorology, Metropolitan State University of Denver
> 720-289-6477
>
>

------------------------------------------------
Subject: Error code
From: brianne at ucar.edu
Time: Thu Jun 14 12:41:27 2018

I am in Kiowa. The path to the data and the attempted netcdf files are
all
under:

d1/personal/brianne/calipso

On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Hi Brianne,
>
> Can you please send us (or point us to) a sample data file so that
we can
> replicate the behavior?  If you're running on kiowa, I can just log
on and
> grab it.  Please just send me the exact command line you're running
that
> results in this error.
>
> Thanks,
> John
>
> On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
> > Transaction: Ticket created by brianne at ucar.edu
> >        Queue: met_help
> >      Subject: Error code
> >        Owner: Nobody
> >   Requestors: brianne at ucar.edu
> >       Status: new
> >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> >
> >
> > This is Brianne. I'm working with Pedro and Amanda on the MADWRF
project
> > this summer. I recently got this error from running the lidar2nc
tool.
> Here
> > is what it said:
> >
> > get_hdf_var_info() -> failed to get index for "Opacity_Flag"
> >
> > What should I do?
> >
> > --
> > Best,
> > *Brianne R. Andersen*
> > Student of Meteorology, Metropolitan State University of Denver
> > 720-289-6477
> >
> >
>
>


--
Best,
*Brianne R. Andersen*
Student of Meteorology, Metropolitan State University of Denver
720-289-6477

------------------------------------------------
Subject: Error code
From: John Halley Gotway
Time: Thu Jun 14 12:44:56 2018

Brianne,

Can you please literally cut-and-paste the command I can run to
replicate
the error?

That'll ensure I'm debugging the correct problem.

Thanks,
John

On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT
<met_help at ucar.edu>
wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>
> I am in Kiowa. The path to the data and the attempted netcdf files
are all
> under:
>
> d1/personal/brianne/calipso
>
> On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Hi Brianne,
> >
> > Can you please send us (or point us to) a sample data file so that
we can
> > replicate the behavior?  If you're running on kiowa, I can just
log on
> and
> > grab it.  Please just send me the exact command line you're
running that
> > results in this error.
> >
> > Thanks,
> > John
> >
> > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
> > > Transaction: Ticket created by brianne at ucar.edu
> > >        Queue: met_help
> > >      Subject: Error code
> > >        Owner: Nobody
> > >   Requestors: brianne at ucar.edu
> > >       Status: new
> > >  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542
> >
> > >
> > >
> > > This is Brianne. I'm working with Pedro and Amanda on the MADWRF
> project
> > > this summer. I recently got this error from running the lidar2nc
tool.
> > Here
> > > is what it said:
> > >
> > > get_hdf_var_info() -> failed to get index for "Opacity_Flag"
> > >
> > > What should I do?
> > >
> > > --
> > > Best,
> > > *Brianne R. Andersen*
> > > Student of Meteorology, Metropolitan State University of Denver
> > > 720-289-6477
> > >
> > >
> >
> >
>
>
> --
> Best,
> *Brianne R. Andersen*
> Student of Meteorology, Metropolitan State University of Denver
> 720-289-6477
>
>

------------------------------------------------
Subject: Error code
From: brianne at ucar.edu
Time: Thu Jun 14 12:48:47 2018

yep

met-7.0/bin/lidar2nc \
calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-V3-
40.2018-04-01T00-57-13ZN.hdf
\
-out calipso/calipso_netcdf/calipso_netcdf_20180401/20180401T0057.nc

On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Brianne,
>
> Can you please literally cut-and-paste the command I can run to
replicate
> the error?
>
> That'll ensure I'm debugging the correct problem.
>
> Thanks,
> John
>
> On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> >
> > I am in Kiowa. The path to the data and the attempted netcdf files
are
> all
> > under:
> >
> > d1/personal/brianne/calipso
> >
> > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Hi Brianne,
> > >
> > > Can you please send us (or point us to) a sample data file so
that we
> can
> > > replicate the behavior?  If you're running on kiowa, I can just
log on
> > and
> > > grab it.  Please just send me the exact command line you're
running
> that
> > > results in this error.
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
> > > > Transaction: Ticket created by brianne at ucar.edu
> > > >        Queue: met_help
> > > >      Subject: Error code
> > > >        Owner: Nobody
> > > >   Requestors: brianne at ucar.edu
> > > >       Status: new
> > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=85542
> > >
> > > >
> > > >
> > > > This is Brianne. I'm working with Pedro and Amanda on the
MADWRF
> > project
> > > > this summer. I recently got this error from running the
lidar2nc
> tool.
> > > Here
> > > > is what it said:
> > > >
> > > > get_hdf_var_info() -> failed to get index for "Opacity_Flag"
> > > >
> > > > What should I do?
> > > >
> > > > --
> > > > Best,
> > > > *Brianne R. Andersen*
> > > > Student of Meteorology, Metropolitan State University of
Denver
> > > > 720-289-6477
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Best,
> > *Brianne R. Andersen*
> > Student of Meteorology, Metropolitan State University of Denver
> > 720-289-6477
> >
> >
>
>


--
Best,
*Brianne R. Andersen*
Student of Meteorology, Metropolitan State University of Denver
720-289-6477

------------------------------------------------
Subject: Error code
From: John Halley Gotway
Time: Thu Jun 14 14:09:57 2018

Brianne,

Great, thanks for sending that.  I see that they lidar2nc tool is
looking
for 11 different variables in each Calipso file.  Only 10 of the 11
are
present in the file you're using.  Just as the error message states,
the
"Opacity Flag" is missing.

FYI, I ran the "hdp" utility to inventory the Calipso file like this:
   hdp dumpsds
CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-04-01T00-57-13ZN.hdf | grep
"Variable Name"


Randy Bullock (cc'ed here) originally developed this code.
Unfortunately,
any fix will require code changes and a recompile.  One difference I
notice
is that your files are named "01km" while our test datasets are named
"05km".


Randy,



Are you familiar with the  difference, if any, between the 01km and
05km
Calipso files?  Ideally, we'd change that ERROR to a WARNING message
and
just skip that observation type.


Can you please take a look at this sample data file:

/scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-04-01T00-57-
13ZN.hdf

Thanks,
John

On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT
<met_help at ucar.edu>
wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>
> yep
>
> met-7.0/bin/lidar2nc \
>
> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-V3-
40.2018-04-01T00-57-13ZN.hdf
> \
> -out calipso/calipso_netcdf/calipso_netcdf_20180401/20180401T0057.nc
>
> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Brianne,
> >
> > Can you please literally cut-and-paste the command I can run to
replicate
> > the error?
> >
> > That'll ensure I'm debugging the correct problem.
> >
> > Thanks,
> > John
> >
> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> > >
> > > I am in Kiowa. The path to the data and the attempted netcdf
files are
> > all
> > > under:
> > >
> > > d1/personal/brianne/calipso
> > >
> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Hi Brianne,
> > > >
> > > > Can you please send us (or point us to) a sample data file so
that we
> > can
> > > > replicate the behavior?  If you're running on kiowa, I can
just log
> on
> > > and
> > > > grab it.  Please just send me the exact command line you're
running
> > that
> > > > results in this error.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > >
> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
> > > > > Transaction: Ticket created by brianne at ucar.edu
> > > > >        Queue: met_help
> > > > >      Subject: Error code
> > > > >        Owner: Nobody
> > > > >   Requestors: brianne at ucar.edu
> > > > >       Status: new
> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=85542
> > > >
> > > > >
> > > > >
> > > > > This is Brianne. I'm working with Pedro and Amanda on the
MADWRF
> > > project
> > > > > this summer. I recently got this error from running the
lidar2nc
> > tool.
> > > > Here
> > > > > is what it said:
> > > > >
> > > > > get_hdf_var_info() -> failed to get index for "Opacity_Flag"
> > > > >
> > > > > What should I do?
> > > > >
> > > > > --
> > > > > Best,
> > > > > *Brianne R. Andersen*
> > > > > Student of Meteorology, Metropolitan State University of
Denver
> > > > > 720-289-6477
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Best,
> > > *Brianne R. Andersen*
> > > Student of Meteorology, Metropolitan State University of Denver
> > > 720-289-6477
> > >
> > >
> >
> >
>
>
> --
> Best,
> *Brianne R. Andersen*
> Student of Meteorology, Metropolitan State University of Denver
> 720-289-6477
>
>

------------------------------------------------
Subject: Error code
From: Randy Bullock
Time: Fri Jun 15 08:12:06 2018

John -

Sorry ... it's been a long time since I even thought about calypso
files.
I could look into it, but not sure how much time would be involved.

Randy

On Thu, Jun 14, 2018 at 2:09 PM, John Halley Gotway <johnhg at ucar.edu>
wrote:

> Brianne,
>
> Great, thanks for sending that.  I see that they lidar2nc tool is
looking
> for 11 different variables in each Calipso file.  Only 10 of the 11
are
> present in the file you're using.  Just as the error message states,
the
> "Opacity Flag" is missing.
>
> FYI, I ran the "hdp" utility to inventory the Calipso file like
this:
>    hdp dumpsds CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-04-01T00-57-
13ZN.hdf
> | grep "Variable Name"
>
>
> Randy Bullock (cc'ed here) originally developed this code.
Unfortunately,
> any fix will require code changes and a recompile.  One difference I
notice
> is that your files are named "01km" while our test datasets are
named
> "05km".
>
>
> Randy,
>
>
>
> Are you familiar with the  difference, if any, between the 01km and
05km
> Calipso files?  Ideally, we'd change that ERROR to a WARNING message
and
> just skip that observation type.
>
>
> Can you please take a look at this sample data file:
>
> /scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-
> 04-01T00-57-13ZN.hdf
>
> Thanks,
> John
>
> On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>>
>> yep
>>
>> met-7.0/bin/lidar2nc \
>> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-
>> V3-40.2018-04-01T00-57-13ZN.hdf
>> \
>> -out
calipso/calipso_netcdf/calipso_netcdf_20180401/20180401T0057.nc
>>
>> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>> > Brianne,
>> >
>> > Can you please literally cut-and-paste the command I can run to
>> replicate
>> > the error?
>> >
>> > That'll ensure I'm debugging the correct problem.
>> >
>> > Thanks,
>> > John
>> >
>> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
>> > met_help at ucar.edu>
>> > wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>> > >
>> > > I am in Kiowa. The path to the data and the attempted netcdf
files are
>> > all
>> > > under:
>> > >
>> > > d1/personal/brianne/calipso
>> > >
>> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > > Hi Brianne,
>> > > >
>> > > > Can you please send us (or point us to) a sample data file so
that
>> we
>> > can
>> > > > replicate the behavior?  If you're running on kiowa, I can
just log
>> on
>> > > and
>> > > > grab it.  Please just send me the exact command line you're
running
>> > that
>> > > > results in this error.
>> > > >
>> > > > Thanks,
>> > > > John
>> > > >
>> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
>> > > > met_help at ucar.edu>
>> > > > wrote:
>> > > >
>> > > > >
>> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
>> > > > > Transaction: Ticket created by brianne at ucar.edu
>> > > > >        Queue: met_help
>> > > > >      Subject: Error code
>> > > > >        Owner: Nobody
>> > > > >   Requestors: brianne at ucar.edu
>> > > > >       Status: new
>> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
>> > Ticket/Display.html?id=85542
>> > > >
>> > > > >
>> > > > >
>> > > > > This is Brianne. I'm working with Pedro and Amanda on the
MADWRF
>> > > project
>> > > > > this summer. I recently got this error from running the
lidar2nc
>> > tool.
>> > > > Here
>> > > > > is what it said:
>> > > > >
>> > > > > get_hdf_var_info() -> failed to get index for
"Opacity_Flag"
>> > > > >
>> > > > > What should I do?
>> > > > >
>> > > > > --
>> > > > > Best,
>> > > > > *Brianne R. Andersen*
>> > > > > Student of Meteorology, Metropolitan State University of
Denver
>> > > > > 720-289-6477
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> > > --
>> > > Best,
>> > > *Brianne R. Andersen*
>> > > Student of Meteorology, Metropolitan State University of Denver
>> > > 720-289-6477
>> > >
>> > >
>> >
>> >
>>
>>
>> --
>> Best,
>> *Brianne R. Andersen*
>> Student of Meteorology, Metropolitan State University of Denver
>> 720-289-6477
>>
>>

------------------------------------------------
Subject: Error code
From: brianne at ucar.edu
Time: Fri Jun 15 08:16:33 2018

That would be great. Thanks for looking into this. Is there any way
that we
could add a dummy field for the conversion to work? Or is the opacity
field
crucial to the functionality of the lidar2nc tool?



On Fri, Jun 15, 2018 at 8:12 AM, Randy Bullock via RT
<met_help at ucar.edu>
wrote:

> John -
>
> Sorry ... it's been a long time since I even thought about calypso
files.
> I could look into it, but not sure how much time would be involved.
>
> Randy
>
> On Thu, Jun 14, 2018 at 2:09 PM, John Halley Gotway
<johnhg at ucar.edu>
> wrote:
>
> > Brianne,
> >
> > Great, thanks for sending that.  I see that they lidar2nc tool is
looking
> > for 11 different variables in each Calipso file.  Only 10 of the
11 are
> > present in the file you're using.  Just as the error message
states, the
> > "Opacity Flag" is missing.
> >
> > FYI, I ran the "hdp" utility to inventory the Calipso file like
this:
> >    hdp dumpsds CAL_LID_L2_01kmCLay-ValStage1-
> V3-40.2018-04-01T00-57-13ZN.hdf
> > | grep "Variable Name"
> >
> >
> > Randy Bullock (cc'ed here) originally developed this code.
> Unfortunately,
> > any fix will require code changes and a recompile.  One difference
I
> notice
> > is that your files are named "01km" while our test datasets are
named
> > "05km".
> >
> >
> > Randy,
> >
> >
> >
> > Are you familiar with the  difference, if any, between the 01km
and 05km
> > Calipso files?  Ideally, we'd change that ERROR to a WARNING
message and
> > just skip that observation type.
> >
> >
> > Can you please take a look at this sample data file:
> >
> > /scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-
> > 04-01T00-57-13ZN.hdf
> >
> > Thanks,
> > John
> >
> > On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> >>
> >> yep
> >>
> >> met-7.0/bin/lidar2nc \
> >> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-
> >> V3-40.2018-04-01T00-57-13ZN.hdf
> >> \
> >> -out
calipso/calipso_netcdf/calipso_netcdf_20180401/20180401T0057.nc
> >>
> >> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> > Brianne,
> >> >
> >> > Can you please literally cut-and-paste the command I can run to
> >> replicate
> >> > the error?
> >> >
> >> > That'll ensure I'm debugging the correct problem.
> >> >
> >> > Thanks,
> >> > John
> >> >
> >> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
> >> > met_help at ucar.edu>
> >> > wrote:
> >> >
> >> > >
> >> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542
>
> >> > >
> >> > > I am in Kiowa. The path to the data and the attempted netcdf
files
> are
> >> > all
> >> > > under:
> >> > >
> >> > > d1/personal/brianne/calipso
> >> > >
> >> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > > Hi Brianne,
> >> > > >
> >> > > > Can you please send us (or point us to) a sample data file
so that
> >> we
> >> > can
> >> > > > replicate the behavior?  If you're running on kiowa, I can
just
> log
> >> on
> >> > > and
> >> > > > grab it.  Please just send me the exact command line you're
> running
> >> > that
> >> > > > results in this error.
> >> > > >
> >> > > > Thanks,
> >> > > > John
> >> > > >
> >> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
> >> > > > met_help at ucar.edu>
> >> > > > wrote:
> >> > > >
> >> > > > >
> >> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
> >> > > > > Transaction: Ticket created by brianne at ucar.edu
> >> > > > >        Queue: met_help
> >> > > > >      Subject: Error code
> >> > > > >        Owner: Nobody
> >> > > > >   Requestors: brianne at ucar.edu
> >> > > > >       Status: new
> >> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> > Ticket/Display.html?id=85542
> >> > > >
> >> > > > >
> >> > > > >
> >> > > > > This is Brianne. I'm working with Pedro and Amanda on the
MADWRF
> >> > > project
> >> > > > > this summer. I recently got this error from running the
lidar2nc
> >> > tool.
> >> > > > Here
> >> > > > > is what it said:
> >> > > > >
> >> > > > > get_hdf_var_info() -> failed to get index for
"Opacity_Flag"
> >> > > > >
> >> > > > > What should I do?
> >> > > > >
> >> > > > > --
> >> > > > > Best,
> >> > > > > *Brianne R. Andersen*
> >> > > > > Student of Meteorology, Metropolitan State University of
Denver
> >> > > > > 720-289-6477
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> > > --
> >> > > Best,
> >> > > *Brianne R. Andersen*
> >> > > Student of Meteorology, Metropolitan State University of
Denver
> >> > > 720-289-6477
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
> >> --
> >> Best,
> >> *Brianne R. Andersen*
> >> Student of Meteorology, Metropolitan State University of Denver
> >> 720-289-6477
> >>
> >>
>
>


--
Best,
*Brianne R. Andersen*
Student of Meteorology, Metropolitan State University of Denver
720-289-6477

------------------------------------------------
Subject: Error code
From: Amanda Anderson
Time: Fri Jun 15 08:35:20 2018

Randy, do you have the physical time to look into this and if so,
would you
need salary support from our project? In the meantime, I'll check with
Pedro about the necessity of using 1 km Calypso rather than 5 km.
Since
we're verifying against a 9km resolution model, he may be willing to
shift
to the lower resolution satellite product.

~Amanda

On Fri, Jun 15, 2018 at 8:16 AM, Brianne Andersen <brianne at ucar.edu>
wrote:

> That would be great. Thanks for looking into this. Is there any way
that
> we could add a dummy field for the conversion to work? Or is the
opacity
> field crucial to the functionality of the lidar2nc tool?
>
>
>
> On Fri, Jun 15, 2018 at 8:12 AM, Randy Bullock via RT
<met_help at ucar.edu>
> wrote:
>
>> John -
>>
>> Sorry ... it's been a long time since I even thought about calypso
files.
>> I could look into it, but not sure how much time would be involved.
>>
>> Randy
>>
>> On Thu, Jun 14, 2018 at 2:09 PM, John Halley Gotway
<johnhg at ucar.edu>
>> wrote:
>>
>> > Brianne,
>> >
>> > Great, thanks for sending that.  I see that they lidar2nc tool is
>> looking
>> > for 11 different variables in each Calipso file.  Only 10 of the
11 are
>> > present in the file you're using.  Just as the error message
states, the
>> > "Opacity Flag" is missing.
>> >
>> > FYI, I ran the "hdp" utility to inventory the Calipso file like
this:
>> >    hdp dumpsds CAL_LID_L2_01kmCLay-ValStage1-
>> V3-40.2018-04-01T00-57-13ZN.hdf
>> > | grep "Variable Name"
>> >
>> >
>> > Randy Bullock (cc'ed here) originally developed this code.
>> Unfortunately,
>> > any fix will require code changes and a recompile.  One
difference I
>> notice
>> > is that your files are named "01km" while our test datasets are
named
>> > "05km".
>> >
>> >
>> > Randy,
>> >
>> >
>> >
>> > Are you familiar with the  difference, if any, between the 01km
and 05km
>> > Calipso files?  Ideally, we'd change that ERROR to a WARNING
message and
>> > just skip that observation type.
>> >
>> >
>> > Can you please take a look at this sample data file:
>> >
>> > /scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-
>> > 04-01T00-57-13ZN.hdf
>> >
>> > Thanks,
>> > John
>> >
>> > On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> >>
>> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>> >>
>> >> yep
>> >>
>> >> met-7.0/bin/lidar2nc \
>> >> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-
>> >> V3-40.2018-04-01T00-57-13ZN.hdf
>> >> \
>> >> -out
calipso/calipso_netcdf/calipso_netcdf_20180401/20180401T0057.nc
>> >>
>> >> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT <
>> >> met_help at ucar.edu> wrote:
>> >>
>> >> > Brianne,
>> >> >
>> >> > Can you please literally cut-and-paste the command I can run
to
>> >> replicate
>> >> > the error?
>> >> >
>> >> > That'll ensure I'm debugging the correct problem.
>> >> >
>> >> > Thanks,
>> >> > John
>> >> >
>> >> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
>> >> > met_help at ucar.edu>
>> >> > wrote:
>> >> >
>> >> > >
>> >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>> >> > >
>> >> > > I am in Kiowa. The path to the data and the attempted netcdf
files
>> are
>> >> > all
>> >> > > under:
>> >> > >
>> >> > > d1/personal/brianne/calipso
>> >> > >
>> >> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via RT
<
>> >> > > met_help at ucar.edu> wrote:
>> >> > >
>> >> > > > Hi Brianne,
>> >> > > >
>> >> > > > Can you please send us (or point us to) a sample data file
so
>> that
>> >> we
>> >> > can
>> >> > > > replicate the behavior?  If you're running on kiowa, I can
just
>> log
>> >> on
>> >> > > and
>> >> > > > grab it.  Please just send me the exact command line
you're
>> running
>> >> > that
>> >> > > > results in this error.
>> >> > > >
>> >> > > > Thanks,
>> >> > > > John
>> >> > > >
>> >> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT <
>> >> > > > met_help at ucar.edu>
>> >> > > > wrote:
>> >> > > >
>> >> > > > >
>> >> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted upon.
>> >> > > > > Transaction: Ticket created by brianne at ucar.edu
>> >> > > > >        Queue: met_help
>> >> > > > >      Subject: Error code
>> >> > > > >        Owner: Nobody
>> >> > > > >   Requestors: brianne at ucar.edu
>> >> > > > >       Status: new
>> >> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
>> >> > Ticket/Display.html?id=85542
>> >> > > >
>> >> > > > >
>> >> > > > >
>> >> > > > > This is Brianne. I'm working with Pedro and Amanda on
the
>> MADWRF
>> >> > > project
>> >> > > > > this summer. I recently got this error from running the
>> lidar2nc
>> >> > tool.
>> >> > > > Here
>> >> > > > > is what it said:
>> >> > > > >
>> >> > > > > get_hdf_var_info() -> failed to get index for
"Opacity_Flag"
>> >> > > > >
>> >> > > > > What should I do?
>> >> > > > >
>> >> > > > > --
>> >> > > > > Best,
>> >> > > > > *Brianne R. Andersen*
>> >> > > > > Student of Meteorology, Metropolitan State University of
Denver
>> >> > > > > 720-289-6477
>> >> > > > >
>> >> > > > >
>> >> > > >
>> >> > > >
>> >> > >
>> >> > >
>> >> > > --
>> >> > > Best,
>> >> > > *Brianne R. Andersen*
>> >> > > Student of Meteorology, Metropolitan State University of
Denver
>> >> > > 720-289-6477
>> >> > >
>> >> > >
>> >> >
>> >> >
>> >>
>> >>
>> >> --
>> >> Best,
>> >> *Brianne R. Andersen*
>> >> Student of Meteorology, Metropolitan State University of Denver
>> >> 720-289-6477
>> >>
>> >>
>>
>>
>
>
> --
> Best,
> *Brianne R. Andersen*
> Student of Meteorology, Metropolitan State University of Denver
> 720-289-6477
>



--
Amanda Siems-Anderson
Associate Scientist III, Research Applications Laboratory
National Center for Atmospheric Research
Tel: 303-497-2746     Email: aander at ucar.edu
https://ral.ucar.edu/wsap/surface-transportation-weather

------------------------------------------------
Subject: Error code
From: Randy Bullock
Time: Fri Jun 15 08:37:41 2018

Amanda -

It'd have to wait until I've done all my work for our next MET
release.
Then I'd probably have some time.

Randy

On Fri, Jun 15, 2018 at 8:35 AM, Amanda Anderson via RT
<met_help at ucar.edu>
wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>
> Randy, do you have the physical time to look into this and if so,
would you
> need salary support from our project? In the meantime, I'll check
with
> Pedro about the necessity of using 1 km Calypso rather than 5 km.
Since
> we're verifying against a 9km resolution model, he may be willing to
shift
> to the lower resolution satellite product.
>
> ~Amanda
>
> On Fri, Jun 15, 2018 at 8:16 AM, Brianne Andersen <brianne at ucar.edu>
> wrote:
>
> > That would be great. Thanks for looking into this. Is there any
way that
> > we could add a dummy field for the conversion to work? Or is the
opacity
> > field crucial to the functionality of the lidar2nc tool?
> >
> >
> >
> > On Fri, Jun 15, 2018 at 8:12 AM, Randy Bullock via RT
<met_help at ucar.edu
> >
> > wrote:
> >
> >> John -
> >>
> >> Sorry ... it's been a long time since I even thought about
calypso
> files.
> >> I could look into it, but not sure how much time would be
involved.
> >>
> >> Randy
> >>
> >> On Thu, Jun 14, 2018 at 2:09 PM, John Halley Gotway
<johnhg at ucar.edu>
> >> wrote:
> >>
> >> > Brianne,
> >> >
> >> > Great, thanks for sending that.  I see that they lidar2nc tool
is
> >> looking
> >> > for 11 different variables in each Calipso file.  Only 10 of
the 11
> are
> >> > present in the file you're using.  Just as the error message
states,
> the
> >> > "Opacity Flag" is missing.
> >> >
> >> > FYI, I ran the "hdp" utility to inventory the Calipso file like
this:
> >> >    hdp dumpsds CAL_LID_L2_01kmCLay-ValStage1-
> >> V3-40.2018-04-01T00-57-13ZN.hdf
> >> > | grep "Variable Name"
> >> >
> >> >
> >> > Randy Bullock (cc'ed here) originally developed this code.
> >> Unfortunately,
> >> > any fix will require code changes and a recompile.  One
difference I
> >> notice
> >> > is that your files are named "01km" while our test datasets are
named
> >> > "05km".
> >> >
> >> >
> >> > Randy,
> >> >
> >> >
> >> >
> >> > Are you familiar with the  difference, if any, between the 01km
and
> 05km
> >> > Calipso files?  Ideally, we'd change that ERROR to a WARNING
message
> and
> >> > just skip that observation type.
> >> >
> >> >
> >> > Can you please take a look at this sample data file:
> >> >
> >> > /scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-
> >> > 04-01T00-57-13ZN.hdf
> >> >
> >> > Thanks,
> >> > John
> >> >
> >> > On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> >>
> >> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542
>
> >> >>
> >> >> yep
> >> >>
> >> >> met-7.0/bin/lidar2nc \
> >> >> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-
> >> >> V3-40.2018-04-01T00-57-13ZN.hdf
> >> >> \
> >> >> -out
calipso/calipso_netcdf/calipso_netcdf_20180401/20180401T0057.nc
> >> >>
> >> >> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT <
> >> >> met_help at ucar.edu> wrote:
> >> >>
> >> >> > Brianne,
> >> >> >
> >> >> > Can you please literally cut-and-paste the command I can run
to
> >> >> replicate
> >> >> > the error?
> >> >> >
> >> >> > That'll ensure I'm debugging the correct problem.
> >> >> >
> >> >> > Thanks,
> >> >> > John
> >> >> >
> >> >> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
> >> >> > met_help at ucar.edu>
> >> >> > wrote:
> >> >> >
> >> >> > >
> >> >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> >> >> > >
> >> >> > > I am in Kiowa. The path to the data and the attempted
netcdf
> files
> >> are
> >> >> > all
> >> >> > > under:
> >> >> > >
> >> >> > > d1/personal/brianne/calipso
> >> >> > >
> >> >> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via
RT <
> >> >> > > met_help at ucar.edu> wrote:
> >> >> > >
> >> >> > > > Hi Brianne,
> >> >> > > >
> >> >> > > > Can you please send us (or point us to) a sample data
file so
> >> that
> >> >> we
> >> >> > can
> >> >> > > > replicate the behavior?  If you're running on kiowa, I
can just
> >> log
> >> >> on
> >> >> > > and
> >> >> > > > grab it.  Please just send me the exact command line
you're
> >> running
> >> >> > that
> >> >> > > > results in this error.
> >> >> > > >
> >> >> > > > Thanks,
> >> >> > > > John
> >> >> > > >
> >> >> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via RT
<
> >> >> > > > met_help at ucar.edu>
> >> >> > > > wrote:
> >> >> > > >
> >> >> > > > >
> >> >> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted
upon.
> >> >> > > > > Transaction: Ticket created by brianne at ucar.edu
> >> >> > > > >        Queue: met_help
> >> >> > > > >      Subject: Error code
> >> >> > > > >        Owner: Nobody
> >> >> > > > >   Requestors: brianne at ucar.edu
> >> >> > > > >       Status: new
> >> >> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> >> >> > Ticket/Display.html?id=85542
> >> >> > > >
> >> >> > > > >
> >> >> > > > >
> >> >> > > > > This is Brianne. I'm working with Pedro and Amanda on
the
> >> MADWRF
> >> >> > > project
> >> >> > > > > this summer. I recently got this error from running
the
> >> lidar2nc
> >> >> > tool.
> >> >> > > > Here
> >> >> > > > > is what it said:
> >> >> > > > >
> >> >> > > > > get_hdf_var_info() -> failed to get index for
"Opacity_Flag"
> >> >> > > > >
> >> >> > > > > What should I do?
> >> >> > > > >
> >> >> > > > > --
> >> >> > > > > Best,
> >> >> > > > > *Brianne R. Andersen*
> >> >> > > > > Student of Meteorology, Metropolitan State University
of
> Denver
> >> >> > > > > 720-289-6477
> >> >> > > > >
> >> >> > > > >
> >> >> > > >
> >> >> > > >
> >> >> > >
> >> >> > >
> >> >> > > --
> >> >> > > Best,
> >> >> > > *Brianne R. Andersen*
> >> >> > > Student of Meteorology, Metropolitan State University of
Denver
> >> >> > > 720-289-6477
> >> >> > >
> >> >> > >
> >> >> >
> >> >> >
> >> >>
> >> >>
> >> >> --
> >> >> Best,
> >> >> *Brianne R. Andersen*
> >> >> Student of Meteorology, Metropolitan State University of
Denver
> >> >> 720-289-6477
> >> >>
> >> >>
> >>
> >>
> >
> >
> > --
> > Best,
> > *Brianne R. Andersen*
> > Student of Meteorology, Metropolitan State University of Denver
> > 720-289-6477
> >
>
>
>
> --
> Amanda Siems-Anderson
> Associate Scientist III, Research Applications Laboratory
> National Center for Atmospheric Research
> Tel: 303-497-2746     Email: aander at ucar.edu
> https://ral.ucar.edu/wsap/surface-transportation-weather
>
>

------------------------------------------------
Subject: Error code
From: John Halley Gotway
Time: Fri Jun 15 12:42:02 2018

Amanda,

Please let us know what you decide about the 1km vs 5km data.  If you
have
a good reason for sticking with the 1km data, we can at least help you
with
a patch to get around that error message.  One option would be for me
to
build a custom version on kiowa for your project where I comment out
references to the "Opacity Flag".  We don't want to slow down progress
on
your project.

And that'd give Randy time to work on a more robust fix for updating
lidar2nc to handle the 1km data in a future release.

Just let us know.

Thanks,
John

On Fri, Jun 15, 2018 at 8:37 AM, Randy Bullock via RT
<met_help at ucar.edu>
wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
>
> Amanda -
>
> It'd have to wait until I've done all my work for our next MET
release.
> Then I'd probably have some time.
>
> Randy
>
> On Fri, Jun 15, 2018 at 8:35 AM, Amanda Anderson via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> >
> > Randy, do you have the physical time to look into this and if so,
would
> you
> > need salary support from our project? In the meantime, I'll check
with
> > Pedro about the necessity of using 1 km Calypso rather than 5 km.
Since
> > we're verifying against a 9km resolution model, he may be willing
to
> shift
> > to the lower resolution satellite product.
> >
> > ~Amanda
> >
> > On Fri, Jun 15, 2018 at 8:16 AM, Brianne Andersen
<brianne at ucar.edu>
> > wrote:
> >
> > > That would be great. Thanks for looking into this. Is there any
way
> that
> > > we could add a dummy field for the conversion to work? Or is the
> opacity
> > > field crucial to the functionality of the lidar2nc tool?
> > >
> > >
> > >
> > > On Fri, Jun 15, 2018 at 8:12 AM, Randy Bullock via RT <
> met_help at ucar.edu
> > >
> > > wrote:
> > >
> > >> John -
> > >>
> > >> Sorry ... it's been a long time since I even thought about
calypso
> > files.
> > >> I could look into it, but not sure how much time would be
involved.
> > >>
> > >> Randy
> > >>
> > >> On Thu, Jun 14, 2018 at 2:09 PM, John Halley Gotway
<johnhg at ucar.edu>
> > >> wrote:
> > >>
> > >> > Brianne,
> > >> >
> > >> > Great, thanks for sending that.  I see that they lidar2nc
tool is
> > >> looking
> > >> > for 11 different variables in each Calipso file.  Only 10 of
the 11
> > are
> > >> > present in the file you're using.  Just as the error message
states,
> > the
> > >> > "Opacity Flag" is missing.
> > >> >
> > >> > FYI, I ran the "hdp" utility to inventory the Calipso file
like
> this:
> > >> >    hdp dumpsds CAL_LID_L2_01kmCLay-ValStage1-
> > >> V3-40.2018-04-01T00-57-13ZN.hdf
> > >> > | grep "Variable Name"
> > >> >
> > >> >
> > >> > Randy Bullock (cc'ed here) originally developed this code.
> > >> Unfortunately,
> > >> > any fix will require code changes and a recompile.  One
difference I
> > >> notice
> > >> > is that your files are named "01km" while our test datasets
are
> named
> > >> > "05km".
> > >> >
> > >> >
> > >> > Randy,
> > >> >
> > >> >
> > >> >
> > >> > Are you familiar with the  difference, if any, between the
01km and
> > 05km
> > >> > Calipso files?  Ideally, we'd change that ERROR to a WARNING
message
> > and
> > >> > just skip that observation type.
> > >> >
> > >> >
> > >> > Can you please take a look at this sample data file:
> > >> >
> > >> > /scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-
> > >> > 04-01T00-57-13ZN.hdf
> > >> >
> > >> > Thanks,
> > >> > John
> > >> >
> > >> > On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> >>
> > >> >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> > >> >>
> > >> >> yep
> > >> >>
> > >> >> met-7.0/bin/lidar2nc \
> > >> >> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-ValStage1-
> > >> >> V3-40.2018-04-01T00-57-13ZN.hdf
> > >> >> \
> > >> >> -out calipso/calipso_netcdf/calipso_netcdf_20180401/
> 20180401T0057.nc
> > >> >>
> > >> >> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via RT
<
> > >> >> met_help at ucar.edu> wrote:
> > >> >>
> > >> >> > Brianne,
> > >> >> >
> > >> >> > Can you please literally cut-and-paste the command I can
run to
> > >> >> replicate
> > >> >> > the error?
> > >> >> >
> > >> >> > That'll ensure I'm debugging the correct problem.
> > >> >> >
> > >> >> > Thanks,
> > >> >> > John
> > >> >> >
> > >> >> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT <
> > >> >> > met_help at ucar.edu>
> > >> >> > wrote:
> > >> >> >
> > >> >> > >
> > >> >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542
> >
> > >> >> > >
> > >> >> > > I am in Kiowa. The path to the data and the attempted
netcdf
> > files
> > >> are
> > >> >> > all
> > >> >> > > under:
> > >> >> > >
> > >> >> > > d1/personal/brianne/calipso
> > >> >> > >
> > >> >> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway via
RT <
> > >> >> > > met_help at ucar.edu> wrote:
> > >> >> > >
> > >> >> > > > Hi Brianne,
> > >> >> > > >
> > >> >> > > > Can you please send us (or point us to) a sample data
file so
> > >> that
> > >> >> we
> > >> >> > can
> > >> >> > > > replicate the behavior?  If you're running on kiowa, I
can
> just
> > >> log
> > >> >> on
> > >> >> > > and
> > >> >> > > > grab it.  Please just send me the exact command line
you're
> > >> running
> > >> >> > that
> > >> >> > > > results in this error.
> > >> >> > > >
> > >> >> > > > Thanks,
> > >> >> > > > John
> > >> >> > > >
> > >> >> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu via
RT <
> > >> >> > > > met_help at ucar.edu>
> > >> >> > > > wrote:
> > >> >> > > >
> > >> >> > > > >
> > >> >> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted
upon.
> > >> >> > > > > Transaction: Ticket created by brianne at ucar.edu
> > >> >> > > > >        Queue: met_help
> > >> >> > > > >      Subject: Error code
> > >> >> > > > >        Owner: Nobody
> > >> >> > > > >   Requestors: brianne at ucar.edu
> > >> >> > > > >       Status: new
> > >> >> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > >> >> > Ticket/Display.html?id=85542
> > >> >> > > >
> > >> >> > > > >
> > >> >> > > > >
> > >> >> > > > > This is Brianne. I'm working with Pedro and Amanda
on the
> > >> MADWRF
> > >> >> > > project
> > >> >> > > > > this summer. I recently got this error from running
the
> > >> lidar2nc
> > >> >> > tool.
> > >> >> > > > Here
> > >> >> > > > > is what it said:
> > >> >> > > > >
> > >> >> > > > > get_hdf_var_info() -> failed to get index for
> "Opacity_Flag"
> > >> >> > > > >
> > >> >> > > > > What should I do?
> > >> >> > > > >
> > >> >> > > > > --
> > >> >> > > > > Best,
> > >> >> > > > > *Brianne R. Andersen*
> > >> >> > > > > Student of Meteorology, Metropolitan State
University of
> > Denver
> > >> >> > > > > 720-289-6477
> > >> >> > > > >
> > >> >> > > > >
> > >> >> > > >
> > >> >> > > >
> > >> >> > >
> > >> >> > >
> > >> >> > > --
> > >> >> > > Best,
> > >> >> > > *Brianne R. Andersen*
> > >> >> > > Student of Meteorology, Metropolitan State University of
Denver
> > >> >> > > 720-289-6477
> > >> >> > >
> > >> >> > >
> > >> >> >
> > >> >> >
> > >> >>
> > >> >>
> > >> >> --
> > >> >> Best,
> > >> >> *Brianne R. Andersen*
> > >> >> Student of Meteorology, Metropolitan State University of
Denver
> > >> >> 720-289-6477
> > >> >>
> > >> >>
> > >>
> > >>
> > >
> > >
> > > --
> > > Best,
> > > *Brianne R. Andersen*
> > > Student of Meteorology, Metropolitan State University of Denver
> > > 720-289-6477
> > >
> >
> >
> >
> > --
> > Amanda Siems-Anderson
> > Associate Scientist III, Research Applications Laboratory
> > National Center for Atmospheric Research
> > Tel: 303-497-2746     Email: aander at ucar.edu
> > https://ral.ucar.edu/wsap/surface-transportation-weather
> >
> >
>
>

------------------------------------------------
Subject: Error code
From: Amanda Anderson
Time: Fri Jun 15 13:07:14 2018

Thank you John. Pedro is looking into the 5km files now. I'll let you
know
as soon as I hear from him.

~Amanda

On Fri, Jun 15, 2018 at 12:42 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:

> Amanda,
>
> Please let us know what you decide about the 1km vs 5km data.  If
you have
> a good reason for sticking with the 1km data, we can at least help
you with
> a patch to get around that error message.  One option would be for
me to
> build a custom version on kiowa for your project where I comment out
> references to the "Opacity Flag".  We don't want to slow down
progress on
> your project.
>
> And that'd give Randy time to work on a more robust fix for updating
> lidar2nc to handle the 1km data in a future release.
>
> Just let us know.
>
> Thanks,
> John
>
> On Fri, Jun 15, 2018 at 8:37 AM, Randy Bullock via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> >
> > Amanda -
> >
> > It'd have to wait until I've done all my work for our next MET
release.
> > Then I'd probably have some time.
> >
> > Randy
> >
> > On Fri, Jun 15, 2018 at 8:35 AM, Amanda Anderson via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> > >
> > > Randy, do you have the physical time to look into this and if
so, would
> > you
> > > need salary support from our project? In the meantime, I'll
check with
> > > Pedro about the necessity of using 1 km Calypso rather than 5
km. Since
> > > we're verifying against a 9km resolution model, he may be
willing to
> > shift
> > > to the lower resolution satellite product.
> > >
> > > ~Amanda
> > >
> > > On Fri, Jun 15, 2018 at 8:16 AM, Brianne Andersen
<brianne at ucar.edu>
> > > wrote:
> > >
> > > > That would be great. Thanks for looking into this. Is there
any way
> > that
> > > > we could add a dummy field for the conversion to work? Or is
the
> > opacity
> > > > field crucial to the functionality of the lidar2nc tool?
> > > >
> > > >
> > > >
> > > > On Fri, Jun 15, 2018 at 8:12 AM, Randy Bullock via RT <
> > met_help at ucar.edu
> > > >
> > > > wrote:
> > > >
> > > >> John -
> > > >>
> > > >> Sorry ... it's been a long time since I even thought about
calypso
> > > files.
> > > >> I could look into it, but not sure how much time would be
involved.
> > > >>
> > > >> Randy
> > > >>
> > > >> On Thu, Jun 14, 2018 at 2:09 PM, John Halley Gotway <
> johnhg at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> > Brianne,
> > > >> >
> > > >> > Great, thanks for sending that.  I see that they lidar2nc
tool is
> > > >> looking
> > > >> > for 11 different variables in each Calipso file.  Only 10
of the
> 11
> > > are
> > > >> > present in the file you're using.  Just as the error
message
> states,
> > > the
> > > >> > "Opacity Flag" is missing.
> > > >> >
> > > >> > FYI, I ran the "hdp" utility to inventory the Calipso file
like
> > this:
> > > >> >    hdp dumpsds CAL_LID_L2_01kmCLay-ValStage1-
> > > >> V3-40.2018-04-01T00-57-13ZN.hdf
> > > >> > | grep "Variable Name"
> > > >> >
> > > >> >
> > > >> > Randy Bullock (cc'ed here) originally developed this code.
> > > >> Unfortunately,
> > > >> > any fix will require code changes and a recompile.  One
> difference I
> > > >> notice
> > > >> > is that your files are named "01km" while our test datasets
are
> > named
> > > >> > "05km".
> > > >> >
> > > >> >
> > > >> > Randy,
> > > >> >
> > > >> >
> > > >> >
> > > >> > Are you familiar with the  difference, if any, between the
01km
> and
> > > 05km
> > > >> > Calipso files?  Ideally, we'd change that ERROR to a
WARNING
> message
> > > and
> > > >> > just skip that observation type.
> > > >> >
> > > >> >
> > > >> > Can you please take a look at this sample data file:
> > > >> >
> > > >> > /scratch/johnhg/CAL_LID_L2_01kmCLay-ValStage1-V3-40.2018-
> > > >> > 04-01T00-57-13ZN.hdf
> > > >> >
> > > >> > Thanks,
> > > >> > John
> > > >> >
> > > >> > On Thu, Jun 14, 2018 at 12:49 PM brianne at ucar.edu via RT <
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> >>
> > > >> >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=85542 >
> > > >> >>
> > > >> >> yep
> > > >> >>
> > > >> >> met-7.0/bin/lidar2nc \
> > > >> >> calipso/calipso_data/20180401/CAL_LID_L2_01kmCLay-
ValStage1-
> > > >> >> V3-40.2018-04-01T00-57-13ZN.hdf
> > > >> >> \
> > > >> >> -out calipso/calipso_netcdf/calipso_netcdf_20180401/
> > 20180401T0057.nc
> > > >> >>
> > > >> >> On Thu, Jun 14, 2018 at 12:44 PM, John Halley Gotway via
RT <
> > > >> >> met_help at ucar.edu> wrote:
> > > >> >>
> > > >> >> > Brianne,
> > > >> >> >
> > > >> >> > Can you please literally cut-and-paste the command I can
run to
> > > >> >> replicate
> > > >> >> > the error?
> > > >> >> >
> > > >> >> > That'll ensure I'm debugging the correct problem.
> > > >> >> >
> > > >> >> > Thanks,
> > > >> >> > John
> > > >> >> >
> > > >> >> > On Thu, Jun 14, 2018 at 12:41 PM brianne at ucar.edu via RT
<
> > > >> >> > met_help at ucar.edu>
> > > >> >> > wrote:
> > > >> >> >
> > > >> >> > >
> > > >> >> > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=85542
> > >
> > > >> >> > >
> > > >> >> > > I am in Kiowa. The path to the data and the attempted
netcdf
> > > files
> > > >> are
> > > >> >> > all
> > > >> >> > > under:
> > > >> >> > >
> > > >> >> > > d1/personal/brianne/calipso
> > > >> >> > >
> > > >> >> > > On Thu, Jun 14, 2018 at 12:29 PM, John Halley Gotway
via RT <
> > > >> >> > > met_help at ucar.edu> wrote:
> > > >> >> > >
> > > >> >> > > > Hi Brianne,
> > > >> >> > > >
> > > >> >> > > > Can you please send us (or point us to) a sample
data file
> so
> > > >> that
> > > >> >> we
> > > >> >> > can
> > > >> >> > > > replicate the behavior?  If you're running on kiowa,
I can
> > just
> > > >> log
> > > >> >> on
> > > >> >> > > and
> > > >> >> > > > grab it.  Please just send me the exact command line
you're
> > > >> running
> > > >> >> > that
> > > >> >> > > > results in this error.
> > > >> >> > > >
> > > >> >> > > > Thanks,
> > > >> >> > > > John
> > > >> >> > > >
> > > >> >> > > > On Thu, Jun 14, 2018 at 11:43 AM brianne at ucar.edu
via RT <
> > > >> >> > > > met_help at ucar.edu>
> > > >> >> > > > wrote:
> > > >> >> > > >
> > > >> >> > > > >
> > > >> >> > > > > Thu Jun 14 11:42:58 2018: Request 85542 was acted
upon.
> > > >> >> > > > > Transaction: Ticket created by brianne at ucar.edu
> > > >> >> > > > >        Queue: met_help
> > > >> >> > > > >      Subject: Error code
> > > >> >> > > > >        Owner: Nobody
> > > >> >> > > > >   Requestors: brianne at ucar.edu
> > > >> >> > > > >       Status: new
> > > >> >> > > > >  Ticket <URL: https://rt.rap.ucar.edu/rt/
> > > >> >> > Ticket/Display.html?id=85542
> > > >> >> > > >
> > > >> >> > > > >
> > > >> >> > > > >
> > > >> >> > > > > This is Brianne. I'm working with Pedro and Amanda
on the
> > > >> MADWRF
> > > >> >> > > project
> > > >> >> > > > > this summer. I recently got this error from
running the
> > > >> lidar2nc
> > > >> >> > tool.
> > > >> >> > > > Here
> > > >> >> > > > > is what it said:
> > > >> >> > > > >
> > > >> >> > > > > get_hdf_var_info() -> failed to get index for
> > "Opacity_Flag"
> > > >> >> > > > >
> > > >> >> > > > > What should I do?
> > > >> >> > > > >
> > > >> >> > > > > --
> > > >> >> > > > > Best,
> > > >> >> > > > > *Brianne R. Andersen*
> > > >> >> > > > > Student of Meteorology, Metropolitan State
University of
> > > Denver
> > > >> >> > > > > 720-289-6477
> > > >> >> > > > >
> > > >> >> > > > >
> > > >> >> > > >
> > > >> >> > > >
> > > >> >> > >
> > > >> >> > >
> > > >> >> > > --
> > > >> >> > > Best,
> > > >> >> > > *Brianne R. Andersen*
> > > >> >> > > Student of Meteorology, Metropolitan State University
of
> Denver
> > > >> >> > > 720-289-6477
> > > >> >> > >
> > > >> >> > >
> > > >> >> >
> > > >> >> >
> > > >> >>
> > > >> >>
> > > >> >> --
> > > >> >> Best,
> > > >> >> *Brianne R. Andersen*
> > > >> >> Student of Meteorology, Metropolitan State University of
Denver
> > > >> >> 720-289-6477
> > > >> >>
> > > >> >>
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Best,
> > > > *Brianne R. Andersen*
> > > > Student of Meteorology, Metropolitan State University of
Denver
> > > > 720-289-6477
> > > >
> > >
> > >
> > >
> > > --
> > > Amanda Siems-Anderson
> > > Associate Scientist III, Research Applications Laboratory
> > > National Center for Atmospheric Research
> > > Tel: 303-497-2746     Email: aander at ucar.edu
> > > https://ral.ucar.edu/wsap/surface-transportation-weather
> > >
> > >
> >
> >
>
>


--
Amanda Siems-Anderson
Associate Scientist III, Research Applications Laboratory
National Center for Atmospheric Research
Tel: 303-497-2746     Email: aander at ucar.edu
https://ral.ucar.edu/wsap/surface-transportation-weather

------------------------------------------------


More information about the Met_help mailing list