[Met_help] [rt.rap.ucar.edu #86896] History for Re: read binary file in MET6
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:07:25 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I sent an email to met_help and realized my email attachment size is above
the maximum limit. So, I am sending the link page of the dataset which I am
trying to read usng MET6. Take any day from this page :
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/jhuang/npp.viirs.aerosol.data/edraot550/2012/
.
Debasish
On Mon, Sep 10, 2018 at 1:42 PM Debasish Hazra <debasish.hazra5 at gmail.com>
wrote:
> Hi,
>
> How do we read binary gridded satellite file in MET6 ? I have attached one
> file in the attachment, which is VIIRS AOT daily file at 0.25 degree and
> need help how to read that in MET6 ? Thanks
>
> Debasish
>
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: read binary file in MET6
From: John Halley Gotway
Time: Mon Sep 10 13:27:09 2018
Debasish,
I see you have a question about how to read binary VIIRS data into
MET.
Unfortunately, MET doesn't currently support that binary data format.
For met-6.0, the only option would be reformatting it to a gridded
data
file format that MET does support, like GRIB1/2, CF-Compliant NetCDF,
or
make it look like the NetCDF format used internally in the MET tools.
We are currently working on development for met-8.0. And that version
will
include a new feature to enable MET to call a Python script to read
gridded
data. Here's how it'd work...
- You write a python script to read data from the input binary
file.
- That script loads the data into a 2-dimensional NumPy array.
- And that script defines metadata, like the "name" for the data,
timing
information, and grid projection information.
- When you run MET, you pass as input the Python script to be run.
In this way, you'd be able to do the reformatting on the fly. While
met-8.0 has not yet been released, I'd be happy to share a beta
version of
the code with you if you'd like to try it out.
Hope that helps.
Thanks,
John
On Mon, Sep 10, 2018 at 11:54 AM Debasish Hazra via RT
<met_help at ucar.edu>
wrote:
>
> Mon Sep 10 11:54:05 2018: Request 86896 was acted upon.
> Transaction: Ticket created by debasish.hazra5 at gmail.com
> Queue: met_help
> Subject: Re: read binary file in MET6
> Owner: Nobody
> Requestors: debasish.hazra5 at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=86896 >
>
>
> Hi,
>
> I sent an email to met_help and realized my email attachment size is
above
> the maximum limit. So, I am sending the link page of the dataset
which I am
> trying to read usng MET6. Take any day from this page :
>
>
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/jhuang/npp.viirs.aerosol.data/edraot550/2012/
> .
>
> Debasish
>
> On Mon, Sep 10, 2018 at 1:42 PM Debasish Hazra
<debasish.hazra5 at gmail.com>
> wrote:
>
> > Hi,
> >
> > How do we read binary gridded satellite file in MET6 ? I have
attached
> one
> > file in the attachment, which is VIIRS AOT daily file at 0.25
degree and
> > need help how to read that in MET6 ? Thanks
> >
> > Debasish
> >
>
>
------------------------------------------------
Subject: Re: read binary file in MET6
From: Debasish Hazra
Time: Mon Sep 10 17:32:26 2018
Thanks John for your reply. Would you please specify how do I make it
look
like netCDF using MET6?
Also I am interested in trying your upcoming release beta version.
Thanks
Debasish
On Mon, Sep 10, 2018 at 3:27 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Debasish,
>
> I see you have a question about how to read binary VIIRS data into
MET.
> Unfortunately, MET doesn't currently support that binary data
format.
>
> For met-6.0, the only option would be reformatting it to a gridded
data
> file format that MET does support, like GRIB1/2, CF-Compliant
NetCDF, or
> make it look like the NetCDF format used internally in the MET
tools.
>
> We are currently working on development for met-8.0. And that
version will
> include a new feature to enable MET to call a Python script to read
gridded
> data. Here's how it'd work...
> - You write a python script to read data from the input binary
file.
> - That script loads the data into a 2-dimensional NumPy array.
> - And that script defines metadata, like the "name" for the data,
timing
> information, and grid projection information.
> - When you run MET, you pass as input the Python script to be
run.
>
> In this way, you'd be able to do the reformatting on the fly. While
> met-8.0 has not yet been released, I'd be happy to share a beta
version of
> the code with you if you'd like to try it out.
>
> Hope that helps.
>
> Thanks,
> John
>
> On Mon, Sep 10, 2018 at 11:54 AM Debasish Hazra via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Mon Sep 10 11:54:05 2018: Request 86896 was acted upon.
> > Transaction: Ticket created by debasish.hazra5 at gmail.com
> > Queue: met_help
> > Subject: Re: read binary file in MET6
> > Owner: Nobody
> > Requestors: debasish.hazra5 at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=86896 >
> >
> >
> > Hi,
> >
> > I sent an email to met_help and realized my email attachment size
is
> above
> > the maximum limit. So, I am sending the link page of the dataset
which I
> am
> > trying to read usng MET6. Take any day from this page :
> >
> >
>
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/jhuang/npp.viirs.aerosol.data/edraot550/2012/
> > .
> >
> > Debasish
> >
> > On Mon, Sep 10, 2018 at 1:42 PM Debasish Hazra <
> debasish.hazra5 at gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > How do we read binary gridded satellite file in MET6 ? I have
attached
> > one
> > > file in the attachment, which is VIIRS AOT daily file at 0.25
degree
> and
> > > need help how to read that in MET6 ? Thanks
> > >
> > > Debasish
> > >
> >
> >
>
>
------------------------------------------------
Subject: Re: read binary file in MET6
From: John Halley Gotway
Time: Wed Sep 12 16:38:09 2018
Debasish,
I just posted the met-8.0_beta8 release. You can find it here:
- MET Website:
https://dtcenter.org/met/users/downloads/MET_releases/met-
8.0_beta8.20180912.tar.gz
- RAL ftp site:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/met-
8.0_beta8.20180912.tar.gz
The easiest thing to do to see the NetCDF format used by MET is just
run a
sample file through the pcp_combine tool and then mimic the resulting
output file. When you compile MET, you can run "make test" and
that'll
generate output in the "out/pcp_combine" directory. Just run "ncdump
-h"
on a file there to see what the header looks like.
Ultimately, you'll need to know the grid definition. Lat/Lon, Lambert
Conformal, Polar Sterographic, or Mercator?
Thanks,
John
On Mon, Sep 10, 2018 at 5:32 PM Debasish Hazra via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=86896 >
>
> Thanks John for your reply. Would you please specify how do I make
it look
> like netCDF using MET6?
>
> Also I am interested in trying your upcoming release beta version.
>
> Thanks
> Debasish
>
> On Mon, Sep 10, 2018 at 3:27 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Debasish,
> >
> > I see you have a question about how to read binary VIIRS data into
MET.
> > Unfortunately, MET doesn't currently support that binary data
format.
> >
> > For met-6.0, the only option would be reformatting it to a gridded
data
> > file format that MET does support, like GRIB1/2, CF-Compliant
NetCDF, or
> > make it look like the NetCDF format used internally in the MET
tools.
> >
> > We are currently working on development for met-8.0. And that
version
> will
> > include a new feature to enable MET to call a Python script to
read
> gridded
> > data. Here's how it'd work...
> > - You write a python script to read data from the input binary
file.
> > - That script loads the data into a 2-dimensional NumPy array.
> > - And that script defines metadata, like the "name" for the
data,
> timing
> > information, and grid projection information.
> > - When you run MET, you pass as input the Python script to be
run.
> >
> > In this way, you'd be able to do the reformatting on the fly.
While
> > met-8.0 has not yet been released, I'd be happy to share a beta
version
> of
> > the code with you if you'd like to try it out.
> >
> > Hope that helps.
> >
> > Thanks,
> > John
> >
> > On Mon, Sep 10, 2018 at 11:54 AM Debasish Hazra via RT <
> met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Mon Sep 10 11:54:05 2018: Request 86896 was acted upon.
> > > Transaction: Ticket created by debasish.hazra5 at gmail.com
> > > Queue: met_help
> > > Subject: Re: read binary file in MET6
> > > Owner: Nobody
> > > Requestors: debasish.hazra5 at gmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=86896
> >
> > >
> > >
> > > Hi,
> > >
> > > I sent an email to met_help and realized my email attachment
size is
> > above
> > > the maximum limit. So, I am sending the link page of the dataset
which
> I
> > am
> > > trying to read usng MET6. Take any day from this page :
> > >
> > >
> >
>
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/jhuang/npp.viirs.aerosol.data/edraot550/2012/
> > > .
> > >
> > > Debasish
> > >
> > > On Mon, Sep 10, 2018 at 1:42 PM Debasish Hazra <
> > debasish.hazra5 at gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > How do we read binary gridded satellite file in MET6 ? I have
> attached
> > > one
> > > > file in the attachment, which is VIIRS AOT daily file at 0.25
degree
> > and
> > > > need help how to read that in MET6 ? Thanks
> > > >
> > > > Debasish
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list