[Met_help] [rt.rap.ucar.edu #88839] History for regrid GEOS16 Data
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:06:58 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I am using regrid_data_plane to process GOES16 AOD data following example
shown in MET 8 User guide. But when I was trying to check the output in
plot_data_plane or NCL, they return blank. Regrid process does not show any
error apparently. I have attached the script (tried two different
processes to use coordinate Grids) and put data in ftp. Any suggestions?
Thanks
Partha
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: regrid GEOS16 Data
From: John Halley Gotway
Time: Mon Feb 11 09:39:10 2019
Howard,
Partha (from NCEP) wrote a met-help question about regrid_data_plane
not
working well on some GOES16 AOD data. I placed the sample data he
sent us
on dakota in:
/d3/projects/MET/MET_Help/partha_data_20190211
I get a segfault when I run the exact command he sent:
/usr/local/met-8.0/bin/regrid_data_plane \
OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc \
G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
-field 'name="AOD"; level="(*,*)";' \
-coord g16_conus_latlon_2km_20180620.dat \
-qc 0 -method UW_MEAN -v 6
Maybe that's because the g16_conus_latlon_2km_20180620.dat file
doesn't
exist in my directory?
I also don't understand why the input file has a .nc suffix. It's not
a
NetCDF file.
Could you please take a look? We always want to avoid segfaults, so
it'd
be a good idea to debug that and exit with a useful error message
instead.
Thanks,
John
On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> Queue: met_help
> Subject: regrid GEOS16 Data
> Owner: Nobody
> Requestors: partha.bhattacharjee at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>
>
> Hi,
> I am using regrid_data_plane to process GOES16 AOD data following
example
> shown in MET 8 User guide. But when I was trying to check the output
in
> plot_data_plane or NCL, they return blank. Regrid process does not
show any
> error apparently. I have attached the script (tried two different
> processes to use coordinate Grids) and put data in ftp. Any
suggestions?
> Thanks
> Partha
>
>
------------------------------------------------
Subject: regrid GEOS16 Data
From: Howard Soh
Time: Mon Feb 11 11:11:22 2019
The input file is not valid GOES data (it's not a NetCDF format).
It's been fixed at the latest MET with the enhancement of GOES 16. The
fix was checked in to 8.0 bug fix branch.
- src/tools/other/regrid_data_plane/regrid_data_plane.cc
The log message will be:
ERROR :
ERROR : process_data_only_file() ->
"OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc"
not a valid data file
ERROR :
Cheers,
Howard
On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> Howard,
>
> Partha (from NCEP) wrote a met-help question about regrid_data_plane
> not working well on some GOES16 AOD data. I placed the sample data
he
> sent us on dakota in:
> /d3/projects/MET/MET_Help/partha_data_20190211
>
> I get a segfault when I run the exact command he sent:
>
> /usr/local/met-8.0/bin/regrid_data_plane \
> OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc \
> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> -field 'name="AOD"; level="(*,*)";' \
> -coord g16_conus_latlon_2km_20180620.dat \
> -qc 0 -method UW_MEAN -v 6
>
> Maybe that's because the g16_conus_latlon_2km_20180620.dat file
> doesn't exist in my directory?
> I also don't understand why the input file has a .nc suffix. It's
not
> a NetCDF file.
>
> Could you please take a look? We always want to avoid segfaults, so
> it'd be a good idea to debug that and exit with a useful error
message
> instead.
>
> Thanks,
> John
>
> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
>
>
> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> <mailto:partha.bhattacharjee at noaa.gov>
> Queue: met_help
> Subject: regrid GEOS16 Data
> Owner: Nobody
> Requestors: partha.bhattacharjee at noaa.gov
> <mailto:partha.bhattacharjee at noaa.gov>
> Status: new
> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>
>
> Hi,
> I am using regrid_data_plane to process GOES16 AOD data
following
> example
> shown in MET 8 User guide. But when I was trying to check the
> output in
> plot_data_plane or NCL, they return blank. Regrid process does
not
> show any
> error apparently. I have attached the script (tried two
different
> processes to use coordinate Grids) and put data in ftp. Any
> suggestions?
> Thanks
> Partha
>
------------------------------------------------
Subject: regrid GEOS16 Data
From: John Halley Gotway
Time: Mon Feb 11 11:24:47 2019
Partha,
The input data you sent me isn't actually a NetCDF file... even though
it
has a .nc suffix. The regrid_data_plane tool is designed to process
NetCDF
GOES16 AOD data. Perhaps your sample file was corrupted in some way?
Thanks,
John
On Mon, Feb 11, 2019 at 11:11 AM Howard Soh via RT <met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>
> The input file is not valid GOES data (it's not a NetCDF format).
>
> It's been fixed at the latest MET with the enhancement of GOES 16.
The
> fix was checked in to 8.0 bug fix branch.
>
> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
>
> The log message will be:
>
> ERROR :
> ERROR : process_data_only_file() ->
> "OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc"
>
> not a valid data file
> ERROR :
>
> Cheers,
> Howard
>
> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> > Howard,
> >
> > Partha (from NCEP) wrote a met-help question about
regrid_data_plane
> > not working well on some GOES16 AOD data. I placed the sample data
he
> > sent us on dakota in:
> > /d3/projects/MET/MET_Help/partha_data_20190211
> >
> > I get a segfault when I run the exact command he sent:
> >
> > /usr/local/met-8.0/bin/regrid_data_plane \
> > OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc
> \
> > G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> > -field 'name="AOD"; level="(*,*)";' \
> > -coord g16_conus_latlon_2km_20180620.dat \
> > -qc 0 -method UW_MEAN -v 6
> >
> > Maybe that's because the g16_conus_latlon_2km_20180620.dat file
> > doesn't exist in my directory?
> > I also don't understand why the input file has a .nc suffix. It's
not
> > a NetCDF file.
> >
> > Could you please take a look? We always want to avoid segfaults,
so
> > it'd be a good idea to debug that and exit with a useful error
message
> > instead.
> >
> > Thanks,
> > John
> >
> > On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
> > via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
> >
> >
> > Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > <mailto:partha.bhattacharjee at noaa.gov>
> > Queue: met_help
> > Subject: regrid GEOS16 Data
> > Owner: Nobody
> > Requestors: partha.bhattacharjee at noaa.gov
> > <mailto:partha.bhattacharjee at noaa.gov>
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >
> >
> > Hi,
> > I am using regrid_data_plane to process GOES16 AOD data
following
> > example
> > shown in MET 8 User guide. But when I was trying to check the
> > output in
> > plot_data_plane or NCL, they return blank. Regrid process does
not
> > show any
> > error apparently. I have attached the script (tried two
different
> > processes to use coordinate Grids) and put data in ftp. Any
> > suggestions?
> > Thanks
> > Partha
> >
>
>
>
------------------------------------------------
Subject: regrid GEOS16 Data
From: Partha Bhattacharjee - NOAA Affiliate
Time: Mon Feb 11 11:27:19 2019
Thanks John. I got that from someone and let you know about it.
Partha
On Mon, Feb 11, 2019 at 1:24 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Partha,
>
> The input data you sent me isn't actually a NetCDF file... even
though it
> has a .nc suffix. The regrid_data_plane tool is designed to process
NetCDF
> GOES16 AOD data. Perhaps your sample file was corrupted in some
way?
>
> Thanks,
> John
>
> On Mon, Feb 11, 2019 at 11:11 AM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >
> > The input file is not valid GOES data (it's not a NetCDF format).
> >
> > It's been fixed at the latest MET with the enhancement of GOES 16.
The
> > fix was checked in to 8.0 bug fix branch.
> >
> > - src/tools/other/regrid_data_plane/regrid_data_plane.cc
> >
> > The log message will be:
> >
> > ERROR :
> > ERROR : process_data_only_file() ->
> > "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> c20182301007189.nc"
> >
> > not a valid data file
> > ERROR :
> >
> > Cheers,
> > Howard
> >
> > On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> > > Howard,
> > >
> > > Partha (from NCEP) wrote a met-help question about
regrid_data_plane
> > > not working well on some GOES16 AOD data. I placed the sample
data he
> > > sent us on dakota in:
> > > /d3/projects/MET/MET_Help/partha_data_20190211
> > >
> > > I get a segfault when I run the exact command he sent:
> > >
> > > /usr/local/met-8.0/bin/regrid_data_plane \
> > > OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> c20182301007189.nc
> > \
> > > G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> > > -field 'name="AOD"; level="(*,*)";' \
> > > -coord g16_conus_latlon_2km_20180620.dat \
> > > -qc 0 -method UW_MEAN -v 6
> > >
> > > Maybe that's because the g16_conus_latlon_2km_20180620.dat file
> > > doesn't exist in my directory?
> > > I also don't understand why the input file has a .nc suffix.
It's not
> > > a NetCDF file.
> > >
> > > Could you please take a look? We always want to avoid
segfaults, so
> > > it'd be a good idea to debug that and exit with a useful error
message
> > > instead.
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
> > > via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
> > >
> > >
> > > Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> > > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > > <mailto:partha.bhattacharjee at noaa.gov>
> > > Queue: met_help
> > > Subject: regrid GEOS16 Data
> > > Owner: Nobody
> > > Requestors: partha.bhattacharjee at noaa.gov
> > > <mailto:partha.bhattacharjee at noaa.gov>
> > > Status: new
> > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > >
> > >
> > > Hi,
> > > I am using regrid_data_plane to process GOES16 AOD data
following
> > > example
> > > shown in MET 8 User guide. But when I was trying to check
the
> > > output in
> > > plot_data_plane or NCL, they return blank. Regrid process
does not
> > > show any
> > > error apparently. I have attached the script (tried two
different
> > > processes to use coordinate Grids) and put data in ftp. Any
> > > suggestions?
> > > Thanks
> > > Partha
> > >
> >
> >
> >
>
> --
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: regrid GEOS16 Data
From: Partha Bhattacharjee - NOAA Affiliate
Time: Mon Feb 11 16:16:56 2019
John,
Apparently those netcdf files came from NESDIS site :
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-16/NRT/CONUS/AOD/
I put those data in my WCOSS
gyre /global/noscrub/Partha.Bhattacharjee/NAQFC_data and I downloaded
1
from ftp site
(OR_ABI-L2-AODC-
M3_G16_s20190411002137_e20190411004510_c20190411005261.nc).
"plot_data_plane" for both files can not be read using MET.
Thanks
Partha
On Mon, Feb 11, 2019 at 1:27 PM Partha Bhattacharjee - NOAA Affiliate
<
partha.bhattacharjee at noaa.gov> wrote:
> Thanks John. I got that from someone and let you know about it.
> Partha
>
> On Mon, Feb 11, 2019 at 1:24 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Partha,
>>
>> The input data you sent me isn't actually a NetCDF file... even
though it
>> has a .nc suffix. The regrid_data_plane tool is designed to
process
>> NetCDF
>> GOES16 AOD data. Perhaps your sample file was corrupted in some
way?
>>
>> Thanks,
>> John
>>
>> On Mon, Feb 11, 2019 at 11:11 AM Howard Soh via RT
<met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>> >
>> > The input file is not valid GOES data (it's not a NetCDF format).
>> >
>> > It's been fixed at the latest MET with the enhancement of GOES
16. The
>> > fix was checked in to 8.0 bug fix branch.
>> >
>> > - src/tools/other/regrid_data_plane/regrid_data_plane.cc
>> >
>> > The log message will be:
>> >
>> > ERROR :
>> > ERROR : process_data_only_file() ->
>> > "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
>> c20182301007189.nc"
>> >
>> > not a valid data file
>> > ERROR :
>> >
>> > Cheers,
>> > Howard
>> >
>> > On 2/11/2019 9:38 AM, John Halley Gotway wrote:
>> > > Howard,
>> > >
>> > > Partha (from NCEP) wrote a met-help question about
regrid_data_plane
>> > > not working well on some GOES16 AOD data. I placed the sample
data he
>> > > sent us on dakota in:
>> > > /d3/projects/MET/MET_Help/partha_data_20190211
>> > >
>> > > I get a segfault when I run the exact command he sent:
>> > >
>> > > /usr/local/met-8.0/bin/regrid_data_plane \
>> > > OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
>> c20182301007189.nc
>> > \
>> > > G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
>> > > -field 'name="AOD"; level="(*,*)";' \
>> > > -coord g16_conus_latlon_2km_20180620.dat \
>> > > -qc 0 -method UW_MEAN -v 6
>> > >
>> > > Maybe that's because the g16_conus_latlon_2km_20180620.dat file
>> > > doesn't exist in my directory?
>> > > I also don't understand why the input file has a .nc suffix.
It's not
>> > > a NetCDF file.
>> > >
>> > > Could you please take a look? We always want to avoid
segfaults, so
>> > > it'd be a good idea to debug that and exit with a useful error
message
>> > > instead.
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > > On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
>> > > via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
>> > >
>> > >
>> > > Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
>> > > Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
>> > > <mailto:partha.bhattacharjee at noaa.gov>
>> > > Queue: met_help
>> > > Subject: regrid GEOS16 Data
>> > > Owner: Nobody
>> > > Requestors: partha.bhattacharjee at noaa.gov
>> > > <mailto:partha.bhattacharjee at noaa.gov>
>> > > Status: new
>> > > Ticket <URL:
>> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>> > >
>> > >
>> > > Hi,
>> > > I am using regrid_data_plane to process GOES16 AOD data
following
>> > > example
>> > > shown in MET 8 User guide. But when I was trying to check
the
>> > > output in
>> > > plot_data_plane or NCL, they return blank. Regrid process
does not
>> > > show any
>> > > error apparently. I have attached the script (tried two
different
>> > > processes to use coordinate Grids) and put data in ftp. Any
>> > > suggestions?
>> > > Thanks
>> > > Partha
>> > >
>> >
>> >
>> >
>>
>> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: regrid GEOS16 Data
From: Partha Bhattacharjee - NOAA Affiliate
Time: Mon Feb 11 16:33:25 2019
Thanks Howard. Those netcdf files came from NESDIS test products :
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-16/NRT/CONUS/AOD/
So, how can I read those files using bug-fix MET ?
Partha
On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> The input file is not valid GOES data (it's not a NetCDF format).
>
> It's been fixed at the latest MET with the enhancement of GOES 16.
The
> fix was checked in to 8.0 bug fix branch.
>
> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
>
> The log message will be:
>
> ERROR :
> ERROR : process_data_only_file() ->
> "OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc"
>
> not a valid data file
> ERROR :
>
> Cheers,
> Howard
>
> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> > Howard,
> >
> > Partha (from NCEP) wrote a met-help question about
regrid_data_plane
> > not working well on some GOES16 AOD data. I placed the sample data
he
> > sent us on dakota in:
> > /d3/projects/MET/MET_Help/partha_data_20190211
> >
> > I get a segfault when I run the exact command he sent:
> >
> > /usr/local/met-8.0/bin/regrid_data_plane \
> > OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc
> \
> > G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> > -field 'name="AOD"; level="(*,*)";' \
> > -coord g16_conus_latlon_2km_20180620.dat \
> > -qc 0 -method UW_MEAN -v 6
> >
> > Maybe that's because the g16_conus_latlon_2km_20180620.dat file
> > doesn't exist in my directory?
> > I also don't understand why the input file has a .nc suffix. It's
not
> > a NetCDF file.
> >
> > Could you please take a look? We always want to avoid segfaults,
so
> > it'd be a good idea to debug that and exit with a useful error
message
> > instead.
> >
> > Thanks,
> > John
> >
> > On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
> > via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
> >
> >
> > Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > <mailto:partha.bhattacharjee at noaa.gov>
> > Queue: met_help
> > Subject: regrid GEOS16 Data
> > Owner: Nobody
> > Requestors: partha.bhattacharjee at noaa.gov
> > <mailto:partha.bhattacharjee at noaa.gov>
> > Status: new
> > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >
> >
> > Hi,
> > I am using regrid_data_plane to process GOES16 AOD data
following
> > example
> > shown in MET 8 User guide. But when I was trying to check the
> > output in
> > plot_data_plane or NCL, they return blank. Regrid process does
not
> > show any
> > error apparently. I have attached the script (tried two
different
> > processes to use coordinate Grids) and put data in ftp. Any
> > suggestions?
> > Thanks
> > Partha
> >
>
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #88839] regrid GEOS16 Data
From: Howard Soh
Time: Mon Feb 11 17:32:39 2019
The bug fix is for invalid input data.
I don't see the file mentioned early at
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/20190211/.
The other files there work well for me.
If ncdump is available, you can check the GOES data file:
Good input:
ncdump -k
OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
netCDF-4
ncdump -v AOD
OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
OR
Bad input:
hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc
ncdump:
partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc:
NetCDF: Unknown file format
Cheers,
Howard
On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate via RT
wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>
> Thanks Howard. Those netcdf files came from NESDIS test products :
> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/
> So, how can I read those files using bug-fix MET ?
> Partha
>
> On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
<met_help at ucar.edu> wrote:
>
>> The input file is not valid GOES data (it's not a NetCDF format).
>>
>> It's been fixed at the latest MET with the enhancement of GOES 16.
The
>> fix was checked in to 8.0 bug fix branch.
>>
>> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
>>
>> The log message will be:
>>
>> ERROR :
>> ERROR : process_data_only_file() ->
>> "OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc"
>>
>> not a valid data file
>> ERROR :
>>
>> Cheers,
>> Howard
>>
>> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
>>> Howard,
>>>
>>> Partha (from NCEP) wrote a met-help question about
regrid_data_plane
>>> not working well on some GOES16 AOD data. I placed the sample data
he
>>> sent us on dakota in:
>>> /d3/projects/MET/MET_Help/partha_data_20190211
>>>
>>> I get a segfault when I run the exact command he sent:
>>>
>>> /usr/local/met-8.0/bin/regrid_data_plane \
>>> OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_c20182301007189.nc
>> \
>>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
>>> -field 'name="AOD"; level="(*,*)";' \
>>> -coord g16_conus_latlon_2km_20180620.dat \
>>> -qc 0 -method UW_MEAN -v 6
>>>
>>> Maybe that's because the g16_conus_latlon_2km_20180620.dat file
>>> doesn't exist in my directory?
>>> I also don't understand why the input file has a .nc suffix. It's
not
>>> a NetCDF file.
>>>
>>> Could you please take a look? We always want to avoid segfaults,
so
>>> it'd be a good idea to debug that and exit with a useful error
message
>>> instead.
>>>
>>> Thanks,
>>> John
>>>
>>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
>>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
>>>
>>>
>>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
>>> Transaction: Ticket created by partha.bhattacharjee at noaa.gov
>>> <mailto:partha.bhattacharjee at noaa.gov>
>>> Queue: met_help
>>> Subject: regrid GEOS16 Data
>>> Owner: Nobody
>>> Requestors: partha.bhattacharjee at noaa.gov
>>> <mailto:partha.bhattacharjee at noaa.gov>
>>> Status: new
>>> Ticket <URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>>>
>>>
>>> Hi,
>>> I am using regrid_data_plane to process GOES16 AOD data
following
>>> example
>>> shown in MET 8 User guide. But when I was trying to check the
>>> output in
>>> plot_data_plane or NCL, they return blank. Regrid process
does not
>>> show any
>>> error apparently. I have attached the script (tried two
different
>>> processes to use coordinate Grids) and put data in ftp. Any
>>> suggestions?
>>> Thanks
>>> Partha
>>>
>>
>>
------------------------------------------------
Subject: regrid GEOS16 Data
From: Partha Bhattacharjee - NOAA Affiliate
Time: Mon Feb 11 19:01:42 2019
Hi Howard,
I tried using netcdf file from the ftp site mentioned above using MET8
and
got the following error :
plot_data_plane
OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
smcd.ps 'name="AOD"; level="(*,*)";' -v 6
DEBUG 1: Opening data file:
OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_NcCF".
DEBUG 4: NcCfFile::open() -> parsing units for the time variable
"seconds
since 2000-01-01 12:00:00"
DEBUG 4: parse_cf_time_string() -> parsed NetCDF CF convention time
unit
string "seconds since 2000-01-01 12:00:00" as a reference time of
20000101_120000 and 1 second(s) per time step.
DEBUG 4: NcCfFile::open() -> could not extract init time from the
"forecast_reference_time" variable.
DEBUG 4: NcCfFile::open() -> could not extract init time from file
name.
ERROR :
ERROR : NcCfFile::get_grid_from_grid_mapping() -> Unknown grid
mapping
name (geostationary) found in netCDF file.
ERROR :
Any help.
Thanks
Partha
On Mon, Feb 11, 2019 at 7:32 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> The bug fix is for invalid input data.
> I don't see the file mentioned early at
>
> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/20190211/.
>
> The other files there work well for me.
>
> If ncdump is available, you can check the GOES data file:
>
> Good input:
>
> ncdump -k
> OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> netCDF-4
>
> ncdump -v AOD
> OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
>
> OR
>
> Bad input:
>
> hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
> partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_
> c20182301007189.nc
> ncdump:
> partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_
> c20182301007189.nc:
> NetCDF: Unknown file format
>
> Cheers,
> Howard
>
> On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate via RT
wrote:
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >
> > Thanks Howard. Those netcdf files came from NESDIS test products :
> > ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/
> > So, how can I read those files using bug-fix MET ?
> > Partha
> >
> > On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
> >
> >> The input file is not valid GOES data (it's not a NetCDF format).
> >>
> >> It's been fixed at the latest MET with the enhancement of GOES
16. The
> >> fix was checked in to 8.0 bug fix branch.
> >>
> >> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
> >>
> >> The log message will be:
> >>
> >> ERROR :
> >> ERROR : process_data_only_file() ->
> >> "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> c20182301007189.nc"
> >>
> >> not a valid data file
> >> ERROR :
> >>
> >> Cheers,
> >> Howard
> >>
> >> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> >>> Howard,
> >>>
> >>> Partha (from NCEP) wrote a met-help question about
regrid_data_plane
> >>> not working well on some GOES16 AOD data. I placed the sample
data he
> >>> sent us on dakota in:
> >>> /d3/projects/MET/MET_Help/partha_data_20190211
> >>>
> >>> I get a segfault when I run the exact command he sent:
> >>>
> >>> /usr/local/met-8.0/bin/regrid_data_plane \
> >>> OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> c20182301007189.nc
> >> \
> >>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> >>> -field 'name="AOD"; level="(*,*)";' \
> >>> -coord g16_conus_latlon_2km_20180620.dat \
> >>> -qc 0 -method UW_MEAN -v 6
> >>>
> >>> Maybe that's because the g16_conus_latlon_2km_20180620.dat file
> >>> doesn't exist in my directory?
> >>> I also don't understand why the input file has a .nc suffix.
It's not
> >>> a NetCDF file.
> >>>
> >>> Could you please take a look? We always want to avoid
segfaults, so
> >>> it'd be a good idea to debug that and exit with a useful error
message
> >>> instead.
> >>>
> >>> Thanks,
> >>> John
> >>>
> >>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
> >>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
> >>>
> >>>
> >>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> >>> Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> >>> <mailto:partha.bhattacharjee at noaa.gov>
> >>> Queue: met_help
> >>> Subject: regrid GEOS16 Data
> >>> Owner: Nobody
> >>> Requestors: partha.bhattacharjee at noaa.gov
> >>> <mailto:partha.bhattacharjee at noaa.gov>
> >>> Status: new
> >>> Ticket <URL:
> >>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >>>
> >>>
> >>> Hi,
> >>> I am using regrid_data_plane to process GOES16 AOD data
following
> >>> example
> >>> shown in MET 8 User guide. But when I was trying to check
the
> >>> output in
> >>> plot_data_plane or NCL, they return blank. Regrid process
does not
> >>> show any
> >>> error apparently. I have attached the script (tried two
different
> >>> processes to use coordinate Grids) and put data in ftp. Any
> >>> suggestions?
> >>> Thanks
> >>> Partha
> >>>
> >>
> >>
>
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #88839] regrid GEOS16 Data
From: Howard Soh
Time: Mon Feb 11 19:06:57 2019
plot_data_plane can not handle GOES data. Please try
regrid_data_plane.
Cheers,
Howard
On 2/11/2019 7:01 PM, Partha Bhattacharjee - NOAA Affiliate via RT
wrote:
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>
> Hi Howard,
> I tried using netcdf file from the ftp site mentioned above using
MET8 and
> got the following error :
>
> plot_data_plane
> OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> smcd.ps 'name="AOD"; level="(*,*)";' -v 6
> DEBUG 1: Opening data file:
> OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
> Met2dDataFile object of type "FileType_NcCF".
> DEBUG 4: NcCfFile::open() -> parsing units for the time variable
"seconds
> since 2000-01-01 12:00:00"
> DEBUG 4: parse_cf_time_string() -> parsed NetCDF CF convention time
unit
> string "seconds since 2000-01-01 12:00:00" as a reference time of
> 20000101_120000 and 1 second(s) per time step.
> DEBUG 4: NcCfFile::open() -> could not extract init time from the
> "forecast_reference_time" variable.
> DEBUG 4: NcCfFile::open() -> could not extract init time from file
name.
> ERROR :
> ERROR : NcCfFile::get_grid_from_grid_mapping() -> Unknown grid
mapping
> name (geostationary) found in netCDF file.
> ERROR :
>
> Any help.
> Thanks
> Partha
>
>
> On Mon, Feb 11, 2019 at 7:32 PM Howard Soh via RT
<met_help at ucar.edu> wrote:
>
>> The bug fix is for invalid input data.
>> I don't see the file mentioned early at
>>
>> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/20190211/.
>>
>> The other files there work well for me.
>>
>> If ncdump is available, you can check the GOES data file:
>>
>> Good input:
>>
>> ncdump -k
>> OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
>> netCDF-4
>>
>> ncdump -v AOD
>> OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
>>
>> OR
>>
>> Bad input:
>>
>> hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
>> partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_
>> c20182301007189.nc
>> ncdump:
>> partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_
>> c20182301007189.nc:
>> NetCDF: Unknown file format
>>
>> Cheers,
>> Howard
>>
>> On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate via RT
wrote:
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>>>
>>> Thanks Howard. Those netcdf files came from NESDIS test products :
>>> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/
>>> So, how can I read those files using bug-fix MET ?
>>> Partha
>>>
>>> On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
<met_help at ucar.edu>
>> wrote:
>>>> The input file is not valid GOES data (it's not a NetCDF format).
>>>>
>>>> It's been fixed at the latest MET with the enhancement of GOES
16. The
>>>> fix was checked in to 8.0 bug fix branch.
>>>>
>>>> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
>>>>
>>>> The log message will be:
>>>>
>>>> ERROR :
>>>> ERROR : process_data_only_file() ->
>>>> "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
>> c20182301007189.nc"
>>>> not a valid data file
>>>> ERROR :
>>>>
>>>> Cheers,
>>>> Howard
>>>>
>>>> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
>>>>> Howard,
>>>>>
>>>>> Partha (from NCEP) wrote a met-help question about
regrid_data_plane
>>>>> not working well on some GOES16 AOD data. I placed the sample
data he
>>>>> sent us on dakota in:
>>>>> /d3/projects/MET/MET_Help/partha_data_20190211
>>>>>
>>>>> I get a segfault when I run the exact command he sent:
>>>>>
>>>>> /usr/local/met-8.0/bin/regrid_data_plane \
>>>>> OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
>> c20182301007189.nc
>>>> \
>>>>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
>>>>> -field 'name="AOD"; level="(*,*)";' \
>>>>> -coord g16_conus_latlon_2km_20180620.dat \
>>>>> -qc 0 -method UW_MEAN -v 6
>>>>>
>>>>> Maybe that's because the g16_conus_latlon_2km_20180620.dat file
>>>>> doesn't exist in my directory?
>>>>> I also don't understand why the input file has a .nc suffix.
It's not
>>>>> a NetCDF file.
>>>>>
>>>>> Could you please take a look? We always want to avoid
segfaults, so
>>>>> it'd be a good idea to debug that and exit with a useful error
message
>>>>> instead.
>>>>>
>>>>> Thanks,
>>>>> John
>>>>>
>>>>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
>>>>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
>>>>>
>>>>>
>>>>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
>>>>> Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
>>>>> <mailto:partha.bhattacharjee at noaa.gov>
>>>>> Queue: met_help
>>>>> Subject: regrid GEOS16 Data
>>>>> Owner: Nobody
>>>>> Requestors: partha.bhattacharjee at noaa.gov
>>>>> <mailto:partha.bhattacharjee at noaa.gov>
>>>>> Status: new
>>>>> Ticket <URL:
>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>>>>>
>>>>>
>>>>> Hi,
>>>>> I am using regrid_data_plane to process GOES16 AOD data
following
>>>>> example
>>>>> shown in MET 8 User guide. But when I was trying to check
the
>>>>> output in
>>>>> plot_data_plane or NCL, they return blank. Regrid process
does not
>>>>> show any
>>>>> error apparently. I have attached the script (tried two
different
>>>>> processes to use coordinate Grids) and put data in ftp.
Any
>>>>> suggestions?
>>>>> Thanks
>>>>> Partha
>>>>>
>>>>
>>
>>
------------------------------------------------
Subject: regrid GEOS16 Data
From: Partha Bhattacharjee - NOAA Affiliate
Time: Fri Feb 22 10:10:28 2019
Hi Howard,
I need some help to regrid input GOES data to global grid like NOAA's
aerosol model ngac grid. You can find ngac files at ftp site at
ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/ngac/prod/ngac.20190222/ and
you
can pick any "a2df" file to use. I am using following MET script to
read
GOES data and trying to regrid in to G229 grid :
regrid_data_plane \
OR_ABI-L2-AODC-
M3_G16_s20190411002137_e20190411004510_c20190411005261.nc
\
G229 \
regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
-field 'name="AOD"; level="(*,*)";' \
-coord /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
-qc 0 \
-method UW_MEAN -v 6
When I am trying to plot output it showing all missing values. Any
help
would be appreciated
Thanks
Partha
On Mon, Feb 11, 2019 at 9:06 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> plot_data_plane can not handle GOES data. Please try
regrid_data_plane.
>
> Cheers,
> Howard
>
> On 2/11/2019 7:01 PM, Partha Bhattacharjee - NOAA Affiliate via RT
wrote:
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >
> > Hi Howard,
> > I tried using netcdf file from the ftp site mentioned above using
MET8
> and
> > got the following error :
> >
> > plot_data_plane
> > OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > smcd.ps 'name="AOD"; level="(*,*)";' -v 6
> > DEBUG 1: Opening data file:
> > OR_ABI-L2-AODC-
M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created
new
> > Met2dDataFile object of type "FileType_NcCF".
> > DEBUG 4: NcCfFile::open() -> parsing units for the time variable
"seconds
> > since 2000-01-01 12:00:00"
> > DEBUG 4: parse_cf_time_string() -> parsed NetCDF CF convention
time unit
> > string "seconds since 2000-01-01 12:00:00" as a reference time of
> > 20000101_120000 and 1 second(s) per time step.
> > DEBUG 4: NcCfFile::open() -> could not extract init time from the
> > "forecast_reference_time" variable.
> > DEBUG 4: NcCfFile::open() -> could not extract init time from file
name.
> > ERROR :
> > ERROR : NcCfFile::get_grid_from_grid_mapping() -> Unknown grid
mapping
> > name (geostationary) found in netCDF file.
> > ERROR :
> >
> > Any help.
> > Thanks
> > Partha
> >
> >
> > On Mon, Feb 11, 2019 at 7:32 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
> >
> >> The bug fix is for invalid input data.
> >> I don't see the file mentioned early at
> >>
> >>
> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/20190211/
> .
> >>
> >> The other files there work well for me.
> >>
> >> If ncdump is available, you can check the GOES data file:
> >>
> >> Good input:
> >>
> >> ncdump -k
> >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> c20190422151447.nc
> >> netCDF-4
> >>
> >> ncdump -v AOD
> >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> c20190422151447.nc
> >>
> >> OR
> >>
> >> Bad input:
> >>
> >> hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
> >>
> partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_
> >> c20182301007189.nc
> >> ncdump:
> >>
> partha_data_20190211/OR_ABI-L2-AODC-
M3_G16_s20182301002309_e20182301005082_
> >> c20182301007189.nc:
> >> NetCDF: Unknown file format
> >>
> >> Cheers,
> >> Howard
> >>
> >> On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate via
RT
> wrote:
> >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> >>>
> >>> Thanks Howard. Those netcdf files came from NESDIS test products
:
> >>> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/
> >>> So, how can I read those files using bug-fix MET ?
> >>> Partha
> >>>
> >>> On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
<met_help at ucar.edu>
> >> wrote:
> >>>> The input file is not valid GOES data (it's not a NetCDF
format).
> >>>>
> >>>> It's been fixed at the latest MET with the enhancement of GOES
16. The
> >>>> fix was checked in to 8.0 bug fix branch.
> >>>>
> >>>> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
> >>>>
> >>>> The log message will be:
> >>>>
> >>>> ERROR :
> >>>> ERROR : process_data_only_file() ->
> >>>> "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> >> c20182301007189.nc"
> >>>> not a valid data file
> >>>> ERROR :
> >>>>
> >>>> Cheers,
> >>>> Howard
> >>>>
> >>>> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> >>>>> Howard,
> >>>>>
> >>>>> Partha (from NCEP) wrote a met-help question about
regrid_data_plane
> >>>>> not working well on some GOES16 AOD data. I placed the sample
data he
> >>>>> sent us on dakota in:
> >>>>> /d3/projects/MET/MET_Help/partha_data_20190211
> >>>>>
> >>>>> I get a segfault when I run the exact command he sent:
> >>>>>
> >>>>> /usr/local/met-8.0/bin/regrid_data_plane \
> >>>>> OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> >> c20182301007189.nc
> >>>> \
> >>>>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> >>>>> -field 'name="AOD"; level="(*,*)";' \
> >>>>> -coord g16_conus_latlon_2km_20180620.dat \
> >>>>> -qc 0 -method UW_MEAN -v 6
> >>>>>
> >>>>> Maybe that's because the g16_conus_latlon_2km_20180620.dat
file
> >>>>> doesn't exist in my directory?
> >>>>> I also don't understand why the input file has a .nc suffix.
It's
> not
> >>>>> a NetCDF file.
> >>>>>
> >>>>> Could you please take a look? We always want to avoid
segfaults, so
> >>>>> it'd be a good idea to debug that and exit with a useful error
> message
> >>>>> instead.
> >>>>>
> >>>>> Thanks,
> >>>>> John
> >>>>>
> >>>>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
Affiliate
> >>>>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
> >>>>>
> >>>>>
> >>>>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> >>>>> Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> >>>>> Queue: met_help
> >>>>> Subject: regrid GEOS16 Data
> >>>>> Owner: Nobody
> >>>>> Requestors: partha.bhattacharjee at noaa.gov
> >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> >>>>> Status: new
> >>>>> Ticket <URL:
> >>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839
>
> >>>>>
> >>>>>
> >>>>> Hi,
> >>>>> I am using regrid_data_plane to process GOES16 AOD data
> following
> >>>>> example
> >>>>> shown in MET 8 User guide. But when I was trying to
check the
> >>>>> output in
> >>>>> plot_data_plane or NCL, they return blank. Regrid
process does
> not
> >>>>> show any
> >>>>> error apparently. I have attached the script (tried two
> different
> >>>>> processes to use coordinate Grids) and put data in ftp.
Any
> >>>>> suggestions?
> >>>>> Thanks
> >>>>> Partha
> >>>>>
> >>>>
> >>
> >>
>
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: regrid GEOS16 Data
From: Howard Soh
Time: Fri Feb 22 21:11:11 2019
I'm sorry I was out of office today.
The -coord argument accepts two type files:
- NetCDF files with two variables: lat(y,x) and lon(y,x) (y=1500 and
x=2500) or
- binary file with lat/lon. The file size is 30000000 (2 variables * 4
bytes * 1500 * 2500): 2 variables: lat/long, 4 bytes for float.
/com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 is not valid
input for -coord argument. It can be the main input (ut GOES-16 is
main input) or file which contains the target grid information. If it
contains the target grid information, "G229" should be replaced with
/com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2.
The coordinate file name I have is g16_conus_latlon_2km.dat and
g16_conus_latlon_2km.nc.
The first argument is the input data.
The second argument is for the target grid information.
The third argument is the output file name.
So the command will be
regrid_data_plane \
OR_ABI-L2-AODC-
M3_G16_s20190411002137_e20190411004510_c20190411005261.nc \
/com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
-field 'name="AOD"; level="(*,*)";' \
-coord <coord_file_Name_here> \
-qc 0 \
-method UW_MEAN -v 6
Cheers,
Howard
On Fri Feb 22 10:10:28 2019, partha.bhattacharjee at noaa.gov wrote:
> Hi Howard,
>
> I need some help to regrid input GOES data to global grid like
NOAA's
> aerosol model ngac grid. You can find ngac files at ftp site at
> ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/ngac/prod/ngac.20190222/
and
> you
> can pick any "a2df" file to use. I am using following MET script to
> read
> GOES data and trying to regrid in to G229 grid :
>
> regrid_data_plane \
> OR_ABI-L2-AODC-
> M3_G16_s20190411002137_e20190411004510_c20190411005261.nc
> \
> G229 \
> regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
> -field 'name="AOD"; level="(*,*)";' \
> -coord /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
> -qc 0 \
> -method UW_MEAN -v 6
>
> When I am trying to plot output it showing all missing values. Any
> help
> would be appreciated
> Thanks
> Partha
>
> On Mon, Feb 11, 2019 at 9:06 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
>
> > plot_data_plane can not handle GOES data. Please try
> > regrid_data_plane.
> >
> > Cheers,
> > Howard
> >
> > On 2/11/2019 7:01 PM, Partha Bhattacharjee - NOAA Affiliate via RT
> > wrote:
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > >
> > > Hi Howard,
> > > I tried using netcdf file from the ftp site mentioned above
using
> > > MET8
> > and
> > > got the following error :
> > >
> > > plot_data_plane
> > > OR_ABI-L2-AODC-
> > > M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > > smcd.ps 'name="AOD"; level="(*,*)";' -v 6
> > > DEBUG 1: Opening data file:
> > > OR_ABI-L2-AODC-
> > > M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created
> > > new
> > > Met2dDataFile object of type "FileType_NcCF".
> > > DEBUG 4: NcCfFile::open() -> parsing units for the time variable
> > > "seconds
> > > since 2000-01-01 12:00:00"
> > > DEBUG 4: parse_cf_time_string() -> parsed NetCDF CF convention
time
> > > unit
> > > string "seconds since 2000-01-01 12:00:00" as a reference time
of
> > > 20000101_120000 and 1 second(s) per time step.
> > > DEBUG 4: NcCfFile::open() -> could not extract init time from
the
> > > "forecast_reference_time" variable.
> > > DEBUG 4: NcCfFile::open() -> could not extract init time from
file
> > > name.
> > > ERROR :
> > > ERROR : NcCfFile::get_grid_from_grid_mapping() -> Unknown grid
> > > mapping
> > > name (geostationary) found in netCDF file.
> > > ERROR :
> > >
> > > Any help.
> > > Thanks
> > > Partha
> > >
> > >
> > > On Mon, Feb 11, 2019 at 7:32 PM Howard Soh via RT
> > > <met_help at ucar.edu>
> > wrote:
> > >
> > >> The bug fix is for invalid input data.
> > >> I don't see the file mentioned early at
> > >>
> > >>
> > ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
> > 16/NRT/CONUS/AOD/20190211/
> > .
> > >>
> > >> The other files there work well for me.
> > >>
> > >> If ncdump is available, you can check the GOES data file:
> > >>
> > >> Good input:
> > >>
> > >> ncdump -k
> > >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> > c20190422151447.nc
> > >> netCDF-4
> > >>
> > >> ncdump -v AOD
> > >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> > c20190422151447.nc
> > >>
> > >> OR
> > >>
> > >> Bad input:
> > >>
> > >> hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
> > >>
> > partha_data_20190211/OR_ABI-L2-AODC-
> > M3_G16_s20182301002309_e20182301005082_
> > >> c20182301007189.nc
> > >> ncdump:
> > >>
> > partha_data_20190211/OR_ABI-L2-AODC-
> > M3_G16_s20182301002309_e20182301005082_
> > >> c20182301007189.nc:
> > >> NetCDF: Unknown file format
> > >>
> > >> Cheers,
> > >> Howard
> > >>
> > >> On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate via
RT
> > wrote:
> > >>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839
>
> > >>>
> > >>> Thanks Howard. Those netcdf files came from NESDIS test
products
> > >>> :
> > >>> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
> > >>> 16/NRT/CONUS/AOD/
> > >>> So, how can I read those files using bug-fix MET ?
> > >>> Partha
> > >>>
> > >>> On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
> > >>> <met_help at ucar.edu>
> > >> wrote:
> > >>>> The input file is not valid GOES data (it's not a NetCDF
> > >>>> format).
> > >>>>
> > >>>> It's been fixed at the latest MET with the enhancement of
GOES
> > >>>> 16. The
> > >>>> fix was checked in to 8.0 bug fix branch.
> > >>>>
> > >>>> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
> > >>>>
> > >>>> The log message will be:
> > >>>>
> > >>>> ERROR :
> > >>>> ERROR : process_data_only_file() ->
> > >>>> "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> > >> c20182301007189.nc"
> > >>>> not a valid data file
> > >>>> ERROR :
> > >>>>
> > >>>> Cheers,
> > >>>> Howard
> > >>>>
> > >>>> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> > >>>>> Howard,
> > >>>>>
> > >>>>> Partha (from NCEP) wrote a met-help question about
> > >>>>> regrid_data_plane
> > >>>>> not working well on some GOES16 AOD data. I placed the
sample
> > >>>>> data he
> > >>>>> sent us on dakota in:
> > >>>>> /d3/projects/MET/MET_Help/partha_data_20190211
> > >>>>>
> > >>>>> I get a segfault when I run the exact command he sent:
> > >>>>>
> > >>>>> /usr/local/met-8.0/bin/regrid_data_plane \
> > >>>>> OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> > >> c20182301007189.nc
> > >>>> \
> > >>>>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> > >>>>> -field 'name="AOD"; level="(*,*)";' \
> > >>>>> -coord g16_conus_latlon_2km_20180620.dat \
> > >>>>> -qc 0 -method UW_MEAN -v 6
> > >>>>>
> > >>>>> Maybe that's because the g16_conus_latlon_2km_20180620.dat
file
> > >>>>> doesn't exist in my directory?
> > >>>>> I also don't understand why the input file has a .nc suffix.
> > >>>>> It's
> > not
> > >>>>> a NetCDF file.
> > >>>>>
> > >>>>> Could you please take a look? We always want to avoid
> > >>>>> segfaults, so
> > >>>>> it'd be a good idea to debug that and exit with a useful
error
> > message
> > >>>>> instead.
> > >>>>>
> > >>>>> Thanks,
> > >>>>> John
> > >>>>>
> > >>>>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee - NOAA
> > >>>>> Affiliate
> > >>>>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>> wrote:
> > >>>>>
> > >>>>>
> > >>>>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> > >>>>> Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> > >>>>> Queue: met_help
> > >>>>> Subject: regrid GEOS16 Data
> > >>>>> Owner: Nobody
> > >>>>> Requestors: partha.bhattacharjee at noaa.gov
> > >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> > >>>>> Status: new
> > >>>>> Ticket <URL:
> > >>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > >>>>>
> > >>>>>
> > >>>>> Hi,
> > >>>>> I am using regrid_data_plane to process GOES16 AOD data
> > following
> > >>>>> example
> > >>>>> shown in MET 8 User guide. But when I was trying to check
the
> > >>>>> output in
> > >>>>> plot_data_plane or NCL, they return blank. Regrid process
does
> > not
> > >>>>> show any
> > >>>>> error apparently. I have attached the script (tried two
> > different
> > >>>>> processes to use coordinate Grids) and put data in ftp. Any
> > >>>>> suggestions?
> > >>>>> Thanks
> > >>>>> Partha
> > >>>>>
> > >>>>
> > >>
> > >>
> >
> >
> >
------------------------------------------------
Subject: regrid GEOS16 Data
From: Partha Bhattacharjee - NOAA Affiliate
Time: Fri Mar 01 19:07:23 2019
Howard,
I modify my script and use
"OR_ABI-L2-AODC-
M3_G16_s20190541702138_e20190541704511_c20190541707211.nc"
from
ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/20190223/
to regrid at NGAC grid.
regrid_data_plane \
OR_ABI-L2-AODC-
M3_G16_s20190541702138_e20190541704511_c20190541707211.nc
\
/scratch4/NCEPDEV/global/noscrub/Partha.Bhattacharjee/Gyre_BKJan2019/6hrly/Feb_2019/19/ngac.t00z.a2df00.grib2
\
regrid_data_plane_GOES-16_2019AODHC2_TO_Ngac.nc \
-field 'name="AOD"; level="(*,*)";' \
-coord g16_conus_latlon_2km_20180620.dat \
-qc 2 \
-method UW_MEAN -v 6
I am able to generate attached figure of the output. Quick look into
it
seems regrid program worked fine. Just a quick question, is time
information in the input GEOS16 files is saved in the regridded output
file
? We can validate model forecast time with regridded satellite output
then
?
Thanks
Partha
On Fri, Feb 22, 2019 at 11:11 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> I'm sorry I was out of office today.
>
> The -coord argument accepts two type files:
> - NetCDF files with two variables: lat(y,x) and lon(y,x) (y=1500 and
> x=2500) or
> - binary file with lat/lon. The file size is 30000000 (2 variables *
4
> bytes * 1500 * 2500): 2 variables: lat/long, 4 bytes for float.
>
> /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 is not valid
input
> for -coord argument. It can be the main input (ut GOES-16 is main
input) or
> file which contains the target grid information. If it contains the
target
> grid information, "G229" should be replaced with
> /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2.
>
> The coordinate file name I have is g16_conus_latlon_2km.dat and
> g16_conus_latlon_2km.nc.
>
> The first argument is the input data.
> The second argument is for the target grid information.
> The third argument is the output file name.
> So the command will be
>
> regrid_data_plane \
> OR_ABI-L2-AODC-
M3_G16_s20190411002137_e20190411004510_c20190411005261.nc
> \
> /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
> regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
> -field 'name="AOD"; level="(*,*)";' \
> -coord <coord_file_Name_here> \
> -qc 0 \
> -method UW_MEAN -v 6
>
> Cheers,
> Howard
>
> On Fri Feb 22 10:10:28 2019, partha.bhattacharjee at noaa.gov wrote:
> > Hi Howard,
> >
> > I need some help to regrid input GOES data to global grid like
NOAA's
> > aerosol model ngac grid. You can find ngac files at ftp site at
> > ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/ngac/prod/ngac.20190222/
and
> > you
> > can pick any "a2df" file to use. I am using following MET script
to
> > read
> > GOES data and trying to regrid in to G229 grid :
> >
> > regrid_data_plane \
> > OR_ABI-L2-AODC-
> > M3_G16_s20190411002137_e20190411004510_c20190411005261.nc
> > \
> > G229 \
> > regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
> > -field 'name="AOD"; level="(*,*)";' \
> > -coord /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
> > -qc 0 \
> > -method UW_MEAN -v 6
> >
> > When I am trying to plot output it showing all missing values. Any
> > help
> > would be appreciated
> > Thanks
> > Partha
> >
> > On Mon, Feb 11, 2019 at 9:06 PM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > plot_data_plane can not handle GOES data. Please try
> > > regrid_data_plane.
> > >
> > > Cheers,
> > > Howard
> > >
> > > On 2/11/2019 7:01 PM, Partha Bhattacharjee - NOAA Affiliate via
RT
> > > wrote:
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839
>
> > > >
> > > > Hi Howard,
> > > > I tried using netcdf file from the ftp site mentioned above
using
> > > > MET8
> > > and
> > > > got the following error :
> > > >
> > > > plot_data_plane
> > > > OR_ABI-L2-AODC-
> > > > M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > > > smcd.ps 'name="AOD"; level="(*,*)";' -v 6
> > > > DEBUG 1: Opening data file:
> > > > OR_ABI-L2-AODC-
> > > > M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > > > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() ->
created
> > > > new
> > > > Met2dDataFile object of type "FileType_NcCF".
> > > > DEBUG 4: NcCfFile::open() -> parsing units for the time
variable
> > > > "seconds
> > > > since 2000-01-01 12:00:00"
> > > > DEBUG 4: parse_cf_time_string() -> parsed NetCDF CF convention
time
> > > > unit
> > > > string "seconds since 2000-01-01 12:00:00" as a reference time
of
> > > > 20000101_120000 and 1 second(s) per time step.
> > > > DEBUG 4: NcCfFile::open() -> could not extract init time from
the
> > > > "forecast_reference_time" variable.
> > > > DEBUG 4: NcCfFile::open() -> could not extract init time from
file
> > > > name.
> > > > ERROR :
> > > > ERROR : NcCfFile::get_grid_from_grid_mapping() -> Unknown
grid
> > > > mapping
> > > > name (geostationary) found in netCDF file.
> > > > ERROR :
> > > >
> > > > Any help.
> > > > Thanks
> > > > Partha
> > > >
> > > >
> > > > On Mon, Feb 11, 2019 at 7:32 PM Howard Soh via RT
> > > > <met_help at ucar.edu>
> > > wrote:
> > > >
> > > >> The bug fix is for invalid input data.
> > > >> I don't see the file mentioned early at
> > > >>
> > > >>
> > > ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
> > > 16/NRT/CONUS/AOD/20190211/
> > > .
> > > >>
> > > >> The other files there work well for me.
> > > >>
> > > >> If ncdump is available, you can check the GOES data file:
> > > >>
> > > >> Good input:
> > > >>
> > > >> ncdump -k
> > > >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> > > c20190422151447.nc
> > > >> netCDF-4
> > > >>
> > > >> ncdump -v AOD
> > > >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> > > c20190422151447.nc
> > > >>
> > > >> OR
> > > >>
> > > >> Bad input:
> > > >>
> > > >> hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
> > > >>
> > > partha_data_20190211/OR_ABI-L2-AODC-
> > > M3_G16_s20182301002309_e20182301005082_
> > > >> c20182301007189.nc
> > > >> ncdump:
> > > >>
> > > partha_data_20190211/OR_ABI-L2-AODC-
> > > M3_G16_s20182301002309_e20182301005082_
> > > >> c20182301007189.nc:
> > > >> NetCDF: Unknown file format
> > > >>
> > > >> Cheers,
> > > >> Howard
> > > >>
> > > >> On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate
via RT
> > > wrote:
> > > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > > >>>
> > > >>> Thanks Howard. Those netcdf files came from NESDIS test
products
> > > >>> :
> > > >>> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
> > > >>> 16/NRT/CONUS/AOD/
> > > >>> So, how can I read those files using bug-fix MET ?
> > > >>> Partha
> > > >>>
> > > >>> On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
> > > >>> <met_help at ucar.edu>
> > > >> wrote:
> > > >>>> The input file is not valid GOES data (it's not a NetCDF
> > > >>>> format).
> > > >>>>
> > > >>>> It's been fixed at the latest MET with the enhancement of
GOES
> > > >>>> 16. The
> > > >>>> fix was checked in to 8.0 bug fix branch.
> > > >>>>
> > > >>>> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
> > > >>>>
> > > >>>> The log message will be:
> > > >>>>
> > > >>>> ERROR :
> > > >>>> ERROR : process_data_only_file() ->
> > > >>>> "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> > > >> c20182301007189.nc"
> > > >>>> not a valid data file
> > > >>>> ERROR :
> > > >>>>
> > > >>>> Cheers,
> > > >>>> Howard
> > > >>>>
> > > >>>> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> > > >>>>> Howard,
> > > >>>>>
> > > >>>>> Partha (from NCEP) wrote a met-help question about
> > > >>>>> regrid_data_plane
> > > >>>>> not working well on some GOES16 AOD data. I placed the
sample
> > > >>>>> data he
> > > >>>>> sent us on dakota in:
> > > >>>>> /d3/projects/MET/MET_Help/partha_data_20190211
> > > >>>>>
> > > >>>>> I get a segfault when I run the exact command he sent:
> > > >>>>>
> > > >>>>> /usr/local/met-8.0/bin/regrid_data_plane \
> > > >>>>> OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> > > >> c20182301007189.nc
> > > >>>> \
> > > >>>>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> > > >>>>> -field 'name="AOD"; level="(*,*)";' \
> > > >>>>> -coord g16_conus_latlon_2km_20180620.dat \
> > > >>>>> -qc 0 -method UW_MEAN -v 6
> > > >>>>>
> > > >>>>> Maybe that's because the g16_conus_latlon_2km_20180620.dat
file
> > > >>>>> doesn't exist in my directory?
> > > >>>>> I also don't understand why the input file has a .nc
suffix.
> > > >>>>> It's
> > > not
> > > >>>>> a NetCDF file.
> > > >>>>>
> > > >>>>> Could you please take a look? We always want to avoid
> > > >>>>> segfaults, so
> > > >>>>> it'd be a good idea to debug that and exit with a useful
error
> > > message
> > > >>>>> instead.
> > > >>>>>
> > > >>>>> Thanks,
> > > >>>>> John
> > > >>>>>
> > > >>>>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee -
NOAA
> > > >>>>> Affiliate
> > > >>>>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>>
wrote:
> > > >>>>>
> > > >>>>>
> > > >>>>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> > > >>>>> Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> > > >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> > > >>>>> Queue: met_help
> > > >>>>> Subject: regrid GEOS16 Data
> > > >>>>> Owner: Nobody
> > > >>>>> Requestors: partha.bhattacharjee at noaa.gov
> > > >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> > > >>>>> Status: new
> > > >>>>> Ticket <URL:
> > > >>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > > >>>>>
> > > >>>>>
> > > >>>>> Hi,
> > > >>>>> I am using regrid_data_plane to process GOES16 AOD data
> > > following
> > > >>>>> example
> > > >>>>> shown in MET 8 User guide. But when I was trying to check
the
> > > >>>>> output in
> > > >>>>> plot_data_plane or NCL, they return blank. Regrid process
does
> > > not
> > > >>>>> show any
> > > >>>>> error apparently. I have attached the script (tried two
> > > different
> > > >>>>> processes to use coordinate Grids) and put data in ftp.
Any
> > > >>>>> suggestions?
> > > >>>>> Thanks
> > > >>>>> Partha
> > > >>>>>
> > > >>>>
> > > >>
> > > >>
> > >
> > >
> > >
>
>
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: regrid GEOS16 Data
From: Howard Soh
Time: Mon Mar 04 10:55:55 2019
Yes, two time variables (t and time_bounds) are copied from the input
GOES
files to the regridded output.
Cheers,
Howard
On Fri, Mar 1, 2019 at 7:07 PM Partha Bhattacharjee - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
>
> Howard,
> I modify my script and use
> "OR_ABI-L2-AODC-
M3_G16_s20190541702138_e20190541704511_c20190541707211.nc"
> from
>
> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
16/NRT/CONUS/AOD/20190223/
> to regrid at NGAC grid.
>
> regrid_data_plane \
> OR_ABI-L2-AODC-M3_G16_s20190541702138_e20190541704511_
> c20190541707211.nc
> \
>
>
>
/scratch4/NCEPDEV/global/noscrub/Partha.Bhattacharjee/Gyre_BKJan2019/6hrly/Feb_2019/19/ngac.t00z.a2df00.grib2
> \
> regrid_data_plane_GOES-16_2019AODHC2_TO_Ngac.nc \
> -field 'name="AOD"; level="(*,*)";' \
> -coord g16_conus_latlon_2km_20180620.dat \
> -qc 2 \
> -method UW_MEAN -v 6
>
> I am able to generate attached figure of the output. Quick look into
it
> seems regrid program worked fine. Just a quick question, is time
> information in the input GEOS16 files is saved in the regridded
output file
> ? We can validate model forecast time with regridded satellite
output then
> ?
>
> Thanks
> Partha
>
> On Fri, Feb 22, 2019 at 11:11 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
>
> > I'm sorry I was out of office today.
> >
> > The -coord argument accepts two type files:
> > - NetCDF files with two variables: lat(y,x) and lon(y,x) (y=1500
and
> > x=2500) or
> > - binary file with lat/lon. The file size is 30000000 (2 variables
* 4
> > bytes * 1500 * 2500): 2 variables: lat/long, 4 bytes for float.
> >
> > /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 is not valid
input
> > for -coord argument. It can be the main input (ut GOES-16 is main
input)
> or
> > file which contains the target grid information. If it contains
the
> target
> > grid information, "G229" should be replaced with
> > /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2.
> >
> > The coordinate file name I have is g16_conus_latlon_2km.dat and
> > g16_conus_latlon_2km.nc.
> >
> > The first argument is the input data.
> > The second argument is for the target grid information.
> > The third argument is the output file name.
> > So the command will be
> >
> > regrid_data_plane \
> > OR_ABI-L2-AODC-M3_G16_s20190411002137_e20190411004510_
> c20190411005261.nc
> > \
> > /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
> > regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
> > -field 'name="AOD"; level="(*,*)";' \
> > -coord <coord_file_Name_here> \
> > -qc 0 \
> > -method UW_MEAN -v 6
> >
> > Cheers,
> > Howard
> >
> > On Fri Feb 22 10:10:28 2019, partha.bhattacharjee at noaa.gov wrote:
> > > Hi Howard,
> > >
> > > I need some help to regrid input GOES data to global grid like
NOAA's
> > > aerosol model ngac grid. You can find ngac files at ftp site at
> > >
ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/ngac/prod/ngac.20190222/ and
> > > you
> > > can pick any "a2df" file to use. I am using following MET script
to
> > > read
> > > GOES data and trying to regrid in to G229 grid :
> > >
> > > regrid_data_plane \
> > > OR_ABI-L2-AODC-
> > > M3_G16_s20190411002137_e20190411004510_c20190411005261.nc
> > > \
> > > G229 \
> > > regrid_data_plane_GOES-16_2019AOD_TO_G3.nc \
> > > -field 'name="AOD"; level="(*,*)";' \
> > > -coord /com2/ngac/prod/ngac.20190220/ngac.t00z.a2df00.grib2 \
> > > -qc 0 \
> > > -method UW_MEAN -v 6
> > >
> > > When I am trying to plot output it showing all missing values.
Any
> > > help
> > > would be appreciated
> > > Thanks
> > > Partha
> > >
> > > On Mon, Feb 11, 2019 at 9:06 PM Howard Soh via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > plot_data_plane can not handle GOES data. Please try
> > > > regrid_data_plane.
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On 2/11/2019 7:01 PM, Partha Bhattacharjee - NOAA Affiliate
via RT
> > > > wrote:
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > > > >
> > > > > Hi Howard,
> > > > > I tried using netcdf file from the ftp site mentioned above
using
> > > > > MET8
> > > > and
> > > > > got the following error :
> > > > >
> > > > > plot_data_plane
> > > > > OR_ABI-L2-AODC-
> > > > > M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > > > > smcd.ps 'name="AOD"; level="(*,*)";' -v 6
> > > > > DEBUG 1: Opening data file:
> > > > > OR_ABI-L2-AODC-
> > > > > M3_G16_s20190422147136_e20190422149509_c20190422151447.nc
> > > > > DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() ->
created
> > > > > new
> > > > > Met2dDataFile object of type "FileType_NcCF".
> > > > > DEBUG 4: NcCfFile::open() -> parsing units for the time
variable
> > > > > "seconds
> > > > > since 2000-01-01 12:00:00"
> > > > > DEBUG 4: parse_cf_time_string() -> parsed NetCDF CF
convention time
> > > > > unit
> > > > > string "seconds since 2000-01-01 12:00:00" as a reference
time of
> > > > > 20000101_120000 and 1 second(s) per time step.
> > > > > DEBUG 4: NcCfFile::open() -> could not extract init time
from the
> > > > > "forecast_reference_time" variable.
> > > > > DEBUG 4: NcCfFile::open() -> could not extract init time
from file
> > > > > name.
> > > > > ERROR :
> > > > > ERROR : NcCfFile::get_grid_from_grid_mapping() -> Unknown
grid
> > > > > mapping
> > > > > name (geostationary) found in netCDF file.
> > > > > ERROR :
> > > > >
> > > > > Any help.
> > > > > Thanks
> > > > > Partha
> > > > >
> > > > >
> > > > > On Mon, Feb 11, 2019 at 7:32 PM Howard Soh via RT
> > > > > <met_help at ucar.edu>
> > > > wrote:
> > > > >
> > > > >> The bug fix is for invalid input data.
> > > > >> I don't see the file mentioned early at
> > > > >>
> > > > >>
> > > > ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
> > > > 16/NRT/CONUS/AOD/20190211/
> > > > .
> > > > >>
> > > > >> The other files there work well for me.
> > > > >>
> > > > >> If ncdump is available, you can check the GOES data file:
> > > > >>
> > > > >> Good input:
> > > > >>
> > > > >> ncdump -k
> > > > >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> > > > c20190422151447.nc
> > > > >> netCDF-4
> > > > >>
> > > > >> ncdump -v AOD
> > > > >> OR_ABI-L2-AODC-M3_G16_s20190422147136_e20190422149509_
> > > > c20190422151447.nc
> > > > >>
> > > > >> OR
> > > > >>
> > > > >> Bad input:
> > > > >>
> > > > >> hsoh at dakota:/d3/personal/hsoh/data/RT-88839$ ncdump -k
> > > > >>
> > > > partha_data_20190211/OR_ABI-L2-AODC-
> > > > M3_G16_s20182301002309_e20182301005082_
> > > > >> c20182301007189.nc
> > > > >> ncdump:
> > > > >>
> > > > partha_data_20190211/OR_ABI-L2-AODC-
> > > > M3_G16_s20182301002309_e20182301005082_
> > > > >> c20182301007189.nc:
> > > > >> NetCDF: Unknown file format
> > > > >>
> > > > >> Cheers,
> > > > >> Howard
> > > > >>
> > > > >> On 2/11/2019 4:33 PM, Partha Bhattacharjee - NOAA Affiliate
via RT
> > > > wrote:
> > > > >>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839 >
> > > > >>>
> > > > >>> Thanks Howard. Those netcdf files came from NESDIS test
products
> > > > >>> :
> > > > >>> ftp://ftp.star.nesdis.noaa.gov/pub/smcd/hzhang/GOES-
> > > > >>> 16/NRT/CONUS/AOD/
> > > > >>> So, how can I read those files using bug-fix MET ?
> > > > >>> Partha
> > > > >>>
> > > > >>> On Mon, Feb 11, 2019 at 1:11 PM Howard Soh via RT
> > > > >>> <met_help at ucar.edu>
> > > > >> wrote:
> > > > >>>> The input file is not valid GOES data (it's not a NetCDF
> > > > >>>> format).
> > > > >>>>
> > > > >>>> It's been fixed at the latest MET with the enhancement of
GOES
> > > > >>>> 16. The
> > > > >>>> fix was checked in to 8.0 bug fix branch.
> > > > >>>>
> > > > >>>> - src/tools/other/regrid_data_plane/regrid_data_plane.cc
> > > > >>>>
> > > > >>>> The log message will be:
> > > > >>>>
> > > > >>>> ERROR :
> > > > >>>> ERROR : process_data_only_file() ->
> > > > >>>> "OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> > > > >> c20182301007189.nc"
> > > > >>>> not a valid data file
> > > > >>>> ERROR :
> > > > >>>>
> > > > >>>> Cheers,
> > > > >>>> Howard
> > > > >>>>
> > > > >>>> On 2/11/2019 9:38 AM, John Halley Gotway wrote:
> > > > >>>>> Howard,
> > > > >>>>>
> > > > >>>>> Partha (from NCEP) wrote a met-help question about
> > > > >>>>> regrid_data_plane
> > > > >>>>> not working well on some GOES16 AOD data. I placed the
sample
> > > > >>>>> data he
> > > > >>>>> sent us on dakota in:
> > > > >>>>> /d3/projects/MET/MET_Help/partha_data_20190211
> > > > >>>>>
> > > > >>>>> I get a segfault when I run the exact command he sent:
> > > > >>>>>
> > > > >>>>> /usr/local/met-8.0/bin/regrid_data_plane \
> > > > >>>>> OR_ABI-L2-AODC-M3_G16_s20182301002309_e20182301005082_
> > > > >> c20182301007189.nc
> > > > >>>> \
> > > > >>>>> G212 regrid_data_plane_GOES-16_AOD_TO_G212.nc \
> > > > >>>>> -field 'name="AOD"; level="(*,*)";' \
> > > > >>>>> -coord g16_conus_latlon_2km_20180620.dat \
> > > > >>>>> -qc 0 -method UW_MEAN -v 6
> > > > >>>>>
> > > > >>>>> Maybe that's because the
g16_conus_latlon_2km_20180620.dat file
> > > > >>>>> doesn't exist in my directory?
> > > > >>>>> I also don't understand why the input file has a .nc
suffix.
> > > > >>>>> It's
> > > > not
> > > > >>>>> a NetCDF file.
> > > > >>>>>
> > > > >>>>> Could you please take a look? We always want to avoid
> > > > >>>>> segfaults, so
> > > > >>>>> it'd be a good idea to debug that and exit with a useful
error
> > > > message
> > > > >>>>> instead.
> > > > >>>>>
> > > > >>>>> Thanks,
> > > > >>>>> John
> > > > >>>>>
> > > > >>>>> On Fri, Feb 8, 2019 at 10:56 AM Partha Bhattacharjee -
NOAA
> > > > >>>>> Affiliate
> > > > >>>>> via RT <met_help at ucar.edu <mailto:met_help at ucar.edu>>
wrote:
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Fri Feb 08 10:55:12 2019: Request 88839 was acted upon.
> > > > >>>>> Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> > > > >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> > > > >>>>> Queue: met_help
> > > > >>>>> Subject: regrid GEOS16 Data
> > > > >>>>> Owner: Nobody
> > > > >>>>> Requestors: partha.bhattacharjee at noaa.gov
> > > > >>>>> <mailto:partha.bhattacharjee at noaa.gov>
> > > > >>>>> Status: new
> > > > >>>>> Ticket <URL:
> > > > >>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88839
>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Hi,
> > > > >>>>> I am using regrid_data_plane to process GOES16 AOD data
> > > > following
> > > > >>>>> example
> > > > >>>>> shown in MET 8 User guide. But when I was trying to
check the
> > > > >>>>> output in
> > > > >>>>> plot_data_plane or NCL, they return blank. Regrid
process does
> > > > not
> > > > >>>>> show any
> > > > >>>>> error apparently. I have attached the script (tried two
> > > > different
> > > > >>>>> processes to use coordinate Grids) and put data in ftp.
Any
> > > > >>>>> suggestions?
> > > > >>>>> Thanks
> > > > >>>>> Partha
> > > > >>>>>
> > > > >>>>
> > > > >>
> > > > >>
> > > >
> > > >
> > > >
> >
> >
> >
> >
>
> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
------------------------------------------------
More information about the Met_help
mailing list