[Met_help] [rt.rap.ucar.edu #96687] History for Point2grid failed since September 03 2020
John Halley Gotway via RT
met_help at ucar.edu
Thu Sep 17 12:08:06 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
To WHom It May Concern:
I encountered some error for regridding GOES-16 AOD pixel data to AQM model
grid and HYSPLIT model grid. So far as I can tell, it started to fall on
September 03 2020. It successfully produced AOD regridd data on and before
September 02 2020.
Please help me to debug the root of cause of the failure.
ON WCOSS DELL
(1) data location
venus:/gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/GOES16_AOD/REGRID
{denoted as DATADIR}
(2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in (1). Start
with line 1729
"terminate called after throwing an instance of
'netCDF::exceptions::NcRange'
what(): NetCDF: Numeric conversion not representable
file: ncVar.cpp line:1356"
(3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only 10 days of data
as yyyymmdd]
(4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or hysplit.yyyymmdd
(3) script file :
/gpfs/dell2/emc/modeling/save/Ho-Chun.Huang/plot/goes/run.g16taqm_aod.sh
Please let me know if you have additional question.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Ho-Chun Huang - NOAA Affiliate
Time: Mon Sep 14 07:22:35 2020
Hi,
After further investigation, the point2grid works on 16Z 20200903 but
failed since 17Z 20200903.
I have contacted our data provider at the NOAA NESDIS. But if you can
tell
me more specifically of the meaning of
terminate called after throwing an instance of
'netCDF::exceptions::NcRange'
what(): NetCDF: Numeric conversion not representable
file: ncVar.cpp line:1356
That would be helpful for me to discuss the problem with NESDIS
collaborator.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> Greetings,
>
> This message has been automatically generated in response to the
creation
> of a trouble ticket regarding:
> "Point2grid failed since September 03 2020",
> a summary of which appears below.
>
> There is no need to reply to this message right now. Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #96687].
>
> Please include the string:
>
> [rt.rap.ucar.edu #96687]
>
> in the subject line of all future correspondence about this issue.
To do
> so, you may reply to this message.
>
> For more information, please see:
>
> MET Online Tutorial:
>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>
> MET Users Guide:
> https://www.dtcenter.org/met/users/docs/overview.php
>
> MET FAQs:
> https://www.dtcenter.org/met/users/support/faqs/index.php
>
> MET-Help Email Archive:
> http://mailman.ucar.edu/pipermail/met_help
>
> Thank you,
> met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> To WHom It May Concern:
>
> I encountered some error for regridding GOES-16 AOD pixel data to
AQM model
> grid and HYSPLIT model grid. So far as I can tell, it started to
fall on
> September 03 2020. It successfully produced AOD regridd data on and
before
> September 02 2020.
>
> Please help me to debug the root of cause of the failure.
>
> ON WCOSS DELL
> (1) data location
> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/GOES16_AOD/REGRID
> {denoted as DATADIR}
>
> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in (1).
Start
> with line 1729
>
> "terminate called after throwing an instance of
> 'netCDF::exceptions::NcRange'
> what(): NetCDF: Numeric conversion not representable
> file: ncVar.cpp line:1356"
>
> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only 10 days
of data
> as yyyymmdd]
> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or hysplit.yyyymmdd
>
> (3) script file :
> /gpfs/dell2/emc/modeling/save/Ho-
Chun.Huang/plot/goes/run.g16taqm_aod.sh
>
> Please let me know if you have additional question.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Ho-Chun Huang - NOAA Affiliate
Time: Mon Sep 14 07:23:18 2020
Hi,
I found the data format has been changed from signed to unsigned
values in
between 16z and 17z on 20200903. I assume that is the reason the
point2grid can not onstianed valid values NcRange.
If your assessment is the same, then I need to talk to our management
about
the resolution to thai problem.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA Affiliate <
ho-chun.huang at noaa.gov> wrote:
> Hi,
>
> After further investigation, the point2grid works on 16Z 20200903
but
> failed since 17Z 20200903.
>
> I have contacted our data provider at the NOAA NESDIS. But if you
can
> tell me more specifically of the meaning of
>
> terminate called after throwing an instance of
> 'netCDF::exceptions::NcRange'
> what(): NetCDF: Numeric conversion not representable
> file: ncVar.cpp line:1356
>
> That would be helpful for me to discuss the problem with NESDIS
> collaborator.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT <
> met_help at ucar.edu> wrote:
>
>>
>> Greetings,
>>
>> This message has been automatically generated in response to the
creation
>> of a trouble ticket regarding:
>> "Point2grid failed since September 03 2020",
>> a summary of which appears below.
>>
>> There is no need to reply to this message right now. Your ticket
has
>> been assigned an ID of [rt.rap.ucar.edu #96687].
>>
>> Please include the string:
>>
>> [rt.rap.ucar.edu #96687]
>>
>> in the subject line of all future correspondence about this issue.
To do
>> so, you may reply to this message.
>>
>> For more information, please see:
>>
>> MET Online Tutorial:
>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>>
>> MET Users Guide:
>> https://www.dtcenter.org/met/users/docs/overview.php
>>
>> MET FAQs:
>> https://www.dtcenter.org/met/users/support/faqs/index.php
>>
>> MET-Help Email Archive:
>> http://mailman.ucar.edu/pipermail/met_help
>>
>> Thank you,
>> met_help at ucar.edu
>>
>>
-------------------------------------------------------------------------
>> To WHom It May Concern:
>>
>> I encountered some error for regridding GOES-16 AOD pixel data to
AQM
>> model
>> grid and HYSPLIT model grid. So far as I can tell, it started to
fall on
>> September 03 2020. It successfully produced AOD regridd data on
and
>> before
>> September 02 2020.
>>
>> Please help me to debug the root of cause of the failure.
>>
>> ON WCOSS DELL
>> (1) data location
>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/GOES16_AOD/REGRID
>> {denoted as DATADIR}
>>
>> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in (1).
Start
>> with line 1729
>>
>> "terminate called after throwing an instance of
>> 'netCDF::exceptions::NcRange'
>> what(): NetCDF: Numeric conversion not representable
>> file: ncVar.cpp line:1356"
>>
>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only 10 days
of
>> data
>> as yyyymmdd]
>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
hysplit.yyyymmdd
>>
>> (3) script file :
>> /gpfs/dell2/emc/modeling/save/Ho-
Chun.Huang/plot/goes/run.g16taqm_aod.sh
>>
>> Please let me know if you have additional question.
>>
>> Ho-Chun Huang
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct., Rm. 2792
>>
>> College Park, MD 20740
>>
>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>
>> 301-683-3958
>>
>>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Ho-Chun Huang - NOAA Affiliate
Time: Mon Sep 14 08:33:14 2020
Hi,
I received information from our developer regarding the data format
changes
"In the previous ABI AOD data, there is one attribute as _Unsigned =
"true", which is removed from the new PR.09.03 ABI AOD data. Did you
read
this attribute? If yes, you will need to remove it. Hope it helps."
I need to discuss with my supervisor how to resolve this issue. With
the
information provided above, can you let me know how much effort needed
to
read the new GOES-16 data? Does EMC need to give you a new task list
to
resolve this issue?
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA Affiliate <
ho-chun.huang at noaa.gov> wrote:
> Hi,
>
> I found the data format has been changed from signed to unsigned
values in
> between 16z and 17z on 20200903. I assume that is the reason the
> point2grid can not onstianed valid values NcRange.
>
> If your assessment is the same, then I need to talk to our
management
> about the resolution to thai problem.
>
>
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA Affiliate <
> ho-chun.huang at noaa.gov> wrote:
>
>> Hi,
>>
>> After further investigation, the point2grid works on 16Z 20200903
but
>> failed since 17Z 20200903.
>>
>> I have contacted our data provider at the NOAA NESDIS. But if you
can
>> tell me more specifically of the meaning of
>>
>> terminate called after throwing an instance of
>> 'netCDF::exceptions::NcRange'
>> what(): NetCDF: Numeric conversion not representable
>> file: ncVar.cpp line:1356
>>
>> That would be helpful for me to discuss the problem with NESDIS
>> collaborator.
>>
>> Ho-Chun Huang
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct., Rm. 2792
>>
>> College Park, MD 20740
>>
>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>
>> 301-683-3958
>>
>>
>> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT <
>> met_help at ucar.edu> wrote:
>>
>>>
>>> Greetings,
>>>
>>> This message has been automatically generated in response to the
>>> creation of a trouble ticket regarding:
>>> "Point2grid failed since September 03 2020",
>>> a summary of which appears below.
>>>
>>> There is no need to reply to this message right now. Your ticket
has
>>> been assigned an ID of [rt.rap.ucar.edu #96687].
>>>
>>> Please include the string:
>>>
>>> [rt.rap.ucar.edu #96687]
>>>
>>> in the subject line of all future correspondence about this issue.
To do
>>> so, you may reply to this message.
>>>
>>> For more information, please see:
>>>
>>> MET Online Tutorial:
>>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>>>
>>> MET Users Guide:
>>> https://www.dtcenter.org/met/users/docs/overview.php
>>>
>>> MET FAQs:
>>> https://www.dtcenter.org/met/users/support/faqs/index.php
>>>
>>> MET-Help Email Archive:
>>> http://mailman.ucar.edu/pipermail/met_help
>>>
>>> Thank you,
>>> met_help at ucar.edu
>>>
>>>
-------------------------------------------------------------------------
>>> To WHom It May Concern:
>>>
>>> I encountered some error for regridding GOES-16 AOD pixel data to
AQM
>>> model
>>> grid and HYSPLIT model grid. So far as I can tell, it started to
fall on
>>> September 03 2020. It successfully produced AOD regridd data on
and
>>> before
>>> September 02 2020.
>>>
>>> Please help me to debug the root of cause of the failure.
>>>
>>> ON WCOSS DELL
>>> (1) data location
>>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/GOES16_AOD/REGRID
>>> {denoted as DATADIR}
>>>
>>> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in (1).
Start
>>> with line 1729
>>>
>>> "terminate called after throwing an instance of
>>> 'netCDF::exceptions::NcRange'
>>> what(): NetCDF: Numeric conversion not representable
>>> file: ncVar.cpp line:1356"
>>>
>>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only 10
days of
>>> data
>>> as yyyymmdd]
>>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
hysplit.yyyymmdd
>>>
>>> (3) script file :
>>> /gpfs/dell2/emc/modeling/save/Ho-
Chun.Huang/plot/goes/run.g16taqm_aod.sh
>>>
>>> Please let me know if you have additional question.
>>>
>>> Ho-Chun Huang
>>>
>>> IMSG at NOAA/NWS/NCEP/EMC
>>>
>>> 5830 University Research Ct., Rm. 2792
>>>
>>> College Park, MD 20740
>>>
>>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>>
>>> 301-683-3958
>>>
>>>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Howard Soh
Time: Mon Sep 14 09:38:21 2020
Hi, Ho-Chun
MET does process "_Unsigned" attribute, but does not process the
unsigned data types. The second part is the cause. I have to
investigate NetCDF C++ API which recognizes the "unsigned short" as
the "signed short". The "_Unsigned" attribute is not CF standard, but
some programming languages do not support "unsigned" data type, for
example, Java.
The GOES data is changed from the "short" data type with
"_Unsigned=true" to the "unsigned short" data type without
"_Unsigned=true".
The error message by MET was caused by the data value range at the
attribute "AOD:valid_range = 0US, 65530US ;" which is not allowed in
signed short data type.
Cheers,
Howard
Old:
short AOD(y, x) ;
AOD:_FillValue = -1s ;
AOD:long_name = "ABI L2+ Aerosol Optical Depth at 550
nm" ;
AOD:standard_name =
"atmosphere_absorption_optical_thickness_due_to_ambient_aerosol" ;
AOD:_Unsigned = "true" ;
AOD:valid_range = 0s, -6s ;
AOD:scale_factor = 9.156e-05f ;
AOD:add_offset = -1.f ;
New:
ushort AOD(y, x) ;
AOD:_FillValue = 65535US ;
AOD:long_name = "ABI L2+ Aerosol Optical Depth at 550
nm" ;
AOD:standard_name =
"atmosphere_extinction_optical_thickness_due_to_ambient_aerosol" ;
AOD:valid_range = 0US, 65530US ;
AOD:scale_factor = 7.706e-05f ;
AOD:add_offset = -0.05f ;
On Mon Sep 14 08:33:14 2020, ho-chun.huang at noaa.gov wrote:
> Hi,
>
> I received information from our developer regarding the data format
> changes
>
> "In the previous ABI AOD data, there is one attribute as _Unsigned =
> "true", which is removed from the new PR.09.03 ABI AOD data. Did you
> read
> this attribute? If yes, you will need to remove it. Hope it helps."
>
> I need to discuss with my supervisor how to resolve this issue.
With
> the
> information provided above, can you let me know how much effort
needed
> to
> read the new GOES-16 data? Does EMC need to give you a new task
list
> to
> resolve this issue?
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA Affiliate <
> ho-chun.huang at noaa.gov> wrote:
>
> > Hi,
> >
> > I found the data format has been changed from signed to unsigned
> > values in
> > between 16z and 17z on 20200903. I assume that is the reason the
> > point2grid can not onstianed valid values NcRange.
> >
> > If your assessment is the same, then I need to talk to our
management
> > about the resolution to thai problem.
> >
> >
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> >
> > On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA Affiliate <
> > ho-chun.huang at noaa.gov> wrote:
> >
> >> Hi,
> >>
> >> After further investigation, the point2grid works on 16Z 20200903
> >> but
> >> failed since 17Z 20200903.
> >>
> >> I have contacted our data provider at the NOAA NESDIS. But if
you
> >> can
> >> tell me more specifically of the meaning of
> >>
> >> terminate called after throwing an instance of
> >> 'netCDF::exceptions::NcRange'
> >> what(): NetCDF: Numeric conversion not representable
> >> file: ncVar.cpp line:1356
> >>
> >> That would be helpful for me to discuss the problem with NESDIS
> >> collaborator.
> >>
> >> Ho-Chun Huang
> >>
> >> IMSG at NOAA/NWS/NCEP/EMC
> >>
> >> 5830 University Research Ct., Rm. 2792
> >>
> >> College Park, MD 20740
> >>
> >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>
> >> 301-683-3958
> >>
> >>
> >> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>>
> >>> Greetings,
> >>>
> >>> This message has been automatically generated in response to the
> >>> creation of a trouble ticket regarding:
> >>> "Point2grid failed since September 03 2020",
> >>> a summary of which appears below.
> >>>
> >>> There is no need to reply to this message right now. Your
ticket
> >>> has
> >>> been assigned an ID of [rt.rap.ucar.edu #96687].
> >>>
> >>> Please include the string:
> >>>
> >>> [rt.rap.ucar.edu #96687]
> >>>
> >>> in the subject line of all future correspondence about this
issue.
> >>> To do
> >>> so, you may reply to this message.
> >>>
> >>> For more information, please see:
> >>>
> >>> MET Online Tutorial:
> >>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> >>>
> >>> MET Users Guide:
> >>> https://www.dtcenter.org/met/users/docs/overview.php
> >>>
> >>> MET FAQs:
> >>> https://www.dtcenter.org/met/users/support/faqs/index.php
> >>>
> >>> MET-Help Email Archive:
> >>> http://mailman.ucar.edu/pipermail/met_help
> >>>
> >>> Thank you,
> >>> met_help at ucar.edu
> >>>
> >>>
-------------------------------------------------------------------------
> >>> To WHom It May Concern:
> >>>
> >>> I encountered some error for regridding GOES-16 AOD pixel data
to
> >>> AQM
> >>> model
> >>> grid and HYSPLIT model grid. So far as I can tell, it started
to
> >>> fall on
> >>> September 03 2020. It successfully produced AOD regridd data on
> >>> and
> >>> before
> >>> September 02 2020.
> >>>
> >>> Please help me to debug the root of cause of the failure.
> >>>
> >>> ON WCOSS DELL
> >>> (1) data location
> >>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
> >>> Chun.Huang/GOES16_AOD/REGRID
> >>> {denoted as DATADIR}
> >>>
> >>> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in
(1).
> >>> Start
> >>> with line 1729
> >>>
> >>> "terminate called after throwing an instance of
> >>> 'netCDF::exceptions::NcRange'
> >>> what(): NetCDF: Numeric conversion not representable
> >>> file: ncVar.cpp line:1356"
> >>>
> >>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only 10
days
> >>> of
> >>> data
> >>> as yyyymmdd]
> >>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
> >>> hysplit.yyyymmdd
> >>>
> >>> (3) script file :
> >>> /gpfs/dell2/emc/modeling/save/Ho-
> >>> Chun.Huang/plot/goes/run.g16taqm_aod.sh
> >>>
> >>> Please let me know if you have additional question.
> >>>
> >>> Ho-Chun Huang
> >>>
> >>> IMSG at NOAA/NWS/NCEP/EMC
> >>>
> >>> 5830 University Research Ct., Rm. 2792
> >>>
> >>> College Park, MD 20740
> >>>
> >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>>
> >>> 301-683-3958
> >>>
> >>>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Howard Soh
Time: Tue Sep 15 11:47:58 2020
The failure on reading new AOD file happens with "DQF" variable
(unsigned byte type). MET reads the unsigned short type AOD data as
the signed short (without _Unsigned attribute).
The temporary solution without changing MET is "adding _Unsigned
attribute" for both data and quality flag variables (AOD & DQF, and
more variables for ADP).
Ho-Chun, when do you need the supporting unsigned data types (hotfix
or next release at the end of this year or early next year)?
Cheers,
Howard
On Mon Sep 14 09:38:21 2020, hsoh wrote:
> Hi, Ho-Chun
>
> MET does process "_Unsigned" attribute, but does not process the
> unsigned data types. The second part is the cause. I have to
> investigate NetCDF C++ API which recognizes the "unsigned short" as
> the "signed short". The "_Unsigned" attribute is not CF standard,
but
> some programming languages do not support "unsigned" data type, for
> example, Java.
>
> The GOES data is changed from the "short" data type with
> "_Unsigned=true" to the "unsigned short" data type without
> "_Unsigned=true".
>
> The error message by MET was caused by the data value range at the
> attribute "AOD:valid_range = 0US, 65530US ;" which is not allowed in
> signed short data type.
>
> Cheers,
> Howard
>
> Old:
> short AOD(y, x) ;
> AOD:_FillValue = -1s ;
> AOD:long_name = "ABI L2+ Aerosol Optical Depth at
550
> nm" ;
> AOD:standard_name =
> "atmosphere_absorption_optical_thickness_due_to_ambient_aerosol" ;
> AOD:_Unsigned = "true" ;
> AOD:valid_range = 0s, -6s ;
> AOD:scale_factor = 9.156e-05f ;
> AOD:add_offset = -1.f ;
>
> New:
> ushort AOD(y, x) ;
> AOD:_FillValue = 65535US ;
> AOD:long_name = "ABI L2+ Aerosol Optical Depth at
550
> nm" ;
> AOD:standard_name =
> "atmosphere_extinction_optical_thickness_due_to_ambient_aerosol" ;
> AOD:valid_range = 0US, 65530US ;
> AOD:scale_factor = 7.706e-05f ;
> AOD:add_offset = -0.05f ;
>
>
>
> On Mon Sep 14 08:33:14 2020, ho-chun.huang at noaa.gov wrote:
> > Hi,
> >
> > I received information from our developer regarding the data
format
> > changes
> >
> > "In the previous ABI AOD data, there is one attribute as _Unsigned
=
> > "true", which is removed from the new PR.09.03 ABI AOD data. Did
you
> > read
> > this attribute? If yes, you will need to remove it. Hope it
helps."
> >
> > I need to discuss with my supervisor how to resolve this issue.
With
> > the
> > information provided above, can you let me know how much effort
> > needed
> > to
> > read the new GOES-16 data? Does EMC need to give you a new task
list
> > to
> > resolve this issue?
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> >
> > On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA Affiliate <
> > ho-chun.huang at noaa.gov> wrote:
> >
> > > Hi,
> > >
> > > I found the data format has been changed from signed to unsigned
> > > values in
> > > between 16z and 17z on 20200903. I assume that is the reason
the
> > > point2grid can not onstianed valid values NcRange.
> > >
> > > If your assessment is the same, then I need to talk to our
> > > management
> > > about the resolution to thai problem.
> > >
> > >
> > >
> > > Ho-Chun Huang
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct., Rm. 2792
> > >
> > > College Park, MD 20740
> > >
> > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >
> > > 301-683-3958
> > >
> > >
> > > On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA Affiliate <
> > > ho-chun.huang at noaa.gov> wrote:
> > >
> > >> Hi,
> > >>
> > >> After further investigation, the point2grid works on 16Z
20200903
> > >> but
> > >> failed since 17Z 20200903.
> > >>
> > >> I have contacted our data provider at the NOAA NESDIS. But if
you
> > >> can
> > >> tell me more specifically of the meaning of
> > >>
> > >> terminate called after throwing an instance of
> > >> 'netCDF::exceptions::NcRange'
> > >> what(): NetCDF: Numeric conversion not representable
> > >> file: ncVar.cpp line:1356
> > >>
> > >> That would be helpful for me to discuss the problem with NESDIS
> > >> collaborator.
> > >>
> > >> Ho-Chun Huang
> > >>
> > >> IMSG at NOAA/NWS/NCEP/EMC
> > >>
> > >> 5830 University Research Ct., Rm. 2792
> > >>
> > >> College Park, MD 20740
> > >>
> > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >>
> > >> 301-683-3958
> > >>
> > >>
> > >> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >>>
> > >>> Greetings,
> > >>>
> > >>> This message has been automatically generated in response to
the
> > >>> creation of a trouble ticket regarding:
> > >>> "Point2grid failed since September 03 2020",
> > >>> a summary of which appears below.
> > >>>
> > >>> There is no need to reply to this message right now. Your
ticket
> > >>> has
> > >>> been assigned an ID of [rt.rap.ucar.edu #96687].
> > >>>
> > >>> Please include the string:
> > >>>
> > >>> [rt.rap.ucar.edu #96687]
> > >>>
> > >>> in the subject line of all future correspondence about this
> > >>> issue.
> > >>> To do
> > >>> so, you may reply to this message.
> > >>>
> > >>> For more information, please see:
> > >>>
> > >>> MET Online Tutorial:
> > >>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > >>>
> > >>> MET Users Guide:
> > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > >>>
> > >>> MET FAQs:
> > >>> https://www.dtcenter.org/met/users/support/faqs/index.php
> > >>>
> > >>> MET-Help Email Archive:
> > >>> http://mailman.ucar.edu/pipermail/met_help
> > >>>
> > >>> Thank you,
> > >>> met_help at ucar.edu
> > >>>
> > >>>
-------------------------------------------------------------------------
> > >>> To WHom It May Concern:
> > >>>
> > >>> I encountered some error for regridding GOES-16 AOD pixel data
to
> > >>> AQM
> > >>> model
> > >>> grid and HYSPLIT model grid. So far as I can tell, it started
to
> > >>> fall on
> > >>> September 03 2020. It successfully produced AOD regridd data
on
> > >>> and
> > >>> before
> > >>> September 02 2020.
> > >>>
> > >>> Please help me to debug the root of cause of the failure.
> > >>>
> > >>> ON WCOSS DELL
> > >>> (1) data location
> > >>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
> > >>> Chun.Huang/GOES16_AOD/REGRID
> > >>> {denoted as DATADIR}
> > >>>
> > >>> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in
(1).
> > >>> Start
> > >>> with line 1729
> > >>>
> > >>> "terminate called after throwing an instance of
> > >>> 'netCDF::exceptions::NcRange'
> > >>> what(): NetCDF: Numeric conversion not representable
> > >>> file: ncVar.cpp line:1356"
> > >>>
> > >>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only 10
> > >>> days
> > >>> of
> > >>> data
> > >>> as yyyymmdd]
> > >>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
> > >>> hysplit.yyyymmdd
> > >>>
> > >>> (3) script file :
> > >>> /gpfs/dell2/emc/modeling/save/Ho-
> > >>> Chun.Huang/plot/goes/run.g16taqm_aod.sh
> > >>>
> > >>> Please let me know if you have additional question.
> > >>>
> > >>> Ho-Chun Huang
> > >>>
> > >>> IMSG at NOAA/NWS/NCEP/EMC
> > >>>
> > >>> 5830 University Research Ct., Rm. 2792
> > >>>
> > >>> College Park, MD 20740
> > >>>
> > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >>>
> > >>> 301-683-3958
> > >>>
> > >>>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Ho-Chun Huang - NOAA Affiliate
Time: Tue Sep 15 13:16:22 2020
Hi, Howard:
The changes of the GOES-16 AOD file comes from the NESDIS operational
decision. NESDIS's implementation of changes is similar to the EMC
and it
takes some time for the changes to be in effect. I do not think your
temporary solution can be done in a short time, but I will ask.
I currently suspend the CMAQ AOD verification using GOES-16 AOD since
September 03 2020 till EMC can regain the point2grid functionality for
GOES-16 AOD. I understand MET already has a lot of tasks scheduled,
for me
it is as soon as possible, but in reality it is as convenient as it
can be
for your group.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Tue, Sep 15, 2020 at 1:48 PM Howard Soh via RT <met_help at ucar.edu>
wrote:
> The failure on reading new AOD file happens with "DQF" variable
(unsigned
> byte type). MET reads the unsigned short type AOD data as the signed
short
> (without _Unsigned attribute).
>
> The temporary solution without changing MET is "adding _Unsigned
> attribute" for both data and quality flag variables (AOD & DQF, and
more
> variables for ADP).
>
> Ho-Chun, when do you need the supporting unsigned data types (hotfix
or
> next release at the end of this year or early next year)?
>
> Cheers,
> Howard
>
> On Mon Sep 14 09:38:21 2020, hsoh wrote:
> > Hi, Ho-Chun
> >
> > MET does process "_Unsigned" attribute, but does not process the
> > unsigned data types. The second part is the cause. I have to
> > investigate NetCDF C++ API which recognizes the "unsigned short"
as
> > the "signed short". The "_Unsigned" attribute is not CF standard,
but
> > some programming languages do not support "unsigned" data type,
for
> > example, Java.
> >
> > The GOES data is changed from the "short" data type with
> > "_Unsigned=true" to the "unsigned short" data type without
> > "_Unsigned=true".
> >
> > The error message by MET was caused by the data value range at the
> > attribute "AOD:valid_range = 0US, 65530US ;" which is not allowed
in
> > signed short data type.
> >
> > Cheers,
> > Howard
> >
> > Old:
> > short AOD(y, x) ;
> > AOD:_FillValue = -1s ;
> > AOD:long_name = "ABI L2+ Aerosol Optical Depth at
550
> > nm" ;
> > AOD:standard_name =
> > "atmosphere_absorption_optical_thickness_due_to_ambient_aerosol" ;
> > AOD:_Unsigned = "true" ;
> > AOD:valid_range = 0s, -6s ;
> > AOD:scale_factor = 9.156e-05f ;
> > AOD:add_offset = -1.f ;
> >
> > New:
> > ushort AOD(y, x) ;
> > AOD:_FillValue = 65535US ;
> > AOD:long_name = "ABI L2+ Aerosol Optical Depth at
550
> > nm" ;
> > AOD:standard_name =
> > "atmosphere_extinction_optical_thickness_due_to_ambient_aerosol" ;
> > AOD:valid_range = 0US, 65530US ;
> > AOD:scale_factor = 7.706e-05f ;
> > AOD:add_offset = -0.05f ;
> >
> >
> >
> > On Mon Sep 14 08:33:14 2020, ho-chun.huang at noaa.gov wrote:
> > > Hi,
> > >
> > > I received information from our developer regarding the data
format
> > > changes
> > >
> > > "In the previous ABI AOD data, there is one attribute as
_Unsigned =
> > > "true", which is removed from the new PR.09.03 ABI AOD data. Did
you
> > > read
> > > this attribute? If yes, you will need to remove it. Hope it
helps."
> > >
> > > I need to discuss with my supervisor how to resolve this issue.
With
> > > the
> > > information provided above, can you let me know how much effort
> > > needed
> > > to
> > > read the new GOES-16 data? Does EMC need to give you a new task
list
> > > to
> > > resolve this issue?
> > >
> > > Ho-Chun Huang
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct., Rm. 2792
> > >
> > > College Park, MD 20740
> > >
> > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >
> > > 301-683-3958
> > >
> > >
> > > On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA Affiliate <
> > > ho-chun.huang at noaa.gov> wrote:
> > >
> > > > Hi,
> > > >
> > > > I found the data format has been changed from signed to
unsigned
> > > > values in
> > > > between 16z and 17z on 20200903. I assume that is the reason
the
> > > > point2grid can not onstianed valid values NcRange.
> > > >
> > > > If your assessment is the same, then I need to talk to our
> > > > management
> > > > about the resolution to thai problem.
> > > >
> > > >
> > > >
> > > > Ho-Chun Huang
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct., Rm. 2792
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >
> > > > 301-683-3958
> > > >
> > > >
> > > > On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA Affiliate
<
> > > > ho-chun.huang at noaa.gov> wrote:
> > > >
> > > >> Hi,
> > > >>
> > > >> After further investigation, the point2grid works on 16Z
20200903
> > > >> but
> > > >> failed since 17Z 20200903.
> > > >>
> > > >> I have contacted our data provider at the NOAA NESDIS. But
if you
> > > >> can
> > > >> tell me more specifically of the meaning of
> > > >>
> > > >> terminate called after throwing an instance of
> > > >> 'netCDF::exceptions::NcRange'
> > > >> what(): NetCDF: Numeric conversion not representable
> > > >> file: ncVar.cpp line:1356
> > > >>
> > > >> That would be helpful for me to discuss the problem with
NESDIS
> > > >> collaborator.
> > > >>
> > > >> Ho-Chun Huang
> > > >>
> > > >> IMSG at NOAA/NWS/NCEP/EMC
> > > >>
> > > >> 5830 University Research Ct., Rm. 2792
> > > >>
> > > >> College Park, MD 20740
> > > >>
> > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >>
> > > >> 301-683-3958
> > > >>
> > > >>
> > > >> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >>>
> > > >>> Greetings,
> > > >>>
> > > >>> This message has been automatically generated in response to
the
> > > >>> creation of a trouble ticket regarding:
> > > >>> "Point2grid failed since September 03 2020",
> > > >>> a summary of which appears below.
> > > >>>
> > > >>> There is no need to reply to this message right now. Your
ticket
> > > >>> has
> > > >>> been assigned an ID of [rt.rap.ucar.edu #96687].
> > > >>>
> > > >>> Please include the string:
> > > >>>
> > > >>> [rt.rap.ucar.edu #96687]
> > > >>>
> > > >>> in the subject line of all future correspondence about this
> > > >>> issue.
> > > >>> To do
> > > >>> so, you may reply to this message.
> > > >>>
> > > >>> For more information, please see:
> > > >>>
> > > >>> MET Online Tutorial:
> > > >>>
> https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > > >>>
> > > >>> MET Users Guide:
> > > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > > >>>
> > > >>> MET FAQs:
> > > >>> https://www.dtcenter.org/met/users/support/faqs/index.php
> > > >>>
> > > >>> MET-Help Email Archive:
> > > >>> http://mailman.ucar.edu/pipermail/met_help
> > > >>>
> > > >>> Thank you,
> > > >>> met_help at ucar.edu
> > > >>>
> > > >>>
>
-------------------------------------------------------------------------
> > > >>> To WHom It May Concern:
> > > >>>
> > > >>> I encountered some error for regridding GOES-16 AOD pixel
data to
> > > >>> AQM
> > > >>> model
> > > >>> grid and HYSPLIT model grid. So far as I can tell, it
started to
> > > >>> fall on
> > > >>> September 03 2020. It successfully produced AOD regridd
data on
> > > >>> and
> > > >>> before
> > > >>> September 02 2020.
> > > >>>
> > > >>> Please help me to debug the root of cause of the failure.
> > > >>>
> > > >>> ON WCOSS DELL
> > > >>> (1) data location
> > > >>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
> > > >>> Chun.Huang/GOES16_AOD/REGRID
> > > >>> {denoted as DATADIR}
> > > >>>
> > > >>> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in
(1).
> > > >>> Start
> > > >>> with line 1729
> > > >>>
> > > >>> "terminate called after throwing an instance of
> > > >>> 'netCDF::exceptions::NcRange'
> > > >>> what(): NetCDF: Numeric conversion not representable
> > > >>> file: ncVar.cpp line:1356"
> > > >>>
> > > >>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep only
10
> > > >>> days
> > > >>> of
> > > >>> data
> > > >>> as yyyymmdd]
> > > >>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
> > > >>> hysplit.yyyymmdd
> > > >>>
> > > >>> (3) script file :
> > > >>> /gpfs/dell2/emc/modeling/save/Ho-
> > > >>> Chun.Huang/plot/goes/run.g16taqm_aod.sh
> > > >>>
> > > >>> Please let me know if you have additional question.
> > > >>>
> > > >>> Ho-Chun Huang
> > > >>>
> > > >>> IMSG at NOAA/NWS/NCEP/EMC
> > > >>>
> > > >>> 5830 University Research Ct., Rm. 2792
> > > >>>
> > > >>> College Park, MD 20740
> > > >>>
> > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >>>
> > > >>> 301-683-3958
> > > >>>
> > > >>>
>
>
>
>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: John Halley Gotway
Time: Tue Sep 15 16:11:45 2020
Hi Ho-Chun,
I wanted to let you know that Howard wrote up this change as an issue
in
GitHub:
https://github.com/dtcenter/MET/issues/1492
He'll start by fixing it in the develop branch for inclusion in the
next
major MET release, MET-10.0 in March 2021.
Once we're confident that it's working well there, we can evaluate how
significant the changes are and consider including it in a met-9.1.1
bugfix
release sooner than that.
One option would be asking you to join the DTCenter organization on
GitHub.
Then, we could assign this issue to both you and Howard. Howard can do
the
code changes and you could test to confirm that they work correctly.
If
you'd like to do this, please just send me your GitHub user name, and
I'll
invite you to join the DTCenter organization.
Thanks,
John
On Tue, Sep 15, 2020 at 1:16 PM Ho-Chun Huang - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96687 >
>
> Hi, Howard:
>
> The changes of the GOES-16 AOD file comes from the NESDIS
operational
> decision. NESDIS's implementation of changes is similar to the EMC
and it
> takes some time for the changes to be in effect. I do not think
your
> temporary solution can be done in a short time, but I will ask.
>
> I currently suspend the CMAQ AOD verification using GOES-16 AOD
since
> September 03 2020 till EMC can regain the point2grid functionality
for
> GOES-16 AOD. I understand MET already has a lot of tasks scheduled,
for me
> it is as soon as possible, but in reality it is as convenient as it
can be
> for your group.
>
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Tue, Sep 15, 2020 at 1:48 PM Howard Soh via RT
<met_help at ucar.edu>
> wrote:
>
> > The failure on reading new AOD file happens with "DQF" variable
(unsigned
> > byte type). MET reads the unsigned short type AOD data as the
signed
> short
> > (without _Unsigned attribute).
> >
> > The temporary solution without changing MET is "adding _Unsigned
> > attribute" for both data and quality flag variables (AOD & DQF,
and more
> > variables for ADP).
> >
> > Ho-Chun, when do you need the supporting unsigned data types
(hotfix or
> > next release at the end of this year or early next year)?
> >
> > Cheers,
> > Howard
> >
> > On Mon Sep 14 09:38:21 2020, hsoh wrote:
> > > Hi, Ho-Chun
> > >
> > > MET does process "_Unsigned" attribute, but does not process the
> > > unsigned data types. The second part is the cause. I have to
> > > investigate NetCDF C++ API which recognizes the "unsigned short"
as
> > > the "signed short". The "_Unsigned" attribute is not CF
standard, but
> > > some programming languages do not support "unsigned" data type,
for
> > > example, Java.
> > >
> > > The GOES data is changed from the "short" data type with
> > > "_Unsigned=true" to the "unsigned short" data type without
> > > "_Unsigned=true".
> > >
> > > The error message by MET was caused by the data value range at
the
> > > attribute "AOD:valid_range = 0US, 65530US ;" which is not
allowed in
> > > signed short data type.
> > >
> > > Cheers,
> > > Howard
> > >
> > > Old:
> > > short AOD(y, x) ;
> > > AOD:_FillValue = -1s ;
> > > AOD:long_name = "ABI L2+ Aerosol Optical Depth
at 550
> > > nm" ;
> > > AOD:standard_name =
> > > "atmosphere_absorption_optical_thickness_due_to_ambient_aerosol"
;
> > > AOD:_Unsigned = "true" ;
> > > AOD:valid_range = 0s, -6s ;
> > > AOD:scale_factor = 9.156e-05f ;
> > > AOD:add_offset = -1.f ;
> > >
> > > New:
> > > ushort AOD(y, x) ;
> > > AOD:_FillValue = 65535US ;
> > > AOD:long_name = "ABI L2+ Aerosol Optical Depth
at 550
> > > nm" ;
> > > AOD:standard_name =
> > > "atmosphere_extinction_optical_thickness_due_to_ambient_aerosol"
;
> > > AOD:valid_range = 0US, 65530US ;
> > > AOD:scale_factor = 7.706e-05f ;
> > > AOD:add_offset = -0.05f ;
> > >
> > >
> > >
> > > On Mon Sep 14 08:33:14 2020, ho-chun.huang at noaa.gov wrote:
> > > > Hi,
> > > >
> > > > I received information from our developer regarding the data
format
> > > > changes
> > > >
> > > > "In the previous ABI AOD data, there is one attribute as
_Unsigned =
> > > > "true", which is removed from the new PR.09.03 ABI AOD data.
Did you
> > > > read
> > > > this attribute? If yes, you will need to remove it. Hope it
helps."
> > > >
> > > > I need to discuss with my supervisor how to resolve this
issue. With
> > > > the
> > > > information provided above, can you let me know how much
effort
> > > > needed
> > > > to
> > > > read the new GOES-16 data? Does EMC need to give you a new
task list
> > > > to
> > > > resolve this issue?
> > > >
> > > > Ho-Chun Huang
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct., Rm. 2792
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >
> > > > 301-683-3958
> > > >
> > > >
> > > > On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA Affiliate
<
> > > > ho-chun.huang at noaa.gov> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I found the data format has been changed from signed to
unsigned
> > > > > values in
> > > > > between 16z and 17z on 20200903. I assume that is the
reason the
> > > > > point2grid can not onstianed valid values NcRange.
> > > > >
> > > > > If your assessment is the same, then I need to talk to our
> > > > > management
> > > > > about the resolution to thai problem.
> > > > >
> > > > >
> > > > >
> > > > > Ho-Chun Huang
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct., Rm. 2792
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >
> > > > > 301-683-3958
> > > > >
> > > > >
> > > > > On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA
Affiliate <
> > > > > ho-chun.huang at noaa.gov> wrote:
> > > > >
> > > > >> Hi,
> > > > >>
> > > > >> After further investigation, the point2grid works on 16Z
20200903
> > > > >> but
> > > > >> failed since 17Z 20200903.
> > > > >>
> > > > >> I have contacted our data provider at the NOAA NESDIS. But
if you
> > > > >> can
> > > > >> tell me more specifically of the meaning of
> > > > >>
> > > > >> terminate called after throwing an instance of
> > > > >> 'netCDF::exceptions::NcRange'
> > > > >> what(): NetCDF: Numeric conversion not representable
> > > > >> file: ncVar.cpp line:1356
> > > > >>
> > > > >> That would be helpful for me to discuss the problem with
NESDIS
> > > > >> collaborator.
> > > > >>
> > > > >> Ho-Chun Huang
> > > > >>
> > > > >> IMSG at NOAA/NWS/NCEP/EMC
> > > > >>
> > > > >> 5830 University Research Ct., Rm. 2792
> > > > >>
> > > > >> College Park, MD 20740
> > > > >>
> > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >>
> > > > >> 301-683-3958
> > > > >>
> > > > >>
> > > > >> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT <
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >>>
> > > > >>> Greetings,
> > > > >>>
> > > > >>> This message has been automatically generated in response
to the
> > > > >>> creation of a trouble ticket regarding:
> > > > >>> "Point2grid failed since September 03 2020",
> > > > >>> a summary of which appears below.
> > > > >>>
> > > > >>> There is no need to reply to this message right now. Your
ticket
> > > > >>> has
> > > > >>> been assigned an ID of [rt.rap.ucar.edu #96687].
> > > > >>>
> > > > >>> Please include the string:
> > > > >>>
> > > > >>> [rt.rap.ucar.edu #96687]
> > > > >>>
> > > > >>> in the subject line of all future correspondence about
this
> > > > >>> issue.
> > > > >>> To do
> > > > >>> so, you may reply to this message.
> > > > >>>
> > > > >>> For more information, please see:
> > > > >>>
> > > > >>> MET Online Tutorial:
> > > > >>>
> >
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > > > >>>
> > > > >>> MET Users Guide:
> > > > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > > > >>>
> > > > >>> MET FAQs:
> > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
> > > > >>>
> > > > >>> MET-Help Email Archive:
> > > > >>> http://mailman.ucar.edu/pipermail/met_help
> > > > >>>
> > > > >>> Thank you,
> > > > >>> met_help at ucar.edu
> > > > >>>
> > > > >>>
> >
-------------------------------------------------------------------------
> > > > >>> To WHom It May Concern:
> > > > >>>
> > > > >>> I encountered some error for regridding GOES-16 AOD pixel
data to
> > > > >>> AQM
> > > > >>> model
> > > > >>> grid and HYSPLIT model grid. So far as I can tell, it
started to
> > > > >>> fall on
> > > > >>> September 03 2020. It successfully produced AOD regridd
data on
> > > > >>> and
> > > > >>> before
> > > > >>> September 02 2020.
> > > > >>>
> > > > >>> Please help me to debug the root of cause of the failure.
> > > > >>>
> > > > >>> ON WCOSS DELL
> > > > >>> (1) data location
> > > > >>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
> > > > >>> Chun.Huang/GOES16_AOD/REGRID
> > > > >>> {denoted as DATADIR}
> > > > >>>
> > > > >>> (2) Log file : ${DATADIR}/daily_ftp_goes16_aod_adp.sh.log
in (1).
> > > > >>> Start
> > > > >>> with line 1729
> > > > >>>
> > > > >>> "terminate called after throwing an instance of
> > > > >>> 'netCDF::exceptions::NcRange'
> > > > >>> what(): NetCDF: Numeric conversion not representable
> > > > >>> file: ncVar.cpp line:1356"
> > > > >>>
> > > > >>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep
only 10
> > > > >>> days
> > > > >>> of
> > > > >>> data
> > > > >>> as yyyymmdd]
> > > > >>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
> > > > >>> hysplit.yyyymmdd
> > > > >>>
> > > > >>> (3) script file :
> > > > >>> /gpfs/dell2/emc/modeling/save/Ho-
> > > > >>> Chun.Huang/plot/goes/run.g16taqm_aod.sh
> > > > >>>
> > > > >>> Please let me know if you have additional question.
> > > > >>>
> > > > >>> Ho-Chun Huang
> > > > >>>
> > > > >>> IMSG at NOAA/NWS/NCEP/EMC
> > > > >>>
> > > > >>> 5830 University Research Ct., Rm. 2792
> > > > >>>
> > > > >>> College Park, MD 20740
> > > > >>>
> > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >>>
> > > > >>> 301-683-3958
> > > > >>>
> > > > >>>
> >
> >
> >
> >
>
>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: Ho-Chun Huang - NOAA Affiliate
Time: Thu Sep 17 06:38:14 2020
Hi, John:
Thanks for the update. I am waiting for the response from my task
lead for
the participation of testing. Will get back to you as soon as
possible.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Tue, Sep 15, 2020 at 6:11 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Ho-Chun,
>
> I wanted to let you know that Howard wrote up this change as an
issue in
> GitHub:
> https://github.com/dtcenter/MET/issues/1492
>
> He'll start by fixing it in the develop branch for inclusion in the
next
> major MET release, MET-10.0 in March 2021.
> Once we're confident that it's working well there, we can evaluate
how
> significant the changes are and consider including it in a met-9.1.1
bugfix
> release sooner than that.
>
> One option would be asking you to join the DTCenter organization on
GitHub.
> Then, we could assign this issue to both you and Howard. Howard can
do the
> code changes and you could test to confirm that they work correctly.
If
> you'd like to do this, please just send me your GitHub user name,
and I'll
> invite you to join the DTCenter organization.
>
> Thanks,
> John
>
> On Tue, Sep 15, 2020 at 1:16 PM Ho-Chun Huang - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96687 >
> >
> > Hi, Howard:
> >
> > The changes of the GOES-16 AOD file comes from the NESDIS
operational
> > decision. NESDIS's implementation of changes is similar to the
EMC and
> it
> > takes some time for the changes to be in effect. I do not think
your
> > temporary solution can be done in a short time, but I will ask.
> >
> > I currently suspend the CMAQ AOD verification using GOES-16 AOD
since
> > September 03 2020 till EMC can regain the point2grid functionality
for
> > GOES-16 AOD. I understand MET already has a lot of tasks
scheduled, for
> me
> > it is as soon as possible, but in reality it is as convenient as
it can
> be
> > for your group.
> >
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> >
> > On Tue, Sep 15, 2020 at 1:48 PM Howard Soh via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > The failure on reading new AOD file happens with "DQF" variable
> (unsigned
> > > byte type). MET reads the unsigned short type AOD data as the
signed
> > short
> > > (without _Unsigned attribute).
> > >
> > > The temporary solution without changing MET is "adding _Unsigned
> > > attribute" for both data and quality flag variables (AOD & DQF,
and
> more
> > > variables for ADP).
> > >
> > > Ho-Chun, when do you need the supporting unsigned data types
(hotfix or
> > > next release at the end of this year or early next year)?
> > >
> > > Cheers,
> > > Howard
> > >
> > > On Mon Sep 14 09:38:21 2020, hsoh wrote:
> > > > Hi, Ho-Chun
> > > >
> > > > MET does process "_Unsigned" attribute, but does not process
the
> > > > unsigned data types. The second part is the cause. I have to
> > > > investigate NetCDF C++ API which recognizes the "unsigned
short" as
> > > > the "signed short". The "_Unsigned" attribute is not CF
standard, but
> > > > some programming languages do not support "unsigned" data
type, for
> > > > example, Java.
> > > >
> > > > The GOES data is changed from the "short" data type with
> > > > "_Unsigned=true" to the "unsigned short" data type without
> > > > "_Unsigned=true".
> > > >
> > > > The error message by MET was caused by the data value range at
the
> > > > attribute "AOD:valid_range = 0US, 65530US ;" which is not
allowed in
> > > > signed short data type.
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > Old:
> > > > short AOD(y, x) ;
> > > > AOD:_FillValue = -1s ;
> > > > AOD:long_name = "ABI L2+ Aerosol Optical Depth
at 550
> > > > nm" ;
> > > > AOD:standard_name =
> > > >
"atmosphere_absorption_optical_thickness_due_to_ambient_aerosol" ;
> > > > AOD:_Unsigned = "true" ;
> > > > AOD:valid_range = 0s, -6s ;
> > > > AOD:scale_factor = 9.156e-05f ;
> > > > AOD:add_offset = -1.f ;
> > > >
> > > > New:
> > > > ushort AOD(y, x) ;
> > > > AOD:_FillValue = 65535US ;
> > > > AOD:long_name = "ABI L2+ Aerosol Optical Depth
at 550
> > > > nm" ;
> > > > AOD:standard_name =
> > > >
"atmosphere_extinction_optical_thickness_due_to_ambient_aerosol" ;
> > > > AOD:valid_range = 0US, 65530US ;
> > > > AOD:scale_factor = 7.706e-05f ;
> > > > AOD:add_offset = -0.05f ;
> > > >
> > > >
> > > >
> > > > On Mon Sep 14 08:33:14 2020, ho-chun.huang at noaa.gov wrote:
> > > > > Hi,
> > > > >
> > > > > I received information from our developer regarding the data
format
> > > > > changes
> > > > >
> > > > > "In the previous ABI AOD data, there is one attribute as
_Unsigned
> =
> > > > > "true", which is removed from the new PR.09.03 ABI AOD data.
Did
> you
> > > > > read
> > > > > this attribute? If yes, you will need to remove it. Hope it
helps."
> > > > >
> > > > > I need to discuss with my supervisor how to resolve this
issue.
> With
> > > > > the
> > > > > information provided above, can you let me know how much
effort
> > > > > needed
> > > > > to
> > > > > read the new GOES-16 data? Does EMC need to give you a new
task
> list
> > > > > to
> > > > > resolve this issue?
> > > > >
> > > > > Ho-Chun Huang
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct., Rm. 2792
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >
> > > > > 301-683-3958
> > > > >
> > > > >
> > > > > On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA
Affiliate <
> > > > > ho-chun.huang at noaa.gov> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I found the data format has been changed from signed to
unsigned
> > > > > > values in
> > > > > > between 16z and 17z on 20200903. I assume that is the
reason
> the
> > > > > > point2grid can not onstianed valid values NcRange.
> > > > > >
> > > > > > If your assessment is the same, then I need to talk to our
> > > > > > management
> > > > > > about the resolution to thai problem.
> > > > > >
> > > > > >
> > > > > >
> > > > > > Ho-Chun Huang
> > > > > >
> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >
> > > > > > 5830 University Research Ct., Rm. 2792
> > > > > >
> > > > > > College Park, MD 20740
> > > > > >
> > > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > >
> > > > > > 301-683-3958
> > > > > >
> > > > > >
> > > > > > On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA
Affiliate <
> > > > > > ho-chun.huang at noaa.gov> wrote:
> > > > > >
> > > > > >> Hi,
> > > > > >>
> > > > > >> After further investigation, the point2grid works on 16Z
> 20200903
> > > > > >> but
> > > > > >> failed since 17Z 20200903.
> > > > > >>
> > > > > >> I have contacted our data provider at the NOAA NESDIS.
But if
> you
> > > > > >> can
> > > > > >> tell me more specifically of the meaning of
> > > > > >>
> > > > > >> terminate called after throwing an instance of
> > > > > >> 'netCDF::exceptions::NcRange'
> > > > > >> what(): NetCDF: Numeric conversion not representable
> > > > > >> file: ncVar.cpp line:1356
> > > > > >>
> > > > > >> That would be helpful for me to discuss the problem with
NESDIS
> > > > > >> collaborator.
> > > > > >>
> > > > > >> Ho-Chun Huang
> > > > > >>
> > > > > >> IMSG at NOAA/NWS/NCEP/EMC
> > > > > >>
> > > > > >> 5830 University Research Ct., Rm. 2792
> > > > > >>
> > > > > >> College Park, MD 20740
> > > > > >>
> > > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > >>
> > > > > >> 301-683-3958
> > > > > >>
> > > > > >>
> > > > > >> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via RT
<
> > > > > >> met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >>>
> > > > > >>> Greetings,
> > > > > >>>
> > > > > >>> This message has been automatically generated in
response to
> the
> > > > > >>> creation of a trouble ticket regarding:
> > > > > >>> "Point2grid failed since September 03 2020",
> > > > > >>> a summary of which appears below.
> > > > > >>>
> > > > > >>> There is no need to reply to this message right now.
Your
> ticket
> > > > > >>> has
> > > > > >>> been assigned an ID of [rt.rap.ucar.edu #96687].
> > > > > >>>
> > > > > >>> Please include the string:
> > > > > >>>
> > > > > >>> [rt.rap.ucar.edu #96687]
> > > > > >>>
> > > > > >>> in the subject line of all future correspondence about
this
> > > > > >>> issue.
> > > > > >>> To do
> > > > > >>> so, you may reply to this message.
> > > > > >>>
> > > > > >>> For more information, please see:
> > > > > >>>
> > > > > >>> MET Online Tutorial:
> > > > > >>>
> > >
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > > > > >>>
> > > > > >>> MET Users Guide:
> > > > > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > > > > >>>
> > > > > >>> MET FAQs:
> > > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
> > > > > >>>
> > > > > >>> MET-Help Email Archive:
> > > > > >>> http://mailman.ucar.edu/pipermail/met_help
> > > > > >>>
> > > > > >>> Thank you,
> > > > > >>> met_help at ucar.edu
> > > > > >>>
> > > > > >>>
> > >
>
-------------------------------------------------------------------------
> > > > > >>> To WHom It May Concern:
> > > > > >>>
> > > > > >>> I encountered some error for regridding GOES-16 AOD
pixel data
> to
> > > > > >>> AQM
> > > > > >>> model
> > > > > >>> grid and HYSPLIT model grid. So far as I can tell, it
started
> to
> > > > > >>> fall on
> > > > > >>> September 03 2020. It successfully produced AOD regridd
data
> on
> > > > > >>> and
> > > > > >>> before
> > > > > >>> September 02 2020.
> > > > > >>>
> > > > > >>> Please help me to debug the root of cause of the
failure.
> > > > > >>>
> > > > > >>> ON WCOSS DELL
> > > > > >>> (1) data location
> > > > > >>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
> > > > > >>> Chun.Huang/GOES16_AOD/REGRID
> > > > > >>> {denoted as DATADIR}
> > > > > >>>
> > > > > >>> (2) Log file :
${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in
> (1).
> > > > > >>> Start
> > > > > >>> with line 1729
> > > > > >>>
> > > > > >>> "terminate called after throwing an instance of
> > > > > >>> 'netCDF::exceptions::NcRange'
> > > > > >>> what(): NetCDF: Numeric conversion not representable
> > > > > >>> file: ncVar.cpp line:1356"
> > > > > >>>
> > > > > >>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep
only 10
> > > > > >>> days
> > > > > >>> of
> > > > > >>> data
> > > > > >>> as yyyymmdd]
> > > > > >>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
> > > > > >>> hysplit.yyyymmdd
> > > > > >>>
> > > > > >>> (3) script file :
> > > > > >>> /gpfs/dell2/emc/modeling/save/Ho-
> > > > > >>> Chun.Huang/plot/goes/run.g16taqm_aod.sh
> > > > > >>>
> > > > > >>> Please let me know if you have additional question.
> > > > > >>>
> > > > > >>> Ho-Chun Huang
> > > > > >>>
> > > > > >>> IMSG at NOAA/NWS/NCEP/EMC
> > > > > >>>
> > > > > >>> 5830 University Research Ct., Rm. 2792
> > > > > >>>
> > > > > >>> College Park, MD 20740
> > > > > >>>
> > > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > >>>
> > > > > >>> 301-683-3958
> > > > > >>>
> > > > > >>>
> > >
> > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Point2grid failed since September 03 2020
From: John Halley Gotway
Time: Thu Sep 17 12:08:05 2020
Ho-Chun,
You can definitely still do the testing for this feature when it's
available in a beta release. And there certainly is no requirement
that you
join/use GitHub. I just mentioned it as an option in case you're
already
using GitHub in other contexts. So it's an option for the future if
that
sounds useful to you.
I'll go ahead and resolve this ticket for now.
Thanks,
John
On Thu, Sep 17, 2020 at 6:38 AM Ho-Chun Huang - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96687 >
>
> Hi, John:
>
> Thanks for the update. I am waiting for the response from my task
lead for
> the participation of testing. Will get back to you as soon as
possible.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Tue, Sep 15, 2020 at 6:11 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Ho-Chun,
> >
> > I wanted to let you know that Howard wrote up this change as an
issue in
> > GitHub:
> > https://github.com/dtcenter/MET/issues/1492
> >
> > He'll start by fixing it in the develop branch for inclusion in
the next
> > major MET release, MET-10.0 in March 2021.
> > Once we're confident that it's working well there, we can evaluate
how
> > significant the changes are and consider including it in a met-
9.1.1
> bugfix
> > release sooner than that.
> >
> > One option would be asking you to join the DTCenter organization
on
> GitHub.
> > Then, we could assign this issue to both you and Howard. Howard
can do
> the
> > code changes and you could test to confirm that they work
correctly. If
> > you'd like to do this, please just send me your GitHub user name,
and
> I'll
> > invite you to join the DTCenter organization.
> >
> > Thanks,
> > John
> >
> > On Tue, Sep 15, 2020 at 1:16 PM Ho-Chun Huang - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=96687 >
> > >
> > > Hi, Howard:
> > >
> > > The changes of the GOES-16 AOD file comes from the NESDIS
operational
> > > decision. NESDIS's implementation of changes is similar to the
EMC and
> > it
> > > takes some time for the changes to be in effect. I do not think
your
> > > temporary solution can be done in a short time, but I will ask.
> > >
> > > I currently suspend the CMAQ AOD verification using GOES-16 AOD
since
> > > September 03 2020 till EMC can regain the point2grid
functionality for
> > > GOES-16 AOD. I understand MET already has a lot of tasks
scheduled,
> for
> > me
> > > it is as soon as possible, but in reality it is as convenient as
it can
> > be
> > > for your group.
> > >
> > >
> > > Ho-Chun Huang
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct., Rm. 2792
> > >
> > > College Park, MD 20740
> > >
> > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >
> > > 301-683-3958
> > >
> > >
> > > On Tue, Sep 15, 2020 at 1:48 PM Howard Soh via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > The failure on reading new AOD file happens with "DQF"
variable
> > (unsigned
> > > > byte type). MET reads the unsigned short type AOD data as the
signed
> > > short
> > > > (without _Unsigned attribute).
> > > >
> > > > The temporary solution without changing MET is "adding
_Unsigned
> > > > attribute" for both data and quality flag variables (AOD &
DQF, and
> > more
> > > > variables for ADP).
> > > >
> > > > Ho-Chun, when do you need the supporting unsigned data types
(hotfix
> or
> > > > next release at the end of this year or early next year)?
> > > >
> > > > Cheers,
> > > > Howard
> > > >
> > > > On Mon Sep 14 09:38:21 2020, hsoh wrote:
> > > > > Hi, Ho-Chun
> > > > >
> > > > > MET does process "_Unsigned" attribute, but does not process
the
> > > > > unsigned data types. The second part is the cause. I have to
> > > > > investigate NetCDF C++ API which recognizes the "unsigned
short" as
> > > > > the "signed short". The "_Unsigned" attribute is not CF
standard,
> but
> > > > > some programming languages do not support "unsigned" data
type, for
> > > > > example, Java.
> > > > >
> > > > > The GOES data is changed from the "short" data type with
> > > > > "_Unsigned=true" to the "unsigned short" data type without
> > > > > "_Unsigned=true".
> > > > >
> > > > > The error message by MET was caused by the data value range
at the
> > > > > attribute "AOD:valid_range = 0US, 65530US ;" which is not
allowed
> in
> > > > > signed short data type.
> > > > >
> > > > > Cheers,
> > > > > Howard
> > > > >
> > > > > Old:
> > > > > short AOD(y, x) ;
> > > > > AOD:_FillValue = -1s ;
> > > > > AOD:long_name = "ABI L2+ Aerosol Optical
Depth at
> 550
> > > > > nm" ;
> > > > > AOD:standard_name =
> > > > >
"atmosphere_absorption_optical_thickness_due_to_ambient_aerosol" ;
> > > > > AOD:_Unsigned = "true" ;
> > > > > AOD:valid_range = 0s, -6s ;
> > > > > AOD:scale_factor = 9.156e-05f ;
> > > > > AOD:add_offset = -1.f ;
> > > > >
> > > > > New:
> > > > > ushort AOD(y, x) ;
> > > > > AOD:_FillValue = 65535US ;
> > > > > AOD:long_name = "ABI L2+ Aerosol Optical
Depth at
> 550
> > > > > nm" ;
> > > > > AOD:standard_name =
> > > > >
"atmosphere_extinction_optical_thickness_due_to_ambient_aerosol" ;
> > > > > AOD:valid_range = 0US, 65530US ;
> > > > > AOD:scale_factor = 7.706e-05f ;
> > > > > AOD:add_offset = -0.05f ;
> > > > >
> > > > >
> > > > >
> > > > > On Mon Sep 14 08:33:14 2020, ho-chun.huang at noaa.gov wrote:
> > > > > > Hi,
> > > > > >
> > > > > > I received information from our developer regarding the
data
> format
> > > > > > changes
> > > > > >
> > > > > > "In the previous ABI AOD data, there is one attribute as
> _Unsigned
> > =
> > > > > > "true", which is removed from the new PR.09.03 ABI AOD
data. Did
> > you
> > > > > > read
> > > > > > this attribute? If yes, you will need to remove it. Hope
it
> helps."
> > > > > >
> > > > > > I need to discuss with my supervisor how to resolve this
issue.
> > With
> > > > > > the
> > > > > > information provided above, can you let me know how much
effort
> > > > > > needed
> > > > > > to
> > > > > > read the new GOES-16 data? Does EMC need to give you a
new task
> > list
> > > > > > to
> > > > > > resolve this issue?
> > > > > >
> > > > > > Ho-Chun Huang
> > > > > >
> > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > >
> > > > > > 5830 University Research Ct., Rm. 2792
> > > > > >
> > > > > > College Park, MD 20740
> > > > > >
> > > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > >
> > > > > > 301-683-3958
> > > > > >
> > > > > >
> > > > > > On Mon, Sep 14, 2020 at 9:23 AM Ho-Chun Huang - NOAA
Affiliate <
> > > > > > ho-chun.huang at noaa.gov> wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > I found the data format has been changed from signed to
> unsigned
> > > > > > > values in
> > > > > > > between 16z and 17z on 20200903. I assume that is the
reason
> > the
> > > > > > > point2grid can not onstianed valid values NcRange.
> > > > > > >
> > > > > > > If your assessment is the same, then I need to talk to
our
> > > > > > > management
> > > > > > > about the resolution to thai problem.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Ho-Chun Huang
> > > > > > >
> > > > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >
> > > > > > > 5830 University Research Ct., Rm. 2792
> > > > > > >
> > > > > > > College Park, MD 20740
> > > > > > >
> > > > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > > >
> > > > > > > 301-683-3958
> > > > > > >
> > > > > > >
> > > > > > > On Mon, Sep 14, 2020 at 9:11 AM Ho-Chun Huang - NOAA
Affiliate
> <
> > > > > > > ho-chun.huang at noaa.gov> wrote:
> > > > > > >
> > > > > > >> Hi,
> > > > > > >>
> > > > > > >> After further investigation, the point2grid works on
16Z
> > 20200903
> > > > > > >> but
> > > > > > >> failed since 17Z 20200903.
> > > > > > >>
> > > > > > >> I have contacted our data provider at the NOAA NESDIS.
But if
> > you
> > > > > > >> can
> > > > > > >> tell me more specifically of the meaning of
> > > > > > >>
> > > > > > >> terminate called after throwing an instance of
> > > > > > >> 'netCDF::exceptions::NcRange'
> > > > > > >> what(): NetCDF: Numeric conversion not representable
> > > > > > >> file: ncVar.cpp line:1356
> > > > > > >>
> > > > > > >> That would be helpful for me to discuss the problem
with
> NESDIS
> > > > > > >> collaborator.
> > > > > > >>
> > > > > > >> Ho-Chun Huang
> > > > > > >>
> > > > > > >> IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >>
> > > > > > >> 5830 University Research Ct., Rm. 2792
> > > > > > >>
> > > > > > >> College Park, MD 20740
> > > > > > >>
> > > > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > > >>
> > > > > > >> 301-683-3958
> > > > > > >>
> > > > > > >>
> > > > > > >> On Sun, Sep 13, 2020 at 1:54 PM met_help at ucar.edu via
RT <
> > > > > > >> met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >>>
> > > > > > >>> Greetings,
> > > > > > >>>
> > > > > > >>> This message has been automatically generated in
response to
> > the
> > > > > > >>> creation of a trouble ticket regarding:
> > > > > > >>> "Point2grid failed since September 03 2020",
> > > > > > >>> a summary of which appears below.
> > > > > > >>>
> > > > > > >>> There is no need to reply to this message right now.
Your
> > ticket
> > > > > > >>> has
> > > > > > >>> been assigned an ID of [rt.rap.ucar.edu #96687].
> > > > > > >>>
> > > > > > >>> Please include the string:
> > > > > > >>>
> > > > > > >>> [rt.rap.ucar.edu #96687]
> > > > > > >>>
> > > > > > >>> in the subject line of all future correspondence about
this
> > > > > > >>> issue.
> > > > > > >>> To do
> > > > > > >>> so, you may reply to this message.
> > > > > > >>>
> > > > > > >>> For more information, please see:
> > > > > > >>>
> > > > > > >>> MET Online Tutorial:
> > > > > > >>>
> > > >
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > > > > > >>>
> > > > > > >>> MET Users Guide:
> > > > > > >>>
https://www.dtcenter.org/met/users/docs/overview.php
> > > > > > >>>
> > > > > > >>> MET FAQs:
> > > > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
> > > > > > >>>
> > > > > > >>> MET-Help Email Archive:
> > > > > > >>> http://mailman.ucar.edu/pipermail/met_help
> > > > > > >>>
> > > > > > >>> Thank you,
> > > > > > >>> met_help at ucar.edu
> > > > > > >>>
> > > > > > >>>
> > > >
> >
-------------------------------------------------------------------------
> > > > > > >>> To WHom It May Concern:
> > > > > > >>>
> > > > > > >>> I encountered some error for regridding GOES-16 AOD
pixel
> data
> > to
> > > > > > >>> AQM
> > > > > > >>> model
> > > > > > >>> grid and HYSPLIT model grid. So far as I can tell, it
> started
> > to
> > > > > > >>> fall on
> > > > > > >>> September 03 2020. It successfully produced AOD
regridd data
> > on
> > > > > > >>> and
> > > > > > >>> before
> > > > > > >>> September 02 2020.
> > > > > > >>>
> > > > > > >>> Please help me to debug the root of cause of the
failure.
> > > > > > >>>
> > > > > > >>> ON WCOSS DELL
> > > > > > >>> (1) data location
> > > > > > >>> venus:/gpfs/dell2/emc/modeling/noscrub/Ho-
> > > > > > >>> Chun.Huang/GOES16_AOD/REGRID
> > > > > > >>> {denoted as DATADIR}
> > > > > > >>>
> > > > > > >>> (2) Log file :
${DATADIR}/daily_ftp_goes16_aod_adp.sh.log in
> > (1).
> > > > > > >>> Start
> > > > > > >>> with line 1729
> > > > > > >>>
> > > > > > >>> "terminate called after throwing an instance of
> > > > > > >>> 'netCDF::exceptions::NcRange'
> > > > > > >>> what(): NetCDF: Numeric conversion not
representable
> > > > > > >>> file: ncVar.cpp line:1356"
> > > > > > >>>
> > > > > > >>> (3) Input data : ${DATADIR}/AOD/yyyymmdd.keep. [I keep
only
> 10
> > > > > > >>> days
> > > > > > >>> of
> > > > > > >>> data
> > > > > > >>> as yyyymmdd]
> > > > > > >>> (4) Output data : ${DATADIR}/REGRID/aqm.yyyymmdd or
> > > > > > >>> hysplit.yyyymmdd
> > > > > > >>>
> > > > > > >>> (3) script file :
> > > > > > >>> /gpfs/dell2/emc/modeling/save/Ho-
> > > > > > >>> Chun.Huang/plot/goes/run.g16taqm_aod.sh
> > > > > > >>>
> > > > > > >>> Please let me know if you have additional question.
> > > > > > >>>
> > > > > > >>> Ho-Chun Huang
> > > > > > >>>
> > > > > > >>> IMSG at NOAA/NWS/NCEP/EMC
> > > > > > >>>
> > > > > > >>> 5830 University Research Ct., Rm. 2792
> > > > > > >>>
> > > > > > >>> College Park, MD 20740
> > > > > > >>>
> > > > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > > > >>>
> > > > > > >>> 301-683-3958
> > > > > > >>>
> > > > > > >>>
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list