[Met_help] [rt.rap.ucar.edu #93563] History for Close GIT issue to be updated fro MET 9.0

Howard Soh via RT met_help at ucar.edu
Wed Jan 22 09:53:04 MST 2020


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

To WHom It May Help,

John has asked me to check the user guide and regrid_data_plane ADP
function at bi-wwekly MET user's meeting with NCEP.

I found there is a description of using ADP file in v9.0 beta user's
guide.   I can produce the Smoke_AOD and Dust_AOD in model grid with the
new capability.

While trying to produce the same products by IDL code to verify the MET
produced Smoke_AOD and Dust_AOD, I discovered a bug in NESDIS's ADP read
code and need to report to you for the MET 9.0 release.

You can find the description in https://github.com/NCAR/MET/issues/1194

But since it said it has been closed, I am sending the same description
here in case you want to re-open it or create a new one.

====================================================

The description of the smoke and dust mask confidence level has been updated

(OLD)
; bit 6 (sunglint)
tmp_mask=DQF
idx = WHERE(((tmp_mask AND 64) EQ 64), COMPLEMENT=cidx, nc)

*IF nc GT 0 THEN smoke_con[idx] = 0IF nc GT 0 THEN dust_con[idx] = 0*

;Byte1, bit7 (solar and satellite angles)
tmp_mask=DQF
idx = WHERE(((tmp_mask AND 128) EQ 128), COMPLEMENT=cidx, nc)
*IF nc GT 0 THEN dust_con[idx] = 0*

(NEW and Correct one)
; bit 6 (sunglint)
tmp_mask=DQF
idx = WHERE(((tmp_mask AND 64) EQ 64), COMPLEMENT=cidx, nc)
IF nc GT 0 THEN dust_con[idx] = 0

;Byte1, bit7 (solar and satellite angles)
tmp_mask=DQF
idx = WHERE(((tmp_mask AND 128) EQ 128), COMPLEMENT=cidx, nc)
IF nc GT 0 THEN dust_con[idx] = 0
IF nc GT 0 THEN smoke_con[idx] = 0

Please update MET9.0 beta version before official release.

I also want to point out that from AOD files
AOD high quality is quality flag=0
AOD medium quality is quality flag=0,1
AOD low quality is quality flag=0,1,2

For ADP files
Smoke Mask high confidence flag=3
Smoke Mask medium confidence flag=2
Smoke Mask low confidence flag=1
Dust Mask is the same as Smoke Mask
===================================================

Ho-Chun Huang

IMSG at NOAA/NWS/NCEP/EMC

5830 University Research Ct., Rm. 2792

College Park, MD 20740

Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>

301-683-3958


----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Close GIT issue to be updated fro MET 9.0
From: Ho-Chun Huang - NOAA Affiliate
Time: Tue Dec 24 08:40:22 2019

To Whom It May Concern:

There may have some issues for the enhanced regrid_data_plane
capability
for variable AOD_Smoke and AOD_Dust.

I use idl program to plot out Smoke_AOD and Dust_AOD in pixel scale.
There
is no high quality Dust_AOD pixel for any hour on 2019 08 01.  But the
regrid_data_plane does have non-zero high quality Dust_AOD regrided to
hysplit model grid.

While working on the smoke/dust mask confidence level, the value of
high
confidence smoke/dust mask is 3. medium confidence is 2, and low
confidence
is 1.  I do not know whether you notice the difference from AOD
quality
flag, 0 is high, 1 is medium, and 2 is low.  You should have a copy of
NESDIS readme for ADP files to double check my statements.

This is my logic for your comparison
         if aodqf eq 0L then begin
            index_smoke=where(g16dqf eq 0L and smoke_mask eq 3,
nidx_smoke)
            index_dust=where(g16dqf eq 0L and dust_mask eq 3,
nidx_dust)
            strDQF='DQF=0'
            strfile='high'
         endif else begin
            if aodqf eq 1L then begin
               index_smoke=where(g16dqf le 1L and smoke_mask ge 2,
nidx_smoke)
               index_dust=where(g16dqf le 1L and dust_mask ge 2,
nidx_dust)
               strDQF='DQF=0 or DQF=1'
               strfile='medium'
            endif else begin
               index_smoke=where(g16dqf le 2L and smoke_mask ge 1,
nidx_smoke)
               index_dust=where(g16dqf le 2L and dust_mask ge 1,
nidx_dust)
               strDQF='DQF=0 or DQF=1 or DQF=2'
               strfile='low'
            endelse
         endelse

The raw AOD /ADP data files can be found
in /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/GOES16_AOD/AOD/20190801
&  /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/GOES16_AOD/ADP/20190801

The produce of regrid_data_plane can be found at
/gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/GOES16_AOD/REGRID_DUSTAOD/hysplit.20190801/

This is the command I used, high value=0, medium value=0,1 and low
value=0,1,2

regrid_data_plane ${aod_file} ${model_file} ${out_file} -field
'name="AOD_Dust"; level="(*,*)";' -method UW_MEAN -v 1 -qc ${value}
-adp
${adp_file}

The paired AOD/ADP data files I used is
AOD file list : [
'OR_ABI-L2-AODC-
M6_G16_s20192131001462_e20192131004235_c20192131006286.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131101462_e20192131104235_c20192131106330.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131201463_e20192131204236_c20192131206488.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131301463_e20192131304236_c20192131310411.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131401464_e20192131404237_c20192131406525.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131501465_e20192131504238_c20192131507134.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131601465_e20192131604238_c20192131607142.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131701466_e20192131704239_c20192131706505.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131801466_e20192131804239_c20192131806515.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192131901467_e20192131904240_c20192131907243.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192132001468_e20192132004241_c20192132006505.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192132101468_e20192132104241_c20192132106420.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192132201469_e20192132204242_c20192132206426.nc',
'OR_ABI-L2-AODC-
M6_G16_s20192132301469_e20192132304242_c20192132306098.nc' ]
ADP file list : [
'OR_ABI-L2-ADPC-
M6_G16_s20192131001462_e20192131004235_c20192131005097.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131101462_e20192131104235_c20192131105086.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131201463_e20192131204236_c20192131205129.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131301463_e20192131304236_c20192131305192.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131401464_e20192131404237_c20192131405164.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131501465_e20192131504238_c20192131505170.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131601465_e20192131604238_c20192131605172.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131701466_e20192131704239_c20192131705169.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131801466_e20192131804239_c20192131805131.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192131901467_e20192131904240_c20192131905128.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192132001468_e20192132004241_c20192132005202.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192132101468_e20192132104241_c20192132105138.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192132201469_e20192132204242_c20192132205197.nc',
'OR_ABI-L2-ADPC-
M6_G16_s20192132301469_e20192132304242_c20192132305153.nc' ]

Ho-Chun Huang

IMSG at NOAA/NWS/NCEP/EMC

5830 University Research Ct., Rm. 2792

College Park, MD 20740

Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>

301-683-3958


On Fri, Dec 20, 2019 at 1:14 PM met_help at ucar.edu via RT
<met_help at ucar.edu>
wrote:

> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING THE
WINTER
> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY BE
DELAYED.
>
> Greetings,
>
> This message has been automatically generated in response to the
creation
> of a trouble ticket regarding:
>         "Close GIT issue to be updated fro MET 9.0",
> a summary of which appears below.
>
> There is no need to reply to this message right now.  Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #93563].
>
> Please include the string:
>
>          [rt.rap.ucar.edu #93563]
>
> in the subject line of all future correspondence about this issue.
To do
> so, you may reply to this message.
>
> For more information, please see:
>
> MET Online Tutorial:
>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>
> MET Users Guide:
>    https://www.dtcenter.org/met/users/docs/overview.php
>
> MET FAQs:
>    https://www.dtcenter.org/met/users/support/faqs/index.php
>
> MET-Help Email Archive:
>    http://mailman.ucar.edu/pipermail/met_help
>
>                         Thank you,
>                         met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> To WHom It May Help,
>
> John has asked me to check the user guide and regrid_data_plane ADP
> function at bi-wwekly MET user's meeting with NCEP.
>
> I found there is a description of using ADP file in v9.0 beta user's
> guide.   I can produce the Smoke_AOD and Dust_AOD in model grid with
the
> new capability.
>
> While trying to produce the same products by IDL code to verify the
MET
> produced Smoke_AOD and Dust_AOD, I discovered a bug in NESDIS's ADP
read
> code and need to report to you for the MET 9.0 release.
>
> You can find the description in
https://github.com/NCAR/MET/issues/1194
>
> But since it said it has been closed, I am sending the same
description
> here in case you want to re-open it or create a new one.
>
> ====================================================
>
> The description of the smoke and dust mask confidence level has been
> updated
>
> (OLD)
> ; bit 6 (sunglint)
> tmp_mask=DQF
> idx = WHERE(((tmp_mask AND 64) EQ 64), COMPLEMENT=cidx, nc)
>
> *IF nc GT 0 THEN smoke_con[idx] = 0IF nc GT 0 THEN dust_con[idx] =
0*
>
> ;Byte1, bit7 (solar and satellite angles)
> tmp_mask=DQF
> idx = WHERE(((tmp_mask AND 128) EQ 128), COMPLEMENT=cidx, nc)
> *IF nc GT 0 THEN dust_con[idx] = 0*
>
> (NEW and Correct one)
> ; bit 6 (sunglint)
> tmp_mask=DQF
> idx = WHERE(((tmp_mask AND 64) EQ 64), COMPLEMENT=cidx, nc)
> IF nc GT 0 THEN dust_con[idx] = 0
>
> ;Byte1, bit7 (solar and satellite angles)
> tmp_mask=DQF
> idx = WHERE(((tmp_mask AND 128) EQ 128), COMPLEMENT=cidx, nc)
> IF nc GT 0 THEN dust_con[idx] = 0
> IF nc GT 0 THEN smoke_con[idx] = 0
>
> Please update MET9.0 beta version before official release.
>
> I also want to point out that from AOD files
> AOD high quality is quality flag=0
> AOD medium quality is quality flag=0,1
> AOD low quality is quality flag=0,1,2
>
> For ADP files
> Smoke Mask high confidence flag=3
> Smoke Mask medium confidence flag=2
> Smoke Mask low confidence flag=1
> Dust Mask is the same as Smoke Mask
> ===================================================
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>

------------------------------------------------
Subject: Close GIT issue to be updated fro MET 9.0
From: Randy Bullock
Time: Tue Dec 24 09:42:11 2019

Duplicated in github

------------------------------------------------
Subject: Close GIT issue to be updated fro MET 9.0
From: Ho-Chun Huang - NOAA Affiliate
Time: Tue Dec 24 09:49:00 2019

Hi, Randy:

This is pending to be resolved.  My Subject title may be miss leading.
This is the new finding related to the old GITHUB issues that has been
closed.

Either you want to reopen old GitHUB issue or create a new GITHUB
issue.
There might be some error for MET 9.0 beta version.
I sent additional information to  rt.rap.ucar.edu #93563 today


Ho-Chun Huang

IMSG at NOAA/NWS/NCEP/EMC

5830 University Research Ct., Rm. 2792

College Park, MD 20740

Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>

301-683-3958


On Tue, Dec 24, 2019 at 11:42 AM Randy Bullock via RT
<met_help at ucar.edu>
wrote:

> According to our records, your request has been resolved. If you
have any
> further questions or concerns, please respond to this message.
>

------------------------------------------------
Subject: Close GIT issue to be updated fro MET 9.0
From: Howard Soh
Time: Wed Jan 22 09:51:03 2020

The new ticket
(https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93598) was created.
I will close this.

Cheers,
Howard

On Tue Dec 24 09:49:00 2019, ho-chun.huang at noaa.gov wrote:
> Hi, Randy:
>
> This is pending to be resolved.  My Subject title may be miss
leading.
> This is the new finding related to the old GITHUB issues that has
been
> closed.
>
> Either you want to reopen old GitHUB issue or create a new GITHUB
issue.
> There might be some error for MET 9.0 beta version.
> I sent additional information to  rt.rap.ucar.edu #93563 today
>
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Tue, Dec 24, 2019 at 11:42 AM Randy Bullock via RT
<met_help at ucar.edu>
> wrote:
>
> > According to our records, your request has been resolved. If you
have any
> > further questions or concerns, please respond to this message.
> >



------------------------------------------------


More information about the Met_help mailing list