[Met_help] [rt.rap.ucar.edu #93694] History for HYSPLIT Dust versus MODIS dust MET gridsta verification
John Halley Gotway via RT
met_help at ucar.edu
Fri Jan 17 14:13:25 MST 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
To Whom It May help:
I am working on MET gridsta verification between HYSPLIT Dust versus MODIS
dust to replace FVS verification.
I found the number in the FHO statistic between these two approaches are
quite different, especially for G245. I am seeking help from your group
to resolve this issue.
Verification grdstat script is at
/gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
lead time or FCST_HOUR is from 01 to 48 (
/gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
Verification configuration file is at
/gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-aq-g2g/parm/verf_g2g_config_hysplitdust
MET verification output is at
/gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/com/verif/prod/hysplitdust.20200105
Current operational output are at
/gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
Forecast file are at /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
Observation files are at /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Wed Jan 08 10:47:52 2020
To Whom It May Concern:
After talking to BinBin, there are more filtering processing on the
observation after the conversion of 10^9.
I might still need your help because there are multiple condition to
meet
that I need to describe them in configuration file.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT
<met_help at ucar.edu>
wrote:
> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING THE
WINTER
> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY BE
DELAYED.
>
> Greetings,
>
> This message has been automatically generated in response to the
creation
> of a trouble ticket regarding:
> "HYSPLIT Dust versus MODIS dust MET gridsta verification",
> a summary of which appears below.
>
> There is no need to reply to this message right now. Your ticket
has been
> assigned an ID of [rt.rap.ucar.edu #93694].
>
> Please include the string:
>
> [rt.rap.ucar.edu #93694]
>
> in the subject line of all future correspondence about this issue.
To do
> so, you may reply to this message.
>
> For more information, please see:
>
> MET Online Tutorial:
>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>
> MET Users Guide:
> https://www.dtcenter.org/met/users/docs/overview.php
>
> MET FAQs:
> https://www.dtcenter.org/met/users/support/faqs/index.php
>
> MET-Help Email Archive:
> http://mailman.ucar.edu/pipermail/met_help
>
> Thank you,
> met_help at ucar.edu
>
>
-------------------------------------------------------------------------
> To Whom It May help:
>
> I am working on MET gridsta verification between HYSPLIT Dust versus
MODIS
> dust to replace FVS verification.
>
> I found the number in the FHO statistic between these two approaches
are
> quite different, especially for G245. I am seeking help from your
group
> to resolve this issue.
>
> Verification grdstat script is at
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
>
> lead time or FCST_HOUR is from 01 to 48 (
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
>
> Verification configuration file is at
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
>
> MET verification output is at
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
>
> Current operational output are at
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
>
> Forecast file are at
/gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> Observation files are at
> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Wed Jan 08 11:40:24 2020
To Whom It May Concern:
I need help to deal with multiple logical if statement.
In /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
*fcst = { wind_thresh = [ NA ]; field = [ { name
=
"LIPMF"; convert(LIPMF) = 10^LIPMF; level = [ "Z0-
5000"
]; lead_time = "${CUR_LEAD_HOUR}"; cat_thresh = [ <1.0,
>1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
*};*
To satisfy
if ( LIPMF < -90.) then
LIMPF=0.
else
LIMPF=10^LIMPF
endif
*obs = { wind_thresh = [ NA ]; field = [ { name
=
"DEN"; convert(DEN) = DEN * 10^9; level = [ "Z5000"
];
cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ];
} ];*
*};*
To satisfy
(1) DEN=DEN*1.0E9
(2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
DEN=1.0E-6
fi
(3)Then use only positive (>=0) values of DEN (after convert(DEN) for
verification. (i.e., include (2) grid that originally have values
-3.5 <=
X <= -1.5 and positive values)
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA Affiliate <
ho-chun.huang at noaa.gov> wrote:
> To Whom It May Concern:
>
> After talking to BinBin, there are more filtering processing on the
> observation after the conversion of 10^9.
>
> I might still need your help because there are multiple condition to
meet
> that I need to describe them in configuration file.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
> met_help at ucar.edu> wrote:
>
>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING THE
WINTER
>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY BE
DELAYED.
>>
>> Greetings,
>>
>> This message has been automatically generated in response to the
creation
>> of a trouble ticket regarding:
>> "HYSPLIT Dust versus MODIS dust MET gridsta verification",
>> a summary of which appears below.
>>
>> There is no need to reply to this message right now. Your ticket
has
>> been assigned an ID of [rt.rap.ucar.edu #93694].
>>
>> Please include the string:
>>
>> [rt.rap.ucar.edu #93694]
>>
>> in the subject line of all future correspondence about this issue.
To do
>> so, you may reply to this message.
>>
>> For more information, please see:
>>
>> MET Online Tutorial:
>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>>
>> MET Users Guide:
>> https://www.dtcenter.org/met/users/docs/overview.php
>>
>> MET FAQs:
>> https://www.dtcenter.org/met/users/support/faqs/index.php
>>
>> MET-Help Email Archive:
>> http://mailman.ucar.edu/pipermail/met_help
>>
>> Thank you,
>> met_help at ucar.edu
>>
>>
-------------------------------------------------------------------------
>> To Whom It May help:
>>
>> I am working on MET gridsta verification between HYSPLIT Dust
versus MODIS
>> dust to replace FVS verification.
>>
>> I found the number in the FHO statistic between these two
approaches are
>> quite different, especially for G245. I am seeking help from your
group
>> to resolve this issue.
>>
>> Verification grdstat script is at
>>
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
>>
>> lead time or FCST_HOUR is from 01 to 48 (
>>
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
>>
>> Verification configuration file is at
>>
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
>>
>> MET verification output is at
>>
>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
>>
>> Current operational output are at
>>
>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
>>
>> Forecast file are at
/gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
>> Observation files are at
>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
>>
>> Ho-Chun Huang
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct., Rm. 2792
>>
>> College Park, MD 20740
>>
>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>
>> 301-683-3958
>>
>>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Thu Jan 09 06:23:26 2020
To Whom It May Concern,
Will this configuration satisfies the logical condition as described
in
previous email? I assume censor threshold applied to convert(LIPMF)
and
convert(DEN). Is -9999. the default missing value for MET, or I need
to
set an environment variable for missing values, e.g., export
MET_DEFAULT_MISSING=-9999.. Please advise.
fcst = {
wind_thresh = [ NA ];
field = [
{
name = "LIPMF";
convert(LIPMF) = 10^LIPMF;
censor_thresh = [ <10^-90.];
censor_val = [ 0. ];
level = [ "Z0-5000" ];
lead_time = "${CUR_LEAD_HOUR}";
cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ];
}
];
};
obs = {
wind_thresh = [ NA ];
field = [
{
name = "DEN";
convert(DEN) = DEN * 10^9;
level = [ "Z5000" ];
censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5, >-9&&<-3.5 ];
censor_val = [ -9999., 10^-6, -9999. ]
cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ];
}
];
};
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA Affiliate <
ho-chun.huang at noaa.gov> wrote:
> To Whom It May Concern:
>
> I need help to deal with multiple logical if statement.
>
>
> In /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/parm/verf_g2g_config_hysplitdust
>
>
>
>
>
>
>
>
>
>
>
> *fcst = { wind_thresh = [ NA ]; field = [ { name
=
> "LIPMF"; convert(LIPMF) = 10^LIPMF; level = [
"Z0-5000"
> ]; lead_time = "${CUR_LEAD_HOUR}"; cat_thresh = [
<1.0,
> >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
> *};*
>
> To satisfy
> if ( LIPMF < -90.) then
> LIMPF=0.
> else
> LIMPF=10^LIMPF
> endif
>
>
>
>
>
>
>
>
>
>
>
> *obs = { wind_thresh = [ NA ]; field = [ { name
=
> "DEN"; convert(DEN) = DEN * 10^9; level = [
"Z5000" ];
> cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ];
> } ];*
> *};*
>
> To satisfy
> (1) DEN=DEN*1.0E9
> (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
> DEN=1.0E-6
> fi
> (3)Then use only positive (>=0) values of DEN (after convert(DEN)
for
> verification. (i.e., include (2) grid that originally have values
-3.5 <=
> X <= -1.5 and positive values)
>
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA Affiliate <
> ho-chun.huang at noaa.gov> wrote:
>
>> To Whom It May Concern:
>>
>> After talking to BinBin, there are more filtering processing on the
>> observation after the conversion of 10^9.
>>
>> I might still need your help because there are multiple condition
to meet
>> that I need to describe them in configuration file.
>>
>> Ho-Chun Huang
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct., Rm. 2792
>>
>> College Park, MD 20740
>>
>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>
>> 301-683-3958
>>
>>
>> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
>> met_help at ucar.edu> wrote:
>>
>>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING THE
WINTER
>>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY BE
DELAYED.
>>>
>>> Greetings,
>>>
>>> This message has been automatically generated in response to the
>>> creation of a trouble ticket regarding:
>>> "HYSPLIT Dust versus MODIS dust MET gridsta verification",
>>> a summary of which appears below.
>>>
>>> There is no need to reply to this message right now. Your ticket
has
>>> been assigned an ID of [rt.rap.ucar.edu #93694].
>>>
>>> Please include the string:
>>>
>>> [rt.rap.ucar.edu #93694]
>>>
>>> in the subject line of all future correspondence about this issue.
To do
>>> so, you may reply to this message.
>>>
>>> For more information, please see:
>>>
>>> MET Online Tutorial:
>>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>>>
>>> MET Users Guide:
>>> https://www.dtcenter.org/met/users/docs/overview.php
>>>
>>> MET FAQs:
>>> https://www.dtcenter.org/met/users/support/faqs/index.php
>>>
>>> MET-Help Email Archive:
>>> http://mailman.ucar.edu/pipermail/met_help
>>>
>>> Thank you,
>>> met_help at ucar.edu
>>>
>>>
-------------------------------------------------------------------------
>>> To Whom It May help:
>>>
>>> I am working on MET gridsta verification between HYSPLIT Dust
versus
>>> MODIS
>>> dust to replace FVS verification.
>>>
>>> I found the number in the FHO statistic between these two
approaches are
>>> quite different, especially for G245. I am seeking help from
your group
>>> to resolve this issue.
>>>
>>> Verification grdstat script is at
>>>
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
>>>
>>> lead time or FCST_HOUR is from 01 to 48 (
>>>
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
>>>
>>> Verification configuration file is at
>>>
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/parm/verf_g2g_config_hysplitdust
>>>
>>> MET verification output is at
>>>
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
>>>
>>> Current operational output are at
>>>
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
>>>
>>> Forecast file are at
/gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
>>> Observation files are at
>>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
>>>
>>> Ho-Chun Huang
>>>
>>> IMSG at NOAA/NWS/NCEP/EMC
>>>
>>> 5830 University Research Ct., Rm. 2792
>>>
>>> College Park, MD 20740
>>>
>>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>>
>>> 301-683-3958
>>>
>>>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: John Halley Gotway
Time: Fri Jan 10 15:04:42 2020
Ho-Chun,
Those seem like reasonable settings to me. I do often use the
plot_data_plane tool to test these sort of things out.
# Plot temperature data in kelvin
bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
DEBUG 1: Opening data file:
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
DEBUG 1: Creating postscript file: TMP_Z2_K.ps
# Test converting kelvin to celsius
bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP - 273.15;'
-v 2
And then I check the resulting plots to make sure the range of data is
as
expected.
You can also test censor in this way:
# Test converting kelvin to celsius and censor
bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
273.15;
censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
Are your convert and censor thresholds working OK for you?
Thanks,
John Halley Gotway
On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
>
> To Whom It May Concern,
>
> Will this configuration satisfies the logical condition as described
in
> previous email? I assume censor threshold applied to
convert(LIPMF) and
> convert(DEN). Is -9999. the default missing value for MET, or I
need to
> set an environment variable for missing values, e.g., export
> MET_DEFAULT_MISSING=-9999.. Please advise.
>
> fcst = {
> wind_thresh = [ NA ];
>
> field = [
> {
> name = "LIPMF";
> convert(LIPMF) = 10^LIPMF;
> censor_thresh = [ <10^-90.];
> censor_val = [ 0. ];
> level = [ "Z0-5000" ];
> lead_time = "${CUR_LEAD_HOUR}";
> cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0
];
> }
> ];
>
> };
> obs = {
> wind_thresh = [ NA ];
>
> field = [
> {
> name = "DEN";
> convert(DEN) = DEN * 10^9;
> level = [ "Z5000" ];
> censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5, >-9&&<-3.5
];
> censor_val = [ -9999., 10^-6, -9999. ]
> cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0
];
> }
> ];
>
> };
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA Affiliate <
> ho-chun.huang at noaa.gov> wrote:
>
> > To Whom It May Concern:
> >
> > I need help to deal with multiple logical if statement.
> >
> >
> > In
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > *fcst = { wind_thresh = [ NA ]; field = [ { name
=
> > "LIPMF"; convert(LIPMF) = 10^LIPMF; level = [
> "Z0-5000"
> > ]; lead_time = "${CUR_LEAD_HOUR}"; cat_thresh = [
<1.0,
> > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
> > *};*
> >
> > To satisfy
> > if ( LIPMF < -90.) then
> > LIMPF=0.
> > else
> > LIMPF=10^LIMPF
> > endif
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > *obs = { wind_thresh = [ NA ]; field = [ { name
=
> > "DEN"; convert(DEN) = DEN * 10^9; level = [
"Z5000" ];
> > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0, >20.0
];
> > } ];*
> > *};*
> >
> > To satisfy
> > (1) DEN=DEN*1.0E9
> > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
> > DEN=1.0E-6
> > fi
> > (3)Then use only positive (>=0) values of DEN (after convert(DEN)
for
> > verification. (i.e., include (2) grid that originally have values
-3.5
> <=
> > X <= -1.5 and positive values)
> >
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> >
> > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA Affiliate <
> > ho-chun.huang at noaa.gov> wrote:
> >
> >> To Whom It May Concern:
> >>
> >> After talking to BinBin, there are more filtering processing on
the
> >> observation after the conversion of 10^9.
> >>
> >> I might still need your help because there are multiple condition
to
> meet
> >> that I need to describe them in configuration file.
> >>
> >> Ho-Chun Huang
> >>
> >> IMSG at NOAA/NWS/NCEP/EMC
> >>
> >> 5830 University Research Ct., Rm. 2792
> >>
> >> College Park, MD 20740
> >>
> >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>
> >> 301-683-3958
> >>
> >>
> >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING THE
WINTER
> >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY BE
DELAYED.
> >>>
> >>> Greetings,
> >>>
> >>> This message has been automatically generated in response to the
> >>> creation of a trouble ticket regarding:
> >>> "HYSPLIT Dust versus MODIS dust MET gridsta
verification",
> >>> a summary of which appears below.
> >>>
> >>> There is no need to reply to this message right now. Your
ticket has
> >>> been assigned an ID of [rt.rap.ucar.edu #93694].
> >>>
> >>> Please include the string:
> >>>
> >>> [rt.rap.ucar.edu #93694]
> >>>
> >>> in the subject line of all future correspondence about this
issue. To
> do
> >>> so, you may reply to this message.
> >>>
> >>> For more information, please see:
> >>>
> >>> MET Online Tutorial:
> >>>
> https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> >>>
> >>> MET Users Guide:
> >>> https://www.dtcenter.org/met/users/docs/overview.php
> >>>
> >>> MET FAQs:
> >>> https://www.dtcenter.org/met/users/support/faqs/index.php
> >>>
> >>> MET-Help Email Archive:
> >>> http://mailman.ucar.edu/pipermail/met_help
> >>>
> >>> Thank you,
> >>> met_help at ucar.edu
> >>>
> >>>
>
-------------------------------------------------------------------------
> >>> To Whom It May help:
> >>>
> >>> I am working on MET gridsta verification between HYSPLIT Dust
versus
> >>> MODIS
> >>> dust to replace FVS verification.
> >>>
> >>> I found the number in the FHO statistic between these two
approaches
> are
> >>> quite different, especially for G245. I am seeking help from
your
> group
> >>> to resolve this issue.
> >>>
> >>> Verification grdstat script is at
> >>>
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
> >>>
> >>> lead time or FCST_HOUR is from 01 to 48 (
> >>>
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
> >>>
> >>> Verification configuration file is at
> >>>
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> >>>
> >>> MET verification output is at
> >>>
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
> >>>
> >>> Current operational output are at
> >>>
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
> >>>
> >>> Forecast file are at
> /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> >>> Observation files are at
> >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
> >>>
> >>> Ho-Chun Huang
> >>>
> >>> IMSG at NOAA/NWS/NCEP/EMC
> >>>
> >>> 5830 University Research Ct., Rm. 2792
> >>>
> >>> College Park, MD 20740
> >>>
> >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>>
> >>> 301-683-3958
> >>>
> >>>
>
>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Mon Jan 13 05:56:08 2020
Hi, John:
Thanks for the reply.
The statement generate error
> censor_thresh = [ <10^-90.];
I tried <10^-90 the grid_stat still is not working. Is the 10^-90
over the
single or double precision limit?
Just to confirm again, -9999 is the correct value to use to tell MET
this
data should be removed from pairing with FCST data?
Today the WCOSS is down, so I can not provide a more detailed error
message, will do that as soon as I can.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Fri, Jan 10, 2020 at 5:04 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Ho-Chun,
>
> Those seem like reasonable settings to me. I do often use the
> plot_data_plane tool to test these sort of things out.
>
> # Plot temperature data in kelvin
> bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
> DEBUG 1: Opening data file:
> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> DEBUG 1: Creating postscript file: TMP_Z2_K.ps
>
> # Test converting kelvin to celsius
> bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP - 273.15;'
-v 2
>
> And then I check the resulting plots to make sure the range of data
is as
> expected.
>
> You can also test censor in this way:
> # Test converting kelvin to celsius and censor
> bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
273.15;
> censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
>
> Are your convert and censor thresholds working OK for you?
>
> Thanks,
> John Halley Gotway
>
>
>
> On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
> >
> > To Whom It May Concern,
> >
> > Will this configuration satisfies the logical condition as
described in
> > previous email? I assume censor threshold applied to
convert(LIPMF) and
> > convert(DEN). Is -9999. the default missing value for MET, or I
need to
> > set an environment variable for missing values, e.g., export
> > MET_DEFAULT_MISSING=-9999.. Please advise.
> >
> > fcst = {
> > wind_thresh = [ NA ];
> >
> > field = [
> > {
> > name = "LIPMF";
> > convert(LIPMF) = 10^LIPMF;
> > censor_thresh = [ <10^-90.];
> > censor_val = [ 0. ];
> > level = [ "Z0-5000" ];
> > lead_time = "${CUR_LEAD_HOUR}";
> > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0 ];
> > }
> > ];
> >
> > };
> > obs = {
> > wind_thresh = [ NA ];
> >
> > field = [
> > {
> > name = "DEN";
> > convert(DEN) = DEN * 10^9;
> > level = [ "Z5000" ];
> > censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5, >-9&&<-
3.5 ];
> > censor_val = [ -9999., 10^-6, -9999. ]
> > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0 ];
> > }
> > ];
> >
> > };
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> >
> > On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA Affiliate <
> > ho-chun.huang at noaa.gov> wrote:
> >
> > > To Whom It May Concern:
> > >
> > > I need help to deal with multiple logical if statement.
> > >
> > >
> > > In
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > *fcst = { wind_thresh = [ NA ]; field = [ { name
> =
> > > "LIPMF"; convert(LIPMF) = 10^LIPMF; level = [
> > "Z0-5000"
> > > ]; lead_time = "${CUR_LEAD_HOUR}"; cat_thresh = [
<1.0,
> > > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
> > > *};*
> > >
> > > To satisfy
> > > if ( LIPMF < -90.) then
> > > LIMPF=0.
> > > else
> > > LIMPF=10^LIMPF
> > > endif
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > *obs = { wind_thresh = [ NA ]; field = [ { name
=
> > > "DEN"; convert(DEN) = DEN * 10^9; level = [
"Z5000"
> ];
> > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0 ];
> > > } ];*
> > > *};*
> > >
> > > To satisfy
> > > (1) DEN=DEN*1.0E9
> > > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
> > > DEN=1.0E-6
> > > fi
> > > (3)Then use only positive (>=0) values of DEN (after
convert(DEN) for
> > > verification. (i.e., include (2) grid that originally have
values -3.5
> > <=
> > > X <= -1.5 and positive values)
> > >
> > >
> > > Ho-Chun Huang
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct., Rm. 2792
> > >
> > > College Park, MD 20740
> > >
> > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >
> > > 301-683-3958
> > >
> > >
> > > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA Affiliate <
> > > ho-chun.huang at noaa.gov> wrote:
> > >
> > >> To Whom It May Concern:
> > >>
> > >> After talking to BinBin, there are more filtering processing on
the
> > >> observation after the conversion of 10^9.
> > >>
> > >> I might still need your help because there are multiple
condition to
> > meet
> > >> that I need to describe them in configuration file.
> > >>
> > >> Ho-Chun Huang
> > >>
> > >> IMSG at NOAA/NWS/NCEP/EMC
> > >>
> > >> 5830 University Research Ct., Rm. 2792
> > >>
> > >> College Park, MD 20740
> > >>
> > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >>
> > >> 301-683-3958
> > >>
> > >>
> > >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING
THE
> WINTER
> > >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY BE
> DELAYED.
> > >>>
> > >>> Greetings,
> > >>>
> > >>> This message has been automatically generated in response to
the
> > >>> creation of a trouble ticket regarding:
> > >>> "HYSPLIT Dust versus MODIS dust MET gridsta
verification",
> > >>> a summary of which appears below.
> > >>>
> > >>> There is no need to reply to this message right now. Your
ticket has
> > >>> been assigned an ID of [rt.rap.ucar.edu #93694].
> > >>>
> > >>> Please include the string:
> > >>>
> > >>> [rt.rap.ucar.edu #93694]
> > >>>
> > >>> in the subject line of all future correspondence about this
issue. To
> > do
> > >>> so, you may reply to this message.
> > >>>
> > >>> For more information, please see:
> > >>>
> > >>> MET Online Tutorial:
> > >>>
> >
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > >>>
> > >>> MET Users Guide:
> > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > >>>
> > >>> MET FAQs:
> > >>> https://www.dtcenter.org/met/users/support/faqs/index.php
> > >>>
> > >>> MET-Help Email Archive:
> > >>> http://mailman.ucar.edu/pipermail/met_help
> > >>>
> > >>> Thank you,
> > >>> met_help at ucar.edu
> > >>>
> > >>>
> >
-------------------------------------------------------------------------
> > >>> To Whom It May help:
> > >>>
> > >>> I am working on MET gridsta verification between HYSPLIT Dust
versus
> > >>> MODIS
> > >>> dust to replace FVS verification.
> > >>>
> > >>> I found the number in the FHO statistic between these two
approaches
> > are
> > >>> quite different, especially for G245. I am seeking help from
your
> > group
> > >>> to resolve this issue.
> > >>>
> > >>> Verification grdstat script is at
> > >>>
> > >>>
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
> > >>>
> > >>> lead time or FCST_HOUR is from 01 to 48 (
> > >>>
> > >>>
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
> > >>>
> > >>> Verification configuration file is at
> > >>>
> > >>>
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> > >>>
> > >>> MET verification output is at
> > >>>
> > >>>
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
> > >>>
> > >>> Current operational output are at
> > >>>
> > >>>
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
> > >>>
> > >>> Forecast file are at
> > /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> > >>> Observation files are at
> > >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
> > >>>
> > >>> Ho-Chun Huang
> > >>>
> > >>> IMSG at NOAA/NWS/NCEP/EMC
> > >>>
> > >>> 5830 University Research Ct., Rm. 2792
> > >>>
> > >>> College Park, MD 20740
> > >>>
> > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >>>
> > >>> 301-683-3958
> > >>>
> > >>>
> >
> >
>
>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: John Halley Gotway
Time: Mon Jan 13 12:58:00 2020
Ho-Chun,
Thanks for clarifying the problem. I tried this out and was able to
replicate the same behavior you described.
Unfortunately, "math" embedded directly in threshold string is not
supported. That's why you're getting a parsing error for:
censor_thresh = [ <10^-90.];
We might be able to add this to the config file language in the
future.
Should I write up a GitHub issue with the feature request?
Is 10^(-90) really the correct threshold? I agree that with numbers
so
close to 0, there may be precision issues. Generally MET stores data
as
double precision, but honestly we haven’t tested haven’t tested it
with
this type of data.
Environment variables are supported here. For example, you could set:
censor_thresh = [ <${SMALL_NUMBER} ];
Where that’s an env variable you’ve already set.
Math is supported in the convert(x) function, such as:
convert(x) = x * 10^90;
Perhaps that’d be helpful?
Thanks
John
On Mon, Jan 13, 2020 at 7:56 AM Ho-Chun Huang - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
>
> Hi, John:
>
> Thanks for the reply.
>
> The statement generate error
>
> > censor_thresh = [ <10^-90.];
>
> I tried <10^-90 the grid_stat still is not working. Is the 10^-90
over the
> single or double precision limit?
>
> Just to confirm again, -9999 is the correct value to use to tell MET
this
> data should be removed from pairing with FCST data?
>
> Today the WCOSS is down, so I can not provide a more detailed error
> message, will do that as soon as I can.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Fri, Jan 10, 2020 at 5:04 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Ho-Chun,
> >
> > Those seem like reasonable settings to me. I do often use the
> > plot_data_plane tool to test these sort of things out.
> >
> > # Plot temperature data in kelvin
> > bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
> > DEBUG 1: Opening data file:
> > data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > DEBUG 1: Creating postscript file: TMP_Z2_K.ps
> >
> > # Test converting kelvin to celsius
> > bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
273.15;' -v 2
> >
> > And then I check the resulting plots to make sure the range of
data is as
> > expected.
> >
> > You can also test censor in this way:
> > # Test converting kelvin to celsius and censor
> > bin/plot_data_plane
data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
> 273.15;
> > censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
> >
> > Are your convert and censor thresholds working OK for you?
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> >
> > On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
> > >
> > > To Whom It May Concern,
> > >
> > > Will this configuration satisfies the logical condition as
described in
> > > previous email? I assume censor threshold applied to
convert(LIPMF)
> and
> > > convert(DEN). Is -9999. the default missing value for MET, or I
need
> to
> > > set an environment variable for missing values, e.g., export
> > > MET_DEFAULT_MISSING=-9999.. Please advise.
> > >
> > > fcst = {
> > > wind_thresh = [ NA ];
> > >
> > > field = [
> > > {
> > > name = "LIPMF";
> > > convert(LIPMF) = 10^LIPMF;
> > > censor_thresh = [ <10^-90.];
> > > censor_val = [ 0. ];
> > > level = [ "Z0-5000" ];
> > > lead_time = "${CUR_LEAD_HOUR}";
> > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0 ];
> > > }
> > > ];
> > >
> > > };
> > > obs = {
> > > wind_thresh = [ NA ];
> > >
> > > field = [
> > > {
> > > name = "DEN";
> > > convert(DEN) = DEN * 10^9;
> > > level = [ "Z5000" ];
> > > censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5, >-9&&<-
3.5 ];
> > > censor_val = [ -9999., 10^-6, -9999. ]
> > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0 ];
> > > }
> > > ];
> > >
> > > };
> > >
> > > Ho-Chun Huang
> > >
> > > IMSG at NOAA/NWS/NCEP/EMC
> > >
> > > 5830 University Research Ct., Rm. 2792
> > >
> > > College Park, MD 20740
> > >
> > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > >
> > > 301-683-3958
> > >
> > >
> > > On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA Affiliate <
> > > ho-chun.huang at noaa.gov> wrote:
> > >
> > > > To Whom It May Concern:
> > > >
> > > > I need help to deal with multiple logical if statement.
> > > >
> > > >
> > > > In
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > *fcst = { wind_thresh = [ NA ]; field = [ {
name
> > =
> > > > "LIPMF"; convert(LIPMF) = 10^LIPMF; level =
[
> > > "Z0-5000"
> > > > ]; lead_time = "${CUR_LEAD_HOUR}"; cat_thresh =
[
> <1.0,
> > > > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
> > > > *};*
> > > >
> > > > To satisfy
> > > > if ( LIPMF < -90.) then
> > > > LIMPF=0.
> > > > else
> > > > LIMPF=10^LIMPF
> > > > endif
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > *obs = { wind_thresh = [ NA ]; field = [ {
name
> =
> > > > "DEN"; convert(DEN) = DEN * 10^9; level = [
> "Z5000"
> > ];
> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0 ];
> > > > } ];*
> > > > *};*
> > > >
> > > > To satisfy
> > > > (1) DEN=DEN*1.0E9
> > > > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
> > > > DEN=1.0E-6
> > > > fi
> > > > (3)Then use only positive (>=0) values of DEN (after
convert(DEN) for
> > > > verification. (i.e., include (2) grid that originally have
values
> -3.5
> > > <=
> > > > X <= -1.5 and positive values)
> > > >
> > > >
> > > > Ho-Chun Huang
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct., Rm. 2792
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >
> > > > 301-683-3958
> > > >
> > > >
> > > > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA Affiliate
<
> > > > ho-chun.huang at noaa.gov> wrote:
> > > >
> > > >> To Whom It May Concern:
> > > >>
> > > >> After talking to BinBin, there are more filtering processing
on the
> > > >> observation after the conversion of 10^9.
> > > >>
> > > >> I might still need your help because there are multiple
condition to
> > > meet
> > > >> that I need to describe them in configuration file.
> > > >>
> > > >> Ho-Chun Huang
> > > >>
> > > >> IMSG at NOAA/NWS/NCEP/EMC
> > > >>
> > > >> 5830 University Research Ct., Rm. 2792
> > > >>
> > > >> College Park, MD 20740
> > > >>
> > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >>
> > > >> 301-683-3958
> > > >>
> > > >>
> > > >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY DURING
THE
> > WINTER
> > > >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES MAY
BE
> > DELAYED.
> > > >>>
> > > >>> Greetings,
> > > >>>
> > > >>> This message has been automatically generated in response to
the
> > > >>> creation of a trouble ticket regarding:
> > > >>> "HYSPLIT Dust versus MODIS dust MET gridsta
verification",
> > > >>> a summary of which appears below.
> > > >>>
> > > >>> There is no need to reply to this message right now. Your
ticket
> has
> > > >>> been assigned an ID of [rt.rap.ucar.edu #93694].
> > > >>>
> > > >>> Please include the string:
> > > >>>
> > > >>> [rt.rap.ucar.edu #93694]
> > > >>>
> > > >>> in the subject line of all future correspondence about this
issue.
> To
> > > do
> > > >>> so, you may reply to this message.
> > > >>>
> > > >>> For more information, please see:
> > > >>>
> > > >>> MET Online Tutorial:
> > > >>>
> > >
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > > >>>
> > > >>> MET Users Guide:
> > > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > > >>>
> > > >>> MET FAQs:
> > > >>> https://www.dtcenter.org/met/users/support/faqs/index.php
> > > >>>
> > > >>> MET-Help Email Archive:
> > > >>> http://mailman.ucar.edu/pipermail/met_help
> > > >>>
> > > >>> Thank you,
> > > >>> met_help at ucar.edu
> > > >>>
> > > >>>
> > >
>
-------------------------------------------------------------------------
> > > >>> To Whom It May help:
> > > >>>
> > > >>> I am working on MET gridsta verification between HYSPLIT
Dust
> versus
> > > >>> MODIS
> > > >>> dust to replace FVS verification.
> > > >>>
> > > >>> I found the number in the FHO statistic between these two
> approaches
> > > are
> > > >>> quite different, especially for G245. I am seeking help
from your
> > > group
> > > >>> to resolve this issue.
> > > >>>
> > > >>> Verification grdstat script is at
> > > >>>
> > > >>>
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
> > > >>>
> > > >>> lead time or FCST_HOUR is from 01 to 48 (
> > > >>>
> > > >>>
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
> > > >>>
> > > >>> Verification configuration file is at
> > > >>>
> > > >>>
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> > > >>>
> > > >>> MET verification output is at
> > > >>>
> > > >>>
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
> > > >>>
> > > >>> Current operational output are at
> > > >>>
> > > >>>
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
> > > >>>
> > > >>> Forecast file are at
> > > /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> > > >>> Observation files are at
> > > >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
> > > >>>
> > > >>> Ho-Chun Huang
> > > >>>
> > > >>> IMSG at NOAA/NWS/NCEP/EMC
> > > >>>
> > > >>> 5830 University Research Ct., Rm. 2792
> > > >>>
> > > >>> College Park, MD 20740
> > > >>>
> > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >>>
> > > >>> 301-683-3958
> > > >>>
> > > >>>
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Mon Jan 13 13:19:53 2020
Hi, John:
The model fcst field set x=-99 for zero concentration gridded value.
Thus
for grid value /= -99 the concentration values is 10^x.
This logic <-90 reset conc=0 is from current VSDB routine.
I will try the SMALLNUMBER concept, but I do not know whether I can
really
spelling out 10^-90 is bash script.
Since my fcst and obs field all utilize convert[x], I want to know for
sure
the censor_thresold is applied to convert[x] but not the original
field
from FCST and OBSV input file, correct?
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Mon, Jan 13, 2020 at 2:58 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Ho-Chun,
>
> Thanks for clarifying the problem. I tried this out and was able to
> replicate the same behavior you described.
>
> Unfortunately, "math" embedded directly in threshold string is not
> supported. That's why you're getting a parsing error for:
> censor_thresh = [ <10^-90.];
>
> We might be able to add this to the config file language in the
future.
> Should I write up a GitHub issue with the feature request?
>
> Is 10^(-90) really the correct threshold? I agree that with numbers
so
> close to 0, there may be precision issues. Generally MET stores
data as
> double precision, but honestly we haven’t tested haven’t tested it
with
> this type of data.
>
> Environment variables are supported here. For example, you could
set:
> censor_thresh = [ <${SMALL_NUMBER} ];
>
> Where that’s an env variable you’ve already set.
>
> Math is supported in the convert(x) function, such as:
> convert(x) = x * 10^90;
>
> Perhaps that’d be helpful?
>
> Thanks
> John
>
> On Mon, Jan 13, 2020 at 7:56 AM Ho-Chun Huang - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
> >
> > Hi, John:
> >
> > Thanks for the reply.
> >
> > The statement generate error
> >
> > > censor_thresh = [ <10^-90.];
> >
> > I tried <10^-90 the grid_stat still is not working. Is the 10^-90
over
> the
> > single or double precision limit?
> >
> > Just to confirm again, -9999 is the correct value to use to tell
MET this
> > data should be removed from pairing with FCST data?
> >
> > Today the WCOSS is down, so I can not provide a more detailed
error
> > message, will do that as soon as I can.
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> >
> > On Fri, Jan 10, 2020 at 5:04 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Ho-Chun,
> > >
> > > Those seem like reasonable settings to me. I do often use the
> > > plot_data_plane tool to test these sort of things out.
> > >
> > > # Plot temperature data in kelvin
> > > bin/plot_data_plane
> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > > TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
> > > DEBUG 1: Opening data file:
> > > data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > > DEBUG 1: Creating postscript file: TMP_Z2_K.ps
> > >
> > > # Test converting kelvin to celsius
> > > bin/plot_data_plane
> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > > TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
273.15;'
> -v 2
> > >
> > > And then I check the resulting plots to make sure the range of
data is
> as
> > > expected.
> > >
> > > You can also test censor in this way:
> > > # Test converting kelvin to celsius and censor
> > > bin/plot_data_plane
> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> > > TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP
-
> > 273.15;
> > > censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
> > >
> > > Are your convert and censor thresholds working OK for you?
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > >
> > >
> > > On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694
>
> > > >
> > > > To Whom It May Concern,
> > > >
> > > > Will this configuration satisfies the logical condition as
described
> in
> > > > previous email? I assume censor threshold applied to
convert(LIPMF)
> > and
> > > > convert(DEN). Is -9999. the default missing value for MET, or
I need
> > to
> > > > set an environment variable for missing values, e.g., export
> > > > MET_DEFAULT_MISSING=-9999.. Please advise.
> > > >
> > > > fcst = {
> > > > wind_thresh = [ NA ];
> > > >
> > > > field = [
> > > > {
> > > > name = "LIPMF";
> > > > convert(LIPMF) = 10^LIPMF;
> > > > censor_thresh = [ <10^-90.];
> > > > censor_val = [ 0. ];
> > > > level = [ "Z0-5000" ];
> > > > lead_time = "${CUR_LEAD_HOUR}";
> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0
> ];
> > > > }
> > > > ];
> > > >
> > > > };
> > > > obs = {
> > > > wind_thresh = [ NA ];
> > > >
> > > > field = [
> > > > {
> > > > name = "DEN";
> > > > convert(DEN) = DEN * 10^9;
> > > > level = [ "Z5000" ];
> > > > censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5, >-
9&&<-3.5
> ];
> > > > censor_val = [ -9999., 10^-6, -9999. ]
> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0
> ];
> > > > }
> > > > ];
> > > >
> > > > };
> > > >
> > > > Ho-Chun Huang
> > > >
> > > > IMSG at NOAA/NWS/NCEP/EMC
> > > >
> > > > 5830 University Research Ct., Rm. 2792
> > > >
> > > > College Park, MD 20740
> > > >
> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > >
> > > > 301-683-3958
> > > >
> > > >
> > > > On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA Affiliate
<
> > > > ho-chun.huang at noaa.gov> wrote:
> > > >
> > > > > To Whom It May Concern:
> > > > >
> > > > > I need help to deal with multiple logical if statement.
> > > > >
> > > > >
> > > > > In
> > > >
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > *fcst = { wind_thresh = [ NA ]; field = [ {
name
> > > =
> > > > > "LIPMF"; convert(LIPMF) = 10^LIPMF; level
= [
> > > > "Z0-5000"
> > > > > ]; lead_time = "${CUR_LEAD_HOUR}"; cat_thresh
= [
> > <1.0,
> > > > > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
> > > > > *};*
> > > > >
> > > > > To satisfy
> > > > > if ( LIPMF < -90.) then
> > > > > LIMPF=0.
> > > > > else
> > > > > LIMPF=10^LIMPF
> > > > > endif
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > *obs = { wind_thresh = [ NA ]; field = [ {
name
> > =
> > > > > "DEN"; convert(DEN) = DEN * 10^9; level =
[
> > "Z5000"
> > > ];
> > > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0
> ];
> > > > > } ];*
> > > > > *};*
> > > > >
> > > > > To satisfy
> > > > > (1) DEN=DEN*1.0E9
> > > > > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
> > > > > DEN=1.0E-6
> > > > > fi
> > > > > (3)Then use only positive (>=0) values of DEN (after
convert(DEN)
> for
> > > > > verification. (i.e., include (2) grid that originally have
values
> > -3.5
> > > > <=
> > > > > X <= -1.5 and positive values)
> > > > >
> > > > >
> > > > > Ho-Chun Huang
> > > > >
> > > > > IMSG at NOAA/NWS/NCEP/EMC
> > > > >
> > > > > 5830 University Research Ct., Rm. 2792
> > > > >
> > > > > College Park, MD 20740
> > > > >
> > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >
> > > > > 301-683-3958
> > > > >
> > > > >
> > > > > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA
Affiliate <
> > > > > ho-chun.huang at noaa.gov> wrote:
> > > > >
> > > > >> To Whom It May Concern:
> > > > >>
> > > > >> After talking to BinBin, there are more filtering
processing on
> the
> > > > >> observation after the conversion of 10^9.
> > > > >>
> > > > >> I might still need your help because there are multiple
condition
> to
> > > > meet
> > > > >> that I need to describe them in configuration file.
> > > > >>
> > > > >> Ho-Chun Huang
> > > > >>
> > > > >> IMSG at NOAA/NWS/NCEP/EMC
> > > > >>
> > > > >> 5830 University Research Ct., Rm. 2792
> > > > >>
> > > > >> College Park, MD 20740
> > > > >>
> > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >>
> > > > >> 301-683-3958
> > > > >>
> > > > >>
> > > > >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY
DURING THE
> > > WINTER
> > > > >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES
MAY BE
> > > DELAYED.
> > > > >>>
> > > > >>> Greetings,
> > > > >>>
> > > > >>> This message has been automatically generated in response
to the
> > > > >>> creation of a trouble ticket regarding:
> > > > >>> "HYSPLIT Dust versus MODIS dust MET gridsta
> verification",
> > > > >>> a summary of which appears below.
> > > > >>>
> > > > >>> There is no need to reply to this message right now. Your
ticket
> > has
> > > > >>> been assigned an ID of [rt.rap.ucar.edu #93694].
> > > > >>>
> > > > >>> Please include the string:
> > > > >>>
> > > > >>> [rt.rap.ucar.edu #93694]
> > > > >>>
> > > > >>> in the subject line of all future correspondence about
this
> issue.
> > To
> > > > do
> > > > >>> so, you may reply to this message.
> > > > >>>
> > > > >>> For more information, please see:
> > > > >>>
> > > > >>> MET Online Tutorial:
> > > > >>>
> > > >
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> > > > >>>
> > > > >>> MET Users Guide:
> > > > >>> https://www.dtcenter.org/met/users/docs/overview.php
> > > > >>>
> > > > >>> MET FAQs:
> > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
> > > > >>>
> > > > >>> MET-Help Email Archive:
> > > > >>> http://mailman.ucar.edu/pipermail/met_help
> > > > >>>
> > > > >>> Thank you,
> > > > >>> met_help at ucar.edu
> > > > >>>
> > > > >>>
> > > >
> >
-------------------------------------------------------------------------
> > > > >>> To Whom It May help:
> > > > >>>
> > > > >>> I am working on MET gridsta verification between HYSPLIT
Dust
> > versus
> > > > >>> MODIS
> > > > >>> dust to replace FVS verification.
> > > > >>>
> > > > >>> I found the number in the FHO statistic between these two
> > approaches
> > > > are
> > > > >>> quite different, especially for G245. I am seeking help
from
> your
> > > > group
> > > > >>> to resolve this issue.
> > > > >>>
> > > > >>> Verification grdstat script is at
> > > > >>>
> > > > >>>
> > > >
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
> > > > >>>
> > > > >>> lead time or FCST_HOUR is from 01 to 48 (
> > > > >>>
> > > > >>>
> > > >
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
> > > > >>>
> > > > >>> Verification configuration file is at
> > > > >>>
> > > > >>>
> > > >
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> > > > >>>
> > > > >>> MET verification output is at
> > > > >>>
> > > > >>>
> > > >
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
> > > > >>>
> > > > >>> Current operational output are at
> > > > >>>
> > > > >>>
> > > >
> > >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
> > > > >>>
> > > > >>> Forecast file are at
> > > > /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> > > > >>> Observation files are at
> > > > >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
> > > > >>>
> > > > >>> Ho-Chun Huang
> > > > >>>
> > > > >>> IMSG at NOAA/NWS/NCEP/EMC
> > > > >>>
> > > > >>> 5830 University Research Ct., Rm. 2792
> > > > >>>
> > > > >>> College Park, MD 20740
> > > > >>>
> > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> > > > >>>
> > > > >>> 301-683-3958
> > > > >>>
> > > > >>>
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Mon Jan 13 14:17:11 2020
I do try the SMALLNUMBER and no parsing error
export SMALLNUMBER=$((10**-90))
I do type in a number with 90 decimal 0 for 10^-90, it also passed.
{Stupid but work.} I am using this one for now.
The FHO values is still not the same as that of VSDB. for 20190110.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
MET verification output is at
/gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200110
Current operational output are at
/gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200110.vsdb
Forecast file are at
/gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
Observation files are at
/gpfs/dell1/nco/ops/dcom/prod/20200110/wgrbbul/dust
On Mon, Jan 13, 2020 at 3:19 PM Ho-Chun Huang - NOAA Affiliate <
ho-chun.huang at noaa.gov> wrote:
> Hi, John:
>
> The model fcst field set x=-99 for zero concentration gridded value.
Thus
> for grid value /= -99 the concentration values is 10^x.
>
> This logic <-90 reset conc=0 is from current VSDB routine.
>
> I will try the SMALLNUMBER concept, but I do not know whether I can
really
> spelling out 10^-90 is bash script.
>
> Since my fcst and obs field all utilize convert[x], I want to know
for
> sure the censor_thresold is applied to convert[x] but not the
original
> field from FCST and OBSV input file, correct?
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Mon, Jan 13, 2020 at 2:58 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Ho-Chun,
>>
>> Thanks for clarifying the problem. I tried this out and was able
to
>> replicate the same behavior you described.
>>
>> Unfortunately, "math" embedded directly in threshold string is not
>> supported. That's why you're getting a parsing error for:
>> censor_thresh = [ <10^-90.];
>>
>> We might be able to add this to the config file language in the
future.
>> Should I write up a GitHub issue with the feature request?
>>
>> Is 10^(-90) really the correct threshold? I agree that with
numbers so
>> close to 0, there may be precision issues. Generally MET stores
data as
>> double precision, but honestly we haven’t tested haven’t tested it
with
>> this type of data.
>>
>> Environment variables are supported here. For example, you could
set:
>> censor_thresh = [ <${SMALL_NUMBER} ];
>>
>> Where that’s an env variable you’ve already set.
>>
>> Math is supported in the convert(x) function, such as:
>> convert(x) = x * 10^90;
>>
>> Perhaps that’d be helpful?
>>
>> Thanks
>> John
>>
>> On Mon, Jan 13, 2020 at 7:56 AM Ho-Chun Huang - NOAA Affiliate via
RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
>> >
>> > Hi, John:
>> >
>> > Thanks for the reply.
>> >
>> > The statement generate error
>> >
>> > > censor_thresh = [ <10^-90.];
>> >
>> > I tried <10^-90 the grid_stat still is not working. Is the 10^-
90 over
>> the
>> > single or double precision limit?
>> >
>> > Just to confirm again, -9999 is the correct value to use to tell
MET
>> this
>> > data should be removed from pairing with FCST data?
>> >
>> > Today the WCOSS is down, so I can not provide a more detailed
error
>> > message, will do that as soon as I can.
>> >
>> > Ho-Chun Huang
>> >
>> > IMSG at NOAA/NWS/NCEP/EMC
>> >
>> > 5830 University Research Ct., Rm. 2792
>> >
>> > College Park, MD 20740
>> >
>> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>> >
>> > 301-683-3958
>> >
>> >
>> > On Fri, Jan 10, 2020 at 5:04 PM John Halley Gotway via RT <
>> > met_help at ucar.edu>
>> > wrote:
>> >
>> > > Ho-Chun,
>> > >
>> > > Those seem like reasonable settings to me. I do often use the
>> > > plot_data_plane tool to test these sort of things out.
>> > >
>> > > # Plot temperature data in kelvin
>> > > bin/plot_data_plane
>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>> > > TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
>> > > DEBUG 1: Opening data file:
>> > > data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>> > > DEBUG 1: Creating postscript file: TMP_Z2_K.ps
>> > >
>> > > # Test converting kelvin to celsius
>> > > bin/plot_data_plane
>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>> > > TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
273.15;'
>> -v 2
>> > >
>> > > And then I check the resulting plots to make sure the range of
data
>> is as
>> > > expected.
>> > >
>> > > You can also test censor in this way:
>> > > # Test converting kelvin to celsius and censor
>> > > bin/plot_data_plane
>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>> > > TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) =
TEMP -
>> > 273.15;
>> > > censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
>> > >
>> > > Are your convert and censor thresholds working OK for you?
>> > >
>> > > Thanks,
>> > > John Halley Gotway
>> > >
>> > >
>> > >
>> > > On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA Affiliate
via RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694
>
>> > > >
>> > > > To Whom It May Concern,
>> > > >
>> > > > Will this configuration satisfies the logical condition as
>> described in
>> > > > previous email? I assume censor threshold applied to
>> convert(LIPMF)
>> > and
>> > > > convert(DEN). Is -9999. the default missing value for MET,
or I
>> need
>> > to
>> > > > set an environment variable for missing values, e.g., export
>> > > > MET_DEFAULT_MISSING=-9999.. Please advise.
>> > > >
>> > > > fcst = {
>> > > > wind_thresh = [ NA ];
>> > > >
>> > > > field = [
>> > > > {
>> > > > name = "LIPMF";
>> > > > convert(LIPMF) = 10^LIPMF;
>> > > > censor_thresh = [ <10^-90.];
>> > > > censor_val = [ 0. ];
>> > > > level = [ "Z0-5000" ];
>> > > > lead_time = "${CUR_LEAD_HOUR}";
>> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0
>> ];
>> > > > }
>> > > > ];
>> > > >
>> > > > };
>> > > > obs = {
>> > > > wind_thresh = [ NA ];
>> > > >
>> > > > field = [
>> > > > {
>> > > > name = "DEN";
>> > > > convert(DEN) = DEN * 10^9;
>> > > > level = [ "Z5000" ];
>> > > > censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5, >-
9&&<-3.5
>> ];
>> > > > censor_val = [ -9999., 10^-6, -9999. ]
>> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0
>> ];
>> > > > }
>> > > > ];
>> > > >
>> > > > };
>> > > >
>> > > > Ho-Chun Huang
>> > > >
>> > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > >
>> > > > 5830 University Research Ct., Rm. 2792
>> > > >
>> > > > College Park, MD 20740
>> > > >
>> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>> > > >
>> > > > 301-683-3958
>> > > >
>> > > >
>> > > > On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA Affiliate
<
>> > > > ho-chun.huang at noaa.gov> wrote:
>> > > >
>> > > > > To Whom It May Concern:
>> > > > >
>> > > > > I need help to deal with multiple logical if statement.
>> > > > >
>> > > > >
>> > > > > In
>> > > >
>> > >
>> >
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > > *fcst = { wind_thresh = [ NA ]; field = [ {
name
>> > > =
>> > > > > "LIPMF"; convert(LIPMF) = 10^LIPMF; level
= [
>> > > > "Z0-5000"
>> > > > > ]; lead_time = "${CUR_LEAD_HOUR}";
cat_thresh = [
>> > <1.0,
>> > > > > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
>> > > > > *};*
>> > > > >
>> > > > > To satisfy
>> > > > > if ( LIPMF < -90.) then
>> > > > > LIMPF=0.
>> > > > > else
>> > > > > LIMPF=10^LIMPF
>> > > > > endif
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > > > > *obs = { wind_thresh = [ NA ]; field = [ {
name
>> > =
>> > > > > "DEN"; convert(DEN) = DEN * 10^9; level
= [
>> > "Z5000"
>> > > ];
>> > > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0, >15.0,
>20.0
>> ];
>> > > > > } ];*
>> > > > > *};*
>> > > > >
>> > > > > To satisfy
>> > > > > (1) DEN=DEN*1.0E9
>> > > > > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
>> > > > > DEN=1.0E-6
>> > > > > fi
>> > > > > (3)Then use only positive (>=0) values of DEN (after
convert(DEN)
>> for
>> > > > > verification. (i.e., include (2) grid that originally have
values
>> > -3.5
>> > > > <=
>> > > > > X <= -1.5 and positive values)
>> > > > >
>> > > > >
>> > > > > Ho-Chun Huang
>> > > > >
>> > > > > IMSG at NOAA/NWS/NCEP/EMC
>> > > > >
>> > > > > 5830 University Research Ct., Rm. 2792
>> > > > >
>> > > > > College Park, MD 20740
>> > > > >
>> > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>> > > > >
>> > > > > 301-683-3958
>> > > > >
>> > > > >
>> > > > > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA
Affiliate <
>> > > > > ho-chun.huang at noaa.gov> wrote:
>> > > > >
>> > > > >> To Whom It May Concern:
>> > > > >>
>> > > > >> After talking to BinBin, there are more filtering
processing on
>> the
>> > > > >> observation after the conversion of 10^9.
>> > > > >>
>> > > > >> I might still need your help because there are multiple
>> condition to
>> > > > meet
>> > > > >> that I need to describe them in configuration file.
>> > > > >>
>> > > > >> Ho-Chun Huang
>> > > > >>
>> > > > >> IMSG at NOAA/NWS/NCEP/EMC
>> > > > >>
>> > > > >> 5830 University Research Ct., Rm. 2792
>> > > > >>
>> > > > >> College Park, MD 20740
>> > > > >>
>> > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>> > > > >>
>> > > > >> 301-683-3958
>> > > > >>
>> > > > >>
>> > > > >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT <
>> > > > >> met_help at ucar.edu> wrote:
>> > > > >>
>> > > > >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY
DURING THE
>> > > WINTER
>> > > > >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES
MAY BE
>> > > DELAYED.
>> > > > >>>
>> > > > >>> Greetings,
>> > > > >>>
>> > > > >>> This message has been automatically generated in response
to the
>> > > > >>> creation of a trouble ticket regarding:
>> > > > >>> "HYSPLIT Dust versus MODIS dust MET gridsta
>> verification",
>> > > > >>> a summary of which appears below.
>> > > > >>>
>> > > > >>> There is no need to reply to this message right now.
Your
>> ticket
>> > has
>> > > > >>> been assigned an ID of [rt.rap.ucar.edu #93694].
>> > > > >>>
>> > > > >>> Please include the string:
>> > > > >>>
>> > > > >>> [rt.rap.ucar.edu #93694]
>> > > > >>>
>> > > > >>> in the subject line of all future correspondence about
this
>> issue.
>> > To
>> > > > do
>> > > > >>> so, you may reply to this message.
>> > > > >>>
>> > > > >>> For more information, please see:
>> > > > >>>
>> > > > >>> MET Online Tutorial:
>> > > > >>>
>> > > >
>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>> > > > >>>
>> > > > >>> MET Users Guide:
>> > > > >>> https://www.dtcenter.org/met/users/docs/overview.php
>> > > > >>>
>> > > > >>> MET FAQs:
>> > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
>> > > > >>>
>> > > > >>> MET-Help Email Archive:
>> > > > >>> http://mailman.ucar.edu/pipermail/met_help
>> > > > >>>
>> > > > >>> Thank you,
>> > > > >>> met_help at ucar.edu
>> > > > >>>
>> > > > >>>
>> > > >
>> >
>>
-------------------------------------------------------------------------
>> > > > >>> To Whom It May help:
>> > > > >>>
>> > > > >>> I am working on MET gridsta verification between HYSPLIT
Dust
>> > versus
>> > > > >>> MODIS
>> > > > >>> dust to replace FVS verification.
>> > > > >>>
>> > > > >>> I found the number in the FHO statistic between these two
>> > approaches
>> > > > are
>> > > > >>> quite different, especially for G245. I am seeking help
from
>> your
>> > > > group
>> > > > >>> to resolve this issue.
>> > > > >>>
>> > > > >>> Verification grdstat script is at
>> > > > >>>
>> > > > >>>
>> > > >
>> > >
>> >
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
>> > > > >>>
>> > > > >>> lead time or FCST_HOUR is from 01 to 48 (
>> > > > >>>
>> > > > >>>
>> > > >
>> > >
>> >
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
>> > > > >>>
>> > > > >>> Verification configuration file is at
>> > > > >>>
>> > > > >>>
>> > > >
>> > >
>> >
>> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
>> > > > >>>
>> > > > >>> MET verification output is at
>> > > > >>>
>> > > > >>>
>> > > >
>> > >
>> >
>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
>> > > > >>>
>> > > > >>> Current operational output are at
>> > > > >>>
>> > > > >>>
>> > > >
>> > >
>> >
>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
>> > > > >>>
>> > > > >>> Forecast file are at
>> > > > /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
>> > > > >>> Observation files are at
>> > > > >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
>> > > > >>>
>> > > > >>> Ho-Chun Huang
>> > > > >>>
>> > > > >>> IMSG at NOAA/NWS/NCEP/EMC
>> > > > >>>
>> > > > >>> 5830 University Research Ct., Rm. 2792
>> > > > >>>
>> > > > >>> College Park, MD 20740
>> > > > >>>
>> > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>> > > > >>>
>> > > > >>> 301-683-3958
>> > > > >>>
>> > > > >>>
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: Ho-Chun Huang - NOAA Affiliate
Time: Fri Jan 17 13:52:09 2020
Hi, John:
I am able to produce CSI plots using MET between HYSPLIT DUST and
MODIS
DUST. The numbers of CSI between current operational VSDB FHO and MET
CTC
are different but look similar to each other.
Seems like conditional data filtering can be done by censor_thresh and
censor_val. I will ask you to close the current ticket while I am
investigating the CSI difference between FVS and MET. Will check CSI
values for 2019 summer months next.
Thank you for your help again. I am also worried about ticket #93563,
is
there any progress from Randy? This may impact your next MET release.
Ho-Chun Huang
IMSG at NOAA/NWS/NCEP/EMC
5830 University Research Ct., Rm. 2792
College Park, MD 20740
Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
301-683-3958
On Mon, Jan 13, 2020 at 4:16 PM Ho-Chun Huang - NOAA Affiliate <
ho-chun.huang at noaa.gov> wrote:
> I do try the SMALLNUMBER and no parsing error
>
> export SMALLNUMBER=$((10**-90))
>
> I do type in a number with 90 decimal 0 for 10^-90, it also passed.
> {Stupid but work.} I am using this one for now.
>
> The FHO values is still not the same as that of VSDB. for 20190110.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
> MET verification output is at
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200110
>
> Current operational output are at
>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200110.vsdb
>
> Forecast file are at
/gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> Observation files are at
> /gpfs/dell1/nco/ops/dcom/prod/20200110/wgrbbul/dust
>
> On Mon, Jan 13, 2020 at 3:19 PM Ho-Chun Huang - NOAA Affiliate <
> ho-chun.huang at noaa.gov> wrote:
>
>> Hi, John:
>>
>> The model fcst field set x=-99 for zero concentration gridded
value.
>> Thus for grid value /= -99 the concentration values is 10^x.
>>
>> This logic <-90 reset conc=0 is from current VSDB routine.
>>
>> I will try the SMALLNUMBER concept, but I do not know whether I can
>> really spelling out 10^-90 is bash script.
>>
>> Since my fcst and obs field all utilize convert[x], I want to know
for
>> sure the censor_thresold is applied to convert[x] but not the
original
>> field from FCST and OBSV input file, correct?
>>
>> Ho-Chun Huang
>>
>> IMSG at NOAA/NWS/NCEP/EMC
>>
>> 5830 University Research Ct., Rm. 2792
>>
>> College Park, MD 20740
>>
>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>
>> 301-683-3958
>>
>>
>> On Mon, Jan 13, 2020 at 2:58 PM John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>>> Ho-Chun,
>>>
>>> Thanks for clarifying the problem. I tried this out and was able
to
>>> replicate the same behavior you described.
>>>
>>> Unfortunately, "math" embedded directly in threshold string is not
>>> supported. That's why you're getting a parsing error for:
>>> censor_thresh = [ <10^-90.];
>>>
>>> We might be able to add this to the config file language in the
future.
>>> Should I write up a GitHub issue with the feature request?
>>>
>>> Is 10^(-90) really the correct threshold? I agree that with
numbers so
>>> close to 0, there may be precision issues. Generally MET stores
data as
>>> double precision, but honestly we haven’t tested haven’t tested it
with
>>> this type of data.
>>>
>>> Environment variables are supported here. For example, you could
set:
>>> censor_thresh = [ <${SMALL_NUMBER} ];
>>>
>>> Where that’s an env variable you’ve already set.
>>>
>>> Math is supported in the convert(x) function, such as:
>>> convert(x) = x * 10^90;
>>>
>>> Perhaps that’d be helpful?
>>>
>>> Thanks
>>> John
>>>
>>> On Mon, Jan 13, 2020 at 7:56 AM Ho-Chun Huang - NOAA Affiliate via
RT <
>>> met_help at ucar.edu> wrote:
>>>
>>> >
>>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
>>> >
>>> > Hi, John:
>>> >
>>> > Thanks for the reply.
>>> >
>>> > The statement generate error
>>> >
>>> > > censor_thresh = [ <10^-90.];
>>> >
>>> > I tried <10^-90 the grid_stat still is not working. Is the 10^-
90
>>> over the
>>> > single or double precision limit?
>>> >
>>> > Just to confirm again, -9999 is the correct value to use to tell
MET
>>> this
>>> > data should be removed from pairing with FCST data?
>>> >
>>> > Today the WCOSS is down, so I can not provide a more detailed
error
>>> > message, will do that as soon as I can.
>>> >
>>> > Ho-Chun Huang
>>> >
>>> > IMSG at NOAA/NWS/NCEP/EMC
>>> >
>>> > 5830 University Research Ct., Rm. 2792
>>> >
>>> > College Park, MD 20740
>>> >
>>> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>> >
>>> > 301-683-3958
>>> >
>>> >
>>> > On Fri, Jan 10, 2020 at 5:04 PM John Halley Gotway via RT <
>>> > met_help at ucar.edu>
>>> > wrote:
>>> >
>>> > > Ho-Chun,
>>> > >
>>> > > Those seem like reasonable settings to me. I do often use the
>>> > > plot_data_plane tool to test these sort of things out.
>>> > >
>>> > > # Plot temperature data in kelvin
>>> > > bin/plot_data_plane
>>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>>> > > TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
>>> > > DEBUG 1: Opening data file:
>>> > > data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>>> > > DEBUG 1: Creating postscript file: TMP_Z2_K.ps
>>> > >
>>> > > # Test converting kelvin to celsius
>>> > > bin/plot_data_plane
>>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>>> > > TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
273.15;'
>>> -v 2
>>> > >
>>> > > And then I check the resulting plots to make sure the range of
data
>>> is as
>>> > > expected.
>>> > >
>>> > > You can also test censor in this way:
>>> > > # Test converting kelvin to celsius and censor
>>> > > bin/plot_data_plane
>>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
>>> > > TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) =
TEMP -
>>> > 273.15;
>>> > > censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
>>> > >
>>> > > Are your convert and censor thresholds working OK for you?
>>> > >
>>> > > Thanks,
>>> > > John Halley Gotway
>>> > >
>>> > >
>>> > >
>>> > > On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA Affiliate
via RT
>>> <
>>> > > met_help at ucar.edu> wrote:
>>> > >
>>> > > >
>>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
>>> > > >
>>> > > > To Whom It May Concern,
>>> > > >
>>> > > > Will this configuration satisfies the logical condition as
>>> described in
>>> > > > previous email? I assume censor threshold applied to
>>> convert(LIPMF)
>>> > and
>>> > > > convert(DEN). Is -9999. the default missing value for MET,
or I
>>> need
>>> > to
>>> > > > set an environment variable for missing values, e.g., export
>>> > > > MET_DEFAULT_MISSING=-9999.. Please advise.
>>> > > >
>>> > > > fcst = {
>>> > > > wind_thresh = [ NA ];
>>> > > >
>>> > > > field = [
>>> > > > {
>>> > > > name = "LIPMF";
>>> > > > convert(LIPMF) = 10^LIPMF;
>>> > > > censor_thresh = [ <10^-90.];
>>> > > > censor_val = [ 0. ];
>>> > > > level = [ "Z0-5000" ];
>>> > > > lead_time = "${CUR_LEAD_HOUR}";
>>> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0,
>15.0,
>>> >20.0 ];
>>> > > > }
>>> > > > ];
>>> > > >
>>> > > > };
>>> > > > obs = {
>>> > > > wind_thresh = [ NA ];
>>> > > >
>>> > > > field = [
>>> > > > {
>>> > > > name = "DEN";
>>> > > > convert(DEN) = DEN * 10^9;
>>> > > > level = [ "Z5000" ];
>>> > > > censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5,
>>> >-9&&<-3.5 ];
>>> > > > censor_val = [ -9999., 10^-6, -9999.
]
>>> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0,
>15.0,
>>> >20.0 ];
>>> > > > }
>>> > > > ];
>>> > > >
>>> > > > };
>>> > > >
>>> > > > Ho-Chun Huang
>>> > > >
>>> > > > IMSG at NOAA/NWS/NCEP/EMC
>>> > > >
>>> > > > 5830 University Research Ct., Rm. 2792
>>> > > >
>>> > > > College Park, MD 20740
>>> > > >
>>> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>> > > >
>>> > > > 301-683-3958
>>> > > >
>>> > > >
>>> > > > On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA
Affiliate <
>>> > > > ho-chun.huang at noaa.gov> wrote:
>>> > > >
>>> > > > > To Whom It May Concern:
>>> > > > >
>>> > > > > I need help to deal with multiple logical if statement.
>>> > > > >
>>> > > > >
>>> > > > > In
>>> > > >
>>> > >
>>> >
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/parm/verf_g2g_config_hysplitdust
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > > *fcst = { wind_thresh = [ NA ]; field = [ {
name
>>> > > =
>>> > > > > "LIPMF"; convert(LIPMF) = 10^LIPMF; level
= [
>>> > > > "Z0-5000"
>>> > > > > ]; lead_time = "${CUR_LEAD_HOUR}";
cat_thresh = [
>>> > <1.0,
>>> > > > > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
>>> > > > > *};*
>>> > > > >
>>> > > > > To satisfy
>>> > > > > if ( LIPMF < -90.) then
>>> > > > > LIMPF=0.
>>> > > > > else
>>> > > > > LIMPF=10^LIMPF
>>> > > > > endif
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > > *obs = { wind_thresh = [ NA ]; field = [ {
name
>>> > =
>>> > > > > "DEN"; convert(DEN) = DEN * 10^9; level
= [
>>> > "Z5000"
>>> > > ];
>>> > > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0,
>15.0,
>>> >20.0 ];
>>> > > > > } ];*
>>> > > > > *};*
>>> > > > >
>>> > > > > To satisfy
>>> > > > > (1) DEN=DEN*1.0E9
>>> > > > > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
>>> > > > > DEN=1.0E-6
>>> > > > > fi
>>> > > > > (3)Then use only positive (>=0) values of DEN (after
>>> convert(DEN) for
>>> > > > > verification. (i.e., include (2) grid that originally
have
>>> values
>>> > -3.5
>>> > > > <=
>>> > > > > X <= -1.5 and positive values)
>>> > > > >
>>> > > > >
>>> > > > > Ho-Chun Huang
>>> > > > >
>>> > > > > IMSG at NOAA/NWS/NCEP/EMC
>>> > > > >
>>> > > > > 5830 University Research Ct., Rm. 2792
>>> > > > >
>>> > > > > College Park, MD 20740
>>> > > > >
>>> > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>> > > > >
>>> > > > > 301-683-3958
>>> > > > >
>>> > > > >
>>> > > > > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA
Affiliate <
>>> > > > > ho-chun.huang at noaa.gov> wrote:
>>> > > > >
>>> > > > >> To Whom It May Concern:
>>> > > > >>
>>> > > > >> After talking to BinBin, there are more filtering
processing on
>>> the
>>> > > > >> observation after the conversion of 10^9.
>>> > > > >>
>>> > > > >> I might still need your help because there are multiple
>>> condition to
>>> > > > meet
>>> > > > >> that I need to describe them in configuration file.
>>> > > > >>
>>> > > > >> Ho-Chun Huang
>>> > > > >>
>>> > > > >> IMSG at NOAA/NWS/NCEP/EMC
>>> > > > >>
>>> > > > >> 5830 University Research Ct., Rm. 2792
>>> > > > >>
>>> > > > >> College Park, MD 20740
>>> > > > >>
>>> > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>> > > > >>
>>> > > > >> 301-683-3958
>>> > > > >>
>>> > > > >>
>>> > > > >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via RT
<
>>> > > > >> met_help at ucar.edu> wrote:
>>> > > > >>
>>> > > > >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY
DURING THE
>>> > > WINTER
>>> > > > >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND RESPONSES
MAY BE
>>> > > DELAYED.
>>> > > > >>>
>>> > > > >>> Greetings,
>>> > > > >>>
>>> > > > >>> This message has been automatically generated in
response to
>>> the
>>> > > > >>> creation of a trouble ticket regarding:
>>> > > > >>> "HYSPLIT Dust versus MODIS dust MET gridsta
>>> verification",
>>> > > > >>> a summary of which appears below.
>>> > > > >>>
>>> > > > >>> There is no need to reply to this message right now.
Your
>>> ticket
>>> > has
>>> > > > >>> been assigned an ID of [rt.rap.ucar.edu #93694].
>>> > > > >>>
>>> > > > >>> Please include the string:
>>> > > > >>>
>>> > > > >>> [rt.rap.ucar.edu #93694]
>>> > > > >>>
>>> > > > >>> in the subject line of all future correspondence about
this
>>> issue.
>>> > To
>>> > > > do
>>> > > > >>> so, you may reply to this message.
>>> > > > >>>
>>> > > > >>> For more information, please see:
>>> > > > >>>
>>> > > > >>> MET Online Tutorial:
>>> > > > >>>
>>> > > >
>>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
>>> > > > >>>
>>> > > > >>> MET Users Guide:
>>> > > > >>> https://www.dtcenter.org/met/users/docs/overview.php
>>> > > > >>>
>>> > > > >>> MET FAQs:
>>> > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
>>> > > > >>>
>>> > > > >>> MET-Help Email Archive:
>>> > > > >>> http://mailman.ucar.edu/pipermail/met_help
>>> > > > >>>
>>> > > > >>> Thank you,
>>> > > > >>> met_help at ucar.edu
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> >
>>>
-------------------------------------------------------------------------
>>> > > > >>> To Whom It May help:
>>> > > > >>>
>>> > > > >>> I am working on MET gridsta verification between HYSPLIT
Dust
>>> > versus
>>> > > > >>> MODIS
>>> > > > >>> dust to replace FVS verification.
>>> > > > >>>
>>> > > > >>> I found the number in the FHO statistic between these
two
>>> > approaches
>>> > > > are
>>> > > > >>> quite different, especially for G245. I am seeking
help from
>>> your
>>> > > > group
>>> > > > >>> to resolve this issue.
>>> > > > >>>
>>> > > > >>> Verification grdstat script is at
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> > >
>>> >
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
>>> > > > >>>
>>> > > > >>> lead time or FCST_HOUR is from 01 to 48 (
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> > >
>>> >
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
>>> > > > >>>
>>> > > > >>> Verification configuration file is at
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> > >
>>> >
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/MET_verif/EMC_verif-aq-g2g/parm/verf_g2g_config_hysplitdust
>>> > > > >>>
>>> > > > >>> MET verification output is at
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> > >
>>> >
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
>>> > > > >>>
>>> > > > >>> Current operational output are at
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> > >
>>> >
>>> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
>>> > > > >>>
>>> > > > >>> Forecast file are at
>>> > > > /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
>>> > > > >>> Observation files are at
>>> > > > >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
>>> > > > >>>
>>> > > > >>> Ho-Chun Huang
>>> > > > >>>
>>> > > > >>> IMSG at NOAA/NWS/NCEP/EMC
>>> > > > >>>
>>> > > > >>> 5830 University Research Ct., Rm. 2792
>>> > > > >>>
>>> > > > >>> College Park, MD 20740
>>> > > > >>>
>>> > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>>> > > > >>>
>>> > > > >>> 301-683-3958
>>> > > > >>>
>>> > > > >>>
>>> > > >
>>> > > >
>>> > >
>>> > >
>>> >
>>> >
>>>
>>>
------------------------------------------------
Subject: HYSPLIT Dust versus MODIS dust MET gridsta verification
From: John Halley Gotway
Time: Fri Jan 17 14:13:08 2020
Ho-Chun,
Thanks for the update. I'll go ahead and resolve the ticket, but if
more
issues arise, please let us know.
And I'll check in with Randy on ticket #93563.
Thanks,
John
On Fri, Jan 17, 2020 at 1:52 PM Ho-Chun Huang - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
>
> Hi, John:
>
> I am able to produce CSI plots using MET between HYSPLIT DUST and
MODIS
> DUST. The numbers of CSI between current operational VSDB FHO and
MET CTC
> are different but look similar to each other.
>
> Seems like conditional data filtering can be done by censor_thresh
and
> censor_val. I will ask you to close the current ticket while I am
> investigating the CSI difference between FVS and MET. Will check
CSI
> values for 2019 summer months next.
>
> Thank you for your help again. I am also worried about ticket
#93563, is
> there any progress from Randy? This may impact your next MET
release.
>
> Ho-Chun Huang
>
> IMSG at NOAA/NWS/NCEP/EMC
>
> 5830 University Research Ct., Rm. 2792
>
> College Park, MD 20740
>
> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
>
> 301-683-3958
>
>
> On Mon, Jan 13, 2020 at 4:16 PM Ho-Chun Huang - NOAA Affiliate <
> ho-chun.huang at noaa.gov> wrote:
>
> > I do try the SMALLNUMBER and no parsing error
> >
> > export SMALLNUMBER=$((10**-90))
> >
> > I do type in a number with 90 decimal 0 for 10^-90, it also
passed.
> > {Stupid but work.} I am using this one for now.
> >
> > The FHO values is still not the same as that of VSDB. for
20190110.
> >
> > Ho-Chun Huang
> >
> > IMSG at NOAA/NWS/NCEP/EMC
> >
> > 5830 University Research Ct., Rm. 2792
> >
> > College Park, MD 20740
> >
> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >
> > 301-683-3958
> >
> > MET verification output is at
> >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200110
> >
> > Current operational output are at
> >
> >
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200110.vsdb
> >
> > Forecast file are at
/gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> > Observation files are at
> > /gpfs/dell1/nco/ops/dcom/prod/20200110/wgrbbul/dust
> >
> > On Mon, Jan 13, 2020 at 3:19 PM Ho-Chun Huang - NOAA Affiliate <
> > ho-chun.huang at noaa.gov> wrote:
> >
> >> Hi, John:
> >>
> >> The model fcst field set x=-99 for zero concentration gridded
value.
> >> Thus for grid value /= -99 the concentration values is 10^x.
> >>
> >> This logic <-90 reset conc=0 is from current VSDB routine.
> >>
> >> I will try the SMALLNUMBER concept, but I do not know whether I
can
> >> really spelling out 10^-90 is bash script.
> >>
> >> Since my fcst and obs field all utilize convert[x], I want to
know for
> >> sure the censor_thresold is applied to convert[x] but not the
original
> >> field from FCST and OBSV input file, correct?
> >>
> >> Ho-Chun Huang
> >>
> >> IMSG at NOAA/NWS/NCEP/EMC
> >>
> >> 5830 University Research Ct., Rm. 2792
> >>
> >> College Park, MD 20740
> >>
> >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>
> >> 301-683-3958
> >>
> >>
> >> On Mon, Jan 13, 2020 at 2:58 PM John Halley Gotway via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>> Ho-Chun,
> >>>
> >>> Thanks for clarifying the problem. I tried this out and was
able to
> >>> replicate the same behavior you described.
> >>>
> >>> Unfortunately, "math" embedded directly in threshold string is
not
> >>> supported. That's why you're getting a parsing error for:
> >>> censor_thresh = [ <10^-90.];
> >>>
> >>> We might be able to add this to the config file language in the
future.
> >>> Should I write up a GitHub issue with the feature request?
> >>>
> >>> Is 10^(-90) really the correct threshold? I agree that with
numbers so
> >>> close to 0, there may be precision issues. Generally MET stores
data
> as
> >>> double precision, but honestly we haven’t tested haven’t tested
it with
> >>> this type of data.
> >>>
> >>> Environment variables are supported here. For example, you
could set:
> >>> censor_thresh = [ <${SMALL_NUMBER} ];
> >>>
> >>> Where that’s an env variable you’ve already set.
> >>>
> >>> Math is supported in the convert(x) function, such as:
> >>> convert(x) = x * 10^90;
> >>>
> >>> Perhaps that’d be helpful?
> >>>
> >>> Thanks
> >>> John
> >>>
> >>> On Mon, Jan 13, 2020 at 7:56 AM Ho-Chun Huang - NOAA Affiliate
via RT <
> >>> met_help at ucar.edu> wrote:
> >>>
> >>> >
> >>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694
>
> >>> >
> >>> > Hi, John:
> >>> >
> >>> > Thanks for the reply.
> >>> >
> >>> > The statement generate error
> >>> >
> >>> > > censor_thresh = [ <10^-90.];
> >>> >
> >>> > I tried <10^-90 the grid_stat still is not working. Is the
10^-90
> >>> over the
> >>> > single or double precision limit?
> >>> >
> >>> > Just to confirm again, -9999 is the correct value to use to
tell MET
> >>> this
> >>> > data should be removed from pairing with FCST data?
> >>> >
> >>> > Today the WCOSS is down, so I can not provide a more detailed
error
> >>> > message, will do that as soon as I can.
> >>> >
> >>> > Ho-Chun Huang
> >>> >
> >>> > IMSG at NOAA/NWS/NCEP/EMC
> >>> >
> >>> > 5830 University Research Ct., Rm. 2792
> >>> >
> >>> > College Park, MD 20740
> >>> >
> >>> > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>> >
> >>> > 301-683-3958
> >>> >
> >>> >
> >>> > On Fri, Jan 10, 2020 at 5:04 PM John Halley Gotway via RT <
> >>> > met_help at ucar.edu>
> >>> > wrote:
> >>> >
> >>> > > Ho-Chun,
> >>> > >
> >>> > > Those seem like reasonable settings to me. I do often use
the
> >>> > > plot_data_plane tool to test these sort of things out.
> >>> > >
> >>> > > # Plot temperature data in kelvin
> >>> > > bin/plot_data_plane
> >>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> >>> > > TMP_Z2_K.ps 'name="TMP"; level="Z2";' -v 2
> >>> > > DEBUG 1: Opening data file:
> >>> > > data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> >>> > > DEBUG 1: Creating postscript file: TMP_Z2_K.ps
> >>> > >
> >>> > > # Test converting kelvin to celsius
> >>> > > bin/plot_data_plane
> >>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> >>> > > TMP_Z2_C.ps 'name="TMP"; level="Z2"; convert(TEMP) = TEMP -
> 273.15;'
> >>> -v 2
> >>> > >
> >>> > > And then I check the resulting plots to make sure the range
of data
> >>> is as
> >>> > > expected.
> >>> > >
> >>> > > You can also test censor in this way:
> >>> > > # Test converting kelvin to celsius and censor
> >>> > > bin/plot_data_plane
> >>> data/sample_fcst/2005080700/wrfprs_ruc13_06.tm00_G212
> >>> > > TMP_Z2_C_censor.ps 'name="TMP"; level="Z2"; convert(TEMP) =
TEMP -
> >>> > 273.15;
> >>> > > censor_thresh = [ lt20 ]; censor_val = [ 0 ];' -v 2
> >>> > >
> >>> > > Are your convert and censor thresholds working OK for you?
> >>> > >
> >>> > > Thanks,
> >>> > > John Halley Gotway
> >>> > >
> >>> > >
> >>> > >
> >>> > > On Thu, Jan 9, 2020 at 6:23 AM Ho-Chun Huang - NOAA
Affiliate via
> RT
> >>> <
> >>> > > met_help at ucar.edu> wrote:
> >>> > >
> >>> > > >
> >>> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=93694 >
> >>> > > >
> >>> > > > To Whom It May Concern,
> >>> > > >
> >>> > > > Will this configuration satisfies the logical condition as
> >>> described in
> >>> > > > previous email? I assume censor threshold applied to
> >>> convert(LIPMF)
> >>> > and
> >>> > > > convert(DEN). Is -9999. the default missing value for
MET, or I
> >>> need
> >>> > to
> >>> > > > set an environment variable for missing values, e.g.,
export
> >>> > > > MET_DEFAULT_MISSING=-9999.. Please advise.
> >>> > > >
> >>> > > > fcst = {
> >>> > > > wind_thresh = [ NA ];
> >>> > > >
> >>> > > > field = [
> >>> > > > {
> >>> > > > name = "LIPMF";
> >>> > > > convert(LIPMF) = 10^LIPMF;
> >>> > > > censor_thresh = [ <10^-90.];
> >>> > > > censor_val = [ 0. ];
> >>> > > > level = [ "Z0-5000" ];
> >>> > > > lead_time = "${CUR_LEAD_HOUR}";
> >>> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0,
>15.0,
> >>> >20.0 ];
> >>> > > > }
> >>> > > > ];
> >>> > > >
> >>> > > > };
> >>> > > > obs = {
> >>> > > > wind_thresh = [ NA ];
> >>> > > >
> >>> > > > field = [
> >>> > > > {
> >>> > > > name = "DEN";
> >>> > > > convert(DEN) = DEN * 10^9;
> >>> > > > level = [ "Z5000" ];
> >>> > > > censor_thresh = [ >-1.5&&<0., >=-3.5&&<=-1.5,
> >>> >-9&&<-3.5 ];
> >>> > > > censor_val = [ -9999., 10^-6,
-9999. ]
> >>> > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0,
>15.0,
> >>> >20.0 ];
> >>> > > > }
> >>> > > > ];
> >>> > > >
> >>> > > > };
> >>> > > >
> >>> > > > Ho-Chun Huang
> >>> > > >
> >>> > > > IMSG at NOAA/NWS/NCEP/EMC
> >>> > > >
> >>> > > > 5830 University Research Ct., Rm. 2792
> >>> > > >
> >>> > > > College Park, MD 20740
> >>> > > >
> >>> > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>> > > >
> >>> > > > 301-683-3958
> >>> > > >
> >>> > > >
> >>> > > > On Wed, Jan 8, 2020 at 1:40 PM Ho-Chun Huang - NOAA
Affiliate <
> >>> > > > ho-chun.huang at noaa.gov> wrote:
> >>> > > >
> >>> > > > > To Whom It May Concern:
> >>> > > > >
> >>> > > > > I need help to deal with multiple logical if statement.
> >>> > > > >
> >>> > > > >
> >>> > > > > In
> >>> > > >
> >>> > >
> >>> >
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > > *fcst = { wind_thresh = [ NA ]; field = [ {
> name
> >>> > > =
> >>> > > > > "LIPMF"; convert(LIPMF) = 10^LIPMF; level
=
> [
> >>> > > > "Z0-5000"
> >>> > > > > ]; lead_time = "${CUR_LEAD_HOUR}";
cat_thresh =
> [
> >>> > <1.0,
> >>> > > > > >1.0, >2.0, >5.0, >10.0, >15.0, >20.0 ]; } ];*
> >>> > > > > *};*
> >>> > > > >
> >>> > > > > To satisfy
> >>> > > > > if ( LIPMF < -90.) then
> >>> > > > > LIMPF=0.
> >>> > > > > else
> >>> > > > > LIMPF=10^LIMPF
> >>> > > > > endif
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > >
> >>> > > > > *obs = { wind_thresh = [ NA ]; field = [ {
name
> >>> > =
> >>> > > > > "DEN"; convert(DEN) = DEN * 10^9; level
= [
> >>> > "Z5000"
> >>> > > ];
> >>> > > > > cat_thresh = [ <1.0, >1.0, >2.0, >5.0, >10.0,
>15.0,
> >>> >20.0 ];
> >>> > > > > } ];*
> >>> > > > > *};*
> >>> > > > >
> >>> > > > > To satisfy
> >>> > > > > (1) DEN=DEN*1.0E9
> >>> > > > > (2) if (DEN.ge.-3.5 .and. DEN.le.-1.5) then
> >>> > > > > DEN=1.0E-6
> >>> > > > > fi
> >>> > > > > (3)Then use only positive (>=0) values of DEN (after
> >>> convert(DEN) for
> >>> > > > > verification. (i.e., include (2) grid that originally
have
> >>> values
> >>> > -3.5
> >>> > > > <=
> >>> > > > > X <= -1.5 and positive values)
> >>> > > > >
> >>> > > > >
> >>> > > > > Ho-Chun Huang
> >>> > > > >
> >>> > > > > IMSG at NOAA/NWS/NCEP/EMC
> >>> > > > >
> >>> > > > > 5830 University Research Ct., Rm. 2792
> >>> > > > >
> >>> > > > > College Park, MD 20740
> >>> > > > >
> >>> > > > > Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>> > > > >
> >>> > > > > 301-683-3958
> >>> > > > >
> >>> > > > >
> >>> > > > > On Wed, Jan 8, 2020 at 12:47 PM Ho-Chun Huang - NOAA
Affiliate
> <
> >>> > > > > ho-chun.huang at noaa.gov> wrote:
> >>> > > > >
> >>> > > > >> To Whom It May Concern:
> >>> > > > >>
> >>> > > > >> After talking to BinBin, there are more filtering
processing
> on
> >>> the
> >>> > > > >> observation after the conversion of 10^9.
> >>> > > > >>
> >>> > > > >> I might still need your help because there are multiple
> >>> condition to
> >>> > > > meet
> >>> > > > >> that I need to describe them in configuration file.
> >>> > > > >>
> >>> > > > >> Ho-Chun Huang
> >>> > > > >>
> >>> > > > >> IMSG at NOAA/NWS/NCEP/EMC
> >>> > > > >>
> >>> > > > >> 5830 University Research Ct., Rm. 2792
> >>> > > > >>
> >>> > > > >> College Park, MD 20740
> >>> > > > >>
> >>> > > > >> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>> > > > >>
> >>> > > > >> 301-683-3958
> >>> > > > >>
> >>> > > > >>
> >>> > > > >> On Tue, Jan 7, 2020 at 11:11 AM met_help at ucar.edu via
RT <
> >>> > > > >> met_help at ucar.edu> wrote:
> >>> > > > >>
> >>> > > > >>> THE MET SUPPORT STAFF WILL HAVE LIMITED AVAILABILITY
DURING
> THE
> >>> > > WINTER
> >>> > > > >>> HOLIDAYS FROM 12/23/2019 THROUGH 1/1/2020 AND
RESPONSES MAY
> BE
> >>> > > DELAYED.
> >>> > > > >>>
> >>> > > > >>> Greetings,
> >>> > > > >>>
> >>> > > > >>> This message has been automatically generated in
response to
> >>> the
> >>> > > > >>> creation of a trouble ticket regarding:
> >>> > > > >>> "HYSPLIT Dust versus MODIS dust MET gridsta
> >>> verification",
> >>> > > > >>> a summary of which appears below.
> >>> > > > >>>
> >>> > > > >>> There is no need to reply to this message right now.
Your
> >>> ticket
> >>> > has
> >>> > > > >>> been assigned an ID of [rt.rap.ucar.edu #93694].
> >>> > > > >>>
> >>> > > > >>> Please include the string:
> >>> > > > >>>
> >>> > > > >>> [rt.rap.ucar.edu #93694]
> >>> > > > >>>
> >>> > > > >>> in the subject line of all future correspondence about
this
> >>> issue.
> >>> > To
> >>> > > > do
> >>> > > > >>> so, you may reply to this message.
> >>> > > > >>>
> >>> > > > >>> For more information, please see:
> >>> > > > >>>
> >>> > > > >>> MET Online Tutorial:
> >>> > > > >>>
> >>> > > >
> >>>
https://www.dtcenter.org/met/users/support/online_tutorial/index.php
> >>> > > > >>>
> >>> > > > >>> MET Users Guide:
> >>> > > > >>>
https://www.dtcenter.org/met/users/docs/overview.php
> >>> > > > >>>
> >>> > > > >>> MET FAQs:
> >>> > > > >>>
https://www.dtcenter.org/met/users/support/faqs/index.php
> >>> > > > >>>
> >>> > > > >>> MET-Help Email Archive:
> >>> > > > >>> http://mailman.ucar.edu/pipermail/met_help
> >>> > > > >>>
> >>> > > > >>> Thank you,
> >>> > > > >>> met_help at ucar.edu
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> >
> >>>
>
-------------------------------------------------------------------------
> >>> > > > >>> To Whom It May help:
> >>> > > > >>>
> >>> > > > >>> I am working on MET gridsta verification between
HYSPLIT Dust
> >>> > versus
> >>> > > > >>> MODIS
> >>> > > > >>> dust to replace FVS verification.
> >>> > > > >>>
> >>> > > > >>> I found the number in the FHO statistic between these
two
> >>> > approaches
> >>> > > > are
> >>> > > > >>> quite different, especially for G245. I am seeking
help
> from
> >>> your
> >>> > > > group
> >>> > > > >>> to resolve this issue.
> >>> > > > >>>
> >>> > > > >>> Verification grdstat script is at
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> > >
> >>> >
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_hysplitdust_sat.sh
> >>> > > > >>>
> >>> > > > >>> lead time or FCST_HOUR is from 01 to 48 (
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> > >
> >>> >
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/ush/verf_g2g_run_hysplitdust.sh)
> >>> > > > >>>
> >>> > > > >>> Verification configuration file is at
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> > >
> >>> >
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-Chun.Huang/MET_verif/EMC_verif-
aq-g2g/parm/verf_g2g_config_hysplitdust
> >>> > > > >>>
> >>> > > > >>> MET verification output is at
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> > >
> >>> >
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/hysplitdust.20200105
> >>> > > > >>>
> >>> > > > >>> Current operational output are at
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> > >
> >>> >
> >>>
> /gpfs/dell2/emc/modeling/noscrub/Ho-
Chun.Huang/com/verif/prod/vsdb/hysplit_20200105.vsdb
> >>> > > > >>>
> >>> > > > >>> Forecast file are at
> >>> > > > /gpfs/dell1/nco/ops/com/hysplit/prod/dustcs.yyyymmdd
> >>> > > > >>> Observation files are at
> >>> > > > >>> /gpfs/dell1/nco/ops/dcom/prod/20200105/wgrbbul/dust
> >>> > > > >>>
> >>> > > > >>> Ho-Chun Huang
> >>> > > > >>>
> >>> > > > >>> IMSG at NOAA/NWS/NCEP/EMC
> >>> > > > >>>
> >>> > > > >>> 5830 University Research Ct., Rm. 2792
> >>> > > > >>>
> >>> > > > >>> College Park, MD 20740
> >>> > > > >>>
> >>> > > > >>> Ho-Chun.Huang at noaa.gov <Joe.Smith at noaa.gov>
> >>> > > > >>>
> >>> > > > >>> 301-683-3958
> >>> > > > >>>
> >>> > > > >>>
> >>> > > >
> >>> > > >
> >>> > >
> >>> > >
> >>> >
> >>> >
> >>>
> >>>
>
>
------------------------------------------------
More information about the Met_help
mailing list