[Met_help] [rt.rap.ucar.edu #98467] History for empty output
John Halley Gotway via RT
met_help at ucar.edu
Mon Feb 8 17:35:46 MST 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I was trying to verify the WIND profile using HREF vs. NDAS obs. data and I
can not get the result that I want. Here is the log file:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
It is weird that the "match is found for P850 and Z10", and one of the
output " grid_stat_href_test_120000L_20210130_000000V.stat" is not empty,
but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty inside of
the working directory "verf_g2g_hrefv3_00_dev.164719".
Inside of the working directory "
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
verf_g2g_hrefv3_00_dev.164719", I tried
$ grid_stat ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
-v 3 > testlog3
There is no any ERROR message, but I just got empty " *vcnt, *vl1l2, *cnt,
*fho" etc.
What is the problem here? Thank you.
Binyu
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Mon Feb 01 11:43:24 2021
Hi Binyu,
I see that you have a question about why you are NOT getting any
output for
the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS and took
a
look in:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
In there, you're verifying ensemble probability fields, like:
WIND_Z10_ENS_FREQ_le1
and
WIND_P850_ENS_FREQ_le1
So this is the probability of WIND SPEED being less than 1, as
computed by
the Ensemble-Stat tool.
Probability fields are evaluated in MET by the line types which begin
with
'P'... PCT, PTSD, PJC, and PRC. You can request whatever line types
you'd
like in the Grid-Stat configuration file, but if you don't pass data
which
applies to the corresponding verification logic, then you'll get empty
output files.
And that's what's going on here.
Specifically, the vector line types, VL1L2, VAL1L2, and VCT are only
created when processing the U and V wind components.
And the scalar continuous statistics line types (SL1L2, SAL1L2, and
CNT)
only apply to scalar data. That includes wind speed... not the
probability
of wind speed.
If you define categorical threshold for the scalar data, you can also
get
categorical statistics line type (FHO, CTC, and CTS).
It looks like your Ensemble-Stat config file already includes the
ensemble
mean field in the output:
ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
float WIND_Z10_ENS_MEAN(lat, lon) ;
float WIND_P850_ENS_MEAN(lat, lon) ;
So just add those to the list of fields to be evaluated by Grid-Stat.
And
define meaningful categorical thresholds for them:
In fcst...
{ name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1, gt3,
gt5,
gt10 ]; }
{ name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1, gt3,
gt5,
gt10 ]; }
And then make similar entries in the obs dictionary.
Getting the vector statistics is a little trickier. Can you confirm
that
you want vector statistics for the ensemble mean... and not for the
individual members? Is that correct?
Hope that helps.
Thanks,
John Halley Gotway
On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> Transaction: Ticket created by binyu.wang at noaa.gov
> Queue: met_help
> Subject: empty output
> Owner: Nobody
> Requestors: binyu.wang at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
>
> Hello,
>
> I was trying to verify the WIND profile using HREF vs. NDAS obs.
data and I
> can not get the result that I want. Here is the log file:
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> It is weird that the "match is found for P850 and Z10", and one of
the
> output " grid_stat_href_test_120000L_20210130_000000V.stat" is not
empty,
> but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty
inside of
> the working directory "verf_g2g_hrefv3_00_dev.164719".
>
> Inside of the working directory "
> /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> verf_g2g_hrefv3_00_dev.164719", I tried
> $ grid_stat ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> -v 3 > testlog3
> There is no any ERROR message, but I just got empty " *vcnt, *vl1l2,
*cnt,
> *fho" etc.
>
> What is the problem here? Thank you.
> Binyu
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Tue Feb 02 21:13:29 2021
Hello John,
You are absolutely right. I do NOT want the ensemble mean, and I want
the
individual member instead. I do realize that after I sent the email
for
help. I did figure out how to get vl1l2 using UGRD/VGRD. But I do have
a
question: last time I did a similar thing using ensemble data. I had
to
extract the WDIR from each member and make a scatter plot (obs. WIND
for
x-axis, difference WDIR b/t obs and model for y-axis), which takes a
lot of
time. So is it possible that MET could add some function like that in
the
future? WDIR is an important factor.
One more thing: I recall that you have updated the "plot_point_obs",
so it
can make plot for only a certain pressure level now.Which version has
the
new function? How to use it?
Thank you.
Binyu
On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Binyu,
>
> I see that you have a question about why you are NOT getting any
output for
> the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS and
took a
> look in:
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
>
> In there, you're verifying ensemble probability fields, like:
> WIND_Z10_ENS_FREQ_le1
> and
> WIND_P850_ENS_FREQ_le1
>
> So this is the probability of WIND SPEED being less than 1, as
computed by
> the Ensemble-Stat tool.
>
> Probability fields are evaluated in MET by the line types which
begin with
> 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line types
you'd
> like in the Grid-Stat configuration file, but if you don't pass data
which
> applies to the corresponding verification logic, then you'll get
empty
> output files.
>
> And that's what's going on here.
>
> Specifically, the vector line types, VL1L2, VAL1L2, and VCT are only
> created when processing the U and V wind components.
>
> And the scalar continuous statistics line types (SL1L2, SAL1L2, and
CNT)
> only apply to scalar data. That includes wind speed... not the
probability
> of wind speed.
>
> If you define categorical threshold for the scalar data, you can
also get
> categorical statistics line type (FHO, CTC, and CTS).
>
> It looks like your Ensemble-Stat config file already includes the
ensemble
> mean field in the output:
>
> ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> float WIND_Z10_ENS_MEAN(lat, lon) ;
> float WIND_P850_ENS_MEAN(lat, lon) ;
>
> So just add those to the list of fields to be evaluated by Grid-
Stat. And
> define meaningful categorical thresholds for them:
>
> In fcst...
>
> { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1, gt3,
gt5,
> gt10 ]; }
> { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3, gt5,
> gt10 ]; }
>
> And then make similar entries in the obs dictionary.
>
> Getting the vector statistics is a little trickier. Can you confirm
that
> you want vector statistics for the ensemble mean... and not for the
> individual members? Is that correct?
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
> On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > Transaction: Ticket created by binyu.wang at noaa.gov
> > Queue: met_help
> > Subject: empty output
> > Owner: Nobody
> > Requestors: binyu.wang at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> >
> > Hello,
> >
> > I was trying to verify the WIND profile using HREF vs. NDAS obs.
data
> and I
> > can not get the result that I want. Here is the log file:
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > It is weird that the "match is found for P850 and Z10", and one
of the
> > output " grid_stat_href_test_120000L_20210130_000000V.stat" is not
empty,
> > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty
inside
> of
> > the working directory "verf_g2g_hrefv3_00_dev.164719".
> >
> > Inside of the working directory "
> > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > verf_g2g_hrefv3_00_dev.164719", I tried
> > $ grid_stat ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > -v 3 > testlog3
> > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> *cnt,
> > *fho" etc.
> >
> > What is the problem here? Thank you.
> > Binyu
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Wed Feb 03 09:40:13 2021
Binyu,
Here's a few GitHub issues which describe recent enhancements to
plot_point_obs:
https://github.com/dtcenter/MET/issues/1528
https://github.com/dtcenter/MET/issues/1052
https://github.com/dtcenter/MET/issues/1627
All of these changes were made after the met-9.1 release and in
preparation
for the met-10.0.0 release. If you'd like to test them out, I'd
recommend
using the met-10.0.0-beta3 release, which is our most recent
development
version for met-10.0.0. Please note that this code is only intended
for
testing and should not be used operational evaluation.
It's already installed on WCOSS, and you can find the details on this
page.
Just click the "NOAA machines" tab:
http://dtcenter.org/community-code/metplus/metplus-4-0-existing-builds
As for an example, here's one we run as part of the unit tests for
MET:
export TO_GRID="NONE"
plot_point_obs \
pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
-point_obs ascii2nc/trmm_2012040912_3hr.nc \
-plot_grid grib2/nam/nam_2012040900_F012.grib2 \
-config PlotPointObsConfig \
-title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
-v 3
Here's a link to the config file, which has all the important details:
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
And please see the updated documentation for this tool:
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
Here's the output of the sample command above:
[image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
So this plots a gridded base image, and then 3 different types of
point
observations.
John
On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> Hello John,
>
> You are absolutely right. I do NOT want the ensemble mean, and I
want the
> individual member instead. I do realize that after I sent the email
for
> help. I did figure out how to get vl1l2 using UGRD/VGRD. But I do
have a
> question: last time I did a similar thing using ensemble data. I had
to
> extract the WDIR from each member and make a scatter plot (obs. WIND
for
> x-axis, difference WDIR b/t obs and model for y-axis), which takes a
lot of
> time. So is it possible that MET could add some function like that
in the
> future? WDIR is an important factor.
>
> One more thing: I recall that you have updated the "plot_point_obs",
so it
> can make plot for only a certain pressure level now.Which version
has the
> new function? How to use it?
>
> Thank you.
> Binyu
>
> On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Binyu,
> >
> > I see that you have a question about why you are NOT getting any
output
> for
> > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS and
took a
> > look in:
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> >
> > In there, you're verifying ensemble probability fields, like:
> > WIND_Z10_ENS_FREQ_le1
> > and
> > WIND_P850_ENS_FREQ_le1
> >
> > So this is the probability of WIND SPEED being less than 1, as
computed
> by
> > the Ensemble-Stat tool.
> >
> > Probability fields are evaluated in MET by the line types which
begin
> with
> > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types you'd
> > like in the Grid-Stat configuration file, but if you don't pass
data
> which
> > applies to the corresponding verification logic, then you'll get
empty
> > output files.
> >
> > And that's what's going on here.
> >
> > Specifically, the vector line types, VL1L2, VAL1L2, and VCT are
only
> > created when processing the U and V wind components.
> >
> > And the scalar continuous statistics line types (SL1L2, SAL1L2,
and CNT)
> > only apply to scalar data. That includes wind speed... not the
> probability
> > of wind speed.
> >
> > If you define categorical threshold for the scalar data, you can
also get
> > categorical statistics line type (FHO, CTC, and CTS).
> >
> > It looks like your Ensemble-Stat config file already includes the
> ensemble
> > mean field in the output:
> >
> > ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > float WIND_P850_ENS_MEAN(lat, lon) ;
> >
> > So just add those to the list of fields to be evaluated by Grid-
Stat. And
> > define meaningful categorical thresholds for them:
> >
> > In fcst...
> >
> > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3, gt5,
> > gt10 ]; }
> > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> gt5,
> > gt10 ]; }
> >
> > And then make similar entries in the obs dictionary.
> >
> > Getting the vector statistics is a little trickier. Can you
confirm that
> > you want vector statistics for the ensemble mean... and not for
the
> > individual members? Is that correct?
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > Queue: met_help
> > > Subject: empty output
> > > Owner: Nobody
> > > Requestors: binyu.wang at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> >
> > >
> > >
> > > Hello,
> > >
> > > I was trying to verify the WIND profile using HREF vs. NDAS obs.
data
> > and I
> > > can not get the result that I want. Here is the log file:
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > It is weird that the "match is found for P850 and Z10", and one
of the
> > > output " grid_stat_href_test_120000L_20210130_000000V.stat" is
not
> empty,
> > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty
inside
> > of
> > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > >
> > > Inside of the working directory "
> > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > -v 3 > testlog3
> > > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> > *cnt,
> > > *fho" etc.
> > >
> > > What is the problem here? Thank you.
> > > Binyu
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Wed Feb 03 18:50:05 2021
Hello John,
That is awesome. It seems the function works great with my test.
One question though: eg, for point UGRD, if we don't set any
"prs_thresh"
or "hgt_thresh", then all the points with UGRD at EACH layer and
height
will be plotted on the map, correct?
Thank you.
Binyu
On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> Here's a few GitHub issues which describe recent enhancements to
> plot_point_obs:
> https://github.com/dtcenter/MET/issues/1528
> https://github.com/dtcenter/MET/issues/1052
> https://github.com/dtcenter/MET/issues/1627
>
> All of these changes were made after the met-9.1 release and in
preparation
> for the met-10.0.0 release. If you'd like to test them out, I'd
recommend
> using the met-10.0.0-beta3 release, which is our most recent
development
> version for met-10.0.0. Please note that this code is only intended
for
> testing and should not be used operational evaluation.
>
> It's already installed on WCOSS, and you can find the details on
this page.
> Just click the "NOAA machines" tab:
> http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
>
> As for an example, here's one we run as part of the unit tests for
MET:
>
> export TO_GRID="NONE"
> plot_point_obs \
> pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> -config PlotPointObsConfig \
> -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> -v 3
>
> Here's a link to the config file, which has all the important
details:
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
>
> And please see the updated documentation for this tool:
>
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
>
> Here's the output of the sample command above:
> [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> So this plots a gridded base image, and then 3 different types of
point
> observations.
>
> John
>
>
> On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello John,
> >
> > You are absolutely right. I do NOT want the ensemble mean, and I
want the
> > individual member instead. I do realize that after I sent the
email for
> > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I do
have a
> > question: last time I did a similar thing using ensemble data. I
had to
> > extract the WDIR from each member and make a scatter plot (obs.
WIND for
> > x-axis, difference WDIR b/t obs and model for y-axis), which takes
a lot
> of
> > time. So is it possible that MET could add some function like that
in the
> > future? WDIR is an important factor.
> >
> > One more thing: I recall that you have updated the
"plot_point_obs", so
> it
> > can make plot for only a certain pressure level now.Which version
has the
> > new function? How to use it?
> >
> > Thank you.
> > Binyu
> >
> > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binyu,
> > >
> > > I see that you have a question about why you are NOT getting any
output
> > for
> > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS
and took
> a
> > > look in:
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > >
> > > In there, you're verifying ensemble probability fields, like:
> > > WIND_Z10_ENS_FREQ_le1
> > > and
> > > WIND_P850_ENS_FREQ_le1
> > >
> > > So this is the probability of WIND SPEED being less than 1, as
computed
> > by
> > > the Ensemble-Stat tool.
> > >
> > > Probability fields are evaluated in MET by the line types which
begin
> > with
> > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types
> you'd
> > > like in the Grid-Stat configuration file, but if you don't pass
data
> > which
> > > applies to the corresponding verification logic, then you'll get
empty
> > > output files.
> > >
> > > And that's what's going on here.
> > >
> > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT are
only
> > > created when processing the U and V wind components.
> > >
> > > And the scalar continuous statistics line types (SL1L2, SAL1L2,
and
> CNT)
> > > only apply to scalar data. That includes wind speed... not the
> > probability
> > > of wind speed.
> > >
> > > If you define categorical threshold for the scalar data, you can
also
> get
> > > categorical statistics line type (FHO, CTC, and CTS).
> > >
> > > It looks like your Ensemble-Stat config file already includes
the
> > ensemble
> > > mean field in the output:
> > >
> > > ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > >
> > > So just add those to the list of fields to be evaluated by Grid-
Stat.
> And
> > > define meaningful categorical thresholds for them:
> > >
> > > In fcst...
> > >
> > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> gt5,
> > > gt10 ]; }
> > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> > gt5,
> > > gt10 ]; }
> > >
> > > And then make similar entries in the obs dictionary.
> > >
> > > Getting the vector statistics is a little trickier. Can you
confirm
> that
> > > you want vector statistics for the ensemble mean... and not for
the
> > > individual members? Is that correct?
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > Queue: met_help
> > > > Subject: empty output
> > > > Owner: Nobody
> > > > Requestors: binyu.wang at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > >
> > > >
> > > >
> > > > Hello,
> > > >
> > > > I was trying to verify the WIND profile using HREF vs. NDAS
obs. data
> > > and I
> > > > can not get the result that I want. Here is the log file:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > It is weird that the "match is found for P850 and Z10", and
one of
> the
> > > > output " grid_stat_href_test_120000L_20210130_000000V.stat" is
not
> > empty,
> > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> inside
> > > of
> > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > >
> > > > Inside of the working directory "
> > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > -v 3 > testlog3
> > > > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> > > *cnt,
> > > > *fho" etc.
> > > >
> > > > What is the problem here? Thank you.
> > > > Binyu
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Wed Feb 03 19:58:08 2021
Correct, only those obs meeting all the filtering criteria will be
plotted.
So if you’d don’t specify a filter, all obs will be plotted. If you
define
multiple filters (as in the example I sent) each obs will be plotted
using
the plotting options defined fir the FIRST matching filter.
Make sense?
John
On Wed, Feb 3, 2021 at 6:50 PM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> Hello John,
>
> That is awesome. It seems the function works great with my test.
> One question though: eg, for point UGRD, if we don't set any
"prs_thresh"
> or "hgt_thresh", then all the points with UGRD at EACH layer and
height
> will be plotted on the map, correct?
>
> Thank you.
> Binyu
>
>
> On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > Here's a few GitHub issues which describe recent enhancements to
> > plot_point_obs:
> > https://github.com/dtcenter/MET/issues/1528
> > https://github.com/dtcenter/MET/issues/1052
> > https://github.com/dtcenter/MET/issues/1627
> >
> > All of these changes were made after the met-9.1 release and in
> preparation
> > for the met-10.0.0 release. If you'd like to test them out, I'd
recommend
> > using the met-10.0.0-beta3 release, which is our most recent
development
> > version for met-10.0.0. Please note that this code is only
intended for
> > testing and should not be used operational evaluation.
> >
> > It's already installed on WCOSS, and you can find the details on
this
> page.
> > Just click the "NOAA machines" tab:
> > http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
> >
> > As for an example, here's one we run as part of the unit tests for
MET:
> >
> > export TO_GRID="NONE"
> > plot_point_obs \
> > pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> > plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> > -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> > -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> > -config PlotPointObsConfig \
> > -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> > -v 3
> >
> > Here's a link to the config file, which has all the important
details:
> >
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
> >
> > And please see the updated documentation for this tool:
> >
> >
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
> >
> > Here's the output of the sample command above:
> > [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> > So this plots a gridded base image, and then 3 different types of
point
> > observations.
> >
> > John
> >
> >
> > On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > >
> > > Hello John,
> > >
> > > You are absolutely right. I do NOT want the ensemble mean, and I
want
> the
> > > individual member instead. I do realize that after I sent the
email for
> > > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I
do have
> a
> > > question: last time I did a similar thing using ensemble data. I
had to
> > > extract the WDIR from each member and make a scatter plot (obs.
WIND
> for
> > > x-axis, difference WDIR b/t obs and model for y-axis), which
takes a
> lot
> > of
> > > time. So is it possible that MET could add some function like
that in
> the
> > > future? WDIR is an important factor.
> > >
> > > One more thing: I recall that you have updated the
"plot_point_obs", so
> > it
> > > can make plot for only a certain pressure level now.Which
version has
> the
> > > new function? How to use it?
> > >
> > > Thank you.
> > > Binyu
> > >
> > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Binyu,
> > > >
> > > > I see that you have a question about why you are NOT getting
any
> output
> > > for
> > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS
and
> took
> > a
> > > > look in:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > >
> > > > In there, you're verifying ensemble probability fields, like:
> > > > WIND_Z10_ENS_FREQ_le1
> > > > and
> > > > WIND_P850_ENS_FREQ_le1
> > > >
> > > > So this is the probability of WIND SPEED being less than 1, as
> computed
> > > by
> > > > the Ensemble-Stat tool.
> > > >
> > > > Probability fields are evaluated in MET by the line types
which begin
> > > with
> > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types
> > you'd
> > > > like in the Grid-Stat configuration file, but if you don't
pass data
> > > which
> > > > applies to the corresponding verification logic, then you'll
get
> empty
> > > > output files.
> > > >
> > > > And that's what's going on here.
> > > >
> > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are only
> > > > created when processing the U and V wind components.
> > > >
> > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > CNT)
> > > > only apply to scalar data. That includes wind speed... not the
> > > probability
> > > > of wind speed.
> > > >
> > > > If you define categorical threshold for the scalar data, you
can also
> > get
> > > > categorical statistics line type (FHO, CTC, and CTS).
> > > >
> > > > It looks like your Ensemble-Stat config file already includes
the
> > > ensemble
> > > > mean field in the output:
> > > >
> > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > >
> > > > So just add those to the list of fields to be evaluated by
Grid-Stat.
> > And
> > > > define meaningful categorical thresholds for them:
> > > >
> > > > In fcst...
> > > >
> > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1, gt3,
> > gt5,
> > > > gt10 ]; }
> > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1, gt3,
> > > gt5,
> > > > gt10 ]; }
> > > >
> > > > And then make similar entries in the obs dictionary.
> > > >
> > > > Getting the vector statistics is a little trickier. Can you
confirm
> > that
> > > > you want vector statistics for the ensemble mean... and not
for the
> > > > individual members? Is that correct?
> > > >
> > > > Hope that helps.
> > > >
> > > > Thanks,
> > > > John Halley Gotway
> > > >
> > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: empty output
> > > > > Owner: Nobody
> > > > > Requestors: binyu.wang at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > >
> > > > >
> > > > >
> > > > > Hello,
> > > > >
> > > > > I was trying to verify the WIND profile using HREF vs. NDAS
obs.
> data
> > > > and I
> > > > > can not get the result that I want. Here is the log file:
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > It is weird that the "match is found for P850 and Z10", and
one of
> > the
> > > > > output " grid_stat_href_test_120000L_20210130_000000V.stat"
is not
> > > empty,
> > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > inside
> > > > of
> > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > >
> > > > > Inside of the working directory "
> > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > -v 3 > testlog3
> > > > > There is no any ERROR message, but I just got empty " *vcnt,
> *vl1l2,
> > > > *cnt,
> > > > > *fho" etc.
> > > > >
> > > > > What is the problem here? Thank you.
> > > > > Binyu
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Wed Feb 03 20:40:42 2021
Yes, that makes sense. Thank you.
Binyu
On Wed, Feb 3, 2021 at 9:58 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Correct, only those obs meeting all the filtering criteria will be
plotted.
> So if you’d don’t specify a filter, all obs will be plotted. If you
define
> multiple filters (as in the example I sent) each obs will be plotted
using
> the plotting options defined fir the FIRST matching filter.
>
> Make sense?
>
> John
>
> On Wed, Feb 3, 2021 at 6:50 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello John,
> >
> > That is awesome. It seems the function works great with my test.
> > One question though: eg, for point UGRD, if we don't set any
"prs_thresh"
> > or "hgt_thresh", then all the points with UGRD at EACH layer and
height
> > will be plotted on the map, correct?
> >
> > Thank you.
> > Binyu
> >
> >
> > On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > Here's a few GitHub issues which describe recent enhancements to
> > > plot_point_obs:
> > > https://github.com/dtcenter/MET/issues/1528
> > > https://github.com/dtcenter/MET/issues/1052
> > > https://github.com/dtcenter/MET/issues/1627
> > >
> > > All of these changes were made after the met-9.1 release and in
> > preparation
> > > for the met-10.0.0 release. If you'd like to test them out, I'd
> recommend
> > > using the met-10.0.0-beta3 release, which is our most recent
> development
> > > version for met-10.0.0. Please note that this code is only
intended for
> > > testing and should not be used operational evaluation.
> > >
> > > It's already installed on WCOSS, and you can find the details on
this
> > page.
> > > Just click the "NOAA machines" tab:
> > > http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
> > >
> > > As for an example, here's one we run as part of the unit tests
for MET:
> > >
> > > export TO_GRID="NONE"
> > > plot_point_obs \
> > > pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> > > plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> > > -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> > > -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> > > -config PlotPointObsConfig \
> > > -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> > > -v 3
> > >
> > > Here's a link to the config file, which has all the important
details:
> > >
> >
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
> > >
> > > And please see the updated documentation for this tool:
> > >
> > >
> >
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
> > >
> > > Here's the output of the sample command above:
> > > [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> > > So this plots a gridded base image, and then 3 different types
of point
> > > observations.
> > >
> > > John
> > >
> > >
> > > On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
>
> > > >
> > > > Hello John,
> > > >
> > > > You are absolutely right. I do NOT want the ensemble mean, and
I want
> > the
> > > > individual member instead. I do realize that after I sent the
email
> for
> > > > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I
do
> have
> > a
> > > > question: last time I did a similar thing using ensemble data.
I had
> to
> > > > extract the WDIR from each member and make a scatter plot
(obs. WIND
> > for
> > > > x-axis, difference WDIR b/t obs and model for y-axis), which
takes a
> > lot
> > > of
> > > > time. So is it possible that MET could add some function like
that in
> > the
> > > > future? WDIR is an important factor.
> > > >
> > > > One more thing: I recall that you have updated the
"plot_point_obs",
> so
> > > it
> > > > can make plot for only a certain pressure level now.Which
version has
> > the
> > > > new function? How to use it?
> > > >
> > > > Thank you.
> > > > Binyu
> > > >
> > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Binyu,
> > > > >
> > > > > I see that you have a question about why you are NOT getting
any
> > output
> > > > for
> > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS and
> > took
> > > a
> > > > > look in:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > >
> > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > WIND_Z10_ENS_FREQ_le1
> > > > > and
> > > > > WIND_P850_ENS_FREQ_le1
> > > > >
> > > > > So this is the probability of WIND SPEED being less than 1,
as
> > computed
> > > > by
> > > > > the Ensemble-Stat tool.
> > > > >
> > > > > Probability fields are evaluated in MET by the line types
which
> begin
> > > > with
> > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line types
> > > you'd
> > > > > like in the Grid-Stat configuration file, but if you don't
pass
> data
> > > > which
> > > > > applies to the corresponding verification logic, then you'll
get
> > empty
> > > > > output files.
> > > > >
> > > > > And that's what's going on here.
> > > > >
> > > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are
> only
> > > > > created when processing the U and V wind components.
> > > > >
> > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > > CNT)
> > > > > only apply to scalar data. That includes wind speed... not
the
> > > > probability
> > > > > of wind speed.
> > > > >
> > > > > If you define categorical threshold for the scalar data, you
can
> also
> > > get
> > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > >
> > > > > It looks like your Ensemble-Stat config file already
includes the
> > > > ensemble
> > > > > mean field in the output:
> > > > >
> > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > >
> > > > > So just add those to the list of fields to be evaluated by
> Grid-Stat.
> > > And
> > > > > define meaningful categorical thresholds for them:
> > > > >
> > > > > In fcst...
> > > > >
> > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > gt5,
> > > > > gt10 ]; }
> > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > > gt5,
> > > > > gt10 ]; }
> > > > >
> > > > > And then make similar entries in the obs dictionary.
> > > > >
> > > > > Getting the vector statistics is a little trickier. Can you
confirm
> > > that
> > > > > you want vector statistics for the ensemble mean... and not
for the
> > > > > individual members? Is that correct?
> > > > >
> > > > > Hope that helps.
> > > > >
> > > > > Thanks,
> > > > > John Halley Gotway
> > > > >
> > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: empty output
> > > > > > Owner: Nobody
> > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > >
> > > > > >
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS obs.
> > data
> > > > > and I
> > > > > > can not get the result that I want. Here is the log file:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > It is weird that the "match is found for P850 and Z10",
and one
> of
> > > the
> > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat" is
> not
> > > > empty,
> > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > > inside
> > > > > of
> > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > >
> > > > > > Inside of the working directory "
> > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > -v 3 > testlog3
> > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > *vl1l2,
> > > > > *cnt,
> > > > > > *fho" etc.
> > > > > >
> > > > > > What is the problem here? Thank you.
> > > > > > Binyu
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Thu Feb 04 07:10:38 2021
John,
I guess you are not the best one to answer this question, but just in
case
you happen to know that: I am looking for point obs. WIND data at
upper
layer around Labadie power plant at MO for verification. Do you know
where
to look for this? Thank you.
Binyu
On Wed, Feb 3, 2021 at 9:58 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Correct, only those obs meeting all the filtering criteria will be
plotted.
> So if you’d don’t specify a filter, all obs will be plotted. If you
define
> multiple filters (as in the example I sent) each obs will be plotted
using
> the plotting options defined fir the FIRST matching filter.
>
> Make sense?
>
> John
>
> On Wed, Feb 3, 2021 at 6:50 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello John,
> >
> > That is awesome. It seems the function works great with my test.
> > One question though: eg, for point UGRD, if we don't set any
"prs_thresh"
> > or "hgt_thresh", then all the points with UGRD at EACH layer and
height
> > will be plotted on the map, correct?
> >
> > Thank you.
> > Binyu
> >
> >
> > On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > Here's a few GitHub issues which describe recent enhancements to
> > > plot_point_obs:
> > > https://github.com/dtcenter/MET/issues/1528
> > > https://github.com/dtcenter/MET/issues/1052
> > > https://github.com/dtcenter/MET/issues/1627
> > >
> > > All of these changes were made after the met-9.1 release and in
> > preparation
> > > for the met-10.0.0 release. If you'd like to test them out, I'd
> recommend
> > > using the met-10.0.0-beta3 release, which is our most recent
> development
> > > version for met-10.0.0. Please note that this code is only
intended for
> > > testing and should not be used operational evaluation.
> > >
> > > It's already installed on WCOSS, and you can find the details on
this
> > page.
> > > Just click the "NOAA machines" tab:
> > > http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
> > >
> > > As for an example, here's one we run as part of the unit tests
for MET:
> > >
> > > export TO_GRID="NONE"
> > > plot_point_obs \
> > > pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> > > plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> > > -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> > > -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> > > -config PlotPointObsConfig \
> > > -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> > > -v 3
> > >
> > > Here's a link to the config file, which has all the important
details:
> > >
> >
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
> > >
> > > And please see the updated documentation for this tool:
> > >
> > >
> >
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
> > >
> > > Here's the output of the sample command above:
> > > [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> > > So this plots a gridded base image, and then 3 different types
of point
> > > observations.
> > >
> > > John
> > >
> > >
> > > On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
>
> > > >
> > > > Hello John,
> > > >
> > > > You are absolutely right. I do NOT want the ensemble mean, and
I want
> > the
> > > > individual member instead. I do realize that after I sent the
email
> for
> > > > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I
do
> have
> > a
> > > > question: last time I did a similar thing using ensemble data.
I had
> to
> > > > extract the WDIR from each member and make a scatter plot
(obs. WIND
> > for
> > > > x-axis, difference WDIR b/t obs and model for y-axis), which
takes a
> > lot
> > > of
> > > > time. So is it possible that MET could add some function like
that in
> > the
> > > > future? WDIR is an important factor.
> > > >
> > > > One more thing: I recall that you have updated the
"plot_point_obs",
> so
> > > it
> > > > can make plot for only a certain pressure level now.Which
version has
> > the
> > > > new function? How to use it?
> > > >
> > > > Thank you.
> > > > Binyu
> > > >
> > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Binyu,
> > > > >
> > > > > I see that you have a question about why you are NOT getting
any
> > output
> > > > for
> > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS and
> > took
> > > a
> > > > > look in:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > >
> > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > WIND_Z10_ENS_FREQ_le1
> > > > > and
> > > > > WIND_P850_ENS_FREQ_le1
> > > > >
> > > > > So this is the probability of WIND SPEED being less than 1,
as
> > computed
> > > > by
> > > > > the Ensemble-Stat tool.
> > > > >
> > > > > Probability fields are evaluated in MET by the line types
which
> begin
> > > > with
> > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line types
> > > you'd
> > > > > like in the Grid-Stat configuration file, but if you don't
pass
> data
> > > > which
> > > > > applies to the corresponding verification logic, then you'll
get
> > empty
> > > > > output files.
> > > > >
> > > > > And that's what's going on here.
> > > > >
> > > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are
> only
> > > > > created when processing the U and V wind components.
> > > > >
> > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > > CNT)
> > > > > only apply to scalar data. That includes wind speed... not
the
> > > > probability
> > > > > of wind speed.
> > > > >
> > > > > If you define categorical threshold for the scalar data, you
can
> also
> > > get
> > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > >
> > > > > It looks like your Ensemble-Stat config file already
includes the
> > > > ensemble
> > > > > mean field in the output:
> > > > >
> > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > >
> > > > > So just add those to the list of fields to be evaluated by
> Grid-Stat.
> > > And
> > > > > define meaningful categorical thresholds for them:
> > > > >
> > > > > In fcst...
> > > > >
> > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > gt5,
> > > > > gt10 ]; }
> > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > > gt5,
> > > > > gt10 ]; }
> > > > >
> > > > > And then make similar entries in the obs dictionary.
> > > > >
> > > > > Getting the vector statistics is a little trickier. Can you
confirm
> > > that
> > > > > you want vector statistics for the ensemble mean... and not
for the
> > > > > individual members? Is that correct?
> > > > >
> > > > > Hope that helps.
> > > > >
> > > > > Thanks,
> > > > > John Halley Gotway
> > > > >
> > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: empty output
> > > > > > Owner: Nobody
> > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > >
> > > > > >
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS obs.
> > data
> > > > > and I
> > > > > > can not get the result that I want. Here is the log file:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > It is weird that the "match is found for P850 and Z10",
and one
> of
> > > the
> > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat" is
> not
> > > > empty,
> > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > > inside
> > > > > of
> > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > >
> > > > > > Inside of the working directory "
> > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > -v 3 > testlog3
> > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > *vl1l2,
> > > > > *cnt,
> > > > > > *fho" etc.
> > > > > >
> > > > > > What is the problem here? Thank you.
> > > > > > Binyu
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Thu Feb 04 10:50:28 2021
John, I still have a question for my WDIR verification even I did get
some
results:
Looking at the output file (*vcnt and *vl1l2), why are the six lines
all
the same? Should each line give the stat. for different
"cat_thresh"? It
looks like it treats all the data as one. If so, why are there so many
lines then?
The log file:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
The working dir:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
The output file (*vcnt):
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
The config file:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
Thank you
Binyu
On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Binyu,
>
> I see that you have a question about why you are NOT getting any
output for
> the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS and
took a
> look in:
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
>
> In there, you're verifying ensemble probability fields, like:
> WIND_Z10_ENS_FREQ_le1
> and
> WIND_P850_ENS_FREQ_le1
>
> So this is the probability of WIND SPEED being less than 1, as
computed by
> the Ensemble-Stat tool.
>
> Probability fields are evaluated in MET by the line types which
begin with
> 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line types
you'd
> like in the Grid-Stat configuration file, but if you don't pass data
which
> applies to the corresponding verification logic, then you'll get
empty
> output files.
>
> And that's what's going on here.
>
> Specifically, the vector line types, VL1L2, VAL1L2, and VCT are only
> created when processing the U and V wind components.
>
> And the scalar continuous statistics line types (SL1L2, SAL1L2, and
CNT)
> only apply to scalar data. That includes wind speed... not the
probability
> of wind speed.
>
> If you define categorical threshold for the scalar data, you can
also get
> categorical statistics line type (FHO, CTC, and CTS).
>
> It looks like your Ensemble-Stat config file already includes the
ensemble
> mean field in the output:
>
> ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> float WIND_Z10_ENS_MEAN(lat, lon) ;
> float WIND_P850_ENS_MEAN(lat, lon) ;
>
> So just add those to the list of fields to be evaluated by Grid-
Stat. And
> define meaningful categorical thresholds for them:
>
> In fcst...
>
> { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1, gt3,
gt5,
> gt10 ]; }
> { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3, gt5,
> gt10 ]; }
>
> And then make similar entries in the obs dictionary.
>
> Getting the vector statistics is a little trickier. Can you confirm
that
> you want vector statistics for the ensemble mean... and not for the
> individual members? Is that correct?
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
> On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > Transaction: Ticket created by binyu.wang at noaa.gov
> > Queue: met_help
> > Subject: empty output
> > Owner: Nobody
> > Requestors: binyu.wang at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> >
> > Hello,
> >
> > I was trying to verify the WIND profile using HREF vs. NDAS obs.
data
> and I
> > can not get the result that I want. Here is the log file:
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > It is weird that the "match is found for P850 and Z10", and one
of the
> > output " grid_stat_href_test_120000L_20210130_000000V.stat" is not
empty,
> > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty
inside
> of
> > the working directory "verf_g2g_hrefv3_00_dev.164719".
> >
> > Inside of the working directory "
> > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > verf_g2g_hrefv3_00_dev.164719", I tried
> > $ grid_stat ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > -v 3 > testlog3
> > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> *cnt,
> > *fho" etc.
> >
> > What is the problem here? Thank you.
> > Binyu
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Thu Feb 04 15:48:06 2021
Binyu,
Unfortunately, I don't have any great suggestions with regards to the
point
observation data you're looking for.
I can say that we've started keep track of useful datasets for
verification
in a METplus "Verification Datasets" guide:
https://dtcenter.github.io/METplus/develop/Verification_Datasets/index.html
The idea is, as we add new METplus use cases, document details about
the
datasets used in those use cases. And collect that information all in
one
place.
But this is brand new, and currently only has entries for 15 datasets.
I'll take a look at your next question and reply in a separate email.
John
On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> John, I still have a question for my WDIR verification even I did
get some
> results:
>
> Looking at the output file (*vcnt and *vl1l2), why are the six lines
all
> the same? Should each line give the stat. for different
"cat_thresh"? It
> looks like it treats all the data as one. If so, why are there so
many
> lines then?
>
> The log file:
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> The working dir:
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> The output file (*vcnt):
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> The config file:
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
>
> Thank you
> Binyu
>
> On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Binyu,
> >
> > I see that you have a question about why you are NOT getting any
output
> for
> > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS and
took a
> > look in:
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> >
> > In there, you're verifying ensemble probability fields, like:
> > WIND_Z10_ENS_FREQ_le1
> > and
> > WIND_P850_ENS_FREQ_le1
> >
> > So this is the probability of WIND SPEED being less than 1, as
computed
> by
> > the Ensemble-Stat tool.
> >
> > Probability fields are evaluated in MET by the line types which
begin
> with
> > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types you'd
> > like in the Grid-Stat configuration file, but if you don't pass
data
> which
> > applies to the corresponding verification logic, then you'll get
empty
> > output files.
> >
> > And that's what's going on here.
> >
> > Specifically, the vector line types, VL1L2, VAL1L2, and VCT are
only
> > created when processing the U and V wind components.
> >
> > And the scalar continuous statistics line types (SL1L2, SAL1L2,
and CNT)
> > only apply to scalar data. That includes wind speed... not the
> probability
> > of wind speed.
> >
> > If you define categorical threshold for the scalar data, you can
also get
> > categorical statistics line type (FHO, CTC, and CTS).
> >
> > It looks like your Ensemble-Stat config file already includes the
> ensemble
> > mean field in the output:
> >
> > ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > float WIND_P850_ENS_MEAN(lat, lon) ;
> >
> > So just add those to the list of fields to be evaluated by Grid-
Stat. And
> > define meaningful categorical thresholds for them:
> >
> > In fcst...
> >
> > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3, gt5,
> > gt10 ]; }
> > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> gt5,
> > gt10 ]; }
> >
> > And then make similar entries in the obs dictionary.
> >
> > Getting the vector statistics is a little trickier. Can you
confirm that
> > you want vector statistics for the ensemble mean... and not for
the
> > individual members? Is that correct?
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > Queue: met_help
> > > Subject: empty output
> > > Owner: Nobody
> > > Requestors: binyu.wang at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> >
> > >
> > >
> > > Hello,
> > >
> > > I was trying to verify the WIND profile using HREF vs. NDAS obs.
data
> > and I
> > > can not get the result that I want. Here is the log file:
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > It is weird that the "match is found for P850 and Z10", and one
of the
> > > output " grid_stat_href_test_120000L_20210130_000000V.stat" is
not
> empty,
> > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty
inside
> > of
> > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > >
> > > Inside of the working directory "
> > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > -v 3 > testlog3
> > > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> > *cnt,
> > > *fho" etc.
> > >
> > > What is the problem here? Thank you.
> > > Binyu
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Thu Feb 04 16:10:01 2021
Binyu,
Thanks for sending the details for the location of your log files, run
script, config file, and output on Luna. That makes it a lot easier to
debug.
So looking in your output file
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
you are wondering why all 6 lines contain the exact same output.
I took a look in that file and see what you describe. This is
happening
because you have the same field listed 6 times... each with 1
cat_thresh
setting. Instead, I'd recommend that you list each field once, with 6
different cat_thresh settings. But note that for the VCNT output,
filtering
the U/V pairs is NOT done with the cat_thresh... it's done using the
wind_thresh instead.
To avoid confusion, I downloaded your config file, modified it, and
attached an updated version to this email for you to try.
Let me know if you have any questions about the changes I made.
This is a little confusing... wind_thresh can be defined in both the
fcst
and obs dictionaries. wind_logic defines how you combine those to
decide
whether or not to include the point. I set it up as..
In fcst, set wind_thresh = real thresholds.
In obs, set wind_thresh = NA... which always evaluates to true.
Set wind_logic to INTERSECTION... so basically we're filtering the
fcst/obs
U/V pairs based on the FORECAST wind speed. You could of course switch
that
to filter based on the observation wind speed.
Search for "wind_thresh" on this page to see more details:
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
Thanks,
John
On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> John, I still have a question for my WDIR verification even I did
get some
> results:
>
> Looking at the output file (*vcnt and *vl1l2), why are the six lines
all
> the same? Should each line give the stat. for different
"cat_thresh"? It
> looks like it treats all the data as one. If so, why are there so
many
> lines then?
>
> The log file:
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> The working dir:
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> The output file (*vcnt):
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> The config file:
>
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
>
> Thank you
> Binyu
>
> On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Binyu,
> >
> > I see that you have a question about why you are NOT getting any
output
> for
> > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS and
took a
> > look in:
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> >
> > In there, you're verifying ensemble probability fields, like:
> > WIND_Z10_ENS_FREQ_le1
> > and
> > WIND_P850_ENS_FREQ_le1
> >
> > So this is the probability of WIND SPEED being less than 1, as
computed
> by
> > the Ensemble-Stat tool.
> >
> > Probability fields are evaluated in MET by the line types which
begin
> with
> > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types you'd
> > like in the Grid-Stat configuration file, but if you don't pass
data
> which
> > applies to the corresponding verification logic, then you'll get
empty
> > output files.
> >
> > And that's what's going on here.
> >
> > Specifically, the vector line types, VL1L2, VAL1L2, and VCT are
only
> > created when processing the U and V wind components.
> >
> > And the scalar continuous statistics line types (SL1L2, SAL1L2,
and CNT)
> > only apply to scalar data. That includes wind speed... not the
> probability
> > of wind speed.
> >
> > If you define categorical threshold for the scalar data, you can
also get
> > categorical statistics line type (FHO, CTC, and CTS).
> >
> > It looks like your Ensemble-Stat config file already includes the
> ensemble
> > mean field in the output:
> >
> > ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > float WIND_P850_ENS_MEAN(lat, lon) ;
> >
> > So just add those to the list of fields to be evaluated by Grid-
Stat. And
> > define meaningful categorical thresholds for them:
> >
> > In fcst...
> >
> > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3, gt5,
> > gt10 ]; }
> > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> gt5,
> > gt10 ]; }
> >
> > And then make similar entries in the obs dictionary.
> >
> > Getting the vector statistics is a little trickier. Can you
confirm that
> > you want vector statistics for the ensemble mean... and not for
the
> > individual members? Is that correct?
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > Queue: met_help
> > > Subject: empty output
> > > Owner: Nobody
> > > Requestors: binyu.wang at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> >
> > >
> > >
> > > Hello,
> > >
> > > I was trying to verify the WIND profile using HREF vs. NDAS obs.
data
> > and I
> > > can not get the result that I want. Here is the log file:
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > It is weird that the "match is found for P850 and Z10", and one
of the
> > > output " grid_stat_href_test_120000L_20210130_000000V.stat" is
not
> empty,
> > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all empty
inside
> > of
> > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > >
> > > Inside of the working directory "
> > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > -v 3 > testlog3
> > > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> > *cnt,
> > > *fho" etc.
> > >
> > > What is the problem here? Thank you.
> > > Binyu
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Thu Feb 04 21:09:09 2021
Hello John,
Thank you for the detailed explanation. That helps a lot. Looking at
your
config file below, I do have a question:
As you said, "or the VCNT output, filtering the U/V pairs is NOT done
with
the cat_thresh... it's done using the wind_thresh instead.", why do we
still need to use " cat_thresh = my_thr_list"? Is that for UGRD and
VGRD?
Why don't we need "cat_logic"?
fcst = {
cat_thresh = my_thr_list;
wind_thresh = my_thr_list;
wind_logic = INTERSECTION;
field = [
{ name = "WIND"; level = "P925"; },
I appreciate your help a lot. Even the information is in the document,
but
I always tend to overlook that without your pointing out.
Binyu
On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> Thanks for sending the details for the location of your log files,
run
> script, config file, and output on Luna. That makes it a lot easier
to
> debug.
>
> So looking in your output file
>
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> you are wondering why all 6 lines contain the exact same output.
>
> I took a look in that file and see what you describe. This is
happening
> because you have the same field listed 6 times... each with 1
cat_thresh
> setting. Instead, I'd recommend that you list each field once, with
6
> different cat_thresh settings. But note that for the VCNT output,
filtering
> the U/V pairs is NOT done with the cat_thresh... it's done using the
> wind_thresh instead.
>
> To avoid confusion, I downloaded your config file, modified it, and
> attached an updated version to this email for you to try.
>
> Let me know if you have any questions about the changes I made.
>
> This is a little confusing... wind_thresh can be defined in both the
fcst
> and obs dictionaries. wind_logic defines how you combine those to
decide
> whether or not to include the point. I set it up as..
> In fcst, set wind_thresh = real thresholds.
> In obs, set wind_thresh = NA... which always evaluates to true.
> Set wind_logic to INTERSECTION... so basically we're filtering the
fcst/obs
> U/V pairs based on the FORECAST wind speed. You could of course
switch that
> to filter based on the observation wind speed.
>
> Search for "wind_thresh" on this page to see more details:
> https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
>
> Thanks,
> John
>
> On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > John, I still have a question for my WDIR verification even I did
get
> some
> > results:
> >
> > Looking at the output file (*vcnt and *vl1l2), why are the six
lines all
> > the same? Should each line give the stat. for different
"cat_thresh"?
> It
> > looks like it treats all the data as one. If so, why are there so
many
> > lines then?
> >
> > The log file:
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > The working dir:
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > The output file (*vcnt):
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > The config file:
> >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> >
> > Thank you
> > Binyu
> >
> > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binyu,
> > >
> > > I see that you have a question about why you are NOT getting any
output
> > for
> > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS
and took
> a
> > > look in:
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > >
> > > In there, you're verifying ensemble probability fields, like:
> > > WIND_Z10_ENS_FREQ_le1
> > > and
> > > WIND_P850_ENS_FREQ_le1
> > >
> > > So this is the probability of WIND SPEED being less than 1, as
computed
> > by
> > > the Ensemble-Stat tool.
> > >
> > > Probability fields are evaluated in MET by the line types which
begin
> > with
> > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types
> you'd
> > > like in the Grid-Stat configuration file, but if you don't pass
data
> > which
> > > applies to the corresponding verification logic, then you'll get
empty
> > > output files.
> > >
> > > And that's what's going on here.
> > >
> > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT are
only
> > > created when processing the U and V wind components.
> > >
> > > And the scalar continuous statistics line types (SL1L2, SAL1L2,
and
> CNT)
> > > only apply to scalar data. That includes wind speed... not the
> > probability
> > > of wind speed.
> > >
> > > If you define categorical threshold for the scalar data, you can
also
> get
> > > categorical statistics line type (FHO, CTC, and CTS).
> > >
> > > It looks like your Ensemble-Stat config file already includes
the
> > ensemble
> > > mean field in the output:
> > >
> > > ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > >
> > > So just add those to the list of fields to be evaluated by Grid-
Stat.
> And
> > > define meaningful categorical thresholds for them:
> > >
> > > In fcst...
> > >
> > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> gt5,
> > > gt10 ]; }
> > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> > gt5,
> > > gt10 ]; }
> > >
> > > And then make similar entries in the obs dictionary.
> > >
> > > Getting the vector statistics is a little trickier. Can you
confirm
> that
> > > you want vector statistics for the ensemble mean... and not for
the
> > > individual members? Is that correct?
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > Queue: met_help
> > > > Subject: empty output
> > > > Owner: Nobody
> > > > Requestors: binyu.wang at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > >
> > > >
> > > >
> > > > Hello,
> > > >
> > > > I was trying to verify the WIND profile using HREF vs. NDAS
obs. data
> > > and I
> > > > can not get the result that I want. Here is the log file:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > It is weird that the "match is found for P850 and Z10", and
one of
> the
> > > > output " grid_stat_href_test_120000L_20210130_000000V.stat" is
not
> > empty,
> > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> inside
> > > of
> > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > >
> > > > Inside of the working directory "
> > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > -v 3 > testlog3
> > > > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> > > *cnt,
> > > > *fho" etc.
> > > >
> > > > What is the problem here? Thank you.
> > > > Binyu
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Fri Feb 05 06:58:23 2021
Binyu,
The WIND variable is wind speed which is just a scalar field of
numbers,
and not a vector. That can be verified using categorical counts and
statistics, i.e. the CTC or FHO and CTS line types. And cat_thresh
defines
the threshold for those line types.
But I don’t recall actually checking the output_flag to see if you’re
requesting those line types. If so, that’s where you’ll see that
cat_thresh
setting used.
John
On Thu, Feb 4, 2021 at 9:09 PM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> Hello John,
>
> Thank you for the detailed explanation. That helps a lot. Looking at
your
> config file below, I do have a question:
>
> As you said, "or the VCNT output, filtering the U/V pairs is NOT
done with
> the cat_thresh... it's done using the wind_thresh instead.", why do
we
> still need to use " cat_thresh = my_thr_list"? Is that for UGRD
and VGRD?
> Why don't we need "cat_logic"?
>
> fcst = {
>
> cat_thresh = my_thr_list;
> wind_thresh = my_thr_list;
> wind_logic = INTERSECTION;
>
> field = [
> { name = "WIND"; level = "P925"; },
>
> I appreciate your help a lot. Even the information is in the
document, but
> I always tend to overlook that without your pointing out.
>
> Binyu
>
> On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > Thanks for sending the details for the location of your log files,
run
> > script, config file, and output on Luna. That makes it a lot
easier to
> > debug.
> >
> > So looking in your output file
> >
> >
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> > you are wondering why all 6 lines contain the exact same output.
> >
> > I took a look in that file and see what you describe. This is
happening
> > because you have the same field listed 6 times... each with 1
cat_thresh
> > setting. Instead, I'd recommend that you list each field once,
with 6
> > different cat_thresh settings. But note that for the VCNT output,
> filtering
> > the U/V pairs is NOT done with the cat_thresh... it's done using
the
> > wind_thresh instead.
> >
> > To avoid confusion, I downloaded your config file, modified it,
and
> > attached an updated version to this email for you to try.
> >
> > Let me know if you have any questions about the changes I made.
> >
> > This is a little confusing... wind_thresh can be defined in both
the fcst
> > and obs dictionaries. wind_logic defines how you combine those to
decide
> > whether or not to include the point. I set it up as..
> > In fcst, set wind_thresh = real thresholds.
> > In obs, set wind_thresh = NA... which always evaluates to true.
> > Set wind_logic to INTERSECTION... so basically we're filtering the
> fcst/obs
> > U/V pairs based on the FORECAST wind speed. You could of course
switch
> that
> > to filter based on the observation wind speed.
> >
> > Search for "wind_thresh" on this page to see more details:
> > https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
> >
> > Thanks,
> > John
> >
> > On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > >
> > > John, I still have a question for my WDIR verification even I
did get
> > some
> > > results:
> > >
> > > Looking at the output file (*vcnt and *vl1l2), why are the six
lines
> all
> > > the same? Should each line give the stat. for different
"cat_thresh"?
> > It
> > > looks like it treats all the data as one. If so, why are there
so many
> > > lines then?
> > >
> > > The log file:
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > > The working dir:
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > > The output file (*vcnt):
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > > The config file:
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> > >
> > > Thank you
> > > Binyu
> > >
> > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Binyu,
> > > >
> > > > I see that you have a question about why you are NOT getting
any
> output
> > > for
> > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS
and
> took
> > a
> > > > look in:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > >
> > > > In there, you're verifying ensemble probability fields, like:
> > > > WIND_Z10_ENS_FREQ_le1
> > > > and
> > > > WIND_P850_ENS_FREQ_le1
> > > >
> > > > So this is the probability of WIND SPEED being less than 1, as
> computed
> > > by
> > > > the Ensemble-Stat tool.
> > > >
> > > > Probability fields are evaluated in MET by the line types
which begin
> > > with
> > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types
> > you'd
> > > > like in the Grid-Stat configuration file, but if you don't
pass data
> > > which
> > > > applies to the corresponding verification logic, then you'll
get
> empty
> > > > output files.
> > > >
> > > > And that's what's going on here.
> > > >
> > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are only
> > > > created when processing the U and V wind components.
> > > >
> > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > CNT)
> > > > only apply to scalar data. That includes wind speed... not the
> > > probability
> > > > of wind speed.
> > > >
> > > > If you define categorical threshold for the scalar data, you
can also
> > get
> > > > categorical statistics line type (FHO, CTC, and CTS).
> > > >
> > > > It looks like your Ensemble-Stat config file already includes
the
> > > ensemble
> > > > mean field in the output:
> > > >
> > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > >
> > > > So just add those to the list of fields to be evaluated by
Grid-Stat.
> > And
> > > > define meaningful categorical thresholds for them:
> > > >
> > > > In fcst...
> > > >
> > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1, gt3,
> > gt5,
> > > > gt10 ]; }
> > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1, gt3,
> > > gt5,
> > > > gt10 ]; }
> > > >
> > > > And then make similar entries in the obs dictionary.
> > > >
> > > > Getting the vector statistics is a little trickier. Can you
confirm
> > that
> > > > you want vector statistics for the ensemble mean... and not
for the
> > > > individual members? Is that correct?
> > > >
> > > > Hope that helps.
> > > >
> > > > Thanks,
> > > > John Halley Gotway
> > > >
> > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: empty output
> > > > > Owner: Nobody
> > > > > Requestors: binyu.wang at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > >
> > > > >
> > > > >
> > > > > Hello,
> > > > >
> > > > > I was trying to verify the WIND profile using HREF vs. NDAS
obs.
> data
> > > > and I
> > > > > can not get the result that I want. Here is the log file:
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > It is weird that the "match is found for P850 and Z10", and
one of
> > the
> > > > > output " grid_stat_href_test_120000L_20210130_000000V.stat"
is not
> > > empty,
> > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > inside
> > > > of
> > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > >
> > > > > Inside of the working directory "
> > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > -v 3 > testlog3
> > > > > There is no any ERROR message, but I just got empty " *vcnt,
> *vl1l2,
> > > > *cnt,
> > > > > *fho" etc.
> > > > >
> > > > > What is the problem here? Thank you.
> > > > > Binyu
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Fri Feb 05 07:40:26 2021
Hello John,
Using the new config file, I got error as below:
1.418 + grid_stat href.ens03.t18z.grid227.f06.grib2
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210201/ndas.t00z.grid227.f00.grib2
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.131675/verf_g2g_grid_stat_href_config_ndas
-outdir out/grid_stat.href03 -v 3
DEBUG 1: Default Config File:
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.131675/verf_g2g_grid_stat_href_config_ndas
ERROR :
ERROR : GridStatConfInfo::process_config() -> The number of
verification
tasks in "obs.field" (1) must be non-zero and match the number in
"fcst.field" (3).
ERROR :
My log file:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52587155
My working dir:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.131675
Config file:
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.131675/verf_g2g_grid_stat_href_config_ndas
I tried to switch "wind_thresh = na_thr_list;" from obs. to forecast,
and
got the same error.
How to fix that? Thank you.
Binyu
On Fri, Feb 5, 2021 at 8:58 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> The WIND variable is wind speed which is just a scalar field of
numbers,
> and not a vector. That can be verified using categorical counts and
> statistics, i.e. the CTC or FHO and CTS line types. And cat_thresh
defines
> the threshold for those line types.
>
> But I don’t recall actually checking the output_flag to see if
you’re
> requesting those line types. If so, that’s where you’ll see that
cat_thresh
> setting used.
>
> John
>
> On Thu, Feb 4, 2021 at 9:09 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello John,
> >
> > Thank you for the detailed explanation. That helps a lot. Looking
at your
> > config file below, I do have a question:
> >
> > As you said, "or the VCNT output, filtering the U/V pairs is NOT
done
> with
> > the cat_thresh... it's done using the wind_thresh instead.", why
do we
> > still need to use " cat_thresh = my_thr_list"? Is that for UGRD
and
> VGRD?
> > Why don't we need "cat_logic"?
> >
> > fcst = {
> >
> > cat_thresh = my_thr_list;
> > wind_thresh = my_thr_list;
> > wind_logic = INTERSECTION;
> >
> > field = [
> > { name = "WIND"; level = "P925"; },
> >
> > I appreciate your help a lot. Even the information is in the
document,
> but
> > I always tend to overlook that without your pointing out.
> >
> > Binyu
> >
> > On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > Thanks for sending the details for the location of your log
files, run
> > > script, config file, and output on Luna. That makes it a lot
easier to
> > > debug.
> > >
> > > So looking in your output file
> > >
> > >
> >
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> > > you are wondering why all 6 lines contain the exact same output.
> > >
> > > I took a look in that file and see what you describe. This is
happening
> > > because you have the same field listed 6 times... each with 1
> cat_thresh
> > > setting. Instead, I'd recommend that you list each field once,
with 6
> > > different cat_thresh settings. But note that for the VCNT
output,
> > filtering
> > > the U/V pairs is NOT done with the cat_thresh... it's done using
the
> > > wind_thresh instead.
> > >
> > > To avoid confusion, I downloaded your config file, modified it,
and
> > > attached an updated version to this email for you to try.
> > >
> > > Let me know if you have any questions about the changes I made.
> > >
> > > This is a little confusing... wind_thresh can be defined in both
the
> fcst
> > > and obs dictionaries. wind_logic defines how you combine those
to
> decide
> > > whether or not to include the point. I set it up as..
> > > In fcst, set wind_thresh = real thresholds.
> > > In obs, set wind_thresh = NA... which always evaluates to true.
> > > Set wind_logic to INTERSECTION... so basically we're filtering
the
> > fcst/obs
> > > U/V pairs based on the FORECAST wind speed. You could of course
switch
> > that
> > > to filter based on the observation wind speed.
> > >
> > > Search for "wind_thresh" on this page to see more details:
> > > https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
>
> > > >
> > > > John, I still have a question for my WDIR verification even I
did get
> > > some
> > > > results:
> > > >
> > > > Looking at the output file (*vcnt and *vl1l2), why are the six
lines
> > all
> > > > the same? Should each line give the stat. for different
> "cat_thresh"?
> > > It
> > > > looks like it treats all the data as one. If so, why are there
so
> many
> > > > lines then?
> > > >
> > > > The log file:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > > > The working dir:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > > > The output file (*vcnt):
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > > > The config file:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> > > >
> > > > Thank you
> > > > Binyu
> > > >
> > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Binyu,
> > > > >
> > > > > I see that you have a question about why you are NOT getting
any
> > output
> > > > for
> > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS and
> > took
> > > a
> > > > > look in:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > >
> > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > WIND_Z10_ENS_FREQ_le1
> > > > > and
> > > > > WIND_P850_ENS_FREQ_le1
> > > > >
> > > > > So this is the probability of WIND SPEED being less than 1,
as
> > computed
> > > > by
> > > > > the Ensemble-Stat tool.
> > > > >
> > > > > Probability fields are evaluated in MET by the line types
which
> begin
> > > > with
> > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line types
> > > you'd
> > > > > like in the Grid-Stat configuration file, but if you don't
pass
> data
> > > > which
> > > > > applies to the corresponding verification logic, then you'll
get
> > empty
> > > > > output files.
> > > > >
> > > > > And that's what's going on here.
> > > > >
> > > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are
> only
> > > > > created when processing the U and V wind components.
> > > > >
> > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > > CNT)
> > > > > only apply to scalar data. That includes wind speed... not
the
> > > > probability
> > > > > of wind speed.
> > > > >
> > > > > If you define categorical threshold for the scalar data, you
can
> also
> > > get
> > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > >
> > > > > It looks like your Ensemble-Stat config file already
includes the
> > > > ensemble
> > > > > mean field in the output:
> > > > >
> > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > >
> > > > > So just add those to the list of fields to be evaluated by
> Grid-Stat.
> > > And
> > > > > define meaningful categorical thresholds for them:
> > > > >
> > > > > In fcst...
> > > > >
> > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > gt5,
> > > > > gt10 ]; }
> > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > > gt5,
> > > > > gt10 ]; }
> > > > >
> > > > > And then make similar entries in the obs dictionary.
> > > > >
> > > > > Getting the vector statistics is a little trickier. Can you
confirm
> > > that
> > > > > you want vector statistics for the ensemble mean... and not
for the
> > > > > individual members? Is that correct?
> > > > >
> > > > > Hope that helps.
> > > > >
> > > > > Thanks,
> > > > > John Halley Gotway
> > > > >
> > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: empty output
> > > > > > Owner: Nobody
> > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > >
> > > > > >
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS obs.
> > data
> > > > > and I
> > > > > > can not get the result that I want. Here is the log file:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > It is weird that the "match is found for P850 and Z10",
and one
> of
> > > the
> > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat" is
> not
> > > > empty,
> > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > > inside
> > > > > of
> > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > >
> > > > > > Inside of the working directory "
> > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > -v 3 > testlog3
> > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > *vl1l2,
> > > > > *cnt,
> > > > > > *fho" etc.
> > > > > >
> > > > > > What is the problem here? Thank you.
> > > > > > Binyu
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Fri Feb 05 08:50:31 2021
So the line type is decided by the threshold that is set, e.g: to set
up the threshold for WIND, we must use wind_thresh. "wind_thresh" is
for "
VL1V2 " and "VCNT", "cat_thresh" is for "CTC or FHO and CTS".
You mentioned that "WIND variable is wind speed which is just a
scalar
field of numbers, and not a vector. That can be verified using
categorical
counts and statistics". But are "UGRD" and "VGRD" vectors?
Reading the MET document about "cat_thresh" and "cnt_thresh" (see
below),
it seems to me all the verification (metrology or air quality field)
should
be verified with "cat_thresh" (except wind direction), can you give
an
example of using "cnt_thresh"? Thank you.
- The "cat_thresh" entry is an array of thresholds to be used when
// computing categorical statistics.
//
// - The "cnt_thresh" entry is an array of thresholds for
filtering
// data prior to computing continuous statistics and partial
sums.
Binyu
On Fri, Feb 5, 2021 at 8:58 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> The WIND variable is wind speed which is just a scalar field of
numbers,
> and not a vector. That can be verified using categorical counts and
> statistics, i.e. the CTC or FHO and CTS line types. And cat_thresh
defines
> the threshold for those line types.
>
> But I don’t recall actually checking the output_flag to see if
you’re
> requesting those line types. If so, that’s where you’ll see that
cat_thresh
> setting used.
>
> John
>
> On Thu, Feb 4, 2021 at 9:09 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello John,
> >
> > Thank you for the detailed explanation. That helps a lot. Looking
at your
> > config file below, I do have a question:
> >
> > As you said, "or the VCNT output, filtering the U/V pairs is NOT
done
> with
> > the cat_thresh... it's done using the wind_thresh instead.", why
do we
> > still need to use " cat_thresh = my_thr_list"? Is that for UGRD
and
> VGRD?
> > Why don't we need "cat_logic"?
> >
> > fcst = {
> >
> > cat_thresh = my_thr_list;
> > wind_thresh = my_thr_list;
> > wind_logic = INTERSECTION;
> >
> > field = [
> > { name = "WIND"; level = "P925"; },
> >
> > I appreciate your help a lot. Even the information is in the
document,
> but
> > I always tend to overlook that without your pointing out.
> >
> > Binyu
> >
> > On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > Thanks for sending the details for the location of your log
files, run
> > > script, config file, and output on Luna. That makes it a lot
easier to
> > > debug.
> > >
> > > So looking in your output file
> > >
> > >
> >
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> > > you are wondering why all 6 lines contain the exact same output.
> > >
> > > I took a look in that file and see what you describe. This is
happening
> > > because you have the same field listed 6 times... each with 1
> cat_thresh
> > > setting. Instead, I'd recommend that you list each field once,
with 6
> > > different cat_thresh settings. But note that for the VCNT
output,
> > filtering
> > > the U/V pairs is NOT done with the cat_thresh... it's done using
the
> > > wind_thresh instead.
> > >
> > > To avoid confusion, I downloaded your config file, modified it,
and
> > > attached an updated version to this email for you to try.
> > >
> > > Let me know if you have any questions about the changes I made.
> > >
> > > This is a little confusing... wind_thresh can be defined in both
the
> fcst
> > > and obs dictionaries. wind_logic defines how you combine those
to
> decide
> > > whether or not to include the point. I set it up as..
> > > In fcst, set wind_thresh = real thresholds.
> > > In obs, set wind_thresh = NA... which always evaluates to true.
> > > Set wind_logic to INTERSECTION... so basically we're filtering
the
> > fcst/obs
> > > U/V pairs based on the FORECAST wind speed. You could of course
switch
> > that
> > > to filter based on the observation wind speed.
> > >
> > > Search for "wind_thresh" on this page to see more details:
> > > https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
> > >
> > > Thanks,
> > > John
> > >
> > > On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
>
> > > >
> > > > John, I still have a question for my WDIR verification even I
did get
> > > some
> > > > results:
> > > >
> > > > Looking at the output file (*vcnt and *vl1l2), why are the six
lines
> > all
> > > > the same? Should each line give the stat. for different
> "cat_thresh"?
> > > It
> > > > looks like it treats all the data as one. If so, why are there
so
> many
> > > > lines then?
> > > >
> > > > The log file:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > > > The working dir:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > > > The output file (*vcnt):
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > > > The config file:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> > > >
> > > > Thank you
> > > > Binyu
> > > >
> > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Binyu,
> > > > >
> > > > > I see that you have a question about why you are NOT getting
any
> > output
> > > > for
> > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS and
> > took
> > > a
> > > > > look in:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > >
> > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > WIND_Z10_ENS_FREQ_le1
> > > > > and
> > > > > WIND_P850_ENS_FREQ_le1
> > > > >
> > > > > So this is the probability of WIND SPEED being less than 1,
as
> > computed
> > > > by
> > > > > the Ensemble-Stat tool.
> > > > >
> > > > > Probability fields are evaluated in MET by the line types
which
> begin
> > > > with
> > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line types
> > > you'd
> > > > > like in the Grid-Stat configuration file, but if you don't
pass
> data
> > > > which
> > > > > applies to the corresponding verification logic, then you'll
get
> > empty
> > > > > output files.
> > > > >
> > > > > And that's what's going on here.
> > > > >
> > > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are
> only
> > > > > created when processing the U and V wind components.
> > > > >
> > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > > CNT)
> > > > > only apply to scalar data. That includes wind speed... not
the
> > > > probability
> > > > > of wind speed.
> > > > >
> > > > > If you define categorical threshold for the scalar data, you
can
> also
> > > get
> > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > >
> > > > > It looks like your Ensemble-Stat config file already
includes the
> > > > ensemble
> > > > > mean field in the output:
> > > > >
> > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > >
> > > > > So just add those to the list of fields to be evaluated by
> Grid-Stat.
> > > And
> > > > > define meaningful categorical thresholds for them:
> > > > >
> > > > > In fcst...
> > > > >
> > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > gt5,
> > > > > gt10 ]; }
> > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > > gt5,
> > > > > gt10 ]; }
> > > > >
> > > > > And then make similar entries in the obs dictionary.
> > > > >
> > > > > Getting the vector statistics is a little trickier. Can you
confirm
> > > that
> > > > > you want vector statistics for the ensemble mean... and not
for the
> > > > > individual members? Is that correct?
> > > > >
> > > > > Hope that helps.
> > > > >
> > > > > Thanks,
> > > > > John Halley Gotway
> > > > >
> > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: empty output
> > > > > > Owner: Nobody
> > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > >
> > > > > >
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS obs.
> > data
> > > > > and I
> > > > > > can not get the result that I want. Here is the log file:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > It is weird that the "match is found for P850 and Z10",
and one
> of
> > > the
> > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat" is
> not
> > > > empty,
> > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > > inside
> > > > > of
> > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > >
> > > > > > Inside of the working directory "
> > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > -v 3 > testlog3
> > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > *vl1l2,
> > > > > *cnt,
> > > > > > *fho" etc.
> > > > > >
> > > > > > What is the problem here? Thank you.
> > > > > > Binyu
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Fri Feb 05 09:38:47 2021
Binyu,
Sorry, I had a typo in the config file I sent to you yesterday.
I had a capital "Obs" when it should have been all lower-case "obs".
And
the config files are case-sensitive.
So that did NOT override the default settings, which led to the error.
Please just edit the config file, making sure to use "obs" instead of
"Obs".
The cat_thresh setting is used in categorical verification of scalar
fields. That means it impacts the output line types of CTC, FHO, CTS,
MCTC,
MCTS, as well as neighborhood statistic output from Grid-Stat. Wind
speed
is a scalar field. To do categorical verification of wind speed, you'd
specify the cat_thresh option.
The wind_thresh setting is used to filter U/V matched pairs when
computing
vector partial sums and statistics. U wind and V wind are the only
vector
variables for which this logic is defined and applied. That means it
impacts the output lines types of VL1L2, VAL1L2, and VCNT. If you set
wind_thresh = NA (which is the default) then all U/V matched pairs are
included in the output statistics.
This is a little confusing because cat_thresh and wind_thresh both end
with
the same "thresh". But they operate in different ways. cat_thresh
defines
thresholds to convert raw values into yes/no events (i.e. the
categories).
wind_thresh, on the other hand, is a filtering threshold. Meaning, it
defines the criteria for which u/v pairs should be included in the
statistics.
John
On Fri, Feb 5, 2021 at 8:51 AM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> So the line type is decided by the threshold that is set, e.g: to
set
> up the threshold for WIND, we must use wind_thresh. "wind_thresh" is
for "
> VL1V2 " and "VCNT", "cat_thresh" is for "CTC or FHO and CTS".
>
> You mentioned that "WIND variable is wind speed which is just a
scalar
> field of numbers, and not a vector. That can be verified using
categorical
> counts and statistics". But are "UGRD" and "VGRD" vectors?
>
> Reading the MET document about "cat_thresh" and "cnt_thresh" (see
below),
> it seems to me all the verification (metrology or air quality field)
should
> be verified with "cat_thresh" (except wind direction), can you give
an
> example of using "cnt_thresh"? Thank you.
>
> - The "cat_thresh" entry is an array of thresholds to be used when
> // computing categorical statistics.
> //
> // - The "cnt_thresh" entry is an array of thresholds for
filtering
> // data prior to computing continuous statistics and partial
sums.
>
>
> Binyu
>
>
> On Fri, Feb 5, 2021 at 8:58 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > The WIND variable is wind speed which is just a scalar field of
numbers,
> > and not a vector. That can be verified using categorical counts
and
> > statistics, i.e. the CTC or FHO and CTS line types. And cat_thresh
> defines
> > the threshold for those line types.
> >
> > But I don’t recall actually checking the output_flag to see if
you’re
> > requesting those line types. If so, that’s where you’ll see that
> cat_thresh
> > setting used.
> >
> > John
> >
> > On Thu, Feb 4, 2021 at 9:09 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > >
> > > Hello John,
> > >
> > > Thank you for the detailed explanation. That helps a lot.
Looking at
> your
> > > config file below, I do have a question:
> > >
> > > As you said, "or the VCNT output, filtering the U/V pairs is NOT
done
> > with
> > > the cat_thresh... it's done using the wind_thresh instead.", why
do we
> > > still need to use " cat_thresh = my_thr_list"? Is that for
UGRD and
> > VGRD?
> > > Why don't we need "cat_logic"?
> > >
> > > fcst = {
> > >
> > > cat_thresh = my_thr_list;
> > > wind_thresh = my_thr_list;
> > > wind_logic = INTERSECTION;
> > >
> > > field = [
> > > { name = "WIND"; level = "P925"; },
> > >
> > > I appreciate your help a lot. Even the information is in the
document,
> > but
> > > I always tend to overlook that without your pointing out.
> > >
> > > Binyu
> > >
> > > On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Binyu,
> > > >
> > > > Thanks for sending the details for the location of your log
files,
> run
> > > > script, config file, and output on Luna. That makes it a lot
easier
> to
> > > > debug.
> > > >
> > > > So looking in your output file
> > > >
> > > >
> > >
> >
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> > > > you are wondering why all 6 lines contain the exact same
output.
> > > >
> > > > I took a look in that file and see what you describe. This is
> happening
> > > > because you have the same field listed 6 times... each with 1
> > cat_thresh
> > > > setting. Instead, I'd recommend that you list each field once,
with 6
> > > > different cat_thresh settings. But note that for the VCNT
output,
> > > filtering
> > > > the U/V pairs is NOT done with the cat_thresh... it's done
using the
> > > > wind_thresh instead.
> > > >
> > > > To avoid confusion, I downloaded your config file, modified
it, and
> > > > attached an updated version to this email for you to try.
> > > >
> > > > Let me know if you have any questions about the changes I
made.
> > > >
> > > > This is a little confusing... wind_thresh can be defined in
both the
> > fcst
> > > > and obs dictionaries. wind_logic defines how you combine those
to
> > decide
> > > > whether or not to include the point. I set it up as..
> > > > In fcst, set wind_thresh = real thresholds.
> > > > In obs, set wind_thresh = NA... which always evaluates to
true.
> > > > Set wind_logic to INTERSECTION... so basically we're filtering
the
> > > fcst/obs
> > > > U/V pairs based on the FORECAST wind speed. You could of
course
> switch
> > > that
> > > > to filter based on the observation wind speed.
> > > >
> > > > Search for "wind_thresh" on this page to see more details:
> > > > https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > > > >
> > > > > John, I still have a question for my WDIR verification even
I did
> get
> > > > some
> > > > > results:
> > > > >
> > > > > Looking at the output file (*vcnt and *vl1l2), why are the
six
> lines
> > > all
> > > > > the same? Should each line give the stat. for different
> > "cat_thresh"?
> > > > It
> > > > > looks like it treats all the data as one. If so, why are
there so
> > many
> > > > > lines then?
> > > > >
> > > > > The log file:
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > > > > The working dir:
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > > > > The output file (*vcnt):
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > > > > The config file:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> > > > >
> > > > > Thank you
> > > > > Binyu
> > > > >
> > > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Hi Binyu,
> > > > > >
> > > > > > I see that you have a question about why you are NOT
getting any
> > > output
> > > > > for
> > > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS and
> > > took
> > > > a
> > > > > > look in:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > > >
> > > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > > WIND_Z10_ENS_FREQ_le1
> > > > > > and
> > > > > > WIND_P850_ENS_FREQ_le1
> > > > > >
> > > > > > So this is the probability of WIND SPEED being less than
1, as
> > > computed
> > > > > by
> > > > > > the Ensemble-Stat tool.
> > > > > >
> > > > > > Probability fields are evaluated in MET by the line types
which
> > begin
> > > > > with
> > > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line
> types
> > > > you'd
> > > > > > like in the Grid-Stat configuration file, but if you don't
pass
> > data
> > > > > which
> > > > > > applies to the corresponding verification logic, then
you'll get
> > > empty
> > > > > > output files.
> > > > > >
> > > > > > And that's what's going on here.
> > > > > >
> > > > > > Specifically, the vector line types, VL1L2, VAL1L2, and
VCT are
> > only
> > > > > > created when processing the U and V wind components.
> > > > > >
> > > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2,
> and
> > > > CNT)
> > > > > > only apply to scalar data. That includes wind speed... not
the
> > > > > probability
> > > > > > of wind speed.
> > > > > >
> > > > > > If you define categorical threshold for the scalar data,
you can
> > also
> > > > get
> > > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > > >
> > > > > > It looks like your Ensemble-Stat config file already
includes the
> > > > > ensemble
> > > > > > mean field in the output:
> > > > > >
> > > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > > >
> > > > > > So just add those to the list of fields to be evaluated by
> > Grid-Stat.
> > > > And
> > > > > > define meaningful categorical thresholds for them:
> > > > > >
> > > > > > In fcst...
> > > > > >
> > > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> > gt3,
> > > > gt5,
> > > > > > gt10 ]; }
> > > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh =
[ gt1,
> > gt3,
> > > > > gt5,
> > > > > > gt10 ]; }
> > > > > >
> > > > > > And then make similar entries in the obs dictionary.
> > > > > >
> > > > > > Getting the vector statistics is a little trickier. Can
you
> confirm
> > > > that
> > > > > > you want vector statistics for the ensemble mean... and
not for
> the
> > > > > > individual members? Is that correct?
> > > > > >
> > > > > > Hope that helps.
> > > > > >
> > > > > > Thanks,
> > > > > > John Halley Gotway
> > > > > >
> > > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > > Queue: met_help
> > > > > > > Subject: empty output
> > > > > > > Owner: Nobody
> > > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > > Status: new
> > > > > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Hello,
> > > > > > >
> > > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS
> obs.
> > > data
> > > > > > and I
> > > > > > > can not get the result that I want. Here is the log
file:
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > > It is weird that the "match is found for P850 and Z10",
and
> one
> > of
> > > > the
> > > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat" is
> > not
> > > > > empty,
> > > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are
all
> empty
> > > > inside
> > > > > > of
> > > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > > >
> > > > > > > Inside of the working directory "
> > > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > > $ grid_stat
> ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > > -v 3 > testlog3
> > > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > > *vl1l2,
> > > > > > *cnt,
> > > > > > > *fho" etc.
> > > > > > >
> > > > > > > What is the problem here? Thank you.
> > > > > > > Binyu
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Sun Feb 07 20:16:45 2021
Hello John,
Yes, you are right. After I changed "Obs" to "obs", the error was
gone.
You mentioned that if we set "wind_thresh = NA (which is the default)
then
all U/V matched pairs are included in the output statistics.", so if
"VL1V2 " and "VCNT" are not selected, then "wind_thresh" is not used
at
all, is that correct?
Best
Binyu
On Fri, Feb 5, 2021 at 11:38 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> Sorry, I had a typo in the config file I sent to you yesterday.
> I had a capital "Obs" when it should have been all lower-case "obs".
And
> the config files are case-sensitive.
> So that did NOT override the default settings, which led to the
error.
> Please just edit the config file, making sure to use "obs" instead
of
> "Obs".
>
> The cat_thresh setting is used in categorical verification of scalar
> fields. That means it impacts the output line types of CTC, FHO,
CTS, MCTC,
> MCTS, as well as neighborhood statistic output from Grid-Stat. Wind
speed
> is a scalar field. To do categorical verification of wind speed,
you'd
> specify the cat_thresh option.
>
> The wind_thresh setting is used to filter U/V matched pairs when
computing
> vector partial sums and statistics. U wind and V wind are the only
vector
> variables for which this logic is defined and applied. That means it
> impacts the output lines types of VL1L2, VAL1L2, and VCNT. If you
set
> wind_thresh = NA (which is the default) then all U/V matched pairs
are
> included in the output statistics.
>
> This is a little confusing because cat_thresh and wind_thresh both
end with
> the same "thresh". But they operate in different ways. cat_thresh
defines
> thresholds to convert raw values into yes/no events (i.e. the
categories).
> wind_thresh, on the other hand, is a filtering threshold. Meaning,
it
> defines the criteria for which u/v pairs should be included in the
> statistics.
>
> John
>
> On Fri, Feb 5, 2021 at 8:51 AM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > So the line type is decided by the threshold that is set, e.g: to
set
> > up the threshold for WIND, we must use wind_thresh. "wind_thresh"
is for
> "
> > VL1V2 " and "VCNT", "cat_thresh" is for "CTC or FHO and CTS".
> >
> > You mentioned that "WIND variable is wind speed which is just a
scalar
> > field of numbers, and not a vector. That can be verified using
> categorical
> > counts and statistics". But are "UGRD" and "VGRD" vectors?
> >
> > Reading the MET document about "cat_thresh" and "cnt_thresh" (see
below),
> > it seems to me all the verification (metrology or air quality
field)
> should
> > be verified with "cat_thresh" (except wind direction), can you
give an
> > example of using "cnt_thresh"? Thank you.
> >
> > - The "cat_thresh" entry is an array of thresholds to be used when
> > // computing categorical statistics.
> > //
> > // - The "cnt_thresh" entry is an array of thresholds for
filtering
> > // data prior to computing continuous statistics and
partial sums.
> >
> >
> > Binyu
> >
> >
> > On Fri, Feb 5, 2021 at 8:58 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > The WIND variable is wind speed which is just a scalar field of
> numbers,
> > > and not a vector. That can be verified using categorical counts
and
> > > statistics, i.e. the CTC or FHO and CTS line types. And
cat_thresh
> > defines
> > > the threshold for those line types.
> > >
> > > But I don’t recall actually checking the output_flag to see if
you’re
> > > requesting those line types. If so, that’s where you’ll see that
> > cat_thresh
> > > setting used.
> > >
> > > John
> > >
> > > On Thu, Feb 4, 2021 at 9:09 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
>
> > > >
> > > > Hello John,
> > > >
> > > > Thank you for the detailed explanation. That helps a lot.
Looking at
> > your
> > > > config file below, I do have a question:
> > > >
> > > > As you said, "or the VCNT output, filtering the U/V pairs is
NOT done
> > > with
> > > > the cat_thresh... it's done using the wind_thresh instead.",
why do
> we
> > > > still need to use " cat_thresh = my_thr_list"? Is that for
UGRD and
> > > VGRD?
> > > > Why don't we need "cat_logic"?
> > > >
> > > > fcst = {
> > > >
> > > > cat_thresh = my_thr_list;
> > > > wind_thresh = my_thr_list;
> > > > wind_logic = INTERSECTION;
> > > >
> > > > field = [
> > > > { name = "WIND"; level = "P925"; },
> > > >
> > > > I appreciate your help a lot. Even the information is in the
> document,
> > > but
> > > > I always tend to overlook that without your pointing out.
> > > >
> > > > Binyu
> > > >
> > > > On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Binyu,
> > > > >
> > > > > Thanks for sending the details for the location of your log
files,
> > run
> > > > > script, config file, and output on Luna. That makes it a lot
easier
> > to
> > > > > debug.
> > > > >
> > > > > So looking in your output file
> > > > >
> > > > >
> > > >
> > >
> >
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> > > > > you are wondering why all 6 lines contain the exact same
output.
> > > > >
> > > > > I took a look in that file and see what you describe. This
is
> > happening
> > > > > because you have the same field listed 6 times... each with
1
> > > cat_thresh
> > > > > setting. Instead, I'd recommend that you list each field
once,
> with 6
> > > > > different cat_thresh settings. But note that for the VCNT
output,
> > > > filtering
> > > > > the U/V pairs is NOT done with the cat_thresh... it's done
using
> the
> > > > > wind_thresh instead.
> > > > >
> > > > > To avoid confusion, I downloaded your config file, modified
it, and
> > > > > attached an updated version to this email for you to try.
> > > > >
> > > > > Let me know if you have any questions about the changes I
made.
> > > > >
> > > > > This is a little confusing... wind_thresh can be defined in
both
> the
> > > fcst
> > > > > and obs dictionaries. wind_logic defines how you combine
those to
> > > decide
> > > > > whether or not to include the point. I set it up as..
> > > > > In fcst, set wind_thresh = real thresholds.
> > > > > In obs, set wind_thresh = NA... which always evaluates to
true.
> > > > > Set wind_logic to INTERSECTION... so basically we're
filtering the
> > > > fcst/obs
> > > > > U/V pairs based on the FORECAST wind speed. You could of
course
> > switch
> > > > that
> > > > > to filter based on the observation wind speed.
> > > > >
> > > > > Search for "wind_thresh" on this page to see more details:
> > > > >
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > > > > >
> > > > > > John, I still have a question for my WDIR verification
even I did
> > get
> > > > > some
> > > > > > results:
> > > > > >
> > > > > > Looking at the output file (*vcnt and *vl1l2), why are the
six
> > lines
> > > > all
> > > > > > the same? Should each line give the stat. for different
> > > "cat_thresh"?
> > > > > It
> > > > > > looks like it treats all the data as one. If so, why are
there so
> > > many
> > > > > > lines then?
> > > > > >
> > > > > > The log file:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > > > > > The working dir:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > > > > > The output file (*vcnt):
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > > > > > The config file:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> > > > > >
> > > > > > Thank you
> > > > > > Binyu
> > > > > >
> > > > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > > > met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi Binyu,
> > > > > > >
> > > > > > > I see that you have a question about why you are NOT
getting
> any
> > > > output
> > > > > > for
> > > > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS
> and
> > > > took
> > > > > a
> > > > > > > look in:
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > > > >
> > > > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > > > WIND_Z10_ENS_FREQ_le1
> > > > > > > and
> > > > > > > WIND_P850_ENS_FREQ_le1
> > > > > > >
> > > > > > > So this is the probability of WIND SPEED being less than
1, as
> > > > computed
> > > > > > by
> > > > > > > the Ensemble-Stat tool.
> > > > > > >
> > > > > > > Probability fields are evaluated in MET by the line
types which
> > > begin
> > > > > > with
> > > > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line
> > types
> > > > > you'd
> > > > > > > like in the Grid-Stat configuration file, but if you
don't pass
> > > data
> > > > > > which
> > > > > > > applies to the corresponding verification logic, then
you'll
> get
> > > > empty
> > > > > > > output files.
> > > > > > >
> > > > > > > And that's what's going on here.
> > > > > > >
> > > > > > > Specifically, the vector line types, VL1L2, VAL1L2, and
VCT are
> > > only
> > > > > > > created when processing the U and V wind components.
> > > > > > >
> > > > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2,
> > and
> > > > > CNT)
> > > > > > > only apply to scalar data. That includes wind speed...
not the
> > > > > > probability
> > > > > > > of wind speed.
> > > > > > >
> > > > > > > If you define categorical threshold for the scalar data,
you
> can
> > > also
> > > > > get
> > > > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > > > >
> > > > > > > It looks like your Ensemble-Stat config file already
includes
> the
> > > > > > ensemble
> > > > > > > mean field in the output:
> > > > > > >
> > > > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > > > >
> > > > > > > So just add those to the list of fields to be evaluated
by
> > > Grid-Stat.
> > > > > And
> > > > > > > define meaningful categorical thresholds for them:
> > > > > > >
> > > > > > > In fcst...
> > > > > > >
> > > > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh =
[ gt1,
> > > gt3,
> > > > > gt5,
> > > > > > > gt10 ]; }
> > > > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh
= [
> gt1,
> > > gt3,
> > > > > > gt5,
> > > > > > > gt10 ]; }
> > > > > > >
> > > > > > > And then make similar entries in the obs dictionary.
> > > > > > >
> > > > > > > Getting the vector statistics is a little trickier. Can
you
> > confirm
> > > > > that
> > > > > > > you want vector statistics for the ensemble mean... and
not for
> > the
> > > > > > > individual members? Is that correct?
> > > > > > >
> > > > > > > Hope that helps.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > John Halley Gotway
> > > > > > >
> > > > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted
upon.
> > > > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > > > Queue: met_help
> > > > > > > > Subject: empty output
> > > > > > > > Owner: Nobody
> > > > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > > > Status: new
> > > > > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Hello,
> > > > > > > >
> > > > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS
> > obs.
> > > > data
> > > > > > > and I
> > > > > > > > can not get the result that I want. Here is the log
file:
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > > > It is weird that the "match is found for P850 and
Z10", and
> > one
> > > of
> > > > > the
> > > > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat"
> is
> > > not
> > > > > > empty,
> > > > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are
all
> > empty
> > > > > inside
> > > > > > > of
> > > > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > > > >
> > > > > > > > Inside of the working directory "
> > > > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > > > $ grid_stat
> > ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > > > -v 3 > testlog3
> > > > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > > > *vl1l2,
> > > > > > > *cnt,
> > > > > > > > *fho" etc.
> > > > > > > >
> > > > > > > > What is the problem here? Thank you.
> > > > > > > > Binyu
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Mon Feb 08 09:11:28 2021
Binyu,
Yes, that's correct. The wind_thresh option only applies to the
creation of
the VCNT, VL1L2, and VAL1L2 line types. If you do not request those
output
types... or aren't verifying U and V vectors of wind, then the
wind_thresh
setting has no impact on the output.
John
On Sun, Feb 7, 2021 at 8:16 PM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> Hello John,
>
> Yes, you are right. After I changed "Obs" to "obs", the error was
gone.
>
> You mentioned that if we set "wind_thresh = NA (which is the
default) then
> all U/V matched pairs are included in the output statistics.", so if
> "VL1V2 " and "VCNT" are not selected, then "wind_thresh" is not used
at
> all, is that correct?
>
> Best
> Binyu
>
>
>
> On Fri, Feb 5, 2021 at 11:38 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > Sorry, I had a typo in the config file I sent to you yesterday.
> > I had a capital "Obs" when it should have been all lower-case
"obs". And
> > the config files are case-sensitive.
> > So that did NOT override the default settings, which led to the
error.
> > Please just edit the config file, making sure to use "obs" instead
of
> > "Obs".
> >
> > The cat_thresh setting is used in categorical verification of
scalar
> > fields. That means it impacts the output line types of CTC, FHO,
CTS,
> MCTC,
> > MCTS, as well as neighborhood statistic output from Grid-Stat.
Wind speed
> > is a scalar field. To do categorical verification of wind speed,
you'd
> > specify the cat_thresh option.
> >
> > The wind_thresh setting is used to filter U/V matched pairs when
> computing
> > vector partial sums and statistics. U wind and V wind are the only
vector
> > variables for which this logic is defined and applied. That means
it
> > impacts the output lines types of VL1L2, VAL1L2, and VCNT. If you
set
> > wind_thresh = NA (which is the default) then all U/V matched pairs
are
> > included in the output statistics.
> >
> > This is a little confusing because cat_thresh and wind_thresh both
end
> with
> > the same "thresh". But they operate in different ways. cat_thresh
defines
> > thresholds to convert raw values into yes/no events (i.e. the
> categories).
> > wind_thresh, on the other hand, is a filtering threshold. Meaning,
it
> > defines the criteria for which u/v pairs should be included in the
> > statistics.
> >
> > John
> >
> > On Fri, Feb 5, 2021 at 8:51 AM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > >
> > > So the line type is decided by the threshold that is set, e.g:
to set
> > > up the threshold for WIND, we must use wind_thresh.
"wind_thresh" is
> for
> > "
> > > VL1V2 " and "VCNT", "cat_thresh" is for "CTC or FHO and CTS".
> > >
> > > You mentioned that "WIND variable is wind speed which is just a
scalar
> > > field of numbers, and not a vector. That can be verified using
> > categorical
> > > counts and statistics". But are "UGRD" and "VGRD" vectors?
> > >
> > > Reading the MET document about "cat_thresh" and "cnt_thresh"
(see
> below),
> > > it seems to me all the verification (metrology or air quality
field)
> > should
> > > be verified with "cat_thresh" (except wind direction), can you
give an
> > > example of using "cnt_thresh"? Thank you.
> > >
> > > - The "cat_thresh" entry is an array of thresholds to be used
when
> > > // computing categorical statistics.
> > > //
> > > // - The "cnt_thresh" entry is an array of thresholds for
> filtering
> > > // data prior to computing continuous statistics and
partial
> sums.
> > >
> > >
> > > Binyu
> > >
> > >
> > > On Fri, Feb 5, 2021 at 8:58 AM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Binyu,
> > > >
> > > > The WIND variable is wind speed which is just a scalar field
of
> > numbers,
> > > > and not a vector. That can be verified using categorical
counts and
> > > > statistics, i.e. the CTC or FHO and CTS line types. And
cat_thresh
> > > defines
> > > > the threshold for those line types.
> > > >
> > > > But I don’t recall actually checking the output_flag to see if
you’re
> > > > requesting those line types. If so, that’s where you’ll see
that
> > > cat_thresh
> > > > setting used.
> > > >
> > > > John
> > > >
> > > > On Thu, Feb 4, 2021 at 9:09 PM binyu.wang at noaa.gov via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > > > >
> > > > > Hello John,
> > > > >
> > > > > Thank you for the detailed explanation. That helps a lot.
Looking
> at
> > > your
> > > > > config file below, I do have a question:
> > > > >
> > > > > As you said, "or the VCNT output, filtering the U/V pairs is
NOT
> done
> > > > with
> > > > > the cat_thresh... it's done using the wind_thresh instead.",
why do
> > we
> > > > > still need to use " cat_thresh = my_thr_list"? Is that for
UGRD
> and
> > > > VGRD?
> > > > > Why don't we need "cat_logic"?
> > > > >
> > > > > fcst = {
> > > > >
> > > > > cat_thresh = my_thr_list;
> > > > > wind_thresh = my_thr_list;
> > > > > wind_logic = INTERSECTION;
> > > > >
> > > > > field = [
> > > > > { name = "WIND"; level = "P925"; },
> > > > >
> > > > > I appreciate your help a lot. Even the information is in the
> > document,
> > > > but
> > > > > I always tend to overlook that without your pointing out.
> > > > >
> > > > > Binyu
> > > > >
> > > > > On Thu, Feb 4, 2021 at 6:10 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Binyu,
> > > > > >
> > > > > > Thanks for sending the details for the location of your
log
> files,
> > > run
> > > > > > script, config file, and output on Luna. That makes it a
lot
> easier
> > > to
> > > > > > debug.
> > > > > >
> > > > > > So looking in your output file
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
(/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/grid_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt),
> > > > > > you are wondering why all 6 lines contain the exact same
output.
> > > > > >
> > > > > > I took a look in that file and see what you describe. This
is
> > > happening
> > > > > > because you have the same field listed 6 times... each
with 1
> > > > cat_thresh
> > > > > > setting. Instead, I'd recommend that you list each field
once,
> > with 6
> > > > > > different cat_thresh settings. But note that for the VCNT
output,
> > > > > filtering
> > > > > > the U/V pairs is NOT done with the cat_thresh... it's done
using
> > the
> > > > > > wind_thresh instead.
> > > > > >
> > > > > > To avoid confusion, I downloaded your config file,
modified it,
> and
> > > > > > attached an updated version to this email for you to try.
> > > > > >
> > > > > > Let me know if you have any questions about the changes I
made.
> > > > > >
> > > > > > This is a little confusing... wind_thresh can be defined
in both
> > the
> > > > fcst
> > > > > > and obs dictionaries. wind_logic defines how you combine
those to
> > > > decide
> > > > > > whether or not to include the point. I set it up as..
> > > > > > In fcst, set wind_thresh = real thresholds.
> > > > > > In obs, set wind_thresh = NA... which always evaluates to
true.
> > > > > > Set wind_logic to INTERSECTION... so basically we're
filtering
> the
> > > > > fcst/obs
> > > > > > U/V pairs based on the FORECAST wind speed. You could of
course
> > > switch
> > > > > that
> > > > > > to filter based on the observation wind speed.
> > > > > >
> > > > > > Search for "wind_thresh" on this page to see more details:
> > > > > >
https://dtcenter.github.io/MET/latest/Users_Guide/data_io.html
> > > > > >
> > > > > > Thanks,
> > > > > > John
> > > > > >
> > > > > > On Thu, Feb 4, 2021 at 10:50 AM binyu.wang at noaa.gov via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> >
> > > > > > >
> > > > > > > John, I still have a question for my WDIR verification
even I
> did
> > > get
> > > > > > some
> > > > > > > results:
> > > > > > >
> > > > > > > Looking at the output file (*vcnt and *vl1l2), why are
the six
> > > lines
> > > > > all
> > > > > > > the same? Should each line give the stat. for
different
> > > > "cat_thresh"?
> > > > > > It
> > > > > > > looks like it treats all the data as one. If so, why are
there
> so
> > > > many
> > > > > > > lines then?
> > > > > > >
> > > > > > > The log file:
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52376585
> > > > > > > The working dir:
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309
> > > > > > > The output file (*vcnt):
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/out.20210201/point_stat.href01/grid_stat_HREFV3_F36_NDAS_360000L_20210201_180000V_vcnt.txt
> > > > > > > The config file:
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.92309/verf_g2g_grid_stat_href_config_ndas
> > > > > > >
> > > > > > > Thank you
> > > > > > > Binyu
> > > > > > >
> > > > > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT
<
> > > > > > > met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi Binyu,
> > > > > > > >
> > > > > > > > I see that you have a question about why you are NOT
getting
> > any
> > > > > output
> > > > > > > for
> > > > > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on
to WCOSS
> > and
> > > > > took
> > > > > > a
> > > > > > > > look in:
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > > > > >
> > > > > > > > In there, you're verifying ensemble probability
fields, like:
> > > > > > > > WIND_Z10_ENS_FREQ_le1
> > > > > > > > and
> > > > > > > > WIND_P850_ENS_FREQ_le1
> > > > > > > >
> > > > > > > > So this is the probability of WIND SPEED being less
than 1,
> as
> > > > > computed
> > > > > > > by
> > > > > > > > the Ensemble-Stat tool.
> > > > > > > >
> > > > > > > > Probability fields are evaluated in MET by the line
types
> which
> > > > begin
> > > > > > > with
> > > > > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request
whatever line
> > > types
> > > > > > you'd
> > > > > > > > like in the Grid-Stat configuration file, but if you
don't
> pass
> > > > data
> > > > > > > which
> > > > > > > > applies to the corresponding verification logic, then
you'll
> > get
> > > > > empty
> > > > > > > > output files.
> > > > > > > >
> > > > > > > > And that's what's going on here.
> > > > > > > >
> > > > > > > > Specifically, the vector line types, VL1L2, VAL1L2,
and VCT
> are
> > > > only
> > > > > > > > created when processing the U and V wind components.
> > > > > > > >
> > > > > > > > And the scalar continuous statistics line types
(SL1L2,
> SAL1L2,
> > > and
> > > > > > CNT)
> > > > > > > > only apply to scalar data. That includes wind speed...
not
> the
> > > > > > > probability
> > > > > > > > of wind speed.
> > > > > > > >
> > > > > > > > If you define categorical threshold for the scalar
data, you
> > can
> > > > also
> > > > > > get
> > > > > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > > > > >
> > > > > > > > It looks like your Ensemble-Stat config file already
includes
> > the
> > > > > > > ensemble
> > > > > > > > mean field in the output:
> > > > > > > >
> > > > > > > > ncdump -h
> ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > > > > >
> > > > > > > > So just add those to the list of fields to be
evaluated by
> > > > Grid-Stat.
> > > > > > And
> > > > > > > > define meaningful categorical thresholds for them:
> > > > > > > >
> > > > > > > > In fcst...
> > > > > > > >
> > > > > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh
= [
> gt1,
> > > > gt3,
> > > > > > gt5,
> > > > > > > > gt10 ]; }
> > > > > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE;
cat_thresh = [
> > gt1,
> > > > gt3,
> > > > > > > gt5,
> > > > > > > > gt10 ]; }
> > > > > > > >
> > > > > > > > And then make similar entries in the obs dictionary.
> > > > > > > >
> > > > > > > > Getting the vector statistics is a little trickier.
Can you
> > > confirm
> > > > > > that
> > > > > > > > you want vector statistics for the ensemble mean...
and not
> for
> > > the
> > > > > > > > individual members? Is that correct?
> > > > > > > >
> > > > > > > > Hope that helps.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > John Halley Gotway
> > > > > > > >
> > > > > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted
upon.
> > > > > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > > > > Queue: met_help
> > > > > > > > > Subject: empty output
> > > > > > > > > Owner: Nobody
> > > > > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > > > > Status: new
> > > > > > > > > Ticket <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Hello,
> > > > > > > > >
> > > > > > > > > I was trying to verify the WIND profile using HREF
vs. NDAS
> > > obs.
> > > > > data
> > > > > > > > and I
> > > > > > > > > can not get the result that I want. Here is the log
file:
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > > > > It is weird that the "match is found for P850 and
Z10",
> and
> > > one
> > > > of
> > > > > > the
> > > > > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat"
> > is
> > > > not
> > > > > > > empty,
> > > > > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho"
are all
> > > empty
> > > > > > inside
> > > > > > > > of
> > > > > > > > > the working directory
"verf_g2g_hrefv3_00_dev.164719".
> > > > > > > > >
> > > > > > > > > Inside of the working directory "
> > > > > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > > > > $ grid_stat
> > > ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > > > > -v 3 > testlog3
> > > > > > > > > There is no any ERROR message, but I just got empty
"
> *vcnt,
> > > > > *vl1l2,
> > > > > > > > *cnt,
> > > > > > > > > *fho" etc.
> > > > > > > > >
> > > > > > > > > What is the problem here? Thank you.
> > > > > > > > > Binyu
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Mon Feb 08 14:32:24 2021
Hello again,
Just a quick question: plot_point_obs has the powerful function now,
how
about the other plot tool? e.g "plot_data_plane"? I guess it will have
the
same update as well?
e.g:
To use "plot_data_plane" to make a plot using grib2 file, if I only
want to
plot a subregion, do I still have to use other tools first to cut the
subregion out before using "plot_data_plane"?
Thank you.
Binyu
On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> Here's a few GitHub issues which describe recent enhancements to
> plot_point_obs:
> https://github.com/dtcenter/MET/issues/1528
> https://github.com/dtcenter/MET/issues/1052
> https://github.com/dtcenter/MET/issues/1627
>
> All of these changes were made after the met-9.1 release and in
preparation
> for the met-10.0.0 release. If you'd like to test them out, I'd
recommend
> using the met-10.0.0-beta3 release, which is our most recent
development
> version for met-10.0.0. Please note that this code is only intended
for
> testing and should not be used operational evaluation.
>
> It's already installed on WCOSS, and you can find the details on
this page.
> Just click the "NOAA machines" tab:
> http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
>
> As for an example, here's one we run as part of the unit tests for
MET:
>
> export TO_GRID="NONE"
> plot_point_obs \
> pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> -config PlotPointObsConfig \
> -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> -v 3
>
> Here's a link to the config file, which has all the important
details:
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
>
> And please see the updated documentation for this tool:
>
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
>
> Here's the output of the sample command above:
> [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> So this plots a gridded base image, and then 3 different types of
point
> observations.
>
> John
>
>
> On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello John,
> >
> > You are absolutely right. I do NOT want the ensemble mean, and I
want the
> > individual member instead. I do realize that after I sent the
email for
> > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I do
have a
> > question: last time I did a similar thing using ensemble data. I
had to
> > extract the WDIR from each member and make a scatter plot (obs.
WIND for
> > x-axis, difference WDIR b/t obs and model for y-axis), which takes
a lot
> of
> > time. So is it possible that MET could add some function like that
in the
> > future? WDIR is an important factor.
> >
> > One more thing: I recall that you have updated the
"plot_point_obs", so
> it
> > can make plot for only a certain pressure level now.Which version
has the
> > new function? How to use it?
> >
> > Thank you.
> > Binyu
> >
> > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Hi Binyu,
> > >
> > > I see that you have a question about why you are NOT getting any
output
> > for
> > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS
and took
> a
> > > look in:
> > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > >
> > > In there, you're verifying ensemble probability fields, like:
> > > WIND_Z10_ENS_FREQ_le1
> > > and
> > > WIND_P850_ENS_FREQ_le1
> > >
> > > So this is the probability of WIND SPEED being less than 1, as
computed
> > by
> > > the Ensemble-Stat tool.
> > >
> > > Probability fields are evaluated in MET by the line types which
begin
> > with
> > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types
> you'd
> > > like in the Grid-Stat configuration file, but if you don't pass
data
> > which
> > > applies to the corresponding verification logic, then you'll get
empty
> > > output files.
> > >
> > > And that's what's going on here.
> > >
> > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT are
only
> > > created when processing the U and V wind components.
> > >
> > > And the scalar continuous statistics line types (SL1L2, SAL1L2,
and
> CNT)
> > > only apply to scalar data. That includes wind speed... not the
> > probability
> > > of wind speed.
> > >
> > > If you define categorical threshold for the scalar data, you can
also
> get
> > > categorical statistics line type (FHO, CTC, and CTS).
> > >
> > > It looks like your Ensemble-Stat config file already includes
the
> > ensemble
> > > mean field in the output:
> > >
> > > ncdump -h ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > >
> > > So just add those to the list of fields to be evaluated by Grid-
Stat.
> And
> > > define meaningful categorical thresholds for them:
> > >
> > > In fcst...
> > >
> > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> gt5,
> > > gt10 ]; }
> > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [ gt1,
gt3,
> > gt5,
> > > gt10 ]; }
> > >
> > > And then make similar entries in the obs dictionary.
> > >
> > > Getting the vector statistics is a little trickier. Can you
confirm
> that
> > > you want vector statistics for the ensemble mean... and not for
the
> > > individual members? Is that correct?
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > Queue: met_help
> > > > Subject: empty output
> > > > Owner: Nobody
> > > > Requestors: binyu.wang at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > >
> > > >
> > > >
> > > > Hello,
> > > >
> > > > I was trying to verify the WIND profile using HREF vs. NDAS
obs. data
> > > and I
> > > > can not get the result that I want. Here is the log file:
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > It is weird that the "match is found for P850 and Z10", and
one of
> the
> > > > output " grid_stat_href_test_120000L_20210130_000000V.stat" is
not
> > empty,
> > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> inside
> > > of
> > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > >
> > > > Inside of the working directory "
> > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > -v 3 > testlog3
> > > > There is no any ERROR message, but I just got empty " *vcnt,
*vl1l2,
> > > *cnt,
> > > > *fho" etc.
> > > >
> > > > What is the problem here? Thank you.
> > > > Binyu
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: John Halley Gotway
Time: Mon Feb 08 16:54:56 2021
Binyu,
We don’t currently have any updates planned for plot_data_plane. I’m
not
aware of any enhancements that should be made.
In regards to plotting a sub-region with plot_point_obs, I actually
added
the regridding option just a couple weeks ago. And it’s included in
met-10.0.0_beta3:
https://github.com/dtcenter/MET/issues/1627
You can regrid the gridded data to a smaller domain prior to plotting
it if
you’d like.
Thanks
John
On Mon, Feb 8, 2021 at 2:32 PM binyu.wang at noaa.gov via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
>
> Hello again,
>
> Just a quick question: plot_point_obs has the powerful function now,
how
> about the other plot tool? e.g "plot_data_plane"? I guess it will
have the
> same update as well?
> e.g:
> To use "plot_data_plane" to make a plot using grib2 file, if I only
want to
> plot a subregion, do I still have to use other tools first to cut
the
> subregion out before using "plot_data_plane"?
>
> Thank you.
> Binyu
>
> On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Binyu,
> >
> > Here's a few GitHub issues which describe recent enhancements to
> > plot_point_obs:
> > https://github.com/dtcenter/MET/issues/1528
> > https://github.com/dtcenter/MET/issues/1052
> > https://github.com/dtcenter/MET/issues/1627
> >
> > All of these changes were made after the met-9.1 release and in
> preparation
> > for the met-10.0.0 release. If you'd like to test them out, I'd
recommend
> > using the met-10.0.0-beta3 release, which is our most recent
development
> > version for met-10.0.0. Please note that this code is only
intended for
> > testing and should not be used operational evaluation.
> >
> > It's already installed on WCOSS, and you can find the details on
this
> page.
> > Just click the "NOAA machines" tab:
> > http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
> >
> > As for an example, here's one we run as part of the unit tests for
MET:
> >
> > export TO_GRID="NONE"
> > plot_point_obs \
> > pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> > plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> > -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> > -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> > -config PlotPointObsConfig \
> > -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> > -v 3
> >
> > Here's a link to the config file, which has all the important
details:
> >
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
> >
> > And please see the updated documentation for this tool:
> >
> >
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
> >
> > Here's the output of the sample command above:
> > [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> > So this plots a gridded base image, and then 3 different types of
point
> > observations.
> >
> > John
> >
> >
> > On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> > >
> > > Hello John,
> > >
> > > You are absolutely right. I do NOT want the ensemble mean, and I
want
> the
> > > individual member instead. I do realize that after I sent the
email for
> > > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I
do have
> a
> > > question: last time I did a similar thing using ensemble data. I
had to
> > > extract the WDIR from each member and make a scatter plot (obs.
WIND
> for
> > > x-axis, difference WDIR b/t obs and model for y-axis), which
takes a
> lot
> > of
> > > time. So is it possible that MET could add some function like
that in
> the
> > > future? WDIR is an important factor.
> > >
> > > One more thing: I recall that you have updated the
"plot_point_obs", so
> > it
> > > can make plot for only a certain pressure level now.Which
version has
> the
> > > new function? How to use it?
> > >
> > > Thank you.
> > > Binyu
> > >
> > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Binyu,
> > > >
> > > > I see that you have a question about why you are NOT getting
any
> output
> > > for
> > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to WCOSS
and
> took
> > a
> > > > look in:
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > >
> > > > In there, you're verifying ensemble probability fields, like:
> > > > WIND_Z10_ENS_FREQ_le1
> > > > and
> > > > WIND_P850_ENS_FREQ_le1
> > > >
> > > > So this is the probability of WIND SPEED being less than 1, as
> computed
> > > by
> > > > the Ensemble-Stat tool.
> > > >
> > > > Probability fields are evaluated in MET by the line types
which begin
> > > with
> > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever line
types
> > you'd
> > > > like in the Grid-Stat configuration file, but if you don't
pass data
> > > which
> > > > applies to the corresponding verification logic, then you'll
get
> empty
> > > > output files.
> > > >
> > > > And that's what's going on here.
> > > >
> > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are only
> > > > created when processing the U and V wind components.
> > > >
> > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > CNT)
> > > > only apply to scalar data. That includes wind speed... not the
> > > probability
> > > > of wind speed.
> > > >
> > > > If you define categorical threshold for the scalar data, you
can also
> > get
> > > > categorical statistics line type (FHO, CTC, and CTS).
> > > >
> > > > It looks like your Ensemble-Stat config file already includes
the
> > > ensemble
> > > > mean field in the output:
> > > >
> > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > >
> > > > So just add those to the list of fields to be evaluated by
Grid-Stat.
> > And
> > > > define meaningful categorical thresholds for them:
> > > >
> > > > In fcst...
> > > >
> > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1, gt3,
> > gt5,
> > > > gt10 ]; }
> > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1, gt3,
> > > gt5,
> > > > gt10 ]; }
> > > >
> > > > And then make similar entries in the obs dictionary.
> > > >
> > > > Getting the vector statistics is a little trickier. Can you
confirm
> > that
> > > > you want vector statistics for the ensemble mean... and not
for the
> > > > individual members? Is that correct?
> > > >
> > > > Hope that helps.
> > > >
> > > > Thanks,
> > > > John Halley Gotway
> > > >
> > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: empty output
> > > > > Owner: Nobody
> > > > > Requestors: binyu.wang at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > >
> > > > >
> > > > >
> > > > > Hello,
> > > > >
> > > > > I was trying to verify the WIND profile using HREF vs. NDAS
obs.
> data
> > > > and I
> > > > > can not get the result that I want. Here is the log file:
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > It is weird that the "match is found for P850 and Z10", and
one of
> > the
> > > > > output " grid_stat_href_test_120000L_20210130_000000V.stat"
is not
> > > empty,
> > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > inside
> > > > of
> > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > >
> > > > > Inside of the working directory "
> > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > -v 3 > testlog3
> > > > > There is no any ERROR message, but I just got empty " *vcnt,
> *vl1l2,
> > > > *cnt,
> > > > > *fho" etc.
> > > > >
> > > > > What is the problem here? Thank you.
> > > > > Binyu
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: empty output
From: binyu.wang at noaa.gov
Time: Mon Feb 08 17:28:47 2021
Got it, thank you.
Binyu
On Mon, Feb 8, 2021 at 6:55 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Binyu,
>
> We don’t currently have any updates planned for plot_data_plane. I’m
not
> aware of any enhancements that should be made.
>
> In regards to plotting a sub-region with plot_point_obs, I actually
added
> the regridding option just a couple weeks ago. And it’s included in
> met-10.0.0_beta3:
> https://github.com/dtcenter/MET/issues/1627
>
> You can regrid the gridded data to a smaller domain prior to
plotting it if
> you’d like.
>
> Thanks
> John
>
> On Mon, Feb 8, 2021 at 2:32 PM binyu.wang at noaa.gov via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467 >
> >
> > Hello again,
> >
> > Just a quick question: plot_point_obs has the powerful function
now, how
> > about the other plot tool? e.g "plot_data_plane"? I guess it will
have
> the
> > same update as well?
> > e.g:
> > To use "plot_data_plane" to make a plot using grib2 file, if I
only want
> to
> > plot a subregion, do I still have to use other tools first to cut
the
> > subregion out before using "plot_data_plane"?
> >
> > Thank you.
> > Binyu
> >
> > On Wed, Feb 3, 2021 at 11:46 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Binyu,
> > >
> > > Here's a few GitHub issues which describe recent enhancements to
> > > plot_point_obs:
> > > https://github.com/dtcenter/MET/issues/1528
> > > https://github.com/dtcenter/MET/issues/1052
> > > https://github.com/dtcenter/MET/issues/1627
> > >
> > > All of these changes were made after the met-9.1 release and in
> > preparation
> > > for the met-10.0.0 release. If you'd like to test them out, I'd
> recommend
> > > using the met-10.0.0-beta3 release, which is our most recent
> development
> > > version for met-10.0.0. Please note that this code is only
intended for
> > > testing and should not be used operational evaluation.
> > >
> > > It's already installed on WCOSS, and you can find the details on
this
> > page.
> > > Just click the "NOAA machines" tab:
> > > http://dtcenter.org/community-code/metplus/metplus-4-0-existing-
builds
> > >
> > > As for an example, here's one we run as part of the unit tests
for MET:
> > >
> > > export TO_GRID="NONE"
> > > plot_point_obs \
> > > pb2nc/ndas.20120409.t12z.prepbufr.tm00.nc \
> > > plot_point_obs/nam_and_ndas.20120409.t12z.prepbufr_CONFIG.ps \
> > > -point_obs ascii2nc/trmm_2012040912_3hr.nc \
> > > -plot_grid grib2/nam/nam_2012040900_F012.grib2 \
> > > -config PlotPointObsConfig \
> > > -title "NAM 2012040900 F12 vs NDAS 500mb RH and TRMM 3h > 0" \
> > > -v 3
> > >
> > > Here's a link to the config file, which has all the important
details:
> > >
> >
>
https://github.com/dtcenter/MET/blob/develop/test/config/PlotPointObsConfig
> > >
> > > And please see the updated documentation for this tool:
> > >
> > >
> >
>
https://dtcenter.github.io/MET/develop/Users_Guide/plotting.html#plot-
point-obs-usage
> > >
> > > Here's the output of the sample command above:
> > > [image: nam_and_ndas.20120409.t12z.prepbufr_CONFIG.png]
> > > So this plots a gridded base image, and then 3 different types
of point
> > > observations.
> > >
> > > John
> > >
> > >
> > > On Tue, Feb 2, 2021 at 9:14 PM binyu.wang at noaa.gov via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
>
> > > >
> > > > Hello John,
> > > >
> > > > You are absolutely right. I do NOT want the ensemble mean, and
I want
> > the
> > > > individual member instead. I do realize that after I sent the
email
> for
> > > > help. I did figure out how to get vl1l2 using UGRD/VGRD. But I
do
> have
> > a
> > > > question: last time I did a similar thing using ensemble data.
I had
> to
> > > > extract the WDIR from each member and make a scatter plot
(obs. WIND
> > for
> > > > x-axis, difference WDIR b/t obs and model for y-axis), which
takes a
> > lot
> > > of
> > > > time. So is it possible that MET could add some function like
that in
> > the
> > > > future? WDIR is an important factor.
> > > >
> > > > One more thing: I recall that you have updated the
"plot_point_obs",
> so
> > > it
> > > > can make plot for only a certain pressure level now.Which
version has
> > the
> > > > new function? How to use it?
> > > >
> > > > Thank you.
> > > > Binyu
> > > >
> > > > On Mon, Feb 1, 2021 at 1:43 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Binyu,
> > > > >
> > > > > I see that you have a question about why you are NOT getting
any
> > output
> > > > for
> > > > > the VCNT, VL1L2, CNT, or FHO line types. I logged on to
WCOSS and
> > took
> > > a
> > > > > look in:
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719
> > > > >
> > > > > In there, you're verifying ensemble probability fields,
like:
> > > > > WIND_Z10_ENS_FREQ_le1
> > > > > and
> > > > > WIND_P850_ENS_FREQ_le1
> > > > >
> > > > > So this is the probability of WIND SPEED being less than 1,
as
> > computed
> > > > by
> > > > > the Ensemble-Stat tool.
> > > > >
> > > > > Probability fields are evaluated in MET by the line types
which
> begin
> > > > with
> > > > > 'P'... PCT, PTSD, PJC, and PRC. You can request whatever
line types
> > > you'd
> > > > > like in the Grid-Stat configuration file, but if you don't
pass
> data
> > > > which
> > > > > applies to the corresponding verification logic, then you'll
get
> > empty
> > > > > output files.
> > > > >
> > > > > And that's what's going on here.
> > > > >
> > > > > Specifically, the vector line types, VL1L2, VAL1L2, and VCT
are
> only
> > > > > created when processing the U and V wind components.
> > > > >
> > > > > And the scalar continuous statistics line types (SL1L2,
SAL1L2, and
> > > CNT)
> > > > > only apply to scalar data. That includes wind speed... not
the
> > > > probability
> > > > > of wind speed.
> > > > >
> > > > > If you define categorical threshold for the scalar data, you
can
> also
> > > get
> > > > > categorical statistics line type (FHO, CTC, and CTS).
> > > > >
> > > > > It looks like your Ensemble-Stat config file already
includes the
> > > > ensemble
> > > > > mean field in the output:
> > > > >
> > > > > ncdump -h
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > float WIND_Z10_ENS_MEAN(lat, lon) ;
> > > > > float WIND_P850_ENS_MEAN(lat, lon) ;
> > > > >
> > > > > So just add those to the list of fields to be evaluated by
> Grid-Stat.
> > > And
> > > > > define meaningful categorical thresholds for them:
> > > > >
> > > > > In fcst...
> > > > >
> > > > > { name = "WIND_Z10_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > gt5,
> > > > > gt10 ]; }
> > > > > { name = "WIND_P850_ENS_MEAN"; prob = FALSE; cat_thresh = [
gt1,
> gt3,
> > > > gt5,
> > > > > gt10 ]; }
> > > > >
> > > > > And then make similar entries in the obs dictionary.
> > > > >
> > > > > Getting the vector statistics is a little trickier. Can you
confirm
> > > that
> > > > > you want vector statistics for the ensemble mean... and not
for the
> > > > > individual members? Is that correct?
> > > > >
> > > > > Hope that helps.
> > > > >
> > > > > Thanks,
> > > > > John Halley Gotway
> > > > >
> > > > > On Sun, Jan 31, 2021 at 3:05 PM binyu.wang at noaa.gov via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Sun Jan 31 15:05:03 2021: Request 98467 was acted upon.
> > > > > > Transaction: Ticket created by binyu.wang at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: empty output
> > > > > > Owner: Nobody
> > > > > > Requestors: binyu.wang at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98467
> > > > >
> > > > > >
> > > > > >
> > > > > > Hello,
> > > > > >
> > > > > > I was trying to verify the WIND profile using HREF vs.
NDAS obs.
> > data
> > > > > and I
> > > > > > can not get the result that I want. Here is the log file:
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_met_hrefv3.52121495
> > > > > > It is weird that the "match is found for P850 and Z10",
and one
> of
> > > the
> > > > > > output "
grid_stat_href_test_120000L_20210130_000000V.stat" is
> not
> > > > empty,
> > > > > > but the others like " *vcnt, *vl1l2, *cnt, *fho" are all
empty
> > > inside
> > > > > of
> > > > > > the working directory "verf_g2g_hrefv3_00_dev.164719".
> > > > > >
> > > > > > Inside of the working directory "
> > > > > > /gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/
> > > > > > verf_g2g_hrefv3_00_dev.164719", I tried
> > > > > > $ grid_stat
ensemble_stat_HREFV3_F12_NDAS_20210130_000000V_ens.nc
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/com/verf/dev/hrefv3.20210130/ndas.t00z.grid227.f00.grib2
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/ptmp/Binyu.Wang/g2g/RFC2/tmpnwprd/verf_g2g_hrefv3_00_dev.164719/verf_g2g_grid_stat_href_config_ndas
> > > > > > -v 3 > testlog3
> > > > > > There is no any ERROR message, but I just got empty "
*vcnt,
> > *vl1l2,
> > > > > *cnt,
> > > > > > *fho" etc.
> > > > > >
> > > > > > What is the problem here? Thank you.
> > > > > > Binyu
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list