[Met_help] [rt.rap.ucar.edu #80446] History for define ensemble stat
John Halley Gotway via RT
met_help at ucar.edu
Wed May 17 09:16:20 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi All,
I'm not quit understand the instruction of defining the ensemble files in ensemble configure file.
If I have 5 emsemble members, which are wrfoutm1_d01_**, wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the second command line, follow below:
bin/ensemble_stat \
6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
tutorial/config/EnsembleStatConfig_APCP_24 \
-grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
-point_obs out/ascii2nc/precip24_2010010112.nc \
-outdir tutorial/out/ensemble_stat -v 2
**********
what does the *gep*/ mean?
Thank you very much!
Mandy
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: define ensemble stat
From: John Halley Gotway
Time: Fri May 12 14:09:25 2017
Mandy,
I see that you have a question about passing ensemble member files to
the
ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
in particular. It's just an example where we had output for different
ensemble members stored in different directories. If your ensemble
member
files have different file names, just pass them in on the command
line.
Something like this:
bin/ensemble_stat \
5 wrfoutm*_d01_{TIMESTAMP}.grib \
tutorial/config/EnsembleStatConfig_APCP_24 \
-grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
-point_obs out/ascii2nc/precip24_2010010112.nc \
-outdir tutorial/out/ensemble_stat -v 2
Hope that helps.
Thanks,
John Halley Gotway
On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> Transaction: Ticket created by Man.Zhang-1 at ou.edu
> Queue: met_help
> Subject: define ensemble stat
> Owner: Nobody
> Requestors: Man.Zhang-1 at ou.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
>
> Hi All,
>
> I'm not quit understand the instruction of defining the
ensemble
> files in ensemble configure file.
>
> If I have 5 emsemble members, which are wrfoutm1_d01_**,
> wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> command line, follow below:
>
> bin/ensemble_stat \
> 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> **********
>
> what does the *gep*/ mean?
>
> Thank you very much!
>
> Mandy
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Mon May 15 15:37:53 2017
Hi John,
Thank you for your answer.
If I have different file names, can I do like this:
bin/ensemble_stat \
5 wrfoutm1ek1_d01_{TIMESTAMP}.grib wrfoutm2ek2_d01_{TIMESTAMP}.grib
wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
wrfoutm5ek5_d01_{TIMESTAMP}.grib\
tutorial/config/EnsembleStatConfig_APCP_24 \
-grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
Is it right?
Thank you very much!
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Friday, May 12, 2017 3:09:26 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Mandy,
I see that you have a question about passing ensemble member files to
the
ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
in particular. It's just an example where we had output for different
ensemble members stored in different directories. If your ensemble
member
files have different file names, just pass them in on the command
line.
Something like this:
bin/ensemble_stat \
5 wrfoutm*_d01_{TIMESTAMP}.grib \
tutorial/config/EnsembleStatConfig_APCP_24 \
-grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
-point_obs out/ascii2nc/precip24_2010010112.nc \
-outdir tutorial/out/ensemble_stat -v 2
Hope that helps.
Thanks,
John Halley Gotway
On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> Transaction: Ticket created by Man.Zhang-1 at ou.edu
> Queue: met_help
> Subject: define ensemble stat
> Owner: Nobody
> Requestors: Man.Zhang-1 at ou.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
>
> Hi All,
>
> I'm not quit understand the instruction of defining the
ensemble
> files in ensemble configure file.
>
> If I have 5 emsemble members, which are wrfoutm1_d01_**,
> wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> command line, follow below:
>
> bin/ensemble_stat \
> 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> **********
>
> what does the *gep*/ mean?
>
> Thank you very much!
>
> Mandy
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: John Halley Gotway
Time: Mon May 15 15:43:17 2017
Yes, that should work.
Thanks,
John
On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Thank you for your answer.
>
> If I have different file names, can I do like this:
>
> bin/ensemble_stat \
> 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
>
>
> Is it right?
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, May 12, 2017 3:09:26 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I see that you have a question about passing ensemble member files
to the
> ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
> in particular. It's just an example where we had output for
different
> ensemble members stored in different directories. If your ensemble
member
> files have different file names, just pass them in on the command
line.
> Something like this:
>
> bin/ensemble_stat \
> 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
>
> On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > Queue: met_help
> > Subject: define ensemble stat
> > Owner: Nobody
> > Requestors: Man.Zhang-1 at ou.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> >
> > Hi All,
> >
> > I'm not quit understand the instruction of defining the
ensemble
> > files in ensemble configure file.
> >
> > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > command line, follow below:
> >
> > bin/ensemble_stat \
> > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > **********
> >
> > what does the *gep*/ mean?
> >
> > Thank you very much!
> >
> > Mandy
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Mon May 15 15:46:59 2017
Hi John，
Another question, can Met calculate ROC and AUC score?
Thank you!
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, May 15, 2017 4:43:17 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Yes, that should work.
Thanks,
John
On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Thank you for your answer.
>
> If I have different file names, can I do like this:
>
> bin/ensemble_stat \
> 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
>
>
> Is it right?
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, May 12, 2017 3:09:26 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I see that you have a question about passing ensemble member files
to the
> ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
> in particular. It's just an example where we had output for
different
> ensemble members stored in different directories. If your ensemble
member
> files have different file names, just pass them in on the command
line.
> Something like this:
>
> bin/ensemble_stat \
> 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
>
> On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > Queue: met_help
> > Subject: define ensemble stat
> > Owner: Nobody
> > Requestors: Man.Zhang-1 at ou.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> >
> > Hi All,
> >
> > I'm not quit understand the instruction of defining the
ensemble
> > files in ensemble configure file.
> >
> > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > command line, follow below:
> >
> > bin/ensemble_stat \
> > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > **********
> >
> > what does the *gep*/ mean?
> >
> > Thank you very much!
> >
> > Mandy
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: John Halley Gotway
Time: Mon May 15 16:14:30 2017
Mandy,
Please refer to table 7.11 of the MET User's Guide:
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.0.pdf
The PSTD line type from Ensemble-Stat includes the ROC area under the
curve.
Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
files on the command line. Please give it a try and let me know if
you
have more questions.
Thanks,
John
On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Thank you for your answer.
>
> If I have different file names, can I do like this:
>
> bin/ensemble_stat \
> 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
>
>
> Is it right?
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, May 12, 2017 3:09:26 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I see that you have a question about passing ensemble member files
to the
> ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
> in particular. It's just an example where we had output for
different
> ensemble members stored in different directories. If your ensemble
member
> files have different file names, just pass them in on the command
line.
> Something like this:
>
> bin/ensemble_stat \
> 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
>
> On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > Queue: met_help
> > Subject: define ensemble stat
> > Owner: Nobody
> > Requestors: Man.Zhang-1 at ou.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> >
> > Hi All,
> >
> > I'm not quit understand the instruction of defining the
ensemble
> > files in ensemble configure file.
> >
> > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > command line, follow below:
> >
> > bin/ensemble_stat \
> > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > **********
> >
> > what does the *gep*/ mean?
> >
> > Thank you very much!
> >
> > Mandy
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Tue May 16 08:04:42 2017
Thank you John， and I'll try it.
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, May 15, 2017 5:14:31 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Mandy,
Please refer to table 7.11 of the MET User's Guide:
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.0.pdf
The PSTD line type from Ensemble-Stat includes the ROC area under the
curve.
Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
files on the command line. Please give it a try and let me know if
you
have more questions.
Thanks,
John
On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Thank you for your answer.
>
> If I have different file names, can I do like this:
>
> bin/ensemble_stat \
> 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
>
>
> Is it right?
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, May 12, 2017 3:09:26 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I see that you have a question about passing ensemble member files
to the
> ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
> in particular. It's just an example where we had output for
different
> ensemble members stored in different directories. If your ensemble
member
> files have different file names, just pass them in on the command
line.
> Something like this:
>
> bin/ensemble_stat \
> 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
>
> On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > Queue: met_help
> > Subject: define ensemble stat
> > Owner: Nobody
> > Requestors: Man.Zhang-1 at ou.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> >
> > Hi All,
> >
> > I'm not quit understand the instruction of defining the
ensemble
> > files in ensemble configure file.
> >
> > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > command line, follow below:
> >
> > bin/ensemble_stat \
> > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > **********
> >
> > what does the *gep*/ mean?
> >
> > Thank you very much!
> >
> > Mandy
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Tue May 16 12:48:07 2017
Hi John,
The ensemble-stat works well. I find that table 7.11 is from
point-stat tool, if my observation is grid-data, I need to use grid-
stat tool, from the tables in grid-stat tool, there's no AUC
information.
How to calculate it if using grid-stat tool?
And I try to use point-stat tool to read grid data, the error
is: can't read level (*,*)..
Thank you!
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Monday, May 15, 2017 5:14:31 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Mandy,
Please refer to table 7.11 of the MET User's Guide:
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.0.pdf
The PSTD line type from Ensemble-Stat includes the ROC area under the
curve.
Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
files on the command line. Please give it a try and let me know if
you
have more questions.
Thanks,
John
On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Thank you for your answer.
>
> If I have different file names, can I do like this:
>
> bin/ensemble_stat \
> 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
>
>
> Is it right?
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Friday, May 12, 2017 3:09:26 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I see that you have a question about passing ensemble member files
to the
> ensembe_stat tool. The "gep" in the example you sent doesn't mean
anything
> in particular. It's just an example where we had output for
different
> ensemble members stored in different directories. If your ensemble
member
> files have different file names, just pass them in on the command
line.
> Something like this:
>
> bin/ensemble_stat \
> 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> tutorial/config/EnsembleStatConfig_APCP_24 \
> -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> -point_obs out/ascii2nc/precip24_2010010112.nc \
> -outdir tutorial/out/ensemble_stat -v 2
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
>
>
> On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > Queue: met_help
> > Subject: define ensemble stat
> > Owner: Nobody
> > Requestors: Man.Zhang-1 at ou.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> >
> > Hi All,
> >
> > I'm not quit understand the instruction of defining the
ensemble
> > files in ensemble configure file.
> >
> > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > command line, follow below:
> >
> > bin/ensemble_stat \
> > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > **********
> >
> > what does the *gep*/ mean?
> >
> > Thank you very much!
> >
> > Mandy
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: John Halley Gotway
Time: Tue May 16 13:03:36 2017
Mandy,
I apologize for misleading you. The PSTD line type contains
statistics for
verifying probabilistic forecasts. Both the Grid-Stat and Point-Stat
tools
can be used to verify probabilistic forecasts. As you've seen Grid-
Stat
does grid-to-grid verification and Point-Stat does grid-to-point
verification. But they both write the exact same PSTD line type.
If you are verifying a probabilistic forecast field against
deterministic
observations, then computing the PSTD line type and looking at the
area
under the curve would be appropriate.
I see that you're having trouble getting the config file to do what
you'd
like. Might be easiest to just have you post sample data files, along
with
your current Grid-Stat config file to our anonymous ftp site. I can
grab
the data and suggset how to set up your config file.
Here are instructions for posting to our ftp site:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
If you post data there, please write me back so that I know to go grab
it.
Thanks,
John
On Tue, May 16, 2017 at 12:48 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> The ensemble-stat works well. I find that table 7.11 is from
> point-stat tool, if my observation is grid-data, I need to use grid-
stat
> tool, from the tables in grid-stat tool, there's no AUC information.
>
> How to calculate it if using grid-stat tool?
>
> And I try to use point-stat tool to read grid data, the error
is:
> can't read level (*,*)..
>
> Thank you!
>
> Mandy
>
>
>
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, May 15, 2017 5:14:31 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> Please refer to table 7.11 of the MET User's Guide:
> http://www.dtcenter.org/met/users/docs/users_guide/MET_
> Users_Guide_v6.0.pdf
>
> The PSTD line type from Ensemble-Stat includes the ROC area under
the
> curve.
>
> Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
> files on the command line. Please give it a try and let me know if
you
> have more questions.
>
> Thanks,
> John
>
> On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> > Hi John,
> >
> > Thank you for your answer.
> >
> > If I have different file names, can I do like this:
> >
> > bin/ensemble_stat \
> > 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> > wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> > wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> >
> >
> > Is it right?
> >
> > Thank you very much!
> >
> > Mandy
> >
> > ________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Friday, May 12, 2017 3:09:26 PM
> > To: Zhang, Mandy
> > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> >
> > Mandy,
> >
> > I see that you have a question about passing ensemble member files
to the
> > ensembe_stat tool. The "gep" in the example you sent doesn't mean
> anything
> > in particular. It's just an example where we had output for
different
> > ensemble members stored in different directories. If your
ensemble
> member
> > files have different file names, just pass them in on the command
line.
> > Something like this:
> >
> > bin/ensemble_stat \
> > 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> > On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > > Queue: met_help
> > > Subject: define ensemble stat
> > > Owner: Nobody
> > > Requestors: Man.Zhang-1 at ou.edu
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446
> >
> > >
> > >
> > > Hi All,
> > >
> > > I'm not quit understand the instruction of defining the
ensemble
> > > files in ensemble configure file.
> > >
> > > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > > command line, follow below:
> > >
> > > bin/ensemble_stat \
> > > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > -outdir tutorial/out/ensemble_stat -v 2
> > >
> > > **********
> > >
> > > what does the *gep*/ mean?
> > >
> > > Thank you very much!
> > >
> > > Mandy
> > >
> > >
> > >
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Tue May 16 13:37:30 2017
Hi John,
the data is post to zhang_data , thank you!
ensemble_stat_20160427_060000V_ens.nc comes from ensemble_stat tool
and QPE_20160427_6thr.nc is the observation.
Thanks
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Tuesday, May 16, 2017 2:03:36 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Mandy,
I apologize for misleading you. The PSTD line type contains
statistics for
verifying probabilistic forecasts. Both the Grid-Stat and Point-Stat
tools
can be used to verify probabilistic forecasts. As you've seen Grid-
Stat
does grid-to-grid verification and Point-Stat does grid-to-point
verification. But they both write the exact same PSTD line type.
If you are verifying a probabilistic forecast field against
deterministic
observations, then computing the PSTD line type and looking at the
area
under the curve would be appropriate.
I see that you're having trouble getting the config file to do what
you'd
like. Might be easiest to just have you post sample data files, along
with
your current Grid-Stat config file to our anonymous ftp site. I can
grab
the data and suggset how to set up your config file.
Here are instructions for posting to our ftp site:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
If you post data there, please write me back so that I know to go grab
it.
Thanks,
John
On Tue, May 16, 2017 at 12:48 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> The ensemble-stat works well. I find that table 7.11 is from
> point-stat tool, if my observation is grid-data, I need to use grid-
stat
> tool, from the tables in grid-stat tool, there's no AUC information.
>
> How to calculate it if using grid-stat tool?
>
> And I try to use point-stat tool to read grid data, the error
is:
> can't read level (*,*)..
>
> Thank you!
>
> Mandy
>
>
>
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, May 15, 2017 5:14:31 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> Please refer to table 7.11 of the MET User's Guide:
> http://www.dtcenter.org/met/users/docs/users_guide/MET_
> Users_Guide_v6.0.pdf
>
> The PSTD line type from Ensemble-Stat includes the ROC area under
the
> curve.
>
> Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
> files on the command line. Please give it a try and let me know if
you
> have more questions.
>
> Thanks,
> John
>
> On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> > Hi John,
> >
> > Thank you for your answer.
> >
> > If I have different file names, can I do like this:
> >
> > bin/ensemble_stat \
> > 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> > wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> > wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> >
> >
> > Is it right?
> >
> > Thank you very much!
> >
> > Mandy
> >
> > ________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Friday, May 12, 2017 3:09:26 PM
> > To: Zhang, Mandy
> > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> >
> > Mandy,
> >
> > I see that you have a question about passing ensemble member files
to the
> > ensembe_stat tool. The "gep" in the example you sent doesn't mean
> anything
> > in particular. It's just an example where we had output for
different
> > ensemble members stored in different directories. If your
ensemble
> member
> > files have different file names, just pass them in on the command
line.
> > Something like this:
> >
> > bin/ensemble_stat \
> > 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> > On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > > Queue: met_help
> > > Subject: define ensemble stat
> > > Owner: Nobody
> > > Requestors: Man.Zhang-1 at ou.edu
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446
> >
> > >
> > >
> > > Hi All,
> > >
> > > I'm not quit understand the instruction of defining the
ensemble
> > > files in ensemble configure file.
> > >
> > > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > > command line, follow below:
> > >
> > > bin/ensemble_stat \
> > > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > -outdir tutorial/out/ensemble_stat -v 2
> > >
> > > **********
> > >
> > > what does the *gep*/ mean?
> > >
> > > Thank you very much!
> > >
> > > Mandy
> > >
> > >
> > >
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Tue May 16 15:53:25 2017
Hi John,
Just let you know the grid_stat_ensemble works~
Thank you very much!
Mandy
________________________________
From: Zhang, Mandy
Sent: Tuesday, May 16, 2017 2:37:25 PM
To: met_help at ucar.edu
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Hi John,
the data is post to zhang_data , thank you!
ensemble_stat_20160427_060000V_ens.nc comes from ensemble_stat tool
and QPE_20160427_6thr.nc is the observation.
Thanks
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Tuesday, May 16, 2017 2:03:36 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Mandy,
I apologize for misleading you. The PSTD line type contains
statistics for
verifying probabilistic forecasts. Both the Grid-Stat and Point-Stat
tools
can be used to verify probabilistic forecasts. As you've seen Grid-
Stat
does grid-to-grid verification and Point-Stat does grid-to-point
verification. But they both write the exact same PSTD line type.
If you are verifying a probabilistic forecast field against
deterministic
observations, then computing the PSTD line type and looking at the
area
under the curve would be appropriate.
I see that you're having trouble getting the config file to do what
you'd
like. Might be easiest to just have you post sample data files, along
with
your current Grid-Stat config file to our anonymous ftp site. I can
grab
the data and suggset how to set up your config file.
Here are instructions for posting to our ftp site:
http://www.dtcenter.org/met/users/support/met_help.php#ftp
If you post data there, please write me back so that I know to go grab
it.
Thanks,
John
On Tue, May 16, 2017 at 12:48 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> The ensemble-stat works well. I find that table 7.11 is from
> point-stat tool, if my observation is grid-data, I need to use grid-
stat
> tool, from the tables in grid-stat tool, there's no AUC information.
>
> How to calculate it if using grid-stat tool?
>
> And I try to use point-stat tool to read grid data, the error
is:
> can't read level (*,*)..
>
> Thank you!
>
> Mandy
>
>
>
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Monday, May 15, 2017 5:14:31 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> Please refer to table 7.11 of the MET User's Guide:
> http://www.dtcenter.org/met/users/docs/users_guide/MET_
> Users_Guide_v6.0.pdf
>
> The PSTD line type from Ensemble-Stat includes the ROC area under
the
> curve.
>
> Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
> files on the command line. Please give it a try and let me know if
you
> have more questions.
>
> Thanks,
> John
>
> On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> > Hi John,
> >
> > Thank you for your answer.
> >
> > If I have different file names, can I do like this:
> >
> > bin/ensemble_stat \
> > 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> > wrfoutm3ek3_d01_{TIMESTAMP}.grib wrfoutm4ek4_d01_{TIMESTAMP}.grib
> > wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> >
> >
> > Is it right?
> >
> > Thank you very much!
> >
> > Mandy
> >
> > ________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Friday, May 12, 2017 3:09:26 PM
> > To: Zhang, Mandy
> > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> >
> > Mandy,
> >
> > I see that you have a question about passing ensemble member files
to the
> > ensembe_stat tool. The "gep" in the example you sent doesn't mean
> anything
> > in particular. It's just an example where we had output for
different
> > ensemble members stored in different directories. If your
ensemble
> member
> > files have different file names, just pass them in on the command
line.
> > Something like this:
> >
> > bin/ensemble_stat \
> > 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> > tutorial/config/EnsembleStatConfig_APCP_24 \
> > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > -outdir tutorial/out/ensemble_stat -v 2
> >
> > Hope that helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> > On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > > Queue: met_help
> > > Subject: define ensemble stat
> > > Owner: Nobody
> > > Requestors: Man.Zhang-1 at ou.edu
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446
> >
> > >
> > >
> > > Hi All,
> > >
> > > I'm not quit understand the instruction of defining the
ensemble
> > > files in ensemble configure file.
> > >
> > > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
second
> > > command line, follow below:
> > >
> > > bin/ensemble_stat \
> > > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib \
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > -outdir tutorial/out/ensemble_stat -v 2
> > >
> > > **********
> > >
> > > what does the *gep*/ mean?
> > >
> > > Thank you very much!
> > >
> > > Mandy
> > >
> > >
> > >
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: John Halley Gotway
Time: Tue May 16 16:35:16 2017
Mandy,
Thanks for sending the sample data. I grabbed it and was able to run
with
your Grid-Stat config file. However, I'm a little puzzled by the
naming
convention of the QPE_20160427_6thr.nc file. The data variable is
named
"pres", suggesting that it's pressure data, but looking at the data it
does
actually look like precip.
So I'll assume that you really do want to compare the forecast precip
in
ensemble_stat_20160427_060000V_ens.nc to the poorly named "pres"
variable.
When you ran ensemble-stat, you computed relative frequencies using
two
thresholds as seen by these NetCDF variable names:
float APCP_01_A1_ENS_FREQ_gt0.0(lat, lon) ;
float APCP_01_A1_ENS_FREQ_ge1.0(lat, lon) ;
I've set up the attached Grid-Stat config file to evaluate the
ensemble
mean field (APCP_01_A1_ENS_MEAN) as well as the relative frequencies
listed
above.
Please see the attached config file. Notice the following:
(1) I've specified 3 forecast fields and 3 observed fields.
(2) In the 2nd and 3rd forecast fields, I set "prob = TRUE" to tell
Grid-Stat to process this data as probabilities.
(3) In the 2nd and 3rd forecast fields, I set cat_thresh = a long list
of
probability thresholds. Read page 114 of the MET User's Guide:
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.0.pdf
(4) In the obs section, since "name" and "level" are fixed for all 3
fields, I just pulled them out one level above. That's a nice trick
for
making a shorter config file.
(5) In the 2nd and 3rd obs fields, I set "cat_thresh" to the threshold
used
to define the probability that you're evaluating.
(6) In output_flag, I turned on the probabilistic output line type
(PSTD,
PJC, PRC, PCT).
(7) I left SL1L2 and CNT turned on since you had them on. Usually
people
don't evaluate precip using continuous statistics, like RMSE. But you
can
if you want to.
Hope that helps.
Thanks,
John
On Tue, May 16, 2017 at 3:53 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Just let you know the grid_stat_ensemble works~
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: Zhang, Mandy
> Sent: Tuesday, May 16, 2017 2:37:25 PM
> To: met_help at ucar.edu
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
>
> Hi John,
>
> the data is post to zhang_data , thank you!
> ensemble_stat_20160427_060000V_ens.nc comes from ensemble_stat tool
and
> QPE_20160427_6thr.nc is the observation.
>
> Thanks
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Tuesday, May 16, 2017 2:03:36 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I apologize for misleading you. The PSTD line type contains
statistics for
> verifying probabilistic forecasts. Both the Grid-Stat and Point-
Stat tools
> can be used to verify probabilistic forecasts. As you've seen Grid-
Stat
> does grid-to-grid verification and Point-Stat does grid-to-point
> verification. But they both write the exact same PSTD line type.
>
> If you are verifying a probabilistic forecast field against
deterministic
> observations, then computing the PSTD line type and looking at the
area
> under the curve would be appropriate.
>
> I see that you're having trouble getting the config file to do what
you'd
> like. Might be easiest to just have you post sample data files,
along with
> your current Grid-Stat config file to our anonymous ftp site. I can
grab
> the data and suggset how to set up your config file.
>
> Here are instructions for posting to our ftp site:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> If you post data there, please write me back so that I know to go
grab it.
>
> Thanks,
> John
>
> On Tue, May 16, 2017 at 12:48 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> > Hi John,
> >
> > The ensemble-stat works well. I find that table 7.11 is from
> > point-stat tool, if my observation is grid-data, I need to use
grid-stat
> > tool, from the tables in grid-stat tool, there's no AUC
information.
> >
> > How to calculate it if using grid-stat tool?
> >
> > And I try to use point-stat tool to read grid data, the
error is:
> > can't read level (*,*)..
> >
> > Thank you!
> >
> > Mandy
> >
> >
> >
> >
> > ________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Monday, May 15, 2017 5:14:31 PM
> > To: Zhang, Mandy
> > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> >
> > Mandy,
> >
> > Please refer to table 7.11 of the MET User's Guide:
> > http://www.dtcenter.org/met/users/docs/users_guide/MET_
> > Users_Guide_v6.0.pdf
> >
> > The PSTD line type from Ensemble-Stat includes the ROC area under
the
> > curve.
> >
> > Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
> > files on the command line. Please give it a try and let me know
if you
> > have more questions.
> >
> > Thanks,
> > John
> >
> > On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> > >
> > > Hi John,
> > >
> > > Thank you for your answer.
> > >
> > > If I have different file names, can I do like this:
> > >
> > > bin/ensemble_stat \
> > > 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> > > wrfoutm3ek3_d01_{TIMESTAMP}.grib
wrfoutm4ek4_d01_{TIMESTAMP}.grib
> > > wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > >
> > >
> > > Is it right?
> > >
> > > Thank you very much!
> > >
> > > Mandy
> > >
> > > ________________________________
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Friday, May 12, 2017 3:09:26 PM
> > > To: Zhang, Mandy
> > > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> > >
> > > Mandy,
> > >
> > > I see that you have a question about passing ensemble member
files to
> the
> > > ensembe_stat tool. The "gep" in the example you sent doesn't
mean
> > anything
> > > in particular. It's just an example where we had output for
different
> > > ensemble members stored in different directories. If your
ensemble
> > member
> > > files have different file names, just pass them in on the
command line.
> > > Something like this:
> > >
> > > bin/ensemble_stat \
> > > 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > -outdir tutorial/out/ensemble_stat -v 2
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > >
> > > On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > > > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > > > Queue: met_help
> > > > Subject: define ensemble stat
> > > > Owner: Nobody
> > > > Requestors: Man.Zhang-1 at ou.edu
> > > > Status: new
> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
> ket/Display.html?id=80446
> > >
> > > >
> > > >
> > > > Hi All,
> > > >
> > > > I'm not quit understand the instruction of defining the
ensemble
> > > > files in ensemble configure file.
> > > >
> > > > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > > > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
> second
> > > > command line, follow below:
> > > >
> > > > bin/ensemble_stat \
> > > > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib
\
> > > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > > -outdir tutorial/out/ensemble_stat -v 2
> > > >
> > > > **********
> > > >
> > > > what does the *gep*/ mean?
> > > >
> > > > Thank you very much!
> > > >
> > > > Mandy
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
------------------------------------------------
Subject: define ensemble stat
From: Zhang, Mandy
Time: Wed May 17 07:40:42 2017
John,
It teaches me how to well set MET configure file and is very
helpful.
Yes, pres is short name of "precipitation" , I give a confused name of
it.
Thanks a lot!
Have a good day!
Mandy
________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Tuesday, May 16, 2017 5:35:17 PM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
Mandy,
Thanks for sending the sample data. I grabbed it and was able to run
with
your Grid-Stat config file. However, I'm a little puzzled by the
naming
convention of the QPE_20160427_6thr.nc file. The data variable is
named
"pres", suggesting that it's pressure data, but looking at the data it
does
actually look like precip.
So I'll assume that you really do want to compare the forecast precip
in
ensemble_stat_20160427_060000V_ens.nc to the poorly named "pres"
variable.
When you ran ensemble-stat, you computed relative frequencies using
two
thresholds as seen by these NetCDF variable names:
float APCP_01_A1_ENS_FREQ_gt0.0(lat, lon) ;
float APCP_01_A1_ENS_FREQ_ge1.0(lat, lon) ;
I've set up the attached Grid-Stat config file to evaluate the
ensemble
mean field (APCP_01_A1_ENS_MEAN) as well as the relative frequencies
listed
above.
Please see the attached config file. Notice the following:
(1) I've specified 3 forecast fields and 3 observed fields.
(2) In the 2nd and 3rd forecast fields, I set "prob = TRUE" to tell
Grid-Stat to process this data as probabilities.
(3) In the 2nd and 3rd forecast fields, I set cat_thresh = a long list
of
probability thresholds. Read page 114 of the MET User's Guide:
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v6.0.pdf
(4) In the obs section, since "name" and "level" are fixed for all 3
fields, I just pulled them out one level above. That's a nice trick
for
making a shorter config file.
(5) In the 2nd and 3rd obs fields, I set "cat_thresh" to the threshold
used
to define the probability that you're evaluating.
(6) In output_flag, I turned on the probabilistic output line type
(PSTD,
PJC, PRC, PCT).
(7) I left SL1L2 and CNT turned on since you had them on. Usually
people
don't evaluate precip using continuous statistics, like RMSE. But you
can
if you want to.
Hope that helps.
Thanks,
John
On Tue, May 16, 2017 at 3:53 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
>
> Hi John,
>
> Just let you know the grid_stat_ensemble works~
>
> Thank you very much!
>
> Mandy
>
> ________________________________
> From: Zhang, Mandy
> Sent: Tuesday, May 16, 2017 2:37:25 PM
> To: met_help at ucar.edu
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
>
> Hi John,
>
> the data is post to zhang_data , thank you!
> ensemble_stat_20160427_060000V_ens.nc comes from ensemble_stat tool
and
> QPE_20160427_6thr.nc is the observation.
>
> Thanks
>
> Mandy
>
> ________________________________
> From: John Halley Gotway via RT <met_help at ucar.edu>
> Sent: Tuesday, May 16, 2017 2:03:36 PM
> To: Zhang, Mandy
> Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
>
> Mandy,
>
> I apologize for misleading you. The PSTD line type contains
statistics for
> verifying probabilistic forecasts. Both the Grid-Stat and Point-
Stat tools
> can be used to verify probabilistic forecasts. As you've seen Grid-
Stat
> does grid-to-grid verification and Point-Stat does grid-to-point
> verification. But they both write the exact same PSTD line type.
>
> If you are verifying a probabilistic forecast field against
deterministic
> observations, then computing the PSTD line type and looking at the
area
> under the curve would be appropriate.
>
> I see that you're having trouble getting the config file to do what
you'd
> like. Might be easiest to just have you post sample data files,
along with
> your current Grid-Stat config file to our anonymous ftp site. I can
grab
> the data and suggset how to set up your config file.
>
> Here are instructions for posting to our ftp site:
> http://www.dtcenter.org/met/users/support/met_help.php#ftp
>
> If you post data there, please write me back so that I know to go
grab it.
>
> Thanks,
> John
>
> On Tue, May 16, 2017 at 12:48 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> >
> > Hi John,
> >
> > The ensemble-stat works well. I find that table 7.11 is from
> > point-stat tool, if my observation is grid-data, I need to use
grid-stat
> > tool, from the tables in grid-stat tool, there's no AUC
information.
> >
> > How to calculate it if using grid-stat tool?
> >
> > And I try to use point-stat tool to read grid data, the
error is:
> > can't read level (*,*)..
> >
> > Thank you!
> >
> > Mandy
> >
> >
> >
> >
> > ________________________________
> > From: John Halley Gotway via RT <met_help at ucar.edu>
> > Sent: Monday, May 15, 2017 5:14:31 PM
> > To: Zhang, Mandy
> > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> >
> > Mandy,
> >
> > Please refer to table 7.11 of the MET User's Guide:
> > http://www.dtcenter.org/met/users/docs/users_guide/MET_
> > Users_Guide_v6.0.pdf
> >
> > The PSTD line type from Ensemble-Stat includes the ROC area under
the
> > curve.
> >
> > Yes, Ensemble-Stat expects you to specify the name of the input
ensemble
> > files on the command line. Please give it a try and let me know
if you
> > have more questions.
> >
> > Thanks,
> > John
> >
> > On Mon, May 15, 2017 at 3:37 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80446 >
> > >
> > > Hi John,
> > >
> > > Thank you for your answer.
> > >
> > > If I have different file names, can I do like this:
> > >
> > > bin/ensemble_stat \
> > > 5 wrfoutm1ek1_d01_{TIMESTAMP}.grib
wrfoutm2ek2_d01_{TIMESTAMP}.grib
> > > wrfoutm3ek3_d01_{TIMESTAMP}.grib
wrfoutm4ek4_d01_{TIMESTAMP}.grib
> > > wrfoutm5ek5_d01_{TIMESTAMP}.grib\
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > >
> > >
> > > Is it right?
> > >
> > > Thank you very much!
> > >
> > > Mandy
> > >
> > > ________________________________
> > > From: John Halley Gotway via RT <met_help at ucar.edu>
> > > Sent: Friday, May 12, 2017 3:09:26 PM
> > > To: Zhang, Mandy
> > > Subject: Re: [rt.rap.ucar.edu #80446] define ensemble stat
> > >
> > > Mandy,
> > >
> > > I see that you have a question about passing ensemble member
files to
> the
> > > ensembe_stat tool. The "gep" in the example you sent doesn't
mean
> > anything
> > > in particular. It's just an example where we had output for
different
> > > ensemble members stored in different directories. If your
ensemble
> > member
> > > files have different file names, just pass them in on the
command line.
> > > Something like this:
> > >
> > > bin/ensemble_stat \
> > > 5 wrfoutm*_d01_{TIMESTAMP}.grib \
> > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > -outdir tutorial/out/ensemble_stat -v 2
> > >
> > > Hope that helps.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > >
> > > On Fri, May 12, 2017 at 1:50 PM, Zhang, Mandy via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > Fri May 12 13:50:10 2017: Request 80446 was acted upon.
> > > > Transaction: Ticket created by Man.Zhang-1 at ou.edu
> > > > Queue: met_help
> > > > Subject: define ensemble stat
> > > > Owner: Nobody
> > > > Requestors: Man.Zhang-1 at ou.edu
> > > > Status: new
> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
> ket/Display.html?id=80446
> > >
> > > >
> > > >
> > > > Hi All,
> > > >
> > > > I'm not quit understand the instruction of defining the
ensemble
> > > > files in ensemble configure file.
> > > >
> > > > If I have 5 emsemble members, which are wrfoutm1_d01_**,
> > > > wrfoutm2_d01_**,....wrfoutm5_d01***, how to define them in the
> second
> > > > command line, follow below:
> > > >
> > > > bin/ensemble_stat \
> > > > 6 data/sample_fcst/2009123112/*gep*/d01_2009123112_02400.grib
\
> > > > tutorial/config/EnsembleStatConfig_APCP_24 \
> > > > -grid_obs data/sample_obs/ST4/ST4.2010010112.24h \
> > > > -point_obs out/ascii2nc/precip24_2010010112.nc \
> > > > -outdir tutorial/out/ensemble_stat -v 2
> > > >
> > > > **********
> > > >
> > > > what does the *gep*/ mean?
> > > >
> > > > Thank you very much!
> > > >
> > > > Mandy
> > > >
> > > >
> > > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
------------------------------------------------
More information about the Met_help
mailing list