[Met_help] [rt.rap.ucar.edu #55009] History for skill scores
John Halley Gotway via RT
met_help at ucar.edu
Tue Apr 3 13:24:04 MDT 2012
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I want to understand how to get model skill scores(specially CSI, HSS, GSS)
1. Do I need to put all variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
2. What should I put in level_category[] = [ ?] - skill score based on model surface to upper atmosphere level-200mb)
3. Do I also put all variables in pointstat config file?
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
If you have any sample pb2nc config and pointstat config file for just skill score (category 3) that will be very help.
Thanks,
Anil
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Paul Oldenburg
Time: Thu Mar 08 09:25:21 2012
Anil,
I see that you're not currently a registered user of the MET software.
Prior to providing direct support in the use of
MET, we require that users fill out the free online registration form.
That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
To fill out the registration, just go here:
http://www.dtcenter.org/met/users/downloads/index.php
Enter you email address and hit enter to be taken to the form.
Once you have registered, can you please send me the following
information:
1. point_stat config file
2. type of model data that you want to verify (e.g. GRIB, p_interp,
etc)
Thanks,
Paul
On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
> Transaction: Ticket created by anil.kumar at nasa.gov
> Queue: met_help
> Subject: skill scores
> Owner: Nobody
> Requestors: anil.kumar at nasa.gov
> Status: new
> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
> Hi,
> I want to understand how to get model skill scores(specially CSI,
HSS, GSS)
>
> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>
> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>
> 3. Do I also put all variables in pointstat config file?
>
> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>
> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>
> If you have any sample pb2nc config and pointstat config file for
just skill score (category 3) that will be very help.
> Thanks,
> Anil
>
------------------------------------------------
Subject: skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Thu Mar 08 12:20:38 2012
Paul,
Thanks for your help. Please find the Point config file.
I am
using P-interp wrf model data(pressure level)
Thanks,
Anil
-----Original Message-----
From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
Sent: Thursday, March 08, 2012 11:25 AM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
I see that you're
not currently a registered user of the MET software. Prior to
providing direct support in the use of MET, we require that users fill
out the free online registration form. That enables us to ensure that
we remain in compliance with the international export laws of the
United States.
To fill out the registration, just go here:
http://www.dtcenter.org/met/users/downloads/index.php
Enter you email
address and hit enter to be taken to the form.
Once you have
registered, can you please send me the following information:
1.
point_stat config file
2. type of model data that you want to verify
(e.g. GRIB, p_interp, etc)
Thanks,
Paul
On 03/08/2012 09:03
AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>
> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
> Transaction:
Ticket created by anil.kumar at nasa.gov
> Queue: met_help
>
Subject: skill scores
> Owner: Nobody
> Requestors:
anil.kumar at nasa.gov
> Status: new
> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
> Hi,
> I want to understand how to get model skill scores(specially CSI,
HSS,
> GSS)
>
> 1. Do I need to put all variables in pb2nc
config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>
> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>
> 3.
Do I also put all variables in pointstat config file?
>
>
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>
>
obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>
> If you
have any sample pb2nc config and pointstat config file for just skill
score (category 3) that will be very help.
> Thanks,
> Anil
>
------------------------------------------------
Subject: skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Thu Mar 08 14:23:09 2012
Paul,
Please find the latest Point config file.
I do get some
output (see below) but I need help to get skill scores only.
Thanks,
Anil
-----Original Message-----
From: Paul Oldenburg
via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 08, 2012
11:25 AM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
Anil,
I see
that you're not currently a registered user of the MET software.
Prior to providing direct support in the use of MET, we require that
users fill out the free online registration form. That enables us to
ensure that we remain in compliance with the international export laws
of the United States.
To fill out the registration, just go here:
http://www.dtcenter.org/met/users/downloads/index.php
Enter you email
address and hit enter to be taken to the form.
Once you have
registered, can you please send me the following information:
1.
point_stat config file
2. type of model data that you want to verify
(e.g. GRIB, p_interp, etc)
Thanks,
Paul
On 03/08/2012 09:03
AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>
> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
> Transaction:
Ticket created by anil.kumar at nasa.gov
> Queue: met_help
>
Subject: skill scores
> Owner: Nobody
> Requestors:
anil.kumar at nasa.gov
> Status: new
> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
> Hi,
> I want to understand how to get model skill scores(specially CSI,
HSS,
> GSS)
>
> 1. Do I need to put all variables in pb2nc
config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>
> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>
> 3.
Do I also put all variables in pointstat config file?
>
>
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>
>
obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>
> If you
have any sample pb2nc config and pointstat config file for just skill
score (category 3) that will be very help.
> Thanks,
> Anil
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Thu Mar 08 14:33:06 2012
Some output
VERSION MODEL FCST_LEAD FCST_VALID_BEG FCST_VALID_END
OBS_LEAD OBS_VALID_BEG OBS_VALID_END FCST_VAR FCST_LEV OBS_VAR
OBS_LEV OBTYPE VX_MASK INTERP_MTHD INTERP_PNTS FCST_THRESH OBS_THRES
H COV_THRESH ALPHA LINE_TYPE TOTAL FBAR FBAR_NCL FBAR_NCU
FBAR_BCL FBAR_BCU FSTDEV FSTDEV_NCL FSTDEV_NCU FSTDEV_BCL
FSTDEV_BCU OBAR OBAR_NCL OBAR_NCU OBAR_BCL OBAR_BCU OSTD
EV
OSTDEV_NCL OSTDEV_NCU OSTDEV_BCL OSTDEV_BCU PR_CORR PR_CORR_NCL
PR_CORR_NCU PR_CORR_BCL PR_CORR_BCU SP_CORR KT_CORR RANKS FRANK_TIES
ORANK_TIES ME ME_NCL ME_NCU ME_BCL ME
_BCU ESTDEV
ESTDEV_NCL ESTDEV_NCU ESTDEV_BCL ESTDEV_BCU MBIAS MBIAS_BCL
MBIAS_BCU MAE MAE_BCL MAE_BCU MSE MSE_BCL MSE_BCU
BCMSE BCMSE_BCL BCMSE_BCU RMSE RMSE
_BCL RMSE_BCU E10
E10_BCL E10_BCU E25 E25_BCL E25_BCU E50 E50_BCL
E50_BCU E75 E75_BCL E75_BCU E90 E90_BCL E90_BCU
V3.0 WRF 120000 20020613_000000 20020613_000000 000000
20020612_230000 20020613_010000 TT P1000-100 TMP P1000-100
ADPUPA SPL LS_FIT 9 NA NA
NA
0.05000 CNT 11 273.51168 261.20063 285.82273 261.27694
283.61275 18.32522 12.80414 32.15954 10.30561 21.55406
306.15000 304.21804 308.08197 304.39445 307.86112 2.87
576 2.00934
5.04677 1.58971 3.75740 -0.42068 -0.84439 0.32681
-0.92774 0.04469 -0.47836 -0.36699 11 0 1
-32.63832 -45.87863 -19.39802 -45.47172 -2
1.74076 19.70843 13.77062
34.58698 11.20862 23.32310 0.89339 0.85207 0.92861 32.63832
21.74076 45.47172 1418.37121 592.59402 2394.94220 353.11109
111.67494 483.52642 37.66127 24.3
4325 48.93811 -59.37399 -65.00446
-28.83925 -50.17513 -65.00446 -17.68464 -19.79795 -51.35643 -15.80723
-16.18215 -33.03522 -15.68160 -15.72914 -18.98419 -15.68160
V3.0
WRF 120000 20020613_000000 20020613_000000 000000
20020612_230000 20020613_010000 QVAPOR P1000-100 MIXR P1000-100
ADPUPA SPL LS_FIT 9 NA NA
NA
0.05000 CNT 11 0.00460 0.00460 0.00460 0.00229
0.00669 0.00000 0.00000 0.00000 0.00000 0.00000 0.01655
0.01655 0.01655 0.01575 0.01740 0.00
000 0.00000 0.00000
0.00000 0.00000 NA NA NA NA NA
-0.65593 -0.44264 11 1 4 -0.01195 -0.01195
-0.01195 -0.01504 -0
.00917 0.00000 0.00000 0.00000 0.00000
0.00000 0.27788 0.13099 0.42264 0.01195 0.00917 0.01504
0.00016 0.00009 0.00024 0.00002 0.00001 0.00003
0.01278 0.00
956 0.01555 -0.01759 -0.01809 -0.01197 -0.01727
-0.01809 -0.01066 -0.01066 -0.01733 -0.00747 -0.00803 -0.01140
-0.00596 -0.00647 -0.01025 -0.00596
V3.0 WRF 120000
20020613_000000 20020613_000000 000000 20020612_230000
20020613_010000 RH P1000-100 RH P1000-100 ADPUPA SPL
LS_FIT 9 NA NA
NA 0.05000
CNT 124 95.11487 92.03864 98.19110 91.63572 98.08698
17.47759 15.53963 19.97248 9.98766 23.36490 41.46234
37.02546 45.89921 36.34192 46.42946 25.2
0809 22.41295 28.80649
22.87578 27.26962 -0.07982 -0.25258 0.09787 -0.15755
-0.00270 -0.06172 -0.05149 124 112 0 53.65253
48.05539 59.24967 47.37460 60
.11258 31.80014 28.27406 36.33954
27.48698 36.23847 2.29401 2.02770 2.63158 56.06231 50.48908
61.63984 3881.68761 3248.88478 4540.66147 1003.09390 747.90249
1299.96181 62.30319 56.9
9899 67.38443 18.49786 7.67329 25.67728
33.39037 25.90071 40.17238 53.51995 44.22004 63.30344 85.82488
69.09310 90.32237 93.33376 90.39337 96.70833
-----Original
Message-----
From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 08, 2012 11:25 AM
To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
Anil,
I see that you're not currently a
registered user of the MET software. Prior to providing direct
support in the use of MET, we require that users fill out the free
online registration form. That enables us to ensure that we remain in
compliance with the international export laws of the United States.
To fill out the registration, just go here:
http://www.dtcenter.org/met/users/downloads/index.php
Enter you email
address and hit enter to be taken to the form.
Once you have
registered, can you please send me the following information:
1.
point_stat config file
2. type of model data that you want to verify
(e.g. GRIB, p_interp, etc)
Thanks,
Paul
On 03/08/2012 09:03
AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>
> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
> Transaction:
Ticket created by anil.kumar at nasa.gov
> Queue: met_help
>
Subject: skill scores
> Owner: Nobody
> Requestors:
anil.kumar at nasa.gov
> Status: new
> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
> Hi,
> I want to understand how to get model skill scores(specially CSI,
HSS,
> GSS)
>
> 1. Do I need to put all variables in pb2nc
config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>
> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>
> 3.
Do I also put all variables in pointstat config file?
>
>
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>
>
obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>
> If you
have any sample pb2nc config and pointstat config file for just skill
score (category 3) that will be very help.
> Thanks,
> Anil
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Fri Mar 09 08:45:51 2012
Paul,
I able to get some output on skill score but I still have quick
question
What is the appropriate threshold value used for Temperature
and RH. I put these values.
fcst_thresh[] = ["gt273", "gt5"];
I
found that if change threshold value then output also change
significantly. SO I want to know the right threshold values
for
TEMPERATURE, RH, MIXING RATIO, WIND SPEED
Another thing about
ci_alpha values for again TEMPERATURE, RH, MIXING RATIO, WIND SPEED
ci_alpha[] = [ 0.05, 0.10 ];
Thanks,
Anil
-----Original
Message-----
From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 08, 2012 11:25 AM
To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
Anil,
I see that you're not currently a
registered user of the MET software. Prior to providing direct
support in the use of MET, we require that users fill out the free
online registration form. That enables us to ensure that we remain in
compliance with the international export laws of the United States.
To fill out the registration, just go here:
http://www.dtcenter.org/met/users/downloads/index.php
Enter you email
address and hit enter to be taken to the form.
Once you have
registered, can you please send me the following information:
1.
point_stat config file
2. type of model data that you want to verify
(e.g. GRIB, p_interp, etc)
Thanks,
Paul
On 03/08/2012 09:03
AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>
> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
> Transaction:
Ticket created by anil.kumar at nasa.gov
> Queue: met_help
>
Subject: skill scores
> Owner: Nobody
> Requestors:
anil.kumar at nasa.gov
> Status: new
> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
> Hi,
> I want to understand how to get model skill scores(specially CSI,
HSS,
> GSS)
>
> 1. Do I need to put all variables in pb2nc
config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>
> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>
> 3.
Do I also put all variables in pointstat config file?
>
>
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>
>
obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>
> If you
have any sample pb2nc config and pointstat config file for just skill
score (category 3) that will be very help.
> Thanks,
> Anil
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Paul Oldenburg
Time: Fri Mar 09 10:06:36 2012
Anil,
I am afraid that there is no easy answer to the question "what are the
right threshold values". First of all, it
depends on the units that your model fields (temp, RH, wind, etc) are
in. For example, if your temperature data is in
kelvin, then the freezing threshold is gt273, in celsius it would be
gt0. Also, the threshold values that you choose
depend on the verification analysis that you are trying to perform,
for example determining how well a model predicts
freezing temperatures or perhaps a wind speed that is specific to
aviation or wind power, etc. I hope this is clear.
If you have any further questions, please let me know.
Paul
On 03/09/2012 08:45 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Paul,
> I able to get some output on skill score but I still have quick
question
> What is the appropriate threshold value used for Temperature and RH.
I put these values.
> fcst_thresh[] = ["gt273", "gt5"];
>
> I found that if change threshold value then output also change
significantly. SO I want to know the right threshold values
> for TEMPERATURE, RH, MIXING RATIO, WIND SPEED
> Another thing about ci_alpha values for again TEMPERATURE, RH,
MIXING RATIO, WIND SPEED
> ci_alpha[] = [ 0.05, 0.10 ];
>
> Thanks,
> Anil
>
>
>
> -----Original Message-----
> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 08, 2012 11:25 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>
> To fill out the registration, just go here:
> http://www.dtcenter.org/met/users/downloads/index.php
> Enter you email address and hit enter to be taken to the form.
>
> Once you have registered, can you please send me the following
information:
>
> 1. point_stat config file
> 2. type of model data that you want to verify (e.g. GRIB, p_interp,
etc)
>
> Thanks,
>
> Paul
>
>
> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>> Transaction: Ticket created by anil.kumar at nasa.gov
>> Queue: met_help
>> Subject: skill scores
>> Owner: Nobody
>> Requestors: anil.kumar at nasa.gov
>> Status: new
>> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>>
>> Hi,
>> I want to understand how to get model skill scores(specially CSI,
HSS,
>> GSS)
>>
>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>
>> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>>
>> 3. Do I also put all variables in pointstat config file?
>>
>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>
>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>
>> If you have any sample pb2nc config and pointstat config file for
just skill score (category 3) that will be very help.
>> Thanks,
>> Anil
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Fri Mar 09 10:27:09 2012
Paul,
One more quick question
I used this kind of observed data
(prepbufr.gdas.2002061300.wo40) downloaded from NCAR CISL data center
(DS337.0).
I am wondering what other data we can used for
verification?
Thanks,
Anil
-----Original Message-----
From:
Paul Oldenburg via RT [mailto:met_help at ucar.edu]
Sent: Friday, March
09, 2012 12:07 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
Anil,
I am afraid that there is no easy answer to the question "what are the
right threshold values". First of all, it depends on the units that
your model fields (temp, RH, wind, etc) are in. For example, if your
temperature data is in kelvin, then the freezing threshold is gt273,
in celsius it would be gt0. Also, the threshold values that you
choose depend on the verification analysis that you are trying to
perform, for example determining how well a model predicts freezing
temperatures or perhaps a wind speed that is specific to aviation or
wind power, etc. I hope this is clear.
If you have any further
questions, please let me know.
Paul
On 03/09/2012 08:45 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Paul,
> I able to get some output on skill score but I still have quick
>
question What is the appropriate threshold value used for Temperature
and RH. I put these values.
> fcst_thresh[] = ["gt273", "gt5"];
>
>
I found that if change threshold value then output also change
significantly. SO I want to know the right threshold values
> for
TEMPERATURE, RH, MIXING RATIO, WIND SPEED Another thing about
>
ci_alpha values for again TEMPERATURE, RH, MIXING RATIO, WIND SPEED
> ci_alpha[] = [ 0.05, 0.10 ];
>
> Thanks,
> Anil
>
>
>
>
-----Original Message-----
> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
> Sent: Thursday, March 08, 2012 11:25 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject:
Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I see that
you're not currently a registered user of the MET software. Prior to
providing direct support in the use of MET, we require that users fill
out the free online registration form. That enables us to ensure that
we remain in compliance with the international export laws of the
United States.
>
> To fill out the registration, just go here:
>
http://www.dtcenter.org/met/users/downloads/index.php
> Enter you
email address and hit enter to be taken to the form.
>
> Once you
have registered, can you please send me the following information:
>
> 1. point_stat config file
> 2. type of model data that you want to
verify (e.g. GRIB, p_interp,
> etc)
>
> Thanks,
>
> Paul
>
>
> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> Thu Mar 08 09:03:43 2012: Request 55009 was acted
upon.
>> Transaction: Ticket created by anil.kumar at nasa.gov
>>
Queue: met_help
>> Subject: skill scores
>> Owner:
Nobody
>> Requestors: anil.kumar at nasa.gov
>> Status: new
>> Ticket<URL:
>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>>
>>
Hi,
>> I want to understand how to get model skill scores(specially
CSI,
>> HSS,
>> GSS)
>>
>> 1. Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>
>> 2. What should I put in
level_category[] = [ ?] - skill score based on model surface to upper
atmosphere level-200mb)
>>
>> 3. Do I also put all variables
in pointstat config file?
>>
>> fcst_field[] = [ "TT(0,0-25,*,*)",
"RH(0,0-25,*,*)" etc ];
>>
>> obs_field[] = [ "TMP/1000-200",
"RH/P1000-200" etc];
>>
>> If you have any sample pb2nc config and
pointstat config file for just skill score (category 3) that will be
very help.
>> Thanks,
>> Anil
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Paul Oldenburg
Time: Fri Mar 09 10:30:04 2012
Anil,
It depends on where the domain of verification is located and what
forecast variables you are interested in. There are
several sources of observations for download on the MET website at:
http://www.dtcenter.org/met/users/downloads/observation_data.php
You can also choose to verify against a model analysis, for example
the GFS analysis. This dataset would not be a true
observation source, but does have a large amount of gridded forecast
fields.
Paul
On 03/09/2012 10:27 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Paul,
> One more quick question
> I used this kind of observed data (prepbufr.gdas.2002061300.wo40)
downloaded from NCAR CISL data center (DS337.0).
> I am wondering what other data we can used for verification?
> Thanks,
> Anil
>
>
> -----Original Message-----
> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 09, 2012 12:07 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I am afraid that there is no easy answer to the question "what are
the right threshold values". First of all, it depends on the units
that your model fields (temp, RH, wind, etc) are in. For example, if
your temperature data is in kelvin, then the freezing threshold is
gt273, in celsius it would be gt0. Also, the threshold values that
you choose depend on the verification analysis that you are trying to
perform, for example determining how well a model predicts freezing
temperatures or perhaps a wind speed that is specific to aviation or
wind power, etc. I hope this is clear.
> If you have any further questions, please let me know.
>
> Paul
>
>
> On 03/09/2012 08:45 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Paul,
>> I able to get some output on skill score but I still have quick
>> question What is the appropriate threshold value used for
Temperature and RH. I put these values.
>> fcst_thresh[] = ["gt273", "gt5"];
>>
>> I found that if change threshold value then output also change
significantly. SO I want to know the right threshold values
>> for TEMPERATURE, RH, MIXING RATIO, WIND SPEED Another thing
about
>> ci_alpha values for again TEMPERATURE, RH, MIXING RATIO, WIND SPEED
>> ci_alpha[] = [ 0.05, 0.10 ];
>>
>> Thanks,
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, March 08, 2012 11:25 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>
>> To fill out the registration, just go here:
>> http://www.dtcenter.org/met/users/downloads/index.php
>> Enter you email address and hit enter to be taken to the form.
>>
>> Once you have registered, can you please send me the following
information:
>>
>> 1. point_stat config file
>> 2. type of model data that you want to verify (e.g. GRIB, p_interp,
>> etc)
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>>
>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>> Queue: met_help
>>> Subject: skill scores
>>> Owner: Nobody
>>> Requestors: anil.kumar at nasa.gov
>>> Status: new
>>> Ticket<URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
>>> Hi,
>>> I want to understand how to get model skill scores(specially CSI,
>>> HSS,
>>> GSS)
>>>
>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>
>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>
>>> 3. Do I also put all variables in pointstat config file?
>>>
>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>
>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>
>>> If you have any sample pb2nc config and pointstat config file for
just skill score (category 3) that will be very help.
>>> Thanks,
>>> Anil
>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Fri Mar 09 12:16:22 2012
Anil,
I can answer some of your questions. For question 3 below in your
original message, I am going to hand that one over to a statistician
to
discuss categorical vs. continuous statistics better.
I want to understand how to get model skill scores(specially CSI, HSS,
GSS).
Here you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
Do I need to put all variables in pb2nc config file (obs_grib_code[] =
[
"SPFH", "TMP", "MIXR", "WIND" ]?
You do not have to, but it is easier to just run PB2NC once for all of
the variables that you want. Then all of the variables will be in one
MET usable netCDF file.
What should I put in level_category[] = [ ?] - skill score based on
model surface to upper atmosphere level-200mb)?
Leave it blank to get all of them.
Let us know if you need any more help.
Anne
On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Paul,
> Please find the latest Point config file.
> I do get some output (see below) but I need help to get skill scores
only.
>
> Thanks,
> Anil
>
>
>
> -----Original Message-----
> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 08, 2012 11:25 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>
> To fill out the registration, just go here:
> http://www.dtcenter.org/met/users/downloads/index.php
> Enter you email address and hit enter to be taken to the form.
>
> Once you have registered, can you please send me the following
information:
>
> 1. point_stat config file
> 2. type of model data that you want to verify (e.g. GRIB, p_interp,
etc)
>
> Thanks,
>
> Paul
>
>
> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>> Transaction: Ticket created by anil.kumar at nasa.gov
>> Queue: met_help
>> Subject: skill scores
>> Owner: Nobody
>> Requestors: anil.kumar at nasa.gov
>> Status: new
>> Ticket<URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>>
>> Hi,
>> I want to understand how to get model skill scores(specially CSI,
HSS,
>> GSS)
>>
>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>
>> 2. What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)
>>
>> 3. Do I also put all variables in pointstat config file?
>>
>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>
>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>
>> If you have any sample pb2nc config and pointstat config file for
just skill score (category 3) that will be very help.
>> Thanks,
>> Anil
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Fri Mar 09 13:11:38 2012
Thanks Anne!
One quick question
My wrf domain is over SGP region and
I would like to used best observed available data for June 2002. I am
currently using prepbufr.gdas.2002061300.wo40 from dss337. Do you
think this prepbufr data is only data we can use over SGP region.
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
Thanks for your wonderful help.
Anil
-----Original Message-----
From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
Sent: Friday, March 09, 2012 2:16 PM
To:
Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
I can answer some of
your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
I want to understand how to get
model skill scores(specially CSI, HSS, GSS).
Here you need to make
sure that in your PointStat config file the output_flag[] for CTS
(continuous statistics) is turned on.
Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
You do not have to, but it is easier to just run
PB2NC once for all of the variables that you want. Then all of the
variables will be in one MET usable netCDF file.
What should I put
in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)?
Leave it blank to get all of them.
Let us know if you need any more help.
Anne
On 03/08/2012
02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
>
<URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
Paul,
> Please find the latest Point config file.
> I do get some
output (see below) but I need help to get skill scores only.
>
>
Thanks,
> Anil
>
>
>
> -----Original Message-----
> From: Paul
Oldenburg via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March
08, 2012 11:25 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I see that you're not currently a registered user of the
MET software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>
> To fill out the
registration, just go here:
>
http://www.dtcenter.org/met/users/downloads/index.php
> Enter you
email address and hit enter to be taken to the form.
>
> Once you
have registered, can you please send me the following information:
>
> 1. point_stat config file
> 2. type of model data that you want to
verify (e.g. GRIB, p_interp,
> etc)
>
> Thanks,
>
> Paul
>
>
> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> Thu Mar 08 09:03:43 2012: Request 55009 was acted
upon.
>> Transaction: Ticket created by anil.kumar at nasa.gov
>>
Queue: met_help
>> Subject: skill scores
>> Owner:
Nobody
>> Requestors: anil.kumar at nasa.gov
>> Status: new
>> Ticket<URL:
>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>>
>>
Hi,
>> I want to understand how to get model skill scores(specially
CSI,
>> HSS,
>> GSS)
>>
>> 1. Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>
>> 2. What should I put in
level_category[] = [ ?] - skill score based on model surface to upper
atmosphere level-200mb)
>>
>> 3. Do I also put all variables
in pointstat config file?
>>
>> fcst_field[] = [ "TT(0,0-25,*,*)",
"RH(0,0-25,*,*)" etc ];
>>
>> obs_field[] = [ "TMP/1000-200",
"RH/P1000-200" etc];
>>
>> If you have any sample pb2nc config and
pointstat config file for just skill score (category 3) that will be
very help.
>> Thanks,
>> Anil
>>
>
>
------------------------------------------------
Subject: skill scores
From: Tressa Fowler
Time: Fri Mar 09 13:26:08 2012
Hi Anil,
The skill scores you mention, CSI, HSS, and GSS are defined by some
'event' threshold. They are most typically used on precipitation since
it is well organized into events and non-events. For other variables,
these measures on ly make sense if you have some event in mind, such
as freezing temperatures, high winds, etc. Otherwise, statistics such
as RMSE and bias give an overall sense of forecast performance without
use of thresholds. Perhaps you can clarify the goals of your
verification analyses prior to choosing your statistics.
Please let me know if you have any further questions.
Tressa
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Fri Mar 09 13:30:33 2012
Tressa,
This is good information.
Thanks,
Anil
-----Original Message-----
From: Tressa Fowler via RT
[mailto:met_help at ucar.edu]
Sent: Friday, March 09, 2012 3:26 PM
To:
Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject:
[rt.rap.ucar.edu #55009] skill scores
Hi Anil,
The skill scores
you mention, CSI, HSS, and GSS are defined by some 'event' threshold.
They are most typically used on precipitation since it is well
organized into events and non-events. For other variables, these
measures on ly make sense if you have some event in mind, such as
freezing temperatures, high winds, etc. Otherwise, statistics such as
RMSE and bias give an overall sense of forecast performance without
use of thresholds. Perhaps you can clarify the goals of your
verification analyses prior to choosing your statistics.
Please let
me know if you have any further questions.
Tressa
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Fri Mar 09 13:37:53 2012
Anil,
I am not sure what SGP stands for, so I can't directly answer your
question. However, if the region is over North America then using the
data from NDAS will give you what you want. If it is not over North
America, then you would want to use the GDAS files for global data. A
link to both of these can be found on the following web page:
http://www.dtcenter.org/met/users/downloads/observation_data.php
See the PrepBufr Point Observations links on this page.
To get you started, the best way would be to use the
mask_grid[] = [ "FULL" ];
first. After you are comfortable with the full grid, then you can
begin
to use the mask regions.
Please let us know if we can be of any further assistance.
Anne
On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Thanks Anne!
> One quick question
> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>
> Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>
> Thanks for your wonderful help.
>
> Anil
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 09, 2012 2:16 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I can answer some of your questions. For question 3 below in your
original message, I am going to hand that one over to a statistician
to discuss categorical vs. continuous statistics better.
>
> I want to understand how to get model skill scores(specially CSI,
HSS, GSS).
>
> Here you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>
> Do I need to put all variables in pb2nc config file (obs_grib_code[]
= [ "SPFH", "TMP", "MIXR", "WIND" ]?
>
> You do not have to, but it is easier to just run PB2NC once for all
of the variables that you want. Then all of the variables will be in
one MET usable netCDF file.
>
> What should I put in level_category[] = [ ?] - skill score based on
model surface to upper atmosphere level-200mb)?
>
> Leave it blank to get all of them.
>
> Let us know if you need any more help.
>
> Anne
>
>
>
> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Paul,
>> Please find the latest Point config file.
>> I do get some output (see below) but I need help to get skill
scores only.
>>
>> Thanks,
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, March 08, 2012 11:25 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>
>> To fill out the registration, just go here:
>> http://www.dtcenter.org/met/users/downloads/index.php
>> Enter you email address and hit enter to be taken to the form.
>>
>> Once you have registered, can you please send me the following
information:
>>
>> 1. point_stat config file
>> 2. type of model data that you want to verify (e.g. GRIB, p_interp,
>> etc)
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>>
>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>> Queue: met_help
>>> Subject: skill scores
>>> Owner: Nobody
>>> Requestors: anil.kumar at nasa.gov
>>> Status: new
>>> Ticket<URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
>>> Hi,
>>> I want to understand how to get model skill scores(specially CSI,
>>> HSS,
>>> GSS)
>>>
>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>
>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>
>>> 3. Do I also put all variables in pointstat config file?
>>>
>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>
>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>
>>> If you have any sample pb2nc config and pointstat config file for
just skill score (category 3) that will be very help.
>>> Thanks,
>>> Anil
>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Fri Mar 09 13:47:37 2012
Anne,
SGP stands for Southern Great Plains (covering OK, TX and NE
states)
I don't see NDAS data for June 2002
NDAS observed data is
available for past 3 days and for past one month data is available.
Thanks,
Anil
-----Original Message-----
From: Anne Holmes
via RT [mailto:met_help at ucar.edu]
Sent: Friday, March 09, 2012 3:38
PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject:
Re: [rt.rap.ucar.edu #55009] skill scores
Anil,
I am not sure
what SGP stands for, so I can't directly answer your question.
However, if the region is over North America then using the data from
NDAS will give you what you want. If it is not over North America,
then you would want to use the GDAS files for global data. A link to
both of these can be found on the following web page:
http://www.dtcenter.org/met/users/downloads/observation_data.php
See the PrepBufr Point Observations links on this page.
To get you
started, the best way would be to use the
mask_grid[] = [ "FULL"
];
first. After you are comfortable with the full grid, then you can
begin to use the mask regions.
Please let us know if we can be of
any further assistance.
Anne
On 03/09/2012 01:11 PM, Kumar,
Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Thanks
Anne!
> One quick question
> My wrf domain is over SGP region and I
would like to used best observed available data for June 2002. I am
currently using prepbufr.gdas.2002061300.wo40 from dss337. Do you
think this prepbufr data is only data we can use over SGP region.
>
> Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>
> Thanks for your wonderful help.
>
> Anil
>
> -----Original Message-----
> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
> Sent: Friday, March 09, 2012 2:16 PM
>
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject:
Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I can
answer some of your questions. For question 3 below in your original
message, I am going to hand that one over to a statistician to discuss
categorical vs. continuous statistics better.
>
> I want to
understand how to get model skill scores(specially CSI, HSS, GSS).
>
> Here you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>
> Do I
need to put all variables in pb2nc config file (obs_grib_code[] = [
"SPFH", "TMP", "MIXR", "WIND" ]?
>
> You do not have to, but it is
easier to just run PB2NC once for all of the variables that you want.
Then all of the variables will be in one MET usable netCDF file.
>
>
What should I put in level_category[] = [ ?] - skill score based on
model surface to upper atmosphere level-200mb)?
>
> Leave it blank
to get all of them.
>
> Let us know if you need any more help.
>
>
Anne
>
>
>
> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK] via RT
> wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Paul,
>> Please find the latest Point config file.
>> I do get some output
(see below) but I need help to get skill scores only.
>>
>> Thanks,
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Paul
Oldenburg via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, March
08, 2012 11:25 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I see that you're not currently a registered user
of the MET software. Prior to providing direct support in the use of
MET, we require that users fill out the free online registration form.
That enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>
>> To fill out
the registration, just go here:
>>
http://www.dtcenter.org/met/users/downloads/index.php
>> Enter you
email address and hit enter to be taken to the form.
>>
>> Once you
have registered, can you please send me the following information:
>>
>> 1. point_stat config file
>> 2. type of model data that you want
to verify (e.g. GRIB, p_interp,
>> etc)
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>
>>> Thu Mar 08 09:03:43 2012: Request 55009
was acted upon.
>>> Transaction: Ticket created by
anil.kumar at nasa.gov
>>> Queue: met_help
>>>
Subject: skill scores
>>> Owner: Nobody
>>>
Requestors: anil.kumar at nasa.gov
>>> Status: new
>>>
Ticket<URL:
>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
>>> Hi,
>>> I want to understand how to get model skill
scores(specially CSI,
>>> HSS,
>>> GSS)
>>>
>>> 1. Do I
need to put all variables in pb2nc config file (obs_grib_code[] = [
"SPFH", "TMP", "MIXR", "WIND" ]?
>>>
>>> 2. What should I put
in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)
>>>
>>> 3. Do I also put all
variables in pointstat config file?
>>>
>>> fcst_field[] = [
"TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>
>>> obs_field[] = [
"TMP/1000-200", "RH/P1000-200" etc];
>>>
>>> If you have any sample
pb2nc config and pointstat config file for just skill score (category
3) that will be very help.
>>> Thanks,
>>> Anil
>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Tue Mar 13 12:54:16 2012
Anil,
Sorry for the delay in getting back to you. I was out of the office
yesterday. I checked with my colleagues and the answer is that unless
you have a contact at NCEP to get you old archived data, then you only
have what is available at that site for PrepBufr data. We do not
provide
data as a service, just list a few locations in which users can
retrieve
some data.
For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a
sample for how to create one. They are just text files.
Let us know if we can be of any further assistance.
Anne
On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> SGP stands for Southern Great Plains (covering OK, TX and NE states)
> I don't see NDAS data for June 2002
> NDAS observed data is available for past 3 days and for past one
month data is available.
>
> Thanks,
> Anil
>
>
>
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Friday, March 09, 2012 3:38 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I am not sure what SGP stands for, so I can't directly answer your
question. However, if the region is over North America then using the
data from NDAS will give you what you want. If it is not over North
America, then you would want to use the GDAS files for global data. A
link to both of these can be found on the following web page:
>
> http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> See the PrepBufr Point Observations links on this page.
>
> To get you started, the best way would be to use the
> mask_grid[] = [ "FULL" ];
> first. After you are comfortable with the full grid, then you can
begin to use the mask regions.
>
> Please let us know if we can be of any further assistance.
>
> Anne
>
>
> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Thanks Anne!
>> One quick question
>> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>
>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>
>> Thanks for your wonderful help.
>>
>> Anil
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Friday, March 09, 2012 2:16 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I can answer some of your questions. For question 3 below in your
original message, I am going to hand that one over to a statistician
to discuss categorical vs. continuous statistics better.
>>
>> I want to understand how to get model skill scores(specially CSI,
HSS, GSS).
>>
>> Here you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>>
>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>
>> You do not have to, but it is easier to just run PB2NC once for all
of the variables that you want. Then all of the variables will be in
one MET usable netCDF file.
>>
>> What should I put in level_category[] = [ ?] - skill score based on
model surface to upper atmosphere level-200mb)?
>>
>> Leave it blank to get all of them.
>>
>> Let us know if you need any more help.
>>
>> Anne
>>
>>
>>
>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Paul,
>>> Please find the latest Point config file.
>>> I do get some output (see below) but I need help to get skill
scores only.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>> Sent: Thursday, March 08, 2012 11:25 AM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>
>>> To fill out the registration, just go here:
>>> http://www.dtcenter.org/met/users/downloads/index.php
>>> Enter you email address and hit enter to be taken to the form.
>>>
>>> Once you have registered, can you please send me the following
information:
>>>
>>> 1. point_stat config file
>>> 2. type of model data that you want to verify (e.g. GRIB,
p_interp,
>>> etc)
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT wrote:
>>>>
>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>> Queue: met_help
>>>> Subject: skill scores
>>>> Owner: Nobody
>>>> Requestors: anil.kumar at nasa.gov
>>>> Status: new
>>>> Ticket<URL:
>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
>>>> Hi,
>>>> I want to understand how to get model skill scores(specially CSI,
>>>> HSS,
>>>> GSS)
>>>>
>>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>
>>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>>
>>>> 3. Do I also put all variables in pointstat config file?
>>>>
>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>
>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>
>>>> If you have any sample pb2nc config and pointstat config file for
just skill score (category 3) that will be very help.
>>>> Thanks,
>>>> Anil
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Thu Mar 15 10:13:30 2012
Thanks Anne!
Anil
-----Original Message-----
From: Anne
Holmes via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 13,
2012 2:54 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
Anil,
Sorry
for the delay in getting back to you. I was out of the office
yesterday. I checked with my colleagues and the answer is that unless
you have a contact at NCEP to get you old archived data, then you only
have what is available at that site for PrepBufr data. We do not
provide data as a service, just list a few locations in which users
can retrieve some data.
For the second part of your questions, you
might look at the region files in the data/poly directory. MET comes
with several smaller polyline regions for various parts of the US. If
we don't have one in there that covers the area that you want, you can
at least use them as a sample for how to create one. They are just
text files.
Let us know if we can be of any further assistance.
Anne
On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> SGP stands for Southern Great Plains (covering OK, TX and NE states)
I
> don't see NDAS data for June 2002 NDAS observed data is
available for
> past 3 days and for past one month data is
available.
>
> Thanks,
> Anil
>
>
>
>
> -----Original
Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>
Sent: Friday, March 09, 2012 3:38 PM
> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>
> Anil,
>
> I am not sure what SGP stands
for, so I can't directly answer your question. However, if the region
is over North America then using the data from NDAS will give you what
you want. If it is not over North America, then you would want to use
the GDAS files for global data. A link to both of these can be found
on the following web page:
>
>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>
>
See the PrepBufr Point Observations links on this page.
>
> To get
you started, the best way would be to use the
> mask_grid[] = [
"FULL" ];
> first. After you are comfortable with the full grid, then
you can begin to use the mask regions.
>
> Please let us know if we
can be of any further assistance.
>
> Anne
>
>
> On 03/09/2012
01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Thanks Anne!
>> One quick question
>> My wrf domain is over SGP
region and I would like to used best observed available data for June
2002. I am currently using prepbufr.gdas.2002061300.wo40 from dss337.
Do you think this prepbufr data is only data we can use over SGP
region.
>>
>> Another, what is the best way to create SGP.poly, I
saw some example in MET tutorial but still don't understand the lat
lon information represented in the poly file.
>>
>> Thanks for your
wonderful help.
>>
>> Anil
>>
>> -----Original Message-----
>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Friday,
March 09, 2012 2:16 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I can answer some of your questions. For question
3 below in your original message, I am going to hand that one over to
a statistician to discuss categorical vs. continuous statistics
better.
>>
>> I want to understand how to get model skill
scores(specially CSI, HSS, GSS).
>>
>> Here you need to make sure
that in your PointStat config file the output_flag[] for CTS
(continuous statistics) is turned on.
>>
>> Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>
>> You do not have to, but it is easier to just
run PB2NC once for all of the variables that you want. Then all of the
variables will be in one MET usable netCDF file.
>>
>> What should I
put in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)?
>>
>> Leave it blank to get all of
them.
>>
>> Let us know if you need any more help.
>>
>> Anne
>>
>>
>>
>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via
>> RT
>> wrote:
>>>
>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
Paul,
>>> Please find the latest Point config file.
>>> I do get
some output (see below) but I need help to get skill scores only.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>> Sent:
Thursday, March 08, 2012 11:25 AM
>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>>>
>>> Anil,
>>>
>>> I see that you're not
currently a registered user of the MET software. Prior to providing
direct support in the use of MET, we require that users fill out the
free online registration form. That enables us to ensure that we
remain in compliance with the international export laws of the United
States.
>>>
>>> To fill out the registration, just go here:
>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>> Enter you
email address and hit enter to be taken to the form.
>>>
>>> Once
you have registered, can you please send me the following information:
>>>
>>> 1. point_stat config file
>>> 2. type of model data that you
want to verify (e.g. GRIB, p_interp,
>>> etc)
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>>>>
>>>> Thu Mar 08 09:03:43
2012: Request 55009 was acted upon.
>>>> Transaction: Ticket created
by anil.kumar at nasa.gov
>>>> Queue: met_help
>>>>
Subject: skill scores
>>>> Owner: Nobody
>>>>
Requestors: anil.kumar at nasa.gov
>>>> Status: new
>>>>
Ticket<URL:
>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
>>>> Hi,
>>>> I want to understand how to get model skill
scores(specially CSI,
>>>> HSS,
>>>> GSS)
>>>>
>>>> 1. Do I
need to put all variables in pb2nc config file (obs_grib_code[] = [
"SPFH", "TMP", "MIXR", "WIND" ]?
>>>>
>>>> 2. What should I
put in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)
>>>>
>>>> 3. Do I also put all
variables in pointstat config file?
>>>>
>>>> fcst_field[] = [
"TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>
>>>> obs_field[] = [
"TMP/1000-200", "RH/P1000-200" etc];
>>>>
>>>> If you have any
sample pb2nc config and pointstat config file for just skill score
(category 3) that will be very help.
>>>> Thanks,
>>>> Anil
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Mar 20 09:29:30 2012
Anne,
I have one more question please help me out
I am trying to see
CSI (Critical Success Index) from different model runs but the problem
is I am getting same CSI index even with different model runs.
I
am using command as
bin/point_stat
../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV 2002061300.nc
PointStatConfig_nuwrf -v 2
How CSI score is same from all model
runs. I checked all model runs have different precipitation patterns
and (T, Q, RH) profiles so how
CSI is same I am getting while
running point state.
Thanks,
Anil
-----Original
Message-----
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, March 13, 2012 2:54 PM
To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
Anil,
Sorry for the delay in getting back
to you. I was out of the office yesterday. I checked with my
colleagues and the answer is that unless you have a contact at NCEP to
get you old archived data, then you only have what is available at
that site for PrepBufr data. We do not provide data as a service, just
list a few locations in which users can retrieve some data.
For the
second part of your questions, you might look at the region files in
the data/poly directory. MET comes with several smaller polyline
regions for various parts of the US. If we don't have one in there
that covers the area that you want, you can at least use them as a
sample for how to create one. They are just text files.
Let us know
if we can be of any further assistance.
Anne
On 03/09/2012
01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
>
<URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
Anne,
> SGP stands for Southern Great Plains (covering OK, TX and NE
states) I
> don't see NDAS data for June 2002 NDAS observed data is
available for
> past 3 days and for past one month data is
available.
>
> Thanks,
> Anil
>
>
>
>
> -----Original
Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>
Sent: Friday, March 09, 2012 3:38 PM
> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>
> Anil,
>
> I am not sure what SGP stands
for, so I can't directly answer your question. However, if the region
is over North America then using the data from NDAS will give you what
you want. If it is not over North America, then you would want to use
the GDAS files for global data. A link to both of these can be found
on the following web page:
>
>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>
>
See the PrepBufr Point Observations links on this page.
>
> To get
you started, the best way would be to use the
> mask_grid[] = [
"FULL" ];
> first. After you are comfortable with the full grid, then
you can begin to use the mask regions.
>
> Please let us know if we
can be of any further assistance.
>
> Anne
>
>
> On 03/09/2012
01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Thanks Anne!
>> One quick question
>> My wrf domain is over SGP
region and I would like to used best observed available data for June
2002. I am currently using prepbufr.gdas.2002061300.wo40 from dss337.
Do you think this prepbufr data is only data we can use over SGP
region.
>>
>> Another, what is the best way to create SGP.poly, I
saw some example in MET tutorial but still don't understand the lat
lon information represented in the poly file.
>>
>> Thanks for your
wonderful help.
>>
>> Anil
>>
>> -----Original Message-----
>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Friday,
March 09, 2012 2:16 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I can answer some of your questions. For question
3 below in your original message, I am going to hand that one over to
a statistician to discuss categorical vs. continuous statistics
better.
>>
>> I want to understand how to get model skill
scores(specially CSI, HSS, GSS).
>>
>> Here you need to make sure
that in your PointStat config file the output_flag[] for CTS
(continuous statistics) is turned on.
>>
>> Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>
>> You do not have to, but it is easier to just
run PB2NC once for all of the variables that you want. Then all of the
variables will be in one MET usable netCDF file.
>>
>> What should I
put in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)?
>>
>> Leave it blank to get all of
them.
>>
>> Let us know if you need any more help.
>>
>> Anne
>>
>>
>>
>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via
>> RT
>> wrote:
>>>
>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
Paul,
>>> Please find the latest Point config file.
>>> I do get
some output (see below) but I need help to get skill scores only.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>> Sent:
Thursday, March 08, 2012 11:25 AM
>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>>>
>>> Anil,
>>>
>>> I see that you're not
currently a registered user of the MET software. Prior to providing
direct support in the use of MET, we require that users fill out the
free online registration form. That enables us to ensure that we
remain in compliance with the international export laws of the United
States.
>>>
>>> To fill out the registration, just go here:
>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>> Enter you
email address and hit enter to be taken to the form.
>>>
>>> Once
you have registered, can you please send me the following information:
>>>
>>> 1. point_stat config file
>>> 2. type of model data that you
want to verify (e.g. GRIB, p_interp,
>>> etc)
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>>>>
>>>> Thu Mar 08 09:03:43
2012: Request 55009 was acted upon.
>>>> Transaction: Ticket created
by anil.kumar at nasa.gov
>>>> Queue: met_help
>>>>
Subject: skill scores
>>>> Owner: Nobody
>>>>
Requestors: anil.kumar at nasa.gov
>>>> Status: new
>>>>
Ticket<URL:
>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
>>>> Hi,
>>>> I want to understand how to get model skill
scores(specially CSI,
>>>> HSS,
>>>> GSS)
>>>>
>>>> 1. Do I
need to put all variables in pb2nc config file (obs_grib_code[] = [
"SPFH", "TMP", "MIXR", "WIND" ]?
>>>>
>>>> 2. What should I
put in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)
>>>>
>>>> 3. Do I also put all
variables in pointstat config file?
>>>>
>>>> fcst_field[] = [
"TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>
>>>> obs_field[] = [
"TMP/1000-200", "RH/P1000-200" etc];
>>>>
>>>> If you have any
sample pb2nc config and pointstat config file for just skill score
(category 3) that will be very help.
>>>> Thanks,
>>>> Anil
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Tue Mar 20 09:59:41 2012
Anil,
I think at this point it would be helpful if you could upload the
following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
* observation files
* forecast files
* point_stat config file
When you have done this, let us know and we will take a look and try
to
see what you are doing.
Anne
On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> I have one more question please help me out
> I am trying to see CSI (Critical Success Index) from different model
runs but the problem is I am getting same CSI index even with
different model runs.
>
> I am using command as
> bin/point_stat ../P_INTERP/GODDARD/wrfout_d02_2002-06-
13_00:00:00_PLEV 2002061300.nc PointStatConfig_nuwrf -v 2
>
> How CSI score is same from all model runs. I checked all model runs
have different precipitation patterns and (T, Q, RH) profiles so how
> CSI is same I am getting while running point state.
>
> Thanks,
> Anil
>
>
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 13, 2012 2:54 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> Sorry for the delay in getting back to you. I was out of the office
yesterday. I checked with my colleagues and the answer is that unless
you have a contact at NCEP to get you old archived data, then you only
have what is available at that site for PrepBufr data. We do not
provide data as a service, just list a few locations in which users
can retrieve some data.
>
> For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a sample for how to create one. They are just text files.
>
> Let us know if we can be of any further assistance.
>
> Anne
>
>
>
> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> SGP stands for Southern Great Plains (covering OK, TX and NE
states) I
>> don't see NDAS data for June 2002 NDAS observed data is available
for
>> past 3 days and for past one month data is available.
>>
>> Thanks,
>> Anil
>>
>>
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Friday, March 09, 2012 3:38 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I am not sure what SGP stands for, so I can't directly answer your
question. However, if the region is over North America then using the
data from NDAS will give you what you want. If it is not over North
America, then you would want to use the GDAS files for global data. A
link to both of these can be found on the following web page:
>>
>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>
>> See the PrepBufr Point Observations links on this page.
>>
>> To get you started, the best way would be to use the
>> mask_grid[] = [ "FULL" ];
>> first. After you are comfortable with the full grid, then you can
begin to use the mask regions.
>>
>> Please let us know if we can be of any further assistance.
>>
>> Anne
>>
>>
>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Thanks Anne!
>>> One quick question
>>> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>
>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>
>>> Thanks for your wonderful help.
>>>
>>> Anil
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Friday, March 09, 2012 2:16 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I can answer some of your questions. For question 3 below in your
original message, I am going to hand that one over to a statistician
to discuss categorical vs. continuous statistics better.
>>>
>>> I want to understand how to get model skill scores(specially CSI,
HSS, GSS).
>>>
>>> Here you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>>>
>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>
>>> You do not have to, but it is easier to just run PB2NC once for
all of the variables that you want. Then all of the variables will be
in one MET usable netCDF file.
>>>
>>> What should I put in level_category[] = [ ?] - skill score based
on model surface to upper atmosphere level-200mb)?
>>>
>>> Leave it blank to get all of them.
>>>
>>> Let us know if you need any more help.
>>>
>>> Anne
>>>
>>>
>>>
>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Paul,
>>>> Please find the latest Point config file.
>>>> I do get some output (see below) but I need help to get skill
scores only.
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>
>>>> To fill out the registration, just go here:
>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>> Enter you email address and hit enter to be taken to the form.
>>>>
>>>> Once you have registered, can you please send me the following
information:
>>>>
>>>> 1. point_stat config file
>>>> 2. type of model data that you want to verify (e.g. GRIB,
p_interp,
>>>> etc)
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT wrote:
>>>>>
>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>> Queue: met_help
>>>>> Subject: skill scores
>>>>> Owner: Nobody
>>>>> Requestors: anil.kumar at nasa.gov
>>>>> Status: new
>>>>> Ticket<URL:
>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>>
>>>>> Hi,
>>>>> I want to understand how to get model skill scores(specially
CSI,
>>>>> HSS,
>>>>> GSS)
>>>>>
>>>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>
>>>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>>>
>>>>> 3. Do I also put all variables in pointstat config file?
>>>>>
>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>
>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>
>>>>> If you have any sample pb2nc config and pointstat config file
for just skill score (category 3) that will be very help.
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Mar 20 11:32:06 2012
Anne,
I put all necessary files under kumar_data dir
I also put
two forecast files (one with GODDARD and another one with THOMPSON)
Point stat config is also there with cts output files and you can
compare that fcst var-TT and RH
Has same CSI and HSS.
Thanks,
Anil
-----Original Message-----
From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
Sent: Tuesday, March 20, 2012 12:00 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
I think at this
point it would be helpful if you could upload the following files to
our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
* observation files
* forecast files
* point_stat
config file
When you have done this, let us know and we will take a
look and try to see what you are doing.
Anne
On 03/20/2012
09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
>
<URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
>
Anne,
> I have one more question please help me out I am trying to
see CSI
> (Critical Success Index) from different model runs but the
problem is I am getting same CSI index even with different model runs.
>
> I am using command as
> bin/point_stat
../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>
2002061300.nc PointStatConfig_nuwrf -v 2
>
> How CSI score is same
from all model runs. I checked all model runs
> have different
precipitation patterns and (T, Q, RH) profiles so how CSI is same I am
getting while running point state.
>
> Thanks,
> Anil
>
>
>
>
-----Original Message-----
> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
> Sent: Tuesday, March 13, 2012 2:54 PM
>
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject:
Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> Sorry for
the delay in getting back to you. I was out of the office yesterday. I
checked with my colleagues and the answer is that unless you have a
contact at NCEP to get you old archived data, then you only have what
is available at that site for PrepBufr data. We do not provide data as
a service, just list a few locations in which users can retrieve some
data.
>
> For the second part of your questions, you might look at
the region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>
> Let us know if we can be of any further assistance.
>
> Anne
>
>
>
> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT
> wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> SGP stands for Southern Great Plains (covering OK, TX and NE
states)
>> I don't see NDAS data for June 2002 NDAS observed data is
available
>> for past 3 days and for past one month data is
available.
>>
>> Thanks,
>> Anil
>>
>>
>>
>>
>> -----Original
Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Friday, March 09, 2012 3:38 PM
>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>>
>> Anil,
>>
>> I am not sure what SGP
stands for, so I can't directly answer your question. However, if the
region is over North America then using the data from NDAS will give
you what you want. If it is not over North America, then you would
want to use the GDAS files for global data. A link to both of these
can be found on the following web page:
>>
>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>
>> See the PrepBufr Point Observations links on this page.
>>
>> To
get you started, the best way would be to use the
>> mask_grid[]
= [ "FULL" ];
>> first. After you are comfortable with the full grid,
then you can begin to use the mask regions.
>>
>> Please let us know
if we can be of any further assistance.
>>
>> Anne
>>
>>
>> On
03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>
RT
>> wrote:
>>>
>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
Thanks Anne!
>>> One quick question
>>> My wrf domain is over SGP
region and I would like to used best observed available data for June
2002. I am currently using prepbufr.gdas.2002061300.wo40 from dss337.
Do you think this prepbufr data is only data we can use over SGP
region.
>>>
>>> Another, what is the best way to create SGP.poly, I
saw some example in MET tutorial but still don't understand the lat
lon information represented in the poly file.
>>>
>>> Thanks for
your wonderful help.
>>>
>>> Anil
>>>
>>> -----Original
Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Friday, March 09, 2012 2:16 PM
>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>>>
>>> Anil,
>>>
>>> I can answer some of
your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
>>>
>>> I want to understand how
to get model skill scores(specially CSI, HSS, GSS).
>>>
>>> Here you
need to make sure that in your PointStat config file the output_flag[]
for CTS (continuous statistics) is turned on.
>>>
>>> Do I need to
put all variables in pb2nc config file (obs_grib_code[] = [ "SPFH",
"TMP", "MIXR", "WIND" ]?
>>>
>>> You do not have to, but it is
easier to just run PB2NC once for all of the variables that you want.
Then all of the variables will be in one MET usable netCDF file.
>>>
>>> What should I put in level_category[] = [ ?] - skill score based
on model surface to upper atmosphere level-200mb)?
>>>
>>> Leave it
blank to get all of them.
>>>
>>> Let us know if you need any more
help.
>>>
>>> Anne
>>>
>>>
>>>
>>> On 03/08/2012 02:23 PM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Paul,
>>>> Please find the latest Point config file.
>>>>
I do get some output (see below) but I need help to get skill scores
only.
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>>
>>>>
-----Original Message-----
>>>> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
>>>> Sent: Thursday, March 08, 2012 11:25
AM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>>
Anil,
>>>>
>>>> I see that you're not currently a registered user of
the MET software. Prior to providing direct support in the use of
MET, we require that users fill out the free online registration form.
That enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>
>>>> To fill
out the registration, just go here:
>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>> Enter you
email address and hit enter to be taken to the form.
>>>>
>>>> Once
you have registered, can you please send me the following information:
>>>>
>>>> 1. point_stat config file
>>>> 2. type of model data that
you want to verify (e.g. GRIB, p_interp,
>>>> etc)
>>>>
>>>>
Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 03/08/2012 09:03 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>>>>>
>>>>>
Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>
Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>
Queue: met_help
>>>>> Subject: skill scores
>>>>>
Owner: Nobody
>>>>> Requestors: anil.kumar at nasa.gov
>>>>>
Status: new
>>>>> Ticket<URL:
>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>>
>>>>> Hi,
>>>>> I want to understand how to get model skill
scores(specially CSI,
>>>>> HSS,
>>>>> GSS)
>>>>>
>>>>> 1.
Do I need to put all variables in pb2nc config file (obs_grib_code[] =
[ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>
>>>>> 2. What should
I put in level_category[] = [ ?] - skill score based on model surface
to upper atmosphere level-200mb)
>>>>>
>>>>> 3. Do I also put
all variables in pointstat config file?
>>>>>
>>>>> fcst_field[] = [
"TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>
>>>>> obs_field[] =
[ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>
>>>>> If you have any
sample pb2nc config and pointstat config file for just skill score
(category 3) that will be very help.
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Tue Mar 20 14:06:34 2012
Anil,
I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
Anne
On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> I put all necessary files under kumar_data dir
>
> I also put two forecast files (one with GODDARD and another one with
THOMPSON)
> Point stat config is also there with cts output files and you can
compare that fcst var-TT and RH
> Has same CSI and HSS.
>
> Thanks,
> Anil
>
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 20, 2012 12:00 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I think at this point it would be helpful if you could upload the
following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>
> * observation files
> * forecast files
> * point_stat config file
>
> When you have done this, let us know and we will take a look and try
to see what you are doing.
>
> Anne
>
>
> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> I have one more question please help me out I am trying to see CSI
>> (Critical Success Index) from different model runs but the problem
is I am getting same CSI index even with different model runs.
>>
>> I am using command as
>> bin/point_stat ../P_INTERP/GODDARD/wrfout_d02_2002-06-
13_00:00:00_PLEV
>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>
>> How CSI score is same from all model runs. I checked all model runs
>> have different precipitation patterns and (T, Q, RH) profiles so
how CSI is same I am getting while running point state.
>>
>> Thanks,
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, March 13, 2012 2:54 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Sorry for the delay in getting back to you. I was out of the office
yesterday. I checked with my colleagues and the answer is that unless
you have a contact at NCEP to get you old archived data, then you only
have what is available at that site for PrepBufr data. We do not
provide data as a service, just list a few locations in which users
can retrieve some data.
>>
>> For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a sample for how to create one. They are just text files.
>>
>> Let us know if we can be of any further assistance.
>>
>> Anne
>>
>>
>>
>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>> SGP stands for Southern Great Plains (covering OK, TX and NE
states)
>>> I don't see NDAS data for June 2002 NDAS observed data is
available
>>> for past 3 days and for past one month data is available.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Friday, March 09, 2012 3:38 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I am not sure what SGP stands for, so I can't directly answer your
question. However, if the region is over North America then using the
data from NDAS will give you what you want. If it is not over North
America, then you would want to use the GDAS files for global data. A
link to both of these can be found on the following web page:
>>>
>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>
>>> See the PrepBufr Point Observations links on this page.
>>>
>>> To get you started, the best way would be to use the
>>> mask_grid[] = [ "FULL" ];
>>> first. After you are comfortable with the full grid, then you can
begin to use the mask regions.
>>>
>>> Please let us know if we can be of any further assistance.
>>>
>>> Anne
>>>
>>>
>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Thanks Anne!
>>>> One quick question
>>>> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>
>>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>
>>>> Thanks for your wonderful help.
>>>>
>>>> Anil
>>>>
>>>> -----Original Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I can answer some of your questions. For question 3 below in your
original message, I am going to hand that one over to a statistician
to discuss categorical vs. continuous statistics better.
>>>>
>>>> I want to understand how to get model skill scores(specially CSI,
HSS, GSS).
>>>>
>>>> Here you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>>>>
>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>
>>>> You do not have to, but it is easier to just run PB2NC once for
all of the variables that you want. Then all of the variables will be
in one MET usable netCDF file.
>>>>
>>>> What should I put in level_category[] = [ ?] - skill score based
on model surface to upper atmosphere level-200mb)?
>>>>
>>>> Leave it blank to get all of them.
>>>>
>>>> Let us know if you need any more help.
>>>>
>>>> Anne
>>>>
>>>>
>>>>
>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Paul,
>>>>> Please find the latest Point config file.
>>>>> I do get some output (see below) but I need help to get skill
scores only.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>
>>>>> To fill out the registration, just go here:
>>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>>> Enter you email address and hit enter to be taken to the form.
>>>>>
>>>>> Once you have registered, can you please send me the following
information:
>>>>>
>>>>> 1. point_stat config file
>>>>> 2. type of model data that you want to verify (e.g. GRIB,
p_interp,
>>>>> etc)
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT wrote:
>>>>>>
>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>> Queue: met_help
>>>>>> Subject: skill scores
>>>>>> Owner: Nobody
>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>> Status: new
>>>>>> Ticket<URL:
>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>>
>>>>>> Hi,
>>>>>> I want to understand how to get model skill scores(specially
CSI,
>>>>>> HSS,
>>>>>> GSS)
>>>>>>
>>>>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>
>>>>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>>>>
>>>>>> 3. Do I also put all variables in pointstat config file?
>>>>>>
>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>
>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>
>>>>>> If you have any sample pb2nc config and pointstat config file
for just skill score (category 3) that will be very help.
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Mar 20 16:15:30 2012
Anne,
Updated 6 October 2010 for MET 3.0
Thanks,
Anil
-----Original Message-----
From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
Sent: Tuesday, March 20, 2012 4:07 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
I've got your files
and I will try to figure this out. One quick question for you. What
version of MET are you using?
Anne
On 03/20/2012 11:32 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> I put all necessary files under kumar_data dir
>
> I also put two
forecast files (one with GODDARD and another one with
> THOMPSON)
Point stat config is also there with cts output files and
> you can
compare that fcst var-TT and RH Has same CSI and HSS.
>
> Thanks,
>
Anil
>
>
> -----Original Message-----
> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
> Sent: Tuesday, March 20, 2012 12:00 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject:
Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I think at
this point it would be helpful if you could upload the following files
to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>
> * observation files
> * forecast files
> *
point_stat config file
>
> When you have done this, let us know and
we will take a look and try to see what you are doing.
>
> Anne
>
>
> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT
> wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> I have one more question please help me out I am trying to see CSI
>> (Critical Success Index) from different model runs but the problem
is I am getting same CSI index even with different model runs.
>>
>>
I am using command as
>> bin/point_stat
>>
../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>
2002061300.nc PointStatConfig_nuwrf -v 2
>>
>> How CSI score is same
from all model runs. I checked all model runs
>> have different
precipitation patterns and (T, Q, RH) profiles so how CSI is same I am
getting while running point state.
>>
>> Thanks,
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>> Sent: Tuesday, March 13, 2012 2:54 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Sorry for the delay in getting back to you. I was out of the office
yesterday. I checked with my colleagues and the answer is that unless
you have a contact at NCEP to get you old archived data, then you only
have what is available at that site for PrepBufr data. We do not
provide data as a service, just list a few locations in which users
can retrieve some data.
>>
>> For the second part of your questions,
you might look at the region files in the data/poly directory. MET
comes with several smaller polyline regions for various parts of the
US. If we don't have one in there that covers the area that you want,
you can at least use them as a sample for how to create one. They are
just text files.
>>
>> Let us know if we can be of any further
assistance.
>>
>> Anne
>>
>>
>>
>> On 03/09/2012 01:47 PM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>> RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>> SGP stands for Southern Great Plains (covering OK,
TX and NE states)
>>> I don't see NDAS data for June 2002 NDAS
observed data is available
>>> for past 3 days and for past one
month data is available.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>> Sent: Friday, March 09, 2012 3:38 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>
>>>
>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>
>>> See the PrepBufr Point Observations links on this page.
>>>
>>>
To get you started, the best way would be to use the
>>>
mask_grid[] = [ "FULL" ];
>>> first. After you are comfortable with
the full grid, then you can begin to use the mask regions.
>>>
>>>
Please let us know if we can be of any further assistance.
>>>
>>>
Anne
>>>
>>>
>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK] via
>>> RT
>>> wrote:
>>>>
>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
Thanks Anne!
>>>> One quick question
>>>> My wrf domain is over SGP
region and I would like to used best observed available data for June
2002. I am currently using prepbufr.gdas.2002061300.wo40 from dss337.
Do you think this prepbufr data is only data we can use over SGP
region.
>>>>
>>>> Another, what is the best way to create SGP.poly,
I saw some example in MET tutorial but still don't understand the lat
lon information represented in the poly file.
>>>>
>>>> Thanks for
your wonderful help.
>>>>
>>>> Anil
>>>>
>>>> -----Original
Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I can answer some
of your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
>>>>
>>>> I want to understand how
to get model skill scores(specially CSI, HSS, GSS).
>>>>
>>>> Here
you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>>>>
>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>
>>>> You
do not have to, but it is easier to just run PB2NC once for all of the
variables that you want. Then all of the variables will be in one MET
usable netCDF file.
>>>>
>>>> What should I put in level_category[]
= [ ?] - skill score based on model surface to upper atmosphere level-
200mb)?
>>>>
>>>> Leave it blank to get all of them.
>>>>
>>>> Let
us know if you need any more help.
>>>>
>>>> Anne
>>>>
>>>>
>>>>
>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>>
Paul,
>>>>> Please find the latest Point config file.
>>>>> I do get
some output (see below) but I need help to get skill scores only.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>>
>>>>>
-----Original Message-----
>>>>> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
>>>>> Sent: Thursday, March 08, 2012 11:25
AM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>>
Anil,
>>>>>
>>>>> I see that you're not currently a registered user
of the MET software. Prior to providing direct support in the use of
MET, we require that users fill out the free online registration form.
That enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>
>>>>> To fill
out the registration, just go here:
>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>> Enter you
email address and hit enter to be taken to the form.
>>>>>
>>>>>
Once you have registered, can you please send me the following
information:
>>>>>
>>>>> 1. point_stat config file
>>>>> 2. type of
model data that you want to verify (e.g. GRIB,
>>>>> p_interp,
>>>>> etc)
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT wrote:
>>>>>>
>>>>>> Thu Mar 08 09:03:43 2012: Request 55009
was acted upon.
>>>>>> Transaction: Ticket created by
anil.kumar at nasa.gov
>>>>>> Queue: met_help
>>>>>>
Subject: skill scores
>>>>>> Owner: Nobody
>>>>>>
Requestors: anil.kumar at nasa.gov
>>>>>> Status: new
>>>>>> Ticket<URL:
>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>>
>>>>>> Hi,
>>>>>> I want to understand how to get model skill
scores(specially CSI,
>>>>>> HSS,
>>>>>> GSS)
>>>>>>
>>>>>> 1.
Do I need to put all variables in pb2nc config file (obs_grib_code[] =
[ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>
>>>>>> 2. What
should I put in level_category[] = [ ?] - skill score based on model
surface to upper atmosphere level-200mb)
>>>>>>
>>>>>> 3. Do I
also put all variables in pointstat config file?
>>>>>>
>>>>>>
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>
>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>
>>>>>> If you have any sample pb2nc config and pointstat config file
for just skill score (category 3) that will be very help.
>>>>>>
Thanks,
>>>>>> Anil
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Wed Mar 21 09:09:22 2012
Anil,
We just released a new version of MET. This version has some new
features as well as an improvement in our handling of variables that
improves precision. We strongly recommend that you update to this
version. The new version can be downloaded from the following
location:
http://www.dtcenter.org/met/users/downloads/index.php.
Anne
On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
>
> Updated 6 October 2010 for MET 3.0
>
> Thanks,
> Anil
>
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, March 20, 2012 4:07 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
>
> Anne
>
>
> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> I put all necessary files under kumar_data dir
>>
>> I also put two forecast files (one with GODDARD and another one
with
>> THOMPSON) Point stat config is also there with cts output files and
>> you can compare that fcst var-TT and RH Has same CSI and HSS.
>>
>> Thanks,
>> Anil
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, March 20, 2012 12:00 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I think at this point it would be helpful if you could upload the
following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>
>> * observation files
>> * forecast files
>> * point_stat config file
>>
>> When you have done this, let us know and we will take a look and
try to see what you are doing.
>>
>> Anne
>>
>>
>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>> I have one more question please help me out I am trying to see CSI
>>> (Critical Success Index) from different model runs but the problem
is I am getting same CSI index even with different model runs.
>>>
>>> I am using command as
>>> bin/point_stat
>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>
>>> How CSI score is same from all model runs. I checked all model
runs
>>> have different precipitation patterns and (T, Q, RH) profiles so
how CSI is same I am getting while running point state.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>
>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>
>>> Let us know if we can be of any further assistance.
>>>
>>> Anne
>>>
>>>
>>>
>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Anne,
>>>> SGP stands for Southern Great Plains (covering OK, TX and NE
states)
>>>> I don't see NDAS data for June 2002 NDAS observed data is
available
>>>> for past 3 days and for past one month data is available.
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>
>>>>
>>>> http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>
>>>> See the PrepBufr Point Observations links on this page.
>>>>
>>>> To get you started, the best way would be to use the
>>>> mask_grid[] = [ "FULL" ];
>>>> first. After you are comfortable with the full grid, then you can
begin to use the mask regions.
>>>>
>>>> Please let us know if we can be of any further assistance.
>>>>
>>>> Anne
>>>>
>>>>
>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Thanks Anne!
>>>>> One quick question
>>>>> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>
>>>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>
>>>>> Thanks for your wonderful help.
>>>>>
>>>>> Anil
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> I can answer some of your questions. For question 3 below in
your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>
>>>>> I want to understand how to get model skill scores(specially
CSI, HSS, GSS).
>>>>>
>>>>> Here you need to make sure that in your PointStat config file
the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>
>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>
>>>>> You do not have to, but it is easier to just run PB2NC once for
all of the variables that you want. Then all of the variables will be
in one MET usable netCDF file.
>>>>>
>>>>> What should I put in level_category[] = [ ?] - skill score based
on model surface to upper atmosphere level-200mb)?
>>>>>
>>>>> Leave it blank to get all of them.
>>>>>
>>>>> Let us know if you need any more help.
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>>
>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>> RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Paul,
>>>>>> Please find the latest Point config file.
>>>>>> I do get some output (see below) but I need help to get skill
scores only.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>
>>>>>> To fill out the registration, just go here:
>>>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>>>> Enter you email address and hit enter to be taken to the form.
>>>>>>
>>>>>> Once you have registered, can you please send me the following
information:
>>>>>>
>>>>>> 1. point_stat config file
>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>> p_interp,
>>>>>> etc)
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>>
>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT wrote:
>>>>>>>
>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>> Queue: met_help
>>>>>>> Subject: skill scores
>>>>>>> Owner: Nobody
>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>> Status: new
>>>>>>> Ticket<URL:
>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>>
>>>>>>> Hi,
>>>>>>> I want to understand how to get model skill scores(specially
CSI,
>>>>>>> HSS,
>>>>>>> GSS)
>>>>>>>
>>>>>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>
>>>>>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>>>>>
>>>>>>> 3. Do I also put all variables in pointstat config file?
>>>>>>>
>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>
>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>
>>>>>>> If you have any sample pb2nc config and pointstat config file
for just skill score (category 3) that will be very help.
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Wed Mar 21 09:13:12 2012
Anne,
Yes I will do. But you still check my output with latest version of
MET?
Thanks
Anil
Sent from my iPhone
On Mar 21, 2012, at 11:09 AM, "Anne Holmes via RT" <met_help at ucar.edu>
wrote:
> Anil,
>
> We just released a new version of MET. This version has some new
> features as well as an improvement in our handling of variables that
> improves precision. We strongly recommend that you update to this
> version. The new version can be downloaded from the following
location:
>
> http://www.dtcenter.org/met/users/downloads/index.php.
>
> Anne
>
> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>>
>> Updated 6 October 2010 for MET 3.0
>>
>> Thanks,
>> Anil
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Tuesday, March 20, 2012 4:07 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
>>
>> Anne
>>
>>
>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>> I put all necessary files under kumar_data dir
>>>
>>> I also put two forecast files (one with GODDARD and another one
with
>>> THOMPSON) Point stat config is also there with cts output files
and
>>> you can compare that fcst var-TT and RH Has same CSI and HSS.
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Tuesday, March 20, 2012 12:00 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I think at this point it would be helpful if you could upload the
following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>
>>> * observation files
>>> * forecast files
>>> * point_stat config file
>>>
>>> When you have done this, let us know and we will take a look and
try to see what you are doing.
>>>
>>> Anne
>>>
>>>
>>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Anne,
>>>> I have one more question please help me out I am trying to see
CSI
>>>> (Critical Success Index) from different model runs but the
problem is I am getting same CSI index even with different model runs.
>>>>
>>>> I am using command as
>>>> bin/point_stat
>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>
>>>> How CSI score is same from all model runs. I checked all model
runs
>>>> have different precipitation patterns and (T, Q, RH) profiles so
how CSI is same I am getting while running point state.
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>>
>>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>>
>>>> Let us know if we can be of any further assistance.
>>>>
>>>> Anne
>>>>
>>>>
>>>>
>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Anne,
>>>>> SGP stands for Southern Great Plains (covering OK, TX and NE
states)
>>>>> I don't see NDAS data for June 2002 NDAS observed data is
available
>>>>> for past 3 days and for past one month data is available.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>>
>>>>>
>>>>> http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>>
>>>>> See the PrepBufr Point Observations links on this page.
>>>>>
>>>>> To get you started, the best way would be to use the
>>>>> mask_grid[] = [ "FULL" ];
>>>>> first. After you are comfortable with the full grid, then you
can begin to use the mask regions.
>>>>>
>>>>> Please let us know if we can be of any further assistance.
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>> RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Thanks Anne!
>>>>>> One quick question
>>>>>> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>
>>>>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>>
>>>>>> Thanks for your wonderful help.
>>>>>>
>>>>>> Anil
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I can answer some of your questions. For question 3 below in
your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>>
>>>>>> I want to understand how to get model skill scores(specially
CSI, HSS, GSS).
>>>>>>
>>>>>> Here you need to make sure that in your PointStat config file
the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>
>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>
>>>>>> You do not have to, but it is easier to just run PB2NC once for
all of the variables that you want. Then all of the variables will be
in one MET usable netCDF file.
>>>>>>
>>>>>> What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)?
>>>>>>
>>>>>> Leave it blank to get all of them.
>>>>>>
>>>>>> Let us know if you need any more help.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>>> RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Paul,
>>>>>>> Please find the latest Point config file.
>>>>>>> I do get some output (see below) but I need help to get skill
scores only.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>
>>>>>>> To fill out the registration, just go here:
>>>>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>> Enter you email address and hit enter to be taken to the form.
>>>>>>>
>>>>>>> Once you have registered, can you please send me the following
information:
>>>>>>>
>>>>>>> 1. point_stat config file
>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>> p_interp,
>>>>>>> etc)
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Paul
>>>>>>>
>>>>>>>
>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>>>>>>
>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>> Queue: met_help
>>>>>>>> Subject: skill scores
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>> Status: new
>>>>>>>> Ticket<URL:
>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>>
>>>>>>>> Hi,
>>>>>>>> I want to understand how to get model skill scores(specially
CSI,
>>>>>>>> HSS,
>>>>>>>> GSS)
>>>>>>>>
>>>>>>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>
>>>>>>>> 2. What should I put in level_category[] = [ ?] - skill
score based on model surface to upper atmosphere level-200mb)
>>>>>>>>
>>>>>>>> 3. Do I also put all variables in pointstat config
file?
>>>>>>>>
>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>
>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>
>>>>>>>> If you have any sample pb2nc config and pointstat config file
for just skill score (category 3) that will be very help.
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>
>
------------------------------------------------
Subject: skill scores
From: Anne Holmes
Time: Wed Mar 21 14:05:35 2012
Anil,
In looking at your data there are several points I want to make.
* The top level (level 30) of your data contains invalid data and this
is having an impact on the statistics. I've attached an image plot of
level 30 from the GODDARD file for you to look at. So skip this level
in
your forecasts (e.g., just do 0-29).
* It doesn't make sense to aggregate your data over the entire
atmosphere. You might want to consider using smaller sets of levels to
verify over.
* The reason that the CSI score is the same is because the threshold
that you have chosen has resulted in the same contingency table counts
for your different forecast files. If you choose a different forecast
threshold, you can get different contingency table counts and then the
CSI value will be different. The CSI is based on the contingency
tables.
When in doubt it helps to look at the matched pairs (MPR) output to
see
where the differences are.
One other suggestion I have for you is to use the Unified Post
Processor
(UPP) to post-process your WRF output. This puts the data into GRIB
format which is better supported in MET than the pinterp data is.
Hope this helps you out. Let us know if we can be of any further
assistance.
Anne
On 03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> Yes I will do. But you still check my output with latest version of
MET?
> Thanks
> Anil
>
> Sent from my iPhone
>
> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>
>> Anil,
>>
>> We just released a new version of MET. This version has some new
>> features as well as an improvement in our handling of variables
that
>> improves precision. We strongly recommend that you update to this
>> version. The new version can be downloaded from the following
location:
>>
>> http://www.dtcenter.org/met/users/downloads/index.php.
>>
>> Anne
>>
>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>>
>>> Updated 6 October 2010 for MET 3.0
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Tuesday, March 20, 2012 4:07 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
>>>
>>> Anne
>>>
>>>
>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Anne,
>>>> I put all necessary files under kumar_data dir
>>>>
>>>> I also put two forecast files (one with GODDARD and another one
with
>>>> THOMPSON) Point stat config is also there with cts output files
and
>>>> you can compare that fcst var-TT and RH Has same CSI and HSS.
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Tuesday, March 20, 2012 12:00 PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I think at this point it would be helpful if you could upload the
following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>
>>>> * observation files
>>>> * forecast files
>>>> * point_stat config file
>>>>
>>>> When you have done this, let us know and we will take a look and
try to see what you are doing.
>>>>
>>>> Anne
>>>>
>>>>
>>>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Anne,
>>>>> I have one more question please help me out I am trying to see
CSI
>>>>> (Critical Success Index) from different model runs but the
problem is I am getting same CSI index even with different model runs.
>>>>>
>>>>> I am using command as
>>>>> bin/point_stat
>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>
>>>>> How CSI score is same from all model runs. I checked all model
runs
>>>>> have different precipitation patterns and (T, Q, RH) profiles so
how CSI is same I am getting while running point state.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>>>
>>>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>>>
>>>>> Let us know if we can be of any further assistance.
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>>
>>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>> RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>> SGP stands for Southern Great Plains (covering OK, TX and NE
states)
>>>>>> I don't see NDAS data for June 2002 NDAS observed data is
available
>>>>>> for past 3 days and for past one month data is available.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>>>
>>>>>>
>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>>>
>>>>>> See the PrepBufr Point Observations links on this page.
>>>>>>
>>>>>> To get you started, the best way would be to use the
>>>>>> mask_grid[] = [ "FULL" ];
>>>>>> first. After you are comfortable with the full grid, then you
can begin to use the mask regions.
>>>>>>
>>>>>> Please let us know if we can be of any further assistance.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>>> RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Thanks Anne!
>>>>>>> One quick question
>>>>>>> My wrf domain is over SGP region and I would like to used best
observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>
>>>>>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>>>
>>>>>>> Thanks for your wonderful help.
>>>>>>>
>>>>>>> Anil
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I can answer some of your questions. For question 3 below in
your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>>>
>>>>>>> I want to understand how to get model skill scores(specially
CSI, HSS, GSS).
>>>>>>>
>>>>>>> Here you need to make sure that in your PointStat config file
the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>
>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>
>>>>>>> You do not have to, but it is easier to just run PB2NC once
for all of the variables that you want. Then all of the variables will
be in one MET usable netCDF file.
>>>>>>>
>>>>>>> What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)?
>>>>>>>
>>>>>>> Leave it blank to get all of them.
>>>>>>>
>>>>>>> Let us know if you need any more help.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via
>>>>>>> RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Paul,
>>>>>>>> Please find the latest Point config file.
>>>>>>>> I do get some output (see below) but I need help to get skill
scores only.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>>
>>>>>>>> To fill out the registration, just go here:
>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>> Enter you email address and hit enter to be taken to the
form.
>>>>>>>>
>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>
>>>>>>>> 1. point_stat config file
>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>> p_interp,
>>>>>>>> etc)
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> Paul
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>>>>>>>
>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>> Queue: met_help
>>>>>>>>> Subject: skill scores
>>>>>>>>> Owner: Nobody
>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>> Status: new
>>>>>>>>> Ticket<URL:
>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>> I want to understand how to get model skill scores(specially
CSI,
>>>>>>>>> HSS,
>>>>>>>>> GSS)
>>>>>>>>>
>>>>>>>>> 1. Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>
>>>>>>>>> 2. What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)
>>>>>>>>>
>>>>>>>>> 3. Do I also put all variables in pointstat config
file?
>>>>>>>>>
>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>>
>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>
>>>>>>>>> If you have any sample pb2nc config and pointstat config
file for just skill score (category 3) that will be very help.
>>>>>>>>> Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Wed Mar 21 15:08:29 2012
Thanks Anne!
I will first do it with these correction .
On SCI
score, I still not understand why two model shows same CSI score and
even with same threshold value (for example TT >273 forecast
threshold) on two different
Model simulation possibly give different
CSI score because both model outputs fields are different.
I will
use UPP for WRF outputs and check.
Thanks for your help.
Anil
-----Original Message-----
From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
Sent: Wednesday, March 21, 2012 4:06 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
In looking at your
data there are several points I want to make.
* The top level (level
30) of your data contains invalid data and this is having an impact on
the statistics. I've attached an image plot of level 30 from the
GODDARD file for you to look at. So skip this level in your forecasts
(e.g., just do 0-29).n with
* It doesn't make sense to aggregate your
data over the entire atmosphere. You might want to consider using
smaller sets of levels to verify over.
* The reason that the CSI
score is the same is because the threshold that you have chosen has
resulted in the same contingency table counts for your different
forecast files. If you choose a different forecast threshold, you can
get different contingency table counts and then the CSI value will be
different. The CSI is based on the contingency tables.
When in doubt
it helps to look at the matched pairs (MPR) output to see where the
differences are.
One other suggestion I have for you is to use the
Unified Post Processor
(UPP) to post-process your WRF output. This
puts the data into GRIB format which is better supported in MET than
the pinterp data is.
Hope this helps you out. Let us know if we can
be of any further assistance.
Anne
On 03/21/2012 09:13 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> Yes I will do. But you still check my output with latest version of
MET?
> Thanks
> Anil
>
> Sent from my iPhone
>
> On Mar 21,
2012, at 11:09 AM, "Anne Holmes via RT"<met_help at ucar.edu> wrote:
>
>> Anil,
>>
>> We just released a new version of MET. This version
has some new
>> features as well as an improvement in our handling
of variables that
>> improves precision. We strongly recommend that
you update to this
>> version. The new version can be downloaded
from the following location:
>>
>>
http://www.dtcenter.org/met/users/downloads/index.php.
>>
>> Anne
>>
>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>> RT
>> wrote:
>>>
>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
Anne,
>>>
>>> Updated 6 October 2010 for MET 3.0
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>> -----Original Message-----
>>> From: Anne
Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Tuesday, March 20,
2012 4:07 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> I've got your files and I will try to figure this
out. One quick question for you. What version of MET are you using?
>>>
>>> Anne
>>>
>>>
>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via
>>> RT
>>> wrote:
>>>>
>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
Anne,
>>>> I put all necessary files under kumar_data dir
>>>>
>>>>
I also put two forecast files (one with GODDARD and another one
>>>>
with
>>>> THOMPSON) Point stat config is also there with cts output
files and
>>>> you can compare that fcst var-TT and RH Has same CSI
and HSS.
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>>
-----Original Message-----
>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>> Sent: Tuesday, March 20, 2012 12:00
PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>>
Anil,
>>>>
>>>> I think at this point it would be helpful if you
could upload the following files to our FTP server using the
instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>
>>>> * observation files
>>>> * forecast files
>>>> * point_stat config file
>>>>
>>>> When you have done this, let
us know and we will take a look and try to see what you are doing.
>>>>
>>>> Anne
>>>>
>>>>
>>>> On 03/20/2012 09:29 AM, Kumar,
Anil[UNIV MARYLAND COLLEGE PARK] via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Anne,
>>>>> I have one more question please help me out
I am trying to see CSI
>>>>> (Critical Success Index) from different
model runs but the problem is I am getting same CSI index even with
different model runs.
>>>>>
>>>>> I am using command as
>>>>>
bin/point_stat
>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-
13_00:00:00_PLEV
>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>
>>>>> How CSI score is same from all model runs. I checked all
model
>>>>> runs have different precipitation patterns and (T, Q,
RH) profiles so how CSI is same I am getting while running point
state.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>>
>>>>>
-----Original Message-----
>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>> Sent: Tuesday, March 13, 2012 2:54
PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>>
Anil,
>>>>>
>>>>> Sorry for the delay in getting back to you. I was
out of the office yesterday. I checked with my colleagues and the
answer is that unless you have a contact at NCEP to get you old
archived data, then you only have what is available at that site for
PrepBufr data. We do not provide data as a service, just list a few
locations in which users can retrieve some data.
>>>>>
>>>>> For the
second part of your questions, you might look at the region files in
the data/poly directory. MET comes with several smaller polyline
regions for various parts of the US. If we don't have one in there
that covers the area that you want, you can at least use them as a
sample for how to create one. They are just text files.
>>>>>
>>>>>
Let us know if we can be of any further assistance.
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>>
>>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK]
>>>>> via RT
>>>>> wrote:
>>>>>>
>>>>>>
<URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>> SGP stands for Southern Great Plains (covering
OK, TX and NE
>>>>>> states) I don't see NDAS data for June 2002
NDAS observed data is
>>>>>> available for past 3 days and for past
one month data is available.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>
Sent: Friday, March 09, 2012 3:38 PM
>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>>>
>>>>>>
>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>>>
>>>>>> See the PrepBufr Point Observations links on this page.
>>>>>>
>>>>>> To get you started, the best way would be to use the
>>>>>> mask_grid[] = [ "FULL" ];
>>>>>> first. After you are
comfortable with the full grid, then you can begin to use the mask
regions.
>>>>>>
>>>>>> Please let us know if we can be of any
further assistance.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On
03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>
via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Thanks Anne!
>>>>>>> One quick question
>>>>>>> My wrf
domain is over SGP region and I would like to used best observed
available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>
>>>>>>>
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>>>>>>>
>>>>>>> Thanks for your
wonderful help.
>>>>>>>
>>>>>>> Anil
>>>>>>>
>>>>>>> -----Original
Message-----
>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>> Sent: Friday, March 09, 2012 2:16
PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I can answer some of your questions.
For question 3 below in your original message, I am going to hand that
one over to a statistician to discuss categorical vs. continuous
statistics better.
>>>>>>>
>>>>>>> I want to understand how to get
model skill scores(specially CSI, HSS, GSS).
>>>>>>>
>>>>>>> Here
you need to make sure that in your PointStat config file the
output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>
>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>
>>>>>>> You do not have to, but it is easier to just run PB2NC once
for all of the variables that you want. Then all of the variables will
be in one MET usable netCDF file.
>>>>>>>
>>>>>>> What should I put
in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)?
>>>>>>>
>>>>>>> Leave it blank to get
all of them.
>>>>>>>
>>>>>>> Let us know if you need any more help.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On
03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>>
via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Paul,
>>>>>>>> Please find the latest Point config file.
>>>>>>>> I do get some output (see below) but I need help to get skill
scores only.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>>
From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent:
Thursday, March 08, 2012 11:25 AM
>>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I see that you're not currently a registered user
of the MET software. Prior to providing direct support in the use of
MET, we require that users fill out the free online registration form.
That enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>>
>>>>>>>> To
fill out the registration, just go here:
>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>> Enter
you email address and hit enter to be taken to the form.
>>>>>>>>
>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>
>>>>>>>> 1. point_stat config file
>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>> p_interp,
>>>>>>>> etc)
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> Paul
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/08/2012
09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>>>>>>>>>
>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted
upon.
>>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>> Queue: met_help
>>>>>>>>>
Subject: skill scores
>>>>>>>>> Owner: Nobody
>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>>
Status: new
>>>>>>>>> Ticket<URL:
>>>>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>> I want to understand how to get
model skill scores(specially
>>>>>>>>> CSI, HSS,
>>>>>>>>> GSS)
>>>>>>>>>
>>>>>>>>> 1. Do I need to put all variables in pb2nc
config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>
>>>>>>>>> 2. What should I put in level_category[] =
[ ?] - skill score based on model surface to upper atmosphere level-
200mb)
>>>>>>>>>
>>>>>>>>> 3. Do I also put all variables in
pointstat config file?
>>>>>>>>>
>>>>>>>>> fcst_field[] = [ "TT(0,0-
25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>>
>>>>>>>>> obs_field[] =
[ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>
>>>>>>>>> If you
have any sample pb2nc config and pointstat config file for just skill
score (category 3) that will be very help.
>>>>>>>>> Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>>
>>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: Anne Holmes
Time: Thu Mar 22 09:02:54 2012
Anil,
Using UPP to post-process your WRF output files will not change your
output of MET. The reason that the CSI score is the same for the two
forecasts is that the contingency tables are the same for the two
runs.
Try using several different thresholds and output the CTC files as
well.
If you get contingency table counts that are different between the two
runs, then your CSI score will be different. Hope this helps.
Anne
On 03/21/2012 03:08 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Thanks Anne!
> I will first do it with these correction .
> On SCI score, I still not understand why two model shows same CSI
score and even with same threshold value (for example TT>273 forecast
threshold) on two different
> Model simulation possibly give different CSI score because both
model outputs fields are different.
>
> I will use UPP for WRF outputs and check.
> Thanks for your help.
>
> Anil
>
>
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Wednesday, March 21, 2012 4:06 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> In looking at your data there are several points I want to make.
> * The top level (level 30) of your data contains invalid data and
this is having an impact on the statistics. I've attached an image
plot of level 30 from the GODDARD file for you to look at. So skip
this level in your forecasts (e.g., just do 0-29).n with
> * It doesn't make sense to aggregate your data over the entire
atmosphere. You might want to consider using smaller sets of levels to
verify over.
> * The reason that the CSI score is the same is because the threshold
that you have chosen has resulted in the same contingency table counts
for your different forecast files. If you choose a different forecast
threshold, you can get different contingency table counts and then the
CSI value will be different. The CSI is based on the contingency
tables.
> When in doubt it helps to look at the matched pairs (MPR) output to
see where the differences are.
>
> One other suggestion I have for you is to use the Unified Post
Processor
> (UPP) to post-process your WRF output. This puts the data into GRIB
format which is better supported in MET than the pinterp data is.
>
> Hope this helps you out. Let us know if we can be of any further
assistance.
>
> Anne
>
>
> On 03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> Yes I will do. But you still check my output with latest version of
MET?
>> Thanks
>> Anil
>>
>> Sent from my iPhone
>>
>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>
>>> Anil,
>>>
>>> We just released a new version of MET. This version has some new
>>> features as well as an improvement in our handling of variables
that
>>> improves precision. We strongly recommend that you update to this
>>> version. The new version can be downloaded from the following
location:
>>>
>>> http://www.dtcenter.org/met/users/downloads/index.php.
>>>
>>> Anne
>>>
>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Anne,
>>>>
>>>> Updated 6 October 2010 for MET 3.0
>>>>
>>>> Thanks,
>>>> Anil
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Tuesday, March 20, 2012 4:07 PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
>>>>
>>>> Anne
>>>>
>>>>
>>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Anne,
>>>>> I put all necessary files under kumar_data dir
>>>>>
>>>>> I also put two forecast files (one with GODDARD and another one
>>>>> with
>>>>> THOMPSON) Point stat config is also there with cts output files
and
>>>>> you can compare that fcst var-TT and RH Has same CSI and HSS.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>> Sent: Tuesday, March 20, 2012 12:00 PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>
>>>>> * observation files
>>>>> * forecast files
>>>>> * point_stat config file
>>>>>
>>>>> When you have done this, let us know and we will take a look and
try to see what you are doing.
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>> RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>> I have one more question please help me out I am trying to see
CSI
>>>>>> (Critical Success Index) from different model runs but the
problem is I am getting same CSI index even with different model runs.
>>>>>>
>>>>>> I am using command as
>>>>>> bin/point_stat
>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>
>>>>>> How CSI score is same from all model runs. I checked all model
>>>>>> runs have different precipitation patterns and (T, Q, RH)
profiles so how CSI is same I am getting while running point state.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>>>>
>>>>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>>>>
>>>>>> Let us know if we can be of any further assistance.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> SGP stands for Southern Great Plains (covering OK, TX and NE
>>>>>>> states) I don't see NDAS data for June 2002 NDAS observed data
is
>>>>>>> available for past 3 days and for past one month data is
available.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>>>>
>>>>>>>
>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>>>>
>>>>>>> See the PrepBufr Point Observations links on this page.
>>>>>>>
>>>>>>> To get you started, the best way would be to use the
>>>>>>> mask_grid[] = [ "FULL" ];
>>>>>>> first. After you are comfortable with the full grid, then you
can begin to use the mask regions.
>>>>>>>
>>>>>>> Please let us know if we can be of any further assistance.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Thanks Anne!
>>>>>>>> One quick question
>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>
>>>>>>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>>>>
>>>>>>>> Thanks for your wonderful help.
>>>>>>>>
>>>>>>>> Anil
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I can answer some of your questions. For question 3 below in
your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>>>>
>>>>>>>> I want to understand how to get model skill scores(specially
CSI, HSS, GSS).
>>>>>>>>
>>>>>>>> Here you need to make sure that in your PointStat config file
the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>>
>>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>
>>>>>>>> You do not have to, but it is easier to just run PB2NC once
for all of the variables that you want. Then all of the variables will
be in one MET usable netCDF file.
>>>>>>>>
>>>>>>>> What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)?
>>>>>>>>
>>>>>>>> Leave it blank to get all of them.
>>>>>>>>
>>>>>>>> Let us know if you need any more help.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Paul,
>>>>>>>>> Please find the latest Point config file.
>>>>>>>>> I do get some output (see below) but I need help to get
skill scores only.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I see that you're not currently a registered user of the MET
software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>>>
>>>>>>>>> To fill out the registration, just go here:
>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>> Enter you email address and hit enter to be taken to the
form.
>>>>>>>>>
>>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>>
>>>>>>>>> 1. point_stat config file
>>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>>> p_interp,
>>>>>>>>> etc)
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>>
>>>>>>>>> Paul
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>>>>>>>>
>>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>> Queue: met_help
>>>>>>>>>> Subject: skill scores
>>>>>>>>>> Owner: Nobody
>>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>>> Status: new
>>>>>>>>>> Ticket<URL:
>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>> I want to understand how to get model skill
scores(specially
>>>>>>>>>> CSI, HSS,
>>>>>>>>>> GSS)
>>>>>>>>>>
>>>>>>>>>> 1. Do I need to put all variables in pb2nc config
file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>>
>>>>>>>>>> 2. What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)
>>>>>>>>>>
>>>>>>>>>> 3. Do I also put all variables in pointstat config
file?
>>>>>>>>>>
>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>>>
>>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>
>>>>>>>>>> If you have any sample pb2nc config and pointstat config
file for just skill score (category 3) that will be very help.
>>>>>>>>>> Thanks,
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Mon Apr 02 07:01:02 2012
Anne,
Sorry to bother you again! I want to know how precipitation in
wrf model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain
is in mm.
In Observation files (prepbufrgdas file) precipitation is
in Kg/m2 APCP.
My question is
1. I add APCP in PB2NC config file
obs_field[] = [ "APCP"]
2. In Pointstat config file
Fcst_field[]
= ["RAINNC"]
Obs_field[] = ["APCP"]
Is this is correct?
Thanks,
Anil
-----Original Message-----
From: Anne Holmes via
RT [mailto:met_help at ucar.edu]
Sent: Thursday, March 22, 2012 11:03 AM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
Using UPP to post-
process your WRF output files will not change your output of MET. The
reason that the CSI score is the same for the two forecasts is that
the contingency tables are the same for the two runs.
Try using
several different thresholds and output the CTC files as well.
If you
get contingency table counts that are different between the two runs,
then your CSI score will be different. Hope this helps.
Anne
On 03/21/2012 03:08 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Thanks
Anne!
> I will first do it with these correction .
> On SCI score, I
still not understand why two model shows same CSI
> score and even
with same threshold value (for example TT>273 forecast threshold) on
two different Model simulation possibly give different CSI score
because both model outputs fields are different.
>
> I will use UPP
for WRF outputs and check.
> Thanks for your help.
>
> Anil
>
>
>
> -----Original Message-----
> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
> Sent: Wednesday, March 21, 2012 4:06 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject:
Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> In looking
at your data there are several points I want to make.
> * The top
level (level 30) of your data contains invalid data and this
> is
having an impact on the statistics. I've attached an image plot of
>
level 30 from the GODDARD file for you to look at. So skip this level
> in your forecasts (e.g., just do 0-29).n with
> * It doesn't make
sense to aggregate your data over the entire atmosphere. You might
want to consider using smaller sets of levels to verify over.
> * The
reason that the CSI score is the same is because the threshold that
you have chosen has resulted in the same contingency table counts for
your different forecast files. If you choose a different forecast
threshold, you can get different contingency table counts and then the
CSI value will be different. The CSI is based on the contingency
tables.
> When in doubt it helps to look at the matched pairs (MPR)
output to see where the differences are.
>
> One other suggestion I
have for you is to use the Unified Post
> Processor
> (UPP) to post-
process your WRF output. This puts the data into GRIB format which is
better supported in MET than the pinterp data is.
>
> Hope this
helps you out. Let us know if we can be of any further assistance.
>
> Anne
>
>
> On 03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK] via RT
> wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> Yes I will do. But you still check my output with latest version of
MET?
>> Thanks
>> Anil
>>
>> Sent from my iPhone
>>
>> On Mar
21, 2012, at 11:09 AM, "Anne Holmes via RT"<met_help at ucar.edu>
wrote:
>>
>>> Anil,
>>>
>>> We just released a new version of MET.
This version has some new
>>> features as well as an improvement in
our handling of variables that
>>> improves precision. We strongly
recommend that you update to this
>>> version. The new version can be
downloaded from the following location:
>>>
>>>
http://www.dtcenter.org/met/users/downloads/index.php.
>>>
>>> Anne
>>>
>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via
>>> RT
>>> wrote:
>>>>
>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
Anne,
>>>>
>>>> Updated 6 October 2010 for MET 3.0
>>>>
>>>>
Thanks,
>>>> Anil
>>>>
>>>>
>>>> -----Original Message-----
>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent:
Tuesday, March 20, 2012 4:07 PM
>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> I've got your files
and I will try to figure this out. One quick question for you. What
version of MET are you using?
>>>>
>>>> Anne
>>>>
>>>>
>>>> On
03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>>>
RT
>>>> wrote:
>>>>>
>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>>
Anne,
>>>>> I put all necessary files under kumar_data dir
>>>>>
>>>>> I also put two forecast files (one with GODDARD and another one
>>>>> with
>>>>> THOMPSON) Point stat config is also there with cts
output files
>>>>> and you can compare that fcst var-TT and RH Has
same CSI and HSS.
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>> Sent: Tuesday, March 20, 2012 12:00
PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>>
Anil,
>>>>>
>>>>> I think at this point it would be helpful if you
could upload the following files to our FTP server using the
instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>
>>>>> * observation files
>>>>> * forecast files
>>>>> * point_stat config file
>>>>>
>>>>> When you have done this,
let us know and we will take a look and try to see what you are doing.
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>> On 03/20/2012 09:29 AM, Kumar,
Anil[UNIV MARYLAND COLLEGE PARK]
>>>>> via RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>> I have one more question please help me
out I am trying to see
>>>>>> CSI (Critical Success Index) from
different model runs but the problem is I am getting same CSI index
even with different model runs.
>>>>>>
>>>>>> I am using command as
>>>>>> bin/point_stat
>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-
13_00:00:00_PLEV
>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>
>>>>>> How CSI score is same from all model runs. I checked
all model
>>>>>> runs have different precipitation patterns and (T,
Q, RH) profiles so how CSI is same I am getting while running point
state.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 13, 2012 2:54
PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> Sorry for the delay in getting back to
you. I was out of the office yesterday. I checked with my colleagues
and the answer is that unless you have a contact at NCEP to get you
old archived data, then you only have what is available at that site
for PrepBufr data. We do not provide data as a service, just list a
few locations in which users can retrieve some data.
>>>>>>
>>>>>>
For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a sample for how to create one. They are just text files.
>>>>>>
>>>>>> Let us know if we can be of any further assistance.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 03/09/2012 01:47 PM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> SGP stands for Southern Great Plains (covering
OK, TX and NE
>>>>>>> states) I don't see NDAS data for June 2002
NDAS observed data
>>>>>>> is available for past 3 days and for past
one month data is available.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>
Sent: Friday, March 09, 2012 3:38 PM
>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>>>>
>>>>>>>
>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>>>>
>>>>>>> See the PrepBufr Point Observations links on this
page.
>>>>>>>
>>>>>>> To get you started, the best way would be to
use the
>>>>>>> mask_grid[] = [ "FULL" ]; first. After you
are
>>>>>>> comfortable with the full grid, then you can begin to use
the mask regions.
>>>>>>>
>>>>>>> Please let us know if we can be of
any further assistance.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Thanks Anne!
>>>>>>>> One quick question
>>>>>>>> My wrf
domain is over SGP region and I would like to used best observed
available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>
>>>>>>>>
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>>>>>>>>
>>>>>>>> Thanks for your
wonderful help.
>>>>>>>>
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
-----Original Message-----
>>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>>> Sent: Friday, March 09, 2012 2:16
PM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I can answer some of your
questions. For question 3 below in your original message, I am going
to hand that one over to a statistician to discuss categorical vs.
continuous statistics better.
>>>>>>>>
>>>>>>>> I want to understand
how to get model skill scores(specially CSI, HSS, GSS).
>>>>>>>>
>>>>>>>> Here you need to make sure that in your PointStat config file
the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>>
>>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>
>>>>>>>> You do not have to, but it is easier to just run PB2NC once
for all of the variables that you want. Then all of the variables will
be in one MET usable netCDF file.
>>>>>>>>
>>>>>>>> What should I
put in level_category[] = [ ?] - skill score based on model surface to
upper atmosphere level-200mb)?
>>>>>>>>
>>>>>>>> Leave it blank to
get all of them.
>>>>>>>>
>>>>>>>> Let us know if you need any more
help.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Paul,
>>>>>>>>> Please find the latest Point config file.
>>>>>>>>> I do get some output (see below) but I need help to get
skill scores only.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>>>> To:
Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I see that you're not currently
a registered user of the MET software. Prior to providing direct
support in the use of MET, we require that users fill out the free
online registration form. That enables us to ensure that we remain in
compliance with the international export laws of the United States.
>>>>>>>>>
>>>>>>>>> To fill out the registration, just go here:
>>>>>>>>>
>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>> Enter
you email address and hit enter to be taken to the form.
>>>>>>>>>
>>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>>
>>>>>>>>> 1. point_stat config file
>>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>>> p_interp,
>>>>>>>>> etc)
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>>
>>>>>>>>> Paul
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On
03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>>>>>>>>>>
>>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009
was acted upon.
>>>>>>>>>> Transaction: Ticket created by
anil.kumar at nasa.gov
>>>>>>>>>> Queue: met_help
>>>>>>>>>> Subject: skill scores
>>>>>>>>>>
Owner: Nobody
>>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>>> Status: new
>>>>>>>>>> Ticket<URL:
>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>> I want to
understand how to get model skill scores(specially
>>>>>>>>>> CSI,
HSS,
>>>>>>>>>> GSS)
>>>>>>>>>>
>>>>>>>>>> 1. Do I need to
put all variables in pb2nc config file (obs_grib_code[] = [ "SPFH",
"TMP", "MIXR", "WIND" ]?
>>>>>>>>>>
>>>>>>>>>> 2. What should
I put in level_category[] = [ ?] - skill score based on model surface
to upper atmosphere level-200mb)
>>>>>>>>>>
>>>>>>>>>> 3. Do I
also put all variables in pointstat config file?
>>>>>>>>>>
>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>>>
>>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200"
etc];
>>>>>>>>>>
>>>>>>>>>> If you have any sample pb2nc config and
pointstat config file for just skill score (category 3) that will be
very help.
>>>>>>>>>> Thanks,
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: John Halley Gotway
Time: Mon Apr 02 09:50:55 2012
Anil,
Yes, that would be the correct approach. Unfortunately though, the
PrepBUFR files do not contain point observations of accumulated
precipitation! The PB2NC tool only reads observations of type P, Q,
T, Z, U, V (pressure, specific humidity, temperature, geopotential
height, and U/V winds) from the PrepBUFR files. It can also derive
some additional observations from those types (relative humidity,
for example), as listed in the comments of the PB2NC config file.
If you'd like to verify accumulated precipitation, you first need to
look at the location of your domain. If it's over the United States,
I'd suggest verifying against the StageII or StageIV
precipitation analyses. Since both the forecast/observations would be
gridded, you would use the Grid-Stat tool. And you could also use
MODE and Wavelet-Stat. Our website lists links to those products:
http://www.dtcenter.org/met/users/downloads/observation_data.php
If you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
Lastly, some users have made use of the "trmm2nc.R" R-script on the
MET website (see link above) to reformat TRMM satellite accumulated
precipitation estimates into a gridded NetCDF format that MET
can read.
Hope that helps.
John Halley Gotway
met_help at ucar.edu
On 04/02/2012 07:01 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
> In Observation files (prepbufrgdas file) precipitation is in Kg/m2
APCP.
> My question is
> 1. I add APCP in PB2NC config file obs_field[] = [ "APCP"]
> 2. In Pointstat config file
> Fcst_field[] = ["RAINNC"]
> Obs_field[] = ["APCP"]
> Is this is correct?
>
> Thanks,
> Anil
>
>
>
> -----Original Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
> Sent: Thursday, March 22, 2012 11:03 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> Using UPP to post-process your WRF output files will not change your
output of MET. The reason that the CSI score is the same for the two
forecasts is that the contingency tables are the same for the two
runs.
> Try using several different thresholds and output the CTC files as
well.
> If you get contingency table counts that are different between the
two runs, then your CSI score will be different. Hope this helps.
>
> Anne
>
>
> On 03/21/2012 03:08 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
> wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Thanks Anne!
>> I will first do it with these correction .
>> On SCI score, I still not understand why two model shows same CSI
>> score and even with same threshold value (for example TT>273
forecast threshold) on two different Model simulation possibly give
different CSI score because both model outputs fields are different.
>>
>> I will use UPP for WRF outputs and check.
>> Thanks for your help.
>>
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Wednesday, March 21, 2012 4:06 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> In looking at your data there are several points I want to make.
>> * The top level (level 30) of your data contains invalid data and
this
>> is having an impact on the statistics. I've attached an image plot
of
>> level 30 from the GODDARD file for you to look at. So skip this
level
>> in your forecasts (e.g., just do 0-29).n with
>> * It doesn't make sense to aggregate your data over the entire
atmosphere. You might want to consider using smaller sets of levels to
verify over.
>> * The reason that the CSI score is the same is because the
threshold that you have chosen has resulted in the same contingency
table counts for your different forecast files. If you choose a
different forecast threshold, you can get different contingency table
counts and then the CSI value will be different. The CSI is based on
the contingency tables.
>> When in doubt it helps to look at the matched pairs (MPR) output to
see where the differences are.
>>
>> One other suggestion I have for you is to use the Unified Post
>> Processor
>> (UPP) to post-process your WRF output. This puts the data into GRIB
format which is better supported in MET than the pinterp data is.
>>
>> Hope this helps you out. Let us know if we can be of any further
assistance.
>>
>> Anne
>>
>>
>> On 03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>> Yes I will do. But you still check my output with latest version
of MET?
>>> Thanks
>>> Anil
>>>
>>> Sent from my iPhone
>>>
>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>
>>>> Anil,
>>>>
>>>> We just released a new version of MET. This version has some new
>>>> features as well as an improvement in our handling of variables
that
>>>> improves precision. We strongly recommend that you update to this
>>>> version. The new version can be downloaded from the following
location:
>>>>
>>>> http://www.dtcenter.org/met/users/downloads/index.php.
>>>>
>>>> Anne
>>>>
>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Anne,
>>>>>
>>>>> Updated 6 October 2010 for MET 3.0
>>>>>
>>>>> Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>> Sent: Tuesday, March 20, 2012 4:07 PM
>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
>>>>>
>>>>> Anne
>>>>>
>>>>>
>>>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>> RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>> I put all necessary files under kumar_data dir
>>>>>>
>>>>>> I also put two forecast files (one with GODDARD and another one
>>>>>> with
>>>>>> THOMPSON) Point stat config is also there with cts output files
>>>>>> and you can compare that fcst var-TT and RH Has same CSI and
HSS.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 20, 2012 12:00 PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>
>>>>>> * observation files
>>>>>> * forecast files
>>>>>> * point_stat config file
>>>>>>
>>>>>> When you have done this, let us know and we will take a look
and try to see what you are doing.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> I have one more question please help me out I am trying to see
>>>>>>> CSI (Critical Success Index) from different model runs but the
problem is I am getting same CSI index even with different model runs.
>>>>>>>
>>>>>>> I am using command as
>>>>>>> bin/point_stat
>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>
>>>>>>> How CSI score is same from all model runs. I checked all model
>>>>>>> runs have different precipitation patterns and (T, Q, RH)
profiles so how CSI is same I am getting while running point state.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>>>>>
>>>>>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>>>>>
>>>>>>> Let us know if we can be of any further assistance.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> SGP stands for Southern Great Plains (covering OK, TX and NE
>>>>>>>> states) I don't see NDAS data for June 2002 NDAS observed
data
>>>>>>>> is available for past 3 days and for past one month data is
available.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I am not sure what SGP stands for, so I can't directly answer
your question. However, if the region is over North America then using
the data from NDAS will give you what you want. If it is not over
North America, then you would want to use the GDAS files for global
data. A link to both of these can be found on the following web page:
>>>>>>>>
>>>>>>>>
>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>>>>>>>
>>>>>>>> See the PrepBufr Point Observations links on this page.
>>>>>>>>
>>>>>>>> To get you started, the best way would be to use the
>>>>>>>> mask_grid[] = [ "FULL" ]; first. After you are
>>>>>>>> comfortable with the full grid, then you can begin to use the
mask regions.
>>>>>>>>
>>>>>>>> Please let us know if we can be of any further assistance.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Thanks Anne!
>>>>>>>>> One quick question
>>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>
>>>>>>>>> Another, what is the best way to create SGP.poly, I saw some
example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>>>>>
>>>>>>>>> Thanks for your wonderful help.
>>>>>>>>>
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I can answer some of your questions. For question 3 below in
your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>>>>>
>>>>>>>>> I want to understand how to get model skill scores(specially
CSI, HSS, GSS).
>>>>>>>>>
>>>>>>>>> Here you need to make sure that in your PointStat config
file the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>>>
>>>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>
>>>>>>>>> You do not have to, but it is easier to just run PB2NC once
for all of the variables that you want. Then all of the variables will
be in one MET usable netCDF file.
>>>>>>>>>
>>>>>>>>> What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)?
>>>>>>>>>
>>>>>>>>> Leave it blank to get all of them.
>>>>>>>>>
>>>>>>>>> Let us know if you need any more help.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Paul,
>>>>>>>>>> Please find the latest Point config file.
>>>>>>>>>> I do get some output (see below) but I need help to get
skill scores only.
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> -----Original Message-----
>>>>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I see that you're not currently a registered user of the
MET software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>>>>
>>>>>>>>>> To fill out the registration, just go here:
>>>>>>>>>>
>>>>>>>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>> Enter you email address and hit enter to be taken to the
form.
>>>>>>>>>>
>>>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>>>
>>>>>>>>>> 1. point_stat config file
>>>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>>>> p_interp,
>>>>>>>>>> etc)
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>>
>>>>>>>>>> Paul
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>>>>>>>>>
>>>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>> Queue: met_help
>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>>>> Status: new
>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>> I want to understand how to get model skill
scores(specially
>>>>>>>>>>> CSI, HSS,
>>>>>>>>>>> GSS)
>>>>>>>>>>>
>>>>>>>>>>> 1. Do I need to put all variables in pb2nc config
file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>
>>>>>>>>>>> 2. What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)
>>>>>>>>>>>
>>>>>>>>>>> 3. Do I also put all variables in pointstat config
file?
>>>>>>>>>>>
>>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>>>>
>>>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>>
>>>>>>>>>>> If you have any sample pb2nc config and pointstat config
file for just skill score (category 3) that will be very help.
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>
>>
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Apr 03 09:54:21 2012
John,
I am running MET over US (Southern Great Plains). Now I am
using STAGE4 precipitation data and comparing with WRF out and doing
some statistics (specially CSI/Threat Score )
When I am doing
grid_stat I get
ERROR: process_scores() -> The forecast and
observation grids do not match for field 1.
So I looked again wrf
out domain grid dimension and STAGE 4 dimension
In steps:
1. I
used wrfpost.exe (WPP) to convert WRFPRS_d02.012 (Grib) and APCP var
dimension is
APCP=Total precipitation [kg/m^2]
timerange 4 P1
0 P2 24 TimeU 1 nx 489 ny 435 GDS grid 3 num_in_ave 0 missing 0
center 7 subcenter 0 process 89 Table 2 scan: WE:SN winds(grid)
Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
Latin1 60.000000 Latin2 36.300000 LatSP 0.000000 LonSP 0.000000
North Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode 137
min/max data 0 93.25 num bits 11 BDS_Ref 0 DecScale 0 BinScale -4
2. On other hand STAGE4 files
Dimension of stage4 files is
wgrib -V
STAGE4/ST4.2002061300.01h
rec 1:0:date 2002061223 APCP kpds5=61
kpds6=1 kpds7=0 levels=(0,0) grid=255 sfc 0-1hr acc: bitmap: 389369
undef
APCP=Total precipitation [kg/m^2]
timerange 4 P1 0 P2 1
TimeU 1 nx 1121 ny 881 GDS grid 5 num_in_ave 0 missing 0
center 7
subcenter 4 process 182 Table 2 scan: WE:SN winds(grid)
polar
stereo: Lat1 23.117000 Long1 240.983000 Orient -105.000000
north
pole (1121 x 881) Dx 4762 Dy 4762 scan 64 mode 8
min/max data 0
69.38 num bits 13 BDS_Ref 0 DecScale 2 BinScale 0
My Question is
"Is I have to regrid STAGE4 data as same as model grid? " and how?
FYI: I used pcp this way:
I use pcp_combine and created one file for
12 hours accumulation
bin/pcp_combine -sum 00000000_000000 1
20020613_000000 12 OBS_200206_12A.nc -pcpdir STAGE4
Performing sum
command: Init/In_Accum/Valid/Out_Accum Times =
00000000_000000/010000/20020613_000000/120000
Searching for 12 files
with accumulation times of 010000 to sum to a total accumulation time
of 120000.
[1] Reading input file: STAGE4/ST4.2002061300.01h
[2]
Reading input file: STAGE4/ST4.2002061223.01h
[3] Reading input file:
STAGE4/ST4.2002061222.01h
[4] Reading input file:
STAGE4/ST4.2002061221.01h
[5] Reading input file:
STAGE4/ST4.2002061220.01h
[6] Reading input file:
STAGE4/ST4.2002061219.01h
[7] Reading input file:
STAGE4/ST4.2002061218.01h
[8] Reading input file:
STAGE4/ST4.2002061217.01h
[9] Reading input file:
STAGE4/ST4.2002061216.01h
[10] Reading input file:
STAGE4/ST4.2002061215.01h
[11] Reading input file:
STAGE4/ST4.2002061214.01h
[12] Reading input file:
STAGE4/ST4.2002061213.01h
-----Original Message-----
From:
John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Monday,
April 02, 2012 11:51 AM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
Anil,
Yes, that would be the correct approach. Unfortunately
though, the PrepBUFR files do not contain point observations of
accumulated precipitation! The PB2NC tool only reads observations of
type P, Q, T, Z, U, V (pressure, specific humidity, temperature,
geopotential height, and U/V winds) from the PrepBUFR files. It can
also derive some additional observations from those types (relative
humidity, for example), as listed in the comments of the PB2NC config
file.
If you'd like to verify accumulated precipitation, you first
need to look at the location of your domain. If it's over the United
States, I'd suggest verifying against the StageII or StageIV
precipitation analyses. Since both the forecast/observations would be
gridded, you would use the Grid-Stat tool. And you could also use
MODE and Wavelet-Stat. Our website lists links to those products:
http://www.dtcenter.org/met/users/downloads/observation_data.php
If
you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
Lastly, some users have made use of the "trmm2nc.R"
R-script on the MET website (see link above) to reformat TRMM
satellite accumulated precipitation estimates into a gridded NetCDF
format that MET can read.
Hope that helps.
John Halley Gotway
met_help at ucar.edu
On 04/02/2012 07:01 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> Anne,
> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
> In Observation files (prepbufrgdas file) precipitation is in
Kg/m2 APCP.
> My question is
> 1. I add APCP in PB2NC config file
obs_field[] = [ "APCP"] 2. In
> Pointstat config file
>
Fcst_field[] = ["RAINNC"]
> Obs_field[] = ["APCP"]
> Is this
is correct?
>
> Thanks,
> Anil
>
>
>
> -----Original
Message-----
> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>
Sent: Thursday, March 22, 2012 11:03 AM
> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu
#55009] skill scores
>
> Anil,
>
> Using UPP to post-process your
WRF output files will not change your output of MET. The reason that
the CSI score is the same for the two forecasts is that the
contingency tables are the same for the two runs.
> Try using several
different thresholds and output the CTC files as well.
> If you get
contingency table counts that are different between the two runs, then
your CSI score will be different. Hope this helps.
>
> Anne
>
>
>
On 03/21/2012 03:08 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
> wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>>
Thanks Anne!
>> I will first do it with these correction .
>> On SCI
score, I still not understand why two model shows same CSI
>> score
and even with same threshold value (for example TT>273 forecast
threshold) on two different Model simulation possibly give different
CSI score because both model outputs fields are different.
>>
>> I
will use UPP for WRF outputs and check.
>> Thanks for your help.
>>
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Anne
Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Wednesday, March
21, 2012 4:06 PM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> In looking at your data there are several points
I want to make.
>> * The top level (level 30) of your data contains
invalid data and
>> this is having an impact on the statistics. I've
attached an image
>> plot of level 30 from the GODDARD file for you
to look at. So skip
>> this level in your forecasts (e.g., just do 0-
29).n with
>> * It doesn't make sense to aggregate your data over the
entire atmosphere. You might want to consider using smaller sets of
levels to verify over.
>> * The reason that the CSI score is the same
is because the threshold that you have chosen has resulted in the same
contingency table counts for your different forecast files. If you
choose a different forecast threshold, you can get different
contingency table counts and then the CSI value will be different. The
CSI is based on the contingency tables.
>> When in doubt it helps to
look at the matched pairs (MPR) output to see where the differences
are.
>>
>> One other suggestion I have for you is to use the Unified
Post
>> Processor
>> (UPP) to post-process your WRF output. This
puts the data into GRIB format which is better supported in MET than
the pinterp data is.
>>
>> Hope this helps you out. Let us know if
we can be of any further assistance.
>>
>> Anne
>>
>>
>> On
03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>
RT
>> wrote:
>>>
>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>>
Anne,
>>> Yes I will do. But you still check my output with latest
version of MET?
>>> Thanks
>>> Anil
>>>
>>> Sent from my iPhone
>>>
>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>
>>>> Anil,
>>>>
>>>> We just
released a new version of MET. This version has some new
>>>>
features as well as an improvement in our handling of variables
>>>>
that improves precision. We strongly recommend that you update to
>>>> this version. The new version can be downloaded from the
following location:
>>>>
>>>>
http://www.dtcenter.org/met/users/downloads/index.php.
>>>>
>>>>
Anne
>>>>
>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK] via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>>
Anne,
>>>>>
>>>>> Updated 6 October 2010 for MET 3.0
>>>>>
>>>>>
Thanks,
>>>>> Anil
>>>>>
>>>>>
>>>>> -----Original Message-----
>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>> Sent:
Tuesday, March 20, 2012 4:07 PM
>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>
>>>>> Anil,
>>>>>
>>>>> I've got your files and I will try to figure this out. One quick
question for you. What version of MET are you using?
>>>>>
>>>>>
Anne
>>>>>
>>>>>
>>>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK]
>>>>> via RT
>>>>> wrote:
>>>>>>
>>>>>>
<URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>> I put all necessary files under kumar_data dir
>>>>>>
>>>>>> I also put two forecast files (one with GODDARD and
another one
>>>>>> with
>>>>>> THOMPSON) Point stat config is also
there with cts output files
>>>>>> and you can compare that fcst var-
TT and RH Has same CSI and HSS.
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne
Holmes via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March
20, 2012 12:00 PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I think at this point it
would be helpful if you could upload the following files to our FTP
server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>
>>>>>> * observation files
>>>>>> * forecast
files
>>>>>> * point_stat config file
>>>>>>
>>>>>> When you have
done this, let us know and we will take a look and try to see what you
are doing.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/20/2012
09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> I have one more question please help me out I
am trying to see
>>>>>>> CSI (Critical Success Index) from different
model runs but the problem is I am getting same CSI index even with
different model runs.
>>>>>>>
>>>>>>> I am using command as
>>>>>>>
bin/point_stat
>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-
13_00:00:00_PLEV
>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>
>>>>>>> How CSI score is same from all model runs. I checked
all model
>>>>>>> runs have different precipitation patterns and (T,
Q, RH) profiles so how CSI is same I am getting while running point
state.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes
via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Tuesday, March 13,
2012 2:54 PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> Sorry for the delay
in getting back to you. I was out of the office yesterday. I checked
with my colleagues and the answer is that unless you have a contact at
NCEP to get you old archived data, then you only have what is
available at that site for PrepBufr data. We do not provide data as a
service, just list a few locations in which users can retrieve some
data.
>>>>>>>
>>>>>>> For the second part of your questions, you
might look at the region files in the data/poly directory. MET comes
with several smaller polyline regions for various parts of the US. If
we don't have one in there that covers the area that you want, you can
at least use them as a sample for how to create one. They are just
text files.
>>>>>>>
>>>>>>> Let us know if we can be of any further
assistance.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> SGP stands for Southern Great Plains
(covering OK, TX and NE
>>>>>>>> states) I don't see NDAS data for
June 2002 NDAS observed data
>>>>>>>> is available for past 3 days
and for past one month data is available.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
-----Original Message-----
>>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>>> Sent: Friday, March 09, 2012 3:38
PM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I am not sure what SGP stands for,
so I can't directly answer your question. However, if the region is
over North America then using the data from NDAS will give you what
you want. If it is not over North America, then you would want to use
the GDAS files for global data. A link to both of these can be found
on the following web page:
>>>>>>>>
>>>>>>>>
>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.ph
>>>>>>>> p
>>>>>>>>
>>>>>>>> See the PrepBufr Point Observations
links on this page.
>>>>>>>>
>>>>>>>> To get you started, the best
way would be to use the
>>>>>>>> mask_grid[] = [ "FULL" ];
first. After you are
>>>>>>>> comfortable with the full grid, then
you can begin to use the mask regions.
>>>>>>>>
>>>>>>>> Please let
us know if we can be of any further assistance.
>>>>>>>>
>>>>>>>>
Anne
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/09/2012 01:11 PM, Kumar,
Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Thanks Anne!
>>>>>>>>> One quick question
>>>>>>>>> My wrf
domain is over SGP region and I would like to used best observed
available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>
>>>>>>>>>
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>>>>>>>>>
>>>>>>>>> Thanks for your
wonderful help.
>>>>>>>>>
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
-----Original Message-----
>>>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Friday, March 09, 2012
2:16 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I can answer some of
your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
>>>>>>>>>
>>>>>>>>> I want to
understand how to get model skill scores(specially CSI, HSS, GSS).
>>>>>>>>>
>>>>>>>>> Here you need to make sure that in your PointStat
config file the output_flag[] for CTS (continuous statistics) is
turned on.
>>>>>>>>>
>>>>>>>>> Do I need to put all variables in
pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND"
]?
>>>>>>>>>
>>>>>>>>> You do not have to, but it is easier to just
run PB2NC once for all of the variables that you want. Then all of the
variables will be in one MET usable netCDF file.
>>>>>>>>>
>>>>>>>>>
What should I put in level_category[] = [ ?] - skill score based on
model surface to upper atmosphere level-200mb)?
>>>>>>>>>
>>>>>>>>>
Leave it blank to get all of them.
>>>>>>>>>
>>>>>>>>> Let us know
if you need any more help.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/08/2012 02:23 PM, Kumar,
Anil[UNIV MARYLAND COLLEGE
>>>>>>>>> PARK] via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
>>>>>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Paul,
>>>>>>>>>> Please find the latest Point config file.
>>>>>>>>>> I do get some output (see below) but I need help to get
skill scores only.
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> -----Original
Message-----
>>>>>>>>>> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Thursday, March 08, 2012
11:25 AM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I see
that you're not currently a registered user of the MET software.
Prior to providing direct support in the use of MET, we require that
users fill out the free online registration form. That enables us to
ensure that we remain in compliance with the international export laws
of the United States.
>>>>>>>>>>
>>>>>>>>>> To fill out the
registration, just go here:
>>>>>>>>>>
>>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>>
Enter you email address and hit enter to be taken to the form.
>>>>>>>>>>
>>>>>>>>>> Once you have registered, can you please send
me the following information:
>>>>>>>>>>
>>>>>>>>>> 1. point_stat
config file
>>>>>>>>>> 2. type of model data that you want to verify
(e.g. GRIB,
>>>>>>>>>> p_interp,
>>>>>>>>>> etc)
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>>
>>>>>>>>>> Paul
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>>>>>>>>>>>
>>>>>>>>>>> Thu Mar
08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>>
Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>>
Queue: met_help
>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>
Requestors: anil.kumar at nasa.gov
>>>>>>>>>>> Status:
new
>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>> I want to understand how to
get model skill scores(specially
>>>>>>>>>>> CSI, HSS,
>>>>>>>>>>>
GSS)
>>>>>>>>>>>
>>>>>>>>>>> 1. Do I need to put all variables
in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR",
"WIND" ]?
>>>>>>>>>>>
>>>>>>>>>>> 2. What should I put in
level_category[] = [ ?] - skill score based on model surface to upper
atmosphere level-200mb)
>>>>>>>>>>>
>>>>>>>>>>> 3. Do I also
put all variables in pointstat config file?
>>>>>>>>>>>
>>>>>>>>>>>
fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc ];
>>>>>>>>>>>
>>>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-
200" etc];
>>>>>>>>>>>
>>>>>>>>>>> If you have any sample pb2nc
config and pointstat config file for just skill score (category 3)
that will be very help.
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: John Halley Gotway
Time: Tue Apr 03 10:13:39 2012
Anil,
Yes, the input to the grid-to-grid tools in MET (Grid-Stat, MODE, and
Wavelet-Stat) must be on a common grid. Regridding the StageIV to
your model domain is probably the way to go. Based on the
wgrib output you sent, I see that your model data is on a Lambert
Conformal projection, and I see that the StageIV data is on a polar
stereographic projection. So you need to regrid the StageIV data
from a polar stereographic grid to a lambert conformal one.
We recommend using the copygb utility to regrid GRIB1 files. copygb
is distributed as part of the WRF-PostProcessor - look in directory
where you see "wrfpost.exe" and you should find an executable
named "copygb.exe". An example of using copygb to regrid to a lambert
conformal grid can be found on this page of the MET online tutorial:
http://www.dtcenter.org/met/users/support/online_tutorial/METv3.1/copygb/run3.php
Just use the wgrib grid definition to translate it into a command line
for copygb following the instructions on that page:
Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
Latin1 60.000000 Latin2 36.300000 LatSP 0.000000 LonSP 0.000000
North Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode 137
Please give it a try. If you get stuck and can't get the data on a
common grid, just let me know and I can help.
Thanks,
John
On 04/03/2012 09:54 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> John,
> I am running MET over US (Southern Great Plains). Now I am using
STAGE4 precipitation data and comparing with WRF out and doing some
statistics (specially CSI/Threat Score )
>
> When I am doing grid_stat I get
> ERROR: process_scores() -> The forecast and observation grids do
not match for field 1.
>
> So I looked again wrf out domain grid dimension and STAGE 4
dimension
>
> In steps:
> 1. I used wrfpost.exe (WPP) to convert WRFPRS_d02.012 (Grib) and
APCP var dimension is
>
> APCP=Total precipitation [kg/m^2]
> timerange 4 P1 0 P2 24 TimeU 1 nx 489 ny 435 GDS grid 3
num_in_ave 0 missing 0
> center 7 subcenter 0 process 89 Table 2 scan: WE:SN winds(grid)
> Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
> Latin1 60.000000 Latin2 36.300000 LatSP 0.000000 LonSP
0.000000
> North Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode
137
> min/max data 0 93.25 num bits 11 BDS_Ref 0 DecScale 0 BinScale
-4
>
>
> 2. On other hand STAGE4 files
> Dimension of stage4 files is
> wgrib -V STAGE4/ST4.2002061300.01h
> rec 1:0:date 2002061223 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
grid=255 sfc 0-1hr acc: bitmap: 389369 undef
> APCP=Total precipitation [kg/m^2]
> timerange 4 P1 0 P2 1 TimeU 1 nx 1121 ny 881 GDS grid 5
num_in_ave 0 missing 0
> center 7 subcenter 4 process 182 Table 2 scan: WE:SN winds(grid)
> polar stereo: Lat1 23.117000 Long1 240.983000 Orient -105.000000
> north pole (1121 x 881) Dx 4762 Dy 4762 scan 64 mode 8
> min/max data 0 69.38 num bits 13 BDS_Ref 0 DecScale 2 BinScale
0
>
> My Question is "Is I have to regrid STAGE4 data as same as model
grid? " and how?
>
> FYI: I used pcp this way:
> I use pcp_combine and created one file for 12 hours accumulation
> bin/pcp_combine -sum 00000000_000000 1 20020613_000000 12
OBS_200206_12A.nc -pcpdir STAGE4
> Performing sum command: Init/In_Accum/Valid/Out_Accum Times =
00000000_000000/010000/20020613_000000/120000
> Searching for 12 files with accumulation times of 010000 to sum to a
total accumulation time of 120000.
> [1] Reading input file: STAGE4/ST4.2002061300.01h
> [2] Reading input file: STAGE4/ST4.2002061223.01h
> [3] Reading input file: STAGE4/ST4.2002061222.01h
> [4] Reading input file: STAGE4/ST4.2002061221.01h
> [5] Reading input file: STAGE4/ST4.2002061220.01h
> [6] Reading input file: STAGE4/ST4.2002061219.01h
> [7] Reading input file: STAGE4/ST4.2002061218.01h
> [8] Reading input file: STAGE4/ST4.2002061217.01h
> [9] Reading input file: STAGE4/ST4.2002061216.01h
> [10] Reading input file: STAGE4/ST4.2002061215.01h
> [11] Reading input file: STAGE4/ST4.2002061214.01h
> [12] Reading input file: STAGE4/ST4.2002061213.01h
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Monday, April 02, 2012 11:51 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> Yes, that would be the correct approach. Unfortunately though, the
PrepBUFR files do not contain point observations of accumulated
precipitation! The PB2NC tool only reads observations of type P, Q,
T, Z, U, V (pressure, specific humidity, temperature, geopotential
height, and U/V winds) from the PrepBUFR files. It can also derive
some additional observations from those types (relative humidity, for
example), as listed in the comments of the PB2NC config file.
>
> If you'd like to verify accumulated precipitation, you first need to
look at the location of your domain. If it's over the United States,
I'd suggest verifying against the StageII or StageIV precipitation
analyses. Since both the forecast/observations would be gridded, you
would use the Grid-Stat tool. And you could also use MODE and
Wavelet-Stat. Our website lists links to those products:
>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>
> If you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
>
> Lastly, some users have made use of the "trmm2nc.R" R-script on the
MET website (see link above) to reformat TRMM satellite accumulated
precipitation estimates into a gridded NetCDF format that MET can
read.
>
> Hope that helps.
>
> John Halley Gotway
> met_help at ucar.edu
>
>
> On 04/02/2012 07:01 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
>> In Observation files (prepbufrgdas file) precipitation is in Kg/m2
APCP.
>> My question is
>> 1. I add APCP in PB2NC config file obs_field[] = [ "APCP"] 2. In
>> Pointstat config file
>> Fcst_field[] = ["RAINNC"]
>> Obs_field[] = ["APCP"]
>> Is this is correct?
>>
>> Thanks,
>> Anil
>>
>>
>>
>> -----Original Message-----
>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>> Sent: Thursday, March 22, 2012 11:03 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Using UPP to post-process your WRF output files will not change
your output of MET. The reason that the CSI score is the same for the
two forecasts is that the contingency tables are the same for the two
runs.
>> Try using several different thresholds and output the CTC files as
well.
>> If you get contingency table counts that are different between the
two runs, then your CSI score will be different. Hope this helps.
>>
>> Anne
>>
>>
>> On 03/21/2012 03:08 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Thanks Anne!
>>> I will first do it with these correction .
>>> On SCI score, I still not understand why two model shows same CSI
>>> score and even with same threshold value (for example TT>273
forecast threshold) on two different Model simulation possibly give
different CSI score because both model outputs fields are different.
>>>
>>> I will use UPP for WRF outputs and check.
>>> Thanks for your help.
>>>
>>> Anil
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Wednesday, March 21, 2012 4:06 PM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> In looking at your data there are several points I want to make.
>>> * The top level (level 30) of your data contains invalid data and
>>> this is having an impact on the statistics. I've attached an image
>>> plot of level 30 from the GODDARD file for you to look at. So skip
>>> this level in your forecasts (e.g., just do 0-29).n with
>>> * It doesn't make sense to aggregate your data over the entire
atmosphere. You might want to consider using smaller sets of levels to
verify over.
>>> * The reason that the CSI score is the same is because the
threshold that you have chosen has resulted in the same contingency
table counts for your different forecast files. If you choose a
different forecast threshold, you can get different contingency table
counts and then the CSI value will be different. The CSI is based on
the contingency tables.
>>> When in doubt it helps to look at the matched pairs (MPR) output
to see where the differences are.
>>>
>>> One other suggestion I have for you is to use the Unified Post
>>> Processor
>>> (UPP) to post-process your WRF output. This puts the data into
GRIB format which is better supported in MET than the pinterp data is.
>>>
>>> Hope this helps you out. Let us know if we can be of any further
assistance.
>>>
>>> Anne
>>>
>>>
>>> On 03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Anne,
>>>> Yes I will do. But you still check my output with latest version
of MET?
>>>> Thanks
>>>> Anil
>>>>
>>>> Sent from my iPhone
>>>>
>>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>>
>>>>> Anil,
>>>>>
>>>>> We just released a new version of MET. This version has some new
>>>>> features as well as an improvement in our handling of variables
>>>>> that improves precision. We strongly recommend that you update
to
>>>>> this version. The new version can be downloaded from the
following location:
>>>>>
>>>>> http://www.dtcenter.org/met/users/downloads/index.php.
>>>>>
>>>>> Anne
>>>>>
>>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>>> RT
>>>>> wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>>
>>>>>> Updated 6 October 2010 for MET 3.0
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>> -----Original Message-----
>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 20, 2012 4:07 PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I've got your files and I will try to figure this out. One
quick question for you. What version of MET are you using?
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> I put all necessary files under kumar_data dir
>>>>>>>
>>>>>>> I also put two forecast files (one with GODDARD and another
one
>>>>>>> with
>>>>>>> THOMPSON) Point stat config is also there with cts output
files
>>>>>>> and you can compare that fcst var-TT and RH Has same CSI and
HSS.
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Tuesday, March 20, 2012 12:00 PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>>
>>>>>>> * observation files
>>>>>>> * forecast files
>>>>>>> * point_stat config file
>>>>>>>
>>>>>>> When you have done this, let us know and we will take a look
and try to see what you are doing.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> I have one more question please help me out I am trying to
see
>>>>>>>> CSI (Critical Success Index) from different model runs but
the problem is I am getting same CSI index even with different model
runs.
>>>>>>>>
>>>>>>>> I am using command as
>>>>>>>> bin/point_stat
>>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>>
>>>>>>>> How CSI score is same from all model runs. I checked all
model
>>>>>>>> runs have different precipitation patterns and (T, Q, RH)
profiles so how CSI is same I am getting while running point state.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>>>>>>
>>>>>>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>>>>>>
>>>>>>>> Let us know if we can be of any further assistance.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Anne,
>>>>>>>>> SGP stands for Southern Great Plains (covering OK, TX and NE
>>>>>>>>> states) I don't see NDAS data for June 2002 NDAS observed
data
>>>>>>>>> is available for past 3 days and for past one month data is
available.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I am not sure what SGP stands for, so I can't directly
answer your question. However, if the region is over North America
then using the data from NDAS will give you what you want. If it is
not over North America, then you would want to use the GDAS files for
global data. A link to both of these can be found on the following web
page:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.ph
>>>>>>>>> p
>>>>>>>>>
>>>>>>>>> See the PrepBufr Point Observations links on this page.
>>>>>>>>>
>>>>>>>>> To get you started, the best way would be to use the
>>>>>>>>> mask_grid[] = [ "FULL" ]; first. After you are
>>>>>>>>> comfortable with the full grid, then you can begin to use
the mask regions.
>>>>>>>>>
>>>>>>>>> Please let us know if we can be of any further assistance.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Thanks Anne!
>>>>>>>>>> One quick question
>>>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>>
>>>>>>>>>> Another, what is the best way to create SGP.poly, I saw
some example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>>>>>>
>>>>>>>>>> Thanks for your wonderful help.
>>>>>>>>>>
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>> -----Original Message-----
>>>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I can answer some of your questions. For question 3 below
in your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>>>>>>
>>>>>>>>>> I want to understand how to get model skill
scores(specially CSI, HSS, GSS).
>>>>>>>>>>
>>>>>>>>>> Here you need to make sure that in your PointStat config
file the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>>>>
>>>>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>>
>>>>>>>>>> You do not have to, but it is easier to just run PB2NC once
for all of the variables that you want. Then all of the variables will
be in one MET usable netCDF file.
>>>>>>>>>>
>>>>>>>>>> What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)?
>>>>>>>>>>
>>>>>>>>>> Leave it blank to get all of them.
>>>>>>>>>>
>>>>>>>>>> Let us know if you need any more help.
>>>>>>>>>>
>>>>>>>>>> Anne
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>>> PARK] via RT
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> <URL:
>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>> Paul,
>>>>>>>>>>> Please find the latest Point config file.
>>>>>>>>>>> I do get some output (see below) but I need help to get
skill scores only.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>>
>>>>>>>>>>> Anil,
>>>>>>>>>>>
>>>>>>>>>>> I see that you're not currently a registered user of the
MET software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>>>>>
>>>>>>>>>>> To fill out the registration, just go here:
>>>>>>>>>>>
>>>>>>>>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>>> Enter you email address and hit enter to be taken to the
form.
>>>>>>>>>>>
>>>>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>>>>
>>>>>>>>>>> 1. point_stat config file
>>>>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>>>>> p_interp,
>>>>>>>>>>> etc)
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Paul
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>>> Queue: met_help
>>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>>>>> Status: new
>>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I want to understand how to get model skill
scores(specially
>>>>>>>>>>>> CSI, HSS,
>>>>>>>>>>>> GSS)
>>>>>>>>>>>>
>>>>>>>>>>>> 1. Do I need to put all variables in pb2nc config
file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>>
>>>>>>>>>>>> 2. What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)
>>>>>>>>>>>>
>>>>>>>>>>>> 3. Do I also put all variables in pointstat config
file?
>>>>>>>>>>>>
>>>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc
];
>>>>>>>>>>>>
>>>>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>>>
>>>>>>>>>>>> If you have any sample pb2nc config and pointstat config
file for just skill score (category 3) that will be very help.
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Anil
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>>
>>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Apr 03 10:46:56 2012
Hi John,
Based on model dimension information
Lambert Conf: Lat1
32.290000 Lon1 -103.515000 Lov -98.400000
Latin1 60.000000
Latin2 36.300000 LatSP 0.000000 LonSP 0.000000
North Pole (489
x 435) Dx 2.000000 Dy 2.000000 scan 64 mode 137
I did copygb
./copygb.exe -xg"255 3 489 435 3229 -103515 8 -98400 2000 2000 0 64
60000 36300" STAGE4/ST4.2002061212.01h ST4_2002061212.Grb_latlon
But nothing is written in file
Is I am missing anything in copygb
command?
Appreciated your help John!
Anil
-----Original
Message-----
From: John Halley Gotway via RT
[mailto:met_help at ucar.edu]
Sent: Tuesday, April 03, 2012 12:14 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
Yes, the input to
the grid-to-grid tools in MET (Grid-Stat, MODE, and Wavelet-Stat) must
be on a common grid. Regridding the StageIV to your model domain is
probably the way to go. Based on the wgrib output you sent, I see
that your model data is on a Lambert Conformal projection, and I see
that the StageIV data is on a polar stereographic projection. So you
need to regrid the StageIV data from a polar stereographic grid to a
lambert conformal one.
We recommend using the copygb utility to
regrid GRIB1 files. copygb is distributed as part of the WRF-
PostProcessor - look in directory where you see "wrfpost.exe" and you
should find an executable named "copygb.exe". An example of using
copygb to regrid to a lambert conformal grid can be found on this page
of the MET online tutorial:
http://www.dtcenter.org/met/users/support/online_tutorial/METv3.1/copygb/run3.php
Just use the wgrib grid definition to translate it into a command line
for copygb following the instructions on that page:
Lambert Conf:
Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
Latin1
60.000000 Latin2 36.300000 LatSP 0.000000 LonSP 0.000000
North
Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode 137
Please
give it a try. If you get stuck and can't get the data on a common
grid, just let me know and I can help.
Thanks,
John
On
04/03/2012 09:54 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> John,
> I am running MET over US (Southern Great Plains). Now I am using
>
STAGE4 precipitation data and comparing with WRF out and doing some
>
statistics (specially CSI/Threat Score )
>
> When I am doing
grid_stat I get
> ERROR: process_scores() -> The forecast and
observation grids do not match for field 1.
>
> So I looked again
wrf out domain grid dimension and STAGE 4 dimension
>
> In steps:
>
1. I used wrfpost.exe (WPP) to convert WRFPRS_d02.012 (Grib) and APCP
> var dimension is
>
> APCP=Total precipitation [kg/m^2]
>
timerange 4 P1 0 P2 24 TimeU 1 nx 489 ny 435 GDS grid 3 num_in_ave 0
missing 0
> center 7 subcenter 0 process 89 Table 2 scan: WE:SN
winds(grid)
> Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov
-98.400000
> Latin1 60.000000 Latin2 36.300000 LatSP 0.000000
LonSP 0.000000
> North Pole (489 x 435) Dx 2.000000 Dy
2.000000 scan 64 mode 137
> min/max data 0 93.25 num bits 11
BDS_Ref 0 DecScale 0 BinScale
> -4
>
>
> 2. On other hand STAGE4
files
> Dimension of stage4 files is
> wgrib -V
STAGE4/ST4.2002061300.01h
> rec 1:0:date 2002061223 APCP kpds5=61
kpds6=1 kpds7=0 levels=(0,0) grid=255 sfc 0-1hr acc: bitmap: 389369
undef
> APCP=Total precipitation [kg/m^2]
> timerange 4 P1 0
P2 1 TimeU 1 nx 1121 ny 881 GDS grid 5 num_in_ave 0 missing 0
>
center 7 subcenter 4 process 182 Table 2 scan: WE:SN winds(grid)
>
polar stereo: Lat1 23.117000 Long1 240.983000 Orient -105.000000
>
north pole (1121 x 881) Dx 4762 Dy 4762 scan 64 mode 8
> min/max
data 0 69.38 num bits 13 BDS_Ref 0 DecScale 2 BinScale 0
>
> My
Question is "Is I have to regrid STAGE4 data as same as model grid? "
and how?
>
> FYI: I used pcp this way:
> I use pcp_combine and
created one file for 12 hours accumulation
> bin/pcp_combine -sum
00000000_000000 1 20020613_000000 12
> OBS_200206_12A.nc -pcpdir
STAGE4 Performing sum command:
> Init/In_Accum/Valid/Out_Accum Times
=
> 00000000_000000/010000/20020613_000000/120000
> Searching for 12
files with accumulation times of 010000 to sum to a total accumulation
time of 120000.
> [1] Reading input file: STAGE4/ST4.2002061300.01h
[2] Reading input
> file: STAGE4/ST4.2002061223.01h [3] Reading input
file:
> STAGE4/ST4.2002061222.01h [4] Reading input file:
>
STAGE4/ST4.2002061221.01h [5] Reading input file:
>
STAGE4/ST4.2002061220.01h [6] Reading input file:
>
STAGE4/ST4.2002061219.01h [7] Reading input file:
>
STAGE4/ST4.2002061218.01h [8] Reading input file:
>
STAGE4/ST4.2002061217.01h [9] Reading input file:
>
STAGE4/ST4.2002061216.01h [10] Reading input file:
>
STAGE4/ST4.2002061215.01h [11] Reading input file:
>
STAGE4/ST4.2002061214.01h [12] Reading input file:
>
STAGE4/ST4.2002061213.01h
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent:
Monday, April 02, 2012 11:51 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV
MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>
> Anil,
>
> Yes, that would be the correct approach.
Unfortunately though, the PrepBUFR files do not contain point
observations of accumulated precipitation! The PB2NC tool only reads
observations of type P, Q, T, Z, U, V (pressure, specific humidity,
temperature, geopotential height, and U/V winds) from the PrepBUFR
files. It can also derive some additional observations from those
types (relative humidity, for example), as listed in the comments of
the PB2NC config file.
>
> If you'd like to verify accumulated
precipitation, you first need to look at the location of your domain.
If it's over the United States, I'd suggest verifying against the
StageII or StageIV precipitation analyses. Since both the
forecast/observations would be gridded, you would use the Grid-Stat
tool. And you could also use MODE and Wavelet-Stat. Our website
lists links to those products:
>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>
>
If you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
>
> Lastly, some users have made use of the
"trmm2nc.R" R-script on the MET website (see link above) to reformat
TRMM satellite accumulated precipitation estimates into a gridded
NetCDF format that MET can read.
>
> Hope that helps.
>
> John
Halley Gotway
> met_help at ucar.edu
>
>
> On 04/02/2012 07:01 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
>> In Observation files (prepbufrgdas file) precipitation is in
Kg/m2 APCP.
>> My question is
>> 1. I add APCP in PB2NC config file
obs_field[] = [ "APCP"] 2. In
>> Pointstat config file
>>
Fcst_field[] = ["RAINNC"]
>> Obs_field[] = ["APCP"]
>> Is
this is correct?
>>
>> Thanks,
>> Anil
>>
>>
>>
>>
-----Original Message-----
>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>> Sent: Thursday, March 22, 2012 11:03 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Using UPP to post-process your WRF output files will not change
your output of MET. The reason that the CSI score is the same for the
two forecasts is that the contingency tables are the same for the two
runs.
>> Try using several different thresholds and output the CTC
files as well.
>> If you get contingency table counts that are
different between the two runs, then your CSI score will be different.
Hope this helps.
>>
>> Anne
>>
>>
>> On 03/21/2012 03:08 PM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>> RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Thanks Anne!
>>> I will first do it with these correction .
>>> On SCI score, I still not understand why two model shows same CSI
>>> score and even with same threshold value (for example TT>273
forecast threshold) on two different Model simulation possibly give
different CSI score because both model outputs fields are different.
>>>
>>> I will use UPP for WRF outputs and check.
>>> Thanks for
your help.
>>>
>>> Anil
>>>
>>>
>>>
>>> -----Original
Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Wednesday, March 21, 2012 4:06 PM
>>> To: Kumar, Anil
(GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> In
looking at your data there are several points I want to make.
>>> *
The top level (level 30) of your data contains invalid data and
>>>
this is having an impact on the statistics. I've attached an image
>>> plot of level 30 from the GODDARD file for you to look at. So skip
>>> this level in your forecasts (e.g., just do 0-29).n with
>>> * It
doesn't make sense to aggregate your data over the entire atmosphere.
You might want to consider using smaller sets of levels to verify
over.
>>> * The reason that the CSI score is the same is because the
threshold that you have chosen has resulted in the same contingency
table counts for your different forecast files. If you choose a
different forecast threshold, you can get different contingency table
counts and then the CSI value will be different. The CSI is based on
the contingency tables.
>>> When in doubt it helps to look at the
matched pairs (MPR) output to see where the differences are.
>>>
>>>
One other suggestion I have for you is to use the Unified Post
>>>
Processor
>>> (UPP) to post-process your WRF output. This puts the
data into GRIB format which is better supported in MET than the
pinterp data is.
>>>
>>> Hope this helps you out. Let us know if we
can be of any further assistance.
>>>
>>> Anne
>>>
>>>
>>> On
03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>>
RT
>>> wrote:
>>>>
>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
Anne,
>>>> Yes I will do. But you still check my output with latest
version of MET?
>>>> Thanks
>>>> Anil
>>>>
>>>> Sent from my
iPhone
>>>>
>>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>>
>>>>> Anil,
>>>>>
>>>>> We
just released a new version of MET. This version has some new
>>>>>
features as well as an improvement in our handling of variables
>>>>>
that improves precision. We strongly recommend that you update to
>>>>> this version. The new version can be downloaded from the
following location:
>>>>>
>>>>>
http://www.dtcenter.org/met/users/downloads/index.php.
>>>>>
>>>>>
Anne
>>>>>
>>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK]
>>>>> via RT
>>>>> wrote:
>>>>>>
>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>>
>>>>>> Updated 6 October 2010 for MET 3.0
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
-----Original Message-----
>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 20, 2012 4:07
PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I've got your files and I will try to
figure this out. One quick question for you. What version of MET are
you using?
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/20/2012
11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> I put all necessary files under kumar_data dir
>>>>>>>
>>>>>>> I also put two forecast files (one with GODDARD and
another one
>>>>>>> with
>>>>>>> THOMPSON) Point stat config is also
there with cts output files
>>>>>>> and you can compare that fcst
var-TT and RH Has same CSI and HSS.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
Anil
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent:
Tuesday, March 20, 2012 12:00 PM
>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>>
>>>>>>> * observation files
>>>>>>> * forecast
files
>>>>>>> * point_stat config file
>>>>>>>
>>>>>>> When you
have done this, let us know and we will take a look and try to see
what you are doing.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> I have one more question please help me out I
am trying to see
>>>>>>>> CSI (Critical Success Index) from different
model runs but the problem is I am getting same CSI index even with
different model runs.
>>>>>>>>
>>>>>>>> I am using command as
>>>>>>>> bin/point_stat
>>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-
06-13_00:00:00_PLEV
>>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>>
>>>>>>>> How CSI score is same from all model runs. I
checked all model
>>>>>>>> runs have different precipitation patterns
and (T, Q, RH) profiles so how CSI is same I am getting while running
point state.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent:
Tuesday, March 13, 2012 2:54 PM
>>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> Sorry for the delay in getting back to you. I was
out of the office yesterday. I checked with my colleagues and the
answer is that unless you have a contact at NCEP to get you old
archived data, then you only have what is available at that site for
PrepBufr data. We do not provide data as a service, just list a few
locations in which users can retrieve some data.
>>>>>>>>
>>>>>>>>
For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a sample for how to create one. They are just text files.
>>>>>>>>
>>>>>>>> Let us know if we can be of any further assistance.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/09/2012
01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Anne,
>>>>>>>>> SGP stands for Southern Great Plains
(covering OK, TX and NE
>>>>>>>>> states) I don't see NDAS data for
June 2002 NDAS observed data
>>>>>>>>> is available for past 3 days
and for past one month data is available.
>>>>>>>>>
>>>>>>>>>
Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Anne Holmes via
RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Friday, March 09, 2012
3:38 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I am not sure what
SGP stands for, so I can't directly answer your question. However, if
the region is over North America then using the data from NDAS will
give you what you want. If it is not over North America, then you
would want to use the GDAS files for global data. A link to both of
these can be found on the following web page:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.p
>>>>>>>>> h
>>>>>>>>> p
>>>>>>>>>
>>>>>>>>> See the PrepBufr Point
Observations links on this page.
>>>>>>>>>
>>>>>>>>> To get you
started, the best way would be to use the
>>>>>>>>>
mask_grid[] = [ "FULL" ]; first. After you are
>>>>>>>>> comfortable
with the full grid, then you can begin to use the mask regions.
>>>>>>>>>
>>>>>>>>> Please let us know if we can be of any further
assistance.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>> PARK] via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Thanks Anne!
>>>>>>>>>> One quick question
>>>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>>
>>>>>>>>>>
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>>>>>>>>>>
>>>>>>>>>> Thanks for your
wonderful help.
>>>>>>>>>>
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>>
-----Original Message-----
>>>>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Friday, March 09, 2012
2:16 PM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I can answer some
of your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
>>>>>>>>>>
>>>>>>>>>> I want to
understand how to get model skill scores(specially CSI, HSS, GSS).
>>>>>>>>>>
>>>>>>>>>> Here you need to make sure that in your
PointStat config file the output_flag[] for CTS (continuous
statistics) is turned on.
>>>>>>>>>>
>>>>>>>>>> Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>>>>>>>>>
>>>>>>>>>> You do not have to, but it
is easier to just run PB2NC once for all of the variables that you
want. Then all of the variables will be in one MET usable netCDF file.
>>>>>>>>>>
>>>>>>>>>> What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)?
>>>>>>>>>>
>>>>>>>>>> Leave it blank to get all of them.
>>>>>>>>>>
>>>>>>>>>> Let us know if you need any more help.
>>>>>>>>>>
>>>>>>>>>> Anne
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On
03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>>>
PARK] via RT
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> <URL:
>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>> Paul,
>>>>>>>>>>> Please find the latest
Point config file.
>>>>>>>>>>> I do get some output (see below) but I
need help to get skill scores only.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
-----Original Message-----
>>>>>>>>>>> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>>> Sent: Thursday, March 08, 2012
11:25 AM
>>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>>>>>>>>>>>
>>>>>>>>>>> Anil,
>>>>>>>>>>>
>>>>>>>>>>> I see
that you're not currently a registered user of the MET software.
Prior to providing direct support in the use of MET, we require that
users fill out the free online registration form. That enables us to
ensure that we remain in compliance with the international export laws
of the United States.
>>>>>>>>>>>
>>>>>>>>>>> To fill out the
registration, just go here:
>>>>>>>>>>>
>>>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>>>
Enter you email address and hit enter to be taken to the form.
>>>>>>>>>>>
>>>>>>>>>>> Once you have registered, can you please send
me the following information:
>>>>>>>>>>>
>>>>>>>>>>> 1. point_stat
config file
>>>>>>>>>>> 2. type of model data that you want to verify
(e.g. GRIB,
>>>>>>>>>>> p_interp,
>>>>>>>>>>> etc)
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Paul
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>>>
Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>>>
Queue: met_help
>>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>>
Requestors: anil.kumar at nasa.gov
>>>>>>>>>>>> Status:
new
>>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I want to understand how
to get model skill
>>>>>>>>>>>> scores(specially CSI, HSS,
>>>>>>>>>>>> GSS)
>>>>>>>>>>>>
>>>>>>>>>>>> 1. Do I need to
put all variables in pb2nc config file (obs_grib_code[] = [ "SPFH",
"TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>>
>>>>>>>>>>>> 2. What
should I put in level_category[] = [ ?] - skill score based on model
surface to upper atmosphere level-200mb)
>>>>>>>>>>>>
>>>>>>>>>>>>
3. Do I also put all variables in pointstat config file?
>>>>>>>>>>>>
>>>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-
25,*,*)" etc ];
>>>>>>>>>>>>
>>>>>>>>>>>> obs_field[] = [
"TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>>>
>>>>>>>>>>>> If
you have any sample pb2nc config and pointstat config file for just
skill score (category 3) that will be very help.
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Anil
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>>
>>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Apr 03 10:52:47 2012
John,
With this command of copygb
./copygb.exe -xg"255 3 489 435
32290 -103515 8 -98400 2000 2000 0 64 60000 36300"
STAGE4/ST4.2002061212.01h ST4_2002061212.Grb_latlon
File is
created.
Let me do grid_stat now
Thanks,
Anil
-----Original Message-----
From: John Halley Gotway via RT
[mailto:met_help at ucar.edu]
Sent: Tuesday, April 03, 2012 12:14 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
Yes, the input to
the grid-to-grid tools in MET (Grid-Stat, MODE, and Wavelet-Stat) must
be on a common grid. Regridding the StageIV to your model domain is
probably the way to go. Based on the wgrib output you sent, I see
that your model data is on a Lambert Conformal projection, and I see
that the StageIV data is on a polar stereographic projection. So you
need to regrid the StageIV data from a polar stereographic grid to a
lambert conformal one.
We recommend using the copygb utility to
regrid GRIB1 files. copygb is distributed as part of the WRF-
PostProcessor - look in directory where you see "wrfpost.exe" and you
should find an executable named "copygb.exe". An example of using
copygb to regrid to a lambert conformal grid can be found on this page
of the MET online tutorial:
http://www.dtcenter.org/met/users/support/online_tutorial/METv3.1/copygb/run3.php
Just use the wgrib grid definition to translate it into a command line
for copygb following the instructions on that page:
Lambert Conf:
Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
Latin1
60.000000 Latin2 36.300000 LatSP 0.000000 LonSP 0.000000
North
Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode 137
Please
give it a try. If you get stuck and can't get the data on a common
grid, just let me know and I can help.
Thanks,
John
On
04/03/2012 09:54 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> John,
> I am running MET over US (Southern Great Plains). Now I am using
>
STAGE4 precipitation data and comparing with WRF out and doing some
>
statistics (specially CSI/Threat Score )
>
> When I am doing
grid_stat I get
> ERROR: process_scores() -> The forecast and
observation grids do not match for field 1.
>
> So I looked again
wrf out domain grid dimension and STAGE 4 dimension
>
> In steps:
>
1. I used wrfpost.exe (WPP) to convert WRFPRS_d02.012 (Grib) and APCP
> var dimension is
>
> APCP=Total precipitation [kg/m^2]
>
timerange 4 P1 0 P2 24 TimeU 1 nx 489 ny 435 GDS grid 3 num_in_ave 0
missing 0
> center 7 subcenter 0 process 89 Table 2 scan: WE:SN
winds(grid)
> Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov
-98.400000
> Latin1 60.000000 Latin2 36.300000 LatSP 0.000000
LonSP 0.000000
> North Pole (489 x 435) Dx 2.000000 Dy
2.000000 scan 64 mode 137
> min/max data 0 93.25 num bits 11
BDS_Ref 0 DecScale 0 BinScale
> -4
>
>
> 2. On other hand STAGE4
files
> Dimension of stage4 files is
> wgrib -V
STAGE4/ST4.2002061300.01h
> rec 1:0:date 2002061223 APCP kpds5=61
kpds6=1 kpds7=0 levels=(0,0) grid=255 sfc 0-1hr acc: bitmap: 389369
undef
> APCP=Total precipitation [kg/m^2]
> timerange 4 P1 0
P2 1 TimeU 1 nx 1121 ny 881 GDS grid 5 num_in_ave 0 missing 0
>
center 7 subcenter 4 process 182 Table 2 scan: WE:SN winds(grid)
>
polar stereo: Lat1 23.117000 Long1 240.983000 Orient -105.000000
>
north pole (1121 x 881) Dx 4762 Dy 4762 scan 64 mode 8
> min/max
data 0 69.38 num bits 13 BDS_Ref 0 DecScale 2 BinScale 0
>
> My
Question is "Is I have to regrid STAGE4 data as same as model grid? "
and how?
>
> FYI: I used pcp this way:
> I use pcp_combine and
created one file for 12 hours accumulation
> bin/pcp_combine -sum
00000000_000000 1 20020613_000000 12
> OBS_200206_12A.nc -pcpdir
STAGE4 Performing sum command:
> Init/In_Accum/Valid/Out_Accum Times
=
> 00000000_000000/010000/20020613_000000/120000
> Searching for 12
files with accumulation times of 010000 to sum to a total accumulation
time of 120000.
> [1] Reading input file: STAGE4/ST4.2002061300.01h
[2] Reading input
> file: STAGE4/ST4.2002061223.01h [3] Reading input
file:
> STAGE4/ST4.2002061222.01h [4] Reading input file:
>
STAGE4/ST4.2002061221.01h [5] Reading input file:
>
STAGE4/ST4.2002061220.01h [6] Reading input file:
>
STAGE4/ST4.2002061219.01h [7] Reading input file:
>
STAGE4/ST4.2002061218.01h [8] Reading input file:
>
STAGE4/ST4.2002061217.01h [9] Reading input file:
>
STAGE4/ST4.2002061216.01h [10] Reading input file:
>
STAGE4/ST4.2002061215.01h [11] Reading input file:
>
STAGE4/ST4.2002061214.01h [12] Reading input file:
>
STAGE4/ST4.2002061213.01h
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent:
Monday, April 02, 2012 11:51 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV
MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>
> Anil,
>
> Yes, that would be the correct approach.
Unfortunately though, the PrepBUFR files do not contain point
observations of accumulated precipitation! The PB2NC tool only reads
observations of type P, Q, T, Z, U, V (pressure, specific humidity,
temperature, geopotential height, and U/V winds) from the PrepBUFR
files. It can also derive some additional observations from those
types (relative humidity, for example), as listed in the comments of
the PB2NC config file.
>
> If you'd like to verify accumulated
precipitation, you first need to look at the location of your domain.
If it's over the United States, I'd suggest verifying against the
StageII or StageIV precipitation analyses. Since both the
forecast/observations would be gridded, you would use the Grid-Stat
tool. And you could also use MODE and Wavelet-Stat. Our website
lists links to those products:
>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>
>
If you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
>
> Lastly, some users have made use of the
"trmm2nc.R" R-script on the MET website (see link above) to reformat
TRMM satellite accumulated precipitation estimates into a gridded
NetCDF format that MET can read.
>
> Hope that helps.
>
> John
Halley Gotway
> met_help at ucar.edu
>
>
> On 04/02/2012 07:01 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
>> In Observation files (prepbufrgdas file) precipitation is in
Kg/m2 APCP.
>> My question is
>> 1. I add APCP in PB2NC config file
obs_field[] = [ "APCP"] 2. In
>> Pointstat config file
>>
Fcst_field[] = ["RAINNC"]
>> Obs_field[] = ["APCP"]
>> Is
this is correct?
>>
>> Thanks,
>> Anil
>>
>>
>>
>>
-----Original Message-----
>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>> Sent: Thursday, March 22, 2012 11:03 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Using UPP to post-process your WRF output files will not change
your output of MET. The reason that the CSI score is the same for the
two forecasts is that the contingency tables are the same for the two
runs.
>> Try using several different thresholds and output the CTC
files as well.
>> If you get contingency table counts that are
different between the two runs, then your CSI score will be different.
Hope this helps.
>>
>> Anne
>>
>>
>> On 03/21/2012 03:08 PM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>> RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Thanks Anne!
>>> I will first do it with these correction .
>>> On SCI score, I still not understand why two model shows same CSI
>>> score and even with same threshold value (for example TT>273
forecast threshold) on two different Model simulation possibly give
different CSI score because both model outputs fields are different.
>>>
>>> I will use UPP for WRF outputs and check.
>>> Thanks for
your help.
>>>
>>> Anil
>>>
>>>
>>>
>>> -----Original
Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Wednesday, March 21, 2012 4:06 PM
>>> To: Kumar, Anil
(GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> In
looking at your data there are several points I want to make.
>>> *
The top level (level 30) of your data contains invalid data and
>>>
this is having an impact on the statistics. I've attached an image
>>> plot of level 30 from the GODDARD file for you to look at. So skip
>>> this level in your forecasts (e.g., just do 0-29).n with
>>> * It
doesn't make sense to aggregate your data over the entire atmosphere.
You might want to consider using smaller sets of levels to verify
over.
>>> * The reason that the CSI score is the same is because the
threshold that you have chosen has resulted in the same contingency
table counts for your different forecast files. If you choose a
different forecast threshold, you can get different contingency table
counts and then the CSI value will be different. The CSI is based on
the contingency tables.
>>> When in doubt it helps to look at the
matched pairs (MPR) output to see where the differences are.
>>>
>>>
One other suggestion I have for you is to use the Unified Post
>>>
Processor
>>> (UPP) to post-process your WRF output. This puts the
data into GRIB format which is better supported in MET than the
pinterp data is.
>>>
>>> Hope this helps you out. Let us know if we
can be of any further assistance.
>>>
>>> Anne
>>>
>>>
>>> On
03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>>
RT
>>> wrote:
>>>>
>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
Anne,
>>>> Yes I will do. But you still check my output with latest
version of MET?
>>>> Thanks
>>>> Anil
>>>>
>>>> Sent from my
iPhone
>>>>
>>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>>
>>>>> Anil,
>>>>>
>>>>> We
just released a new version of MET. This version has some new
>>>>>
features as well as an improvement in our handling of variables
>>>>>
that improves precision. We strongly recommend that you update to
>>>>> this version. The new version can be downloaded from the
following location:
>>>>>
>>>>>
http://www.dtcenter.org/met/users/downloads/index.php.
>>>>>
>>>>>
Anne
>>>>>
>>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK]
>>>>> via RT
>>>>> wrote:
>>>>>>
>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>>
>>>>>> Updated 6 October 2010 for MET 3.0
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
-----Original Message-----
>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 20, 2012 4:07
PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I've got your files and I will try to
figure this out. One quick question for you. What version of MET are
you using?
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/20/2012
11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> I put all necessary files under kumar_data dir
>>>>>>>
>>>>>>> I also put two forecast files (one with GODDARD and
another one
>>>>>>> with
>>>>>>> THOMPSON) Point stat config is also
there with cts output files
>>>>>>> and you can compare that fcst
var-TT and RH Has same CSI and HSS.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
Anil
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent:
Tuesday, March 20, 2012 12:00 PM
>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>>
>>>>>>> * observation files
>>>>>>> * forecast
files
>>>>>>> * point_stat config file
>>>>>>>
>>>>>>> When you
have done this, let us know and we will take a look and try to see
what you are doing.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> I have one more question please help me out I
am trying to see
>>>>>>>> CSI (Critical Success Index) from different
model runs but the problem is I am getting same CSI index even with
different model runs.
>>>>>>>>
>>>>>>>> I am using command as
>>>>>>>> bin/point_stat
>>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-
06-13_00:00:00_PLEV
>>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>>
>>>>>>>> How CSI score is same from all model runs. I
checked all model
>>>>>>>> runs have different precipitation patterns
and (T, Q, RH) profiles so how CSI is same I am getting while running
point state.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent:
Tuesday, March 13, 2012 2:54 PM
>>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> Sorry for the delay in getting back to you. I was
out of the office yesterday. I checked with my colleagues and the
answer is that unless you have a contact at NCEP to get you old
archived data, then you only have what is available at that site for
PrepBufr data. We do not provide data as a service, just list a few
locations in which users can retrieve some data.
>>>>>>>>
>>>>>>>>
For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a sample for how to create one. They are just text files.
>>>>>>>>
>>>>>>>> Let us know if we can be of any further assistance.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/09/2012
01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Anne,
>>>>>>>>> SGP stands for Southern Great Plains
(covering OK, TX and NE
>>>>>>>>> states) I don't see NDAS data for
June 2002 NDAS observed data
>>>>>>>>> is available for past 3 days
and for past one month data is available.
>>>>>>>>>
>>>>>>>>>
Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Anne Holmes via
RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Friday, March 09, 2012
3:38 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I am not sure what
SGP stands for, so I can't directly answer your question. However, if
the region is over North America then using the data from NDAS will
give you what you want. If it is not over North America, then you
would want to use the GDAS files for global data. A link to both of
these can be found on the following web page:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.p
>>>>>>>>> h
>>>>>>>>> p
>>>>>>>>>
>>>>>>>>> See the PrepBufr Point
Observations links on this page.
>>>>>>>>>
>>>>>>>>> To get you
started, the best way would be to use the
>>>>>>>>>
mask_grid[] = [ "FULL" ]; first. After you are
>>>>>>>>> comfortable
with the full grid, then you can begin to use the mask regions.
>>>>>>>>>
>>>>>>>>> Please let us know if we can be of any further
assistance.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>> PARK] via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Thanks Anne!
>>>>>>>>>> One quick question
>>>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>>
>>>>>>>>>>
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>>>>>>>>>>
>>>>>>>>>> Thanks for your
wonderful help.
>>>>>>>>>>
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>>
-----Original Message-----
>>>>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Friday, March 09, 2012
2:16 PM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I can answer some
of your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
>>>>>>>>>>
>>>>>>>>>> I want to
understand how to get model skill scores(specially CSI, HSS, GSS).
>>>>>>>>>>
>>>>>>>>>> Here you need to make sure that in your
PointStat config file the output_flag[] for CTS (continuous
statistics) is turned on.
>>>>>>>>>>
>>>>>>>>>> Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>>>>>>>>>
>>>>>>>>>> You do not have to, but it
is easier to just run PB2NC once for all of the variables that you
want. Then all of the variables will be in one MET usable netCDF file.
>>>>>>>>>>
>>>>>>>>>> What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)?
>>>>>>>>>>
>>>>>>>>>> Leave it blank to get all of them.
>>>>>>>>>>
>>>>>>>>>> Let us know if you need any more help.
>>>>>>>>>>
>>>>>>>>>> Anne
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On
03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>>>
PARK] via RT
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> <URL:
>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>> Paul,
>>>>>>>>>>> Please find the latest
Point config file.
>>>>>>>>>>> I do get some output (see below) but I
need help to get skill scores only.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
-----Original Message-----
>>>>>>>>>>> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>>> Sent: Thursday, March 08, 2012
11:25 AM
>>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>>>>>>>>>>>
>>>>>>>>>>> Anil,
>>>>>>>>>>>
>>>>>>>>>>> I see
that you're not currently a registered user of the MET software.
Prior to providing direct support in the use of MET, we require that
users fill out the free online registration form. That enables us to
ensure that we remain in compliance with the international export laws
of the United States.
>>>>>>>>>>>
>>>>>>>>>>> To fill out the
registration, just go here:
>>>>>>>>>>>
>>>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>>>
Enter you email address and hit enter to be taken to the form.
>>>>>>>>>>>
>>>>>>>>>>> Once you have registered, can you please send
me the following information:
>>>>>>>>>>>
>>>>>>>>>>> 1. point_stat
config file
>>>>>>>>>>> 2. type of model data that you want to verify
(e.g. GRIB,
>>>>>>>>>>> p_interp,
>>>>>>>>>>> etc)
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Paul
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>>>
Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>>>
Queue: met_help
>>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>>
Requestors: anil.kumar at nasa.gov
>>>>>>>>>>>> Status:
new
>>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I want to understand how
to get model skill
>>>>>>>>>>>> scores(specially CSI, HSS,
>>>>>>>>>>>> GSS)
>>>>>>>>>>>>
>>>>>>>>>>>> 1. Do I need to
put all variables in pb2nc config file (obs_grib_code[] = [ "SPFH",
"TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>>
>>>>>>>>>>>> 2. What
should I put in level_category[] = [ ?] - skill score based on model
surface to upper atmosphere level-200mb)
>>>>>>>>>>>>
>>>>>>>>>>>>
3. Do I also put all variables in pointstat config file?
>>>>>>>>>>>>
>>>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-
25,*,*)" etc ];
>>>>>>>>>>>>
>>>>>>>>>>>> obs_field[] = [
"TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>>>
>>>>>>>>>>>> If
you have any sample pb2nc config and pointstat config file for just
skill score (category 3) that will be very help.
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Anil
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>>
>>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #55009] skill scores
From: Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
Time: Tue Apr 03 13:05:28 2012
John,
Grid_stat is working fine.
Thanks for your help!
Anil
-----Original Message-----
From: John Halley Gotway via RT
[mailto:met_help at ucar.edu]
Sent: Tuesday, April 03, 2012 12:14 PM
To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
Anil,
Yes, the input to
the grid-to-grid tools in MET (Grid-Stat, MODE, and Wavelet-Stat) must
be on a common grid. Regridding the StageIV to your model domain is
probably the way to go. Based on the wgrib output you sent, I see
that your model data is on a Lambert Conformal projection, and I see
that the StageIV data is on a polar stereographic projection. So you
need to regrid the StageIV data from a polar stereographic grid to a
lambert conformal one.
We recommend using the copygb utility to
regrid GRIB1 files. copygb is distributed as part of the WRF-
PostProcessor - look in directory where you see "wrfpost.exe" and you
should find an executable named "copygb.exe". An example of using
copygb to regrid to a lambert conformal grid can be found on this page
of the MET online tutorial:
http://www.dtcenter.org/met/users/support/online_tutorial/METv3.1/copygb/run3.php
Just use the wgrib grid definition to translate it into a command line
for copygb following the instructions on that page:
Lambert Conf:
Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
Latin1
60.000000 Latin2 36.300000 LatSP 0.000000 LonSP 0.000000
North
Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode 137
Please
give it a try. If you get stuck and can't get the data on a common
grid, just let me know and I can help.
Thanks,
John
On
04/03/2012 09:54 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> John,
> I am running MET over US (Southern Great Plains). Now I am using
>
STAGE4 precipitation data and comparing with WRF out and doing some
>
statistics (specially CSI/Threat Score )
>
> When I am doing
grid_stat I get
> ERROR: process_scores() -> The forecast and
observation grids do not match for field 1.
>
> So I looked again
wrf out domain grid dimension and STAGE 4 dimension
>
> In steps:
>
1. I used wrfpost.exe (WPP) to convert WRFPRS_d02.012 (Grib) and APCP
> var dimension is
>
> APCP=Total precipitation [kg/m^2]
>
timerange 4 P1 0 P2 24 TimeU 1 nx 489 ny 435 GDS grid 3 num_in_ave 0
missing 0
> center 7 subcenter 0 process 89 Table 2 scan: WE:SN
winds(grid)
> Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov
-98.400000
> Latin1 60.000000 Latin2 36.300000 LatSP 0.000000
LonSP 0.000000
> North Pole (489 x 435) Dx 2.000000 Dy
2.000000 scan 64 mode 137
> min/max data 0 93.25 num bits 11
BDS_Ref 0 DecScale 0 BinScale
> -4
>
>
> 2. On other hand STAGE4
files
> Dimension of stage4 files is
> wgrib -V
STAGE4/ST4.2002061300.01h
> rec 1:0:date 2002061223 APCP kpds5=61
kpds6=1 kpds7=0 levels=(0,0) grid=255 sfc 0-1hr acc: bitmap: 389369
undef
> APCP=Total precipitation [kg/m^2]
> timerange 4 P1 0
P2 1 TimeU 1 nx 1121 ny 881 GDS grid 5 num_in_ave 0 missing 0
>
center 7 subcenter 4 process 182 Table 2 scan: WE:SN winds(grid)
>
polar stereo: Lat1 23.117000 Long1 240.983000 Orient -105.000000
>
north pole (1121 x 881) Dx 4762 Dy 4762 scan 64 mode 8
> min/max
data 0 69.38 num bits 13 BDS_Ref 0 DecScale 2 BinScale 0
>
> My
Question is "Is I have to regrid STAGE4 data as same as model grid? "
and how?
>
> FYI: I used pcp this way:
> I use pcp_combine and
created one file for 12 hours accumulation
> bin/pcp_combine -sum
00000000_000000 1 20020613_000000 12
> OBS_200206_12A.nc -pcpdir
STAGE4 Performing sum command:
> Init/In_Accum/Valid/Out_Accum Times
=
> 00000000_000000/010000/20020613_000000/120000
> Searching for 12
files with accumulation times of 010000 to sum to a total accumulation
time of 120000.
> [1] Reading input file: STAGE4/ST4.2002061300.01h
[2] Reading input
> file: STAGE4/ST4.2002061223.01h [3] Reading input
file:
> STAGE4/ST4.2002061222.01h [4] Reading input file:
>
STAGE4/ST4.2002061221.01h [5] Reading input file:
>
STAGE4/ST4.2002061220.01h [6] Reading input file:
>
STAGE4/ST4.2002061219.01h [7] Reading input file:
>
STAGE4/ST4.2002061218.01h [8] Reading input file:
>
STAGE4/ST4.2002061217.01h [9] Reading input file:
>
STAGE4/ST4.2002061216.01h [10] Reading input file:
>
STAGE4/ST4.2002061215.01h [11] Reading input file:
>
STAGE4/ST4.2002061214.01h [12] Reading input file:
>
STAGE4/ST4.2002061213.01h
>
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent:
Monday, April 02, 2012 11:51 AM
> To: Kumar, Anil (GSFC-617.0)[UNIV
MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>
> Anil,
>
> Yes, that would be the correct approach.
Unfortunately though, the PrepBUFR files do not contain point
observations of accumulated precipitation! The PB2NC tool only reads
observations of type P, Q, T, Z, U, V (pressure, specific humidity,
temperature, geopotential height, and U/V winds) from the PrepBUFR
files. It can also derive some additional observations from those
types (relative humidity, for example), as listed in the comments of
the PB2NC config file.
>
> If you'd like to verify accumulated
precipitation, you first need to look at the location of your domain.
If it's over the United States, I'd suggest verifying against the
StageII or StageIV precipitation analyses. Since both the
forecast/observations would be gridded, you would use the Grid-Stat
tool. And you could also use MODE and Wavelet-Stat. Our website
lists links to those products:
>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>
>
If you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
>
> Lastly, some users have made use of the
"trmm2nc.R" R-script on the MET website (see link above) to reformat
TRMM satellite accumulated precipitation estimates into a gridded
NetCDF format that MET can read.
>
> Hope that helps.
>
> John
Halley Gotway
> met_help at ucar.edu
>
>
> On 04/02/2012 07:01 AM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT wrote:
>>
>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> Anne,
>> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
>> In Observation files (prepbufrgdas file) precipitation is in
Kg/m2 APCP.
>> My question is
>> 1. I add APCP in PB2NC config file
obs_field[] = [ "APCP"] 2. In
>> Pointstat config file
>>
Fcst_field[] = ["RAINNC"]
>> Obs_field[] = ["APCP"]
>> Is
this is correct?
>>
>> Thanks,
>> Anil
>>
>>
>>
>>
-----Original Message-----
>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>> Sent: Thursday, March 22, 2012 11:03 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Using UPP to post-process your WRF output files will not change
your output of MET. The reason that the CSI score is the same for the
two forecasts is that the contingency tables are the same for the two
runs.
>> Try using several different thresholds and output the CTC
files as well.
>> If you get contingency table counts that are
different between the two runs, then your CSI score will be different.
Hope this helps.
>>
>> Anne
>>
>>
>> On 03/21/2012 03:08 PM,
Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>> RT
>> wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Thanks Anne!
>>> I will first do it with these correction .
>>> On SCI score, I still not understand why two model shows same CSI
>>> score and even with same threshold value (for example TT>273
forecast threshold) on two different Model simulation possibly give
different CSI score because both model outputs fields are different.
>>>
>>> I will use UPP for WRF outputs and check.
>>> Thanks for
your help.
>>>
>>> Anil
>>>
>>>
>>>
>>> -----Original
Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Wednesday, March 21, 2012 4:06 PM
>>> To: Kumar, Anil
(GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> In
looking at your data there are several points I want to make.
>>> *
The top level (level 30) of your data contains invalid data and
>>>
this is having an impact on the statistics. I've attached an image
>>> plot of level 30 from the GODDARD file for you to look at. So skip
>>> this level in your forecasts (e.g., just do 0-29).n with
>>> * It
doesn't make sense to aggregate your data over the entire atmosphere.
You might want to consider using smaller sets of levels to verify
over.
>>> * The reason that the CSI score is the same is because the
threshold that you have chosen has resulted in the same contingency
table counts for your different forecast files. If you choose a
different forecast threshold, you can get different contingency table
counts and then the CSI value will be different. The CSI is based on
the contingency tables.
>>> When in doubt it helps to look at the
matched pairs (MPR) output to see where the differences are.
>>>
>>>
One other suggestion I have for you is to use the Unified Post
>>>
Processor
>>> (UPP) to post-process your WRF output. This puts the
data into GRIB format which is better supported in MET than the
pinterp data is.
>>>
>>> Hope this helps you out. Let us know if we
can be of any further assistance.
>>>
>>> Anne
>>>
>>>
>>> On
03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
>>>
RT
>>> wrote:
>>>>
>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>>
Anne,
>>>> Yes I will do. But you still check my output with latest
version of MET?
>>>> Thanks
>>>> Anil
>>>>
>>>> Sent from my
iPhone
>>>>
>>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>>
>>>>> Anil,
>>>>>
>>>>> We
just released a new version of MET. This version has some new
>>>>>
features as well as an improvement in our handling of variables
>>>>>
that improves precision. We strongly recommend that you update to
>>>>> this version. The new version can be downloaded from the
following location:
>>>>>
>>>>>
http://www.dtcenter.org/met/users/downloads/index.php.
>>>>>
>>>>>
Anne
>>>>>
>>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND
COLLEGE PARK]
>>>>> via RT
>>>>> wrote:
>>>>>>
>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>
>>>>>> Anne,
>>>>>>
>>>>>> Updated 6 October 2010 for MET 3.0
>>>>>>
>>>>>> Thanks,
>>>>>> Anil
>>>>>>
>>>>>>
>>>>>>
-----Original Message-----
>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>> Sent: Tuesday, March 20, 2012 4:07
PM
>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> I've got your files and I will try to
figure this out. One quick question for you. What version of MET are
you using?
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>>
>>>>>> On 03/20/2012
11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>> I put all necessary files under kumar_data dir
>>>>>>>
>>>>>>> I also put two forecast files (one with GODDARD and
another one
>>>>>>> with
>>>>>>> THOMPSON) Point stat config is also
there with cts output files
>>>>>>> and you can compare that fcst
var-TT and RH Has same CSI and HSS.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
Anil
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent:
Tuesday, March 20, 2012 12:00 PM
>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>>
>>>>>>> * observation files
>>>>>>> * forecast
files
>>>>>>> * point_stat config file
>>>>>>>
>>>>>>> When you
have done this, let us know and we will take a look and try to see
what you are doing.
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>>
On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> I have one more question please help me out I
am trying to see
>>>>>>>> CSI (Critical Success Index) from different
model runs but the problem is I am getting same CSI index even with
different model runs.
>>>>>>>>
>>>>>>>> I am using command as
>>>>>>>> bin/point_stat
>>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-
06-13_00:00:00_PLEV
>>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>>
>>>>>>>> How CSI score is same from all model runs. I
checked all model
>>>>>>>> runs have different precipitation patterns
and (T, Q, RH) profiles so how CSI is same I am getting while running
point state.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>>
From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent:
Tuesday, March 13, 2012 2:54 PM
>>>>>>>> To: Kumar, Anil (GSFC-
617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re:
[rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> Sorry for the delay in getting back to you. I was
out of the office yesterday. I checked with my colleagues and the
answer is that unless you have a contact at NCEP to get you old
archived data, then you only have what is available at that site for
PrepBufr data. We do not provide data as a service, just list a few
locations in which users can retrieve some data.
>>>>>>>>
>>>>>>>>
For the second part of your questions, you might look at the region
files in the data/poly directory. MET comes with several smaller
polyline regions for various parts of the US. If we don't have one in
there that covers the area that you want, you can at least use them as
a sample for how to create one. They are just text files.
>>>>>>>>
>>>>>>>> Let us know if we can be of any further assistance.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/09/2012
01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Anne,
>>>>>>>>> SGP stands for Southern Great Plains
(covering OK, TX and NE
>>>>>>>>> states) I don't see NDAS data for
June 2002 NDAS observed data
>>>>>>>>> is available for past 3 days
and for past one month data is available.
>>>>>>>>>
>>>>>>>>>
Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Anne Holmes via
RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Friday, March 09, 2012
3:38 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> I am not sure what
SGP stands for, so I can't directly answer your question. However, if
the region is over North America then using the data from NDAS will
give you what you want. If it is not over North America, then you
would want to use the GDAS files for global data. A link to both of
these can be found on the following web page:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.p
>>>>>>>>> h
>>>>>>>>> p
>>>>>>>>>
>>>>>>>>> See the PrepBufr Point
Observations links on this page.
>>>>>>>>>
>>>>>>>>> To get you
started, the best way would be to use the
>>>>>>>>>
mask_grid[] = [ "FULL" ]; first. After you are
>>>>>>>>> comfortable
with the full grid, then you can begin to use the mask regions.
>>>>>>>>>
>>>>>>>>> Please let us know if we can be of any further
assistance.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>> PARK] via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Thanks Anne!
>>>>>>>>>> One quick question
>>>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>>
>>>>>>>>>>
Another, what is the best way to create SGP.poly, I saw some example
in MET tutorial but still don't understand the lat lon information
represented in the poly file.
>>>>>>>>>>
>>>>>>>>>> Thanks for your
wonderful help.
>>>>>>>>>>
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>>
-----Original Message-----
>>>>>>>>>> From: Anne Holmes via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Friday, March 09, 2012
2:16 PM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I can answer some
of your questions. For question 3 below in your original message, I am
going to hand that one over to a statistician to discuss categorical
vs. continuous statistics better.
>>>>>>>>>>
>>>>>>>>>> I want to
understand how to get model skill scores(specially CSI, HSS, GSS).
>>>>>>>>>>
>>>>>>>>>> Here you need to make sure that in your
PointStat config file the output_flag[] for CTS (continuous
statistics) is turned on.
>>>>>>>>>>
>>>>>>>>>> Do I need to put all
variables in pb2nc config file (obs_grib_code[] = [ "SPFH", "TMP",
"MIXR", "WIND" ]?
>>>>>>>>>>
>>>>>>>>>> You do not have to, but it
is easier to just run PB2NC once for all of the variables that you
want. Then all of the variables will be in one MET usable netCDF file.
>>>>>>>>>>
>>>>>>>>>> What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)?
>>>>>>>>>>
>>>>>>>>>> Leave it blank to get all of them.
>>>>>>>>>>
>>>>>>>>>> Let us know if you need any more help.
>>>>>>>>>>
>>>>>>>>>> Anne
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On
03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>>>
PARK] via RT
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> <URL:
>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>> Paul,
>>>>>>>>>>> Please find the latest
Point config file.
>>>>>>>>>>> I do get some output (see below) but I
need help to get skill scores only.
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
-----Original Message-----
>>>>>>>>>>> From: Paul Oldenburg via RT
[mailto:met_help at ucar.edu]
>>>>>>>>>>> Sent: Thursday, March 08, 2012
11:25 AM
>>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND
COLLEGE PARK]
>>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill
scores
>>>>>>>>>>>
>>>>>>>>>>> Anil,
>>>>>>>>>>>
>>>>>>>>>>> I see
that you're not currently a registered user of the MET software.
Prior to providing direct support in the use of MET, we require that
users fill out the free online registration form. That enables us to
ensure that we remain in compliance with the international export laws
of the United States.
>>>>>>>>>>>
>>>>>>>>>>> To fill out the
registration, just go here:
>>>>>>>>>>>
>>>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>>>
Enter you email address and hit enter to be taken to the form.
>>>>>>>>>>>
>>>>>>>>>>> Once you have registered, can you please send
me the following information:
>>>>>>>>>>>
>>>>>>>>>>> 1. point_stat
config file
>>>>>>>>>>> 2. type of model data that you want to verify
(e.g. GRIB,
>>>>>>>>>>> p_interp,
>>>>>>>>>>> etc)
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Paul
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV
MARYLAND COLLEGE PARK] via RT wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Thu
Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>>>
Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>>>
Queue: met_help
>>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>>
Requestors: anil.kumar at nasa.gov
>>>>>>>>>>>> Status:
new
>>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>>>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I want to understand how
to get model skill
>>>>>>>>>>>> scores(specially CSI, HSS,
>>>>>>>>>>>> GSS)
>>>>>>>>>>>>
>>>>>>>>>>>> 1. Do I need to
put all variables in pb2nc config file (obs_grib_code[] = [ "SPFH",
"TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>>
>>>>>>>>>>>> 2. What
should I put in level_category[] = [ ?] - skill score based on model
surface to upper atmosphere level-200mb)
>>>>>>>>>>>>
>>>>>>>>>>>>
3. Do I also put all variables in pointstat config file?
>>>>>>>>>>>>
>>>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-
25,*,*)" etc ];
>>>>>>>>>>>>
>>>>>>>>>>>> obs_field[] = [
"TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>>>
>>>>>>>>>>>> If
you have any sample pb2nc config and pointstat config file for just
skill score (category 3) that will be very help.
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Anil
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #55009] skill scores
From: John Halley Gotway
Time: Tue Apr 03 13:23:47 2012
Anil,
Great. Glad that did the trick.
John
On 04/03/2012 01:05 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via RT
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>
> John,
> Grid_stat is working fine.
> Thanks for your help!
>
> Anil
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, April 03, 2012 12:14 PM
> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>
> Anil,
>
> Yes, the input to the grid-to-grid tools in MET (Grid-Stat, MODE,
and Wavelet-Stat) must be on a common grid. Regridding the StageIV to
your model domain is probably the way to go. Based on the wgrib
output you sent, I see that your model data is on a Lambert Conformal
projection, and I see that the StageIV data is on a polar
stereographic projection. So you need to regrid the StageIV data from
a polar stereographic grid to a lambert conformal one.
>
> We recommend using the copygb utility to regrid GRIB1 files. copygb
is distributed as part of the WRF-PostProcessor - look in directory
where you see "wrfpost.exe" and you should find an executable named
"copygb.exe". An example of using copygb to regrid to a lambert
conformal grid can be found on this page of the MET online tutorial:
>
>
http://www.dtcenter.org/met/users/support/online_tutorial/METv3.1/copygb/run3.php
>
> Just use the wgrib grid definition to translate it into a command
line for copygb following the instructions on that page:
> Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
> Latin1 60.000000 Latin2 36.300000 LatSP 0.000000 LonSP
0.000000
> North Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode
137
>
> Please give it a try. If you get stuck and can't get the data on a
common grid, just let me know and I can help.
>
> Thanks,
> John
>
>
> On 04/03/2012 09:54 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>
>> John,
>> I am running MET over US (Southern Great Plains). Now I am using
>> STAGE4 precipitation data and comparing with WRF out and doing some
>> statistics (specially CSI/Threat Score )
>>
>> When I am doing grid_stat I get
>> ERROR: process_scores() -> The forecast and observation grids do
not match for field 1.
>>
>> So I looked again wrf out domain grid dimension and STAGE 4
dimension
>>
>> In steps:
>> 1. I used wrfpost.exe (WPP) to convert WRFPRS_d02.012 (Grib) and
APCP
>> var dimension is
>>
>> APCP=Total precipitation [kg/m^2]
>> timerange 4 P1 0 P2 24 TimeU 1 nx 489 ny 435 GDS grid 3
num_in_ave 0 missing 0
>> center 7 subcenter 0 process 89 Table 2 scan: WE:SN winds(grid)
>> Lambert Conf: Lat1 32.290000 Lon1 -103.515000 Lov -98.400000
>> Latin1 60.000000 Latin2 36.300000 LatSP 0.000000 LonSP
0.000000
>> North Pole (489 x 435) Dx 2.000000 Dy 2.000000 scan 64 mode
137
>> min/max data 0 93.25 num bits 11 BDS_Ref 0 DecScale 0
BinScale
>> -4
>>
>>
>> 2. On other hand STAGE4 files
>> Dimension of stage4 files is
>> wgrib -V STAGE4/ST4.2002061300.01h
>> rec 1:0:date 2002061223 APCP kpds5=61 kpds6=1 kpds7=0 levels=(0,0)
grid=255 sfc 0-1hr acc: bitmap: 389369 undef
>> APCP=Total precipitation [kg/m^2]
>> timerange 4 P1 0 P2 1 TimeU 1 nx 1121 ny 881 GDS grid 5
num_in_ave 0 missing 0
>> center 7 subcenter 4 process 182 Table 2 scan: WE:SN
winds(grid)
>> polar stereo: Lat1 23.117000 Long1 240.983000 Orient
-105.000000
>> north pole (1121 x 881) Dx 4762 Dy 4762 scan 64 mode 8
>> min/max data 0 69.38 num bits 13 BDS_Ref 0 DecScale 2
BinScale 0
>>
>> My Question is "Is I have to regrid STAGE4 data as same as model
grid? " and how?
>>
>> FYI: I used pcp this way:
>> I use pcp_combine and created one file for 12 hours accumulation
>> bin/pcp_combine -sum 00000000_000000 1 20020613_000000 12
>> OBS_200206_12A.nc -pcpdir STAGE4 Performing sum command:
>> Init/In_Accum/Valid/Out_Accum Times =
>> 00000000_000000/010000/20020613_000000/120000
>> Searching for 12 files with accumulation times of 010000 to sum to
a total accumulation time of 120000.
>> [1] Reading input file: STAGE4/ST4.2002061300.01h [2] Reading input
>> file: STAGE4/ST4.2002061223.01h [3] Reading input file:
>> STAGE4/ST4.2002061222.01h [4] Reading input file:
>> STAGE4/ST4.2002061221.01h [5] Reading input file:
>> STAGE4/ST4.2002061220.01h [6] Reading input file:
>> STAGE4/ST4.2002061219.01h [7] Reading input file:
>> STAGE4/ST4.2002061218.01h [8] Reading input file:
>> STAGE4/ST4.2002061217.01h [9] Reading input file:
>> STAGE4/ST4.2002061216.01h [10] Reading input file:
>> STAGE4/ST4.2002061215.01h [11] Reading input file:
>> STAGE4/ST4.2002061214.01h [12] Reading input file:
>> STAGE4/ST4.2002061213.01h
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
>> Sent: Monday, April 02, 2012 11:51 AM
>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>
>> Anil,
>>
>> Yes, that would be the correct approach. Unfortunately though, the
PrepBUFR files do not contain point observations of accumulated
precipitation! The PB2NC tool only reads observations of type P, Q,
T, Z, U, V (pressure, specific humidity, temperature, geopotential
height, and U/V winds) from the PrepBUFR files. It can also derive
some additional observations from those types (relative humidity, for
example), as listed in the comments of the PB2NC config file.
>>
>> If you'd like to verify accumulated precipitation, you first need
to look at the location of your domain. If it's over the United
States, I'd suggest verifying against the StageII or StageIV
precipitation analyses. Since both the forecast/observations would be
gridded, you would use the Grid-Stat tool. And you could also use
MODE and Wavelet-Stat. Our website lists links to those products:
>>
http://www.dtcenter.org/met/users/downloads/observation_data.php
>>
>> If you're not verifying over the United States, and want to verify
against rain gauges, you'll need to acquire that data yourself. Other
users in similar situations have taken their ASCII gauge data,
formatted it into the 10-column ASCII format expected by the ASCII2NC
tool, and then used ASCII2NC to reformat it. Then they used the
ASCII2NC output files as input to the Point-Stat tool for their
verification.
>>
>> Lastly, some users have made use of the "trmm2nc.R" R-script on the
MET website (see link above) to reformat TRMM satellite accumulated
precipitation estimates into a gridded NetCDF format that MET can
read.
>>
>> Hope that helps.
>>
>> John Halley Gotway
>> met_help at ucar.edu
>>
>>
>> On 04/02/2012 07:01 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK] via
RT wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>
>>> Anne,
>>> Sorry to bother you again! I want to know how precipitation in wrf
model (RAINC, RAINNC) is consider in PB2NCconfig. The model rain is in
mm.
>>> In Observation files (prepbufrgdas file) precipitation is in Kg/m2
APCP.
>>> My question is
>>> 1. I add APCP in PB2NC config file obs_field[] = [ "APCP"] 2. In
>>> Pointstat config file
>>> Fcst_field[] = ["RAINNC"]
>>> Obs_field[] = ["APCP"]
>>> Is this is correct?
>>>
>>> Thanks,
>>> Anil
>>>
>>>
>>>
>>> -----Original Message-----
>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>> Sent: Thursday, March 22, 2012 11:03 AM
>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>
>>> Anil,
>>>
>>> Using UPP to post-process your WRF output files will not change
your output of MET. The reason that the CSI score is the same for the
two forecasts is that the contingency tables are the same for the two
runs.
>>> Try using several different thresholds and output the CTC files as
well.
>>> If you get contingency table counts that are different between the
two runs, then your CSI score will be different. Hope this helps.
>>>
>>> Anne
>>>
>>>
>>> On 03/21/2012 03:08 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>> RT
>>> wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>
>>>> Thanks Anne!
>>>> I will first do it with these correction .
>>>> On SCI score, I still not understand why two model shows same CSI
>>>> score and even with same threshold value (for example TT>273
forecast threshold) on two different Model simulation possibly give
different CSI score because both model outputs fields are different.
>>>>
>>>> I will use UPP for WRF outputs and check.
>>>> Thanks for your help.
>>>>
>>>> Anil
>>>>
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>> Sent: Wednesday, March 21, 2012 4:06 PM
>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>
>>>> Anil,
>>>>
>>>> In looking at your data there are several points I want to make.
>>>> * The top level (level 30) of your data contains invalid data and
>>>> this is having an impact on the statistics. I've attached an
image
>>>> plot of level 30 from the GODDARD file for you to look at. So
skip
>>>> this level in your forecasts (e.g., just do 0-29).n with
>>>> * It doesn't make sense to aggregate your data over the entire
atmosphere. You might want to consider using smaller sets of levels to
verify over.
>>>> * The reason that the CSI score is the same is because the
threshold that you have chosen has resulted in the same contingency
table counts for your different forecast files. If you choose a
different forecast threshold, you can get different contingency table
counts and then the CSI value will be different. The CSI is based on
the contingency tables.
>>>> When in doubt it helps to look at the matched pairs (MPR) output
to see where the differences are.
>>>>
>>>> One other suggestion I have for you is to use the Unified Post
>>>> Processor
>>>> (UPP) to post-process your WRF output. This puts the data into
GRIB format which is better supported in MET than the pinterp data is.
>>>>
>>>> Hope this helps you out. Let us know if we can be of any further
assistance.
>>>>
>>>> Anne
>>>>
>>>>
>>>> On 03/21/2012 09:13 AM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
via
>>>> RT
>>>> wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>
>>>>> Anne,
>>>>> Yes I will do. But you still check my output with latest version
of MET?
>>>>> Thanks
>>>>> Anil
>>>>>
>>>>> Sent from my iPhone
>>>>>
>>>>> On Mar 21, 2012, at 11:09 AM, "Anne Holmes via
RT"<met_help at ucar.edu> wrote:
>>>>>
>>>>>> Anil,
>>>>>>
>>>>>> We just released a new version of MET. This version has some
new
>>>>>> features as well as an improvement in our handling of variables
>>>>>> that improves precision. We strongly recommend that you update
to
>>>>>> this version. The new version can be downloaded from the
following location:
>>>>>>
>>>>>> http://www.dtcenter.org/met/users/downloads/index.php.
>>>>>>
>>>>>> Anne
>>>>>>
>>>>>> On 03/20/2012 04:15 PM, Kumar, Anil[UNIV MARYLAND COLLEGE PARK]
>>>>>> via RT
>>>>>> wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>
>>>>>>> Anne,
>>>>>>>
>>>>>>> Updated 6 October 2010 for MET 3.0
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Anil
>>>>>>>
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>> Sent: Tuesday, March 20, 2012 4:07 PM
>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>
>>>>>>> Anil,
>>>>>>>
>>>>>>> I've got your files and I will try to figure this out. One
quick question for you. What version of MET are you using?
>>>>>>>
>>>>>>> Anne
>>>>>>>
>>>>>>>
>>>>>>> On 03/20/2012 11:32 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>> via RT
>>>>>>> wrote:
>>>>>>>>
>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>
>>>>>>>> Anne,
>>>>>>>> I put all necessary files under kumar_data dir
>>>>>>>>
>>>>>>>> I also put two forecast files (one with GODDARD and another
one
>>>>>>>> with
>>>>>>>> THOMPSON) Point stat config is also there with cts output
files
>>>>>>>> and you can compare that fcst var-TT and RH Has same CSI and
HSS.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Anil
>>>>>>>>
>>>>>>>>
>>>>>>>> -----Original Message-----
>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>> Sent: Tuesday, March 20, 2012 12:00 PM
>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>
>>>>>>>> Anil,
>>>>>>>>
>>>>>>>> I think at this point it would be helpful if you could upload
the following files to our FTP server using the instructions at
http://www.dtcenter.org/met/users/support/met_help.php#ftp and we will
take a look:
>>>>>>>>
>>>>>>>> * observation files
>>>>>>>> * forecast files
>>>>>>>> * point_stat config file
>>>>>>>>
>>>>>>>> When you have done this, let us know and we will take a look
and try to see what you are doing.
>>>>>>>>
>>>>>>>> Anne
>>>>>>>>
>>>>>>>>
>>>>>>>> On 03/20/2012 09:29 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>> via RT
>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>
>>>>>>>>> Anne,
>>>>>>>>> I have one more question please help me out I am trying to
see
>>>>>>>>> CSI (Critical Success Index) from different model runs but
the problem is I am getting same CSI index even with different model
runs.
>>>>>>>>>
>>>>>>>>> I am using command as
>>>>>>>>> bin/point_stat
>>>>>>>>> ../P_INTERP/GODDARD/wrfout_d02_2002-06-13_00:00:00_PLEV
>>>>>>>>> 2002061300.nc PointStatConfig_nuwrf -v 2
>>>>>>>>>
>>>>>>>>> How CSI score is same from all model runs. I checked all
model
>>>>>>>>> runs have different precipitation patterns and (T, Q, RH)
profiles so how CSI is same I am getting while running point state.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Anil
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -----Original Message-----
>>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>>> Sent: Tuesday, March 13, 2012 2:54 PM
>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>
>>>>>>>>> Anil,
>>>>>>>>>
>>>>>>>>> Sorry for the delay in getting back to you. I was out of the
office yesterday. I checked with my colleagues and the answer is that
unless you have a contact at NCEP to get you old archived data, then
you only have what is available at that site for PrepBufr data. We do
not provide data as a service, just list a few locations in which
users can retrieve some data.
>>>>>>>>>
>>>>>>>>> For the second part of your questions, you might look at the
region files in the data/poly directory. MET comes with several
smaller polyline regions for various parts of the US. If we don't have
one in there that covers the area that you want, you can at least use
them as a sample for how to create one. They are just text files.
>>>>>>>>>
>>>>>>>>> Let us know if we can be of any further assistance.
>>>>>>>>>
>>>>>>>>> Anne
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 03/09/2012 01:47 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK]
>>>>>>>>> via RT
>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>
>>>>>>>>>> Anne,
>>>>>>>>>> SGP stands for Southern Great Plains (covering OK, TX and
NE
>>>>>>>>>> states) I don't see NDAS data for June 2002 NDAS observed
data
>>>>>>>>>> is available for past 3 days and for past one month data is
available.
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Anil
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> -----Original Message-----
>>>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>>>> Sent: Friday, March 09, 2012 3:38 PM
>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>
>>>>>>>>>> Anil,
>>>>>>>>>>
>>>>>>>>>> I am not sure what SGP stands for, so I can't directly
answer your question. However, if the region is over North America
then using the data from NDAS will give you what you want. If it is
not over North America, then you would want to use the GDAS files for
global data. A link to both of these can be found on the following web
page:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
http://www.dtcenter.org/met/users/downloads/observation_data.p
>>>>>>>>>> h
>>>>>>>>>> p
>>>>>>>>>>
>>>>>>>>>> See the PrepBufr Point Observations links on this page.
>>>>>>>>>>
>>>>>>>>>> To get you started, the best way would be to use the
>>>>>>>>>> mask_grid[] = [ "FULL" ]; first. After you are
>>>>>>>>>> comfortable with the full grid, then you can begin to use
the mask regions.
>>>>>>>>>>
>>>>>>>>>> Please let us know if we can be of any further assistance.
>>>>>>>>>>
>>>>>>>>>> Anne
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 03/09/2012 01:11 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>>> PARK] via RT
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> <URL:
>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>
>>>>>>>>>>> Thanks Anne!
>>>>>>>>>>> One quick question
>>>>>>>>>>> My wrf domain is over SGP region and I would like to used
best observed available data for June 2002. I am currently using
prepbufr.gdas.2002061300.wo40 from dss337. Do you think this prepbufr
data is only data we can use over SGP region.
>>>>>>>>>>>
>>>>>>>>>>> Another, what is the best way to create SGP.poly, I saw
some example in MET tutorial but still don't understand the lat lon
information represented in the poly file.
>>>>>>>>>>>
>>>>>>>>>>> Thanks for your wonderful help.
>>>>>>>>>>>
>>>>>>>>>>> Anil
>>>>>>>>>>>
>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>> From: Anne Holmes via RT [mailto:met_help at ucar.edu]
>>>>>>>>>>> Sent: Friday, March 09, 2012 2:16 PM
>>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>>
>>>>>>>>>>> Anil,
>>>>>>>>>>>
>>>>>>>>>>> I can answer some of your questions. For question 3 below
in your original message, I am going to hand that one over to a
statistician to discuss categorical vs. continuous statistics better.
>>>>>>>>>>>
>>>>>>>>>>> I want to understand how to get model skill
scores(specially CSI, HSS, GSS).
>>>>>>>>>>>
>>>>>>>>>>> Here you need to make sure that in your PointStat config
file the output_flag[] for CTS (continuous statistics) is turned on.
>>>>>>>>>>>
>>>>>>>>>>> Do I need to put all variables in pb2nc config file
(obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>
>>>>>>>>>>> You do not have to, but it is easier to just run PB2NC
once for all of the variables that you want. Then all of the variables
will be in one MET usable netCDF file.
>>>>>>>>>>>
>>>>>>>>>>> What should I put in level_category[] = [ ?] - skill score
based on model surface to upper atmosphere level-200mb)?
>>>>>>>>>>>
>>>>>>>>>>> Leave it blank to get all of them.
>>>>>>>>>>>
>>>>>>>>>>> Let us know if you need any more help.
>>>>>>>>>>>
>>>>>>>>>>> Anne
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 03/08/2012 02:23 PM, Kumar, Anil[UNIV MARYLAND COLLEGE
>>>>>>>>>>> PARK] via RT
>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> <URL:
>>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>>
>>>>>>>>>>>> Paul,
>>>>>>>>>>>> Please find the latest Point config file.
>>>>>>>>>>>> I do get some output (see below) but I need help to get
skill scores only.
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>> Anil
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> -----Original Message-----
>>>>>>>>>>>> From: Paul Oldenburg via RT [mailto:met_help at ucar.edu]
>>>>>>>>>>>> Sent: Thursday, March 08, 2012 11:25 AM
>>>>>>>>>>>> To: Kumar, Anil (GSFC-617.0)[UNIV MARYLAND COLLEGE PARK]
>>>>>>>>>>>> Subject: Re: [rt.rap.ucar.edu #55009] skill scores
>>>>>>>>>>>>
>>>>>>>>>>>> Anil,
>>>>>>>>>>>>
>>>>>>>>>>>> I see that you're not currently a registered user of the
MET software. Prior to providing direct support in the use of MET, we
require that users fill out the free online registration form. That
enables us to ensure that we remain in compliance with the
international export laws of the United States.
>>>>>>>>>>>>
>>>>>>>>>>>> To fill out the registration, just go here:
>>>>>>>>>>>>
>>>>>>>>>>>> http://www.dtcenter.org/met/users/downloads/index.php
>>>>>>>>>>>> Enter you email address and hit enter to be taken to the
form.
>>>>>>>>>>>>
>>>>>>>>>>>> Once you have registered, can you please send me the
following information:
>>>>>>>>>>>>
>>>>>>>>>>>> 1. point_stat config file
>>>>>>>>>>>> 2. type of model data that you want to verify (e.g. GRIB,
>>>>>>>>>>>> p_interp,
>>>>>>>>>>>> etc)
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>
>>>>>>>>>>>> Paul
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On 03/08/2012 09:03 AM, Kumar, Anil[UNIV MARYLAND COLLEGE
PARK] via RT wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thu Mar 08 09:03:43 2012: Request 55009 was acted upon.
>>>>>>>>>>>>> Transaction: Ticket created by anil.kumar at nasa.gov
>>>>>>>>>>>>> Queue: met_help
>>>>>>>>>>>>> Subject: skill scores
>>>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>>>> Requestors: anil.kumar at nasa.gov
>>>>>>>>>>>>> Status: new
>>>>>>>>>>>>> Ticket<URL:
>>>>>>>>>>>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=55009>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>> I want to understand how to get model skill
>>>>>>>>>>>>> scores(specially CSI, HSS,
>>>>>>>>>>>>> GSS)
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1. Do I need to put all variables in pb2nc config
file (obs_grib_code[] = [ "SPFH", "TMP", "MIXR", "WIND" ]?
>>>>>>>>>>>>>
>>>>>>>>>>>>> 2. What should I put in level_category[] = [ ?] -
skill score based on model surface to upper atmosphere level-200mb)
>>>>>>>>>>>>>
>>>>>>>>>>>>> 3. Do I also put all variables in pointstat config
file?
>>>>>>>>>>>>>
>>>>>>>>>>>>> fcst_field[] = [ "TT(0,0-25,*,*)", "RH(0,0-25,*,*)" etc
];
>>>>>>>>>>>>>
>>>>>>>>>>>>> obs_field[] = [ "TMP/1000-200", "RH/P1000-200" etc];
>>>>>>>>>>>>>
>>>>>>>>>>>>> If you have any sample pb2nc config and pointstat config
file for just skill score (category 3) that will be very help.
>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>> Anil
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>>
>>>
>>
>
------------------------------------------------
More information about the Met_help
mailing list