[Met_help] [rt.rap.ucar.edu #74870] History for Possibility to get co-located forecast and observed values using MET tools
John Halley Gotway via RT
met_help at ucar.edu
Wed Jan 27 11:10:08 MST 2016
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi MET Helper,
I am verifying the WRF-ARW outputs using hourly surface observations obtained from http://rda.ucar.edu/datasets/ds463.3 website.
The MET is awesome for giving me all statists based on stations fall in a region I specified. Is there any way to get collocated forecast and observed values, for example modeled and observed TMP and RH at each date time and station?
I need to have ascii or netcdf file containing station ID, station info (lat, lon), date&time, modeled value, observed value. Can it be done through MET tool? or I have to do something else?
My obtained point observations are GDAS dataset was processed by MET pb2nc tool (see attached file as an example). Your help and guidance on how to convert the dataset to the netcdf format like WRF outputs or plain ascii format will be highly appreciated because I have no clue how to deal with the dataset I have on my hand, an get what I needed.
Thank you in advance for your help and guidance.
Tsengel
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Possibility to get co-located forecast and observed values using MET tools
From: John Halley Gotway
Time: Tue Jan 26 16:28:50 2016
Tsengel,
I see that you've been successfully able to run the Point-Stat tool to
generate statistics. However, you'd like to see the individual
forecast/observation matched pair values that went into the
computation of
those statistics. This one is simple... all you need to do is turn on
the
matched pair (MPR) output line type in the Point-Stat configuration
file:
mpr = STAT;
You can set it to either STAT or BOTH. The former writes the MPR
lines to
only the .stat output file while the second writes it to both the
.stat
file and it creates an _mpr.txt output file containing only MPR output
lines.
You should be aware that your output files will be MUCH larger.
Instead of
having 1 output line containing continuous statistics, you'll have
thousands... one for each matched pair.
Here some more info...
(1) A description of the MPR output line type can be found in Table
7.18 on
page 113 of the MET User's Guide:
http://www.dtcenter.org/met/users/docs/users_guide/MET_Users_Guide_v5.1.pdf
(2) There's a nice little Rscript called "plot_mpr.R" on the MET
website
showing some plots that can be made using MPR output lines:
http://www.dtcenter.org/met/users/downloads/analysis_scripts.php
Here's a direct link to the sample output file:
http://www.dtcenter.org/met/users/downloads/Rscripts/mpr_plots.pdf
For each "case", it creates 4 plots: histograms of the forecast and
observation values, a scatter plot, and a Q-Q plot.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Tue, Jan 26, 2016 at 1:37 PM, Nergui, Tsengel via RT
<met_help at ucar.edu>
wrote:
>
> Tue Jan 26 13:37:09 2016: Request 74870 was acted upon.
> Transaction: Ticket created by tsengel.nergui at wsu.edu
> Queue: met_help
> Subject: Possibility to get co-located forecast and observed
values
> using MET tools
> Owner: Nobody
> Requestors: tsengel.nergui at wsu.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74870 >
>
>
> Hi MET Helper,
>
> I am verifying the WRF-ARW outputs using hourly surface observations
> obtained from http://rda.ucar.edu/datasets/ds463.3 website.
>
> The MET is awesome for giving me all statists based on stations fall
in a
> region I specified. Is there any way to get collocated forecast and
> observed values, for example modeled and observed TMP and RH at each
date
> time and station?
>
> I need to have ascii or netcdf file containing station ID, station
info
> (lat, lon), date&time, modeled value, observed value. Can it be done
> through MET tool? or I have to do something else?
> My obtained point observations are GDAS dataset was processed by MET
pb2nc
> tool (see attached file as an example). Your help and guidance on
how to
> convert the dataset to the netcdf format like WRF outputs or plain
ascii
> format will be highly appreciated because I have no clue how to deal
with
> the dataset I have on my hand, an get what I needed.
>
> Thank you in advance for your help and guidance.
>
> Tsengel
>
>
------------------------------------------------
Subject: RE: [rt.rap.ucar.edu #74870] Possibility to get co-located forecast and observed values using MET tools
From: Nergui, Tsengel
Time: Wed Jan 27 10:24:30 2016
Hi John,
Thank you for your quick and direct answer.
Tsengel
-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, January 26, 2016 3:29 PM
To: Nergui, Tsengel
Subject: Re: [rt.rap.ucar.edu #74870] Possibility to get co-located
forecast and observed values using MET tools
Tsengel,
I see that you've been successfully able to run the Point-Stat tool to
generate statistics. However, you'd like to see the individual
forecast/observation matched pair values that went into the
computation of those statistics. This one is simple... all you need
to do is turn on the matched pair (MPR) output line type in the Point-
Stat configuration file:
mpr = STAT;
You can set it to either STAT or BOTH. The former writes the MPR
lines to only the .stat output file while the second writes it to both
the .stat file and it creates an _mpr.txt output file containing only
MPR output lines.
You should be aware that your output files will be MUCH larger.
Instead of having 1 output line containing continuous statistics,
you'll have thousands... one for each matched pair.
Here some more info...
(1) A description of the MPR output line type can be found in Table
7.18 on page 113 of the MET User's Guide:
https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_docs_users-5Fguide_MET-5FUsers-5FGuide-
5Fv5.1.pdf&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=bJZs2df7VD1lm8tCYnp7vbRcOZtRVQlQunpWMM53T4M&e=
(2) There's a nice little Rscript called "plot_mpr.R" on the MET
website showing some plots that can be made using MPR output lines:
https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_downloads_analysis-
5Fscripts.php&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=6u0DnXvKuI7koU1P8Q27Tr-
JiZoj6uED8evBiTf1P_c&e=
Here's a direct link to the sample output file:
https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_downloads_Rscripts_mpr-
5Fplots.pdf&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=f03n8GBp0CBUzcGfMgOdwnB0w3iAUjE6ZnllMXoHYnY&e=
For each "case", it creates 4 plots: histograms of the forecast and
observation values, a scatter plot, and a Q-Q plot.
Hope that helps.
Thanks,
John Halley Gotway
met_help at ucar.edu
On Tue, Jan 26, 2016 at 1:37 PM, Nergui, Tsengel via RT
<met_help at ucar.edu>
wrote:
>
> Tue Jan 26 13:37:09 2016: Request 74870 was acted upon.
> Transaction: Ticket created by tsengel.nergui at wsu.edu
> Queue: met_help
> Subject: Possibility to get co-located forecast and observed
> values using MET tools
> Owner: Nobody
> Requestors: tsengel.nergui at wsu.edu
> Status: new
> Ticket
> <URL:https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.
> edu_rt_Ticket_Display.html-3Fid-
3D74870&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS0
> 6ZyWk4EJm8LdrrvxQb-Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE
> &m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=0-
bHMqN22zs1BskFY2i_j
> ycCet7-bEl9mkzDbJGKGKw&e= >
>
>
> Hi MET Helper,
>
> I am verifying the WRF-ARW outputs using hourly surface observations
> obtained from https://urldefense.proofpoint.com/v2/url?u=http-
3A__rda.ucar.edu_datasets_ds463.3&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=fsF1qkIhs3-
mjIPeuEiZrji8PKOPPa0Z_7lkGT7YCGc&e= website.
>
> The MET is awesome for giving me all statists based on stations fall
> in a region I specified. Is there any way to get collocated forecast
> and observed values, for example modeled and observed TMP and RH at
> each date time and station?
>
> I need to have ascii or netcdf file containing station ID, station
> info (lat, lon), date&time, modeled value, observed value. Can it be
> done through MET tool? or I have to do something else?
> My obtained point observations are GDAS dataset was processed by MET
> pb2nc tool (see attached file as an example). Your help and guidance
> on how to convert the dataset to the netcdf format like WRF outputs
or
> plain ascii format will be highly appreciated because I have no clue
> how to deal with the dataset I have on my hand, an get what I
needed.
>
> Thank you in advance for your help and guidance.
>
> Tsengel
>
>
------------------------------------------------
Subject: Possibility to get co-located forecast and observed values using MET tools
From: John Halley Gotway
Time: Wed Jan 27 10:56:40 2016
Great, I'll go ahead and resolve this ticket. Just let us know what
other
issues or questions arise in your use of MET.
Thanks,
John
On Wed, Jan 27, 2016 at 10:24 AM, Nergui, Tsengel via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=74870 >
>
> Hi John,
>
> Thank you for your quick and direct answer.
>
> Tsengel
>
>
>
>
> -----Original Message-----
> From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
> Sent: Tuesday, January 26, 2016 3:29 PM
> To: Nergui, Tsengel
> Subject: Re: [rt.rap.ucar.edu #74870] Possibility to get co-located
> forecast and observed values using MET tools
>
> Tsengel,
>
> I see that you've been successfully able to run the Point-Stat tool
to
> generate statistics. However, you'd like to see the individual
> forecast/observation matched pair values that went into the
computation of
> those statistics. This one is simple... all you need to do is turn
on the
> matched pair (MPR) output line type in the Point-Stat configuration
file:
> mpr = STAT;
>
> You can set it to either STAT or BOTH. The former writes the MPR
lines to
> only the .stat output file while the second writes it to both the
.stat
> file and it creates an _mpr.txt output file containing only MPR
output
> lines.
>
> You should be aware that your output files will be MUCH larger.
Instead
> of having 1 output line containing continuous statistics, you'll
have
> thousands... one for each matched pair.
>
> Here some more info...
>
> (1) A description of the MPR output line type can be found in Table
7.18
> on page 113 of the MET User's Guide:
>
>
> https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_docs_users-5Fguide_MET-5FUsers-5FGuide-
5Fv5.1.pdf&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=bJZs2df7VD1lm8tCYnp7vbRcOZtRVQlQunpWMM53T4M&e=
>
> (2) There's a nice little Rscript called "plot_mpr.R" on the MET
website
> showing some plots that can be made using MPR output lines:
>
> https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_downloads_analysis-
5Fscripts.php&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=6u0DnXvKuI7koU1P8Q27Tr-
JiZoj6uED8evBiTf1P_c&e=
>
> Here's a direct link to the sample output file:
>
> https://urldefense.proofpoint.com/v2/url?u=http-
3A__www.dtcenter.org_met_users_downloads_Rscripts_mpr-
5Fplots.pdf&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=f03n8GBp0CBUzcGfMgOdwnB0w3iAUjE6ZnllMXoHYnY&e=
>
> For each "case", it creates 4 plots: histograms of the forecast and
> observation values, a scatter plot, and a Q-Q plot.
>
> Hope that helps.
>
> Thanks,
> John Halley Gotway
> met_help at ucar.edu
>
>
>
> On Tue, Jan 26, 2016 at 1:37 PM, Nergui, Tsengel via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Tue Jan 26 13:37:09 2016: Request 74870 was acted upon.
> > Transaction: Ticket created by tsengel.nergui at wsu.edu
> > Queue: met_help
> > Subject: Possibility to get co-located forecast and observed
> > values using MET tools
> > Owner: Nobody
> > Requestors: tsengel.nergui at wsu.edu
> > Status: new
> > Ticket
> > <URL:https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.
> > edu_rt_Ticket_Display.html-3Fid-
3D74870&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS0
> > 6ZyWk4EJm8LdrrvxQb-Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE
> > &m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=0-
bHMqN22zs1BskFY2i_j
> > ycCet7-bEl9mkzDbJGKGKw&e= >
> >
> >
> > Hi MET Helper,
> >
> > I am verifying the WRF-ARW outputs using hourly surface
observations
> > obtained from
> https://urldefense.proofpoint.com/v2/url?u=http-
3A__rda.ucar.edu_datasets_ds463.3&d=CwIDaQ&c=C3yme8gMkxg_ihJNXS06ZyWk4EJm8LdrrvxQb-
Je7sw&r=OUixJTR1U-
9NUyc8rj3XpGV38A03YgZoNOMgJhE5JYE&m=yKXT4banC4mFjdwP93jb0UJd0e8PPAO0aYjjmYADbzg&s=fsF1qkIhs3-
mjIPeuEiZrji8PKOPPa0Z_7lkGT7YCGc&e=
> website.
> >
> > The MET is awesome for giving me all statists based on stations
fall
> > in a region I specified. Is there any way to get collocated
forecast
> > and observed values, for example modeled and observed TMP and RH
at
> > each date time and station?
> >
> > I need to have ascii or netcdf file containing station ID, station
> > info (lat, lon), date&time, modeled value, observed value. Can it
be
> > done through MET tool? or I have to do something else?
> > My obtained point observations are GDAS dataset was processed by
MET
> > pb2nc tool (see attached file as an example). Your help and
guidance
> > on how to convert the dataset to the netcdf format like WRF
outputs or
> > plain ascii format will be highly appreciated because I have no
clue
> > how to deal with the dataset I have on my hand, an get what I
needed.
> >
> > Thank you in advance for your help and guidance.
> >
> > Tsengel
> >
> >
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list