[Met_help] [rt.rap.ucar.edu #81012] History for How to compute spatial average of a variable over a masked region
John Halley Gotway via RT
met_help at ucar.edu
Wed Jun 28 11:06:53 MDT 2017
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I would like to compute regional average of a variable over a masked region.
For example, 2m temperature and precipitation over Indiana state.
Is it fairly straightforward and fast to use MET for this purpose?
I want to generate a time series of the variables in a csv format.
Previously I used NCL and R to do the similar things.
Please let me know.
Thank you.
Regards,
Jinwoong Yoo
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: John Halley Gotway
Time: Mon Jun 26 10:29:58 2017
Jinwoong,
Sure, you can use MET to compute a spatial average over whatever
sub-regions of your domain that you'd like. If that's really is the
only
thing you're looking for, then using MET may be overkill.
MET was designed to compute verification scores to assess how well
your
model compares to point observations or gridded analyses.
Do you have observations against which you'd like to compare your
model
output?
To answer, your specific question, you could...
(1) Run gen_vx_mask to generate the Indiana masking region (as we were
discussing last week).
(2) Run grid_stat and pass in your model output as both the forecast
and
observation field.
(3) Make sure you've configured grid_stat to compute the continuous
statistics (CNT) output line type.
The FBAR column in the CNT line type is simply the average forecast
value
in the region you've defined.
Grid-Stat should be run once for each verification time step. So
you'd use
a script to loop through your times, and run Grid-Stat once for each.
The output of Grid-Stat is a space-separated ascii file.
Hope that helps.
John
On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
> Transaction: Ticket created by jinwoong.yoo at gmail.com
> Queue: met_help
> Subject: How to compute spatial average of a variable over a
masked
> region
> Owner: Nobody
> Requestors: jinwoong.yoo at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
>
>
> Hi,
>
> I would like to compute regional average of a variable over a masked
> region.
> For example, 2m temperature and precipitation over Indiana state.
> Is it fairly straightforward and fast to use MET for this purpose?
>
> I want to generate a time series of the variables in a csv format.
> Previously I used NCL and R to do the similar things.
> Please let me know.
> Thank you.
>
> Regards,
>
> Jinwoong Yoo
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: Jinwoong Yoo
Time: Mon Jun 26 11:13:13 2017
Hi John,
Thank you so much again.
"Do you have observations against which you'd like to compare your
model
output?"
>>> Yes, there are several observations that I would like to compare
my WRF
outputs with.
MODIS, TRMM, GPM, gridded weather station observation data by Notre
Dame
Univ, to list a few.
Computing spatial averages over IN is just a simple postprocessing for
other data consumers in our group.
I would like to explore more what MET can be utilized for as a core
model
verification module.
In particular, I like to see how fast MET can complete the process
compared
to other software.
Speaking of observation datasets for comparison,
what will be the best practice when it comes to dataset regrid?
They are in each different coordinate grid.
How long does it take to regrid on the fly using config file -regird
option?
Will it be better to convert every dataset into a common grid (such as
lat
lon) and run Grid-Stat?
It seems MET can process data with only one time step while my gridded
weather station observation data has 36160 time stamps in one netcdf
file.
Should I need to create each individual file for each time stamp to
run
Grid-Stat?
I wish MET can utilize multi-temporal files.
Thank you.
Regards,
Jinwoong
On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> Sure, you can use MET to compute a spatial average over whatever
> sub-regions of your domain that you'd like. If that's really is the
only
> thing you're looking for, then using MET may be overkill.
>
> MET was designed to compute verification scores to assess how well
your
> model compares to point observations or gridded analyses.
>
> Do you have observations against which you'd like to compare your
model
> output?
>
> To answer, your specific question, you could...
> (1) Run gen_vx_mask to generate the Indiana masking region (as we
were
> discussing last week).
> (2) Run grid_stat and pass in your model output as both the forecast
and
> observation field.
> (3) Make sure you've configured grid_stat to compute the continuous
> statistics (CNT) output line type.
>
> The FBAR column in the CNT line type is simply the average forecast
value
> in the region you've defined.
>
> Grid-Stat should be run once for each verification time step. So
you'd use
> a script to loop through your times, and run Grid-Stat once for
each.
>
> The output of Grid-Stat is a space-separated ascii file.
>
> Hope that helps.
>
> John
>
>
>
>
> On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
> > Transaction: Ticket created by jinwoong.yoo at gmail.com
> > Queue: met_help
> > Subject: How to compute spatial average of a variable over a
masked
> > region
> > Owner: Nobody
> > Requestors: jinwoong.yoo at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> >
> >
> > Hi,
> >
> > I would like to compute regional average of a variable over a
masked
> > region.
> > For example, 2m temperature and precipitation over Indiana state.
> > Is it fairly straightforward and fast to use MET for this purpose?
> >
> > I want to generate a time series of the variables in a csv format.
> > Previously I used NCL and R to do the similar things.
> > Please let me know.
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong Yoo
> >
> >
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: John Halley Gotway
Time: Mon Jun 26 11:41:35 2017
Jinwoong,
While the MET tools must be run once to evaluate each time separately,
they
do include some time filtering options which may prevent you from
having to
do a lot of reformatting.
For example, suppose you have a GRIB file which contains many output
times. There are options in the MET config file so that you can
specify
which time you want to process.
Ultimately, it comes down to the details. As long as your data is in
format that MET can read, it may already do what you'd like to do.
Thanks,
John
On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
>
> Hi John,
>
> Thank you so much again.
>
> "Do you have observations against which you'd like to compare your
model
> output?"
> >>> Yes, there are several observations that I would like to compare
my WRF
> outputs with.
> MODIS, TRMM, GPM, gridded weather station observation data by Notre
Dame
> Univ, to list a few.
>
> Computing spatial averages over IN is just a simple postprocessing
for
> other data consumers in our group.
> I would like to explore more what MET can be utilized for as a core
model
> verification module.
> In particular, I like to see how fast MET can complete the process
compared
> to other software.
>
> Speaking of observation datasets for comparison,
> what will be the best practice when it comes to dataset regrid?
> They are in each different coordinate grid.
>
> How long does it take to regrid on the fly using config file -regird
> option?
> Will it be better to convert every dataset into a common grid (such
as lat
> lon) and run Grid-Stat?
> It seems MET can process data with only one time step while my
gridded
> weather station observation data has 36160 time stamps in one netcdf
file.
> Should I need to create each individual file for each time stamp to
run
> Grid-Stat?
> I wish MET can utilize multi-temporal files.
>
>
> Thank you.
> Regards,
>
> Jinwoong
>
>
>
> On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Jinwoong,
> >
> > Sure, you can use MET to compute a spatial average over whatever
> > sub-regions of your domain that you'd like. If that's really is
the only
> > thing you're looking for, then using MET may be overkill.
> >
> > MET was designed to compute verification scores to assess how well
your
> > model compares to point observations or gridded analyses.
> >
> > Do you have observations against which you'd like to compare your
model
> > output?
> >
> > To answer, your specific question, you could...
> > (1) Run gen_vx_mask to generate the Indiana masking region (as we
were
> > discussing last week).
> > (2) Run grid_stat and pass in your model output as both the
forecast and
> > observation field.
> > (3) Make sure you've configured grid_stat to compute the
continuous
> > statistics (CNT) output line type.
> >
> > The FBAR column in the CNT line type is simply the average
forecast value
> > in the region you've defined.
> >
> > Grid-Stat should be run once for each verification time step. So
you'd
> use
> > a script to loop through your times, and run Grid-Stat once for
each.
> >
> > The output of Grid-Stat is a space-separated ascii file.
> >
> > Hope that helps.
> >
> > John
> >
> >
> >
> >
> > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
> > > Transaction: Ticket created by jinwoong.yoo at gmail.com
> > > Queue: met_help
> > > Subject: How to compute spatial average of a variable over
a
> masked
> > > region
> > > Owner: Nobody
> > > Requestors: jinwoong.yoo at gmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012
> >
> > >
> > >
> > > Hi,
> > >
> > > I would like to compute regional average of a variable over a
masked
> > > region.
> > > For example, 2m temperature and precipitation over Indiana
state.
> > > Is it fairly straightforward and fast to use MET for this
purpose?
> > >
> > > I want to generate a time series of the variables in a csv
format.
> > > Previously I used NCL and R to do the similar things.
> > > Please let me know.
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong Yoo
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: Jinwoong Yoo
Time: Mon Jun 26 14:32:22 2017
Hi John,
File formats of my obs datasets are netcdf and hdf5, not grib.
In particular, one netcdf file contains 99 years observations.
Which part in the config file should I modify to run Grid-Stat against
the
netcdf file for different time stamp?
By the way,
when I testing a Gird-Stat using my config file, I got error as below:
DEBUG 1: Default Config File:
/home/yoo108/met-6.0_bugfix/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: GridStatConfig_T2hourly
ERROR : yyerror() -> syntax error in file "GridStatConfig_T2hourly"
ERROR : line = 107
ERROR : column = 1
ERROR : text = "climo_mean"
ERROR : climo_mean = {
ERROR : ^^^^^^^^^^____
I don't have any clue what is wrong.
Actually I don't need any from the section.
Thank you.
Regards,
Jinwoong
On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> While the MET tools must be run once to evaluate each time
separately, they
> do include some time filtering options which may prevent you from
having to
> do a lot of reformatting.
>
> For example, suppose you have a GRIB file which contains many output
> times. There are options in the MET config file so that you can
specify
> which time you want to process.
>
> Ultimately, it comes down to the details. As long as your data is
in
> format that MET can read, it may already do what you'd like to do.
>
> Thanks,
> John
>
> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> >
> > Hi John,
> >
> > Thank you so much again.
> >
> > "Do you have observations against which you'd like to compare your
model
> > output?"
> > >>> Yes, there are several observations that I would like to
compare my
> WRF
> > outputs with.
> > MODIS, TRMM, GPM, gridded weather station observation data by
Notre Dame
> > Univ, to list a few.
> >
> > Computing spatial averages over IN is just a simple postprocessing
for
> > other data consumers in our group.
> > I would like to explore more what MET can be utilized for as a
core model
> > verification module.
> > In particular, I like to see how fast MET can complete the process
> compared
> > to other software.
> >
> > Speaking of observation datasets for comparison,
> > what will be the best practice when it comes to dataset regrid?
> > They are in each different coordinate grid.
> >
> > How long does it take to regrid on the fly using config file
-regird
> > option?
> > Will it be better to convert every dataset into a common grid
(such as
> lat
> > lon) and run Grid-Stat?
> > It seems MET can process data with only one time step while my
gridded
> > weather station observation data has 36160 time stamps in one
netcdf
> file.
> > Should I need to create each individual file for each time stamp
to run
> > Grid-Stat?
> > I wish MET can utilize multi-temporal files.
> >
> >
> > Thank you.
> > Regards,
> >
> > Jinwoong
> >
> >
> >
> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Jinwoong,
> > >
> > > Sure, you can use MET to compute a spatial average over whatever
> > > sub-regions of your domain that you'd like. If that's really is
the
> only
> > > thing you're looking for, then using MET may be overkill.
> > >
> > > MET was designed to compute verification scores to assess how
well your
> > > model compares to point observations or gridded analyses.
> > >
> > > Do you have observations against which you'd like to compare
your model
> > > output?
> > >
> > > To answer, your specific question, you could...
> > > (1) Run gen_vx_mask to generate the Indiana masking region (as
we were
> > > discussing last week).
> > > (2) Run grid_stat and pass in your model output as both the
forecast
> and
> > > observation field.
> > > (3) Make sure you've configured grid_stat to compute the
continuous
> > > statistics (CNT) output line type.
> > >
> > > The FBAR column in the CNT line type is simply the average
forecast
> value
> > > in the region you've defined.
> > >
> > > Grid-Stat should be run once for each verification time step.
So you'd
> > use
> > > a script to loop through your times, and run Grid-Stat once for
each.
> > >
> > > The output of Grid-Stat is a space-separated ascii file.
> > >
> > > Hope that helps.
> > >
> > > John
> > >
> > >
> > >
> > >
> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
> > > > Transaction: Ticket created by jinwoong.yoo at gmail.com
> > > > Queue: met_help
> > > > Subject: How to compute spatial average of a variable
over a
> > masked
> > > > region
> > > > Owner: Nobody
> > > > Requestors: jinwoong.yoo at gmail.com
> > > > Status: new
> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=81012
> > >
> > > >
> > > >
> > > > Hi,
> > > >
> > > > I would like to compute regional average of a variable over a
masked
> > > > region.
> > > > For example, 2m temperature and precipitation over Indiana
state.
> > > > Is it fairly straightforward and fast to use MET for this
purpose?
> > > >
> > > > I want to generate a time series of the variables in a csv
format.
> > > > Previously I used NCL and R to do the similar things.
> > > > Please let me know.
> > > > Thank you.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong Yoo
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: Jinwoong Yoo
Time: Mon Jun 26 14:55:53 2017
Hi John,
I figured out the source of error in my config file.
Please ignore my previous question.
Thank you.
Regards,
Jinwoong
On Mon, Jun 26, 2017 at 4:32 PM, Jinwoong Yoo <jinwoong.yoo at gmail.com>
wrote:
> Hi John,
>
> File formats of my obs datasets are netcdf and hdf5, not grib.
> In particular, one netcdf file contains 99 years observations.
> Which part in the config file should I modify to run Grid-Stat
against the
> netcdf file for different time stamp?
>
>
> By the way,
> when I testing a Gird-Stat using my config file, I got error as
below:
>
> DEBUG 1: Default Config File: /home/yoo108/met-6.0_bugfix/
> share/met/config/GridStatConfig_default
>
> DEBUG 1: User Config File: GridStatConfig_T2hourly
>
> ERROR : yyerror() -> syntax error in file "GridStatConfig_T2hourly"
>
> ERROR : line = 107
>
> ERROR : column = 1
>
> ERROR : text = "climo_mean"
>
> ERROR : climo_mean = {
>
> ERROR : ^^^^^^^^^^____
>
> I don't have any clue what is wrong.
> Actually I don't need any from the section.
> Thank you.
> Regards,
>
> Jinwoong
>
> On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Jinwoong,
>>
>> While the MET tools must be run once to evaluate each time
separately,
>> they
>> do include some time filtering options which may prevent you from
having
>> to
>> do a lot of reformatting.
>>
>> For example, suppose you have a GRIB file which contains many
output
>> times. There are options in the MET config file so that you can
specify
>> which time you want to process.
>>
>> Ultimately, it comes down to the details. As long as your data is
in
>> format that MET can read, it may already do what you'd like to do.
>>
>> Thanks,
>> John
>>
>> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT
<met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
>> >
>> > Hi John,
>> >
>> > Thank you so much again.
>> >
>> > "Do you have observations against which you'd like to compare
your model
>> > output?"
>> > >>> Yes, there are several observations that I would like to
compare my
>> WRF
>> > outputs with.
>> > MODIS, TRMM, GPM, gridded weather station observation data by
Notre Dame
>> > Univ, to list a few.
>> >
>> > Computing spatial averages over IN is just a simple
postprocessing for
>> > other data consumers in our group.
>> > I would like to explore more what MET can be utilized for as a
core
>> model
>> > verification module.
>> > In particular, I like to see how fast MET can complete the
process
>> compared
>> > to other software.
>> >
>> > Speaking of observation datasets for comparison,
>> > what will be the best practice when it comes to dataset regrid?
>> > They are in each different coordinate grid.
>> >
>> > How long does it take to regrid on the fly using config file
-regird
>> > option?
>> > Will it be better to convert every dataset into a common grid
(such as
>> lat
>> > lon) and run Grid-Stat?
>> > It seems MET can process data with only one time step while my
gridded
>> > weather station observation data has 36160 time stamps in one
netcdf
>> file.
>> > Should I need to create each individual file for each time stamp
to run
>> > Grid-Stat?
>> > I wish MET can utilize multi-temporal files.
>> >
>> >
>> > Thank you.
>> > Regards,
>> >
>> > Jinwoong
>> >
>> >
>> >
>> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > > Jinwoong,
>> > >
>> > > Sure, you can use MET to compute a spatial average over
whatever
>> > > sub-regions of your domain that you'd like. If that's really
is the
>> only
>> > > thing you're looking for, then using MET may be overkill.
>> > >
>> > > MET was designed to compute verification scores to assess how
well
>> your
>> > > model compares to point observations or gridded analyses.
>> > >
>> > > Do you have observations against which you'd like to compare
your
>> model
>> > > output?
>> > >
>> > > To answer, your specific question, you could...
>> > > (1) Run gen_vx_mask to generate the Indiana masking region (as
we were
>> > > discussing last week).
>> > > (2) Run grid_stat and pass in your model output as both the
forecast
>> and
>> > > observation field.
>> > > (3) Make sure you've configured grid_stat to compute the
continuous
>> > > statistics (CNT) output line type.
>> > >
>> > > The FBAR column in the CNT line type is simply the average
forecast
>> value
>> > > in the region you've defined.
>> > >
>> > > Grid-Stat should be run once for each verification time step.
So
>> you'd
>> > use
>> > > a script to loop through your times, and run Grid-Stat once for
each.
>> > >
>> > > The output of Grid-Stat is a space-separated ascii file.
>> > >
>> > > Hope that helps.
>> > >
>> > > John
>> > >
>> > >
>> > >
>> > >
>> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
>> met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
>> > > > Transaction: Ticket created by jinwoong.yoo at gmail.com
>> > > > Queue: met_help
>> > > > Subject: How to compute spatial average of a variable
over a
>> > masked
>> > > > region
>> > > > Owner: Nobody
>> > > > Requestors: jinwoong.yoo at gmail.com
>> > > > Status: new
>> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
>> ket/Display.html?id=81012
>> > >
>> > > >
>> > > >
>> > > > Hi,
>> > > >
>> > > > I would like to compute regional average of a variable over a
masked
>> > > > region.
>> > > > For example, 2m temperature and precipitation over Indiana
state.
>> > > > Is it fairly straightforward and fast to use MET for this
purpose?
>> > > >
>> > > > I want to generate a time series of the variables in a csv
format.
>> > > > Previously I used NCL and R to do the similar things.
>> > > > Please let me know.
>> > > > Thank you.
>> > > >
>> > > > Regards,
>> > > >
>> > > > Jinwoong Yoo
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: Jinwoong Yoo
Time: Tue Jun 27 13:17:02 2017
Hi John,
Regarding the two APCP variables available in on GRIB2 file,
How can I retrieve the runtime accumulation of precipitation
specifically
between them in the MET?
I would like to do this because I can retrieve APCP using only one
file.
Do I need to convert the variable to netcdf?
Thank you.
Regards,
Jinwoong
On Mon, Jun 26, 2017 at 4:55 PM, Jinwoong Yoo <jinwoong.yoo at gmail.com>
wrote:
> Hi John,
>
> I figured out the source of error in my config file.
> Please ignore my previous question.
> Thank you.
>
> Regards,
>
> Jinwoong
>
> On Mon, Jun 26, 2017 at 4:32 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> wrote:
>
>> Hi John,
>>
>> File formats of my obs datasets are netcdf and hdf5, not grib.
>> In particular, one netcdf file contains 99 years observations.
>> Which part in the config file should I modify to run Grid-Stat
against
>> the netcdf file for different time stamp?
>>
>>
>> By the way,
>> when I testing a Gird-Stat using my config file, I got error as
below:
>>
>> DEBUG 1: Default Config File: /home/yoo108/met-6.0_bugfix/sh
>> are/met/config/GridStatConfig_default
>>
>> DEBUG 1: User Config File: GridStatConfig_T2hourly
>>
>> ERROR : yyerror() -> syntax error in file
"GridStatConfig_T2hourly"
>>
>> ERROR : line = 107
>>
>> ERROR : column = 1
>>
>> ERROR : text = "climo_mean"
>>
>> ERROR : climo_mean = {
>>
>> ERROR : ^^^^^^^^^^____
>>
>> I don't have any clue what is wrong.
>> Actually I don't need any from the section.
>> Thank you.
>> Regards,
>>
>> Jinwoong
>>
>> On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>>> Jinwoong,
>>>
>>> While the MET tools must be run once to evaluate each time
separately,
>>> they
>>> do include some time filtering options which may prevent you from
having
>>> to
>>> do a lot of reformatting.
>>>
>>> For example, suppose you have a GRIB file which contains many
output
>>> times. There are options in the MET config file so that you can
specify
>>> which time you want to process.
>>>
>>> Ultimately, it comes down to the details. As long as your data is
in
>>> format that MET can read, it may already do what you'd like to do.
>>>
>>> Thanks,
>>> John
>>>
>>> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT
<met_help at ucar.edu
>>> >
>>> wrote:
>>>
>>> >
>>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
>>> >
>>> > Hi John,
>>> >
>>> > Thank you so much again.
>>> >
>>> > "Do you have observations against which you'd like to compare
your
>>> model
>>> > output?"
>>> > >>> Yes, there are several observations that I would like to
compare
>>> my WRF
>>> > outputs with.
>>> > MODIS, TRMM, GPM, gridded weather station observation data by
Notre
>>> Dame
>>> > Univ, to list a few.
>>> >
>>> > Computing spatial averages over IN is just a simple
postprocessing for
>>> > other data consumers in our group.
>>> > I would like to explore more what MET can be utilized for as a
core
>>> model
>>> > verification module.
>>> > In particular, I like to see how fast MET can complete the
process
>>> compared
>>> > to other software.
>>> >
>>> > Speaking of observation datasets for comparison,
>>> > what will be the best practice when it comes to dataset regrid?
>>> > They are in each different coordinate grid.
>>> >
>>> > How long does it take to regrid on the fly using config file
-regird
>>> > option?
>>> > Will it be better to convert every dataset into a common grid
(such as
>>> lat
>>> > lon) and run Grid-Stat?
>>> > It seems MET can process data with only one time step while my
gridded
>>> > weather station observation data has 36160 time stamps in one
netcdf
>>> file.
>>> > Should I need to create each individual file for each time stamp
to run
>>> > Grid-Stat?
>>> > I wish MET can utilize multi-temporal files.
>>> >
>>> >
>>> > Thank you.
>>> > Regards,
>>> >
>>> > Jinwoong
>>> >
>>> >
>>> >
>>> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT <
>>> > met_help at ucar.edu> wrote:
>>> >
>>> > > Jinwoong,
>>> > >
>>> > > Sure, you can use MET to compute a spatial average over
whatever
>>> > > sub-regions of your domain that you'd like. If that's really
is the
>>> only
>>> > > thing you're looking for, then using MET may be overkill.
>>> > >
>>> > > MET was designed to compute verification scores to assess how
well
>>> your
>>> > > model compares to point observations or gridded analyses.
>>> > >
>>> > > Do you have observations against which you'd like to compare
your
>>> model
>>> > > output?
>>> > >
>>> > > To answer, your specific question, you could...
>>> > > (1) Run gen_vx_mask to generate the Indiana masking region (as
we
>>> were
>>> > > discussing last week).
>>> > > (2) Run grid_stat and pass in your model output as both the
forecast
>>> and
>>> > > observation field.
>>> > > (3) Make sure you've configured grid_stat to compute the
continuous
>>> > > statistics (CNT) output line type.
>>> > >
>>> > > The FBAR column in the CNT line type is simply the average
forecast
>>> value
>>> > > in the region you've defined.
>>> > >
>>> > > Grid-Stat should be run once for each verification time step.
So
>>> you'd
>>> > use
>>> > > a script to loop through your times, and run Grid-Stat once
for each.
>>> > >
>>> > > The output of Grid-Stat is a space-separated ascii file.
>>> > >
>>> > > Hope that helps.
>>> > >
>>> > > John
>>> > >
>>> > >
>>> > >
>>> > >
>>> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
>>> met_help at ucar.edu>
>>> > > wrote:
>>> > >
>>> > > >
>>> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
>>> > > > Transaction: Ticket created by jinwoong.yoo at gmail.com
>>> > > > Queue: met_help
>>> > > > Subject: How to compute spatial average of a variable
over a
>>> > masked
>>> > > > region
>>> > > > Owner: Nobody
>>> > > > Requestors: jinwoong.yoo at gmail.com
>>> > > > Status: new
>>> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
>>> ket/Display.html?id=81012
>>> > >
>>> > > >
>>> > > >
>>> > > > Hi,
>>> > > >
>>> > > > I would like to compute regional average of a variable over
a
>>> masked
>>> > > > region.
>>> > > > For example, 2m temperature and precipitation over Indiana
state.
>>> > > > Is it fairly straightforward and fast to use MET for this
purpose?
>>> > > >
>>> > > > I want to generate a time series of the variables in a csv
format.
>>> > > > Previously I used NCL and R to do the similar things.
>>> > > > Please let me know.
>>> > > > Thank you.
>>> > > >
>>> > > > Regards,
>>> > > >
>>> > > > Jinwoong Yoo
>>> > > >
>>> > > >
>>> > >
>>> > >
>>> >
>>> >
>>>
>>>
>>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: John Halley Gotway
Time: Tue Jun 27 13:24:52 2017
Jinwoong,
It sounds like you're saying that you have a single GRIB2 file which
contains 2 different runtime accumulations in it. Is that right?
Let's say your file (in.grb2) contains 2 APCP, one for 0-24 and a
second
for 0-30 hours. You can just pass the same file to pcp_combine twice,
requesting different accumulation intervals:
pcp_combine -subtract in.grb2 30 in.grb2 24 apcp_24_30.nc
John
On Tue, Jun 27, 2017 at 1:17 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
>
> Hi John,
>
> Regarding the two APCP variables available in on GRIB2 file,
> How can I retrieve the runtime accumulation of precipitation
specifically
> between them in the MET?
> I would like to do this because I can retrieve APCP using only one
file.
> Do I need to convert the variable to netcdf?
> Thank you.
> Regards,
>
> Jinwoong
>
> On Mon, Jun 26, 2017 at 4:55 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> wrote:
>
> > Hi John,
> >
> > I figured out the source of error in my config file.
> > Please ignore my previous question.
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> > On Mon, Jun 26, 2017 at 4:32 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > wrote:
> >
> >> Hi John,
> >>
> >> File formats of my obs datasets are netcdf and hdf5, not grib.
> >> In particular, one netcdf file contains 99 years observations.
> >> Which part in the config file should I modify to run Grid-Stat
against
> >> the netcdf file for different time stamp?
> >>
> >>
> >> By the way,
> >> when I testing a Gird-Stat using my config file, I got error as
below:
> >>
> >> DEBUG 1: Default Config File: /home/yoo108/met-6.0_bugfix/sh
> >> are/met/config/GridStatConfig_default
> >>
> >> DEBUG 1: User Config File: GridStatConfig_T2hourly
> >>
> >> ERROR : yyerror() -> syntax error in file
"GridStatConfig_T2hourly"
> >>
> >> ERROR : line = 107
> >>
> >> ERROR : column = 1
> >>
> >> ERROR : text = "climo_mean"
> >>
> >> ERROR : climo_mean = {
> >>
> >> ERROR : ^^^^^^^^^^____
> >>
> >> I don't have any clue what is wrong.
> >> Actually I don't need any from the section.
> >> Thank you.
> >> Regards,
> >>
> >> Jinwoong
> >>
> >> On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >>> Jinwoong,
> >>>
> >>> While the MET tools must be run once to evaluate each time
separately,
> >>> they
> >>> do include some time filtering options which may prevent you
from
> having
> >>> to
> >>> do a lot of reformatting.
> >>>
> >>> For example, suppose you have a GRIB file which contains many
output
> >>> times. There are options in the MET config file so that you can
> specify
> >>> which time you want to process.
> >>>
> >>> Ultimately, it comes down to the details. As long as your data
is in
> >>> format that MET can read, it may already do what you'd like to
do.
> >>>
> >>> Thanks,
> >>> John
> >>>
> >>> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT <
> met_help at ucar.edu
> >>> >
> >>> wrote:
> >>>
> >>> >
> >>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012
>
> >>> >
> >>> > Hi John,
> >>> >
> >>> > Thank you so much again.
> >>> >
> >>> > "Do you have observations against which you'd like to compare
your
> >>> model
> >>> > output?"
> >>> > >>> Yes, there are several observations that I would like to
compare
> >>> my WRF
> >>> > outputs with.
> >>> > MODIS, TRMM, GPM, gridded weather station observation data by
Notre
> >>> Dame
> >>> > Univ, to list a few.
> >>> >
> >>> > Computing spatial averages over IN is just a simple
postprocessing
> for
> >>> > other data consumers in our group.
> >>> > I would like to explore more what MET can be utilized for as a
core
> >>> model
> >>> > verification module.
> >>> > In particular, I like to see how fast MET can complete the
process
> >>> compared
> >>> > to other software.
> >>> >
> >>> > Speaking of observation datasets for comparison,
> >>> > what will be the best practice when it comes to dataset
regrid?
> >>> > They are in each different coordinate grid.
> >>> >
> >>> > How long does it take to regrid on the fly using config file
-regird
> >>> > option?
> >>> > Will it be better to convert every dataset into a common grid
(such
> as
> >>> lat
> >>> > lon) and run Grid-Stat?
> >>> > It seems MET can process data with only one time step while my
> gridded
> >>> > weather station observation data has 36160 time stamps in one
netcdf
> >>> file.
> >>> > Should I need to create each individual file for each time
stamp to
> run
> >>> > Grid-Stat?
> >>> > I wish MET can utilize multi-temporal files.
> >>> >
> >>> >
> >>> > Thank you.
> >>> > Regards,
> >>> >
> >>> > Jinwoong
> >>> >
> >>> >
> >>> >
> >>> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT <
> >>> > met_help at ucar.edu> wrote:
> >>> >
> >>> > > Jinwoong,
> >>> > >
> >>> > > Sure, you can use MET to compute a spatial average over
whatever
> >>> > > sub-regions of your domain that you'd like. If that's
really is
> the
> >>> only
> >>> > > thing you're looking for, then using MET may be overkill.
> >>> > >
> >>> > > MET was designed to compute verification scores to assess
how well
> >>> your
> >>> > > model compares to point observations or gridded analyses.
> >>> > >
> >>> > > Do you have observations against which you'd like to compare
your
> >>> model
> >>> > > output?
> >>> > >
> >>> > > To answer, your specific question, you could...
> >>> > > (1) Run gen_vx_mask to generate the Indiana masking region
(as we
> >>> were
> >>> > > discussing last week).
> >>> > > (2) Run grid_stat and pass in your model output as both the
> forecast
> >>> and
> >>> > > observation field.
> >>> > > (3) Make sure you've configured grid_stat to compute the
continuous
> >>> > > statistics (CNT) output line type.
> >>> > >
> >>> > > The FBAR column in the CNT line type is simply the average
forecast
> >>> value
> >>> > > in the region you've defined.
> >>> > >
> >>> > > Grid-Stat should be run once for each verification time
step. So
> >>> you'd
> >>> > use
> >>> > > a script to loop through your times, and run Grid-Stat once
for
> each.
> >>> > >
> >>> > > The output of Grid-Stat is a space-separated ascii file.
> >>> > >
> >>> > > Hope that helps.
> >>> > >
> >>> > > John
> >>> > >
> >>> > >
> >>> > >
> >>> > >
> >>> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
> >>> met_help at ucar.edu>
> >>> > > wrote:
> >>> > >
> >>> > > >
> >>> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
> >>> > > > Transaction: Ticket created by jinwoong.yoo at gmail.com
> >>> > > > Queue: met_help
> >>> > > > Subject: How to compute spatial average of a variable
over a
> >>> > masked
> >>> > > > region
> >>> > > > Owner: Nobody
> >>> > > > Requestors: jinwoong.yoo at gmail.com
> >>> > > > Status: new
> >>> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
> >>> ket/Display.html?id=81012
> >>> > >
> >>> > > >
> >>> > > >
> >>> > > > Hi,
> >>> > > >
> >>> > > > I would like to compute regional average of a variable
over a
> >>> masked
> >>> > > > region.
> >>> > > > For example, 2m temperature and precipitation over Indiana
state.
> >>> > > > Is it fairly straightforward and fast to use MET for this
> purpose?
> >>> > > >
> >>> > > > I want to generate a time series of the variables in a csv
> format.
> >>> > > > Previously I used NCL and R to do the similar things.
> >>> > > > Please let me know.
> >>> > > > Thank you.
> >>> > > >
> >>> > > > Regards,
> >>> > > >
> >>> > > > Jinwoong Yoo
> >>> > > >
> >>> > > >
> >>> > >
> >>> > >
> >>> >
> >>> >
> >>>
> >>>
> >>
> >
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: Jinwoong Yoo
Time: Tue Jun 27 13:50:10 2017
Hi John,
Thank you very much for your reply.
I ran WRF simulations for one and half month producing hourly outputs.
One APCP is total prec from the initial time of the simulation while
the
other APCP is total precipitation from the previous hour to current
time
step.
I would like to retrieve hourly accumulation of precipitation from the
GRIB2 file using MET.
Not using pcp-combine, can I read the hourly APCP as other variables
in the
MET?
Thank you.
Regards,
Jinwoong
On Tue, Jun 27, 2017 at 3:24 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> It sounds like you're saying that you have a single GRIB2 file which
> contains 2 different runtime accumulations in it. Is that right?
>
> Let's say your file (in.grb2) contains 2 APCP, one for 0-24 and a
second
> for 0-30 hours. You can just pass the same file to pcp_combine
twice,
> requesting different accumulation intervals:
>
> pcp_combine -subtract in.grb2 30 in.grb2 24 apcp_24_30.nc
>
> John
>
> On Tue, Jun 27, 2017 at 1:17 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> >
> > Hi John,
> >
> > Regarding the two APCP variables available in on GRIB2 file,
> > How can I retrieve the runtime accumulation of precipitation
specifically
> > between them in the MET?
> > I would like to do this because I can retrieve APCP using only one
file.
> > Do I need to convert the variable to netcdf?
> > Thank you.
> > Regards,
> >
> > Jinwoong
> >
> > On Mon, Jun 26, 2017 at 4:55 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > wrote:
> >
> > > Hi John,
> > >
> > > I figured out the source of error in my config file.
> > > Please ignore my previous question.
> > > Thank you.
> > >
> > > Regards,
> > >
> > > Jinwoong
> > >
> > > On Mon, Jun 26, 2017 at 4:32 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > > wrote:
> > >
> > >> Hi John,
> > >>
> > >> File formats of my obs datasets are netcdf and hdf5, not grib.
> > >> In particular, one netcdf file contains 99 years observations.
> > >> Which part in the config file should I modify to run Grid-Stat
against
> > >> the netcdf file for different time stamp?
> > >>
> > >>
> > >> By the way,
> > >> when I testing a Gird-Stat using my config file, I got error as
below:
> > >>
> > >> DEBUG 1: Default Config File: /home/yoo108/met-6.0_bugfix/sh
> > >> are/met/config/GridStatConfig_default
> > >>
> > >> DEBUG 1: User Config File: GridStatConfig_T2hourly
> > >>
> > >> ERROR : yyerror() -> syntax error in file
"GridStatConfig_T2hourly"
> > >>
> > >> ERROR : line = 107
> > >>
> > >> ERROR : column = 1
> > >>
> > >> ERROR : text = "climo_mean"
> > >>
> > >> ERROR : climo_mean = {
> > >>
> > >> ERROR : ^^^^^^^^^^____
> > >>
> > >> I don't have any clue what is wrong.
> > >> Actually I don't need any from the section.
> > >> Thank you.
> > >> Regards,
> > >>
> > >> Jinwoong
> > >>
> > >> On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT <
> > >> met_help at ucar.edu> wrote:
> > >>
> > >>> Jinwoong,
> > >>>
> > >>> While the MET tools must be run once to evaluate each time
> separately,
> > >>> they
> > >>> do include some time filtering options which may prevent you
from
> > having
> > >>> to
> > >>> do a lot of reformatting.
> > >>>
> > >>> For example, suppose you have a GRIB file which contains many
output
> > >>> times. There are options in the MET config file so that you
can
> > specify
> > >>> which time you want to process.
> > >>>
> > >>> Ultimately, it comes down to the details. As long as your
data is in
> > >>> format that MET can read, it may already do what you'd like to
do.
> > >>>
> > >>> Thanks,
> > >>> John
> > >>>
> > >>> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT <
> > met_help at ucar.edu
> > >>> >
> > >>> wrote:
> > >>>
> > >>> >
> > >>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> > >>> >
> > >>> > Hi John,
> > >>> >
> > >>> > Thank you so much again.
> > >>> >
> > >>> > "Do you have observations against which you'd like to
compare your
> > >>> model
> > >>> > output?"
> > >>> > >>> Yes, there are several observations that I would like to
> compare
> > >>> my WRF
> > >>> > outputs with.
> > >>> > MODIS, TRMM, GPM, gridded weather station observation data
by Notre
> > >>> Dame
> > >>> > Univ, to list a few.
> > >>> >
> > >>> > Computing spatial averages over IN is just a simple
postprocessing
> > for
> > >>> > other data consumers in our group.
> > >>> > I would like to explore more what MET can be utilized for as
a core
> > >>> model
> > >>> > verification module.
> > >>> > In particular, I like to see how fast MET can complete the
process
> > >>> compared
> > >>> > to other software.
> > >>> >
> > >>> > Speaking of observation datasets for comparison,
> > >>> > what will be the best practice when it comes to dataset
regrid?
> > >>> > They are in each different coordinate grid.
> > >>> >
> > >>> > How long does it take to regrid on the fly using config file
> -regird
> > >>> > option?
> > >>> > Will it be better to convert every dataset into a common
grid (such
> > as
> > >>> lat
> > >>> > lon) and run Grid-Stat?
> > >>> > It seems MET can process data with only one time step while
my
> > gridded
> > >>> > weather station observation data has 36160 time stamps in
one
> netcdf
> > >>> file.
> > >>> > Should I need to create each individual file for each time
stamp to
> > run
> > >>> > Grid-Stat?
> > >>> > I wish MET can utilize multi-temporal files.
> > >>> >
> > >>> >
> > >>> > Thank you.
> > >>> > Regards,
> > >>> >
> > >>> > Jinwoong
> > >>> >
> > >>> >
> > >>> >
> > >>> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via RT
<
> > >>> > met_help at ucar.edu> wrote:
> > >>> >
> > >>> > > Jinwoong,
> > >>> > >
> > >>> > > Sure, you can use MET to compute a spatial average over
whatever
> > >>> > > sub-regions of your domain that you'd like. If that's
really is
> > the
> > >>> only
> > >>> > > thing you're looking for, then using MET may be overkill.
> > >>> > >
> > >>> > > MET was designed to compute verification scores to assess
how
> well
> > >>> your
> > >>> > > model compares to point observations or gridded analyses.
> > >>> > >
> > >>> > > Do you have observations against which you'd like to
compare your
> > >>> model
> > >>> > > output?
> > >>> > >
> > >>> > > To answer, your specific question, you could...
> > >>> > > (1) Run gen_vx_mask to generate the Indiana masking region
(as we
> > >>> were
> > >>> > > discussing last week).
> > >>> > > (2) Run grid_stat and pass in your model output as both
the
> > forecast
> > >>> and
> > >>> > > observation field.
> > >>> > > (3) Make sure you've configured grid_stat to compute the
> continuous
> > >>> > > statistics (CNT) output line type.
> > >>> > >
> > >>> > > The FBAR column in the CNT line type is simply the average
> forecast
> > >>> value
> > >>> > > in the region you've defined.
> > >>> > >
> > >>> > > Grid-Stat should be run once for each verification time
step. So
> > >>> you'd
> > >>> > use
> > >>> > > a script to loop through your times, and run Grid-Stat
once for
> > each.
> > >>> > >
> > >>> > > The output of Grid-Stat is a space-separated ascii file.
> > >>> > >
> > >>> > > Hope that helps.
> > >>> > >
> > >>> > > John
> > >>> > >
> > >>> > >
> > >>> > >
> > >>> > >
> > >>> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
> > >>> met_help at ucar.edu>
> > >>> > > wrote:
> > >>> > >
> > >>> > > >
> > >>> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted upon.
> > >>> > > > Transaction: Ticket created by jinwoong.yoo at gmail.com
> > >>> > > > Queue: met_help
> > >>> > > > Subject: How to compute spatial average of a
variable
> over a
> > >>> > masked
> > >>> > > > region
> > >>> > > > Owner: Nobody
> > >>> > > > Requestors: jinwoong.yoo at gmail.com
> > >>> > > > Status: new
> > >>> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
> > >>> ket/Display.html?id=81012
> > >>> > >
> > >>> > > >
> > >>> > > >
> > >>> > > > Hi,
> > >>> > > >
> > >>> > > > I would like to compute regional average of a variable
over a
> > >>> masked
> > >>> > > > region.
> > >>> > > > For example, 2m temperature and precipitation over
Indiana
> state.
> > >>> > > > Is it fairly straightforward and fast to use MET for
this
> > purpose?
> > >>> > > >
> > >>> > > > I want to generate a time series of the variables in a
csv
> > format.
> > >>> > > > Previously I used NCL and R to do the similar things.
> > >>> > > > Please let me know.
> > >>> > > > Thank you.
> > >>> > > >
> > >>> > > > Regards,
> > >>> > > >
> > >>> > > > Jinwoong Yoo
> > >>> > > >
> > >>> > > >
> > >>> > >
> > >>> > >
> > >>> >
> > >>> >
> > >>>
> > >>>
> > >>
> > >
> >
> >
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: John Halley Gotway
Time: Tue Jun 27 15:48:45 2017
Jinwoong,
Yes, of course. If you GRIB file already contains hourly precip, just
request it in the MET config file like this:
name = "APCP";
level = "A1";
Setting the level to A1 tells MET to look for a 1-hourly accumulation
in
whatever file you pass to it.
Also, please try increasing the verbosity level when you run the MET
tools
(i.e. try "-v 4"). Then look at the log messages printed to the
screen.
They'll tell you which GRIB record number is being read. And that way
you
can confirm that MET is reading the data you intend.
Thanks,
John
On Tue, Jun 27, 2017 at 1:50 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
>
> Hi John,
>
> Thank you very much for your reply.
> I ran WRF simulations for one and half month producing hourly
outputs.
> One APCP is total prec from the initial time of the simulation while
the
> other APCP is total precipitation from the previous hour to current
time
> step.
>
> I would like to retrieve hourly accumulation of precipitation from
the
> GRIB2 file using MET.
> Not using pcp-combine, can I read the hourly APCP as other variables
in the
> MET?
> Thank you.
>
> Regards,
>
> Jinwoong
>
> On Tue, Jun 27, 2017 at 3:24 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Jinwoong,
> >
> > It sounds like you're saying that you have a single GRIB2 file
which
> > contains 2 different runtime accumulations in it. Is that right?
> >
> > Let's say your file (in.grb2) contains 2 APCP, one for 0-24 and a
second
> > for 0-30 hours. You can just pass the same file to pcp_combine
twice,
> > requesting different accumulation intervals:
> >
> > pcp_combine -subtract in.grb2 30 in.grb2 24 apcp_24_30.nc
> >
> > John
> >
> > On Tue, Jun 27, 2017 at 1:17 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> > >
> > > Hi John,
> > >
> > > Regarding the two APCP variables available in on GRIB2 file,
> > > How can I retrieve the runtime accumulation of precipitation
> specifically
> > > between them in the MET?
> > > I would like to do this because I can retrieve APCP using only
one
> file.
> > > Do I need to convert the variable to netcdf?
> > > Thank you.
> > > Regards,
> > >
> > > Jinwoong
> > >
> > > On Mon, Jun 26, 2017 at 4:55 PM, Jinwoong Yoo
<jinwoong.yoo at gmail.com>
> > > wrote:
> > >
> > > > Hi John,
> > > >
> > > > I figured out the source of error in my config file.
> > > > Please ignore my previous question.
> > > > Thank you.
> > > >
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > > On Mon, Jun 26, 2017 at 4:32 PM, Jinwoong Yoo <
> jinwoong.yoo at gmail.com>
> > > > wrote:
> > > >
> > > >> Hi John,
> > > >>
> > > >> File formats of my obs datasets are netcdf and hdf5, not
grib.
> > > >> In particular, one netcdf file contains 99 years
observations.
> > > >> Which part in the config file should I modify to run Grid-
Stat
> against
> > > >> the netcdf file for different time stamp?
> > > >>
> > > >>
> > > >> By the way,
> > > >> when I testing a Gird-Stat using my config file, I got error
as
> below:
> > > >>
> > > >> DEBUG 1: Default Config File: /home/yoo108/met-6.0_bugfix/sh
> > > >> are/met/config/GridStatConfig_default
> > > >>
> > > >> DEBUG 1: User Config File: GridStatConfig_T2hourly
> > > >>
> > > >> ERROR : yyerror() -> syntax error in file
"GridStatConfig_T2hourly"
> > > >>
> > > >> ERROR : line = 107
> > > >>
> > > >> ERROR : column = 1
> > > >>
> > > >> ERROR : text = "climo_mean"
> > > >>
> > > >> ERROR : climo_mean = {
> > > >>
> > > >> ERROR : ^^^^^^^^^^____
> > > >>
> > > >> I don't have any clue what is wrong.
> > > >> Actually I don't need any from the section.
> > > >> Thank you.
> > > >> Regards,
> > > >>
> > > >> Jinwoong
> > > >>
> > > >> On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >>> Jinwoong,
> > > >>>
> > > >>> While the MET tools must be run once to evaluate each time
> > separately,
> > > >>> they
> > > >>> do include some time filtering options which may prevent you
from
> > > having
> > > >>> to
> > > >>> do a lot of reformatting.
> > > >>>
> > > >>> For example, suppose you have a GRIB file which contains
many
> output
> > > >>> times. There are options in the MET config file so that you
can
> > > specify
> > > >>> which time you want to process.
> > > >>>
> > > >>> Ultimately, it comes down to the details. As long as your
data is
> in
> > > >>> format that MET can read, it may already do what you'd like
to do.
> > > >>>
> > > >>> Thanks,
> > > >>> John
> > > >>>
> > > >>> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT <
> > > met_help at ucar.edu
> > > >>> >
> > > >>> wrote:
> > > >>>
> > > >>> >
> > > >>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> > > >>> >
> > > >>> > Hi John,
> > > >>> >
> > > >>> > Thank you so much again.
> > > >>> >
> > > >>> > "Do you have observations against which you'd like to
compare
> your
> > > >>> model
> > > >>> > output?"
> > > >>> > >>> Yes, there are several observations that I would like
to
> > compare
> > > >>> my WRF
> > > >>> > outputs with.
> > > >>> > MODIS, TRMM, GPM, gridded weather station observation data
by
> Notre
> > > >>> Dame
> > > >>> > Univ, to list a few.
> > > >>> >
> > > >>> > Computing spatial averages over IN is just a simple
> postprocessing
> > > for
> > > >>> > other data consumers in our group.
> > > >>> > I would like to explore more what MET can be utilized for
as a
> core
> > > >>> model
> > > >>> > verification module.
> > > >>> > In particular, I like to see how fast MET can complete the
> process
> > > >>> compared
> > > >>> > to other software.
> > > >>> >
> > > >>> > Speaking of observation datasets for comparison,
> > > >>> > what will be the best practice when it comes to dataset
regrid?
> > > >>> > They are in each different coordinate grid.
> > > >>> >
> > > >>> > How long does it take to regrid on the fly using config
file
> > -regird
> > > >>> > option?
> > > >>> > Will it be better to convert every dataset into a common
grid
> (such
> > > as
> > > >>> lat
> > > >>> > lon) and run Grid-Stat?
> > > >>> > It seems MET can process data with only one time step
while my
> > > gridded
> > > >>> > weather station observation data has 36160 time stamps in
one
> > netcdf
> > > >>> file.
> > > >>> > Should I need to create each individual file for each time
stamp
> to
> > > run
> > > >>> > Grid-Stat?
> > > >>> > I wish MET can utilize multi-temporal files.
> > > >>> >
> > > >>> >
> > > >>> > Thank you.
> > > >>> > Regards,
> > > >>> >
> > > >>> > Jinwoong
> > > >>> >
> > > >>> >
> > > >>> >
> > > >>> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via
RT <
> > > >>> > met_help at ucar.edu> wrote:
> > > >>> >
> > > >>> > > Jinwoong,
> > > >>> > >
> > > >>> > > Sure, you can use MET to compute a spatial average over
> whatever
> > > >>> > > sub-regions of your domain that you'd like. If that's
really
> is
> > > the
> > > >>> only
> > > >>> > > thing you're looking for, then using MET may be
overkill.
> > > >>> > >
> > > >>> > > MET was designed to compute verification scores to
assess how
> > well
> > > >>> your
> > > >>> > > model compares to point observations or gridded
analyses.
> > > >>> > >
> > > >>> > > Do you have observations against which you'd like to
compare
> your
> > > >>> model
> > > >>> > > output?
> > > >>> > >
> > > >>> > > To answer, your specific question, you could...
> > > >>> > > (1) Run gen_vx_mask to generate the Indiana masking
region (as
> we
> > > >>> were
> > > >>> > > discussing last week).
> > > >>> > > (2) Run grid_stat and pass in your model output as both
the
> > > forecast
> > > >>> and
> > > >>> > > observation field.
> > > >>> > > (3) Make sure you've configured grid_stat to compute the
> > continuous
> > > >>> > > statistics (CNT) output line type.
> > > >>> > >
> > > >>> > > The FBAR column in the CNT line type is simply the
average
> > forecast
> > > >>> value
> > > >>> > > in the region you've defined.
> > > >>> > >
> > > >>> > > Grid-Stat should be run once for each verification time
step.
> So
> > > >>> you'd
> > > >>> > use
> > > >>> > > a script to loop through your times, and run Grid-Stat
once for
> > > each.
> > > >>> > >
> > > >>> > > The output of Grid-Stat is a space-separated ascii file.
> > > >>> > >
> > > >>> > > Hope that helps.
> > > >>> > >
> > > >>> > > John
> > > >>> > >
> > > >>> > >
> > > >>> > >
> > > >>> > >
> > > >>> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
> > > >>> met_help at ucar.edu>
> > > >>> > > wrote:
> > > >>> > >
> > > >>> > > >
> > > >>> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted
upon.
> > > >>> > > > Transaction: Ticket created by jinwoong.yoo at gmail.com
> > > >>> > > > Queue: met_help
> > > >>> > > > Subject: How to compute spatial average of a
variable
> > over a
> > > >>> > masked
> > > >>> > > > region
> > > >>> > > > Owner: Nobody
> > > >>> > > > Requestors: jinwoong.yoo at gmail.com
> > > >>> > > > Status: new
> > > >>> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
> > > >>> ket/Display.html?id=81012
> > > >>> > >
> > > >>> > > >
> > > >>> > > >
> > > >>> > > > Hi,
> > > >>> > > >
> > > >>> > > > I would like to compute regional average of a variable
over a
> > > >>> masked
> > > >>> > > > region.
> > > >>> > > > For example, 2m temperature and precipitation over
Indiana
> > state.
> > > >>> > > > Is it fairly straightforward and fast to use MET for
this
> > > purpose?
> > > >>> > > >
> > > >>> > > > I want to generate a time series of the variables in a
csv
> > > format.
> > > >>> > > > Previously I used NCL and R to do the similar things.
> > > >>> > > > Please let me know.
> > > >>> > > > Thank you.
> > > >>> > > >
> > > >>> > > > Regards,
> > > >>> > > >
> > > >>> > > > Jinwoong Yoo
> > > >>> > > >
> > > >>> > > >
> > > >>> > >
> > > >>> > >
> > > >>> >
> > > >>> >
> > > >>>
> > > >>>
> > > >>
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: How to compute spatial average of a variable over a masked region
From: Jinwoong Yoo
Time: Tue Jun 27 18:57:31 2017
Hi John,
Thank you very much for your comments.
Let me try it.
Thank you.
Regards,
Jinwoong
On Tue, Jun 27, 2017 at 5:48 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Jinwoong,
>
> Yes, of course. If you GRIB file already contains hourly precip,
just
> request it in the MET config file like this:
> name = "APCP";
> level = "A1";
>
> Setting the level to A1 tells MET to look for a 1-hourly
accumulation in
> whatever file you pass to it.
>
> Also, please try increasing the verbosity level when you run the MET
tools
> (i.e. try "-v 4"). Then look at the log messages printed to the
screen.
> They'll tell you which GRIB record number is being read. And that
way you
> can confirm that MET is reading the data you intend.
>
> Thanks,
> John
>
> On Tue, Jun 27, 2017 at 1:50 PM, Jinwoong Yoo via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012 >
> >
> > Hi John,
> >
> > Thank you very much for your reply.
> > I ran WRF simulations for one and half month producing hourly
outputs.
> > One APCP is total prec from the initial time of the simulation
while the
> > other APCP is total precipitation from the previous hour to
current time
> > step.
> >
> > I would like to retrieve hourly accumulation of precipitation from
the
> > GRIB2 file using MET.
> > Not using pcp-combine, can I read the hourly APCP as other
variables in
> the
> > MET?
> > Thank you.
> >
> > Regards,
> >
> > Jinwoong
> >
> > On Tue, Jun 27, 2017 at 3:24 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Jinwoong,
> > >
> > > It sounds like you're saying that you have a single GRIB2 file
which
> > > contains 2 different runtime accumulations in it. Is that
right?
> > >
> > > Let's say your file (in.grb2) contains 2 APCP, one for 0-24 and
a
> second
> > > for 0-30 hours. You can just pass the same file to pcp_combine
twice,
> > > requesting different accumulation intervals:
> > >
> > > pcp_combine -subtract in.grb2 30 in.grb2 24 apcp_24_30.nc
> > >
> > > John
> > >
> > > On Tue, Jun 27, 2017 at 1:17 PM, Jinwoong Yoo via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012
>
> > > >
> > > > Hi John,
> > > >
> > > > Regarding the two APCP variables available in on GRIB2 file,
> > > > How can I retrieve the runtime accumulation of precipitation
> > specifically
> > > > between them in the MET?
> > > > I would like to do this because I can retrieve APCP using only
one
> > file.
> > > > Do I need to convert the variable to netcdf?
> > > > Thank you.
> > > > Regards,
> > > >
> > > > Jinwoong
> > > >
> > > > On Mon, Jun 26, 2017 at 4:55 PM, Jinwoong Yoo <
> jinwoong.yoo at gmail.com>
> > > > wrote:
> > > >
> > > > > Hi John,
> > > > >
> > > > > I figured out the source of error in my config file.
> > > > > Please ignore my previous question.
> > > > > Thank you.
> > > > >
> > > > > Regards,
> > > > >
> > > > > Jinwoong
> > > > >
> > > > > On Mon, Jun 26, 2017 at 4:32 PM, Jinwoong Yoo <
> > jinwoong.yoo at gmail.com>
> > > > > wrote:
> > > > >
> > > > >> Hi John,
> > > > >>
> > > > >> File formats of my obs datasets are netcdf and hdf5, not
grib.
> > > > >> In particular, one netcdf file contains 99 years
observations.
> > > > >> Which part in the config file should I modify to run Grid-
Stat
> > against
> > > > >> the netcdf file for different time stamp?
> > > > >>
> > > > >>
> > > > >> By the way,
> > > > >> when I testing a Gird-Stat using my config file, I got
error as
> > below:
> > > > >>
> > > > >> DEBUG 1: Default Config File: /home/yoo108/met-
6.0_bugfix/sh
> > > > >> are/met/config/GridStatConfig_default
> > > > >>
> > > > >> DEBUG 1: User Config File: GridStatConfig_T2hourly
> > > > >>
> > > > >> ERROR : yyerror() -> syntax error in file
> "GridStatConfig_T2hourly"
> > > > >>
> > > > >> ERROR : line = 107
> > > > >>
> > > > >> ERROR : column = 1
> > > > >>
> > > > >> ERROR : text = "climo_mean"
> > > > >>
> > > > >> ERROR : climo_mean = {
> > > > >>
> > > > >> ERROR : ^^^^^^^^^^____
> > > > >>
> > > > >> I don't have any clue what is wrong.
> > > > >> Actually I don't need any from the section.
> > > > >> Thank you.
> > > > >> Regards,
> > > > >>
> > > > >> Jinwoong
> > > > >>
> > > > >> On Mon, Jun 26, 2017 at 1:41 PM, John Halley Gotway via RT
<
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >>> Jinwoong,
> > > > >>>
> > > > >>> While the MET tools must be run once to evaluate each time
> > > separately,
> > > > >>> they
> > > > >>> do include some time filtering options which may prevent
you from
> > > > having
> > > > >>> to
> > > > >>> do a lot of reformatting.
> > > > >>>
> > > > >>> For example, suppose you have a GRIB file which contains
many
> > output
> > > > >>> times. There are options in the MET config file so that
you can
> > > > specify
> > > > >>> which time you want to process.
> > > > >>>
> > > > >>> Ultimately, it comes down to the details. As long as your
data
> is
> > in
> > > > >>> format that MET can read, it may already do what you'd
like to
> do.
> > > > >>>
> > > > >>> Thanks,
> > > > >>> John
> > > > >>>
> > > > >>> On Mon, Jun 26, 2017 at 11:13 AM, Jinwoong Yoo via RT <
> > > > met_help at ucar.edu
> > > > >>> >
> > > > >>> wrote:
> > > > >>>
> > > > >>> >
> > > > >>> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=81012
> >
> > > > >>> >
> > > > >>> > Hi John,
> > > > >>> >
> > > > >>> > Thank you so much again.
> > > > >>> >
> > > > >>> > "Do you have observations against which you'd like to
compare
> > your
> > > > >>> model
> > > > >>> > output?"
> > > > >>> > >>> Yes, there are several observations that I would
like to
> > > compare
> > > > >>> my WRF
> > > > >>> > outputs with.
> > > > >>> > MODIS, TRMM, GPM, gridded weather station observation
data by
> > Notre
> > > > >>> Dame
> > > > >>> > Univ, to list a few.
> > > > >>> >
> > > > >>> > Computing spatial averages over IN is just a simple
> > postprocessing
> > > > for
> > > > >>> > other data consumers in our group.
> > > > >>> > I would like to explore more what MET can be utilized
for as a
> > core
> > > > >>> model
> > > > >>> > verification module.
> > > > >>> > In particular, I like to see how fast MET can complete
the
> > process
> > > > >>> compared
> > > > >>> > to other software.
> > > > >>> >
> > > > >>> > Speaking of observation datasets for comparison,
> > > > >>> > what will be the best practice when it comes to dataset
regrid?
> > > > >>> > They are in each different coordinate grid.
> > > > >>> >
> > > > >>> > How long does it take to regrid on the fly using config
file
> > > -regird
> > > > >>> > option?
> > > > >>> > Will it be better to convert every dataset into a common
grid
> > (such
> > > > as
> > > > >>> lat
> > > > >>> > lon) and run Grid-Stat?
> > > > >>> > It seems MET can process data with only one time step
while my
> > > > gridded
> > > > >>> > weather station observation data has 36160 time stamps
in one
> > > netcdf
> > > > >>> file.
> > > > >>> > Should I need to create each individual file for each
time
> stamp
> > to
> > > > run
> > > > >>> > Grid-Stat?
> > > > >>> > I wish MET can utilize multi-temporal files.
> > > > >>> >
> > > > >>> >
> > > > >>> > Thank you.
> > > > >>> > Regards,
> > > > >>> >
> > > > >>> > Jinwoong
> > > > >>> >
> > > > >>> >
> > > > >>> >
> > > > >>> > On Mon, Jun 26, 2017 at 12:29 PM, John Halley Gotway via
RT <
> > > > >>> > met_help at ucar.edu> wrote:
> > > > >>> >
> > > > >>> > > Jinwoong,
> > > > >>> > >
> > > > >>> > > Sure, you can use MET to compute a spatial average
over
> > whatever
> > > > >>> > > sub-regions of your domain that you'd like. If that's
really
> > is
> > > > the
> > > > >>> only
> > > > >>> > > thing you're looking for, then using MET may be
overkill.
> > > > >>> > >
> > > > >>> > > MET was designed to compute verification scores to
assess how
> > > well
> > > > >>> your
> > > > >>> > > model compares to point observations or gridded
analyses.
> > > > >>> > >
> > > > >>> > > Do you have observations against which you'd like to
compare
> > your
> > > > >>> model
> > > > >>> > > output?
> > > > >>> > >
> > > > >>> > > To answer, your specific question, you could...
> > > > >>> > > (1) Run gen_vx_mask to generate the Indiana masking
region
> (as
> > we
> > > > >>> were
> > > > >>> > > discussing last week).
> > > > >>> > > (2) Run grid_stat and pass in your model output as
both the
> > > > forecast
> > > > >>> and
> > > > >>> > > observation field.
> > > > >>> > > (3) Make sure you've configured grid_stat to compute
the
> > > continuous
> > > > >>> > > statistics (CNT) output line type.
> > > > >>> > >
> > > > >>> > > The FBAR column in the CNT line type is simply the
average
> > > forecast
> > > > >>> value
> > > > >>> > > in the region you've defined.
> > > > >>> > >
> > > > >>> > > Grid-Stat should be run once for each verification
time step.
> > So
> > > > >>> you'd
> > > > >>> > use
> > > > >>> > > a script to loop through your times, and run Grid-Stat
once
> for
> > > > each.
> > > > >>> > >
> > > > >>> > > The output of Grid-Stat is a space-separated ascii
file.
> > > > >>> > >
> > > > >>> > > Hope that helps.
> > > > >>> > >
> > > > >>> > > John
> > > > >>> > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> > > On Mon, Jun 26, 2017 at 9:54 AM, Jinwoong Yoo via RT <
> > > > >>> met_help at ucar.edu>
> > > > >>> > > wrote:
> > > > >>> > >
> > > > >>> > > >
> > > > >>> > > > Mon Jun 26 09:54:33 2017: Request 81012 was acted
upon.
> > > > >>> > > > Transaction: Ticket created by
jinwoong.yoo at gmail.com
> > > > >>> > > > Queue: met_help
> > > > >>> > > > Subject: How to compute spatial average of a
variable
> > > over a
> > > > >>> > masked
> > > > >>> > > > region
> > > > >>> > > > Owner: Nobody
> > > > >>> > > > Requestors: jinwoong.yoo at gmail.com
> > > > >>> > > > Status: new
> > > > >>> > > > Ticket <URL: https://rt.rap.ucar.edu/rt/Tic
> > > > >>> ket/Display.html?id=81012
> > > > >>> > >
> > > > >>> > > >
> > > > >>> > > >
> > > > >>> > > > Hi,
> > > > >>> > > >
> > > > >>> > > > I would like to compute regional average of a
variable
> over a
> > > > >>> masked
> > > > >>> > > > region.
> > > > >>> > > > For example, 2m temperature and precipitation over
Indiana
> > > state.
> > > > >>> > > > Is it fairly straightforward and fast to use MET for
this
> > > > purpose?
> > > > >>> > > >
> > > > >>> > > > I want to generate a time series of the variables in
a csv
> > > > format.
> > > > >>> > > > Previously I used NCL and R to do the similar
things.
> > > > >>> > > > Please let me know.
> > > > >>> > > > Thank you.
> > > > >>> > > >
> > > > >>> > > > Regards,
> > > > >>> > > >
> > > > >>> > > > Jinwoong Yoo
> > > > >>> > > >
> > > > >>> > > >
> > > > >>> > >
> > > > >>> > >
> > > > >>> >
> > > > >>> >
> > > > >>>
> > > > >>>
> > > > >>
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list