[Met_help] [rt.rap.ucar.edu #91698] History for Climatology for AC calculation in MET
John Halley Gotway via RT
met_help at ucar.edu
Thu Aug 29 15:20:53 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I am interested in computing the anomaly correlation for some global FV3 runs. I want to ensure my statistics are as comparable to the real-time EMC page (https://www.emc.ncep.noaa.gov/gmb/STATS_vsdb/g2o/) as possible. I see the obvious reference to VSDB, but do I understand correctly that MET is now the preferred software?
Importantly, are there standard climatologies available on NOAA's Jet/Theia platforms or are they otherwise downloadable from NCAR?
Thanks.
John Henderson
________________________________
This email is intended solely for the recipient. It may contain privileged, proprietary or confidential information or material. If you are not the intended recipient, please delete this email and any attachments and notify the sender of the error.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Climatology for AC calculation in MET
From: John Halley Gotway
Time: Tue Aug 27 12:24:45 2019
Hi John,
Yes, NOAA is still in the process of transitioning from VSDB to MET.
We do
work closely with the global group and there are a couple of pieces of
functionality that we're still adding in to MET to meet their
requirements.
The global group uses 2.5 degree monthly climatological dataset.
Let me digress for a moment and tell you about METplus. That's a set
of
python wrappers that are used to configure and automate calls to the
MET
tools. It's been under development for a couple of years, but one of
the
goals is making NOAA's vx configurations publicly available. We do
have an
existing grid-to-grid use case for NCEP's global vx.
Here's the METplus configuration file for this:
https://github.com/NCAR/METplus/blob/master_v2.2/parm/use_cases/grid_to_grid/examples/anom.conf
And here's the Grid-Stat config file for this use case:
https://github.com/NCAR/METplus/blob/master_v2.2/parm/use_cases/grid_to_grid/met_config/GridStatConfig_anom
Some important details...
- The data is regridded to NCEP Grid 2, the global 2.5 degree grid on
which
the climo lives.
regrid = {
to_grid = "G002";
- It uses the monthly climo mean files which begin with "cmean".
climo_mean = {
file_name = [
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
I realize there's a lot of room to better organize and document this
information, but I think we're headed in the right direction.
But your question is if/where these climo files live on jet and/or
theia.
I have them and can easily share them with you, as we did with NRL.
But I
agree they would ideally be posted publicly on NCEP's website instead.
Let me email NCEP, make sure they don't have any objections, and then
I'll
post them on our anonymous ftp site for now.
Thanks,
John
On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via RT
<met_help at ucar.edu>
wrote:
>
> Tue Aug 27 11:11:19 2019: Request 91698 was acted upon.
> Transaction: Given to johnhg (John Halley Gotway) by bullock
> Queue: met_help
> Subject: Climatology for AC calculation in MET
> Owner: johnhg
> Requestors: jhenders at aer.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91698 >
>
>
> This transaction appears to have no content
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation in MET
From: jhenders at aer.com
Time: Tue Aug 27 13:14:21 2019
Hi again John,
Thanks for the very useful update. I've downloaded METplus for the
first time and am rooting through it right now.
I look forward to a favorable response from NCEP!
Regards,
John
-----Original Message-----
From: "met_help at ucar.edu" <met_help at ucar.edu>
Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
Date: Tuesday, August 27, 2019 at 2:24 PM
To: "Henderson, John" <jhenders at aer.com>
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation
in MET
Hi John,
Yes, NOAA is still in the process of transitioning from VSDB to
MET. We do
work closely with the global group and there are a couple of
pieces of
functionality that we're still adding in to MET to meet their
requirements.
The global group uses 2.5 degree monthly climatological dataset.
Let me digress for a moment and tell you about METplus. That's a
set of
python wrappers that are used to configure and automate calls to
the MET
tools. It's been under development for a couple of years, but one
of the
goals is making NOAA's vx configurations publicly available. We
do have an
existing grid-to-grid use case for NCEP's global vx.
Here's the METplus configuration file for this:
https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-
5Fgrid_examples_anom.conf&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=7mO57jS-JT4zI0_8eqMA6ecU6P8kiOZ6-o4XDszhZDs&e=
And here's the Grid-Stat config file for this use case:
https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-5Fgrid_met-5Fconfig_GridStatConfig-
5Fanom&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=qn5PhbqeFKXASlLrVmhapN8k47gcsX849j4AajBs99I&e=
Some important details...
- The data is regridded to NCEP Grid 2, the global 2.5 degree grid
on which
the climo lives.
regrid = {
to_grid = "G002";
- It uses the monthly climo mean files which begin with "cmean".
climo_mean = {
file_name = [
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
I realize there's a lot of room to better organize and document
this
information, but I think we're headed in the right direction.
But your question is if/where these climo files live on jet and/or
theia.
I have them and can easily share them with you, as we did with
NRL. But I
agree they would ideally be posted publicly on NCEP's website
instead.
Let me email NCEP, make sure they don't have any objections, and
then I'll
post them on our anonymous ftp site for now.
Thanks,
John
On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via RT
<met_help at ucar.edu>
wrote:
>
> Tue Aug 27 11:11:19 2019: Request 91698 was acted upon.
> Transaction: Given to johnhg (John Halley Gotway) by bullock
> Queue: met_help
> Subject: Climatology for AC calculation in MET
> Owner: johnhg
> Requestors: jhenders at aer.com
> Status: new
> Ticket <URL: https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=ELfOug_Zb5D3Zb2Sdrj-gCii1VflXhA7Yl89P-_14XU&e= >
>
>
> This transaction appears to have no content
>
________________________________
This email is intended solely for the recipient. It may contain
privileged, proprietary or confidential information or material. If
you are not the intended recipient, please delete this email and any
attachments and notify the sender of the error.
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation in MET
From: jhenders at aer.com
Time: Tue Aug 27 14:07:44 2019
Hi again John,
It occurred to me that I should also enquire as to the whereabouts of
the verifying analyses that NCEP typically uses. I may be able to
piece together the right files, but I want to make sure. I have access
to HPSS.
Thanks.
John
-----Original Message-----
From: "met_help at ucar.edu" <met_help at ucar.edu>
Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
Date: Tuesday, August 27, 2019 at 2:24 PM
To: "Henderson, John" <jhenders at aer.com>
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC
calculation in MET
Hi John,
Yes, NOAA is still in the process of transitioning from VSDB
to MET. We do
work closely with the global group and there are a couple of
pieces of
functionality that we're still adding in to MET to meet their
requirements.
The global group uses 2.5 degree monthly climatological
dataset.
Let me digress for a moment and tell you about METplus.
That's a set of
python wrappers that are used to configure and automate calls
to the MET
tools. It's been under development for a couple of years, but
one of the
goals is making NOAA's vx configurations publicly available.
We do have an
existing grid-to-grid use case for NCEP's global vx.
Here's the METplus configuration file for this:
https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-
5Fgrid_examples_anom.conf&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=7mO57jS-JT4zI0_8eqMA6ecU6P8kiOZ6-o4XDszhZDs&e=
And here's the Grid-Stat config file for this use case:
https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-5Fgrid_met-5Fconfig_GridStatConfig-
5Fanom&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=qn5PhbqeFKXASlLrVmhapN8k47gcsX849j4AajBs99I&e=
Some important details...
- The data is regridded to NCEP Grid 2, the global 2.5 degree
grid on which
the climo lives.
regrid = {
to_grid = "G002";
- It uses the monthly climo mean files which begin with
"cmean".
climo_mean = {
file_name = [
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
I realize there's a lot of room to better organize and
document this
information, but I think we're headed in the right direction.
But your question is if/where these climo files live on jet
and/or theia.
I have them and can easily share them with you, as we did with
NRL. But I
agree they would ideally be posted publicly on NCEP's website
instead.
Let me email NCEP, make sure they don't have any objections,
and then I'll
post them on our anonymous ftp site for now.
Thanks,
John
On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via RT
<met_help at ucar.edu>
wrote:
>
> Tue Aug 27 11:11:19 2019: Request 91698 was acted upon.
> Transaction: Given to johnhg (John Halley Gotway) by bullock
> Queue: met_help
> Subject: Climatology for AC calculation in MET
> Owner: johnhg
> Requestors: jhenders at aer.com
> Status: new
> Ticket <URL:
https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=ELfOug_Zb5D3Zb2Sdrj-gCii1VflXhA7Yl89P-_14XU&e= >
>
>
> This transaction appears to have no content
>
________________________________
This email is intended solely for the recipient. It may contain
privileged, proprietary or confidential information or material. If
you are not the intended recipient, please delete this email and any
attachments and notify the sender of the error.
------------------------------------------------
Subject: Climatology for AC calculation in MET
From: John Halley Gotway
Time: Wed Aug 28 14:54:12 2019
John,
Yes, I received approval from NCEP to send these climo files to you.
I
also requested that they host this data on their website (or perhaps
NOMADS) so that I can just redirect users there in the future. And
they're
discusses where to host it.
I just posted the following two tarballs to our anonymous ftp site:
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/climo_data/NCEP_2.5deg.tar.gz
(254 Mb)
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/climo_data/NCEP_1.odeg.tar.gz
(4.3 Gb)
The first 2.5 degree tarball contains the monthly climo data they
currently
use operationally, and the 1.0 degree tarball contains daily climo
data
which they consider "experimental".
In the 2.5 degree directory, you'll find some binary files (named in
all
uppercase, like "500UGRD.OCT") and some GRIB files (named in
lowercase,
like "pgba_mean.19591015"). MET uses those GRIB files instead of the
uppercase binary ones. You'll find 12 of them for the climo mean and
12 of
them for the climo standard deviation:
pgba_mean.19590115 and pgba_stdev.19590115 for January
pgba_mean.19590215 and pgba_stdev.19590215 for February
And so on...
The 1.0 degree directory contains only mean and stdev files
(cmean_1d.19791215 and cstdv_1d.19791215) but one for each day instead
of
each month.
In the Grid-Stat, Point-Stat, and Ensemble-Stat config files, you'll
find
an entry for the "climo_mean". If using the 2.5 degree data, you
should
set "match_day = FALSE". If using the 1.0 degree data, you should set
"match_day = TRUE".
Thanks,
John
On Tue, Aug 27, 2019 at 2:08 PM jhenders at aer.com via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91698 >
>
> Hi again John,
>
> It occurred to me that I should also enquire as to the whereabouts
of the
> verifying analyses that NCEP typically uses. I may be able to piece
> together the right files, but I want to make sure. I have access to
HPSS.
>
> Thanks.
>
> John
>
> -----Original Message-----
> From: "met_help at ucar.edu" <met_help at ucar.edu>
> Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
> Date: Tuesday, August 27, 2019 at 2:24 PM
> To: "Henderson, John" <jhenders at aer.com>
> Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC
calculation
> in MET
>
> Hi John,
>
> Yes, NOAA is still in the process of transitioning from VSDB
to
> MET. We do
> work closely with the global group and there are a couple of
> pieces of
> functionality that we're still adding in to MET to meet
their
> requirements.
>
> The global group uses 2.5 degree monthly climatological
dataset.
>
> Let me digress for a moment and tell you about METplus.
That's a
> set of
> python wrappers that are used to configure and automate
calls to
> the MET
> tools. It's been under development for a couple of years,
but one
> of the
> goals is making NOAA's vx configurations publicly available.
We
> do have an
> existing grid-to-grid use case for NCEP's global vx.
>
> Here's the METplus configuration file for this:
>
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-
5Fgrid_examples_anom.conf&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=7mO57jS-JT4zI0_8eqMA6ecU6P8kiOZ6-o4XDszhZDs&e=
>
> And here's the Grid-Stat config file for this use case:
>
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-5Fgrid_met-5Fconfig_GridStatConfig-
5Fanom&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=qn5PhbqeFKXASlLrVmhapN8k47gcsX849j4AajBs99I&e=
>
> Some important details...
> - The data is regridded to NCEP Grid 2, the global 2.5
degree grid
> on which
> the climo lives.
> regrid = {
> to_grid = "G002";
> - It uses the monthly climo mean files which begin with
"cmean".
> climo_mean = {
> file_name = [
>
>
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
>
> I realize there's a lot of room to better organize and
document
> this
> information, but I think we're headed in the right
direction.
>
> But your question is if/where these climo files live on jet
and/or
> theia.
> I have them and can easily share them with you, as we did
with
> NRL. But I
> agree they would ideally be posted publicly on NCEP's
website
> instead.
>
> Let me email NCEP, make sure they don't have any objections,
and
> then I'll
> post them on our anonymous ftp site for now.
>
> Thanks,
> John
>
> On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > Tue Aug 27 11:11:19 2019: Request 91698 was acted upon.
> > Transaction: Given to johnhg (John Halley Gotway) by
bullock
> > Queue: met_help
> > Subject: Climatology for AC calculation in MET
> > Owner: johnhg
> > Requestors: jhenders at aer.com
> > Status: new
> > Ticket <URL:
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=ELfOug_Zb5D3Zb2Sdrj-gCii1VflXhA7Yl89P-_14XU&e=
> >
> >
> >
> > This transaction appears to have no content
> >
>
>
>
>
>
>
> ________________________________
>
> This email is intended solely for the recipient. It may contain
> privileged, proprietary or confidential information or material. If
you are
> not the intended recipient, please delete this email and any
attachments
> and notify the sender of the error.
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation in MET
From: jhenders at aer.com
Time: Wed Aug 28 15:41:36 2019
Hi John,
Great - I have downloaded the first tarball, but the second link
doesn't take me anywhere. Could you please check to see it's good?
Thanks!
John
-----Original Message-----
From: "met_help at ucar.edu" <met_help at ucar.edu>
Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
Date: Wednesday, August 28, 2019 at 4:54 PM
To: "Henderson, John" <jhenders at aer.com>
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation
in MET
John,
Yes, I received approval from NCEP to send these climo files to
you. I
also requested that they host this data on their website (or
perhaps
NOMADS) so that I can just redirect users there in the future.
And they're
discusses where to host it.
I just posted the following two tarballs to our anonymous ftp
site:
https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F2.5deg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--FmWbda6EEBxOMMeU&s=1d-
ID6-ZgKA-sYFX72uHQrPqVRBoHzGYiL4P8jMFn8Q&e=
(254 Mb)
https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F1.odeg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--
FmWbda6EEBxOMMeU&s=B03ZpvF_8Rra7LsOnjAuU3K5qXisg17-asvoVbul0Qs&e=
(4.3 Gb)
The first 2.5 degree tarball contains the monthly climo data they
currently
use operationally, and the 1.0 degree tarball contains daily climo
data
which they consider "experimental".
In the 2.5 degree directory, you'll find some binary files (named
in all
uppercase, like "500UGRD.OCT") and some GRIB files (named in
lowercase,
like "pgba_mean.19591015"). MET uses those GRIB files instead of
the
uppercase binary ones. You'll find 12 of them for the climo mean
and 12 of
them for the climo standard deviation:
pgba_mean.19590115 and pgba_stdev.19590115 for January
pgba_mean.19590215 and pgba_stdev.19590215 for February
And so on...
The 1.0 degree directory contains only mean and stdev files
(cmean_1d.19791215 and cstdv_1d.19791215) but one for each day
instead of
each month.
In the Grid-Stat, Point-Stat, and Ensemble-Stat config files,
you'll find
an entry for the "climo_mean". If using the 2.5 degree data, you
should
set "match_day = FALSE". If using the 1.0 degree data, you should
set
"match_day = TRUE".
Thanks,
John
On Tue, Aug 27, 2019 at 2:08 PM jhenders at aer.com via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--
FmWbda6EEBxOMMeU&s=rizOtSfjKa4t0qARXoxKncNtrJMbkPIuEBCdtmVKGeA&e= >
>
> Hi again John,
>
> It occurred to me that I should also enquire as to the
whereabouts of the
> verifying analyses that NCEP typically uses. I may be able to
piece
> together the right files, but I want to make sure. I have access
to HPSS.
>
> Thanks.
>
> John
>
> -----Original Message-----
> From: "met_help at ucar.edu" <met_help at ucar.edu>
> Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
> Date: Tuesday, August 27, 2019 at 2:24 PM
> To: "Henderson, John" <jhenders at aer.com>
> Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC
calculation
> in MET
>
> Hi John,
>
> Yes, NOAA is still in the process of transitioning from
VSDB to
> MET. We do
> work closely with the global group and there are a
couple of
> pieces of
> functionality that we're still adding in to MET to meet
their
> requirements.
>
> The global group uses 2.5 degree monthly climatological
dataset.
>
> Let me digress for a moment and tell you about METplus.
That's a
> set of
> python wrappers that are used to configure and automate
calls to
> the MET
> tools. It's been under development for a couple of
years, but one
> of the
> goals is making NOAA's vx configurations publicly
available. We
> do have an
> existing grid-to-grid use case for NCEP's global vx.
>
> Here's the METplus configuration file for this:
>
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-
5Fgrid_examples_anom.conf&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=7mO57jS-JT4zI0_8eqMA6ecU6P8kiOZ6-o4XDszhZDs&e=
>
> And here's the Grid-Stat config file for this use case:
>
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-5Fgrid_met-5Fconfig_GridStatConfig-
5Fanom&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=qn5PhbqeFKXASlLrVmhapN8k47gcsX849j4AajBs99I&e=
>
> Some important details...
> - The data is regridded to NCEP Grid 2, the global 2.5
degree grid
> on which
> the climo lives.
> regrid = {
> to_grid = "G002";
> - It uses the monthly climo mean files which begin with
"cmean".
> climo_mean = {
> file_name = [
>
>
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
>
> I realize there's a lot of room to better organize and
document
> this
> information, but I think we're headed in the right
direction.
>
> But your question is if/where these climo files live on
jet and/or
> theia.
> I have them and can easily share them with you, as we
did with
> NRL. But I
> agree they would ideally be posted publicly on NCEP's
website
> instead.
>
> Let me email NCEP, make sure they don't have any
objections, and
> then I'll
> post them on our anonymous ftp site for now.
>
> Thanks,
> John
>
> On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > Tue Aug 27 11:11:19 2019: Request 91698 was acted
upon.
> > Transaction: Given to johnhg (John Halley Gotway) by
bullock
> > Queue: met_help
> > Subject: Climatology for AC calculation in MET
> > Owner: johnhg
> > Requestors: jhenders at aer.com
> > Status: new
> > Ticket <URL:
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=ELfOug_Zb5D3Zb2Sdrj-gCii1VflXhA7Yl89P-_14XU&e=
> >
> >
> >
> > This transaction appears to have no content
> >
>
>
>
>
>
>
> ________________________________
>
> This email is intended solely for the recipient. It may contain
> privileged, proprietary or confidential information or material.
If you are
> not the intended recipient, please delete this email and any
attachments
> and notify the sender of the error.
>
>
>
________________________________
This email is intended solely for the recipient. It may contain
privileged, proprietary or confidential information or material. If
you are not the intended recipient, please delete this email and any
attachments and notify the sender of the error.
------------------------------------------------
Subject: Climatology for AC calculation in MET
From: John Halley Gotway
Time: Wed Aug 28 16:08:53 2019
Interesting, maybe our ftp server is not happy with such a large file.
I
agree that my browser didn't seem to do anything with it, but wget was
able
to retrieve it (or was at least 40% finished pulling it when I clicked
send). Please try this command:
wget
ftp://ftp.rap.ucar.edu/incoming/irap/met_help/climo_data/NCEP_1.0deg.tar.gz
Thanks,
John
On Wed, Aug 28, 2019 at 3:42 PM jhenders at aer.com via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=91698 >
>
> Hi John,
>
> Great - I have downloaded the first tarball, but the second link
doesn't
> take me anywhere. Could you please check to see it's good?
>
> Thanks!
>
> John
>
> -----Original Message-----
> From: "met_help at ucar.edu" <met_help at ucar.edu>
> Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
> Date: Wednesday, August 28, 2019 at 4:54 PM
> To: "Henderson, John" <jhenders at aer.com>
> Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation
in
> MET
>
> John,
>
> Yes, I received approval from NCEP to send these climo files to
you. I
> also requested that they host this data on their website (or
perhaps
> NOMADS) so that I can just redirect users there in the future.
And
> they're
> discusses where to host it.
>
> I just posted the following two tarballs to our anonymous ftp
site:
>
>
> https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F2.5deg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--FmWbda6EEBxOMMeU&s=1d-
ID6-ZgKA-sYFX72uHQrPqVRBoHzGYiL4P8jMFn8Q&e=
> (254 Mb)
>
>
> https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F1.odeg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--
FmWbda6EEBxOMMeU&s=B03ZpvF_8Rra7LsOnjAuU3K5qXisg17-asvoVbul0Qs&e=
> (4.3 Gb)
>
> The first 2.5 degree tarball contains the monthly climo data
they
> currently
> use operationally, and the 1.0 degree tarball contains daily
climo data
> which they consider "experimental".
>
> In the 2.5 degree directory, you'll find some binary files
(named in
> all
> uppercase, like "500UGRD.OCT") and some GRIB files (named in
lowercase,
> like "pgba_mean.19591015"). MET uses those GRIB files instead
of the
> uppercase binary ones. You'll find 12 of them for the climo
mean and
> 12 of
> them for the climo standard deviation:
> pgba_mean.19590115 and pgba_stdev.19590115 for January
> pgba_mean.19590215 and pgba_stdev.19590215 for February
> And so on...
>
> The 1.0 degree directory contains only mean and stdev files
> (cmean_1d.19791215 and cstdv_1d.19791215) but one for each day
instead
> of
> each month.
>
> In the Grid-Stat, Point-Stat, and Ensemble-Stat config files,
you'll
> find
> an entry for the "climo_mean". If using the 2.5 degree data,
you
> should
> set "match_day = FALSE". If using the 1.0 degree data, you
should set
> "match_day = TRUE".
>
> Thanks,
> John
>
> On Tue, Aug 27, 2019 at 2:08 PM jhenders at aer.com via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL:
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--
FmWbda6EEBxOMMeU&s=rizOtSfjKa4t0qARXoxKncNtrJMbkPIuEBCdtmVKGeA&e=
> >
> >
> > Hi again John,
> >
> > It occurred to me that I should also enquire as to the
whereabouts
> of the
> > verifying analyses that NCEP typically uses. I may be able to
piece
> > together the right files, but I want to make sure. I have
access to
> HPSS.
> >
> > Thanks.
> >
> > John
> >
> > -----Original Message-----
> > From: "met_help at ucar.edu" <met_help at ucar.edu>
> > Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
> > Date: Tuesday, August 27, 2019 at 2:24 PM
> > To: "Henderson, John" <jhenders at aer.com>
> > Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC
> calculation
> > in MET
> >
> > Hi John,
> >
> > Yes, NOAA is still in the process of transitioning
from VSDB
> to
> > MET. We do
> > work closely with the global group and there are a
couple of
> > pieces of
> > functionality that we're still adding in to MET to
meet their
> > requirements.
> >
> > The global group uses 2.5 degree monthly
climatological
> dataset.
> >
> > Let me digress for a moment and tell you about
METplus.
> That's a
> > set of
> > python wrappers that are used to configure and
automate
> calls to
> > the MET
> > tools. It's been under development for a couple of
years,
> but one
> > of the
> > goals is making NOAA's vx configurations publicly
> available. We
> > do have an
> > existing grid-to-grid use case for NCEP's global vx.
> >
> > Here's the METplus configuration file for this:
> >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-
5Fgrid_examples_anom.conf&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=7mO57jS-JT4zI0_8eqMA6ecU6P8kiOZ6-o4XDszhZDs&e=
> >
> > And here's the Grid-Stat config file for this use
case:
> >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-5Fgrid_met-5Fconfig_GridStatConfig-
5Fanom&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=qn5PhbqeFKXASlLrVmhapN8k47gcsX849j4AajBs99I&e=
> >
> > Some important details...
> > - The data is regridded to NCEP Grid 2, the global 2.5
> degree grid
> > on which
> > the climo lives.
> > regrid = {
> > to_grid = "G002";
> > - It uses the monthly climo mean files which begin
with
> "cmean".
> > climo_mean = {
> > file_name = [
> >
> >
>
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
> >
> > I realize there's a lot of room to better organize and
> document
> > this
> > information, but I think we're headed in the right
direction.
> >
> > But your question is if/where these climo files live
on jet
> and/or
> > theia.
> > I have them and can easily share them with you, as we
did
> with
> > NRL. But I
> > agree they would ideally be posted publicly on NCEP's
website
> > instead.
> >
> > Let me email NCEP, make sure they don't have any
objections,
> and
> > then I'll
> > post them on our anonymous ftp site for now.
> >
> > Thanks,
> > John
> >
> > On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via RT
<
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Tue Aug 27 11:11:19 2019: Request 91698 was acted
upon.
> > > Transaction: Given to johnhg (John Halley Gotway) by
> bullock
> > > Queue: met_help
> > > Subject: Climatology for AC calculation in MET
> > > Owner: johnhg
> > > Requestors: jhenders at aer.com
> > > Status: new
> > > Ticket <URL:
> >
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=ELfOug_Zb5D3Zb2Sdrj-gCii1VflXhA7Yl89P-_14XU&e=
> > >
> > >
> > >
> > > This transaction appears to have no content
> > >
> >
> >
> >
> >
> >
> >
> > ________________________________
> >
> > This email is intended solely for the recipient. It may
contain
> > privileged, proprietary or confidential information or
material. If
> you are
> > not the intended recipient, please delete this email and any
> attachments
> > and notify the sender of the error.
> >
> >
> >
>
>
>
>
> ________________________________
>
> This email is intended solely for the recipient. It may contain
> privileged, proprietary or confidential information or material. If
you are
> not the intended recipient, please delete this email and any
attachments
> and notify the sender of the error.
>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation in MET
From: jhenders at aer.com
Time: Thu Aug 29 14:42:37 2019
Thanks - the browser link also worked this morning just fine.
John
-----Original Message-----
From: "met_help at ucar.edu" <met_help at ucar.edu>
Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
Date: Wednesday, August 28, 2019 at 6:08 PM
To: "Henderson, John" <jhenders at aer.com>
Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC calculation
in MET
Interesting, maybe our ftp server is not happy with such a large
file. I
agree that my browser didn't seem to do anything with it, but wget
was able
to retrieve it (or was at least 40% finished pulling it when I
clicked
send). Please try this command:
wget
https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F1.0deg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=js8DVlciyOAa1d9A3VTiKVIRhqh7Eoe2nN7KQDLygW4&s=fbFOhkgwIMqRN1t5KR1TUhPIPOQjqtRlbFY9ihRY-
ig&e=
Thanks,
John
On Wed, Aug 28, 2019 at 3:42 PM jhenders at aer.com via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=js8DVlciyOAa1d9A3VTiKVIRhqh7Eoe2nN7KQDLygW4&s=5OGAUyg9AO3377W9JT9UIAw5S7Czz9QeR7DT_t7pc1o&e=
>
>
> Hi John,
>
> Great - I have downloaded the first tarball, but the second link
doesn't
> take me anywhere. Could you please check to see it's good?
>
> Thanks!
>
> John
>
> -----Original Message-----
> From: "met_help at ucar.edu" <met_help at ucar.edu>
> Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
> Date: Wednesday, August 28, 2019 at 4:54 PM
> To: "Henderson, John" <jhenders at aer.com>
> Subject: Re: [rt.rap.ucar.edu #91698] Climatology for AC
calculation in
> MET
>
> John,
>
> Yes, I received approval from NCEP to send these climo files
to you. I
> also requested that they host this data on their website (or
perhaps
> NOMADS) so that I can just redirect users there in the
future. And
> they're
> discusses where to host it.
>
> I just posted the following two tarballs to our anonymous
ftp site:
>
>
> https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F2.5deg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--FmWbda6EEBxOMMeU&s=1d-
ID6-ZgKA-sYFX72uHQrPqVRBoHzGYiL4P8jMFn8Q&e=
> (254 Mb)
>
>
> https://urldefense.proofpoint.com/v2/url?u=ftp-
3A__ftp.rap.ucar.edu_incoming_irap_met-5Fhelp_climo-5Fdata_NCEP-
5F1.odeg.tar.gz&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--
FmWbda6EEBxOMMeU&s=B03ZpvF_8Rra7LsOnjAuU3K5qXisg17-asvoVbul0Qs&e=
> (4.3 Gb)
>
> The first 2.5 degree tarball contains the monthly climo data
they
> currently
> use operationally, and the 1.0 degree tarball contains daily
climo data
> which they consider "experimental".
>
> In the 2.5 degree directory, you'll find some binary files
(named in
> all
> uppercase, like "500UGRD.OCT") and some GRIB files (named in
lowercase,
> like "pgba_mean.19591015"). MET uses those GRIB files
instead of the
> uppercase binary ones. You'll find 12 of them for the climo
mean and
> 12 of
> them for the climo standard deviation:
> pgba_mean.19590115 and pgba_stdev.19590115 for January
> pgba_mean.19590215 and pgba_stdev.19590215 for February
> And so on...
>
> The 1.0 degree directory contains only mean and stdev files
> (cmean_1d.19791215 and cstdv_1d.19791215) but one for each
day instead
> of
> each month.
>
> In the Grid-Stat, Point-Stat, and Ensemble-Stat config
files, you'll
> find
> an entry for the "climo_mean". If using the 2.5 degree
data, you
> should
> set "match_day = FALSE". If using the 1.0 degree data, you
should set
> "match_day = TRUE".
>
> Thanks,
> John
>
> On Tue, Aug 27, 2019 at 2:08 PM jhenders at aer.com via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL:
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=eOXftyC-aS-NQSOLkSPZDmQL5--
FmWbda6EEBxOMMeU&s=rizOtSfjKa4t0qARXoxKncNtrJMbkPIuEBCdtmVKGeA&e=
> >
> >
> > Hi again John,
> >
> > It occurred to me that I should also enquire as to the
whereabouts
> of the
> > verifying analyses that NCEP typically uses. I may be able
to piece
> > together the right files, but I want to make sure. I have
access to
> HPSS.
> >
> > Thanks.
> >
> > John
> >
> > -----Original Message-----
> > From: "met_help at ucar.edu" <met_help at ucar.edu>
> > Reply-To: "met_help at ucar.edu" <met_help at ucar.edu>
> > Date: Tuesday, August 27, 2019 at 2:24 PM
> > To: "Henderson, John" <jhenders at aer.com>
> > Subject: Re: [rt.rap.ucar.edu #91698] Climatology for
AC
> calculation
> > in MET
> >
> > Hi John,
> >
> > Yes, NOAA is still in the process of transitioning
from VSDB
> to
> > MET. We do
> > work closely with the global group and there are a
couple of
> > pieces of
> > functionality that we're still adding in to MET to
meet their
> > requirements.
> >
> > The global group uses 2.5 degree monthly
climatological
> dataset.
> >
> > Let me digress for a moment and tell you about
METplus.
> That's a
> > set of
> > python wrappers that are used to configure and
automate
> calls to
> > the MET
> > tools. It's been under development for a couple
of years,
> but one
> > of the
> > goals is making NOAA's vx configurations publicly
> available. We
> > do have an
> > existing grid-to-grid use case for NCEP's global
vx.
> >
> > Here's the METplus configuration file for this:
> >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-
5Fgrid_examples_anom.conf&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=7mO57jS-JT4zI0_8eqMA6ecU6P8kiOZ6-o4XDszhZDs&e=
> >
> > And here's the Grid-Stat config file for this use
case:
> >
> >
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__github.com_NCAR_METplus_blob_master-5Fv2.2_parm_use-5Fcases_grid-
5Fto-5Fgrid_met-5Fconfig_GridStatConfig-
5Fanom&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=qn5PhbqeFKXASlLrVmhapN8k47gcsX849j4AajBs99I&e=
> >
> > Some important details...
> > - The data is regridded to NCEP Grid 2, the global
2.5
> degree grid
> > on which
> > the climo lives.
> > regrid = {
> > to_grid = "G002";
> > - It uses the monthly climo mean files which begin
with
> "cmean".
> > climo_mean = {
> > file_name = [
> >
> >
>
"${INPUT_BASE}/grid_to_grid/nwprod/fix/cmean_1d.1959${MET_VALID_HHMM}"
];
> >
> > I realize there's a lot of room to better organize
and
> document
> > this
> > information, but I think we're headed in the right
direction.
> >
> > But your question is if/where these climo files
live on jet
> and/or
> > theia.
> > I have them and can easily share them with you, as
we did
> with
> > NRL. But I
> > agree they would ideally be posted publicly on
NCEP's website
> > instead.
> >
> > Let me email NCEP, make sure they don't have any
objections,
> and
> > then I'll
> > post them on our anonymous ftp site for now.
> >
> > Thanks,
> > John
> >
> > On Tue, Aug 27, 2019 at 11:17 AM Randy Bullock via
RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > >
> > > Tue Aug 27 11:11:19 2019: Request 91698 was
acted upon.
> > > Transaction: Given to johnhg (John Halley
Gotway) by
> bullock
> > > Queue: met_help
> > > Subject: Climatology for AC calculation in
MET
> > > Owner: johnhg
> > > Requestors: jhenders at aer.com
> > > Status: new
> > > Ticket <URL:
> >
> https://urldefense.proofpoint.com/v2/url?u=https-
3A__rt.rap.ucar.edu_rt_Ticket_Display.html-3Fid-
3D91698&d=DwIDaQ&c=birp9sjcGzT9DCP3EIAtLA&r=cwsO3u-
EzDa8rEVrli7TzQ&m=bDW5WXzQRloWFhwN3jxfNbL0NRE3mc7EW7sf34S-
WfQ&s=ELfOug_Zb5D3Zb2Sdrj-gCii1VflXhA7Yl89P-_14XU&e=
> > >
> > >
> > >
> > > This transaction appears to have no content
> > >
> >
> >
> >
> >
> >
> >
> > ________________________________
> >
> > This email is intended solely for the recipient. It may
contain
> > privileged, proprietary or confidential information or
material. If
> you are
> > not the intended recipient, please delete this email and
any
> attachments
> > and notify the sender of the error.
> >
> >
> >
>
>
>
>
> ________________________________
>
> This email is intended solely for the recipient. It may contain
> privileged, proprietary or confidential information or material.
If you are
> not the intended recipient, please delete this email and any
attachments
> and notify the sender of the error.
>
>
>
________________________________
This email is intended solely for the recipient. It may contain
privileged, proprietary or confidential information or material. If
you are not the intended recipient, please delete this email and any
attachments and notify the sender of the error.
------------------------------------------------
More information about the Met_help
mailing list