[Met_help] [rt.rap.ucar.edu #84180] History for regrid_data_plane
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:03:52 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
I have a quick question for you about the "regrid_data_plane" MET tool. I tried using it to regrid a GFS file to a Stage IV file so that I can plot the differences in APCPsfc between the two. When I tried to use the tool, I received an error message:
regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012_APCPsfc ST4.2018021112.24h regridded.nc -field 'name="APCP"; level="A24";'
DEBUG 1: Reading data file: gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012_APCPsfc
ERROR :
ERROR : out of memory! Exiting!
ERROR :
Do you know why I am getting the "out of memory" error?
Thanks,
Tracey
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: regrid_data_plane
From: John Halley Gotway
Time: Fri Feb 23 12:29:35 2018
Tracey,
I used your email to create a new met-help ticket.
Hmm, sounds suspicious! I'd like to replicate this issue if possible.
Can you send me
(https://dtcenter.org/met/users/support/met_help.php#ftp) or point me
to sample files on theia? I'd like to see both the gfs file and the
ST4.
Also, on what machine are you running the tool? And what version of
MET are you running?
FYI, if you ultimately want to see a difference field, using grid_stat
is another option. You could run grid_stat to compare GFS to ST4,
configure it to use regrid.to_grid = OBS, and then make sure the
nc_pairs_flag.diff = true. Then the difference field will show up in
the NetCDF matched pairs output file.
Thanks,
John
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Fri Feb 23 12:45:11 2018
Hi John,
Thanks for your quick response. I've transferred the files from WCOSS
over
to Theia now located
in
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain_Feb9_12_2018.
The version of MET on WCOSS should be the latest, v6.1.
I'd like to be able to plot the differences in GrADS since I have my
own
color schemes that I'd like to apply to it. Best case scenario would
be if
I could regrid the GFS file to Stage IV grid into another GRIB2 file
(instead of a NetCDF file), but I'm not sure there's a way to do that.
Do I type the commands under "Windows FTP client" into my terminal?
It's
been a while since I submitted something to https://dtcenter.org/met/
users/support/met_help.php#ftp.
Thanks,
Tracey
On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Tracey,
>
> I used your email to create a new met-help ticket.
>
> Hmm, sounds suspicious! I'd like to replicate this issue if
possible.
> Can you send me
(https://dtcenter.org/met/users/support/met_help.php#ftp)
> or point me to sample files on theia? I'd like to see both the gfs
file
> and the ST4.
>
> Also, on what machine are you running the tool? And what version of
MET
> are you running?
>
> FYI, if you ultimately want to see a difference field, using
grid_stat is
> another option. You could run grid_stat to compare GFS to ST4,
configure
> it to use regrid.to_grid = OBS, and then make sure the
nc_pairs_flag.diff =
> true. Then the difference field will show up in the NetCDF matched
pairs
> output file.
>
> Thanks,
> John
>
>
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
Subject: regrid_data_plane
From: Julie Prestopnik
Time: Fri Feb 23 12:49:08 2018
Hi Tracey. Can you please tell me what you used to access METv6.1 on
WCOSS?
For example,
module use ?
module load met/6.1
Can you also please tell me which WCOSS machine you were using?
Thank you!
Julie
On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
>
> Hi John,
>
> Thanks for your quick response. I've transferred the files from
WCOSS over
> to Theia now located
> in /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> Rain_Feb9_12_2018.
> The version of MET on WCOSS should be the latest, v6.1.
>
> I'd like to be able to plot the differences in GrADS since I have my
own
> color schemes that I'd like to apply to it. Best case scenario
would be if
> I could regrid the GFS file to Stage IV grid into another GRIB2 file
> (instead of a NetCDF file), but I'm not sure there's a way to do
that.
>
> Do I type the commands under "Windows FTP client" into my terminal?
It's
> been a while since I submitted something to
https://dtcenter.org/met/
> users/support/met_help.php#ftp.
>
> Thanks,
> Tracey
>
> On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Tracey,
> >
> > I used your email to create a new met-help ticket.
> >
> > Hmm, sounds suspicious! I'd like to replicate this issue if
possible.
> > Can you send me
(https://dtcenter.org/met/users/support/met_help.php#ftp
> )
> > or point me to sample files on theia? I'd like to see both the
gfs file
> > and the ST4.
> >
> > Also, on what machine are you running the tool? And what version
of MET
> > are you running?
> >
> > FYI, if you ultimately want to see a difference field, using
grid_stat is
> > another option. You could run grid_stat to compare GFS to ST4,
configure
> > it to use regrid.to_grid = OBS, and then make sure the
> nc_pairs_flag.diff =
> > true. Then the difference field will show up in the NetCDF
matched pairs
> > output file.
> >
> > Thanks,
> > John
> >
> >
> >
>
>
> --
> Tracey Dorian
> NOAA/NCEP/EMC
> IMSG contractor
> 5830 University Research Court
> College Park, MD 20740
>
>
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Fri Feb 23 12:53:43 2018
Hi Julie,
I have the following in my .cshrc file in my home directory on Tide.
module use /usrx/local/dev/modulefiles
module load met
So I assume this defaults to v6.1, but I'm not 100% sure.
Thanks,
Tracey
On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Tracey. Can you please tell me what you used to access METv6.1
on
> WCOSS?
>
> For example,
>
> module use ?
> module load met/6.1
>
> Can you also please tell me which WCOSS machine you were using?
>
> Thank you!
>
> Julie
>
> On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >
> > Hi John,
> >
> > Thanks for your quick response. I've transferred the files from
WCOSS
> over
> > to Theia now located
> > in /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> > Rain_Feb9_12_2018.
> > The version of MET on WCOSS should be the latest, v6.1.
> >
> > I'd like to be able to plot the differences in GrADS since I have
my own
> > color schemes that I'd like to apply to it. Best case scenario
would be
> if
> > I could regrid the GFS file to Stage IV grid into another GRIB2
file
> > (instead of a NetCDF file), but I'm not sure there's a way to do
that.
> >
> > Do I type the commands under "Windows FTP client" into my
terminal? It's
> > been a while since I submitted something to
https://dtcenter.org/met/
> > users/support/met_help.php#ftp.
> >
> > Thanks,
> > Tracey
> >
> > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Tracey,
> > >
> > > I used your email to create a new met-help ticket.
> > >
> > > Hmm, sounds suspicious! I'd like to replicate this issue if
possible.
> > > Can you send me (https://dtcenter.org/met/
> users/support/met_help.php#ftp
> > )
> > > or point me to sample files on theia? I'd like to see both the
gfs
> file
> > > and the ST4.
> > >
> > > Also, on what machine are you running the tool? And what
version of
> MET
> > > are you running?
> > >
> > > FYI, if you ultimately want to see a difference field, using
grid_stat
> is
> > > another option. You could run grid_stat to compare GFS to ST4,
> configure
> > > it to use regrid.to_grid = OBS, and then make sure the
> > nc_pairs_flag.diff =
> > > true. Then the difference field will show up in the NetCDF
matched
> pairs
> > > output file.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > >
> >
> >
> > --
> > Tracey Dorian
> > NOAA/NCEP/EMC
> > IMSG contractor
> > 5830 University Research Court
> > College Park, MD 20740
> >
> >
>
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
Subject: regrid_data_plane
From: John Halley Gotway
Time: Fri Feb 23 13:16:11 2018
Hi Tracey,
When I run your command on theia, it works fine. So it's likely due
to how
MET is installed on WCOSS.
Another MET developer, Julie Prestopnik, recalls seeing this behavior
before. It was caused by building MET and it's external libraries
using
inconsistent flags. This cause the processing of GRIB2 files to run
out of
memory.
She has access to WCOSS and will test this out on Monday.
Here's the commands I ran on theia:
module use /contrib/modulefiles
module load met/6.1
cd
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain_Feb9_12_2018
regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012_APCPsfc
ST4.2018021112.24h ~/regridded.nc -field 'name="APCP"; level="A06";'
-method BUDGET -width 2
*BUT* notice that the GFS file doesn't have 24-hourly precip, only
6-hourly. And I switched from the default nearest neighbor interp to
use
budget interpolation.
Thanks,
John
On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
>
> Hi Julie,
>
> I have the following in my .cshrc file in my home directory on Tide.
>
> module use /usrx/local/dev/modulefiles
> module load met
>
> So I assume this defaults to v6.1, but I'm not 100% sure.
>
> Thanks,
> Tracey
>
> On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Tracey. Can you please tell me what you used to access METv6.1
on
> > WCOSS?
> >
> > For example,
> >
> > module use ?
> > module load met/6.1
> >
> > Can you also please tell me which WCOSS machine you were using?
> >
> > Thank you!
> >
> > Julie
> >
> > On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > >
> > > Hi John,
> > >
> > > Thanks for your quick response. I've transferred the files from
WCOSS
> > over
> > > to Theia now located
> > > in /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> > > Rain_Feb9_12_2018.
> > > The version of MET on WCOSS should be the latest, v6.1.
> > >
> > > I'd like to be able to plot the differences in GrADS since I
have my
> own
> > > color schemes that I'd like to apply to it. Best case scenario
would
> be
> > if
> > > I could regrid the GFS file to Stage IV grid into another GRIB2
file
> > > (instead of a NetCDF file), but I'm not sure there's a way to do
that.
> > >
> > > Do I type the commands under "Windows FTP client" into my
terminal?
> It's
> > > been a while since I submitted something to
https://dtcenter.org/met/
> > > users/support/met_help.php#ftp.
> > >
> > > Thanks,
> > > Tracey
> > >
> > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Tracey,
> > > >
> > > > I used your email to create a new met-help ticket.
> > > >
> > > > Hmm, sounds suspicious! I'd like to replicate this issue if
> possible.
> > > > Can you send me (https://dtcenter.org/met/
> > users/support/met_help.php#ftp
> > > )
> > > > or point me to sample files on theia? I'd like to see both
the gfs
> > file
> > > > and the ST4.
> > > >
> > > > Also, on what machine are you running the tool? And what
version of
> > MET
> > > > are you running?
> > > >
> > > > FYI, if you ultimately want to see a difference field, using
> grid_stat
> > is
> > > > another option. You could run grid_stat to compare GFS to
ST4,
> > configure
> > > > it to use regrid.to_grid = OBS, and then make sure the
> > > nc_pairs_flag.diff =
> > > > true. Then the difference field will show up in the NetCDF
matched
> > pairs
> > > > output file.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Tracey Dorian
> > > NOAA/NCEP/EMC
> > > IMSG contractor
> > > 5830 University Research Court
> > > College Park, MD 20740
> > >
> > >
> >
> >
>
>
> --
> Tracey Dorian
> NOAA/NCEP/EMC
> IMSG contractor
> 5830 University Research Court
> College Park, MD 20740
>
>
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Fri Feb 23 13:22:18 2018
Thanks very much John for testing this. I just ran it myself on Theia
it
worked fine. I did just realize the difference in accumulation
amounts.
Is there a way to use the regrid_data_plane tool to sum four 6-hourly
GFS
files to create a 24-hour accumulation file to then regrid to Stage
IV?
Thanks,
Tracey
On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Hi Tracey,
>
> When I run your command on theia, it works fine. So it's likely due
to how
> MET is installed on WCOSS.
>
> Another MET developer, Julie Prestopnik, recalls seeing this
behavior
> before. It was caused by building MET and it's external libraries
using
> inconsistent flags. This cause the processing of GRIB2 files to run
out of
> memory.
>
> She has access to WCOSS and will test this out on Monday.
>
> Here's the commands I ran on theia:
>
> module use /contrib/modulefiles
> module load met/6.1
> cd /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> Rain_Feb9_12_2018
> regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012_APCPsfc
> ST4.2018021112.24h ~/regridded.nc -field 'name="APCP"; level="A06";'
> -method BUDGET -width 2
>
> *BUT* notice that the GFS file doesn't have 24-hourly precip, only
> 6-hourly. And I switched from the default nearest neighbor interp
to use
> budget interpolation.
>
> Thanks,
> John
>
> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >
> > Hi Julie,
> >
> > I have the following in my .cshrc file in my home directory on
Tide.
> >
> > module use /usrx/local/dev/modulefiles
> > module load met
> >
> > So I assume this defaults to v6.1, but I'm not 100% sure.
> >
> > Thanks,
> > Tracey
> >
> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Hi Tracey. Can you please tell me what you used to access
METv6.1 on
> > > WCOSS?
> > >
> > > For example,
> > >
> > > module use ?
> > > module load met/6.1
> > >
> > > Can you also please tell me which WCOSS machine you were using?
> > >
> > > Thank you!
> > >
> > > Julie
> > >
> > > On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov via RT
<
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
>
> > > >
> > > > Hi John,
> > > >
> > > > Thanks for your quick response. I've transferred the files
from
> WCOSS
> > > over
> > > > to Theia now located
> > > > in /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> > > > Rain_Feb9_12_2018.
> > > > The version of MET on WCOSS should be the latest, v6.1.
> > > >
> > > > I'd like to be able to plot the differences in GrADS since I
have my
> > own
> > > > color schemes that I'd like to apply to it. Best case
scenario would
> > be
> > > if
> > > > I could regrid the GFS file to Stage IV grid into another
GRIB2 file
> > > > (instead of a NetCDF file), but I'm not sure there's a way to
do
> that.
> > > >
> > > > Do I type the commands under "Windows FTP client" into my
terminal?
> > It's
> > > > been a while since I submitted something to
> https://dtcenter.org/met/
> > > > users/support/met_help.php#ftp.
> > > >
> > > > Thanks,
> > > > Tracey
> > > >
> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Tracey,
> > > > >
> > > > > I used your email to create a new met-help ticket.
> > > > >
> > > > > Hmm, sounds suspicious! I'd like to replicate this issue if
> > possible.
> > > > > Can you send me (https://dtcenter.org/met/
> > > users/support/met_help.php#ftp
> > > > )
> > > > > or point me to sample files on theia? I'd like to see both
the gfs
> > > file
> > > > > and the ST4.
> > > > >
> > > > > Also, on what machine are you running the tool? And what
version
> of
> > > MET
> > > > > are you running?
> > > > >
> > > > > FYI, if you ultimately want to see a difference field, using
> > grid_stat
> > > is
> > > > > another option. You could run grid_stat to compare GFS to
ST4,
> > > configure
> > > > > it to use regrid.to_grid = OBS, and then make sure the
> > > > nc_pairs_flag.diff =
> > > > > true. Then the difference field will show up in the NetCDF
matched
> > > pairs
> > > > > output file.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Tracey Dorian
> > > > NOAA/NCEP/EMC
> > > > IMSG contractor
> > > > 5830 University Research Court
> > > > College Park, MD 20740
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Tracey Dorian
> > NOAA/NCEP/EMC
> > IMSG contractor
> > 5830 University Research Court
> > College Park, MD 20740
> >
> >
>
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Fri Feb 23 13:23:28 2018
Also could you please explain what the width part of the command does?
I
see this online:
The -width n option overrides the default regridding width. Default is
1
But I'm still a little bit confused what this means.
Thanks!
Tracey
On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA Affiliate <
tracey.dorian at noaa.gov> wrote:
> Thanks very much John for testing this. I just ran it myself on
Theia it
> worked fine. I did just realize the difference in accumulation
amounts.
> Is there a way to use the regrid_data_plane tool to sum four 6-
hourly GFS
> files to create a 24-hour accumulation file to then regrid to Stage
IV?
>
> Thanks,
> Tracey
>
> On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Hi Tracey,
>>
>> When I run your command on theia, it works fine. So it's likely
due to
>> how
>> MET is installed on WCOSS.
>>
>> Another MET developer, Julie Prestopnik, recalls seeing this
behavior
>> before. It was caused by building MET and it's external libraries
using
>> inconsistent flags. This cause the processing of GRIB2 files to
run out
>> of
>> memory.
>>
>> She has access to WCOSS and will test this out on Monday.
>>
>> Here's the commands I ran on theia:
>>
>> module use /contrib/modulefiles
>> module load met/6.1
>> cd /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain
>> _Feb9_12_2018
>> regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
>> <(201)%20802-1012>_APCPsfc
>> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc -field
>> 'name="APCP"; level="A06";'
>> -method BUDGET -width 2
>>
>> *BUT* notice that the GFS file doesn't have 24-hourly precip, only
>> 6-hourly. And I switched from the default nearest neighbor interp
to use
>> budget interpolation.
>>
>> Thanks,
>> John
>>
>> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov via RT <
>> met_help at ucar.edu> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
>> >
>> > Hi Julie,
>> >
>> > I have the following in my .cshrc file in my home directory on
Tide.
>> >
>> > module use /usrx/local/dev/modulefiles
>> > module load met
>> >
>> > So I assume this defaults to v6.1, but I'm not 100% sure.
>> >
>> > Thanks,
>> > Tracey
>> >
>> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT <
>> > met_help at ucar.edu>
>> > wrote:
>> >
>> > > Hi Tracey. Can you please tell me what you used to access
METv6.1 on
>> > > WCOSS?
>> > >
>> > > For example,
>> > >
>> > > module use ?
>> > > module load met/6.1
>> > >
>> > > Can you also please tell me which WCOSS machine you were using?
>> > >
>> > > Thank you!
>> > >
>> > > Julie
>> > >
>> > > On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov via RT
<
>> > > met_help at ucar.edu> wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
>
>> > > >
>> > > > Hi John,
>> > > >
>> > > > Thanks for your quick response. I've transferred the files
from
>> WCOSS
>> > > over
>> > > > to Theia now located
>> > > > in /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
>> > > > Rain_Feb9_12_2018.
>> > > > The version of MET on WCOSS should be the latest, v6.1.
>> > > >
>> > > > I'd like to be able to plot the differences in GrADS since I
have my
>> > own
>> > > > color schemes that I'd like to apply to it. Best case
scenario
>> would
>> > be
>> > > if
>> > > > I could regrid the GFS file to Stage IV grid into another
GRIB2 file
>> > > > (instead of a NetCDF file), but I'm not sure there's a way to
do
>> that.
>> > > >
>> > > > Do I type the commands under "Windows FTP client" into my
terminal?
>> > It's
>> > > > been a while since I submitted something to
>> https://dtcenter.org/met/
>> > > > users/support/met_help.php#ftp.
>> > > >
>> > > > Thanks,
>> > > > Tracey
>> > > >
>> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > > Tracey,
>> > > > >
>> > > > > I used your email to create a new met-help ticket.
>> > > > >
>> > > > > Hmm, sounds suspicious! I'd like to replicate this issue
if
>> > possible.
>> > > > > Can you send me (https://dtcenter.org/met/
>> > > users/support/met_help.php#ftp
>> > > > )
>> > > > > or point me to sample files on theia? I'd like to see both
the
>> gfs
>> > > file
>> > > > > and the ST4.
>> > > > >
>> > > > > Also, on what machine are you running the tool? And what
version
>> of
>> > > MET
>> > > > > are you running?
>> > > > >
>> > > > > FYI, if you ultimately want to see a difference field,
using
>> > grid_stat
>> > > is
>> > > > > another option. You could run grid_stat to compare GFS to
ST4,
>> > > configure
>> > > > > it to use regrid.to_grid = OBS, and then make sure the
>> > > > nc_pairs_flag.diff =
>> > > > > true. Then the difference field will show up in the NetCDF
>> matched
>> > > pairs
>> > > > > output file.
>> > > > >
>> > > > > Thanks,
>> > > > > John
>> > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > > > --
>> > > > Tracey Dorian
>> > > > NOAA/NCEP/EMC
>> > > > IMSG contractor
>> > > > 5830 University Research Court
>> > > > College Park, MD 20740
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>> > --
>> > Tracey Dorian
>> > NOAA/NCEP/EMC
>> > IMSG contractor
>> > 5830 University Research Court
>> > College Park, MD 20740
>> >
>> >
>>
>>
>
>
> --
> Tracey Dorian
> NOAA/NCEP/EMC
> IMSG contractor
> 5830 University Research Court
> College Park, MD 20740
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
Subject: regrid_data_plane
From: John Halley Gotway
Time: Fri Feb 23 13:40:49 2018
Tracey,
No, you'd use the pcp_combine tool to get a 24-hour accumulation:
# Using the -add option
pcp_combine -add gfs.t12z.pgrb2.0p25.f006_Cycle_2018021012 6
gfs.t12z.pgrb2.0p25.f012_Cycle_2018021012 6
gfs.t12z.pgrb2.0p25.f018_Cycle_2018021012 6
gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012 6 ~/add_apcp_24.nc
# Or you could use the -sum option instead
pcp_combine -sum 20180210_12 6 20180211_12 24 ~/sum_APCP_24.nc
They do the same thing but with different arguments.
# And then you'd regrid the output
regrid_data_plane ~/sum_APCP_24.nc ST4.2018021112.24h
~/sum_APCP_24_regrid.nc -field 'name="APCP_24"; level="(*,*)"; '
-method
BUDGET -width 2
For budget interpolation, you'd always using a regridding with of 2
(i.e. a
2x2 box)... just like with bilinear interpolation, you'd also use
width = 2.
The default for regrid_data_plane is nearest neighbor (i.e. width =
1).
John
On Fri, Feb 23, 2018 at 1:23 PM, tracey.dorian at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
>
> Also could you please explain what the width part of the command
does? I
> see this online:
>
> The -width n option overrides the default regridding width. Default
is 1
>
> But I'm still a little bit confused what this means.
>
> Thanks!
> Tracey
>
> On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA Affiliate <
> tracey.dorian at noaa.gov> wrote:
>
> > Thanks very much John for testing this. I just ran it myself on
Theia it
> > worked fine. I did just realize the difference in accumulation
amounts.
> > Is there a way to use the regrid_data_plane tool to sum four 6-
hourly GFS
> > files to create a 24-hour accumulation file to then regrid to
Stage IV?
> >
> > Thanks,
> > Tracey
> >
> > On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Hi Tracey,
> >>
> >> When I run your command on theia, it works fine. So it's likely
due to
> >> how
> >> MET is installed on WCOSS.
> >>
> >> Another MET developer, Julie Prestopnik, recalls seeing this
behavior
> >> before. It was caused by building MET and it's external
libraries using
> >> inconsistent flags. This cause the processing of GRIB2 files to
run out
> >> of
> >> memory.
> >>
> >> She has access to WCOSS and will test this out on Monday.
> >>
> >> Here's the commands I ran on theia:
> >>
> >> module use /contrib/modulefiles
> >> module load met/6.1
> >> cd /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain
> >> _Feb9_12_2018
> >> regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
> >> <(201)%20802-1012>_APCPsfc
> >> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc -field
> >> 'name="APCP"; level="A06";'
> >> -method BUDGET -width 2
> >>
> >> *BUT* notice that the GFS file doesn't have 24-hourly precip,
only
> >> 6-hourly. And I switched from the default nearest neighbor
interp to
> use
> >> budget interpolation.
> >>
> >> Thanks,
> >> John
> >>
> >> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov via RT <
> >> met_help at ucar.edu> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >> >
> >> > Hi Julie,
> >> >
> >> > I have the following in my .cshrc file in my home directory on
Tide.
> >> >
> >> > module use /usrx/local/dev/modulefiles
> >> > module load met
> >> >
> >> > So I assume this defaults to v6.1, but I'm not 100% sure.
> >> >
> >> > Thanks,
> >> > Tracey
> >> >
> >> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT <
> >> > met_help at ucar.edu>
> >> > wrote:
> >> >
> >> > > Hi Tracey. Can you please tell me what you used to access
METv6.1
> on
> >> > > WCOSS?
> >> > >
> >> > > For example,
> >> > >
> >> > > module use ?
> >> > > module load met/6.1
> >> > >
> >> > > Can you also please tell me which WCOSS machine you were
using?
> >> > >
> >> > > Thank you!
> >> > >
> >> > > Julie
> >> > >
> >> > > On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov via
RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >> > > >
> >> > > > Hi John,
> >> > > >
> >> > > > Thanks for your quick response. I've transferred the files
from
> >> WCOSS
> >> > > over
> >> > > > to Theia now located
> >> > > > in /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> >> > > > Rain_Feb9_12_2018.
> >> > > > The version of MET on WCOSS should be the latest, v6.1.
> >> > > >
> >> > > > I'd like to be able to plot the differences in GrADS since
I have
> my
> >> > own
> >> > > > color schemes that I'd like to apply to it. Best case
scenario
> >> would
> >> > be
> >> > > if
> >> > > > I could regrid the GFS file to Stage IV grid into another
GRIB2
> file
> >> > > > (instead of a NetCDF file), but I'm not sure there's a way
to do
> >> that.
> >> > > >
> >> > > > Do I type the commands under "Windows FTP client" into my
> terminal?
> >> > It's
> >> > > > been a while since I submitted something to
> >> https://dtcenter.org/met/
> >> > > > users/support/met_help.php#ftp.
> >> > > >
> >> > > > Thanks,
> >> > > > Tracey
> >> > > >
> >> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via RT
<
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > > Tracey,
> >> > > > >
> >> > > > > I used your email to create a new met-help ticket.
> >> > > > >
> >> > > > > Hmm, sounds suspicious! I'd like to replicate this issue
if
> >> > possible.
> >> > > > > Can you send me (https://dtcenter.org/met/
> >> > > users/support/met_help.php#ftp
> >> > > > )
> >> > > > > or point me to sample files on theia? I'd like to see
both the
> >> gfs
> >> > > file
> >> > > > > and the ST4.
> >> > > > >
> >> > > > > Also, on what machine are you running the tool? And what
> version
> >> of
> >> > > MET
> >> > > > > are you running?
> >> > > > >
> >> > > > > FYI, if you ultimately want to see a difference field,
using
> >> > grid_stat
> >> > > is
> >> > > > > another option. You could run grid_stat to compare GFS
to ST4,
> >> > > configure
> >> > > > > it to use regrid.to_grid = OBS, and then make sure the
> >> > > > nc_pairs_flag.diff =
> >> > > > > true. Then the difference field will show up in the
NetCDF
> >> matched
> >> > > pairs
> >> > > > > output file.
> >> > > > >
> >> > > > > Thanks,
> >> > > > > John
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > > > --
> >> > > > Tracey Dorian
> >> > > > NOAA/NCEP/EMC
> >> > > > IMSG contractor
> >> > > > 5830 University Research Court
> >> > > > College Park, MD 20740
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> >
> >> > --
> >> > Tracey Dorian
> >> > NOAA/NCEP/EMC
> >> > IMSG contractor
> >> > 5830 University Research Court
> >> > College Park, MD 20740
> >> >
> >> >
> >>
> >>
> >
> >
> > --
> > Tracey Dorian
> > NOAA/NCEP/EMC
> > IMSG contractor
> > 5830 University Research Court
> > College Park, MD 20740
> >
>
>
>
> --
> Tracey Dorian
> NOAA/NCEP/EMC
> IMSG contractor
> 5830 University Research Court
> College Park, MD 20740
>
>
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Fri Feb 23 14:32:24 2018
John,
Great, thanks very much for your help! For now I will just use Theia
to do
any regridding to Stage IV.
Thanks,
Tracey
On Fri, Feb 23, 2018 at 3:40 PM, John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Tracey,
>
> No, you'd use the pcp_combine tool to get a 24-hour accumulation:
>
> # Using the -add option
> pcp_combine -add gfs.t12z.pgrb2.0p25.f006_Cycle_2018021012 6
> gfs.t12z.pgrb2.0p25.f012_Cycle_2018021012 6
> gfs.t12z.pgrb2.0p25.f018_Cycle_2018021012 6
> gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012 6 ~/add_apcp_24.nc
>
> # Or you could use the -sum option instead
> pcp_combine -sum 20180210_12 6 20180211_12 24 ~/sum_APCP_24.nc
>
> They do the same thing but with different arguments.
>
> # And then you'd regrid the output
> regrid_data_plane ~/sum_APCP_24.nc ST4.2018021112.24h
> ~/sum_APCP_24_regrid.nc -field 'name="APCP_24"; level="(*,*)"; '
-method
> BUDGET -width 2
>
> For budget interpolation, you'd always using a regridding with of 2
(i.e. a
> 2x2 box)... just like with bilinear interpolation, you'd also use
width =
> 2.
>
> The default for regrid_data_plane is nearest neighbor (i.e. width =
1).
>
> John
>
>
>
> On Fri, Feb 23, 2018 at 1:23 PM, tracey.dorian at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >
> > Also could you please explain what the width part of the command
does? I
> > see this online:
> >
> > The -width n option overrides the default regridding width.
Default is 1
> >
> > But I'm still a little bit confused what this means.
> >
> > Thanks!
> > Tracey
> >
> > On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA Affiliate <
> > tracey.dorian at noaa.gov> wrote:
> >
> > > Thanks very much John for testing this. I just ran it myself on
Theia
> it
> > > worked fine. I did just realize the difference in accumulation
> amounts.
> > > Is there a way to use the regrid_data_plane tool to sum four 6-
hourly
> GFS
> > > files to create a 24-hour accumulation file to then regrid to
Stage IV?
> > >
> > > Thanks,
> > > Tracey
> > >
> > > On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Hi Tracey,
> > >>
> > >> When I run your command on theia, it works fine. So it's
likely due
> to
> > >> how
> > >> MET is installed on WCOSS.
> > >>
> > >> Another MET developer, Julie Prestopnik, recalls seeing this
behavior
> > >> before. It was caused by building MET and it's external
libraries
> using
> > >> inconsistent flags. This cause the processing of GRIB2 files
to run
> out
> > >> of
> > >> memory.
> > >>
> > >> She has access to WCOSS and will test this out on Monday.
> > >>
> > >> Here's the commands I ran on theia:
> > >>
> > >> module use /contrib/modulefiles
> > >> module load met/6.1
> > >> cd /scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain
> > >> _Feb9_12_2018
> > >> regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
> > >> <(201)%20802-1012>_APCPsfc
> > >> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc -field
> > >> 'name="APCP"; level="A06";'
> > >> -method BUDGET -width 2
> > >>
> > >> *BUT* notice that the GFS file doesn't have 24-hourly precip,
only
> > >> 6-hourly. And I switched from the default nearest neighbor
interp to
> > use
> > >> budget interpolation.
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov via RT
<
> > >> met_help at ucar.edu> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
>
> > >> >
> > >> > Hi Julie,
> > >> >
> > >> > I have the following in my .cshrc file in my home directory
on Tide.
> > >> >
> > >> > module use /usrx/local/dev/modulefiles
> > >> > module load met
> > >> >
> > >> > So I assume this defaults to v6.1, but I'm not 100% sure.
> > >> >
> > >> > Thanks,
> > >> > Tracey
> > >> >
> > >> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT <
> > >> > met_help at ucar.edu>
> > >> > wrote:
> > >> >
> > >> > > Hi Tracey. Can you please tell me what you used to access
METv6.1
> > on
> > >> > > WCOSS?
> > >> > >
> > >> > > For example,
> > >> > >
> > >> > > module use ?
> > >> > > module load met/6.1
> > >> > >
> > >> > > Can you also please tell me which WCOSS machine you were
using?
> > >> > >
> > >> > > Thank you!
> > >> > >
> > >> > > Julie
> > >> > >
> > >> > > On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov
via RT <
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > >> > > >
> > >> > > > Hi John,
> > >> > > >
> > >> > > > Thanks for your quick response. I've transferred the
files from
> > >> WCOSS
> > >> > > over
> > >> > > > to Theia now located
> > >> > > > in
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> > >> > > > Rain_Feb9_12_2018.
> > >> > > > The version of MET on WCOSS should be the latest, v6.1.
> > >> > > >
> > >> > > > I'd like to be able to plot the differences in GrADS
since I
> have
> > my
> > >> > own
> > >> > > > color schemes that I'd like to apply to it. Best case
scenario
> > >> would
> > >> > be
> > >> > > if
> > >> > > > I could regrid the GFS file to Stage IV grid into another
GRIB2
> > file
> > >> > > > (instead of a NetCDF file), but I'm not sure there's a
way to do
> > >> that.
> > >> > > >
> > >> > > > Do I type the commands under "Windows FTP client" into my
> > terminal?
> > >> > It's
> > >> > > > been a while since I submitted something to
> > >> https://dtcenter.org/met/
> > >> > > > users/support/met_help.php#ftp.
> > >> > > >
> > >> > > > Thanks,
> > >> > > > Tracey
> > >> > > >
> > >> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via
RT <
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > > Tracey,
> > >> > > > >
> > >> > > > > I used your email to create a new met-help ticket.
> > >> > > > >
> > >> > > > > Hmm, sounds suspicious! I'd like to replicate this
issue if
> > >> > possible.
> > >> > > > > Can you send me (https://dtcenter.org/met/
> > >> > > users/support/met_help.php#ftp
> > >> > > > )
> > >> > > > > or point me to sample files on theia? I'd like to see
both
> the
> > >> gfs
> > >> > > file
> > >> > > > > and the ST4.
> > >> > > > >
> > >> > > > > Also, on what machine are you running the tool? And
what
> > version
> > >> of
> > >> > > MET
> > >> > > > > are you running?
> > >> > > > >
> > >> > > > > FYI, if you ultimately want to see a difference field,
using
> > >> > grid_stat
> > >> > > is
> > >> > > > > another option. You could run grid_stat to compare GFS
to
> ST4,
> > >> > > configure
> > >> > > > > it to use regrid.to_grid = OBS, and then make sure the
> > >> > > > nc_pairs_flag.diff =
> > >> > > > > true. Then the difference field will show up in the
NetCDF
> > >> matched
> > >> > > pairs
> > >> > > > > output file.
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > John
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > > > --
> > >> > > > Tracey Dorian
> > >> > > > NOAA/NCEP/EMC
> > >> > > > IMSG contractor
> > >> > > > 5830 University Research Court
> > >> > > > College Park, MD 20740
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> > Tracey Dorian
> > >> > NOAA/NCEP/EMC
> > >> > IMSG contractor
> > >> > 5830 University Research Court
> > >> > College Park, MD 20740
> > >> >
> > >> >
> > >>
> > >>
> > >
> > >
> > > --
> > > Tracey Dorian
> > > NOAA/NCEP/EMC
> > > IMSG contractor
> > > 5830 University Research Court
> > > College Park, MD 20740
> > >
> >
> >
> >
> > --
> > Tracey Dorian
> > NOAA/NCEP/EMC
> > IMSG contractor
> > 5830 University Research Court
> > College Park, MD 20740
> >
> >
>
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
Subject: regrid_data_plane
From: Julie Prestopnik
Time: Sat Feb 24 09:03:53 2018
Hi Tracey.
It looks like there was a problem with the IBM installation in
/usrx/local/dev/ for met/6.1 caused by building MET and it's external
libraries using inconsistent flags. I have submitted a helpdesk
ticket for
the issue.
In the meantime if you would prefer to work on WCOSS, you can run:
module use /global/noscrub/Julie.Prestopnik/modulefiles
module load met/6.1
which is my own local installation which shouldn't have this problem.
If
it does, I can fix it myself, but I expect it to work ok.
Please let us know if you have any questions or problems arise.
Julie
On Fri, Feb 23, 2018 at 2:32 PM, tracey.dorian at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
>
> John,
>
> Great, thanks very much for your help! For now I will just use
Theia to do
> any regridding to Stage IV.
>
> Thanks,
> Tracey
>
> On Fri, Feb 23, 2018 at 3:40 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Tracey,
> >
> > No, you'd use the pcp_combine tool to get a 24-hour accumulation:
> >
> > # Using the -add option
> > pcp_combine -add gfs.t12z.pgrb2.0p25.f006_Cycle_2018021012 6
> > gfs.t12z.pgrb2.0p25.f012_Cycle_2018021012 6
> > gfs.t12z.pgrb2.0p25.f018_Cycle_2018021012 6
> > gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012 6 ~/add_apcp_24.nc
> >
> > # Or you could use the -sum option instead
> > pcp_combine -sum 20180210_12 6 20180211_12 24 ~/sum_APCP_24.nc
> >
> > They do the same thing but with different arguments.
> >
> > # And then you'd regrid the output
> > regrid_data_plane ~/sum_APCP_24.nc ST4.2018021112.24h
> > ~/sum_APCP_24_regrid.nc -field 'name="APCP_24"; level="(*,*)"; '
-method
> > BUDGET -width 2
> >
> > For budget interpolation, you'd always using a regridding with of
2
> (i.e. a
> > 2x2 box)... just like with bilinear interpolation, you'd also use
width =
> > 2.
> >
> > The default for regrid_data_plane is nearest neighbor (i.e. width
= 1).
> >
> > John
> >
> >
> >
> > On Fri, Feb 23, 2018 at 1:23 PM, tracey.dorian at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > >
> > > Also could you please explain what the width part of the command
> does? I
> > > see this online:
> > >
> > > The -width n option overrides the default regridding width.
Default is
> 1
> > >
> > > But I'm still a little bit confused what this means.
> > >
> > > Thanks!
> > > Tracey
> > >
> > > On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA Affiliate
<
> > > tracey.dorian at noaa.gov> wrote:
> > >
> > > > Thanks very much John for testing this. I just ran it myself
on
> Theia
> > it
> > > > worked fine. I did just realize the difference in
accumulation
> > amounts.
> > > > Is there a way to use the regrid_data_plane tool to sum four
6-hourly
> > GFS
> > > > files to create a 24-hour accumulation file to then regrid to
Stage
> IV?
> > > >
> > > > Thanks,
> > > > Tracey
> > > >
> > > > On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Hi Tracey,
> > > >>
> > > >> When I run your command on theia, it works fine. So it's
likely due
> > to
> > > >> how
> > > >> MET is installed on WCOSS.
> > > >>
> > > >> Another MET developer, Julie Prestopnik, recalls seeing this
> behavior
> > > >> before. It was caused by building MET and it's external
libraries
> > using
> > > >> inconsistent flags. This cause the processing of GRIB2 files
to run
> > out
> > > >> of
> > > >> memory.
> > > >>
> > > >> She has access to WCOSS and will test this out on Monday.
> > > >>
> > > >> Here's the commands I ran on theia:
> > > >>
> > > >> module use /contrib/modulefiles
> > > >> module load met/6.1
> > > >> cd
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain
> > > >> _Feb9_12_2018
> > > >> regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
> > > >> <(201)%20802-1012>_APCPsfc
> > > >> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc -field
> > > >> 'name="APCP"; level="A06";'
> > > >> -method BUDGET -width 2
> > > >>
> > > >> *BUT* notice that the GFS file doesn't have 24-hourly precip,
only
> > > >> 6-hourly. And I switched from the default nearest neighbor
interp
> to
> > > use
> > > >> budget interpolation.
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov via
RT <
> > > >> met_help at ucar.edu> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > > >> >
> > > >> > Hi Julie,
> > > >> >
> > > >> > I have the following in my .cshrc file in my home directory
on
> Tide.
> > > >> >
> > > >> > module use /usrx/local/dev/modulefiles
> > > >> > module load met
> > > >> >
> > > >> > So I assume this defaults to v6.1, but I'm not 100% sure.
> > > >> >
> > > >> > Thanks,
> > > >> > Tracey
> > > >> >
> > > >> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT <
> > > >> > met_help at ucar.edu>
> > > >> > wrote:
> > > >> >
> > > >> > > Hi Tracey. Can you please tell me what you used to
access
> METv6.1
> > > on
> > > >> > > WCOSS?
> > > >> > >
> > > >> > > For example,
> > > >> > >
> > > >> > > module use ?
> > > >> > > module load met/6.1
> > > >> > >
> > > >> > > Can you also please tell me which WCOSS machine you were
using?
> > > >> > >
> > > >> > > Thank you!
> > > >> > >
> > > >> > > Julie
> > > >> > >
> > > >> > > On Fri, Feb 23, 2018 at 12:45 PM, tracey.dorian at noaa.gov
via
> RT <
> > > >> > > met_help at ucar.edu> wrote:
> > > >> > >
> > > >> > > >
> > > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
> >
> > > >> > > >
> > > >> > > > Hi John,
> > > >> > > >
> > > >> > > > Thanks for your quick response. I've transferred the
files
> from
> > > >> WCOSS
> > > >> > > over
> > > >> > > > to Theia now located
> > > >> > > > in
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> > > >> > > > Rain_Feb9_12_2018.
> > > >> > > > The version of MET on WCOSS should be the latest, v6.1.
> > > >> > > >
> > > >> > > > I'd like to be able to plot the differences in GrADS
since I
> > have
> > > my
> > > >> > own
> > > >> > > > color schemes that I'd like to apply to it. Best case
> scenario
> > > >> would
> > > >> > be
> > > >> > > if
> > > >> > > > I could regrid the GFS file to Stage IV grid into
another
> GRIB2
> > > file
> > > >> > > > (instead of a NetCDF file), but I'm not sure there's a
way to
> do
> > > >> that.
> > > >> > > >
> > > >> > > > Do I type the commands under "Windows FTP client" into
my
> > > terminal?
> > > >> > It's
> > > >> > > > been a while since I submitted something to
> > > >> https://dtcenter.org/met/
> > > >> > > > users/support/met_help.php#ftp.
> > > >> > > >
> > > >> > > > Thanks,
> > > >> > > > Tracey
> > > >> > > >
> > > >> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway via
RT <
> > > >> > > > met_help at ucar.edu> wrote:
> > > >> > > >
> > > >> > > > > Tracey,
> > > >> > > > >
> > > >> > > > > I used your email to create a new met-help ticket.
> > > >> > > > >
> > > >> > > > > Hmm, sounds suspicious! I'd like to replicate this
issue if
> > > >> > possible.
> > > >> > > > > Can you send me (https://dtcenter.org/met/
> > > >> > > users/support/met_help.php#ftp
> > > >> > > > )
> > > >> > > > > or point me to sample files on theia? I'd like to
see both
> > the
> > > >> gfs
> > > >> > > file
> > > >> > > > > and the ST4.
> > > >> > > > >
> > > >> > > > > Also, on what machine are you running the tool? And
what
> > > version
> > > >> of
> > > >> > > MET
> > > >> > > > > are you running?
> > > >> > > > >
> > > >> > > > > FYI, if you ultimately want to see a difference
field, using
> > > >> > grid_stat
> > > >> > > is
> > > >> > > > > another option. You could run grid_stat to compare
GFS to
> > ST4,
> > > >> > > configure
> > > >> > > > > it to use regrid.to_grid = OBS, and then make sure
the
> > > >> > > > nc_pairs_flag.diff =
> > > >> > > > > true. Then the difference field will show up in the
NetCDF
> > > >> matched
> > > >> > > pairs
> > > >> > > > > output file.
> > > >> > > > >
> > > >> > > > > Thanks,
> > > >> > > > > John
> > > >> > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > --
> > > >> > > > Tracey Dorian
> > > >> > > > NOAA/NCEP/EMC
> > > >> > > > IMSG contractor
> > > >> > > > 5830 University Research Court
> > > >> > > > College Park, MD 20740
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > Tracey Dorian
> > > >> > NOAA/NCEP/EMC
> > > >> > IMSG contractor
> > > >> > 5830 University Research Court
> > > >> > College Park, MD 20740
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > Tracey Dorian
> > > > NOAA/NCEP/EMC
> > > > IMSG contractor
> > > > 5830 University Research Court
> > > > College Park, MD 20740
> > > >
> > >
> > >
> > >
> > > --
> > > Tracey Dorian
> > > NOAA/NCEP/EMC
> > > IMSG contractor
> > > 5830 University Research Court
> > > College Park, MD 20740
> > >
> > >
> >
> >
>
>
> --
> Tracey Dorian
> NOAA/NCEP/EMC
> IMSG contractor
> 5830 University Research Court
> College Park, MD 20740
>
>
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Mon Feb 26 07:04:56 2018
Hi Julie,
Thanks for your recommendation - I will change my .cshrc file to
include
what you suggested.
Thanks,
Tracey
On Sat, Feb 24, 2018 at 11:03 AM, Julie Prestopnik via RT
<met_help at ucar.edu
> wrote:
> Hi Tracey.
>
> It looks like there was a problem with the IBM installation in
> /usrx/local/dev/ for met/6.1 caused by building MET and it's
external
> libraries using inconsistent flags. I have submitted a helpdesk
ticket for
> the issue.
>
> In the meantime if you would prefer to work on WCOSS, you can run:
>
> module use /global/noscrub/Julie.Prestopnik/modulefiles
> module load met/6.1
>
> which is my own local installation which shouldn't have this
problem. If
> it does, I can fix it myself, but I expect it to work ok.
>
> Please let us know if you have any questions or problems arise.
>
> Julie
>
>
>
>
> On Fri, Feb 23, 2018 at 2:32 PM, tracey.dorian at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >
> > John,
> >
> > Great, thanks very much for your help! For now I will just use
Theia to
> do
> > any regridding to Stage IV.
> >
> > Thanks,
> > Tracey
> >
> > On Fri, Feb 23, 2018 at 3:40 PM, John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Tracey,
> > >
> > > No, you'd use the pcp_combine tool to get a 24-hour
accumulation:
> > >
> > > # Using the -add option
> > > pcp_combine -add gfs.t12z.pgrb2.0p25.f006_Cycle_2018021012 6
> > > gfs.t12z.pgrb2.0p25.f012_Cycle_2018021012 6
> > > gfs.t12z.pgrb2.0p25.f018_Cycle_2018021012 6
> > > gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012 6 ~/add_apcp_24.nc
> > >
> > > # Or you could use the -sum option instead
> > > pcp_combine -sum 20180210_12 6 20180211_12 24 ~/sum_APCP_24.nc
> > >
> > > They do the same thing but with different arguments.
> > >
> > > # And then you'd regrid the output
> > > regrid_data_plane ~/sum_APCP_24.nc ST4.2018021112.24h
> > > ~/sum_APCP_24_regrid.nc -field 'name="APCP_24"; level="(*,*)"; '
> -method
> > > BUDGET -width 2
> > >
> > > For budget interpolation, you'd always using a regridding with
of 2
> > (i.e. a
> > > 2x2 box)... just like with bilinear interpolation, you'd also
use
> width =
> > > 2.
> > >
> > > The default for regrid_data_plane is nearest neighbor (i.e.
width = 1).
> > >
> > > John
> > >
> > >
> > >
> > > On Fri, Feb 23, 2018 at 1:23 PM, tracey.dorian at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
>
> > > >
> > > > Also could you please explain what the width part of the
command
> > does? I
> > > > see this online:
> > > >
> > > > The -width n option overrides the default regridding width.
Default
> is
> > 1
> > > >
> > > > But I'm still a little bit confused what this means.
> > > >
> > > > Thanks!
> > > > Tracey
> > > >
> > > > On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA
Affiliate <
> > > > tracey.dorian at noaa.gov> wrote:
> > > >
> > > > > Thanks very much John for testing this. I just ran it
myself on
> > Theia
> > > it
> > > > > worked fine. I did just realize the difference in
accumulation
> > > amounts.
> > > > > Is there a way to use the regrid_data_plane tool to sum four
> 6-hourly
> > > GFS
> > > > > files to create a 24-hour accumulation file to then regrid
to Stage
> > IV?
> > > > >
> > > > > Thanks,
> > > > > Tracey
> > > > >
> > > > > On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Hi Tracey,
> > > > >>
> > > > >> When I run your command on theia, it works fine. So it's
likely
> due
> > > to
> > > > >> how
> > > > >> MET is installed on WCOSS.
> > > > >>
> > > > >> Another MET developer, Julie Prestopnik, recalls seeing
this
> > behavior
> > > > >> before. It was caused by building MET and it's external
libraries
> > > using
> > > > >> inconsistent flags. This cause the processing of GRIB2
files to
> run
> > > out
> > > > >> of
> > > > >> memory.
> > > > >>
> > > > >> She has access to WCOSS and will test this out on Monday.
> > > > >>
> > > > >> Here's the commands I ran on theia:
> > > > >>
> > > > >> module use /contrib/modulefiles
> > > > >> module load met/6.1
> > > > >> cd
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain
> > > > >> _Feb9_12_2018
> > > > >> regrid_data_plane gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
> > > > >> <(201)%20802-1012>_APCPsfc
> > > > >> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc -field
> > > > >> 'name="APCP"; level="A06";'
> > > > >> -method BUDGET -width 2
> > > > >>
> > > > >> *BUT* notice that the GFS file doesn't have 24-hourly
precip, only
> > > > >> 6-hourly. And I switched from the default nearest neighbor
interp
> > to
> > > > use
> > > > >> budget interpolation.
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov
via RT <
> > > > >> met_help at ucar.edu> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > > > >> >
> > > > >> > Hi Julie,
> > > > >> >
> > > > >> > I have the following in my .cshrc file in my home
directory on
> > Tide.
> > > > >> >
> > > > >> > module use /usrx/local/dev/modulefiles
> > > > >> > module load met
> > > > >> >
> > > > >> > So I assume this defaults to v6.1, but I'm not 100% sure.
> > > > >> >
> > > > >> > Thanks,
> > > > >> > Tracey
> > > > >> >
> > > > >> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via RT
<
> > > > >> > met_help at ucar.edu>
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Hi Tracey. Can you please tell me what you used to
access
> > METv6.1
> > > > on
> > > > >> > > WCOSS?
> > > > >> > >
> > > > >> > > For example,
> > > > >> > >
> > > > >> > > module use ?
> > > > >> > > module load met/6.1
> > > > >> > >
> > > > >> > > Can you also please tell me which WCOSS machine you
were
> using?
> > > > >> > >
> > > > >> > > Thank you!
> > > > >> > >
> > > > >> > > Julie
> > > > >> > >
> > > > >> > > On Fri, Feb 23, 2018 at 12:45 PM,
tracey.dorian at noaa.gov via
> > RT <
> > > > >> > > met_help at ucar.edu> wrote:
> > > > >> > >
> > > > >> > > >
> > > > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=84180
> > >
> > > > >> > > >
> > > > >> > > > Hi John,
> > > > >> > > >
> > > > >> > > > Thanks for your quick response. I've transferred the
files
> > from
> > > > >> WCOSS
> > > > >> > > over
> > > > >> > > > to Theia now located
> > > > >> > > > in
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_
> > > > >> > > > Rain_Feb9_12_2018.
> > > > >> > > > The version of MET on WCOSS should be the latest,
v6.1.
> > > > >> > > >
> > > > >> > > > I'd like to be able to plot the differences in GrADS
since I
> > > have
> > > > my
> > > > >> > own
> > > > >> > > > color schemes that I'd like to apply to it. Best
case
> > scenario
> > > > >> would
> > > > >> > be
> > > > >> > > if
> > > > >> > > > I could regrid the GFS file to Stage IV grid into
another
> > GRIB2
> > > > file
> > > > >> > > > (instead of a NetCDF file), but I'm not sure there's
a way
> to
> > do
> > > > >> that.
> > > > >> > > >
> > > > >> > > > Do I type the commands under "Windows FTP client"
into my
> > > > terminal?
> > > > >> > It's
> > > > >> > > > been a while since I submitted something to
> > > > >> https://dtcenter.org/met/
> > > > >> > > > users/support/met_help.php#ftp.
> > > > >> > > >
> > > > >> > > > Thanks,
> > > > >> > > > Tracey
> > > > >> > > >
> > > > >> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway
via RT <
> > > > >> > > > met_help at ucar.edu> wrote:
> > > > >> > > >
> > > > >> > > > > Tracey,
> > > > >> > > > >
> > > > >> > > > > I used your email to create a new met-help ticket.
> > > > >> > > > >
> > > > >> > > > > Hmm, sounds suspicious! I'd like to replicate this
issue
> if
> > > > >> > possible.
> > > > >> > > > > Can you send me (https://dtcenter.org/met/
> > > > >> > > users/support/met_help.php#ftp
> > > > >> > > > )
> > > > >> > > > > or point me to sample files on theia? I'd like to
see
> both
> > > the
> > > > >> gfs
> > > > >> > > file
> > > > >> > > > > and the ST4.
> > > > >> > > > >
> > > > >> > > > > Also, on what machine are you running the tool?
And what
> > > > version
> > > > >> of
> > > > >> > > MET
> > > > >> > > > > are you running?
> > > > >> > > > >
> > > > >> > > > > FYI, if you ultimately want to see a difference
field,
> using
> > > > >> > grid_stat
> > > > >> > > is
> > > > >> > > > > another option. You could run grid_stat to compare
GFS to
> > > ST4,
> > > > >> > > configure
> > > > >> > > > > it to use regrid.to_grid = OBS, and then make sure
the
> > > > >> > > > nc_pairs_flag.diff =
> > > > >> > > > > true. Then the difference field will show up in
the
> NetCDF
> > > > >> matched
> > > > >> > > pairs
> > > > >> > > > > output file.
> > > > >> > > > >
> > > > >> > > > > Thanks,
> > > > >> > > > > John
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > --
> > > > >> > > > Tracey Dorian
> > > > >> > > > NOAA/NCEP/EMC
> > > > >> > > > IMSG contractor
> > > > >> > > > 5830 University Research Court
> > > > >> > > > College Park, MD 20740
> > > > >> > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> > Tracey Dorian
> > > > >> > NOAA/NCEP/EMC
> > > > >> > IMSG contractor
> > > > >> > 5830 University Research Court
> > > > >> > College Park, MD 20740
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > > --
> > > > > Tracey Dorian
> > > > > NOAA/NCEP/EMC
> > > > > IMSG contractor
> > > > > 5830 University Research Court
> > > > > College Park, MD 20740
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Tracey Dorian
> > > > NOAA/NCEP/EMC
> > > > IMSG contractor
> > > > 5830 University Research Court
> > > > College Park, MD 20740
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Tracey Dorian
> > NOAA/NCEP/EMC
> > IMSG contractor
> > 5830 University Research Court
> > College Park, MD 20740
> >
> >
>
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
Subject: regrid_data_plane
From: Julie Prestopnik
Time: Mon Feb 26 12:11:42 2018
Hi Tracey. Could you please send me the location of this data on
WCOSS?
gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012_APCPsfc
ST4.2018021112.24h
I would like to save this off as a test case.
Thanks!
Julie
On Mon, Feb 26, 2018 at 7:04 AM, tracey.dorian at noaa.gov via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
>
> Hi Julie,
>
> Thanks for your recommendation - I will change my .cshrc file to
include
> what you suggested.
>
> Thanks,
> Tracey
>
> On Sat, Feb 24, 2018 at 11:03 AM, Julie Prestopnik via RT <
> met_help at ucar.edu
> > wrote:
>
> > Hi Tracey.
> >
> > It looks like there was a problem with the IBM installation in
> > /usrx/local/dev/ for met/6.1 caused by building MET and it's
external
> > libraries using inconsistent flags. I have submitted a helpdesk
ticket
> for
> > the issue.
> >
> > In the meantime if you would prefer to work on WCOSS, you can run:
> >
> > module use /global/noscrub/Julie.Prestopnik/modulefiles
> > module load met/6.1
> >
> > which is my own local installation which shouldn't have this
problem. If
> > it does, I can fix it myself, but I expect it to work ok.
> >
> > Please let us know if you have any questions or problems arise.
> >
> > Julie
> >
> >
> >
> >
> > On Fri, Feb 23, 2018 at 2:32 PM, tracey.dorian at noaa.gov via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > >
> > > John,
> > >
> > > Great, thanks very much for your help! For now I will just use
Theia
> to
> > do
> > > any regridding to Stage IV.
> > >
> > > Thanks,
> > > Tracey
> > >
> > > On Fri, Feb 23, 2018 at 3:40 PM, John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Tracey,
> > > >
> > > > No, you'd use the pcp_combine tool to get a 24-hour
accumulation:
> > > >
> > > > # Using the -add option
> > > > pcp_combine -add gfs.t12z.pgrb2.0p25.f006_Cycle_2018021012 6
> > > > gfs.t12z.pgrb2.0p25.f012_Cycle_2018021012 6
> > > > gfs.t12z.pgrb2.0p25.f018_Cycle_2018021012 6
> > > > gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012 6 ~/add_apcp_24.nc
> > > >
> > > > # Or you could use the -sum option instead
> > > > pcp_combine -sum 20180210_12 6 20180211_12 24 ~/sum_APCP_24.nc
> > > >
> > > > They do the same thing but with different arguments.
> > > >
> > > > # And then you'd regrid the output
> > > > regrid_data_plane ~/sum_APCP_24.nc ST4.2018021112.24h
> > > > ~/sum_APCP_24_regrid.nc -field 'name="APCP_24"; level="(*,*)";
'
> > -method
> > > > BUDGET -width 2
> > > >
> > > > For budget interpolation, you'd always using a regridding with
of 2
> > > (i.e. a
> > > > 2x2 box)... just like with bilinear interpolation, you'd also
use
> > width =
> > > > 2.
> > > >
> > > > The default for regrid_data_plane is nearest neighbor (i.e.
width =
> 1).
> > > >
> > > > John
> > > >
> > > >
> > > >
> > > > On Fri, Feb 23, 2018 at 1:23 PM, tracey.dorian at noaa.gov via RT
<
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > > > >
> > > > > Also could you please explain what the width part of the
command
> > > does? I
> > > > > see this online:
> > > > >
> > > > > The -width n option overrides the default regridding width.
Default
> > is
> > > 1
> > > > >
> > > > > But I'm still a little bit confused what this means.
> > > > >
> > > > > Thanks!
> > > > > Tracey
> > > > >
> > > > > On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA
Affiliate <
> > > > > tracey.dorian at noaa.gov> wrote:
> > > > >
> > > > > > Thanks very much John for testing this. I just ran it
myself on
> > > Theia
> > > > it
> > > > > > worked fine. I did just realize the difference in
accumulation
> > > > amounts.
> > > > > > Is there a way to use the regrid_data_plane tool to sum
four
> > 6-hourly
> > > > GFS
> > > > > > files to create a 24-hour accumulation file to then regrid
to
> Stage
> > > IV?
> > > > > >
> > > > > > Thanks,
> > > > > > Tracey
> > > > > >
> > > > > > On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >> Hi Tracey,
> > > > > >>
> > > > > >> When I run your command on theia, it works fine. So it's
likely
> > due
> > > > to
> > > > > >> how
> > > > > >> MET is installed on WCOSS.
> > > > > >>
> > > > > >> Another MET developer, Julie Prestopnik, recalls seeing
this
> > > behavior
> > > > > >> before. It was caused by building MET and it's external
> libraries
> > > > using
> > > > > >> inconsistent flags. This cause the processing of GRIB2
files to
> > run
> > > > out
> > > > > >> of
> > > > > >> memory.
> > > > > >>
> > > > > >> She has access to WCOSS and will test this out on Monday.
> > > > > >>
> > > > > >> Here's the commands I ran on theia:
> > > > > >>
> > > > > >> module use /contrib/modulefiles
> > > > > >> module load met/6.1
> > > > > >> cd
/scratch4/NCEPDEV/global/save/Tracey.Dorian/grads/Heavy_Rain
> > > > > >> _Feb9_12_2018
> > > > > >> regrid_data_plane
gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
> > > > > >> <(201)%20802-1012>_APCPsfc
> > > > > >> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc
-field
> > > > > >> 'name="APCP"; level="A06";'
> > > > > >> -method BUDGET -width 2
> > > > > >>
> > > > > >> *BUT* notice that the GFS file doesn't have 24-hourly
precip,
> only
> > > > > >> 6-hourly. And I switched from the default nearest
neighbor
> interp
> > > to
> > > > > use
> > > > > >> budget interpolation.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> John
> > > > > >>
> > > > > >> On Fri, Feb 23, 2018 at 12:53 PM, tracey.dorian at noaa.gov
via
> RT <
> > > > > >> met_help at ucar.edu> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
> >
> > > > > >> >
> > > > > >> > Hi Julie,
> > > > > >> >
> > > > > >> > I have the following in my .cshrc file in my home
directory on
> > > Tide.
> > > > > >> >
> > > > > >> > module use /usrx/local/dev/modulefiles
> > > > > >> > module load met
> > > > > >> >
> > > > > >> > So I assume this defaults to v6.1, but I'm not 100%
sure.
> > > > > >> >
> > > > > >> > Thanks,
> > > > > >> > Tracey
> > > > > >> >
> > > > > >> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via
RT <
> > > > > >> > met_help at ucar.edu>
> > > > > >> > wrote:
> > > > > >> >
> > > > > >> > > Hi Tracey. Can you please tell me what you used to
access
> > > METv6.1
> > > > > on
> > > > > >> > > WCOSS?
> > > > > >> > >
> > > > > >> > > For example,
> > > > > >> > >
> > > > > >> > > module use ?
> > > > > >> > > module load met/6.1
> > > > > >> > >
> > > > > >> > > Can you also please tell me which WCOSS machine you
were
> > using?
> > > > > >> > >
> > > > > >> > > Thank you!
> > > > > >> > >
> > > > > >> > > Julie
> > > > > >> > >
> > > > > >> > > On Fri, Feb 23, 2018 at 12:45 PM,
tracey.dorian at noaa.gov
> via
> > > RT <
> > > > > >> > > met_help at ucar.edu> wrote:
> > > > > >> > >
> > > > > >> > > >
> > > > > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > Ticket/Display.html?id=84180
> > > >
> > > > > >> > > >
> > > > > >> > > > Hi John,
> > > > > >> > > >
> > > > > >> > > > Thanks for your quick response. I've transferred
the
> files
> > > from
> > > > > >> WCOSS
> > > > > >> > > over
> > > > > >> > > > to Theia now located
> > > > > >> > > > in /scratch4/NCEPDEV/global/save/
> Tracey.Dorian/grads/Heavy_
> > > > > >> > > > Rain_Feb9_12_2018.
> > > > > >> > > > The version of MET on WCOSS should be the latest,
v6.1.
> > > > > >> > > >
> > > > > >> > > > I'd like to be able to plot the differences in
GrADS
> since I
> > > > have
> > > > > my
> > > > > >> > own
> > > > > >> > > > color schemes that I'd like to apply to it. Best
case
> > > scenario
> > > > > >> would
> > > > > >> > be
> > > > > >> > > if
> > > > > >> > > > I could regrid the GFS file to Stage IV grid into
another
> > > GRIB2
> > > > > file
> > > > > >> > > > (instead of a NetCDF file), but I'm not sure
there's a way
> > to
> > > do
> > > > > >> that.
> > > > > >> > > >
> > > > > >> > > > Do I type the commands under "Windows FTP client"
into my
> > > > > terminal?
> > > > > >> > It's
> > > > > >> > > > been a while since I submitted something to
> > > > > >> https://dtcenter.org/met/
> > > > > >> > > > users/support/met_help.php#ftp.
> > > > > >> > > >
> > > > > >> > > > Thanks,
> > > > > >> > > > Tracey
> > > > > >> > > >
> > > > > >> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley Gotway
via
> RT <
> > > > > >> > > > met_help at ucar.edu> wrote:
> > > > > >> > > >
> > > > > >> > > > > Tracey,
> > > > > >> > > > >
> > > > > >> > > > > I used your email to create a new met-help
ticket.
> > > > > >> > > > >
> > > > > >> > > > > Hmm, sounds suspicious! I'd like to replicate
this
> issue
> > if
> > > > > >> > possible.
> > > > > >> > > > > Can you send me (https://dtcenter.org/met/
> > > > > >> > > users/support/met_help.php#ftp
> > > > > >> > > > )
> > > > > >> > > > > or point me to sample files on theia? I'd like
to see
> > both
> > > > the
> > > > > >> gfs
> > > > > >> > > file
> > > > > >> > > > > and the ST4.
> > > > > >> > > > >
> > > > > >> > > > > Also, on what machine are you running the tool?
And
> what
> > > > > version
> > > > > >> of
> > > > > >> > > MET
> > > > > >> > > > > are you running?
> > > > > >> > > > >
> > > > > >> > > > > FYI, if you ultimately want to see a difference
field,
> > using
> > > > > >> > grid_stat
> > > > > >> > > is
> > > > > >> > > > > another option. You could run grid_stat to
compare GFS
> to
> > > > ST4,
> > > > > >> > > configure
> > > > > >> > > > > it to use regrid.to_grid = OBS, and then make
sure the
> > > > > >> > > > nc_pairs_flag.diff =
> > > > > >> > > > > true. Then the difference field will show up in
the
> > NetCDF
> > > > > >> matched
> > > > > >> > > pairs
> > > > > >> > > > > output file.
> > > > > >> > > > >
> > > > > >> > > > > Thanks,
> > > > > >> > > > > John
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > > --
> > > > > >> > > > Tracey Dorian
> > > > > >> > > > NOAA/NCEP/EMC
> > > > > >> > > > IMSG contractor
> > > > > >> > > > 5830 University Research Court
> > > > > >> > > > College Park, MD 20740
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> > --
> > > > > >> > Tracey Dorian
> > > > > >> > NOAA/NCEP/EMC
> > > > > >> > IMSG contractor
> > > > > >> > 5830 University Research Court
> > > > > >> > College Park, MD 20740
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Tracey Dorian
> > > > > > NOAA/NCEP/EMC
> > > > > > IMSG contractor
> > > > > > 5830 University Research Court
> > > > > > College Park, MD 20740
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Tracey Dorian
> > > > > NOAA/NCEP/EMC
> > > > > IMSG contractor
> > > > > 5830 University Research Court
> > > > > College Park, MD 20740
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> > > --
> > > Tracey Dorian
> > > NOAA/NCEP/EMC
> > > IMSG contractor
> > > 5830 University Research Court
> > > College Park, MD 20740
> > >
> > >
> >
> >
>
>
> --
> Tracey Dorian
> NOAA/NCEP/EMC
> IMSG contractor
> 5830 University Research Court
> College Park, MD 20740
>
>
------------------------------------------------
Subject: regrid_data_plane
From: tracey.dorian at noaa.gov
Time: Mon Feb 26 12:30:40 2018
Hi Julie,
Sure, the data I was experimenting with is located
in /global/save/Tracey.Dorian/grads/Heavy_Rain_Feb9_12_2018 on WCOSS
(Tide).
Thanks,
Tracey
On Mon, Feb 26, 2018 at 2:11 PM, Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Tracey. Could you please send me the location of this data on
WCOSS?
>
> gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012_APCPsfc
> ST4.2018021112.24h
>
> I would like to save this off as a test case.
>
> Thanks!
>
> Julie
>
> On Mon, Feb 26, 2018 at 7:04 AM, tracey.dorian at noaa.gov via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> >
> > Hi Julie,
> >
> > Thanks for your recommendation - I will change my .cshrc file to
include
> > what you suggested.
> >
> > Thanks,
> > Tracey
> >
> > On Sat, Feb 24, 2018 at 11:03 AM, Julie Prestopnik via RT <
> > met_help at ucar.edu
> > > wrote:
> >
> > > Hi Tracey.
> > >
> > > It looks like there was a problem with the IBM installation in
> > > /usrx/local/dev/ for met/6.1 caused by building MET and it's
external
> > > libraries using inconsistent flags. I have submitted a helpdesk
ticket
> > for
> > > the issue.
> > >
> > > In the meantime if you would prefer to work on WCOSS, you can
run:
> > >
> > > module use /global/noscrub/Julie.Prestopnik/modulefiles
> > > module load met/6.1
> > >
> > > which is my own local installation which shouldn't have this
problem.
> If
> > > it does, I can fix it myself, but I expect it to work ok.
> > >
> > > Please let us know if you have any questions or problems arise.
> > >
> > > Julie
> > >
> > >
> > >
> > >
> > > On Fri, Feb 23, 2018 at 2:32 PM, tracey.dorian at noaa.gov via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180
>
> > > >
> > > > John,
> > > >
> > > > Great, thanks very much for your help! For now I will just
use Theia
> > to
> > > do
> > > > any regridding to Stage IV.
> > > >
> > > > Thanks,
> > > > Tracey
> > > >
> > > > On Fri, Feb 23, 2018 at 3:40 PM, John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Tracey,
> > > > >
> > > > > No, you'd use the pcp_combine tool to get a 24-hour
accumulation:
> > > > >
> > > > > # Using the -add option
> > > > > pcp_combine -add gfs.t12z.pgrb2.0p25.f006_Cycle_2018021012 6
> > > > > gfs.t12z.pgrb2.0p25.f012_Cycle_2018021012 6
> > > > > gfs.t12z.pgrb2.0p25.f018_Cycle_2018021012 6
> > > > > gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012 6 ~/add_apcp_24.nc
> > > > >
> > > > > # Or you could use the -sum option instead
> > > > > pcp_combine -sum 20180210_12 6 20180211_12 24
~/sum_APCP_24.nc
> > > > >
> > > > > They do the same thing but with different arguments.
> > > > >
> > > > > # And then you'd regrid the output
> > > > > regrid_data_plane ~/sum_APCP_24.nc ST4.2018021112.24h
> > > > > ~/sum_APCP_24_regrid.nc -field 'name="APCP_24";
level="(*,*)"; '
> > > -method
> > > > > BUDGET -width 2
> > > > >
> > > > > For budget interpolation, you'd always using a regridding
with of 2
> > > > (i.e. a
> > > > > 2x2 box)... just like with bilinear interpolation, you'd
also use
> > > width =
> > > > > 2.
> > > > >
> > > > > The default for regrid_data_plane is nearest neighbor (i.e.
width =
> > 1).
> > > > >
> > > > > John
> > > > >
> > > > >
> > > > >
> > > > > On Fri, Feb 23, 2018 at 1:23 PM, tracey.dorian at noaa.gov via
RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84180 >
> > > > > >
> > > > > > Also could you please explain what the width part of the
command
> > > > does? I
> > > > > > see this online:
> > > > > >
> > > > > > The -width n option overrides the default regridding
width.
> Default
> > > is
> > > > 1
> > > > > >
> > > > > > But I'm still a little bit confused what this means.
> > > > > >
> > > > > > Thanks!
> > > > > > Tracey
> > > > > >
> > > > > > On Fri, Feb 23, 2018 at 3:22 PM, Tracey Dorian - NOAA
Affiliate <
> > > > > > tracey.dorian at noaa.gov> wrote:
> > > > > >
> > > > > > > Thanks very much John for testing this. I just ran it
myself
> on
> > > > Theia
> > > > > it
> > > > > > > worked fine. I did just realize the difference in
accumulation
> > > > > amounts.
> > > > > > > Is there a way to use the regrid_data_plane tool to sum
four
> > > 6-hourly
> > > > > GFS
> > > > > > > files to create a 24-hour accumulation file to then
regrid to
> > Stage
> > > > IV?
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Tracey
> > > > > > >
> > > > > > > On Fri, Feb 23, 2018 at 3:16 PM, John Halley Gotway via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >> Hi Tracey,
> > > > > > >>
> > > > > > >> When I run your command on theia, it works fine. So
it's
> likely
> > > due
> > > > > to
> > > > > > >> how
> > > > > > >> MET is installed on WCOSS.
> > > > > > >>
> > > > > > >> Another MET developer, Julie Prestopnik, recalls seeing
this
> > > > behavior
> > > > > > >> before. It was caused by building MET and it's
external
> > libraries
> > > > > using
> > > > > > >> inconsistent flags. This cause the processing of GRIB2
files
> to
> > > run
> > > > > out
> > > > > > >> of
> > > > > > >> memory.
> > > > > > >>
> > > > > > >> She has access to WCOSS and will test this out on
Monday.
> > > > > > >>
> > > > > > >> Here's the commands I ran on theia:
> > > > > > >>
> > > > > > >> module use /contrib/modulefiles
> > > > > > >> module load met/6.1
> > > > > > >> cd /scratch4/NCEPDEV/global/save/
> Tracey.Dorian/grads/Heavy_Rain
> > > > > > >> _Feb9_12_2018
> > > > > > >> regrid_data_plane
gfs.t12z.pgrb2.0p25.f024_Cycle_2018021012
> > > > > > >> <(201)%20802-1012>_APCPsfc
> > > > > > >> ST4.2018021112 <(201)%20802-1112>.24h ~/regridded.nc
-field
> > > > > > >> 'name="APCP"; level="A06";'
> > > > > > >> -method BUDGET -width 2
> > > > > > >>
> > > > > > >> *BUT* notice that the GFS file doesn't have 24-hourly
precip,
> > only
> > > > > > >> 6-hourly. And I switched from the default nearest
neighbor
> > interp
> > > > to
> > > > > > use
> > > > > > >> budget interpolation.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> John
> > > > > > >>
> > > > > > >> On Fri, Feb 23, 2018 at 12:53 PM,
tracey.dorian at noaa.gov via
> > RT <
> > > > > > >> met_help at ucar.edu> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > <URL: https://rt.rap.ucar.edu/rt/
> Ticket/Display.html?id=84180
> > >
> > > > > > >> >
> > > > > > >> > Hi Julie,
> > > > > > >> >
> > > > > > >> > I have the following in my .cshrc file in my home
directory
> on
> > > > Tide.
> > > > > > >> >
> > > > > > >> > module use /usrx/local/dev/modulefiles
> > > > > > >> > module load met
> > > > > > >> >
> > > > > > >> > So I assume this defaults to v6.1, but I'm not 100%
sure.
> > > > > > >> >
> > > > > > >> > Thanks,
> > > > > > >> > Tracey
> > > > > > >> >
> > > > > > >> > On Fri, Feb 23, 2018 at 2:49 PM, Julie Prestopnik via
RT <
> > > > > > >> > met_help at ucar.edu>
> > > > > > >> > wrote:
> > > > > > >> >
> > > > > > >> > > Hi Tracey. Can you please tell me what you used to
access
> > > > METv6.1
> > > > > > on
> > > > > > >> > > WCOSS?
> > > > > > >> > >
> > > > > > >> > > For example,
> > > > > > >> > >
> > > > > > >> > > module use ?
> > > > > > >> > > module load met/6.1
> > > > > > >> > >
> > > > > > >> > > Can you also please tell me which WCOSS machine you
were
> > > using?
> > > > > > >> > >
> > > > > > >> > > Thank you!
> > > > > > >> > >
> > > > > > >> > > Julie
> > > > > > >> > >
> > > > > > >> > > On Fri, Feb 23, 2018 at 12:45 PM,
tracey.dorian at noaa.gov
> > via
> > > > RT <
> > > > > > >> > > met_help at ucar.edu> wrote:
> > > > > > >> > >
> > > > > > >> > > >
> > > > > > >> > > > <URL: https://rt.rap.ucar.edu/rt/
> > > Ticket/Display.html?id=84180
> > > > >
> > > > > > >> > > >
> > > > > > >> > > > Hi John,
> > > > > > >> > > >
> > > > > > >> > > > Thanks for your quick response. I've transferred
the
> > files
> > > > from
> > > > > > >> WCOSS
> > > > > > >> > > over
> > > > > > >> > > > to Theia now located
> > > > > > >> > > > in /scratch4/NCEPDEV/global/save/
> > Tracey.Dorian/grads/Heavy_
> > > > > > >> > > > Rain_Feb9_12_2018.
> > > > > > >> > > > The version of MET on WCOSS should be the latest,
v6.1.
> > > > > > >> > > >
> > > > > > >> > > > I'd like to be able to plot the differences in
GrADS
> > since I
> > > > > have
> > > > > > my
> > > > > > >> > own
> > > > > > >> > > > color schemes that I'd like to apply to it. Best
case
> > > > scenario
> > > > > > >> would
> > > > > > >> > be
> > > > > > >> > > if
> > > > > > >> > > > I could regrid the GFS file to Stage IV grid into
> another
> > > > GRIB2
> > > > > > file
> > > > > > >> > > > (instead of a NetCDF file), but I'm not sure
there's a
> way
> > > to
> > > > do
> > > > > > >> that.
> > > > > > >> > > >
> > > > > > >> > > > Do I type the commands under "Windows FTP client"
into
> my
> > > > > > terminal?
> > > > > > >> > It's
> > > > > > >> > > > been a while since I submitted something to
> > > > > > >> https://dtcenter.org/met/
> > > > > > >> > > > users/support/met_help.php#ftp.
> > > > > > >> > > >
> > > > > > >> > > > Thanks,
> > > > > > >> > > > Tracey
> > > > > > >> > > >
> > > > > > >> > > > On Fri, Feb 23, 2018 at 2:29 PM, John Halley
Gotway via
> > RT <
> > > > > > >> > > > met_help at ucar.edu> wrote:
> > > > > > >> > > >
> > > > > > >> > > > > Tracey,
> > > > > > >> > > > >
> > > > > > >> > > > > I used your email to create a new met-help
ticket.
> > > > > > >> > > > >
> > > > > > >> > > > > Hmm, sounds suspicious! I'd like to replicate
this
> > issue
> > > if
> > > > > > >> > possible.
> > > > > > >> > > > > Can you send me (https://dtcenter.org/met/
> > > > > > >> > > users/support/met_help.php#ftp
> > > > > > >> > > > )
> > > > > > >> > > > > or point me to sample files on theia? I'd like
to see
> > > both
> > > > > the
> > > > > > >> gfs
> > > > > > >> > > file
> > > > > > >> > > > > and the ST4.
> > > > > > >> > > > >
> > > > > > >> > > > > Also, on what machine are you running the tool?
And
> > what
> > > > > > version
> > > > > > >> of
> > > > > > >> > > MET
> > > > > > >> > > > > are you running?
> > > > > > >> > > > >
> > > > > > >> > > > > FYI, if you ultimately want to see a difference
field,
> > > using
> > > > > > >> > grid_stat
> > > > > > >> > > is
> > > > > > >> > > > > another option. You could run grid_stat to
compare
> GFS
> > to
> > > > > ST4,
> > > > > > >> > > configure
> > > > > > >> > > > > it to use regrid.to_grid = OBS, and then make
sure the
> > > > > > >> > > > nc_pairs_flag.diff =
> > > > > > >> > > > > true. Then the difference field will show up
in the
> > > NetCDF
> > > > > > >> matched
> > > > > > >> > > pairs
> > > > > > >> > > > > output file.
> > > > > > >> > > > >
> > > > > > >> > > > > Thanks,
> > > > > > >> > > > > John
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > >
> > > > > > >> > > >
> > > > > > >> > > > --
> > > > > > >> > > > Tracey Dorian
> > > > > > >> > > > NOAA/NCEP/EMC
> > > > > > >> > > > IMSG contractor
> > > > > > >> > > > 5830 University Research Court
> > > > > > >> > > > College Park, MD 20740
> > > > > > >> > > >
> > > > > > >> > > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > --
> > > > > > >> > Tracey Dorian
> > > > > > >> > NOAA/NCEP/EMC
> > > > > > >> > IMSG contractor
> > > > > > >> > 5830 University Research Court
> > > > > > >> > College Park, MD 20740
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Tracey Dorian
> > > > > > > NOAA/NCEP/EMC
> > > > > > > IMSG contractor
> > > > > > > 5830 University Research Court
> > > > > > > College Park, MD 20740
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Tracey Dorian
> > > > > > NOAA/NCEP/EMC
> > > > > > IMSG contractor
> > > > > > 5830 University Research Court
> > > > > > College Park, MD 20740
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Tracey Dorian
> > > > NOAA/NCEP/EMC
> > > > IMSG contractor
> > > > 5830 University Research Court
> > > > College Park, MD 20740
> > > >
> > > >
> > >
> > >
> >
> >
> > --
> > Tracey Dorian
> > NOAA/NCEP/EMC
> > IMSG contractor
> > 5830 University Research Court
> > College Park, MD 20740
> >
> >
>
>
--
Tracey Dorian
NOAA/NCEP/EMC
IMSG contractor
5830 University Research Court
College Park, MD 20740
------------------------------------------------
More information about the Met_help
mailing list