[Met_help] [rt.rap.ucar.edu #98795] History for RMSE using MET/METplus point-stat tool
John Halley Gotway via RT
met_help at ucar.edu
Wed Apr 21 11:59:21 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
Would someone help me?
Thanks a lot!
Zhuming
I'm trying to use point-stat tool to get domain-averaged RMSE etc., for
WRF12h forecasts against their observations, but failed with following
error information
I have WRF 12h forecast data in
/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
I have little-r format station obs data in /glade/scratch/zhuming/step/obs/
The .conf files are in /gpfs/fs1/work/zhuming/METplus/
>master_metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne > x
02/22 14:27:37.239 metplus.PointStat (command_builder.py:122) ERROR:
(command_builder.py:1032) MET command returned a non-zero return code:
/glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:
00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
-outdir /glade/scratch/zhuming/metplus/point_stat
02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
(command_builder.py:1032)
MET command returned a non-zero return code:
/glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:
00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
-outdir /glade/scratch/zhuming/metplus/point_stat
02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR: PointStat had
1 error.
02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR: PointStat had 1
error.
02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has finished
running but had 1 error.
02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has finished running
but had 1 error.
more /glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called with command:
/glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
02/22 14:27:35.701 metplus INFO: Log file:
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
02/22 14:27:36.669 metplus INFO: ****************************************
02/22 14:27:36.669 metplus INFO: * Running METplus
02/22 14:27:36.669 metplus INFO: * at valid time: 201507150000
02/22 14:27:36.669 metplus INFO: ****************************************
02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast lead 0 hours
02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
/glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2 /glade/scratch/zh
uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:00.nc
/glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc /gpfs
/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped -outdir
/glade/scratch/zhuming/metplus/point_stat
MET OUTPUT:
DEBUG 1: Default Config File:
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
DEBUG 1: User Config File:
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
ERROR :
ERROR : Trouble reading forecast file
"/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:
00.nc"
ERROR :
02/22 14:27:37.239 metplus.PointStat (command_builder.py:122) ERROR:
(command_builder.py:1032) MET command returned a non-zero r
eturn code: /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
2_2015-07-15_00:00:00.nc /glade/scratch/zhuming/metplus/ascii2nc/
obs.2015071500.nc /gpfs/fs1/work/zhuming/METplus/parm/met_confi
g/PointStatConfig_wrapped -outdir /glade/scratch/zhuming/metplus/point_stat
02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile for more
information on why it failed: /glade/scratch/zhuming/metpl
us/logs/master_metplus.log.20210222142735
02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR: PointStat had
1 error.
02/22 14:27:37.240 metplus INFO:
/glade/scratch/zhuming/metplus/metplus_final.conf: write metplus.conf here
02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has finished
running but had 1 error.
02/22 14:27:37.244 metplus INFO: Check the log file for more information:
/glade/scratch/zhuming/metplus/logs/master_metplus.log
.20210222142735
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: RMSE using MET/METplus point-stat tool
From: John Halley Gotway
Time: Tue Feb 23 09:05:55 2021
Zhuming,
I see you're having trouble running METplus on Cheyenne directly on
WRF
output files. Thanks for sending paths to all the output files. I'm
looking
in the PointStat.conf file:
/gpfs/fs1/work/zhuming/METplus/PointStat.conf
And I see that you'd like to evaluate 10-m winds and temperature at
pressure levels.
Here's the issue. The MET tools do not read the raw WRF output files
directly. They can read a subset of the data, but only surface
variables
(e.g. not TMP at pressure levels) and only variables on unstaggered
dimensions (e.g. not winds). For this reason, we recommend that users
first
post-process their raw WRF output using the Unified Post Processor:
https://dtcenter.org/community-code/unified-post-processor-upp
It interpolates WRF output to pressure levels, de-staggers the winds,
and
writes GRIB1 or GRIB2 output files.
Thanks,
John Halley Gotway
On Mon, Feb 22, 2021 at 3:12 PM zhuming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> Mon Feb 22 15:12:01 2021: Request 98795 was acted upon.
> Transaction: Ticket created by zhuming at ucar.edu
> Queue: met_help
> Subject: RMSE using MET/METplus point-stat tool
> Owner: Nobody
> Requestors: zhuming at ucar.edu
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795 >
>
>
> Hi,
>
> Would someone help me?
>
> Thanks a lot!
> Zhuming
>
> I'm trying to use point-stat tool to get domain-averaged RMSE etc.,
for
> WRF12h forecasts against their observations, but failed with
following
> error information
>
> I have WRF 12h forecast data in
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
>
> I have little-r format station obs data in
/glade/scratch/zhuming/step/obs/
>
> The .conf files are in /gpfs/fs1/work/zhuming/METplus/
>
>
> >master_metplus.py -c PointStat.conf -c
./metplus_system.conf.cheyenne > x
>
> 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122) ERROR:
> (command_builder.py:1032) MET command returned a non-zero return
code:
> /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
>
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
>
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> -outdir /glade/scratch/zhuming/metplus/point_stat
>
> 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
> (command_builder.py:1032)
> MET command returned a non-zero return code:
> /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
>
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
>
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> -outdir /glade/scratch/zhuming/metplus/point_stat
>
> 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat had
> 1 error.
>
> 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR: PointStat had
1
> error.
>
> 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
> running but had 1 error.
>
> 02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has finished
running
> but had 1 error.
>
>
>
>
> more
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
>
> 02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called with
command:
> /glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
>
> metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
>
> 02/22 14:27:35.701 metplus INFO: Log file:
>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
>
> 02/22 14:27:36.669 metplus INFO:
****************************************
>
> 02/22 14:27:36.669 metplus INFO: * Running METplus
>
> 02/22 14:27:36.669 metplus INFO: * at valid time: 201507150000
>
> 02/22 14:27:36.669 metplus INFO:
****************************************
>
> 02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast lead
0 hours
>
> 02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
> /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> /glade/scratch/zh
>
> uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:00.nc
> /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc /gpfs
>
> /fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
-outdir
> /glade/scratch/zhuming/metplus/point_stat
>
> MET OUTPUT:
>
> DEBUG 1: Default Config File:
>
>
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
>
> DEBUG 1: User Config File:
>
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
>
> ERROR :
>
> ERROR : Trouble reading forecast file
>
> "/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> 00.nc"
>
> ERROR :
>
> 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122) ERROR:
> (command_builder.py:1032) MET command returned a non-zero r
>
> eturn code: /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v
2
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
>
> 2_2015-07-15_00:00:00.nc /glade/scratch/zhuming/metplus/ascii2nc/
> obs.2015071500.nc /gpfs/fs1/work/zhuming/METplus/parm/met_confi
>
> g/PointStatConfig_wrapped -outdir
/glade/scratch/zhuming/metplus/point_stat
>
> 02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile for
more
> information on why it failed: /glade/scratch/zhuming/metpl
>
> us/logs/master_metplus.log.20210222142735
>
> 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat had
> 1 error.
>
> 02/22 14:27:37.240 metplus INFO:
> /glade/scratch/zhuming/metplus/metplus_final.conf: write
metplus.conf here
>
> 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
> running but had 1 error.
>
> 02/22 14:27:37.244 metplus INFO: Check the log file for more
information:
> /glade/scratch/zhuming/metplus/logs/master_metplus.log
>
> .20210222142735
>
>
------------------------------------------------
Subject: RMSE using MET/METplus point-stat tool
From: zhuming at ucar.edu
Time: Tue Feb 23 17:26:19 2021
Hi John,
Thanks for your quick response. I will learn UPP later.
I need to get the RMSE of WRF forecast against surface obs, and
against
sounding data. Do you have a .conf file related to WRFout?
Actually I did run the WRF again, and output WRF history files with
grib1
format. But it still failed with the log file of
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210223111831
Thanks,
Zhuming
On Tue, Feb 23, 2021 at 9:06 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Zhuming,
>
> I see you're having trouble running METplus on Cheyenne directly on
WRF
> output files. Thanks for sending paths to all the output files. I'm
looking
> in the PointStat.conf file:
> /gpfs/fs1/work/zhuming/METplus/PointStat.conf
>
> And I see that you'd like to evaluate 10-m winds and temperature at
> pressure levels.
>
> Here's the issue. The MET tools do not read the raw WRF output files
> directly. They can read a subset of the data, but only surface
variables
> (e.g. not TMP at pressure levels) and only variables on unstaggered
> dimensions (e.g. not winds). For this reason, we recommend that
users first
> post-process their raw WRF output using the Unified Post Processor:
> https://dtcenter.org/community-code/unified-post-processor-upp
>
> It interpolates WRF output to pressure levels, de-staggers the
winds, and
> writes GRIB1 or GRIB2 output files.
>
> Thanks,
> John Halley Gotway
>
> On Mon, Feb 22, 2021 at 3:12 PM zhuming at ucar.edu via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Mon Feb 22 15:12:01 2021: Request 98795 was acted upon.
> > Transaction: Ticket created by zhuming at ucar.edu
> > Queue: met_help
> > Subject: RMSE using MET/METplus point-stat tool
> > Owner: Nobody
> > Requestors: zhuming at ucar.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795 >
> >
> >
> > Hi,
> >
> > Would someone help me?
> >
> > Thanks a lot!
> > Zhuming
> >
> > I'm trying to use point-stat tool to get domain-averaged RMSE
etc., for
> > WRF12h forecasts against their observations, but failed with
following
> > error information
> >
> > I have WRF 12h forecast data in
> > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
> >
> > I have little-r format station obs data in
> /glade/scratch/zhuming/step/obs/
> >
> > The .conf files are in /gpfs/fs1/work/zhuming/METplus/
> >
> >
> > >master_metplus.py -c PointStat.conf -c
./metplus_system.conf.cheyenne >
> x
> >
> > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > (command_builder.py:1032) MET command returned a non-zero return
code:
> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > -outdir /glade/scratch/zhuming/metplus/point_stat
> >
> > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
> > (command_builder.py:1032)
> > MET command returned a non-zero return code:
> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > -outdir /glade/scratch/zhuming/metplus/point_stat
> >
> > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
> had
> > 1 error.
> >
> > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR: PointStat
had 1
> > error.
> >
> > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
> > running but had 1 error.
> >
> > 02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has finished
running
> > but had 1 error.
> >
> >
> >
> >
> > more
>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> >
> > 02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called with
> command:
> > /glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
> >
> > metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
> >
> > 02/22 14:27:35.701 metplus INFO: Log file:
> >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> >
> > 02/22 14:27:36.669 metplus INFO:
****************************************
> >
> > 02/22 14:27:36.669 metplus INFO: * Running METplus
> >
> > 02/22 14:27:36.669 metplus INFO: * at valid time: 201507150000
> >
> > 02/22 14:27:36.669 metplus INFO:
****************************************
> >
> > 02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast
lead 0
> hours
> >
> > 02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > /glade/scratch/zh
> >
> > uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:00.nc
> > /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc /gpfs
> >
> > /fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
-outdir
> > /glade/scratch/zhuming/metplus/point_stat
> >
> > MET OUTPUT:
> >
> > DEBUG 1: Default Config File:
> >
> >
>
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
> >
> > DEBUG 1: User Config File:
> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> >
> > ERROR :
> >
> > ERROR : Trouble reading forecast file
> >
> >
> "/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00.nc"
> >
> > ERROR :
> >
> > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > (command_builder.py:1032) MET command returned a non-zero r
> >
> > eturn code: /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat
-v 2
> > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
> >
> > 2_2015-07-15_00:00:00.nc /glade/scratch/zhuming/metplus/ascii2nc/
> > obs.2015071500.nc /gpfs/fs1/work/zhuming/METplus/parm/met_confi
> >
> > g/PointStatConfig_wrapped -outdir
> /glade/scratch/zhuming/metplus/point_stat
> >
> > 02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile for
more
> > information on why it failed: /glade/scratch/zhuming/metpl
> >
> > us/logs/master_metplus.log.20210222142735
> >
> > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
> had
> > 1 error.
> >
> > 02/22 14:27:37.240 metplus INFO:
> > /glade/scratch/zhuming/metplus/metplus_final.conf: write
metplus.conf
> here
> >
> > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
> > running but had 1 error.
> >
> > 02/22 14:27:37.244 metplus INFO: Check the log file for more
information:
> > /glade/scratch/zhuming/metplus/logs/master_metplus.log
> >
> > .20210222142735
> >
> >
>
>
------------------------------------------------
Subject: RMSE using MET/METplus point-stat tool
From: zhuming at ucar.edu
Time: Wed Feb 24 10:26:40 2021
Hi, Could anyone help me?
Thanks!
Zhuming
I changed the file of PointStat.conf, and ran again. it seems "metplus
has
successfully finished". But when I checked the results, the stat files
are
almost empty with a head only.
cheyenne2:/glade/scratch/zhuming/metplus/point_stat>ls -l
point_stat_000000L_20150715*
-rw-r--r-- 1 zhuming ncar 1093 Feb 24 10:09
point_stat_000000L_20150715_000000V_cnt.txt
-rw-r--r-- 1 zhuming ncar 341 Feb 24 10:09
point_stat_000000L_20150715_000000V_mpr.txt
-rw-r--r-- 1 zhuming ncar 278 Feb 24 10:09
point_stat_000000L_20150715_000000V_sl1l2.txt
-rw-r--r-- 1 zhuming ncar 240 Feb 24 10:09
point_stat_000000L_20150715_000000V.stat
-rw-r--r-- 1 zhuming ncar 825 Feb 24 10:09
point_stat_000000L_20150715_000000V_vcnt.txt
-rw-r--r-- 1 zhuming ncar 318 Feb 24 10:09
point_stat_000000L_20150715_000000V_vl1l2.txt
cheyenne2:/gpfs/fs1/work/zhuming/METplus>master_metplus.py -c
./PointStat.conf -c ./metplus_system.conf.cheyenne
02/24 10:08:59.341 METplus (met_util.py:97) INFO: Starting METplus
v3.1
02/24 10:08:59.341 metplus (config_metplus.py:76) INFO: Starting
METplus
configuration setup.
02/24 10:08:59.343 metplus (config_launcher.py:204) INFO:
/gpfs/fs1/work/zhuming/METplus/parm/metplus_config/metplus_system.conf:
Parsed this file
02/24 10:08:59.344 metplus (config_launcher.py:204) INFO:
/gpfs/fs1/work/zhuming/METplus/parm/metplus_config/metplus_data.conf:
Parsed this file
02/24 10:08:59.344 metplus (config_launcher.py:204) INFO:
/gpfs/fs1/work/zhuming/METplus/parm/metplus_config/metplus_runtime.conf:
Parsed this file
02/24 10:08:59.345 metplus (config_launcher.py:204) INFO:
/gpfs/fs1/work/zhuming/METplus/parm/metplus_config/metplus_logging.conf:
Parsed this file
02/24 10:08:59.346 metplus (config_launcher.py:204) INFO:
./PointStat.conf:
Parsed this file
02/24 10:08:59.346 metplus (config_launcher.py:204) INFO:
./metplus_system.conf.cheyenne: Parsed this file
02/24 10:08:59.347 metplus (config_launcher.py:394) INFO: Adding:
config.LOG_TIMESTAMP='20210224100859'
02/24 10:08:59.347 metplus (config_launcher.py:400) INFO: Replace
[config]
LOG_METPLUS with
'/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224100859'
02/24 10:08:59.348 metplus (config_launcher.py:272) INFO: Setting
[dir]
METPLUS_BASE to /glade/p/ral/jntp/MET/METplus/METplus-3.1
02/24 10:08:59.348 metplus (config_launcher.py:272) INFO: Setting
[dir]
PARM_BASE to /gpfs/fs1/work/zhuming/METplus/parm
02/24 10:08:59.348 metplus (config_launcher.py:279) INFO:
METPLUS_CONF:
/glade/scratch/zhuming/metplus/metplus_final.conf written here.
02/24 10:08:59.348 metplus (config_metplus.py:147) INFO: Completed
METplus
configuration setup.
02/24 10:08:59.349 metplus (met_util.py:107) INFO: Running METplus
v3.1
called with command:
/glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_metplus.py -c
./PointStat.conf -c ./metplus_system.conf.cheyenne
02/24 10:08:59.350 metplus (met_util.py:109) INFO: Log file:
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224100859
02/24 10:09:00.293 metplus (met_util.py:920) INFO:
****************************************
02/24 10:09:00.293 metplus (met_util.py:921) INFO: * Running METplus
02/24 10:09:00.293 metplus (met_util.py:925) INFO: * at valid time:
201507150000
02/24 10:09:00.293 metplus (met_util.py:926) INFO:
****************************************
02/24 10:09:00.294 metplus.PointStat (compare_gridded_wrapper.py:176)
INFO:
Processing forecast lead 0 hours
02/24 10:09:00.302 metplus.PointStat (command_runner.py:89) INFO:
COMMAND:
/glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
/glade/scratch/zhuming/step/ctrl4/fc_grib1/2015071500/wrfout_d02_2015-
07-15_00:00:00
/glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
-outdir /glade/scratch/zhuming/metplus/point_stat
02/24 10:09:32.154 metplus (met_util.py:812) INFO:
/glade/scratch/zhuming/metplus/metplus_final.conf: write metplus.conf
here
02/24 10:09:32.157 metplus (met_util.py:239) INFO: METplus has
successfully
finished running.
On Tue, Feb 23, 2021 at 5:26 PM Zhuming Ying <zhuming at ucar.edu> wrote:
> Hi John,
>
> Thanks for your quick response. I will learn UPP later.
>
> I need to get the RMSE of WRF forecast against surface obs, and
against
> sounding data. Do you have a .conf file related to WRFout?
> Actually I did run the WRF again, and output WRF history files with
grib1
> format. But it still failed with the log file of
>
>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210223111831
>
>
> Thanks,
>
> Zhuming
>
>
> On Tue, Feb 23, 2021 at 9:06 AM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Zhuming,
>>
>> I see you're having trouble running METplus on Cheyenne directly on
WRF
>> output files. Thanks for sending paths to all the output files. I'm
>> looking
>> in the PointStat.conf file:
>> /gpfs/fs1/work/zhuming/METplus/PointStat.conf
>>
>> And I see that you'd like to evaluate 10-m winds and temperature at
>> pressure levels.
>>
>> Here's the issue. The MET tools do not read the raw WRF output
files
>> directly. They can read a subset of the data, but only surface
variables
>> (e.g. not TMP at pressure levels) and only variables on unstaggered
>> dimensions (e.g. not winds). For this reason, we recommend that
users
>> first
>> post-process their raw WRF output using the Unified Post Processor:
>> https://dtcenter.org/community-code/unified-post-processor-upp
>>
>> It interpolates WRF output to pressure levels, de-staggers the
winds, and
>> writes GRIB1 or GRIB2 output files.
>>
>> Thanks,
>> John Halley Gotway
>>
>> On Mon, Feb 22, 2021 at 3:12 PM zhuming at ucar.edu via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> >
>> > Mon Feb 22 15:12:01 2021: Request 98795 was acted upon.
>> > Transaction: Ticket created by zhuming at ucar.edu
>> > Queue: met_help
>> > Subject: RMSE using MET/METplus point-stat tool
>> > Owner: Nobody
>> > Requestors: zhuming at ucar.edu
>> > Status: new
>> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795 >
>> >
>> >
>> > Hi,
>> >
>> > Would someone help me?
>> >
>> > Thanks a lot!
>> > Zhuming
>> >
>> > I'm trying to use point-stat tool to get domain-averaged RMSE
etc., for
>> > WRF12h forecasts against their observations, but failed with
following
>> > error information
>> >
>> > I have WRF 12h forecast data in
>> > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
>> >
>> > I have little-r format station obs data in
>> /glade/scratch/zhuming/step/obs/
>> >
>> > The .conf files are in /gpfs/fs1/work/zhuming/METplus/
>> >
>> >
>> > >master_metplus.py -c PointStat.conf -c
./metplus_system.conf.cheyenne
>> > x
>> >
>> > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
>> > (command_builder.py:1032) MET command returned a non-zero return
code:
>> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
>> >
>> >
>> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
>> > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
>> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
>> > -outdir /glade/scratch/zhuming/metplus/point_stat
>> >
>> > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
>> > (command_builder.py:1032)
>> > MET command returned a non-zero return code:
>> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
>> >
>> >
>> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
>> > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
>> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
>> > -outdir /glade/scratch/zhuming/metplus/point_stat
>> >
>> > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
>> had
>> > 1 error.
>> >
>> > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR: PointStat
had 1
>> > error.
>> >
>> > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
>> > running but had 1 error.
>> >
>> > 02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has finished
>> running
>> > but had 1 error.
>> >
>> >
>> >
>> >
>> > more
>>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
>> >
>> > 02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called with
>> command:
>> > /glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
>> >
>> > metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
>> >
>> > 02/22 14:27:35.701 metplus INFO: Log file:
>> >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
>> >
>> > 02/22 14:27:36.669 metplus INFO:
>> ****************************************
>> >
>> > 02/22 14:27:36.669 metplus INFO: * Running METplus
>> >
>> > 02/22 14:27:36.669 metplus INFO: * at valid time: 201507150000
>> >
>> > 02/22 14:27:36.669 metplus INFO:
>> ****************************************
>> >
>> > 02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast
lead 0
>> hours
>> >
>> > 02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
>> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
>> > /glade/scratch/zh
>> >
>> > uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:00.nc
>> > /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc /gpfs
>> >
>> > /fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
>> -outdir
>> > /glade/scratch/zhuming/metplus/point_stat
>> >
>> > MET OUTPUT:
>> >
>> > DEBUG 1: Default Config File:
>> >
>> >
>>
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
>> >
>> > DEBUG 1: User Config File:
>> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
>> >
>> > ERROR :
>> >
>> > ERROR : Trouble reading forecast file
>> >
>> >
>> "/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-
07-15_00:00:
>> > 00.nc"
>> >
>> > ERROR :
>> >
>> > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
>> > (command_builder.py:1032) MET command returned a non-zero r
>> >
>> > eturn code: /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat
-v 2
>> > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
>> >
>> > 2_2015-07-15_00:00:00.nc /glade/scratch/zhuming/metplus/ascii2nc/
>> > obs.2015071500.nc /gpfs/fs1/work/zhuming/METplus/parm/met_confi
>> >
>> > g/PointStatConfig_wrapped -outdir
>> /glade/scratch/zhuming/metplus/point_stat
>> >
>> > 02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile for
more
>> > information on why it failed: /glade/scratch/zhuming/metpl
>> >
>> > us/logs/master_metplus.log.20210222142735
>> >
>> > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
>> had
>> > 1 error.
>> >
>> > 02/22 14:27:37.240 metplus INFO:
>> > /glade/scratch/zhuming/metplus/metplus_final.conf: write
metplus.conf
>> here
>> >
>> > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
>> > running but had 1 error.
>> >
>> > 02/22 14:27:37.244 metplus INFO: Check the log file for more
>> information:
>> > /glade/scratch/zhuming/metplus/logs/master_metplus.log
>> >
>> > .20210222142735
>> >
>> >
>>
>>
------------------------------------------------
Subject: RMSE using MET/METplus point-stat tool
From: zhuming at ucar.edu
Time: Wed Feb 24 11:11:08 2021
Hi!
I also convert WRFout forecast files (NetCDF format) to a new CF based
NetCDF (MET accepted format) file using wrfout_to_cf.ncl.
But MET running was still not successful. I'm doubting the
FCST_VAR_NAME
was not set correctly.
Would someone check for me?
Thanks a lot!
Zhuming
The .conf files are in /gpfs/fs1/work/zhuming/METplus/PointStat2.conf
log file:
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224103241
the wrf forecast data are in
/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
00_cf.nc
little-r format station obs data are in
/glade/scratch/zhuming/step/obs/
I changed PointStat2.conf:
#FCST_VAR1_NAME = TMP
#FCST_VAR1_NAME = T_2m
#FCST_VAR1_LEVELS = Z2
FCST_VAR1_NAME = T_p
FCST_VAR1_LEVELS = P750-900
FCST_VAR1_THRESH = <=273, >273
OBS_VAR1_NAME = TMP
#OBS_VAR1_LEVELS = P750-900
OBS_VAR1_LEVELS = Z2
OBS_VAR1_THRESH = <=273, >273
On Tue, Feb 23, 2021 at 9:06 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Zhuming,
>
> I see you're having trouble running METplus on Cheyenne directly on
WRF
> output files. Thanks for sending paths to all the output files. I'm
looking
> in the PointStat.conf file:
> /gpfs/fs1/work/zhuming/METplus/PointStat.conf
>
> And I see that you'd like to evaluate 10-m winds and temperature at
> pressure levels.
>
> Here's the issue. The MET tools do not read the raw WRF output files
> directly. They can read a subset of the data, but only surface
variables
> (e.g. not TMP at pressure levels) and only variables on unstaggered
> dimensions (e.g. not winds). For this reason, we recommend that
users first
> post-process their raw WRF output using the Unified Post Processor:
> https://dtcenter.org/community-code/unified-post-processor-upp
>
> It interpolates WRF output to pressure levels, de-staggers the
winds, and
> writes GRIB1 or GRIB2 output files.
>
> Thanks,
> John Halley Gotway
>
> On Mon, Feb 22, 2021 at 3:12 PM zhuming at ucar.edu via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Mon Feb 22 15:12:01 2021: Request 98795 was acted upon.
> > Transaction: Ticket created by zhuming at ucar.edu
> > Queue: met_help
> > Subject: RMSE using MET/METplus point-stat tool
> > Owner: Nobody
> > Requestors: zhuming at ucar.edu
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795 >
> >
> >
> > Hi,
> >
> > Would someone help me?
> >
> > Thanks a lot!
> > Zhuming
> >
> > I'm trying to use point-stat tool to get domain-averaged RMSE
etc., for
> > WRF12h forecasts against their observations, but failed with
following
> > error information
> >
> > I have WRF 12h forecast data in
> > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
> >
> > I have little-r format station obs data in
> /glade/scratch/zhuming/step/obs/
> >
> > The .conf files are in /gpfs/fs1/work/zhuming/METplus/
> >
> >
> > >master_metplus.py -c PointStat.conf -c
./metplus_system.conf.cheyenne >
> x
> >
> > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > (command_builder.py:1032) MET command returned a non-zero return
code:
> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > -outdir /glade/scratch/zhuming/metplus/point_stat
> >
> > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
> > (command_builder.py:1032)
> > MET command returned a non-zero return code:
> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > -outdir /glade/scratch/zhuming/metplus/point_stat
> >
> > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
> had
> > 1 error.
> >
> > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR: PointStat
had 1
> > error.
> >
> > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
> > running but had 1 error.
> >
> > 02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has finished
running
> > but had 1 error.
> >
> >
> >
> >
> > more
>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> >
> > 02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called with
> command:
> > /glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
> >
> > metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
> >
> > 02/22 14:27:35.701 metplus INFO: Log file:
> >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> >
> > 02/22 14:27:36.669 metplus INFO:
****************************************
> >
> > 02/22 14:27:36.669 metplus INFO: * Running METplus
> >
> > 02/22 14:27:36.669 metplus INFO: * at valid time: 201507150000
> >
> > 02/22 14:27:36.669 metplus INFO:
****************************************
> >
> > 02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast
lead 0
> hours
> >
> > 02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
> > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > /glade/scratch/zh
> >
> > uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:00.nc
> > /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc /gpfs
> >
> > /fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
-outdir
> > /glade/scratch/zhuming/metplus/point_stat
> >
> > MET OUTPUT:
> >
> > DEBUG 1: Default Config File:
> >
> >
>
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
> >
> > DEBUG 1: User Config File:
> >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> >
> > ERROR :
> >
> > ERROR : Trouble reading forecast file
> >
> >
> "/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00.nc"
> >
> > ERROR :
> >
> > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > (command_builder.py:1032) MET command returned a non-zero r
> >
> > eturn code: /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat
-v 2
> > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
> >
> > 2_2015-07-15_00:00:00.nc /glade/scratch/zhuming/metplus/ascii2nc/
> > obs.2015071500.nc /gpfs/fs1/work/zhuming/METplus/parm/met_confi
> >
> > g/PointStatConfig_wrapped -outdir
> /glade/scratch/zhuming/metplus/point_stat
> >
> > 02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile for
more
> > information on why it failed: /glade/scratch/zhuming/metpl
> >
> > us/logs/master_metplus.log.20210222142735
> >
> > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
> had
> > 1 error.
> >
> > 02/22 14:27:37.240 metplus INFO:
> > /glade/scratch/zhuming/metplus/metplus_final.conf: write
metplus.conf
> here
> >
> > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
finished
> > running but had 1 error.
> >
> > 02/22 14:27:37.244 metplus INFO: Check the log file for more
information:
> > /glade/scratch/zhuming/metplus/logs/master_metplus.log
> >
> > .20210222142735
> >
> >
>
>
------------------------------------------------
Subject: RMSE using MET/METplus point-stat tool
From: John Halley Gotway
Time: Wed Feb 24 12:45:29 2021
Zhuming,
Looking in this METplus logfile:
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224103241
I found the following error message:
*ERROR : NcCfFile::getData(NcVar *, const LongArray &, DataPlane &)
const
-> needed 4 arguments for variable T_p, got 2*
You're trying to process the "T_p" variable
from wrfout_d02_2015-07-15_00:00:00_cf.nc:
* float T_p(time, pressure, south_north, west_east) ;*
The format for the level string differs when processing NetCDF files.
You
need to specify the variable dimensions to be used.
I copied over your setup to here, and was able to make some more
progress:
/glade/p/ral/jntp/johnhg/MET_Help/zhuming_data_20210224
And here's the log for my most recent run which does produce matched
pairs
for TMP, but none for U/V wind:
/glade/p/ral/jntp/johnhg/MET_Help/zhuming_data_20210224/metplus/logs/master_metplus.log.20210224124336
Notice that I'm verifying each TMP level separately and not as a
layer.
You could try diffing the versions of PointStat.conf to see what I
changed:
diff /gpfs/fs1/work/zhuming/METplus/PointStat2.conf
/glade/p/ral/jntp/johnhg/MET_Help/zhuming_data_20210224/PointStat2.conf
I'm a little concerned about the point observation files. The qc
values
look to be garbage:
ncdump -v obs_qty_table /glade/scratch/zhuming/metplus/ascii2nc/
obs.2015071500.nc
obs_qty_table =
"0",
"8.10000",
"7.40000",
"NA",
"MOBIL I",
"BIL",
"XX32 KW" ;
Thanks,
John
On Wed, Feb 24, 2021 at 11:11 AM zhuming at ucar.edu via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795 >
>
> Hi!
>
> I also convert WRFout forecast files (NetCDF format) to a new CF
based
> NetCDF (MET accepted format) file using wrfout_to_cf.ncl.
> But MET running was still not successful. I'm doubting the
FCST_VAR_NAME
> was not set correctly.
> Would someone check for me?
>
> Thanks a lot!
> Zhuming
>
> The .conf files are in
/gpfs/fs1/work/zhuming/METplus/PointStat2.conf
> log file:
>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224103241
> the wrf forecast data are in
>
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> 00_cf.nc
>
> little-r format station obs data are in
/glade/scratch/zhuming/step/obs/
>
>
> I changed PointStat2.conf:
>
> #FCST_VAR1_NAME = TMP
>
> #FCST_VAR1_NAME = T_2m
>
> #FCST_VAR1_LEVELS = Z2
>
> FCST_VAR1_NAME = T_p
>
> FCST_VAR1_LEVELS = P750-900
>
> FCST_VAR1_THRESH = <=273, >273
>
> OBS_VAR1_NAME = TMP
>
> #OBS_VAR1_LEVELS = P750-900
>
> OBS_VAR1_LEVELS = Z2
>
> OBS_VAR1_THRESH = <=273, >273
>
>
>
> On Tue, Feb 23, 2021 at 9:06 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Zhuming,
> >
> > I see you're having trouble running METplus on Cheyenne directly
on WRF
> > output files. Thanks for sending paths to all the output files.
I'm
> looking
> > in the PointStat.conf file:
> > /gpfs/fs1/work/zhuming/METplus/PointStat.conf
> >
> > And I see that you'd like to evaluate 10-m winds and temperature
at
> > pressure levels.
> >
> > Here's the issue. The MET tools do not read the raw WRF output
files
> > directly. They can read a subset of the data, but only surface
variables
> > (e.g. not TMP at pressure levels) and only variables on
unstaggered
> > dimensions (e.g. not winds). For this reason, we recommend that
users
> first
> > post-process their raw WRF output using the Unified Post
Processor:
> > https://dtcenter.org/community-code/unified-post-processor-upp
> >
> > It interpolates WRF output to pressure levels, de-staggers the
winds, and
> > writes GRIB1 or GRIB2 output files.
> >
> > Thanks,
> > John Halley Gotway
> >
> > On Mon, Feb 22, 2021 at 3:12 PM zhuming at ucar.edu via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > Mon Feb 22 15:12:01 2021: Request 98795 was acted upon.
> > > Transaction: Ticket created by zhuming at ucar.edu
> > > Queue: met_help
> > > Subject: RMSE using MET/METplus point-stat tool
> > > Owner: Nobody
> > > Requestors: zhuming at ucar.edu
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795
> >
> > >
> > >
> > > Hi,
> > >
> > > Would someone help me?
> > >
> > > Thanks a lot!
> > > Zhuming
> > >
> > > I'm trying to use point-stat tool to get domain-averaged RMSE
etc., for
> > > WRF12h forecasts against their observations, but failed with
following
> > > error information
> > >
> > > I have WRF 12h forecast data in
> > > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
> > >
> > > I have little-r format station obs data in
> > /glade/scratch/zhuming/step/obs/
> > >
> > > The .conf files are in /gpfs/fs1/work/zhuming/METplus/
> > >
> > >
> > > >master_metplus.py -c PointStat.conf -c
./metplus_system.conf.cheyenne
> >
> > x
> > >
> > > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > > (command_builder.py:1032) MET command returned a non-zero return
code:
> > > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > >
> > >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> > >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > > -outdir /glade/scratch/zhuming/metplus/point_stat
> > >
> > > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
> > > (command_builder.py:1032)
> > > MET command returned a non-zero return code:
> > > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > >
> > >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > > 00.nc /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> > >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > > -outdir /glade/scratch/zhuming/metplus/point_stat
> > >
> > > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
> > had
> > > 1 error.
> > >
> > > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR: PointStat
had 1
> > > error.
> > >
> > > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
> finished
> > > running but had 1 error.
> > >
> > > 02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has
finished
> running
> > > but had 1 error.
> > >
> > >
> > >
> > >
> > > more
> >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> > >
> > > 02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called
with
> > command:
> > > /glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
> > >
> > > metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
> > >
> > > 02/22 14:27:35.701 metplus INFO: Log file:
> > >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> > >
> > > 02/22 14:27:36.669 metplus INFO:
> ****************************************
> > >
> > > 02/22 14:27:36.669 metplus INFO: * Running METplus
> > >
> > > 02/22 14:27:36.669 metplus INFO: * at valid time: 201507150000
> > >
> > > 02/22 14:27:36.669 metplus INFO:
> ****************************************
> > >
> > > 02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast
lead 0
> > hours
> > >
> > > 02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
> > > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > > /glade/scratch/zh
> > >
> > > uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-15_00:00:00.nc
> > > /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc /gpfs
> > >
> > >
/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> -outdir
> > > /glade/scratch/zhuming/metplus/point_stat
> > >
> > > MET OUTPUT:
> > >
> > > DEBUG 1: Default Config File:
> > >
> > >
> >
>
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
> > >
> > > DEBUG 1: User Config File:
> > >
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > >
> > > ERROR :
> > >
> > > ERROR : Trouble reading forecast file
> > >
> > >
> >
> "/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > > 00.nc"
> > >
> > > ERROR :
> > >
> > > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > > (command_builder.py:1032) MET command returned a non-zero r
> > >
> > > eturn code:
/glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
> > >
> > > 2_2015-07-15_00:00:00.nc
/glade/scratch/zhuming/metplus/ascii2nc/
> > > obs.2015071500.nc /gpfs/fs1/work/zhuming/METplus/parm/met_confi
> > >
> > > g/PointStatConfig_wrapped -outdir
> > /glade/scratch/zhuming/metplus/point_stat
> > >
> > > 02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile for
more
> > > information on why it failed: /glade/scratch/zhuming/metpl
> > >
> > > us/logs/master_metplus.log.20210222142735
> > >
> > > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
PointStat
> > had
> > > 1 error.
> > >
> > > 02/22 14:27:37.240 metplus INFO:
> > > /glade/scratch/zhuming/metplus/metplus_final.conf: write
metplus.conf
> > here
> > >
> > > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus has
> finished
> > > running but had 1 error.
> > >
> > > 02/22 14:27:37.244 metplus INFO: Check the log file for more
> information:
> > > /glade/scratch/zhuming/metplus/logs/master_metplus.log
> > >
> > > .20210222142735
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: RMSE using MET/METplus point-stat tool
From: zhuming at ucar.edu
Time: Wed Feb 24 15:35:12 2021
Hi John,
I appreciated for your help!!
About processing obs data you mentioned in this email, I may missed
sth.
Would you help me on this? I did as following command:
cheyenne2:/gpfs/fs1/work/zhuming/METplus> master_metplus.py -c
./ASCII2NC.conf ./metplus_system.conf.cheyenne
conf file is /gpfs/fs1/work/zhuming/METplus/ASCII2NC.conf
Obs data with little_r format is
/glade/scratch/zhuming/step/obs/obs.2015071500,
this regional data is from global obs data
/glade/collections/rda/data/ds351.0/little_r/2015/OBS:2015071500.
Actually
I tried to use the global obs data, but the job is stuck there.
met processed obs data in /glade/scratch/zhuming/metplus/ascii2nc
one more thing, I have 12hr forecasts, I need to put the 12hr forecast
fields in one file or just one time for one file?
Thanks!
Zhuming
On Wed, Feb 24, 2021 at 12:45 PM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Zhuming,
>
> Looking in this METplus logfile:
>
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224103241
>
> I found the following error message:
> *ERROR : NcCfFile::getData(NcVar *, const LongArray &, DataPlane &)
const
> -> needed 4 arguments for variable T_p, got 2*
>
> You're trying to process the "T_p" variable
> from wrfout_d02_2015-07-15_00:00:00_cf.nc:
> * float T_p(time, pressure, south_north, west_east) ;*
>
> The format for the level string differs when processing NetCDF
files. You
> need to specify the variable dimensions to be used.
>
> I copied over your setup to here, and was able to make some more
progress:
> /glade/p/ral/jntp/johnhg/MET_Help/zhuming_data_20210224
>
> And here's the log for my most recent run which does produce matched
pairs
> for TMP, but none for U/V wind:
>
>
/glade/p/ral/jntp/johnhg/MET_Help/zhuming_data_20210224/metplus/logs/master_metplus.log.20210224124336
>
> Notice that I'm verifying each TMP level separately and not as a
layer.
>
> You could try diffing the versions of PointStat.conf to see what I
changed:
>
> diff /gpfs/fs1/work/zhuming/METplus/PointStat2.conf
>
/glade/p/ral/jntp/johnhg/MET_Help/zhuming_data_20210224/PointStat2.conf
>
> I'm a little concerned about the point observation files. The qc
values
> look to be garbage:
>
> ncdump -v obs_qty_table /glade/scratch/zhuming/metplus/ascii2nc/
> obs.2015071500.nc
>
> obs_qty_table =
> "0",
> "8.10000",
> "7.40000",
> "NA",
> "MOBIL I",
> "BIL",
> "XX32 KW" ;
>
> Thanks,
> John
>
> On Wed, Feb 24, 2021 at 11:11 AM zhuming at ucar.edu via RT <
> met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795 >
> >
> > Hi!
> >
> > I also convert WRFout forecast files (NetCDF format) to a new CF
based
> > NetCDF (MET accepted format) file using wrfout_to_cf.ncl.
> > But MET running was still not successful. I'm doubting the
FCST_VAR_NAME
> > was not set correctly.
> > Would someone check for me?
> >
> > Thanks a lot!
> > Zhuming
> >
> > The .conf files are in
/gpfs/fs1/work/zhuming/METplus/PointStat2.conf
> > log file:
> >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210224103241
> > the wrf forecast data are in
> >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > 00_cf.nc
> >
> > little-r format station obs data are in
/glade/scratch/zhuming/step/obs/
> >
> >
> > I changed PointStat2.conf:
> >
> > #FCST_VAR1_NAME = TMP
> >
> > #FCST_VAR1_NAME = T_2m
> >
> > #FCST_VAR1_LEVELS = Z2
> >
> > FCST_VAR1_NAME = T_p
> >
> > FCST_VAR1_LEVELS = P750-900
> >
> > FCST_VAR1_THRESH = <=273, >273
> >
> > OBS_VAR1_NAME = TMP
> >
> > #OBS_VAR1_LEVELS = P750-900
> >
> > OBS_VAR1_LEVELS = Z2
> >
> > OBS_VAR1_THRESH = <=273, >273
> >
> >
> >
> > On Tue, Feb 23, 2021 at 9:06 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Zhuming,
> > >
> > > I see you're having trouble running METplus on Cheyenne directly
on WRF
> > > output files. Thanks for sending paths to all the output files.
I'm
> > looking
> > > in the PointStat.conf file:
> > > /gpfs/fs1/work/zhuming/METplus/PointStat.conf
> > >
> > > And I see that you'd like to evaluate 10-m winds and temperature
at
> > > pressure levels.
> > >
> > > Here's the issue. The MET tools do not read the raw WRF output
files
> > > directly. They can read a subset of the data, but only surface
> variables
> > > (e.g. not TMP at pressure levels) and only variables on
unstaggered
> > > dimensions (e.g. not winds). For this reason, we recommend that
users
> > first
> > > post-process their raw WRF output using the Unified Post
Processor:
> > > https://dtcenter.org/community-code/unified-post-processor-upp
> > >
> > > It interpolates WRF output to pressure levels, de-staggers the
winds,
> and
> > > writes GRIB1 or GRIB2 output files.
> > >
> > > Thanks,
> > > John Halley Gotway
> > >
> > > On Mon, Feb 22, 2021 at 3:12 PM zhuming at ucar.edu via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > >
> > > > Mon Feb 22 15:12:01 2021: Request 98795 was acted upon.
> > > > Transaction: Ticket created by zhuming at ucar.edu
> > > > Queue: met_help
> > > > Subject: RMSE using MET/METplus point-stat tool
> > > > Owner: Nobody
> > > > Requestors: zhuming at ucar.edu
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98795
> > >
> > > >
> > > >
> > > > Hi,
> > > >
> > > > Would someone help me?
> > > >
> > > > Thanks a lot!
> > > > Zhuming
> > > >
> > > > I'm trying to use point-stat tool to get domain-averaged RMSE
etc.,
> for
> > > > WRF12h forecasts against their observations, but failed with
> following
> > > > error information
> > > >
> > > > I have WRF 12h forecast data in
> > > > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02*
> > > >
> > > > I have little-r format station obs data in
> > > /glade/scratch/zhuming/step/obs/
> > > >
> > > > The .conf files are in /gpfs/fs1/work/zhuming/METplus/
> > > >
> > > >
> > > > >master_metplus.py -c PointStat.conf -c
> ./metplus_system.conf.cheyenne
> > >
> > > x
> > > >
> > > > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > > > (command_builder.py:1032) MET command returned a non-zero
return
> code:
> > > > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > > >
> > > >
> > >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > > > 00.nc
/glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> > > >
>
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > > > -outdir /glade/scratch/zhuming/metplus/point_stat
> > > >
> > > > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
> > > > (command_builder.py:1032)
> > > > MET command returned a non-zero return code:
> > > > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > > >
> > > >
> > >
> >
> /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > > > 00.nc
/glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
> > > >
>
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > > > -outdir /glade/scratch/zhuming/metplus/point_stat
> > > >
> > > > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
> PointStat
> > > had
> > > > 1 error.
> > > >
> > > > 02/22 14:27:37Z run-METplus-metplus.PointStat: ERROR:
PointStat had
> 1
> > > > error.
> > > >
> > > > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus
has
> > finished
> > > > running but had 1 error.
> > > >
> > > > 02/22 14:27:37Z run-METplus-metplus: ERROR: METplus has
finished
> > running
> > > > but had 1 error.
> > > >
> > > >
> > > >
> > > >
> > > > more
> > >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> > > >
> > > > 02/22 14:27:35.701 metplus INFO: Running METplus v3.1 called
with
> > > command:
> > > > /glade/p/ral/jntp/MET/METplus/METplus-3.1/ush/master_
> > > >
> > > > metplus.py -c PointStat.conf -c ./metplus_system.conf.cheyenne
> > > >
> > > > 02/22 14:27:35.701 metplus INFO: Log file:
> > > >
/glade/scratch/zhuming/metplus/logs/master_metplus.log.20210222142735
> > > >
> > > > 02/22 14:27:36.669 metplus INFO:
> > ****************************************
> > > >
> > > > 02/22 14:27:36.669 metplus INFO: * Running METplus
> > > >
> > > > 02/22 14:27:36.669 metplus INFO: * at valid time:
201507150000
> > > >
> > > > 02/22 14:27:36.669 metplus INFO:
> > ****************************************
> > > >
> > > > 02/22 14:27:36.670 metplus.PointStat INFO: Processing forecast
lead 0
> > > hours
> > > >
> > > > 02/22 14:27:36.676 metplus.PointStat INFO: COMMAND:
> > > > /glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v 2
> > > > /glade/scratch/zh
> > > >
> > > > uming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:00.nc
> > > > /glade/scratch/zhuming/metplus/ascii2nc/obs.2015071500.nc
/gpfs
> > > >
> > > >
/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > -outdir
> > > > /glade/scratch/zhuming/metplus/point_stat
> > > >
> > > > MET OUTPUT:
> > > >
> > > > DEBUG 1: Default Config File:
> > > >
> > > >
> > >
> >
>
/glade/p/ral/jntp/MET/MET_releases/9.1/share/met/config/PointStatConfig_default
> > > >
> > > > DEBUG 1: User Config File:
> > > >
>
/gpfs/fs1/work/zhuming/METplus/parm/met_config/PointStatConfig_wrapped
> > > >
> > > > ERROR :
> > > >
> > > > ERROR : Trouble reading forecast file
> > > >
> > > >
> > >
> >
> "/glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d02_2015-07-
15_00:00:
> > > > 00.nc"
> > > >
> > > > ERROR :
> > > >
> > > > 02/22 14:27:37.239 metplus.PointStat (command_builder.py:122)
ERROR:
> > > > (command_builder.py:1032) MET command returned a non-zero r
> > > >
> > > > eturn code:
/glade/p/ral/jntp/MET/MET_releases/9.1/bin/point_stat -v
> 2
> > > > /glade/scratch/zhuming/step/ctrl4/fc/2015071500/wrfout_d0
> > > >
> > > > 2_2015-07-15_00:00:00.nc
/glade/scratch/zhuming/metplus/ascii2nc/
> > > > obs.2015071500.nc
/gpfs/fs1/work/zhuming/METplus/parm/met_confi
> > > >
> > > > g/PointStatConfig_wrapped -outdir
> > > /glade/scratch/zhuming/metplus/point_stat
> > > >
> > > > 02/22 14:27:37.240 metplus.PointStat INFO: Check the logfile
for more
> > > > information on why it failed: /glade/scratch/zhuming/metpl
> > > >
> > > > us/logs/master_metplus.log.20210222142735
> > > >
> > > > 02/22 14:27:37.240 metplus.PointStat (met_util.py:210) ERROR:
> PointStat
> > > had
> > > > 1 error.
> > > >
> > > > 02/22 14:27:37.240 metplus INFO:
> > > > /glade/scratch/zhuming/metplus/metplus_final.conf: write
metplus.conf
> > > here
> > > >
> > > > 02/22 14:27:37.244 metplus (met_util.py:245) ERROR: METplus
has
> > finished
> > > > running but had 1 error.
> > > >
> > > > 02/22 14:27:37.244 metplus INFO: Check the log file for more
> > information:
> > > > /glade/scratch/zhuming/metplus/logs/master_metplus.log
> > > >
> > > > .20210222142735
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
More information about the Met_help
mailing list