[Met_help] [rt.rap.ucar.edu #80219] History for Not using climo file

Thu Jun 15 10:31:40 MDT 2017

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

John, Since I am waiting for your answer on the error I am getting using
your description for precip thresholds in config file, I moved on to
verifying Total Cloud Percent using WWMCA as ground truth.  When I run the
following job I get the message that 0 climo mean fields were found.  On the
ftp server I stored  the netcdf climo file I am using.   

/h/WXQC/met-5.2/bin/grid_stat
/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.0024
/h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc
/h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated -outdir
/h/data/global/WXQC/data/met/gdstat/geps -v 3

The message I get is:

['/h/WXQC/met-5.2/bin/grid_stat',
'/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.002
4', '/h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc',
'/h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated', '-outdir',
'/h/data/global/WXQC/data/met/gdstat/geps', '-v', '3']

DEBUG 1: Default Config File:
/h/WXQC/met-5.2/share/met/config/GridStatConfig_default

DEBUG 1: User Config File:
/h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated

DEBUG 3: Switching the GRIB2 radius of the earth value of 6367.47 km to
6371.2 km for internal consistency.

DEBUG 3: Use the forecast grid.

DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 360 Ny: 181 lat_ll:
-90.000 lon_ll: -0.000 delta_lat: 1.000 delta_lon: 1.000

GSL_RNG_TYPE=mt19937

GSL_RNG_SEED=130938968

DEBUG 1: Forecast File:
/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.0024

DEBUG 1: Observation File:
/h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc

DEBUG 3: Reading forecast data for PC80/L0.

DEBUG 3: MetGrib2DataFile::data_plane() - Found exact match for 'PC80/L0' in
GRIB2 record 327 field 1 of GRIB2 file
'/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.002
4'

DEBUG 3: Reading observation data for Cloud_Pct(*,*).

WARNING:

WARNING: process_scores() -> Forecast and observation valid times do not
match 20170412_180000 != 20170413_000000 for PC80/L0 versus Cloud_Pct(*,*).

WARNING:

DEBUG 3: Found 0 climatology mean field(s) for forecast PC80/L0.

DEBUG 2:

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2:

DEBUG 3: Smoothing field using the NEAREST(1) interpolation method.

DEBUG 2: Processing PC80/L0 versus Cloud_Pct(*,*), for interpolation method
NEAREST(1), over region FULL, using 64980 pairs.

DEBUG 2:

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2:

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V.
stat

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V_
pstd.txt

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V_
pairs.nc

The time mismatch warning is because the grib 2 total cloud field is a 6
hour average.  I assume this is not causing any problems.  Also, this there
a way to use pcp_combine to convert any binary file to netcdf?  We are
currently have problems with our python netcdf libraries.

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Not using climo file
From: John Halley Gotway
Time: Tue Apr 25 22:07:55 2017

Bob,

I apologize for not getting back to you about these issues.  I'm on
travel
on this week and unfortunately won't be able to take a closer look
until
next Monday.

Thanks
John

On Thu, Apr 20, 2017 at 11:14 AM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Thu Apr 20 09:14:12 2017: Request 80219 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Not using climo file
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80219 >
>
>
> John, Since I am waiting for your answer on the error I am getting
using
> your description for precip thresholds in config file, I moved on to
> verifying Total Cloud Percent using WWMCA as ground truth.  When I
run the
> following job I get the message that 0 climo mean fields were found.
On
> the
> ftp server I stored  the netcdf climo file I am using.
>
>
>
> /h/WXQC/met-5.2/bin/grid_stat
>
>
/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.0024
> /h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc
> /h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated -outdir
> /h/data/global/WXQC/data/met/gdstat/geps -v 3
>
>
>
> The message I get is:
>
>
>
> ['/h/WXQC/met-5.2/bin/grid_stat',
>
>
'/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.002
> 4', '/h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc',
> '/h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated', '-
outdir',
> '/h/data/global/WXQC/data/met/gdstat/geps', '-v', '3']
>
> DEBUG 1: Default Config File:
> /h/WXQC/met-5.2/share/met/config/GridStatConfig_default
>
> DEBUG 1: User Config File:
> /h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated
>
> DEBUG 3: Switching the GRIB2 radius of the earth value of 6367.47 km
to
> 6371.2 km for internal consistency.
>
> DEBUG 3: Use the forecast grid.
>
> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 360 Ny: 181
lat_ll:
> -90.000 lon_ll: -0.000 delta_lat: 1.000 delta_lon: 1.000
>
> GSL_RNG_TYPE=mt19937
>
> GSL_RNG_SEED=130938968
>
> DEBUG 1: Forecast File:
>
>
/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.0024
>
> DEBUG 1: Observation File:
> /h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc
>
> DEBUG 3: Reading forecast data for PC80/L0.
>
> DEBUG 3: MetGrib2DataFile::data_plane() - Found exact match for
'PC80/L0'
> in
> GRIB2 record 327 field 1 of GRIB2 file
>
>
'/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.2017041200.002
> 4'
>
> DEBUG 3: Reading observation data for Cloud_Pct(*,*).
>
> WARNING:
>
> WARNING: process_scores() -> Forecast and observation valid times do
not
> match 20170412_180000 != 20170413_000000 for PC80/L0 versus
Cloud_Pct(*,*).
>
> WARNING:
>
> DEBUG 3: Found 0 climatology mean field(s) for forecast PC80/L0.
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 3: Smoothing field using the NEAREST(1) interpolation method.
>
> DEBUG 3: Smoothing field using the NEAREST(1) interpolation method.
>
> DEBUG 2: Processing PC80/L0 versus Cloud_Pct(*,*), for interpolation
method
> NEAREST(1), over region FULL, using 64980 pairs.
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V.
> stat
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V_
> pstd.txt
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V_
> pairs.nc
>
>
>
> The time mismatch warning is because the grib 2 total cloud field is
a 6
> hour average.  I assume this is not causing any problems.  Also,
this there
> a way to use pcp_combine to convert any binary file to netcdf?  We
are
> currently have problems with our python netcdf libraries.
>
>
>

------------------------------------------------
Subject: RE: [Non-DoD Source] Re: [rt.rap.ucar.edu #80219] Not using climo file
From: robert.craig.2 at us.af.mil
Time: Wed Apr 26 06:53:33 2017

Thanks John, I am sure I will have another question by then :)
Bob

-----Original Message-----
From: John Halley Gotway via RT [mailto:met_help at ucar.edu]
Sent: Tuesday, April 25, 2017 11:08 PM
To: CRAIG, ROBERT J GS-12 USAF ACC 16 WS/WXN
<robert.craig.2 at us.af.mil>
Cc: SITTEL, MATTHEW C CTR USAF AFMC AFLCMC/HBAW-OL
<matthew.sittel.ctr at us.af.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #80219] Not using climo
file

Bob,

I apologize for not getting back to you about these issues.  I'm on
travel on this week and unfortunately won't be able to take a closer
look until next Monday.

Thanks
John

On Thu, Apr 20, 2017 at 11:14 AM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Thu Apr 20 09:14:12 2017: Request 80219 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Not using climo file
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=80219
> >
>
>
> John, Since I am waiting for your answer on the error I am getting
> using your description for precip thresholds in config file, I moved
> on to verifying Total Cloud Percent using WWMCA as ground truth.
When
> I run the following job I get the message that 0 climo mean fields
> were found.  On the ftp server I stored  the netcdf climo file I am
> using.
>
>
>
> /h/WXQC/met-5.2/bin/grid_stat
>
>
/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.201704120
> 0.0024 /h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc
> /h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated -outdir
> /h/data/global/WXQC/data/met/gdstat/geps -v 3
>
>
>
> The message I get is:
>
>
>
> ['/h/WXQC/met-5.2/bin/grid_stat',
>
>
'/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.20170412
> 00.002 4',
> '/h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc',
> '/h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated', '-
outdir',
> '/h/data/global/WXQC/data/met/gdstat/geps', '-v', '3']
>
> DEBUG 1: Default Config File:
> /h/WXQC/met-5.2/share/met/config/GridStatConfig_default
>
> DEBUG 1: User Config File:
> /h/WXQC/met-5.2/data/config/GridStatConfig_geps_updated
>
> DEBUG 3: Switching the GRIB2 radius of the earth value of 6367.47 km
> to
> 6371.2 km for internal consistency.
>
> DEBUG 3: Use the forecast grid.
>
> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 360 Ny: 181
lat_ll:
> -90.000 lon_ll: -0.000 delta_lat: 1.000 delta_lon: 1.000
>
> GSL_RNG_TYPE=mt19937
>
> GSL_RNG_SEED=130938968
>
> DEBUG 1: Forecast File:
>
>
/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.201704120
> 0.0024
>
> DEBUG 1: Observation File:
> /h/data/global/WXQC/data/met/nc_obs/wwmca/201704130000.nc
>
> DEBUG 3: Reading forecast data for PC80/L0.
>
> DEBUG 3: MetGrib2DataFile::data_plane() - Found exact match for
'PC80/L0'
> in
> GRIB2 record 327 field 1 of GRIB2 file
>
>
'/h/data/global/WXQC/data/geps_verify/qcsave/2017041200/grib2.20170412
> 00.002
> 4'
>
> DEBUG 3: Reading observation data for Cloud_Pct(*,*).
>
> WARNING:
>
> WARNING: process_scores() -> Forecast and observation valid times do
> not match 20170412_180000 != 20170413_000000 for PC80/L0 versus
Cloud_Pct(*,*).
>
> WARNING:
>
> DEBUG 3: Found 0 climatology mean field(s) for forecast PC80/L0.
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------
> ------
> ----
>
> DEBUG 2:
>
> DEBUG 3: Smoothing field using the NEAREST(1) interpolation method.
>
> DEBUG 3: Smoothing field using the NEAREST(1) interpolation method.
>
> DEBUG 2: Processing PC80/L0 versus Cloud_Pct(*,*), for interpolation
> method NEAREST(1), over region FULL, using 64980 pairs.
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------
> ------
> ----
>
> DEBUG 2:
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_180000V.
> stat
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_18
> 0000V_
> pstd.txt
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/gdstat/geps/grid_stat_180000L_20170412_18
> 0000V_
> pairs.nc
>
>
>
> The time mismatch warning is because the grib 2 total cloud field is
a
> 6 hour average.  I assume this is not causing any problems.  Also,
> this there a way to use pcp_combine to convert any binary file to
> netcdf?  We are currently have problems with our python netcdf
libraries.
>
>
>

------------------------------------------------