[Met_help] [rt.rap.ucar.edu #89055] History for Empty output files produced.
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:06:59 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello Methelp,
I am trying to verify model outputs with observation which was in Little_R and combined into a single 24hrs netcdf file using the ascii2nc tool. Below is my issued command: point_stat clippedfc.nc pointobs20190217_24.nc PointStatConfig_default -v 3
And my output is as follows:
DEBUG 1: Default Config File: /Users/bamideleoloruntoba/MET/met-8.0/share/met/config/PointStatConfig_default
DEBUG 1: User Config File: PointStatConfig_default
WARNING:
WARNING: NcCfFile::open() -> could not determine the valid time, using 0.
WARNING:
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=415593052
DEBUG 1: Forecast File: clippedfc.nc
DEBUG 1: Observation File: pointobs20190217_24.nc
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Reading data for APCP_24Z0.
DEBUG 3: Use the matching forecast and observation grids.
DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161 lat_ll: -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
DEBUG 2: Processing masking regions.
DEBUG 3: Processing grid mask: FULL
DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology mean levels, and 0 climatology standard deviation levels.
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Searching 14109 observations from 1868 messages.
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type ADPUPA, over region FULL, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 14109
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: obs type = 14109
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type ADPSFC, over region FULL, for interpolation method NEAREST(1), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 14109
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: obs type = 14109
DEBUG 3: Rejected: valid time = 0
DEBUG 3: Rejected: bad obs value = 0
DEBUG 3: Rejected: off the grid = 0
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2: --------------------------------------------------------------------------------
DEBUG 2:
DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_ctc.txt
DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cts.txt
DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_mctc.txt
DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_mcts.txt
DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cnt.txt
There seems to be no error, but all the generated output files contained only headers. They had no results in them.
My 2 input files and configuration files are hereby attached.
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Empty output files produced.
From: John Halley Gotway
Time: Mon Feb 25 15:57:07 2019
Hello,
I see that you're getting 0 matched pairs from the Point-Stat tool.
Thanks
for sending some sample data. You've already done the right thing by
running at verbosity level 3 (-v 3) to dump out the counts for why
observations were/were not used. In your case, it's very obvious:
*DEBUG 3: Observations processed = 14109DEBUG 3: Rejected: obs type
= 14109*
Your data just doesn't contain any observations of precip.
Your Point-Stat config file, indicates that you're looking for
observations
of APCP:
*obs = { field = [ { name="APCP"; level="A1"; cat_thresh = [>=0,
>=10.0,
>=30.0, >=50.0]; } ];}*
APCP corresponds to GRIB code 61. But when I look at the "obs_gc"
variable
from your point observations, there just aren't any 61's in the data:
*ncdump -v obs_gc pointobs20190217_24.nc
<http://pointobs20190217_24.nc>*
For testing, I rerun Point-Stat looking for observations of 2-meter
Temperature:
*obs = { field = [ { name="TMP"; level="Z2"; cat_thresh = [>=0,
>=10.0,
>=30.0, >=50.0]; } ];}*
That made it further, but I still got 0 matched pairs because MET
isn't
able to parse the timing info from your model file.
Looks like your forecast NetCDF is a mixture of MET conventions and
NetCDF
CF-conventions. You just need to pick one and go with it.
If you pick the MET convention, you'll need to fix the grid definition
info
which is inconsistent with the dimensions of the data:
The dimensions indicate a 151x161 grid:
*dimensions: lon = 151 ; lat = 161 ;*
The global attributes indicate a 361x361 grid:
* :Projection = "LatLon" ; :lat_ll =
"-90.000000 degrees_north" ; :lon_ll = "-90.000000
degrees_east" ; :delta_lat = "0.500000 degrees"
; :delta_lon = "0.500000 degrees" ;
:Nlat =
"361 grid_points" ; :Nlon = "361 grid_points" ;*
If you pick the NetCDF CF-Conventions, then you'll need to specify the
timing info a CF-compliant way.
Hope this helps.
Thanks,
John Halley Gotway
On Sun, Feb 24, 2019 at 9:45 AM Bamidele Oloruntoba via RT <
met_help at ucar.edu> wrote:
>
> Sun Feb 24 09:45:24 2019: Request 89055 was acted upon.
> Transaction: Ticket created by deleignition at icloud.com
> Queue: met_help
> Subject: Empty output files produced.
> Owner: Nobody
> Requestors: deleignition at icloud.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89055 >
>
>
>
> Hello Methelp,
> I am trying to verify model outputs with observation which was in
Little_R
> and combined into a single 24hrs netcdf file using the ascii2nc
tool. Below
> is my issued command: point_stat clippedfc.nc pointobs20190217_24.nc
> PointStatConfig_default -v 3
> And my output is as follows:
> DEBUG 1: Default Config File:
> /Users/bamideleoloruntoba/MET/met-
8.0/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: PointStatConfig_default
> WARNING:
> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
> WARNING:
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=415593052
> DEBUG 1: Forecast File: clippedfc.nc
> DEBUG 1: Observation File: pointobs20190217_24.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for APCP_24Z0.
> DEBUG 3: Use the matching forecast and observation grids.
> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161
lat_ll:
> -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
> DEBUG 2: Processing masking regions.
> DEBUG 3: Processing grid mask: FULL
> DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology mean
levels,
> and 0 climatology standard deviation levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 14109 observations from 1868 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPUPA,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 14109
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: obs type = 14109
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPSFC,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 14109
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: obs type = 14109
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cts.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cnt.txt
> There seems to be no error, but all the generated output files
contained
> only headers. They had no results in them.
> My 2 input files and configuration files are hereby attached.
>
>
> Hello Methelp,
> I am trying to verify model outputs with observation which was in
Little_R
> and combined into a single 24hrs netcdf file using the ascii2nc
tool. Below
> is my issued command: point_stat clippedfc.nc pointobs20190217_24.nc
> PointStatConfig_default -v 3
> And my output is as follows:
> DEBUG 1: Default Config File:
> /Users/bamideleoloruntoba/MET/met-
8.0/share/met/config/PointStatConfig_default
> DEBUG 1: User Config File: PointStatConfig_default
> WARNING:
> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
> WARNING:
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=415593052
> DEBUG 1: Forecast File: clippedfc.nc
> DEBUG 1: Observation File: pointobs20190217_24.nc
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Reading data for APCP_24Z0.
> DEBUG 3: Use the matching forecast and observation grids.
> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161
lat_ll:
> -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
> DEBUG 2: Processing masking regions.
> DEBUG 3: Processing grid mask: FULL
> DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology mean
levels,
> and 0 climatology standard deviation levels.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Searching 14109 observations from 1868 messages.
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPUPA,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 14109
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: obs type = 14109
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPSFC,
> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> DEBUG 3: Number of matched pairs = 0
> DEBUG 3: Observations processed = 14109
> DEBUG 3: Rejected: SID exclusion = 0
> DEBUG 3: Rejected: obs type = 14109
> DEBUG 3: Rejected: valid time = 0
> DEBUG 3: Rejected: bad obs value = 0
> DEBUG 3: Rejected: off the grid = 0
> DEBUG 3: Rejected: level mismatch = 0
> DEBUG 3: Rejected: quality marker = 0
> DEBUG 3: Rejected: message type = 0
> DEBUG 3: Rejected: masking region = 0
> DEBUG 3: Rejected: bad fcst value = 0
> DEBUG 3: Rejected: duplicates = 0
> DEBUG 2:
> DEBUG 2:
>
--------------------------------------------------------------------------------
> DEBUG 2:
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_ctc.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cts.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_mctc.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_mcts.txt
> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cnt.txt
> There seems to be no error, but all the generated output files
contained
> only headers. They had no results in them.
> My 2 input files and configuration files are hereby attached.
>
------------------------------------------------
Subject: Empty output files produced.
From: Bamidele Oloruntoba
Time: Tue Feb 26 00:27:52 2019
Thank you John for the response,
I wouldn’t have thought that the precipitation over such a huge domain
could escape reporting (this could just be a major advantage of
gridded observations over station data -satellites don’t sleep). Thank
you for calming my nerves. I am guessing the introduction of the CF
convention into my forecast data occurred when I used CDO’s
sellonlatbox to clip the model file to my domain of interest. If not,
everything on the forecast file had been MET convention. So how do you
suggest I go about the harmonization?
And lest I forget John, thank you for helping me install MET on this
Mac in the last tutorials in Boulder. I can’t wait to have the whole
METPlus package in one suit.
Thanks once again.
Bamidele OLORUNTOBA
African Centre of Meteorological Applications for Development (ACMAD)
> On Feb 25, 2019, at 11:57 PM, John Halley Gotway via RT
<met_help at ucar.edu> wrote:
>
> Hello,
>
> I see that you're getting 0 matched pairs from the Point-Stat tool.
Thanks
> for sending some sample data. You've already done the right thing
by
> running at verbosity level 3 (-v 3) to dump out the counts for why
> observations were/were not used. In your case, it's very obvious:
>
>
> *DEBUG 3: Observations processed = 14109DEBUG 3: Rejected: obs
type
> = 14109*
>
> Your data just doesn't contain any observations of precip.
>
> Your Point-Stat config file, indicates that you're looking for
observations
> of APCP:
>
>
> *obs = { field = [ { name="APCP"; level="A1"; cat_thresh = [>=0,
>=10.0,
>> =30.0, >=50.0]; } ];}*
>
> APCP corresponds to GRIB code 61. But when I look at the "obs_gc"
variable
> from your point observations, there just aren't any 61's in the
data:
> *ncdump -v obs_gc pointobs20190217_24.nc
<http://pointobs20190217_24.nc>*
>
> For testing, I rerun Point-Stat looking for observations of 2-meter
> Temperature:
>
>
> *obs = { field = [ { name="TMP"; level="Z2"; cat_thresh = [>=0,
>=10.0,
>> =30.0, >=50.0]; } ];}*
>
> That made it further, but I still got 0 matched pairs because MET
isn't
> able to parse the timing info from your model file.
>
> Looks like your forecast NetCDF is a mixture of MET conventions and
NetCDF
> CF-conventions. You just need to pick one and go with it.
>
> If you pick the MET convention, you'll need to fix the grid
definition info
> which is inconsistent with the dimensions of the data:
> The dimensions indicate a 151x161 grid:
>
>
> *dimensions: lon = 151 ; lat = 161 ;*
>
> The global attributes indicate a 361x361 grid:
>
>
>
>
>
>
> * :Projection = "LatLon" ; :lat_ll =
> "-90.000000 degrees_north" ; :lon_ll = "-90.000000
> degrees_east" ; :delta_lat = "0.500000 degrees"
> ; :delta_lon = "0.500000 degrees" ;
:Nlat =
> "361 grid_points" ; :Nlon = "361 grid_points" ;*
>
> If you pick the NetCDF CF-Conventions, then you'll need to specify
the
> timing info a CF-compliant way.
>
> Hope this helps.
>
> Thanks,
> John Halley Gotway
>
>
>
>
> On Sun, Feb 24, 2019 at 9:45 AM Bamidele Oloruntoba via RT <
> met_help at ucar.edu> wrote:
>
>>
>> Sun Feb 24 09:45:24 2019: Request 89055 was acted upon.
>> Transaction: Ticket created by deleignition at icloud.com
>> Queue: met_help
>> Subject: Empty output files produced.
>> Owner: Nobody
>> Requestors: deleignition at icloud.com
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89055 >
>>
>>
>>
>> Hello Methelp,
>> I am trying to verify model outputs with observation which was in
Little_R
>> and combined into a single 24hrs netcdf file using the ascii2nc
tool. Below
>> is my issued command: point_stat clippedfc.nc
pointobs20190217_24.nc
>> PointStatConfig_default -v 3
>> And my output is as follows:
>> DEBUG 1: Default Config File:
>> /Users/bamideleoloruntoba/MET/met-
8.0/share/met/config/PointStatConfig_default
>> DEBUG 1: User Config File: PointStatConfig_default
>> WARNING:
>> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
>> WARNING:
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=415593052
>> DEBUG 1: Forecast File: clippedfc.nc
>> DEBUG 1: Observation File: pointobs20190217_24.nc
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Reading data for APCP_24Z0.
>> DEBUG 3: Use the matching forecast and observation grids.
>> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161
lat_ll:
>> -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
>> DEBUG 2: Processing masking regions.
>> DEBUG 3: Processing grid mask: FULL
>> DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology mean
levels,
>> and 0 climatology standard deviation levels.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Searching 14109 observations from 1868 messages.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPUPA,
>> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
>> DEBUG 3: Number of matched pairs = 0
>> DEBUG 3: Observations processed = 14109
>> DEBUG 3: Rejected: SID exclusion = 0
>> DEBUG 3: Rejected: obs type = 14109
>> DEBUG 3: Rejected: valid time = 0
>> DEBUG 3: Rejected: bad obs value = 0
>> DEBUG 3: Rejected: off the grid = 0
>> DEBUG 3: Rejected: level mismatch = 0
>> DEBUG 3: Rejected: quality marker = 0
>> DEBUG 3: Rejected: message type = 0
>> DEBUG 3: Rejected: masking region = 0
>> DEBUG 3: Rejected: bad fcst value = 0
>> DEBUG 3: Rejected: duplicates = 0
>> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPSFC,
>> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
>> DEBUG 3: Number of matched pairs = 0
>> DEBUG 3: Observations processed = 14109
>> DEBUG 3: Rejected: SID exclusion = 0
>> DEBUG 3: Rejected: obs type = 14109
>> DEBUG 3: Rejected: valid time = 0
>> DEBUG 3: Rejected: bad obs value = 0
>> DEBUG 3: Rejected: off the grid = 0
>> DEBUG 3: Rejected: level mismatch = 0
>> DEBUG 3: Rejected: quality marker = 0
>> DEBUG 3: Rejected: message type = 0
>> DEBUG 3: Rejected: masking region = 0
>> DEBUG 3: Rejected: bad fcst value = 0
>> DEBUG 3: Rejected: duplicates = 0
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_ctc.txt
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cts.txt
>> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mctc.txt
>> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mcts.txt
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cnt.txt
>> There seems to be no error, but all the generated output files
contained
>> only headers. They had no results in them.
>> My 2 input files and configuration files are hereby attached.
>>
>>
>> Hello Methelp,
>> I am trying to verify model outputs with observation which was in
Little_R
>> and combined into a single 24hrs netcdf file using the ascii2nc
tool. Below
>> is my issued command: point_stat clippedfc.nc
pointobs20190217_24.nc
>> PointStatConfig_default -v 3
>> And my output is as follows:
>> DEBUG 1: Default Config File:
>> /Users/bamideleoloruntoba/MET/met-
8.0/share/met/config/PointStatConfig_default
>> DEBUG 1: User Config File: PointStatConfig_default
>> WARNING:
>> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
>> WARNING:
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=415593052
>> DEBUG 1: Forecast File: clippedfc.nc
>> DEBUG 1: Observation File: pointobs20190217_24.nc
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Reading data for APCP_24Z0.
>> DEBUG 3: Use the matching forecast and observation grids.
>> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161
lat_ll:
>> -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
>> DEBUG 2: Processing masking regions.
>> DEBUG 3: Processing grid mask: FULL
>> DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology mean
levels,
>> and 0 climatology standard deviation levels.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Searching 14109 observations from 1868 messages.
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPUPA,
>> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
>> DEBUG 3: Number of matched pairs = 0
>> DEBUG 3: Observations processed = 14109
>> DEBUG 3: Rejected: SID exclusion = 0
>> DEBUG 3: Rejected: obs type = 14109
>> DEBUG 3: Rejected: valid time = 0
>> DEBUG 3: Rejected: bad obs value = 0
>> DEBUG 3: Rejected: off the grid = 0
>> DEBUG 3: Rejected: level mismatch = 0
>> DEBUG 3: Rejected: quality marker = 0
>> DEBUG 3: Rejected: message type = 0
>> DEBUG 3: Rejected: masking region = 0
>> DEBUG 3: Rejected: bad fcst value = 0
>> DEBUG 3: Rejected: duplicates = 0
>> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation type
ADPSFC,
>> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
>> DEBUG 3: Number of matched pairs = 0
>> DEBUG 3: Observations processed = 14109
>> DEBUG 3: Rejected: SID exclusion = 0
>> DEBUG 3: Rejected: obs type = 14109
>> DEBUG 3: Rejected: valid time = 0
>> DEBUG 3: Rejected: bad obs value = 0
>> DEBUG 3: Rejected: off the grid = 0
>> DEBUG 3: Rejected: level mismatch = 0
>> DEBUG 3: Rejected: quality marker = 0
>> DEBUG 3: Rejected: message type = 0
>> DEBUG 3: Rejected: masking region = 0
>> DEBUG 3: Rejected: bad fcst value = 0
>> DEBUG 3: Rejected: duplicates = 0
>> DEBUG 2:
>> DEBUG 2:
>>
--------------------------------------------------------------------------------
>> DEBUG 2:
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_ctc.txt
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cts.txt
>> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mctc.txt
>> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mcts.txt
>> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V_cnt.txt
>> There seems to be no error, but all the generated output files
contained
>> only headers. They had no results in them.
>> My 2 input files and configuration files are hereby attached.
>>
>
------------------------------------------------
Subject: Empty output files produced.
From: John Halley Gotway
Time: Thu Feb 28 15:53:37 2019
Bamidele,
I haven't used CDO's sellonlatbox function to subset data in the past.
As
long as MET can read your data, then regridding it to another domain
is
pretty easy in the MET config files. In order to get up and running
more
quickly, I'd suggest sticking with the full 361x361 domain... and not
running selllonlatbox.
If you do want to subset the data, you could either using the "regrid"
capability in the MET config files... or run the regrid_data_plane
tool to
do it manually.
John
On Tue, Feb 26, 2019 at 12:28 AM Bamidele Oloruntoba via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89055 >
>
> Thank you John for the response,
> I wouldn’t have thought that the precipitation over such a huge
domain
> could escape reporting (this could just be a major advantage of
gridded
> observations over station data -satellites don’t sleep). Thank you
for
> calming my nerves. I am guessing the introduction of the CF
convention into
> my forecast data occurred when I used CDO’s sellonlatbox to clip
the model
> file to my domain of interest. If not, everything on the forecast
file had
> been MET convention. So how do you suggest I go about the
harmonization?
> And lest I forget John, thank you for helping me install MET on this
Mac
> in the last tutorials in Boulder. I can’t wait to have the whole
METPlus
> package in one suit.
> Thanks once again.
>
> Bamidele OLORUNTOBA
> African Centre of Meteorological Applications for Development
(ACMAD)
>
> > On Feb 25, 2019, at 11:57 PM, John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
> >
> > Hello,
> >
> > I see that you're getting 0 matched pairs from the Point-Stat
tool.
> Thanks
> > for sending some sample data. You've already done the right thing
by
> > running at verbosity level 3 (-v 3) to dump out the counts for why
> > observations were/were not used. In your case, it's very obvious:
> >
> >
> > *DEBUG 3: Observations processed = 14109DEBUG 3: Rejected: obs
type
> > = 14109*
> >
> > Your data just doesn't contain any observations of precip.
> >
> > Your Point-Stat config file, indicates that you're looking for
> observations
> > of APCP:
> >
> >
> > *obs = { field = [ { name="APCP"; level="A1"; cat_thresh = [>=0,
> >=10.0,
> >> =30.0, >=50.0]; } ];}*
> >
> > APCP corresponds to GRIB code 61. But when I look at the "obs_gc"
> variable
> > from your point observations, there just aren't any 61's in the
data:
> > *ncdump -v obs_gc pointobs20190217_24.nc
<http://pointobs20190217_24.nc
> >*
> >
> > For testing, I rerun Point-Stat looking for observations of 2-
meter
> > Temperature:
> >
> >
> > *obs = { field = [ { name="TMP"; level="Z2"; cat_thresh = [>=0,
>=10.0,
> >> =30.0, >=50.0]; } ];}*
> >
> > That made it further, but I still got 0 matched pairs because MET
isn't
> > able to parse the timing info from your model file.
> >
> > Looks like your forecast NetCDF is a mixture of MET conventions
and
> NetCDF
> > CF-conventions. You just need to pick one and go with it.
> >
> > If you pick the MET convention, you'll need to fix the grid
definition
> info
> > which is inconsistent with the dimensions of the data:
> > The dimensions indicate a 151x161 grid:
> >
> >
> > *dimensions: lon = 151 ; lat = 161 ;*
> >
> > The global attributes indicate a 361x361 grid:
> >
> >
> >
> >
> >
> >
> > * :Projection = "LatLon" ; :lat_ll =
> > "-90.000000 degrees_north" ; :lon_ll = "-90.000000
> > degrees_east" ; :delta_lat = "0.500000 degrees"
> > ; :delta_lon = "0.500000 degrees" ;
:Nlat =
> > "361 grid_points" ; :Nlon = "361 grid_points" ;*
> >
> > If you pick the NetCDF CF-Conventions, then you'll need to specify
the
> > timing info a CF-compliant way.
> >
> > Hope this helps.
> >
> > Thanks,
> > John Halley Gotway
> >
> >
> >
> >
> > On Sun, Feb 24, 2019 at 9:45 AM Bamidele Oloruntoba via RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> Sun Feb 24 09:45:24 2019: Request 89055 was acted upon.
> >> Transaction: Ticket created by deleignition at icloud.com
> >> Queue: met_help
> >> Subject: Empty output files produced.
> >> Owner: Nobody
> >> Requestors: deleignition at icloud.com
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=89055 >
> >>
> >>
> >>
> >> Hello Methelp,
> >> I am trying to verify model outputs with observation which was in
> Little_R
> >> and combined into a single 24hrs netcdf file using the ascii2nc
tool.
> Below
> >> is my issued command: point_stat clippedfc.nc
pointobs20190217_24.nc
> >> PointStatConfig_default -v 3
> >> And my output is as follows:
> >> DEBUG 1: Default Config File:
> >>
> /Users/bamideleoloruntoba/MET/met-
8.0/share/met/config/PointStatConfig_default
> >> DEBUG 1: User Config File: PointStatConfig_default
> >> WARNING:
> >> WARNING: NcCfFile::open() -> could not determine the valid time,
using
> 0.
> >> WARNING:
> >> GSL_RNG_TYPE=mt19937
> >> GSL_RNG_SEED=415593052
> >> DEBUG 1: Forecast File: clippedfc.nc
> >> DEBUG 1: Observation File: pointobs20190217_24.nc
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 2: Reading data for APCP_24Z0.
> >> DEBUG 3: Use the matching forecast and observation grids.
> >> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161
lat_ll:
> >> -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
> >> DEBUG 2: Processing masking regions.
> >> DEBUG 3: Processing grid mask: FULL
> >> DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology
mean
> levels,
> >> and 0 climatology standard deviation levels.
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 2: Searching 14109 observations from 1868 messages.
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation
type
> ADPUPA,
> >> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> >> DEBUG 3: Number of matched pairs = 0
> >> DEBUG 3: Observations processed = 14109
> >> DEBUG 3: Rejected: SID exclusion = 0
> >> DEBUG 3: Rejected: obs type = 14109
> >> DEBUG 3: Rejected: valid time = 0
> >> DEBUG 3: Rejected: bad obs value = 0
> >> DEBUG 3: Rejected: off the grid = 0
> >> DEBUG 3: Rejected: level mismatch = 0
> >> DEBUG 3: Rejected: quality marker = 0
> >> DEBUG 3: Rejected: message type = 0
> >> DEBUG 3: Rejected: masking region = 0
> >> DEBUG 3: Rejected: bad fcst value = 0
> >> DEBUG 3: Rejected: duplicates = 0
> >> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation
type
> ADPSFC,
> >> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> >> DEBUG 3: Number of matched pairs = 0
> >> DEBUG 3: Observations processed = 14109
> >> DEBUG 3: Rejected: SID exclusion = 0
> >> DEBUG 3: Rejected: obs type = 14109
> >> DEBUG 3: Rejected: valid time = 0
> >> DEBUG 3: Rejected: bad obs value = 0
> >> DEBUG 3: Rejected: off the grid = 0
> >> DEBUG 3: Rejected: level mismatch = 0
> >> DEBUG 3: Rejected: quality marker = 0
> >> DEBUG 3: Rejected: message type = 0
> >> DEBUG 3: Rejected: masking region = 0
> >> DEBUG 3: Rejected: bad fcst value = 0
> >> DEBUG 3: Rejected: duplicates = 0
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_ctc.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_cts.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mctc.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mcts.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_cnt.txt
> >> There seems to be no error, but all the generated output files
contained
> >> only headers. They had no results in them.
> >> My 2 input files and configuration files are hereby attached.
> >>
> >>
> >> Hello Methelp,
> >> I am trying to verify model outputs with observation which was in
> Little_R
> >> and combined into a single 24hrs netcdf file using the ascii2nc
tool.
> Below
> >> is my issued command: point_stat clippedfc.nc
pointobs20190217_24.nc
> >> PointStatConfig_default -v 3
> >> And my output is as follows:
> >> DEBUG 1: Default Config File:
> >>
> /Users/bamideleoloruntoba/MET/met-
8.0/share/met/config/PointStatConfig_default
> >> DEBUG 1: User Config File: PointStatConfig_default
> >> WARNING:
> >> WARNING: NcCfFile::open() -> could not determine the valid time,
using
> 0.
> >> WARNING:
> >> GSL_RNG_TYPE=mt19937
> >> GSL_RNG_SEED=415593052
> >> DEBUG 1: Forecast File: clippedfc.nc
> >> DEBUG 1: Observation File: pointobs20190217_24.nc
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 2: Reading data for APCP_24Z0.
> >> DEBUG 3: Use the matching forecast and observation grids.
> >> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 151 Ny: 161
lat_ll:
> >> -40.000 lon_ll: 20.000 delta_lat: 0.500 delta_lon: 0.500
> >> DEBUG 2: Processing masking regions.
> >> DEBUG 3: Processing grid mask: FULL
> >> DEBUG 2: For APCP_24Z0 found 1 forecast levels, 0 climatology
mean
> levels,
> >> and 0 climatology standard deviation levels.
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 2: Searching 14109 observations from 1868 messages.
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation
type
> ADPUPA,
> >> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> >> DEBUG 3: Number of matched pairs = 0
> >> DEBUG 3: Observations processed = 14109
> >> DEBUG 3: Rejected: SID exclusion = 0
> >> DEBUG 3: Rejected: obs type = 14109
> >> DEBUG 3: Rejected: valid time = 0
> >> DEBUG 3: Rejected: bad obs value = 0
> >> DEBUG 3: Rejected: off the grid = 0
> >> DEBUG 3: Rejected: level mismatch = 0
> >> DEBUG 3: Rejected: quality marker = 0
> >> DEBUG 3: Rejected: message type = 0
> >> DEBUG 3: Rejected: masking region = 0
> >> DEBUG 3: Rejected: bad fcst value = 0
> >> DEBUG 3: Rejected: duplicates = 0
> >> DEBUG 2: Processing APCP_24Z0 versus APCP/A1, for observation
type
> ADPSFC,
> >> over region FULL, for interpolation method NEAREST(1), using 0
pairs.
> >> DEBUG 3: Number of matched pairs = 0
> >> DEBUG 3: Observations processed = 14109
> >> DEBUG 3: Rejected: SID exclusion = 0
> >> DEBUG 3: Rejected: obs type = 14109
> >> DEBUG 3: Rejected: valid time = 0
> >> DEBUG 3: Rejected: bad obs value = 0
> >> DEBUG 3: Rejected: off the grid = 0
> >> DEBUG 3: Rejected: level mismatch = 0
> >> DEBUG 3: Rejected: quality marker = 0
> >> DEBUG 3: Rejected: message type = 0
> >> DEBUG 3: Rejected: masking region = 0
> >> DEBUG 3: Rejected: bad fcst value = 0
> >> DEBUG 3: Rejected: duplicates = 0
> >> DEBUG 2:
> >> DEBUG 2:
> >>
>
--------------------------------------------------------------------------------
> >> DEBUG 2:
> >> DEBUG 1: Output file: ./point_stat_000000L_19700101_000000V.stat
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_ctc.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_cts.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mctc.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_mcts.txt
> >> DEBUG 1: Output file:
./point_stat_000000L_19700101_000000V_cnt.txt
> >> There seems to be no error, but all the generated output files
contained
> >> only headers. They had no results in them.
> >> My 2 input files and configuration files are hereby attached.
> >>
> >
>
>
>
------------------------------------------------
More information about the Met_help
mailing list