[Met_help] [rt.rap.ucar.edu #88023] History for Config FIle SID Questions
John Halley Gotway via RT
met_help at ucar.edu
Tue Jul 9 12:07:15 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
John, attached is the configuration file we are using in MET 6.1. In the
MET config file, I have tried setting SID to "725540" to get one station in
the output. The output is below:
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value = 0.310694
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value = 2.17486
DEBUG 2:
DEBUG 2:
----------------------------------------------------------------------------
----
DEBUG 2:
DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region FULL, for interpolation method MIN(4), using 2059 pairs.
DEBUG 3: Number of matched pairs = 2059
DEBUG 3: Observations processed = 33323
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 478
DEBUG 3: Rejected: bad obs value = 30774
DEBUG 3: Rejected: off the grid = 3
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 9
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold <=10,
observation filtering threshold <=10, and field logic UNION.
DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region 725540, for interpolation method MIN(4), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 33323
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 478
DEBUG 3: Rejected: bad obs value = 30774
DEBUG 3: Rejected: off the grid = 3
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 2068
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
----------------------------------------------------------------------------
----
DEBUG 2:
DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V.stat
DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cts.txt
DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cnt.txt
The stat file for this case is attached. It has 2059 obs in the file and
the mask is set to full. I expected 1 station with the VXMASK set to the
station ID.
I also tried setting the SID to a filename ( the sid file is attached).
Again I had 2059 obs and VX MASK was set to full in the stat file. The
output is below.
DEBUG 3: Applying conversion function.
DEBUG 3: Applying censor threshold ">=5.90319" and replacing with a value of
5.90319.
DEBUG 3: Use the matching forecast and observation grids.
DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 1440 Ny: 721 lat_ll:
-90.000 lon_ll: -0.000 delta_lat: 0.250 delta_lon: 0.250
DEBUG 2: Processing masking regions.
DEBUG 3: Processing grid mask: FULL
DEBUG 4: parse_grid_mask() -> parsing grid mask "FULL"
DEBUG 3: Processing station ID mask: BOB
DEBUG 4: parse_sid_mask() -> parsing station ID masking file "BOB"
DEBUG 4: parse_sid_mask() -> parsed 2 station ID's for the "BOB" mask from
file "BOB"
DEBUG 2: For VIS/Z2 found 1 forecast levels, 0 climatology mean levels, and
0 climatology standard deviation levels.
DEBUG 2:
DEBUG 2:
----------------------------------------------------------------------------
----
DEBUG 2:
DEBUG 2: Searching 33323 observations from 33323 messages.
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.970:2.700:-9999.00:0.00] valid at 20181121_010000 with value = 1.9263
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[45.930:6.100:-9999.00:0.00] valid at 20181121_010000 with value = 3.72833
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[48.770:2.200:-9999.00:0.00] valid at 20181121_010000 with value = 2.48555
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[43.100:6.150:-9999.00:0.00] valid at 20181121_010000 with value = 5.90319
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[47.320:1.680:-9999.00:0.00] valid at 20181121_010000 with value = 0.403902
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[46.480:15.690:-9999.00:0.00] valid at 20181121_010000 with value = 0.124278
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[50.200:12.910:-9999.00:0.00] valid at 20181121_010000 with value = 0.621388
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value = 0.310694
DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value = 2.17486
DEBUG 2:
DEBUG 2:
----------------------------------------------------------------------------
----
DEBUG 2:
DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region FULL, for interpolation method MIN(4), using 2059 pairs.
DEBUG 3: Number of matched pairs = 2059
DEBUG 3: Observations processed = 33323
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 478
DEBUG 3: Rejected: bad obs value = 30774
DEBUG 3: Rejected: off the grid = 3
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 0
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 9
DEBUG 2: Computing Categorical Statistics.
DEBUG 2: Computing Continuous Statistics.
DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold <=10,
observation filtering threshold <=10, and field logic UNION.
DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region BOB, for interpolation method MIN(4), using 0 pairs.
DEBUG 3: Number of matched pairs = 0
DEBUG 3: Observations processed = 33323
DEBUG 3: Rejected: SID exclusion = 0
DEBUG 3: Rejected: GRIB code = 0
DEBUG 3: Rejected: valid time = 478
DEBUG 3: Rejected: bad obs value = 30774
DEBUG 3: Rejected: off the grid = 3
DEBUG 3: Rejected: level mismatch = 0
DEBUG 3: Rejected: quality marker = 0
DEBUG 3: Rejected: message type = 0
DEBUG 3: Rejected: masking region = 2068
DEBUG 3: Rejected: bad fcst value = 0
DEBUG 3: Rejected: duplicates = 0
DEBUG 2:
DEBUG 2:
----------------------------------------------------------------------------
----
DEBUG 2:
DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V.stat
DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cts.txt
DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cnt.txt
What am I missing here?
If I set the grid field in the config file to [] then I don't get any output
data lines
Thanks
Bob
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Config FIle SID Questions
From: John Halley Gotway
Time: Wed Dec 05 09:51:50 2018
Bob,
In your config file, you've defined two masking regions. One named
"FULL"
and a second one named "725540". Looking closely through the log
messages
you sent, I see that point_stat found 2059 matched pairs for FULL and
0
matched pairs for 725540:
*DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC,
over region FULL, for interpolation method MIN(4), using 2059 pairs.*
*DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC,
over region 725540, for interpolation method MIN(4), using 0 pairs.*
So then your question is really, why am I getting 0 matched pairs for
the
station mask for 725540. I really don't know. Looking in the MPR
output
lines in the .stat file you sent, I see many station names beginning
with
725, but none of them are actually 725540:
725130, 725059, 725090, 725088, 725069, 725146, 725220, 725407,
725067,
725408, 725235, 725066, 725283, 725085, 725098, 725036, 725073,
725070,
725165, 725190, 725068
To test out the SID masking, please try using one of the station ID's
which
show up in your data. For example, set:
*mask = { grid = [ "FULL" ]; poly = []; sid =
["725130"];}*
Hope that helps clarify.
Thanks,
John
On Tue, Dec 4, 2018 at 1:46 PM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:
>
> Tue Dec 04 13:46:37 2018: Request 88023 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
> Queue: met_help
> Subject: Config FIle SID Questions
> Owner: Nobody
> Requestors: robert.craig.2 at us.af.mil
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88023 >
>
>
> John, attached is the configuration file we are using in MET 6.1.
In the
> MET config file, I have tried setting SID to "725540" to get one
station in
> the output. The output is below:
>
>
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.310694
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value =
2.17486
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method MIN(4), using 2059 pairs.
>
> DEBUG 3: Number of matched pairs = 2059
>
> DEBUG 3: Observations processed = 33323
>
> DEBUG 3: Rejected: SID exclusion = 0
>
> DEBUG 3: Rejected: GRIB code = 0
>
> DEBUG 3: Rejected: valid time = 478
>
> DEBUG 3: Rejected: bad obs value = 30774
>
> DEBUG 3: Rejected: off the grid = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type = 0
>
> DEBUG 3: Rejected: masking region = 0
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates = 9
>
> DEBUG 2: Computing Categorical Statistics.
>
> DEBUG 2: Computing Continuous Statistics.
>
> DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold
<=10,
> observation filtering threshold <=10, and field logic UNION.
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region 725540, for interpolation method MIN(4), using 0 pairs.
>
> DEBUG 3: Number of matched pairs = 0
>
> DEBUG 3: Observations processed = 33323
>
> DEBUG 3: Rejected: SID exclusion = 0
>
> DEBUG 3: Rejected: GRIB code = 0
>
> DEBUG 3: Rejected: valid time = 478
>
> DEBUG 3: Rejected: bad obs value = 30774
>
> DEBUG 3: Rejected: off the grid = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type = 0
>
> DEBUG 3: Rejected: masking region = 2068
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates = 0
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V.stat
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cts.txt
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cnt.txt
>
>
>
> The stat file for this case is attached. It has 2059 obs in the
file and
> the mask is set to full. I expected 1 station with the VXMASK set
to the
> station ID.
>
>
>
> I also tried setting the SID to a filename ( the sid file is
attached).
> Again I had 2059 obs and VX MASK was set to full in the stat file.
The
> output is below.
>
>
>
> DEBUG 3: Applying conversion function.
>
> DEBUG 3: Applying censor threshold ">=5.90319" and replacing with a
value
> of
> 5.90319.
>
> DEBUG 3: Use the matching forecast and observation grids.
>
> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 1440 Ny: 721
lat_ll:
> -90.000 lon_ll: -0.000 delta_lat: 0.250 delta_lon: 0.250
>
> DEBUG 2: Processing masking regions.
>
> DEBUG 3: Processing grid mask: FULL
>
> DEBUG 4: parse_grid_mask() -> parsing grid mask "FULL"
>
> DEBUG 3: Processing station ID mask: BOB
>
> DEBUG 4: parse_sid_mask() -> parsing station ID masking file "BOB"
>
> DEBUG 4: parse_sid_mask() -> parsed 2 station ID's for the "BOB"
mask from
> file "BOB"
>
> DEBUG 2: For VIS/Z2 found 1 forecast levels, 0 climatology mean
levels, and
> 0 climatology standard deviation levels.
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 2: Searching 33323 observations from 33323 messages.
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.970:2.700:-9999.00:0.00] valid at 20181121_010000 with value =
1.9263
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [45.930:6.100:-9999.00:0.00] valid at 20181121_010000 with value =
3.72833
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [48.770:2.200:-9999.00:0.00] valid at 20181121_010000 with value =
2.48555
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [43.100:6.150:-9999.00:0.00] valid at 20181121_010000 with value =
5.90319
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [47.320:1.680:-9999.00:0.00] valid at 20181121_010000 with value =
0.403902
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [46.480:15.690:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.124278
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [50.200:12.910:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.621388
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.310694
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value =
2.17486
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method MIN(4), using 2059 pairs.
>
> DEBUG 3: Number of matched pairs = 2059
>
> DEBUG 3: Observations processed = 33323
>
> DEBUG 3: Rejected: SID exclusion = 0
>
> DEBUG 3: Rejected: GRIB code = 0
>
> DEBUG 3: Rejected: valid time = 478
>
> DEBUG 3: Rejected: bad obs value = 30774
>
> DEBUG 3: Rejected: off the grid = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type = 0
>
> DEBUG 3: Rejected: masking region = 0
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates = 9
>
> DEBUG 2: Computing Categorical Statistics.
>
> DEBUG 2: Computing Continuous Statistics.
>
> DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold
<=10,
> observation filtering threshold <=10, and field logic UNION.
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region BOB, for interpolation method MIN(4), using 0 pairs.
>
> DEBUG 3: Number of matched pairs = 0
>
> DEBUG 3: Observations processed = 33323
>
> DEBUG 3: Rejected: SID exclusion = 0
>
> DEBUG 3: Rejected: GRIB code = 0
>
> DEBUG 3: Rejected: valid time = 478
>
> DEBUG 3: Rejected: bad obs value = 30774
>
> DEBUG 3: Rejected: off the grid = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type = 0
>
> DEBUG 3: Rejected: masking region = 2068
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates = 0
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V.stat
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cts.txt
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cnt.txt
>
>
>
>
>
> What am I missing here?
>
>
>
> If I set the grid field in the config file to [] then I don't get
any
> output
> data lines
>
>
>
> Thanks
>
> Bob
>
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list