[Met_help] [rt.rap.ucar.edu #88023] History for Config FIle SID Questions

John Halley Gotway via RT met_help at ucar.edu
Tue Jul 9 12:07:15 MDT 2019


----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

John, attached is the configuration file we are using in MET 6.1.   In the
MET config file, I have tried setting SID to "725540" to get one station in
the output.  The output is below:

 

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value = 0.310694

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value = 2.17486

DEBUG 2: 

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2: 

DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region FULL, for interpolation method MIN(4), using 2059 pairs.

DEBUG 3: Number of matched pairs  = 2059

DEBUG 3: Observations processed   = 33323

DEBUG 3: Rejected: SID exclusion  = 0

DEBUG 3: Rejected: GRIB code      = 0

DEBUG 3: Rejected: valid time     = 478

DEBUG 3: Rejected: bad obs value  = 30774

DEBUG 3: Rejected: off the grid   = 3

DEBUG 3: Rejected: level mismatch = 0

DEBUG 3: Rejected: quality marker = 0

DEBUG 3: Rejected: message type   = 0

DEBUG 3: Rejected: masking region = 0

DEBUG 3: Rejected: bad fcst value = 0

DEBUG 3: Rejected: duplicates     = 9

DEBUG 2: Computing Categorical Statistics.

DEBUG 2: Computing Continuous Statistics.

DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold <=10,
observation filtering threshold <=10, and field logic UNION.

DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region 725540, for interpolation method MIN(4), using 0 pairs.

DEBUG 3: Number of matched pairs  = 0

DEBUG 3: Observations processed   = 33323

DEBUG 3: Rejected: SID exclusion  = 0

DEBUG 3: Rejected: GRIB code      = 0

DEBUG 3: Rejected: valid time     = 478

DEBUG 3: Rejected: bad obs value  = 30774

DEBUG 3: Rejected: off the grid   = 3

DEBUG 3: Rejected: level mismatch = 0

DEBUG 3: Rejected: quality marker = 0

DEBUG 3: Rejected: message type   = 0

DEBUG 3: Rejected: masking region = 2068

DEBUG 3: Rejected: bad fcst value = 0

DEBUG 3: Rejected: duplicates     = 0

DEBUG 2: 

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2: 

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V.stat

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cts.txt

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cnt.txt

 

The stat file for this case is attached.  It has 2059 obs  in the file and
the mask is set to full.  I expected 1 station with the VXMASK set to the
station ID.

 

I also tried setting the SID to a filename ( the sid file is attached).
Again I had 2059 obs and VX MASK was set to full in the stat file.  The
output is below.

 

DEBUG 3: Applying conversion function.

DEBUG 3: Applying censor threshold ">=5.90319" and replacing with a value of
5.90319.

DEBUG 3: Use the matching forecast and observation grids.

DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 1440 Ny: 721 lat_ll:
-90.000 lon_ll: -0.000 delta_lat: 0.250 delta_lon: 0.250

DEBUG 2: Processing masking regions.

DEBUG 3: Processing grid mask: FULL

DEBUG 4: parse_grid_mask() -> parsing grid mask "FULL"

DEBUG 3: Processing station ID mask: BOB

DEBUG 4: parse_sid_mask() -> parsing station ID masking file "BOB"

DEBUG 4: parse_sid_mask() -> parsed 2 station ID's for the "BOB" mask from
file "BOB"

DEBUG 2: For VIS/Z2 found 1 forecast levels, 0 climatology mean levels, and
0 climatology standard deviation levels.

DEBUG 2: 

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2: 

DEBUG 2: Searching 33323 observations from 33323 messages.

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.970:2.700:-9999.00:0.00] valid at 20181121_010000 with value = 1.9263

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[45.930:6.100:-9999.00:0.00] valid at 20181121_010000 with value = 3.72833

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[48.770:2.200:-9999.00:0.00] valid at 20181121_010000 with value = 2.48555

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[43.100:6.150:-9999.00:0.00] valid at 20181121_010000 with value = 5.90319

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[47.320:1.680:-9999.00:0.00] valid at 20181121_010000 with value = 0.403902

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[46.480:15.690:-9999.00:0.00] valid at 20181121_010000 with value = 0.124278

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[50.200:12.910:-9999.00:0.00] valid at 20181121_010000 with value = 0.621388

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value = 0.310694

DEBUG 4: Skipping duplicate observation for [lat:lon:level:elevation] =
[49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value = 2.17486

DEBUG 2: 

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2: 

DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region FULL, for interpolation method MIN(4), using 2059 pairs.

DEBUG 3: Number of matched pairs  = 2059

DEBUG 3: Observations processed   = 33323

DEBUG 3: Rejected: SID exclusion  = 0

DEBUG 3: Rejected: GRIB code      = 0

DEBUG 3: Rejected: valid time     = 478

DEBUG 3: Rejected: bad obs value  = 30774

DEBUG 3: Rejected: off the grid   = 3

DEBUG 3: Rejected: level mismatch = 0

DEBUG 3: Rejected: quality marker = 0

DEBUG 3: Rejected: message type   = 0

DEBUG 3: Rejected: masking region = 0

DEBUG 3: Rejected: bad fcst value = 0

DEBUG 3: Rejected: duplicates     = 9

DEBUG 2: Computing Categorical Statistics.

DEBUG 2: Computing Continuous Statistics.

DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold <=10,
observation filtering threshold <=10, and field logic UNION.

DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type ADPSFC, over
region BOB, for interpolation method MIN(4), using 0 pairs.

DEBUG 3: Number of matched pairs  = 0

DEBUG 3: Observations processed   = 33323

DEBUG 3: Rejected: SID exclusion  = 0

DEBUG 3: Rejected: GRIB code      = 0

DEBUG 3: Rejected: valid time     = 478

DEBUG 3: Rejected: bad obs value  = 30774

DEBUG 3: Rejected: off the grid   = 3

DEBUG 3: Rejected: level mismatch = 0

DEBUG 3: Rejected: quality marker = 0

DEBUG 3: Rejected: message type   = 0

DEBUG 3: Rejected: masking region = 2068

DEBUG 3: Rejected: bad fcst value = 0

DEBUG 3: Rejected: duplicates     = 0

DEBUG 2: 

DEBUG 2:
----------------------------------------------------------------------------
----

DEBUG 2: 

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V.stat

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cts.txt

DEBUG 1: Output file:
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
all_000000L_20181121_000000V_cnt.txt

 

 

What am I missing here?

 

If I set the grid field in the config file to [] then I don't get any output
data lines

 

Thanks

Bob

 



----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Config FIle SID Questions
From: John Halley Gotway
Time: Wed Dec 05 09:51:50 2018

Bob,

In your config file, you've defined two masking regions.  One named
"FULL"
and a second one named "725540".  Looking closely through the log
messages
you sent, I see that point_stat found 2059 matched pairs for FULL and
0
matched pairs for 725540:


*DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC,
over region FULL, for interpolation method MIN(4), using 2059 pairs.*

*DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC,
over region 725540, for interpolation method MIN(4), using 0 pairs.*

So then your question is really, why am I getting 0 matched pairs for
the
station mask for 725540.  I really don't know.  Looking in the MPR
output
lines in the .stat file you sent, I see many station names beginning
with
725, but none of them are actually 725540:
725130, 725059, 725090, 725088, 725069, 725146, 725220, 725407,
725067,
725408, 725235, 725066, 725283, 725085, 725098, 725036, 725073,
725070,
725165, 725190, 725068

To test out the SID masking, please try using one of the station ID's
which
show up in your data.  For example, set:




*mask = {   grid    = [ "FULL" ];   poly    = [];   sid     =
["725130"];}*

Hope that helps clarify.

Thanks,
John



On Tue, Dec 4, 2018 at 1:46 PM robert.craig.2 at us.af.mil via RT <
met_help at ucar.edu> wrote:

>
> Tue Dec 04 13:46:37 2018: Request 88023 was acted upon.
> Transaction: Ticket created by robert.craig.2 at us.af.mil
>        Queue: met_help
>      Subject: Config FIle SID Questions
>        Owner: Nobody
>   Requestors: robert.craig.2 at us.af.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=88023 >
>
>
> John, attached is the configuration file we are using in MET 6.1.
In the
> MET config file, I have tried setting SID to "725540" to get one
station in
> the output.  The output is below:
>
>
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.310694
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value =
2.17486
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method MIN(4), using 2059 pairs.
>
> DEBUG 3: Number of matched pairs  = 2059
>
> DEBUG 3: Observations processed   = 33323
>
> DEBUG 3: Rejected: SID exclusion  = 0
>
> DEBUG 3: Rejected: GRIB code      = 0
>
> DEBUG 3: Rejected: valid time     = 478
>
> DEBUG 3: Rejected: bad obs value  = 30774
>
> DEBUG 3: Rejected: off the grid   = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type   = 0
>
> DEBUG 3: Rejected: masking region = 0
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates     = 9
>
> DEBUG 2: Computing Categorical Statistics.
>
> DEBUG 2: Computing Continuous Statistics.
>
> DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold
<=10,
> observation filtering threshold <=10, and field logic UNION.
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region 725540, for interpolation method MIN(4), using 0 pairs.
>
> DEBUG 3: Number of matched pairs  = 0
>
> DEBUG 3: Observations processed   = 33323
>
> DEBUG 3: Rejected: SID exclusion  = 0
>
> DEBUG 3: Rejected: GRIB code      = 0
>
> DEBUG 3: Rejected: valid time     = 478
>
> DEBUG 3: Rejected: bad obs value  = 30774
>
> DEBUG 3: Rejected: off the grid   = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type   = 0
>
> DEBUG 3: Rejected: masking region = 2068
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates     = 0
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V.stat
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cts.txt
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cnt.txt
>
>
>
> The stat file for this case is attached.  It has 2059 obs  in the
file and
> the mask is set to full.  I expected 1 station with the VXMASK set
to the
> station ID.
>
>
>
> I also tried setting the SID to a filename ( the sid file is
attached).
> Again I had 2059 obs and VX MASK was set to full in the stat file.
The
> output is below.
>
>
>
> DEBUG 3: Applying conversion function.
>
> DEBUG 3: Applying censor threshold ">=5.90319" and replacing with a
value
> of
> 5.90319.
>
> DEBUG 3: Use the matching forecast and observation grids.
>
> DEBUG 3: Grid Definition: Projection: Lat/Lon Nx: 1440 Ny: 721
lat_ll:
> -90.000 lon_ll: -0.000 delta_lat: 0.250 delta_lon: 0.250
>
> DEBUG 2: Processing masking regions.
>
> DEBUG 3: Processing grid mask: FULL
>
> DEBUG 4: parse_grid_mask() -> parsing grid mask "FULL"
>
> DEBUG 3: Processing station ID mask: BOB
>
> DEBUG 4: parse_sid_mask() -> parsing station ID masking file "BOB"
>
> DEBUG 4: parse_sid_mask() -> parsed 2 station ID's for the "BOB"
mask from
> file "BOB"
>
> DEBUG 2: For VIS/Z2 found 1 forecast levels, 0 climatology mean
levels, and
> 0 climatology standard deviation levels.
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 2: Searching 33323 observations from 33323 messages.
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.970:2.700:-9999.00:0.00] valid at 20181121_010000 with value =
1.9263
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [45.930:6.100:-9999.00:0.00] valid at 20181121_010000 with value =
3.72833
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [48.770:2.200:-9999.00:0.00] valid at 20181121_010000 with value =
2.48555
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [43.100:6.150:-9999.00:0.00] valid at 20181121_010000 with value =
5.90319
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [47.320:1.680:-9999.00:0.00] valid at 20181121_010000 with value =
0.403902
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [46.480:15.690:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.124278
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [50.200:12.910:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.621388
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.170:16.120:-9999.00:0.00] valid at 20181121_010000 with value =
> 0.310694
>
> DEBUG 4: Skipping duplicate observation for
[lat:lon:level:elevation] =
> [49.150:16.690:-9999.00:0.00] valid at 20181121_010000 with value =
2.17486
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region FULL, for interpolation method MIN(4), using 2059 pairs.
>
> DEBUG 3: Number of matched pairs  = 2059
>
> DEBUG 3: Observations processed   = 33323
>
> DEBUG 3: Rejected: SID exclusion  = 0
>
> DEBUG 3: Rejected: GRIB code      = 0
>
> DEBUG 3: Rejected: valid time     = 478
>
> DEBUG 3: Rejected: bad obs value  = 30774
>
> DEBUG 3: Rejected: off the grid   = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type   = 0
>
> DEBUG 3: Rejected: masking region = 0
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates     = 9
>
> DEBUG 2: Computing Categorical Statistics.
>
> DEBUG 2: Computing Continuous Statistics.
>
> DEBUG 3: Using 2059 of 2059 pairs for forecast filtering threshold
<=10,
> observation filtering threshold <=10, and field logic UNION.
>
> DEBUG 2: Processing VIS/Z2 versus VIS/Z2, for observation type
ADPSFC, over
> region BOB, for interpolation method MIN(4), using 0 pairs.
>
> DEBUG 3: Number of matched pairs  = 0
>
> DEBUG 3: Observations processed   = 33323
>
> DEBUG 3: Rejected: SID exclusion  = 0
>
> DEBUG 3: Rejected: GRIB code      = 0
>
> DEBUG 3: Rejected: valid time     = 478
>
> DEBUG 3: Rejected: bad obs value  = 30774
>
> DEBUG 3: Rejected: off the grid   = 3
>
> DEBUG 3: Rejected: level mismatch = 0
>
> DEBUG 3: Rejected: quality marker = 0
>
> DEBUG 3: Rejected: message type   = 0
>
> DEBUG 3: Rejected: masking region = 2068
>
> DEBUG 3: Rejected: bad fcst value = 0
>
> DEBUG 3: Rejected: duplicates     = 0
>
> DEBUG 2:
>
> DEBUG 2:
>
>
----------------------------------------------------------------------------
> ----
>
> DEBUG 2:
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V.stat
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cts.txt
>
> DEBUG 1: Output file:
>
>
/h/data/global/WXQC/data/met/ptstat/mdlob_pairs/galwem/VI/point_stat_galwem_
> all_000000L_20181121_000000V_cnt.txt
>
>
>
>
>
> What am I missing here?
>
>
>
> If I set the grid field in the config file to [] then I don't get
any
> output
> data lines
>
>
>
> Thanks
>
> Bob
>
>
>
>
>

------------------------------------------------


More information about the Met_help mailing list