[Met_help] [rt.rap.ucar.edu #99030] History for V9.1 Gen-Vx-Mask (UNCLASSIFIED)

Thu Mar 18 11:02:29 MDT 2021

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

CLASSIFICATION: UNCLASSIFIED

I'm using Gen-Vx-Mask to replace missing data designated by -9999.0 with
zeros and am working with a 3D variable which has multiple levels and want
to specify the 3rd level. The data I'm working with is NetCDF and I'm using
the argument to specify the level as follows: 
level="(0,2,*,*)"

I assume that the "2" will specify the 3rd level since this is a zero-based
specification, correct?

Thanks.

R/
John
Mr. John W. Raby
U.S. Army Research Laboratory
White Sands Missile Range, NM 88002
Office:(575) 678-2004 DSN 258-2004
Teleworking: Contact Admin Specialist at (410) 278-6974
FAX (575) 678-1230 DSN 258-1230
Email: john.w.raby2.civ at mail.mil

CLASSIFICATION: UNCLASSIFIED

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
From: David Fillmore
Time: Fri Mar 12 13:14:28 2021

Hi John,
yes, that is correct.  The level indices are 0-based.
thanks,
David

On Fri, Mar 12, 2021 at 8:39 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> Fri Mar 12 08:39:09 2021: Request 99030 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
>        Queue: met_help
>      Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
>        Owner: Nobody
>   Requestors: john.w.raby2.civ at mail.mil
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99030 >
>
>
> CLASSIFICATION: UNCLASSIFIED
>
> I'm using Gen-Vx-Mask to replace missing data designated by -9999.0
with
> zeros and am working with a 3D variable which has multiple levels
and want
> to specify the 3rd level. The data I'm working with is NetCDF and
I'm using
> the argument to specify the level as follows:
> level="(0,2,*,*)"
>
> I assume that the "2" will specify the 3rd level since this is a
zero-based
> specification, correct?
>
> Thanks.
>
> R/
> John
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974
> FAX (575) 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri Mar 12 13:40:40 2021

CLASSIFICATION: UNCLASSIFIED

Your quick answer is much appreciated, David.
R/
John

-----Original Message-----
From: David Fillmore via RT <met_help at ucar.edu>
Sent: Friday, March 12, 2021 1:14 PM
To: Raby, John W CIV USARMY DEVCOM ARL (USA)
<john.w.raby2.civ at mail.mil>
Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #99030] V9.1 Gen-Vx-
Mask
(UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.

----

Hi John,
yes, that is correct.  The level indices are 0-based.
thanks,
David

On Fri, Mar 12, 2021 at 8:39 AM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> Fri Mar 12 08:39:09 2021: Request 99030 was acted upon.
> Transaction: Ticket created by john.w.raby2.civ at mail.mil
>        Queue: met_help
>      Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
>        Owner: Nobody
>   Requestors: john.w.raby2.civ at mail.mil
>       Status: new
>  Ticket <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99030 >
>
>
> CLASSIFICATION: UNCLASSIFIED
>
> I'm using Gen-Vx-Mask to replace missing data designated by -9999.0
> with zeros and am working with a 3D variable which has multiple
levels
> and want to specify the 3rd level. The data I'm working with is
NetCDF
> and I'm using the argument to specify the level as follows:
> level="(0,2,*,*)"
>
> I assume that the "2" will specify the 3rd level since this is a
> zero-based specification, correct?
>
> Thanks.
>
> R/
> John
> Mr. John W. Raby
> U.S. Army Research Laboratory
> White Sands Missile Range, NM 88002
> Office:(575) 678-2004 DSN 258-2004
> Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> 678-1230 DSN 258-1230
> Email: john.w.raby2.civ at mail.mil
>
> CLASSIFICATION: UNCLASSIFIED
>
>

CLASSIFICATION: UNCLASSIFIED

------------------------------------------------
Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
From: John Halley Gotway
Time: Fri Mar 12 13:55:48 2021

John,

This is John HG. I wanted to jump in with another piece of advice. I
see
that you're running gen_vx_mask to replace values of bad data with 0,
and
that definitely is a fine way to go.

But I wanted to point out that "data censoring" is another alternative
that
you might find useful. Search for "censor_thresh" on this page:

https://met.readthedocs.io/en/v9.1.2/Users_Guide/data_io.html#configuration-
file-details

In MET config files, when specifying a field "name" and "level", you
can
also specify "censor_thresh" and "censor_val" to list one or more
filtering
thresholds and one or more replacement values. Below are 2 examples of
running plot_data_plane to make plots of the same gridded data:

plot_data_plane data/sample_obs/ST4/ST4.2010010112.24h
plot_NO_CENSOR.ps
'name="APCP"; level="A24";'
plot_data_plane data/sample_obs/ST4/ST4.2010010112.24h
plot_CENSOR_BAD_DATA.ps 'name="APCP"; level="A24"; censor_thresh = [
eq-9999 ]; censor_val = [ 0 ];'

The first plots the raw data, including bad data values. The second
replaces bad data values (-9999) with a value of 0. Here's a
screenshot of
the resulting images:
[image: Screen Shot 2021-03-12 at 1.52.27 PM.png]

So if the only reason you're running gen_vx_mask is to change bad data
values to 0, you could do that via the MET config files directly
without
the need to write an additional output file from gen_vx_mask. And that
could potentially simplify your processing logic.

Thanks,
John

On Fri, Mar 12, 2021 at 1:41 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99030 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Your quick answer is much appreciated, David.
> R/
> John
>
> -----Original Message-----
> From: David Fillmore via RT <met_help at ucar.edu>
> Sent: Friday, March 12, 2021 1:14 PM
> To: Raby, John W CIV USARMY DEVCOM ARL (USA)
<john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #99030] V9.1 Gen-Vx-
Mask
> (UNCLASSIFIED)
>
> All active links contained in this email were disabled.  Please
verify the
> identity of the sender, and confirm the authenticity of all links
> contained
> within the message prior to copying and pasting the address to a Web
> browser.
>
>
>
>
> ----
>
> Hi John,
> yes, that is correct.  The level indices are 0-based.
> thanks,
> David
>
> On Fri, Mar 12, 2021 at 8:39 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Fri Mar 12 08:39:09 2021: Request 99030 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-url:
> > Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99030 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm using Gen-Vx-Mask to replace missing data designated by
-9999.0
> > with zeros and am working with a 3D variable which has multiple
levels
> > and want to specify the 3rd level. The data I'm working with is
NetCDF
> > and I'm using the argument to specify the level as follows:
> > level="(0,2,*,*)"
> >
> > I assume that the "2" will specify the 3rd level since this is a
> > zero-based specification, correct?
> >
> > Thanks.
> >
> > R/
> > John
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

------------------------------------------------
Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
From: Raby, John W USA CIV
Time: Fri Mar 12 14:21:16 2021

CLASSIFICATION: UNCLASSIFIED

Hi John -

Thanks for reminding me about the "data censoring" capability. I
recall that
you mentioned this before, but once I had run gen_vx_mask to modify
the obs as
needed, I was focused on running grid_stat and didn't need to revisit
the obs
processing again. Then I went on to other work taking me away from
that task
for a few months. Hearing about it a second time plus all the helpful
documentation and suggested commands makes it more interesting now.
Since I'll
be running grid_stat again soon, that might be an opportunity to try
it. I
guess my approach would be to try it and run grid_stat to produce
output and
then run grid_stat again without "data censoring" using a set of obs
which
were processed using gen_vx_mask to see that I get the same results.
You have
a point that combining the "data censoring" step and grid_stat into a
single
process would be more efficient.

R/
John

-----Original Message-----
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Friday, March 12, 2021 1:56 PM
To: Raby, John W CIV USARMY DEVCOM ARL (USA)
<john.w.raby2.civ at mail.mil>
Subject: Re: [Non-DoD Source] Re: [rt.rap.ucar.edu #99030] V9.1 Gen-
Vx-Mask
(UNCLASSIFIED)

All active links contained in this email were disabled.  Please verify
the
identity of the sender, and confirm the authenticity of all links
contained
within the message prior to copying and pasting the address to a Web
browser.

----

John,

This is John HG. I wanted to jump in with another piece of advice. I
see that
you're running gen_vx_mask to replace values of bad data with 0, and
that
definitely is a fine way to go.

But I wanted to point out that "data censoring" is another alternative
that
you might find useful. Search for "censor_thresh" on this page:

Caution-
https://met.readthedocs.io/en/v9.1.2/Users_Guide/data_io.html#configuration-
file-details

In MET config files, when specifying a field "name" and "level", you
can also
specify "censor_thresh" and "censor_val" to list one or more filtering
thresholds and one or more replacement values. Below are 2 examples of
running
plot_data_plane to make plots of the same gridded data:

plot_data_plane data/sample_obs/ST4/ST4.2010010112.24h
plot_NO_CENSOR.ps
'name="APCP"; level="A24";'
plot_data_plane data/sample_obs/ST4/ST4.2010010112.24h
plot_CENSOR_BAD_DATA.ps 'name="APCP"; level="A24"; censor_thresh = [
eq-9999 ]; censor_val = [ 0 ];'

The first plots the raw data, including bad data values. The second
replaces
bad data values (-9999) with a value of 0. Here's a screenshot of the
resulting images:
[image: Screen Shot 2021-03-12 at 1.52.27 PM.png]

So if the only reason you're running gen_vx_mask is to change bad data
values
to 0, you could do that via the MET config files directly without the
need to
write an additional output file from gen_vx_mask. And that could
potentially
simplify your processing logic.

Thanks,
John

On Fri, Mar 12, 2021 at 1:41 PM Raby, John W USA CIV via RT <
met_help at ucar.edu> wrote:

>
> <Caution-url:
> Caution-https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99030 >
>
> CLASSIFICATION: UNCLASSIFIED
>
> Your quick answer is much appreciated, David.
> R/
> John
>
> -----Original Message-----
> From: David Fillmore via RT <met_help at ucar.edu>
> Sent: Friday, March 12, 2021 1:14 PM
> To: Raby, John W CIV USARMY DEVCOM ARL (USA)
> <john.w.raby2.civ at mail.mil>
> Subject: [Non-DoD Source] Re: [rt.rap.ucar.edu #99030] V9.1
> Gen-Vx-Mask
> (UNCLASSIFIED)
>
> All active links contained in this email were disabled.  Please
verify
> the identity of the sender, and confirm the authenticity of all
links
> contained within the message prior to copying and pasting the
address
> to a Web browser.
>
>
>
>
> ----
>
> Hi John,
> yes, that is correct.  The level indices are 0-based.
> thanks,
> David
>
> On Fri, Mar 12, 2021 at 8:39 AM Raby, John W USA CIV via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Fri Mar 12 08:39:09 2021: Request 99030 was acted upon.
> > Transaction: Ticket created by john.w.raby2.civ at mail.mil
> >        Queue: met_help
> >      Subject: V9.1 Gen-Vx-Mask (UNCLASSIFIED)
> >        Owner: Nobody
> >   Requestors: john.w.raby2.civ at mail.mil
> >       Status: new
> >  Ticket <Caution-Caution-url:
> > Caution-Caution-
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99
> > 030 >
> >
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> > I'm using Gen-Vx-Mask to replace missing data designated by
-9999.0
> > with zeros and am working with a 3D variable which has multiple
> > levels and want to specify the 3rd level. The data I'm working
with
> > is NetCDF and I'm using the argument to specify the level as
follows:
> > level="(0,2,*,*)"
> >
> > I assume that the "2" will specify the 3rd level since this is a
> > zero-based specification, correct?
> >
> > Thanks.
> >
> > R/
> > John
> > Mr. John W. Raby
> > U.S. Army Research Laboratory
> > White Sands Missile Range, NM 88002
> > Office:(575) 678-2004 DSN 258-2004
> > Teleworking: Contact Admin Specialist at (410) 278-6974 FAX (575)
> > 678-1230 DSN 258-1230
> > Email: john.w.raby2.civ at mail.mil
> >
> > CLASSIFICATION: UNCLASSIFIED
> >
> >
>
> CLASSIFICATION: UNCLASSIFIED
>
>

CLASSIFICATION: UNCLASSIFIED

------------------------------------------------