[Met_help] [rt.rap.ucar.edu #84813] History for masking and interpolation question
John Halley Gotway via RT
met_help at ucar.edu
Wed Jul 10 17:01:08 MDT 2019
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I have a model variable that should not be used for evaluation in places where it is contaminated by clouds. I can either set it to an undefined value or provide a 0-1 mask. Can both of these cases be handled by MET? Also, e.g. 2 or 3 points are masked/undefined - would bilinear interpolation
handle it properly with the remaining valid points?
Thanks,
Mariusz
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: masking and interpolation question
From: Randy Bullock
Time: Tue Apr 17 11:21:19 2018
Hi Mariusz -
Thanks for your email.
(1) MET has several ways to handle masking by a data field (clouds,
in
your case). Probably the easiest is to use the gen_vx_mask tool,
which can
read a gridded data field from an input file, and generate a mask file
that
can then be used with the other MET tools. You can find information
on
this in the gen_vx_mask chapter in the MET user's guide.
(2) Bilinear interplolation in a grid square needs to have valid data
in
all four corner points of the square. If you think that your cloud
masking
will mask out too many data points, then perhaps it would be best to
use
some other interpolation method.
Randy
On Tue, Apr 17, 2018 at 9:10 AM, Mariusz Pagowski via RT
<met_help at ucar.edu>
wrote:
>
> Tue Apr 17 09:10:04 2018: Request 84813 was acted upon.
> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> Queue: met_help
> Subject: masking and interpolation question
> Owner: Nobody
> Requestors: Mariusz.Pagowski at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>
>
> Hello,
> I have a model variable that should not be used for evaluation in
places
> where it is contaminated by clouds. I can either set it to an
undefined
> value or provide a 0-1 mask. Can both of these cases be handled by
MET?
> Also, e.g. 2 or 3 points are masked/undefined - would bilinear
interpolation
> handle it properly with the remaining valid points?
> Thanks,
> Mariusz
>
>
------------------------------------------------
Subject: masking and interpolation question
From: Mariusz Pagowski
Time: Tue Apr 17 14:24:54 2018
Randy,
I can see that ascii2nc can process surfrad data. I want to format AOD
surfrad data from
ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/
<ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/>
but that fails. Can you give me an advice what code AOD should be and
what would be a good template to start with.
I am loading MET modules on Theia,
Mariusz
> On Apr 17, 2018, at 11:21 AM, Randy Bullock via RT
<met_help at ucar.edu> wrote:
>
> Hi Mariusz -
>
> Thanks for your email.
>
> (1) MET has several ways to handle masking by a data field (clouds,
in
> your case). Probably the easiest is to use the gen_vx_mask tool,
which can
> read a gridded data field from an input file, and generate a mask
file that
> can then be used with the other MET tools. You can find
information on
> this in the gen_vx_mask chapter in the MET user's guide.
>
> (2) Bilinear interplolation in a grid square needs to have valid
data in
> all four corner points of the square. If you think that your cloud
masking
> will mask out too many data points, then perhaps it would be best to
use
> some other interpolation method.
>
> Randy
>
> On Tue, Apr 17, 2018 at 9:10 AM, Mariusz Pagowski via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> Tue Apr 17 09:10:04 2018: Request 84813 was acted upon.
>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>> Queue: met_help
>> Subject: masking and interpolation question
>> Owner: Nobody
>> Requestors: Mariusz.Pagowski at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>>
>>
>> Hello,
>> I have a model variable that should not be used for evaluation in
places
>> where it is contaminated by clouds. I can either set it to an
undefined
>> value or provide a 0-1 mask. Can both of these cases be handled by
MET?
>> Also, e.g. 2 or 3 points are masked/undefined - would bilinear
interpolation
>> handle it properly with the remaining valid points?
>> Thanks,
>> Mariusz
>>
>>
>
------------------------------------------------
Subject: masking and interpolation question
From: Tara Jensen
Time: Tue Apr 17 15:07:41 2018
Mariusz,
Sorry to step in here. MET reads SurfRad irradiance data but was not
configured to read AOD data files. Right now, the AOD files needs to
be in
the 11-column format specified on page 126 of the Users Guide. I took
a
screenshot and included here.
I hope this helps.
Best Regards, Tara
On Tue, Apr 17, 2018 at 2:24 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>
> Randy,
> I can see that ascii2nc can process surfrad data. I want to format
AOD
> surfrad data from
> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/ <
> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/>
> but that fails. Can you give me an advice what code AOD should be
and what
> would be a good template to start with.
> I am loading MET modules on Theia,
> Mariusz
>
>
>
> > On Apr 17, 2018, at 11:21 AM, Randy Bullock via RT
<met_help at ucar.edu>
> wrote:
> >
> > Hi Mariusz -
> >
> > Thanks for your email.
> >
> > (1) MET has several ways to handle masking by a data field
(clouds, in
> > your case). Probably the easiest is to use the gen_vx_mask tool,
which
> can
> > read a gridded data field from an input file, and generate a mask
file
> that
> > can then be used with the other MET tools. You can find
information on
> > this in the gen_vx_mask chapter in the MET user's guide.
> >
> > (2) Bilinear interplolation in a grid square needs to have valid
data in
> > all four corner points of the square. If you think that your
cloud
> masking
> > will mask out too many data points, then perhaps it would be best
to use
> > some other interpolation method.
> >
> > Randy
> >
> > On Tue, Apr 17, 2018 at 9:10 AM, Mariusz Pagowski via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >>
> >> Tue Apr 17 09:10:04 2018: Request 84813 was acted upon.
> >> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> >> Queue: met_help
> >> Subject: masking and interpolation question
> >> Owner: Nobody
> >> Requestors: Mariusz.Pagowski at noaa.gov
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
> >>
> >>
> >> Hello,
> >> I have a model variable that should not be used for evaluation in
places
> >> where it is contaminated by clouds. I can either set it to an
undefined
> >> value or provide a 0-1 mask. Can both of these cases be handled
by MET?
> >> Also, e.g. 2 or 3 points are masked/undefined - would bilinear
> interpolation
> >> handle it properly with the remaining valid points?
> >> Thanks,
> >> Mariusz
> >>
> >>
> >
>
>
>
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Tara Jensen
Project Manager II
NCAR RAL and DTC
PO Box 3000, Boulder, Colorado 80307 USA
+1 303-497-8479 jensen at ucar.edu
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #84813] masking and interpolation question
From: Mariusz Pagowski
Time: Tue Apr 17 15:42:02 2018
Thanks Tara,
just two follow up questions:
1) message type (col 1) for ADP can be ADPSFC?
2) can’t find GRIB code for AOD (col 7) - just the name “AOD” be OK?
Mariusz
> On Apr 17, 2018, at 3:07 PM, Tara Jensen via RT <met_help at ucar.edu>
wrote:
>
> Mariusz,
>
> Sorry to step in here. MET reads SurfRad irradiance data but was
not
> configured to read AOD data files. Right now, the AOD files needs
to be in
> the 11-column format specified on page 126 of the Users Guide. I
took a
> screenshot and included here.
>
>
> I hope this helps.
> Best Regards, Tara
>
> On Tue, Apr 17, 2018 at 2:24 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>>
>> Randy,
>> I can see that ascii2nc can process surfrad data. I want to format
AOD
>> surfrad data from
>> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/ <
>> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/>
>> but that fails. Can you give me an advice what code AOD should be
and what
>> would be a good template to start with.
>> I am loading MET modules on Theia,
>> Mariusz
>>
>>
>>
>>> On Apr 17, 2018, at 11:21 AM, Randy Bullock via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Mariusz -
>>>
>>> Thanks for your email.
>>>
>>> (1) MET has several ways to handle masking by a data field
(clouds, in
>>> your case). Probably the easiest is to use the gen_vx_mask tool,
which
>> can
>>> read a gridded data field from an input file, and generate a mask
file
>> that
>>> can then be used with the other MET tools. You can find
information on
>>> this in the gen_vx_mask chapter in the MET user's guide.
>>>
>>> (2) Bilinear interplolation in a grid square needs to have valid
data in
>>> all four corner points of the square. If you think that your
cloud
>> masking
>>> will mask out too many data points, then perhaps it would be best
to use
>>> some other interpolation method.
>>>
>>> Randy
>>>
>>> On Tue, Apr 17, 2018 at 9:10 AM, Mariusz Pagowski via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>>
>>>> Tue Apr 17 09:10:04 2018: Request 84813 was acted upon.
>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>> Queue: met_help
>>>> Subject: masking and interpolation question
>>>> Owner: Nobody
>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>>>>
>>>>
>>>> Hello,
>>>> I have a model variable that should not be used for evaluation in
places
>>>> where it is contaminated by clouds. I can either set it to an
undefined
>>>> value or provide a 0-1 mask. Can both of these cases be handled
by MET?
>>>> Also, e.g. 2 or 3 points are masked/undefined - would bilinear
>> interpolation
>>>> handle it properly with the remaining valid points?
>>>> Thanks,
>>>> Mariusz
>>>>
>>>>
>>>
>>
>>
>>
>
>
> --
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> Tara Jensen
> Project Manager II
> NCAR RAL and DTC
> PO Box 3000, Boulder, Colorado 80307 USA
> +1 303-497-8479 jensen at ucar.edu
>
> <image.png>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #84813] masking and interpolation question
From: Mariusz Pagowski
Time: Tue Apr 17 15:44:06 2018
Forgot to ask: does MET contain any code for converting LST to UTC?
Mariusz
> On Apr 17, 2018, at 3:07 PM, Tara Jensen via RT <met_help at ucar.edu>
wrote:
>
> Mariusz,
>
> Sorry to step in here. MET reads SurfRad irradiance data but was
not
> configured to read AOD data files. Right now, the AOD files needs
to be in
> the 11-column format specified on page 126 of the Users Guide. I
took a
> screenshot and included here.
>
>
> I hope this helps.
> Best Regards, Tara
>
> On Tue, Apr 17, 2018 at 2:24 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>>
>> Randy,
>> I can see that ascii2nc can process surfrad data. I want to format
AOD
>> surfrad data from
>> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/ <
>> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/>
>> but that fails. Can you give me an advice what code AOD should be
and what
>> would be a good template to start with.
>> I am loading MET modules on Theia,
>> Mariusz
>>
>>
>>
>>> On Apr 17, 2018, at 11:21 AM, Randy Bullock via RT
<met_help at ucar.edu>
>> wrote:
>>>
>>> Hi Mariusz -
>>>
>>> Thanks for your email.
>>>
>>> (1) MET has several ways to handle masking by a data field
(clouds, in
>>> your case). Probably the easiest is to use the gen_vx_mask tool,
which
>> can
>>> read a gridded data field from an input file, and generate a mask
file
>> that
>>> can then be used with the other MET tools. You can find
information on
>>> this in the gen_vx_mask chapter in the MET user's guide.
>>>
>>> (2) Bilinear interplolation in a grid square needs to have valid
data in
>>> all four corner points of the square. If you think that your
cloud
>> masking
>>> will mask out too many data points, then perhaps it would be best
to use
>>> some other interpolation method.
>>>
>>> Randy
>>>
>>> On Tue, Apr 17, 2018 at 9:10 AM, Mariusz Pagowski via RT <
>> met_help at ucar.edu>
>>> wrote:
>>>
>>>>
>>>> Tue Apr 17 09:10:04 2018: Request 84813 was acted upon.
>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>> Queue: met_help
>>>> Subject: masking and interpolation question
>>>> Owner: Nobody
>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>>>>
>>>>
>>>> Hello,
>>>> I have a model variable that should not be used for evaluation in
places
>>>> where it is contaminated by clouds. I can either set it to an
undefined
>>>> value or provide a 0-1 mask. Can both of these cases be handled
by MET?
>>>> Also, e.g. 2 or 3 points are masked/undefined - would bilinear
>> interpolation
>>>> handle it properly with the remaining valid points?
>>>> Thanks,
>>>> Mariusz
>>>>
>>>>
>>>
>>
>>
>>
>
>
> --
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> Tara Jensen
> Project Manager II
> NCAR RAL and DTC
> PO Box 3000, Boulder, Colorado 80307 USA
> +1 303-497-8479 jensen at ucar.edu
>
> <image.png>
------------------------------------------------
Subject: masking and interpolation question
From: Tara Jensen
Time: Tue Apr 17 16:00:52 2018
Mariusz,
ADPSFC should be fine for Column 1.
As of METv6.1, you do not have to specify a Grib Code, so "AOD" should
suffice. Make sure you specify name="AOD" in the definition of the
field
in the point-stat call.
To the best of my knowledge, we do not support LST to UTC conversion
in MET.
Best Regards, Tara
On Tue, Apr 17, 2018 at 3:44 PM, Mariusz Pagowski via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
>
> Forgot to ask: does MET contain any code for converting LST to UTC?
> Mariusz
>
>
> > On Apr 17, 2018, at 3:07 PM, Tara Jensen via RT
<met_help at ucar.edu>
> wrote:
> >
> > Mariusz,
> >
> > Sorry to step in here. MET reads SurfRad irradiance data but was
not
> > configured to read AOD data files. Right now, the AOD files needs
to be
> in
> > the 11-column format specified on page 126 of the Users Guide. I
took a
> > screenshot and included here.
> >
> >
> > I hope this helps.
> > Best Regards, Tara
> >
> > On Tue, Apr 17, 2018 at 2:24 PM, Mariusz Pagowski via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813 >
> >>
> >> Randy,
> >> I can see that ascii2nc can process surfrad data. I want to
format AOD
> >> surfrad data from
> >> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/ <
> >> ftp://aftp.cmdl.noaa.gov/data/radiation/surfrad/aod/bon/2015/>
> >> but that fails. Can you give me an advice what code AOD should be
and
> what
> >> would be a good template to start with.
> >> I am loading MET modules on Theia,
> >> Mariusz
> >>
> >>
> >>
> >>> On Apr 17, 2018, at 11:21 AM, Randy Bullock via RT
<met_help at ucar.edu>
> >> wrote:
> >>>
> >>> Hi Mariusz -
> >>>
> >>> Thanks for your email.
> >>>
> >>> (1) MET has several ways to handle masking by a data field
(clouds, in
> >>> your case). Probably the easiest is to use the gen_vx_mask
tool, which
> >> can
> >>> read a gridded data field from an input file, and generate a
mask file
> >> that
> >>> can then be used with the other MET tools. You can find
information
> on
> >>> this in the gen_vx_mask chapter in the MET user's guide.
> >>>
> >>> (2) Bilinear interplolation in a grid square needs to have
valid data
> in
> >>> all four corner points of the square. If you think that your
cloud
> >> masking
> >>> will mask out too many data points, then perhaps it would be
best to
> use
> >>> some other interpolation method.
> >>>
> >>> Randy
> >>>
> >>> On Tue, Apr 17, 2018 at 9:10 AM, Mariusz Pagowski via RT <
> >> met_help at ucar.edu>
> >>> wrote:
> >>>
> >>>>
> >>>> Tue Apr 17 09:10:04 2018: Request 84813 was acted upon.
> >>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> >>>> Queue: met_help
> >>>> Subject: masking and interpolation question
> >>>> Owner: Nobody
> >>>> Requestors: Mariusz.Pagowski at noaa.gov
> >>>> Status: new
> >>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84813
> >
> >>>>
> >>>>
> >>>> Hello,
> >>>> I have a model variable that should not be used for evaluation
in
> places
> >>>> where it is contaminated by clouds. I can either set it to an
> undefined
> >>>> value or provide a 0-1 mask. Can both of these cases be handled
by
> MET?
> >>>> Also, e.g. 2 or 3 points are masked/undefined - would bilinear
> >> interpolation
> >>>> handle it properly with the remaining valid points?
> >>>> Thanks,
> >>>> Mariusz
> >>>>
> >>>>
> >>>
> >>
> >>
> >>
> >
> >
> > --
> > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> > Tara Jensen
> > Project Manager II
> > NCAR RAL and DTC
> > PO Box 3000, Boulder, Colorado 80307 USA
> > +1 303-497-8479 jensen at ucar.edu
> >
> > <image.png>
>
>
>
>
--
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Tara Jensen
Project Manager II
NCAR RAL and DTC
PO Box 3000, Boulder, Colorado 80307 USA
+1 303-497-8479 jensen at ucar.edu
------------------------------------------------
More information about the Met_help
mailing list