[Met_help] [rt.rap.ucar.edu #95364] History for MRMS data reading with MET-9.0.1 on WCOSS Mars
Julie Prestopnik via RT
met_help at ucar.edu
Wed Jun 17 10:52:27 MDT 2020
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I'm running into an issue with MRMS data being read in MET-9.0.1
(specifically regrid_data_plane) on Mars since the WCOSS production switch
last week. MET runs successfully, but the output is all null data.
I attached a full example log file, which shows the input data plane has
min and max values of -999. That's the value I use to identify missing
values with censor_thresh, so I understand why the output is all null data.
I checked the input data with wgrib2 and ncl_filedump, and the data file
has realistic values. MET-8.1 also reads the data correctly, so it seems
like something is incorrect or missing with the MET-9.0.1 build. I see the
following warning in the output, but I'm not sure if it's the culprit:
"libpng warning: Application built with libpng-1.2.59 but running with
1.5.13"
Any help on this would be greatly appreciated.
Thanks,
Logan
--
Logan C. Dawson, Ph.D.
Physical Scientist, VPPPG/MEG
NOAA/NWS/NCEP/EMC
(301) 683-3944
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Julie Prestopnik
Time: Tue May 26 14:27:32 2020
Hi Logan.
I just wanted to let you know I'm looking into what is going on. I am
able
to reproduce the problem you are experiencing with 9.0.1 vs. 8.1.
I see the following warning in the output, but I'm not sure if it's
the
> culprit:
> "libpng warning: Application built with libpng-1.2.59 but running
with
> 1.5.13"
>
Thanks for pointing this out. That could be a problem. This is our
first
attempt at using the modules on WCOSS for MET's dependent libraries
instead
of building our own. I see that libpng/1.2.59 is loaded and not
libpng/1.5.13, so I'm not sure why it is running with 1.5.13. I'm not
entirely sure how all of these work together. When I built MET
using libpng/1.2.59, I did so because I was using g2c/1.5.0 and I saw
in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-ips.log that
it
used libpng/1.2.59, so I did the same.
I will follow up once I have a better idea of what is going on.
Julie
On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
> Transaction: Ticket created by logan.dawson at noaa.gov
> Queue: met_help
> Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
> Owner: Nobody
> Requestors: logan.dawson at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
>
>
> Hi,
>
> I'm running into an issue with MRMS data being read in MET-9.0.1
> (specifically regrid_data_plane) on Mars since the WCOSS production
switch
> last week. MET runs successfully, but the output is all null data.
>
> I attached a full example log file, which shows the input data plane
has
> min and max values of -999. That's the value I use to identify
missing
> values with censor_thresh, so I understand why the output is all
null data.
>
> I checked the input data with wgrib2 and ncl_filedump, and the data
file
> has realistic values. MET-8.1 also reads the data correctly, so it
seems
> like something is incorrect or missing with the MET-9.0.1 build. I
see the
> following warning in the output, but I'm not sure if it's the
culprit:
> "libpng warning: Application built with libpng-1.2.59 but running
with
> 1.5.13"
>
> Any help on this would be greatly appreciated.
>
> Thanks,
> Logan
>
> --
> Logan C. Dawson, Ph.D.
> Physical Scientist, VPPPG/MEG
> NOAA/NWS/NCEP/EMC
> (301) 683-3944
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Julie Prestopnik
Time: Tue May 26 15:04:45 2020
Hi Logan.
As you know, "module spider" isn't working for me on mars right now.
I
can't seem to find a version 1.5.13 of libpng. I try simply loading
it,
but it doesn't work:
> [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
>
> *Lmod has detected the following error: * These module(s) exist but
> cannot be loaded as requested: "libpng/1.5.13"
>
> Try: "module spider libpng/1.5.13" to see how to load the
module(s).
>
I've tried loading:
- libpng/1.5.13
- loading ips first and then load libpng/1.5.13
- loading gnu first and then load libpng/1.5.13
None of those have worked or have found any libpng/1.5.13. Since
"module
spider" is working for you in your default environment, could you
please
take a look and let me know if you can find anything?
Thanks,
Julie
On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik <jpresto at ucar.edu>
wrote:
> Hi Logan.
>
> I just wanted to let you know I'm looking into what is going on. I
am
> able to reproduce the problem you are experiencing with 9.0.1 vs.
8.1.
>
> I see the following warning in the output, but I'm not sure if it's
the
>> culprit:
>> "libpng warning: Application built with libpng-1.2.59 but running
with
>> 1.5.13"
>>
> Thanks for pointing this out. That could be a problem. This is our
first
> attempt at using the modules on WCOSS for MET's dependent libraries
instead
> of building our own. I see that libpng/1.2.59 is loaded and not
> libpng/1.5.13, so I'm not sure why it is running with 1.5.13. I'm
not
> entirely sure how all of these work together. When I built MET
> using libpng/1.2.59, I did so because I was using g2c/1.5.0 and I
saw
> in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-ips.log
that it
> used libpng/1.2.59, so I did the same.
>
> I will follow up once I have a better idea of what is going on.
>
> Julie
>
> On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
>>
>> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
>> Transaction: Ticket created by logan.dawson at noaa.gov
>> Queue: met_help
>> Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
>> Owner: Nobody
>> Requestors: logan.dawson at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
>>
>>
>> Hi,
>>
>> I'm running into an issue with MRMS data being read in MET-9.0.1
>> (specifically regrid_data_plane) on Mars since the WCOSS production
switch
>> last week. MET runs successfully, but the output is all null data.
>>
>> I attached a full example log file, which shows the input data
plane has
>> min and max values of -999. That's the value I use to identify
missing
>> values with censor_thresh, so I understand why the output is all
null
>> data.
>>
>> I checked the input data with wgrib2 and ncl_filedump, and the data
file
>> has realistic values. MET-8.1 also reads the data correctly, so it
seems
>> like something is incorrect or missing with the MET-9.0.1 build. I
see the
>> following warning in the output, but I'm not sure if it's the
culprit:
>> "libpng warning: Application built with libpng-1.2.59 but running
with
>> 1.5.13"
>>
>> Any help on this would be greatly appreciated.
>>
>> Thanks,
>> Logan
>>
>> --
>> Logan C. Dawson, Ph.D.
>> Physical Scientist, VPPPG/MEG
>> NOAA/NWS/NCEP/EMC
>> (301) 683-3944
>>
>>
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Logan Dawson - NOAA Affiliate
Time: Tue May 26 15:29:06 2020
Hi Julie,
Thanks for checking into this issue for me.
Here's what I get when I ran 'module spider libpng':
Versions:
libpng/1.2.44
libpng/1.2.59
Other possible modules matches:
compiler_third/ips/19.0.5/libpng
I did a little poking around in the
/usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and I only saw
those
same two versions mentioned above. I didn't see anything for libpng
under
the /usrx/local/prod/packages/ips/18.0.1/ directory either.
Also, I sourced my METplus environment file (/u/Logan.Dawson/.bashrc),
and
the the correct libpng path
(/usrx/local/prod/packages/gnu/4.8.5/libpng
/1.2.59/bin) shows up there.
So I'm not entirely sure where libpng/1.5.13 is coming from either.
Hopefully the WCOSS helpdesk ticket you submitted will be useful in
sorting
it out.
Thanks,
Logan
On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Logan.
>
> As you know, "module spider" isn't working for me on mars right now.
I
> can't seem to find a version 1.5.13 of libpng. I try simply loading
it,
> but it doesn't work:
>
> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
> >
> > *Lmod has detected the following error: * These module(s) exist
but
> > cannot be loaded as requested: "libpng/1.5.13"
> >
> > Try: "module spider libpng/1.5.13" to see how to load the
module(s).
> >
>
> I've tried loading:
>
> - libpng/1.5.13
> - loading ips first and then load libpng/1.5.13
> - loading gnu first and then load libpng/1.5.13
>
> None of those have worked or have found any libpng/1.5.13. Since
"module
> spider" is working for you in your default environment, could you
please
> take a look and let me know if you can find anything?
>
> Thanks,
> Julie
>
> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik <jpresto at ucar.edu>
wrote:
>
> > Hi Logan.
> >
> > I just wanted to let you know I'm looking into what is going on.
I am
> > able to reproduce the problem you are experiencing with 9.0.1 vs.
8.1.
> >
> > I see the following warning in the output, but I'm not sure if
it's the
> >> culprit:
> >> "libpng warning: Application built with libpng-1.2.59 but running
with
> >> 1.5.13"
> >>
> > Thanks for pointing this out. That could be a problem. This is
our first
> > attempt at using the modules on WCOSS for MET's dependent
libraries
> instead
> > of building our own. I see that libpng/1.2.59 is loaded and not
> > libpng/1.5.13, so I'm not sure why it is running with 1.5.13. I'm
not
> > entirely sure how all of these work together. When I built MET
> > using libpng/1.2.59, I did so because I was using g2c/1.5.0 and I
saw
> > in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-ips.log
that it
> > used libpng/1.2.59, so I did the same.
> >
> > I will follow up once I have a better idea of what is going on.
> >
> > Julie
> >
> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> >>
> >> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
> >> Transaction: Ticket created by logan.dawson at noaa.gov
> >> Queue: met_help
> >> Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
> >> Owner: Nobody
> >> Requestors: logan.dawson at noaa.gov
> >> Status: new
> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
> >>
> >>
> >> Hi,
> >>
> >> I'm running into an issue with MRMS data being read in MET-9.0.1
> >> (specifically regrid_data_plane) on Mars since the WCOSS
production
> switch
> >> last week. MET runs successfully, but the output is all null
data.
> >>
> >> I attached a full example log file, which shows the input data
plane has
> >> min and max values of -999. That's the value I use to identify
missing
> >> values with censor_thresh, so I understand why the output is all
null
> >> data.
> >>
> >> I checked the input data with wgrib2 and ncl_filedump, and the
data file
> >> has realistic values. MET-8.1 also reads the data correctly, so
it seems
> >> like something is incorrect or missing with the MET-9.0.1 build.
I see
> the
> >> following warning in the output, but I'm not sure if it's the
culprit:
> >> "libpng warning: Application built with libpng-1.2.59 but running
with
> >> 1.5.13"
> >>
> >> Any help on this would be greatly appreciated.
> >>
> >> Thanks,
> >> Logan
> >>
> >> --
> >> Logan C. Dawson, Ph.D.
> >> Physical Scientist, VPPPG/MEG
> >> NOAA/NWS/NCEP/EMC
> >> (301) 683-3944
> >>
> >>
> >
> > --
> > Julie Prestopnik
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
>
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Logan C. Dawson, Ph.D.
Physical Scientist, VPPPG/MEG
NOAA/NWS/NCEP/EMC
(301) 683-3944
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Logan Dawson - NOAA Affiliate
Time: Thu Jun 11 12:43:38 2020
Hi Julie,
As I mentioned on Slack, I'm still getting the same libpng warning
with
MET-9.0.2 on Venus when reading in MRMS GRIB2 data.
I attached METplus log files with the regrid_data_plane output from
both
versions run on the same data file. You'll see that the data_plane
function
in met-9.0.2 reads in all of the data as -999 values.
I thought it might be a useful exercise to see if regrid_data_plane
produces the same behavior on a different machine, so I put the sample
file
and the file I use to define the output grid on the RAL ftp server:
/incoming/irap/met_help/dawson_data
I thought trying it on a different machine might help us determine if
the
problem is coming from the WCOSS installation or somewhere else.
Thanks,
Logan
On Tue, May 26, 2020 at 5:28 PM Logan Dawson - NOAA Federal <
logan.dawson at noaa.gov> wrote:
> Hi Julie,
>
> Thanks for checking into this issue for me.
>
> Here's what I get when I ran 'module spider libpng':
>
> Versions:
>
> libpng/1.2.44
>
> libpng/1.2.59
>
> Other possible modules matches:
>
> compiler_third/ips/19.0.5/libpng
>
>
> I did a little poking around in the
> /usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and I only
saw
> those same two versions mentioned above. I didn't see anything for
libpng
> under the /usrx/local/prod/packages/ips/18.0.1/ directory either.
>
> Also, I sourced my METplus environment file
(/u/Logan.Dawson/.bashrc),
> and the the correct libpng path
(/usrx/local/prod/packages/gnu/4.8.5/
> libpng/1.2.59/bin) shows up there.
>
> So I'm not entirely sure where libpng/1.5.13 is coming from either.
> Hopefully the WCOSS helpdesk ticket you submitted will be useful in
sorting
> it out.
>
> Thanks,
> Logan
>
> On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
>> Hi Logan.
>>
>> As you know, "module spider" isn't working for me on mars right
now. I
>> can't seem to find a version 1.5.13 of libpng. I try simply
loading it,
>> but it doesn't work:
>>
>> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
>> >
>> > *Lmod has detected the following error: * These module(s) exist
but
>> > cannot be loaded as requested: "libpng/1.5.13"
>> >
>> > Try: "module spider libpng/1.5.13" to see how to load the
module(s).
>> >
>>
>> I've tried loading:
>>
>> - libpng/1.5.13
>> - loading ips first and then load libpng/1.5.13
>> - loading gnu first and then load libpng/1.5.13
>>
>> None of those have worked or have found any libpng/1.5.13. Since
"module
>> spider" is working for you in your default environment, could you
please
>> take a look and let me know if you can find anything?
>>
>> Thanks,
>> Julie
>>
>> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik <jpresto at ucar.edu>
>> wrote:
>>
>> > Hi Logan.
>> >
>> > I just wanted to let you know I'm looking into what is going on.
I am
>> > able to reproduce the problem you are experiencing with 9.0.1 vs.
8.1.
>> >
>> > I see the following warning in the output, but I'm not sure if
it's the
>> >> culprit:
>> >> "libpng warning: Application built with libpng-1.2.59 but
running with
>> >> 1.5.13"
>> >>
>> > Thanks for pointing this out. That could be a problem. This is
our
>> first
>> > attempt at using the modules on WCOSS for MET's dependent
libraries
>> instead
>> > of building our own. I see that libpng/1.2.59 is loaded and not
>> > libpng/1.5.13, so I'm not sure why it is running with 1.5.13.
I'm not
>> > entirely sure how all of these work together. When I built MET
>> > using libpng/1.2.59, I did so because I was using g2c/1.5.0 and I
saw
>> > in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-ips.log
that it
>> > used libpng/1.2.59, so I did the same.
>> >
>> > I will follow up once I have a better idea of what is going on.
>> >
>> > Julie
>> >
>> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA Affiliate
via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> >>
>> >> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
>> >> Transaction: Ticket created by logan.dawson at noaa.gov
>> >> Queue: met_help
>> >> Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
>> >> Owner: Nobody
>> >> Requestors: logan.dawson at noaa.gov
>> >> Status: new
>> >> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
>> >
>> >>
>> >>
>> >> Hi,
>> >>
>> >> I'm running into an issue with MRMS data being read in MET-9.0.1
>> >> (specifically regrid_data_plane) on Mars since the WCOSS
production
>> switch
>> >> last week. MET runs successfully, but the output is all null
data.
>> >>
>> >> I attached a full example log file, which shows the input data
plane
>> has
>> >> min and max values of -999. That's the value I use to identify
missing
>> >> values with censor_thresh, so I understand why the output is all
null
>> >> data.
>> >>
>> >> I checked the input data with wgrib2 and ncl_filedump, and the
data
>> file
>> >> has realistic values. MET-8.1 also reads the data correctly, so
it
>> seems
>> >> like something is incorrect or missing with the MET-9.0.1 build.
I see
>> the
>> >> following warning in the output, but I'm not sure if it's the
culprit:
>> >> "libpng warning: Application built with libpng-1.2.59 but
running with
>> >> 1.5.13"
>> >>
>> >> Any help on this would be greatly appreciated.
>> >>
>> >> Thanks,
>> >> Logan
>> >>
>> >> --
>> >> Logan C. Dawson, Ph.D.
>> >> Physical Scientist, VPPPG/MEG
>> >> NOAA/NWS/NCEP/EMC
>> >> (301) 683-3944
>> >>
>> >>
>> >
>> > --
>> > Julie Prestopnik
>> > Software Engineer
>> > National Center for Atmospheric Research
>> > Research Applications Laboratory
>> > Phone: 303.497.8399
>> > Email: jpresto at ucar.edu
>> >
>> > My working day may not be your working day. Please do not feel
obliged
>> to
>> > reply to this email outside of your normal working hours.
>> >
>>
>>
>> --
>> Julie Prestopnik
>> Software Engineer
>> National Center for Atmospheric Research
>> Research Applications Laboratory
>> Phone: 303.497.8399
>> Email: jpresto at ucar.edu
>>
>> My working day may not be your working day. Please do not feel
obliged to
>> reply to this email outside of your normal working hours.
>>
>>
>
> --
> Logan C. Dawson, Ph.D.
> Physical Scientist, VPPPG/MEG
> NOAA/NWS/NCEP/EMC
> (301) 683-3944
>
--
Logan C. Dawson, Ph.D.
Physical Scientist, VPPPG/MEG
NOAA/NWS/NCEP/EMC
(301) 683-3944
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Logan Dawson - NOAA Affiliate
Time: Thu Jun 11 12:43:38 2020
06/11 13:27:31.551 metplus INFO: Running METplus v3.0.2 called with
command:
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0.2/ush/master_metplus.py -c
/gpfs/dell2/emc/verification/save/Logan.Dawson/CAM_verif/parm/metplus_config/METplus-
3.0/ldawson_dell.conf
/gpfs/dell2/emc/verification/save/Logan.Dawson/CAM_verif/parm/use_cases/METplus-
3.0/regrid_mrms_obs/RegridDataPlane_obsMRMS_REFC_toG227.conf
06/11 13:27:31.560 metplus (config_launcher.py:520) DEBUG: Setting
[config] USER_SHELL to default value: bash.
06/11 13:27:31.560 metplus (config_launcher.py:520) DEBUG: Setting
[config] DO_NOT_RUN_EXE to default value: False.
06/11 13:27:31.563 metplus (config_launcher.py:520) DEBUG: Setting
[config] LOG_REGRID_DATA_PLANE_VERBOSITY to default value: 5.
06/11 13:27:31.564 metplus (config_launcher.py:520) DEBUG: Setting
[config] REGRID_DATA_PLANE_GAUSSIAN_DX to default value: .
06/11 13:27:31.564 metplus (config_launcher.py:520) DEBUG: Setting
[config] REGRID_DATA_PLANE_GAUSSIAN_RADIUS to default value: .
06/11 13:27:31.671 metplus INFO:
****************************************
06/11 13:27:31.671 metplus INFO: * Running METplus
06/11 13:27:31.672 metplus INFO: * at valid time: 202006111300
06/11 13:27:31.672 metplus INFO:
****************************************
06/11 13:27:31.672 metplus (config_launcher.py:520) DEBUG: Setting
[config] LEAD_SEQ_MIN to default value: 0.
06/11 13:27:31.672 metplus (config_launcher.py:520) DEBUG: Setting
[config] LEAD_SEQ_MAX to default value: 4000Y.
06/11 13:27:31.673 metplus.RegridDataPlane INFO: Processing OBS data
06/11 13:27:31.673 metplus.RegridDataPlane INFO: Processing forecast
lead 0 hours
06/11 13:27:31.686 metplus (config_launcher.py:520) DEBUG: Setting
[config] OBS_PCP_COMBINE_RUN to default value: False.
06/11 13:27:31.687 metplus.RegridDataPlane INFO: COMMAND:
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.0.2/bin/regrid_data_plane
-v 5 -field 'name="MergedReflectivityQCComposite"; level="Z500";'
-method BUDGET -width 2 -name MergedReflectivityQCComposite
/gpfs/dell2/ptmp/Logan.Dawson/com/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000.grib2
"/gpfs/dell2/emc/verification/noscrub/Logan.Dawson/CAM_verif/masks/grid_files/G227.nc"
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/regrid/G227/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000_g227.nc
06/11 13:27:31.690 metplus.RegridDataPlane (command_runner.py:124)
DEBUG: app_name is: regrid_data_plane, output sent to:
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/logs/MRMS/2020061113/master_metplus.MergedReflectivityQCComposite.log.20200611132731
MET OUTPUT:
DEBUG 1: Reading data file:
/gpfs/dell2/ptmp/Logan.Dawson/com/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000.grib2
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_Gb2".
DEBUG 3: Unexpected earth shape (2). Assuming spherical earth with
radius 6371.2 km for internal consistentcy.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: 20.005
DEBUG 4: lon_ll: 129.995
DEBUG 4: delta_lat: 0.01
DEBUG 4: delta_lon: 0.01
DEBUG 4: Nlat: 3500
DEBUG 4: Nlon: 7000
DEBUG 4:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object
of type "FileType_Gb2".
DEBUG 2: Input grid: Projection: Lat/Lon Nx: 7000 Ny: 3500 lat_ll:
20.005 lon_ll: 129.995 delta_lat: 0.010 delta_lon: 0.010
DEBUG 3: Use the grid defined by file
"/gpfs/dell2/emc/verification/noscrub/Logan.Dawson/CAM_verif/masks/grid_files/G227.nc".
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_NcMet".
DEBUG 4:
DEBUG 4: Lambert Conformal Grid Data:
DEBUG 4: hemisphere: N
DEBUG 4: scale_lat_1: 25
DEBUG 4: scale_lat_2: 25
DEBUG 4: lat_pin: 12.19
DEBUG 4: lon_pin: 133.459
DEBUG 4: x_pin: 0
DEBUG 4: y_pin: 0
DEBUG 4: lon_orient: 95
DEBUG 4: d_km: 5.079
DEBUG 4: r_km: 6371.2
DEBUG 4: nx: 1473
DEBUG 4: ny: 1025
DEBUG 4: so2_angle: 0
DEBUG 4:
DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 1473 Ny:
1025 Lat_LL: 12.190 Lon_LL: 133.459 Lon_orient: 95.000 Alpha: 3254.801
Cone: 0.423 Bx: 832.0708 By: 2854.0612
DEBUG 2: Output grid: Projection: Lambert Conformal Nx: 1473 Ny: 1025
Lat_LL: 12.190 Lon_LL: 133.459 Lon_orient: 95.000 Alpha: 3254.801
Cone: 0.423 Bx: 832.0708 By: 2854.0612
DEBUG 2: Interpolation options: method = BUDGET, width = 2, shape =
SQUARE, vld_thresh = 0.5
DEBUG 3: MetGrib2DataFile::data_plane() -> Found exact match for
'MergedReflectivityQCComposite/Z500' in GRIB2 record 1 field 1 of
GRIB2 file
'/gpfs/dell2/ptmp/Logan.Dawson/com/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000.grib2'
libpng warning: Application built with libpng-1.2.59 but running with
1.5.13
DEBUG 4:
DEBUG 4: Data plane information:
DEBUG 4: plane min: -999
DEBUG 4: plane max: -999
DEBUG 4: scan mode: 0
DEBUG 4: valid time: 20200611_130034
DEBUG 4: lead time: 000000
DEBUG 4: init time: 20200611_130034
DEBUG 4: bitmap flag: 255
DEBUG 4:
DEBUG 2: Range of input data (name="MergedReflectivityQCComposite";
level="Z500";) is -999 to -999.
DEBUG 2: Range of regridded data
(name="MergedReflectivityQCComposite"; level="Z500";) is -999 to -999.
DEBUG 1: Writing output file:
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/regrid/G227/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000_g227.nc
06/11 13:27:43.655 metplus.RegridDataPlane (command_runner.py:191)
DEBUG: Finished running
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.0.2/bin/regrid_data_plane
in 0:00:11.932583
06/11 13:27:43.657 metplus INFO:
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/grid2grid_mrms/MRMS/metplus_final_RegridDataPlane_REFC_toG227.conf:
write metplus.conf here
06/11 13:27:43.664 metplus (met_util.py:213) DEBUG: METplus took
0:00:12.664228 to run.
06/11 13:27:43.664 metplus INFO: METplus has successfully finished
running.
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Logan Dawson - NOAA Affiliate
Time: Thu Jun 11 12:43:38 2020
06/11 13:49:26.965 metplus INFO: Running METplus v3.0 called with
command:
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.0/ush/master_metplus.py -c
/gpfs/dell2/emc/verification/save/Logan.Dawson/CAM_verif/parm/metplus_config/METplus-
3.0/ldawson_dell.conf
/gpfs/dell2/emc/verification/save/Logan.Dawson/CAM_verif/parm/use_cases/METplus-
3.0/regrid_mrms_obs/RegridDataPlane_obsMRMS_REFC_toG227.conf
06/11 13:49:26.970 metplus (config_launcher.py:520) DEBUG: Setting
[config] USER_SHELL to default value: bash.
06/11 13:49:26.970 metplus (config_launcher.py:520) DEBUG: Setting
[config] DO_NOT_RUN_EXE to default value: False.
06/11 13:49:26.973 metplus (config_launcher.py:520) DEBUG: Setting
[config] LOG_REGRID_DATA_PLANE_VERBOSITY to default value: 5.
06/11 13:49:26.974 metplus (config_launcher.py:520) DEBUG: Setting
[config] REGRID_DATA_PLANE_GAUSSIAN_DX to default value: .
06/11 13:49:26.974 metplus (config_launcher.py:520) DEBUG: Setting
[config] REGRID_DATA_PLANE_GAUSSIAN_RADIUS to default value: .
06/11 13:49:26.979 metplus INFO:
****************************************
06/11 13:49:26.979 metplus INFO: * Running METplus
06/11 13:49:26.979 metplus INFO: * at valid time: 202006111300
06/11 13:49:26.980 metplus INFO:
****************************************
06/11 13:49:26.980 metplus (config_launcher.py:520) DEBUG: Setting
[config] LEAD_SEQ_MIN to default value: 0.
06/11 13:49:26.980 metplus (config_launcher.py:520) DEBUG: Setting
[config] LEAD_SEQ_MAX to default value: 4000Y.
06/11 13:49:26.980 metplus.RegridDataPlane INFO: Processing OBS data
06/11 13:49:26.980 metplus.RegridDataPlane INFO: Processing forecast
lead 0 hours
06/11 13:49:26.989 metplus (config_launcher.py:520) DEBUG: Setting
[config] OBS_PCP_COMBINE_RUN to default value: False.
06/11 13:49:26.989 metplus.RegridDataPlane INFO: COMMAND:
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.0/bin/regrid_data_plane
-v 5 -field 'name="MergedReflectivityQCComposite"; level="Z500";'
-method BUDGET -width 2 -name MergedReflectivityQCComposite
/gpfs/dell2/ptmp/Logan.Dawson/com/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000.grib2
"/gpfs/dell2/emc/verification/noscrub/Logan.Dawson/CAM_verif/masks/grid_files/G227.nc"
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/regrid/G227/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000_g227.nc
06/11 13:49:26.991 metplus.RegridDataPlane (command_runner.py:124)
DEBUG: app_name is: regrid_data_plane, output sent to:
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/logs/MRMS/2020061113/master_metplus.MergedReflectivityQCComposite.log.20200611134926
MET OUTPUT:
DEBUG 1: Reading data file:
/gpfs/dell2/ptmp/Logan.Dawson/com/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000.grib2
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_Gb2".
DEBUG 3: Unexpected earth shape (2). Assuming spherical earth with
radius 6371.2 km for internal consistentcy.
DEBUG 4:
DEBUG 4: Latitude/Longitude Grid Data:
DEBUG 4: lat_ll: 20.005
DEBUG 4: lon_ll: 129.995
DEBUG 4: delta_lat: 0.01
DEBUG 4: delta_lon: 0.01
DEBUG 4: Nlat: 3500
DEBUG 4: Nlon: 7000
DEBUG 4:
DEBUG 4: VarInfoFactory::new_var_info() -> created new VarInfo object
of type "FileType_Gb2".
DEBUG 2: Input grid: Projection: Lat/Lon Nx: 7000 Ny: 3500 lat_ll:
20.005 lon_ll: 129.995 delta_lat: 0.010 delta_lon: 0.010
DEBUG 3: Use the grid defined by file
"/gpfs/dell2/emc/verification/noscrub/Logan.Dawson/CAM_verif/masks/grid_files/G227.nc".
DEBUG 4: Met2dDataFileFactory::new_met_2d_data_file() -> created new
Met2dDataFile object of type "FileType_NcMet".
DEBUG 4:
DEBUG 4: Lambert Conformal Grid Data:
DEBUG 4: hemisphere: N
DEBUG 4: scale_lat_1: 25
DEBUG 4: scale_lat_2: 25
DEBUG 4: lat_pin: 12.19
DEBUG 4: lon_pin: 133.459
DEBUG 4: x_pin: 0
DEBUG 4: y_pin: 0
DEBUG 4: lon_orient: 95
DEBUG 4: d_km: 5.079
DEBUG 4: r_km: 6371.2
DEBUG 4: nx: 1473
DEBUG 4: ny: 1025
DEBUG 4: so2_angle: 0
DEBUG 4:
DEBUG 3: Grid Definition: Projection: Lambert Conformal Nx: 1473 Ny:
1025 Lat_LL: 12.190 Lon_LL: 133.459 Lon_orient: 95.000 Alpha: 3254.801
Cone: 0.423 Bx: 832.0708 By: 2854.0612
DEBUG 2: Output grid: Projection: Lambert Conformal Nx: 1473 Ny: 1025
Lat_LL: 12.190 Lon_LL: 133.459 Lon_orient: 95.000 Alpha: 3254.801
Cone: 0.423 Bx: 832.0708 By: 2854.0612
DEBUG 2: Interpolation options: method = BUDGET, width = 2, shape =
SQUARE, vld_thresh = 0.5
DEBUG 3: MetGrib2DataFile::data_plane() -> Found exact match for
'MergedReflectivityQCComposite/Z500' in GRIB2 record 1 field 1 of
GRIB2 file
'/gpfs/dell2/ptmp/Logan.Dawson/com/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000.grib2'
DEBUG 4:
DEBUG 4: Data plane information:
DEBUG 4: plane min: -999
DEBUG 4: plane max: 78
DEBUG 4: scan mode: 0
DEBUG 4: valid time: 20200611_130034
DEBUG 4: lead time: 000000
DEBUG 4: init time: 20200611_130034
DEBUG 4: bitmap flag: 255
DEBUG 4:
DEBUG 2: Range of input data (name="MergedReflectivityQCComposite";
level="Z500";) is -999 to 78.
DEBUG 2: Range of regridded data
(name="MergedReflectivityQCComposite"; level="Z500";) is -999 to
48.6046.
DEBUG 1: Writing output file:
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/regrid/G227/MRMS/20200611/MergedReflectivityQCComposite_00.50_20200611-
130000_g227.nc
06/11 13:49:49.355 metplus.RegridDataPlane (command_runner.py:191)
DEBUG: Finished running
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met/9.0/bin/regrid_data_plane
in 0:00:22.330287
06/11 13:49:49.356 metplus INFO:
/gpfs/dell2/ptmp/Logan.Dawson/CAM_verif/METplus/metplus.out/grid2grid_mrms/MRMS/metplus_final_RegridDataPlane_REFC_toG227.conf:
write metplus.conf here
06/11 13:49:49.364 metplus (met_util.py:213) DEBUG: METplus took
0:00:23.364290 to run.
06/11 13:49:49.364 metplus INFO: METplus has successfully finished
running.
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Julie Prestopnik
Time: Thu Jun 11 14:25:50 2020
Hi Logan.
Thank you so much for following up and for providing us with failure
and
success files and also the data. I ran your regrid_data_plane case
successfully using met-9.0 and met-9.0.2 on a local machine, so it
does
appear to be a problem with the build of 9.0.2 on WCOSS. The
difference in
the builds between 9.0 and 9.0.2 on WCOSS is that 9.0.2 uses any
available
modules for the external library dependencies, whereas for 9.0, I
built all
of the external library dependencies myself and it is those that we
are
using. So there must be something a problem with the way MET is built
using the modules on WCOSS. This is something we need to get figured
out
before we release the official installation instructions, so I am
thankful
that you found this issue before we did that.
I'll continue to look into it and will let you know what I find out.
In
the meantime, please let me know if you hear about any other similar
problems on WCOSS. I find it very strange that this warning in the
output:
> libpng warning: Application built with libpng-1.2.59 but running
with
> 1.5.13
>
refers to a version of libpng that doesn't appear to be on WCOSS
anywhere.
Julie
On Thu, Jun 11, 2020 at 12:43 PM Logan Dawson - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
>
> Hi Julie,
>
> As I mentioned on Slack, I'm still getting the same libpng warning
with
> MET-9.0.2 on Venus when reading in MRMS GRIB2 data.
>
> I attached METplus log files with the regrid_data_plane output from
both
> versions run on the same data file. You'll see that the data_plane
function
> in met-9.0.2 reads in all of the data as -999 values.
>
> I thought it might be a useful exercise to see if regrid_data_plane
> produces the same behavior on a different machine, so I put the
sample file
> and the file I use to define the output grid on the RAL ftp server:
>
> /incoming/irap/met_help/dawson_data
>
> I thought trying it on a different machine might help us determine
if the
> problem is coming from the WCOSS installation or somewhere else.
>
> Thanks,
> Logan
>
> On Tue, May 26, 2020 at 5:28 PM Logan Dawson - NOAA Federal <
> logan.dawson at noaa.gov> wrote:
>
> > Hi Julie,
> >
> > Thanks for checking into this issue for me.
> >
> > Here's what I get when I ran 'module spider libpng':
> >
> > Versions:
> >
> > libpng/1.2.44
> >
> > libpng/1.2.59
> >
> > Other possible modules matches:
> >
> > compiler_third/ips/19.0.5/libpng
> >
> >
> > I did a little poking around in the
> > /usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and I only
saw
> > those same two versions mentioned above. I didn't see anything for
libpng
> > under the /usrx/local/prod/packages/ips/18.0.1/ directory either.
> >
> > Also, I sourced my METplus environment file
(/u/Logan.Dawson/.bashrc),
> > and the the correct libpng path
(/usrx/local/prod/packages/gnu/4.8.5/
> > libpng/1.2.59/bin) shows up there.
> >
> > So I'm not entirely sure where libpng/1.5.13 is coming from
either.
> > Hopefully the WCOSS helpdesk ticket you submitted will be useful
in
> sorting
> > it out.
> >
> > Thanks,
> > Logan
> >
> > On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT <
> met_help at ucar.edu>
> > wrote:
> >
> >> Hi Logan.
> >>
> >> As you know, "module spider" isn't working for me on mars right
now. I
> >> can't seem to find a version 1.5.13 of libpng. I try simply
loading it,
> >> but it doesn't work:
> >>
> >> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
> >> >
> >> > *Lmod has detected the following error: * These module(s) exist
but
> >> > cannot be loaded as requested: "libpng/1.5.13"
> >> >
> >> > Try: "module spider libpng/1.5.13" to see how to load the
> module(s).
> >> >
> >>
> >> I've tried loading:
> >>
> >> - libpng/1.5.13
> >> - loading ips first and then load libpng/1.5.13
> >> - loading gnu first and then load libpng/1.5.13
> >>
> >> None of those have worked or have found any libpng/1.5.13. Since
> "module
> >> spider" is working for you in your default environment, could you
please
> >> take a look and let me know if you can find anything?
> >>
> >> Thanks,
> >> Julie
> >>
> >> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik
<jpresto at ucar.edu>
> >> wrote:
> >>
> >> > Hi Logan.
> >> >
> >> > I just wanted to let you know I'm looking into what is going
on. I am
> >> > able to reproduce the problem you are experiencing with 9.0.1
vs. 8.1.
> >> >
> >> > I see the following warning in the output, but I'm not sure if
it's
> the
> >> >> culprit:
> >> >> "libpng warning: Application built with libpng-1.2.59 but
running
> with
> >> >> 1.5.13"
> >> >>
> >> > Thanks for pointing this out. That could be a problem. This is
our
> >> first
> >> > attempt at using the modules on WCOSS for MET's dependent
libraries
> >> instead
> >> > of building our own. I see that libpng/1.2.59 is loaded and
not
> >> > libpng/1.5.13, so I'm not sure why it is running with 1.5.13.
I'm not
> >> > entirely sure how all of these work together. When I built MET
> >> > using libpng/1.2.59, I did so because I was using g2c/1.5.0 and
I saw
> >> > in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-
ips.log that
> it
> >> > used libpng/1.2.59, so I did the same.
> >> >
> >> > I will follow up once I have a better idea of what is going on.
> >> >
> >> > Julie
> >> >
> >> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA Affiliate
via RT
> <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> >>
> >> >> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
> >> >> Transaction: Ticket created by logan.dawson at noaa.gov
> >> >> Queue: met_help
> >> >> Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
> >> >> Owner: Nobody
> >> >> Requestors: logan.dawson at noaa.gov
> >> >> Status: new
> >> >> Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
> >> >
> >> >>
> >> >>
> >> >> Hi,
> >> >>
> >> >> I'm running into an issue with MRMS data being read in MET-
9.0.1
> >> >> (specifically regrid_data_plane) on Mars since the WCOSS
production
> >> switch
> >> >> last week. MET runs successfully, but the output is all null
data.
> >> >>
> >> >> I attached a full example log file, which shows the input data
plane
> >> has
> >> >> min and max values of -999. That's the value I use to identify
> missing
> >> >> values with censor_thresh, so I understand why the output is
all null
> >> >> data.
> >> >>
> >> >> I checked the input data with wgrib2 and ncl_filedump, and the
data
> >> file
> >> >> has realistic values. MET-8.1 also reads the data correctly,
so it
> >> seems
> >> >> like something is incorrect or missing with the MET-9.0.1
build. I
> see
> >> the
> >> >> following warning in the output, but I'm not sure if it's the
> culprit:
> >> >> "libpng warning: Application built with libpng-1.2.59 but
running
> with
> >> >> 1.5.13"
> >> >>
> >> >> Any help on this would be greatly appreciated.
> >> >>
> >> >> Thanks,
> >> >> Logan
> >> >>
> >> >> --
> >> >> Logan C. Dawson, Ph.D.
> >> >> Physical Scientist, VPPPG/MEG
> >> >> NOAA/NWS/NCEP/EMC
> >> >> (301) 683-3944
> >> >>
> >> >>
> >> >
> >> > --
> >> > Julie Prestopnik
> >> > Software Engineer
> >> > National Center for Atmospheric Research
> >> > Research Applications Laboratory
> >> > Phone: 303.497.8399
> >> > Email: jpresto at ucar.edu
> >> >
> >> > My working day may not be your working day. Please do not feel
> obliged
> >> to
> >> > reply to this email outside of your normal working hours.
> >> >
> >>
> >>
> >> --
> >> Julie Prestopnik
> >> Software Engineer
> >> National Center for Atmospheric Research
> >> Research Applications Laboratory
> >> Phone: 303.497.8399
> >> Email: jpresto at ucar.edu
> >>
> >> My working day may not be your working day. Please do not feel
obliged
> to
> >> reply to this email outside of your normal working hours.
> >>
> >>
> >
> > --
> > Logan C. Dawson, Ph.D.
> > Physical Scientist, VPPPG/MEG
> > NOAA/NWS/NCEP/EMC
> > (301) 683-3944
> >
>
>
> --
> Logan C. Dawson, Ph.D.
> Physical Scientist, VPPPG/MEG
> NOAA/NWS/NCEP/EMC
> (301) 683-3944
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Logan Dawson - NOAA Affiliate
Time: Thu Jun 11 15:03:24 2020
Hi Julie,
It's good to have confirmation that the problem is isolated to WCOSS.
I
agree that the libpng warning is very strange.
Also just in case the extra data point is helpful, I attempted to run
'module spider libpng' after loading metplus/3.0.2, but the 'module
spider'
command still doesn't work for me after metplus is loaded.
Thanks,
Logan
On Thu, Jun 11, 2020 at 4:26 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Logan.
>
> Thank you so much for following up and for providing us with failure
and
> success files and also the data. I ran your regrid_data_plane case
> successfully using met-9.0 and met-9.0.2 on a local machine, so it
does
> appear to be a problem with the build of 9.0.2 on WCOSS. The
difference in
> the builds between 9.0 and 9.0.2 on WCOSS is that 9.0.2 uses any
available
> modules for the external library dependencies, whereas for 9.0, I
built all
> of the external library dependencies myself and it is those that we
are
> using. So there must be something a problem with the way MET is
built
> using the modules on WCOSS. This is something we need to get
figured out
> before we release the official installation instructions, so I am
thankful
> that you found this issue before we did that.
>
> I'll continue to look into it and will let you know what I find out.
In
> the meantime, please let me know if you hear about any other similar
> problems on WCOSS. I find it very strange that this warning in the
output:
>
> > libpng warning: Application built with libpng-1.2.59 but running
with
> > 1.5.13
> >
> refers to a version of libpng that doesn't appear to be on WCOSS
anywhere.
>
> Julie
>
>
>
> On Thu, Jun 11, 2020 at 12:43 PM Logan Dawson - NOAA Affiliate via
RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
> >
> > Hi Julie,
> >
> > As I mentioned on Slack, I'm still getting the same libpng warning
with
> > MET-9.0.2 on Venus when reading in MRMS GRIB2 data.
> >
> > I attached METplus log files with the regrid_data_plane output
from both
> > versions run on the same data file. You'll see that the data_plane
> function
> > in met-9.0.2 reads in all of the data as -999 values.
> >
> > I thought it might be a useful exercise to see if
regrid_data_plane
> > produces the same behavior on a different machine, so I put the
sample
> file
> > and the file I use to define the output grid on the RAL ftp
server:
> >
> > /incoming/irap/met_help/dawson_data
> >
> > I thought trying it on a different machine might help us determine
if the
> > problem is coming from the WCOSS installation or somewhere else.
> >
> > Thanks,
> > Logan
> >
> > On Tue, May 26, 2020 at 5:28 PM Logan Dawson - NOAA Federal <
> > logan.dawson at noaa.gov> wrote:
> >
> > > Hi Julie,
> > >
> > > Thanks for checking into this issue for me.
> > >
> > > Here's what I get when I ran 'module spider libpng':
> > >
> > > Versions:
> > >
> > > libpng/1.2.44
> > >
> > > libpng/1.2.59
> > >
> > > Other possible modules matches:
> > >
> > > compiler_third/ips/19.0.5/libpng
> > >
> > >
> > > I did a little poking around in the
> > > /usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and I
only saw
> > > those same two versions mentioned above. I didn't see anything
for
> libpng
> > > under the /usrx/local/prod/packages/ips/18.0.1/ directory
either.
> > >
> > > Also, I sourced my METplus environment file
(/u/Logan.Dawson/.bashrc),
> > > and the the correct libpng path
(/usrx/local/prod/packages/gnu/4.8.5/
> > > libpng/1.2.59/bin) shows up there.
> > >
> > > So I'm not entirely sure where libpng/1.5.13 is coming from
either.
> > > Hopefully the WCOSS helpdesk ticket you submitted will be useful
in
> > sorting
> > > it out.
> > >
> > > Thanks,
> > > Logan
> > >
> > > On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > >> Hi Logan.
> > >>
> > >> As you know, "module spider" isn't working for me on mars right
now.
> I
> > >> can't seem to find a version 1.5.13 of libpng. I try simply
loading
> it,
> > >> but it doesn't work:
> > >>
> > >> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
> > >> >
> > >> > *Lmod has detected the following error: * These module(s)
exist but
> > >> > cannot be loaded as requested: "libpng/1.5.13"
> > >> >
> > >> > Try: "module spider libpng/1.5.13" to see how to load the
> > module(s).
> > >> >
> > >>
> > >> I've tried loading:
> > >>
> > >> - libpng/1.5.13
> > >> - loading ips first and then load libpng/1.5.13
> > >> - loading gnu first and then load libpng/1.5.13
> > >>
> > >> None of those have worked or have found any libpng/1.5.13.
Since
> > "module
> > >> spider" is working for you in your default environment, could
you
> please
> > >> take a look and let me know if you can find anything?
> > >>
> > >> Thanks,
> > >> Julie
> > >>
> > >> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik
<jpresto at ucar.edu>
> > >> wrote:
> > >>
> > >> > Hi Logan.
> > >> >
> > >> > I just wanted to let you know I'm looking into what is going
on. I
> am
> > >> > able to reproduce the problem you are experiencing with 9.0.1
vs.
> 8.1.
> > >> >
> > >> > I see the following warning in the output, but I'm not sure
if it's
> > the
> > >> >> culprit:
> > >> >> "libpng warning: Application built with libpng-1.2.59 but
running
> > with
> > >> >> 1.5.13"
> > >> >>
> > >> > Thanks for pointing this out. That could be a problem. This
is our
> > >> first
> > >> > attempt at using the modules on WCOSS for MET's dependent
libraries
> > >> instead
> > >> > of building our own. I see that libpng/1.2.59 is loaded and
not
> > >> > libpng/1.5.13, so I'm not sure why it is running with 1.5.13.
I'm
> not
> > >> > entirely sure how all of these work together. When I built
MET
> > >> > using libpng/1.2.59, I did so because I was using g2c/1.5.0
and I
> saw
> > >> > in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-
ips.log
> that
> > it
> > >> > used libpng/1.2.59, so I did the same.
> > >> >
> > >> > I will follow up once I have a better idea of what is going
on.
> > >> >
> > >> > Julie
> > >> >
> > >> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA
Affiliate via
> RT
> > <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> >>
> > >> >> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
> > >> >> Transaction: Ticket created by logan.dawson at noaa.gov
> > >> >> Queue: met_help
> > >> >> Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
> > >> >> Owner: Nobody
> > >> >> Requestors: logan.dawson at noaa.gov
> > >> >> Status: new
> > >> >> Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
> > >> >
> > >> >>
> > >> >>
> > >> >> Hi,
> > >> >>
> > >> >> I'm running into an issue with MRMS data being read in MET-
9.0.1
> > >> >> (specifically regrid_data_plane) on Mars since the WCOSS
production
> > >> switch
> > >> >> last week. MET runs successfully, but the output is all null
data.
> > >> >>
> > >> >> I attached a full example log file, which shows the input
data
> plane
> > >> has
> > >> >> min and max values of -999. That's the value I use to
identify
> > missing
> > >> >> values with censor_thresh, so I understand why the output is
all
> null
> > >> >> data.
> > >> >>
> > >> >> I checked the input data with wgrib2 and ncl_filedump, and
the data
> > >> file
> > >> >> has realistic values. MET-8.1 also reads the data correctly,
so it
> > >> seems
> > >> >> like something is incorrect or missing with the MET-9.0.1
build. I
> > see
> > >> the
> > >> >> following warning in the output, but I'm not sure if it's
the
> > culprit:
> > >> >> "libpng warning: Application built with libpng-1.2.59 but
running
> > with
> > >> >> 1.5.13"
> > >> >>
> > >> >> Any help on this would be greatly appreciated.
> > >> >>
> > >> >> Thanks,
> > >> >> Logan
> > >> >>
> > >> >> --
> > >> >> Logan C. Dawson, Ph.D.
> > >> >> Physical Scientist, VPPPG/MEG
> > >> >> NOAA/NWS/NCEP/EMC
> > >> >> (301) 683-3944
> > >> >>
> > >> >>
> > >> >
> > >> > --
> > >> > Julie Prestopnik
> > >> > Software Engineer
> > >> > National Center for Atmospheric Research
> > >> > Research Applications Laboratory
> > >> > Phone: 303.497.8399
> > >> > Email: jpresto at ucar.edu
> > >> >
> > >> > My working day may not be your working day. Please do not
feel
> > obliged
> > >> to
> > >> > reply to this email outside of your normal working hours.
> > >> >
> > >>
> > >>
> > >> --
> > >> Julie Prestopnik
> > >> Software Engineer
> > >> National Center for Atmospheric Research
> > >> Research Applications Laboratory
> > >> Phone: 303.497.8399
> > >> Email: jpresto at ucar.edu
> > >>
> > >> My working day may not be your working day. Please do not feel
> obliged
> > to
> > >> reply to this email outside of your normal working hours.
> > >>
> > >>
> > >
> > > --
> > > Logan C. Dawson, Ph.D.
> > > Physical Scientist, VPPPG/MEG
> > > NOAA/NWS/NCEP/EMC
> > > (301) 683-3944
> > >
> >
> >
> > --
> > Logan C. Dawson, Ph.D.
> > Physical Scientist, VPPPG/MEG
> > NOAA/NWS/NCEP/EMC
> > (301) 683-3944
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Logan C. Dawson, Ph.D.
Physical Scientist, VPPPG/MEG
NOAA/NWS/NCEP/EMC
(301) 683-3944
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Julie Prestopnik
Time: Wed Jun 17 10:13:51 2020
Hi Logan.
I believe the problem with MET-9.0.2 on Venus when reading in MRMS
GRIB2
data is fixed. Could you please take a look and test when you get a
chance? I had your test files on Mars, but unfortunately did not copy
them
over to Venus before the switch...
Here is information on what I did in case you're interested. First, I
ran
ldd on regrid_data_plane, grepped for "png", and sure enough found
reference to an old libpng file:
> lib*png*15.so.15 => /lib64/lib*png*15.so.15 (0x00002b87eeb1f000)
>
So, I added the path to libpng-1.2.59 to LDFLAGS and recompiled MET.
Then, I ran ldd on regrid_data_plane, grepped for "png", and sure
enough
found reference to the libpng file we wanted MET to link with:
> [Julie.Prestopnik at v71a3 exec]$ ldd regrid_data_plane | grep png
>
> lib*png*12.so.0 => /usrx/local/prod/packages/gnu/4.8.5/lib*png*
> /1.2.59/lib/lib*png*12.so.0 (0x00002ad80e8ec000)
>
So, the issue should be resolved with 9.0.2. Please give it a try and
let
me know how it goes.
Regarding the modulefile problem, I forwarded an email to you that I
sent
to WCOSS helpdesk this morning asking for some assistance. It appears
the
problem occurs after running "module
use
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/modulefiles/",
and I don't understand why. Hopefully, they will be able to help with
that.
Julie
On Thu, Jun 11, 2020 at 3:03 PM Logan Dawson - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
>
> Hi Julie,
>
> It's good to have confirmation that the problem is isolated to
WCOSS. I
> agree that the libpng warning is very strange.
>
> Also just in case the extra data point is helpful, I attempted to
run
> 'module spider libpng' after loading metplus/3.0.2, but the 'module
spider'
> command still doesn't work for me after metplus is loaded.
>
> Thanks,
> Logan
>
> On Thu, Jun 11, 2020 at 4:26 PM Julie Prestopnik via RT
<met_help at ucar.edu
> >
> wrote:
>
> > Hi Logan.
> >
> > Thank you so much for following up and for providing us with
failure and
> > success files and also the data. I ran your regrid_data_plane
case
> > successfully using met-9.0 and met-9.0.2 on a local machine, so it
does
> > appear to be a problem with the build of 9.0.2 on WCOSS. The
difference
> in
> > the builds between 9.0 and 9.0.2 on WCOSS is that 9.0.2 uses any
> available
> > modules for the external library dependencies, whereas for 9.0, I
built
> all
> > of the external library dependencies myself and it is those that
we are
> > using. So there must be something a problem with the way MET is
built
> > using the modules on WCOSS. This is something we need to get
figured out
> > before we release the official installation instructions, so I am
> thankful
> > that you found this issue before we did that.
> >
> > I'll continue to look into it and will let you know what I find
out. In
> > the meantime, please let me know if you hear about any other
similar
> > problems on WCOSS. I find it very strange that this warning in
the
> output:
> >
> > > libpng warning: Application built with libpng-1.2.59 but running
with
> > > 1.5.13
> > >
> > refers to a version of libpng that doesn't appear to be on WCOSS
> anywhere.
> >
> > Julie
> >
> >
> >
> > On Thu, Jun 11, 2020 at 12:43 PM Logan Dawson - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
> > >
> > > Hi Julie,
> > >
> > > As I mentioned on Slack, I'm still getting the same libpng
warning with
> > > MET-9.0.2 on Venus when reading in MRMS GRIB2 data.
> > >
> > > I attached METplus log files with the regrid_data_plane output
from
> both
> > > versions run on the same data file. You'll see that the
data_plane
> > function
> > > in met-9.0.2 reads in all of the data as -999 values.
> > >
> > > I thought it might be a useful exercise to see if
regrid_data_plane
> > > produces the same behavior on a different machine, so I put the
sample
> > file
> > > and the file I use to define the output grid on the RAL ftp
server:
> > >
> > > /incoming/irap/met_help/dawson_data
> > >
> > > I thought trying it on a different machine might help us
determine if
> the
> > > problem is coming from the WCOSS installation or somewhere else.
> > >
> > > Thanks,
> > > Logan
> > >
> > > On Tue, May 26, 2020 at 5:28 PM Logan Dawson - NOAA Federal <
> > > logan.dawson at noaa.gov> wrote:
> > >
> > > > Hi Julie,
> > > >
> > > > Thanks for checking into this issue for me.
> > > >
> > > > Here's what I get when I ran 'module spider libpng':
> > > >
> > > > Versions:
> > > >
> > > > libpng/1.2.44
> > > >
> > > > libpng/1.2.59
> > > >
> > > > Other possible modules matches:
> > > >
> > > > compiler_third/ips/19.0.5/libpng
> > > >
> > > >
> > > > I did a little poking around in the
> > > > /usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and I
only saw
> > > > those same two versions mentioned above. I didn't see anything
for
> > libpng
> > > > under the /usrx/local/prod/packages/ips/18.0.1/ directory
either.
> > > >
> > > > Also, I sourced my METplus environment file
> (/u/Logan.Dawson/.bashrc),
> > > > and the the correct libpng path
(/usrx/local/prod/packages/gnu/4.8.5/
> > > > libpng/1.2.59/bin) shows up there.
> > > >
> > > > So I'm not entirely sure where libpng/1.5.13 is coming from
either.
> > > > Hopefully the WCOSS helpdesk ticket you submitted will be
useful in
> > > sorting
> > > > it out.
> > > >
> > > > Thanks,
> > > > Logan
> > > >
> > > > On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT <
> > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > >> Hi Logan.
> > > >>
> > > >> As you know, "module spider" isn't working for me on mars
right now.
> > I
> > > >> can't seem to find a version 1.5.13 of libpng. I try simply
loading
> > it,
> > > >> but it doesn't work:
> > > >>
> > > >> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
> > > >> >
> > > >> > *Lmod has detected the following error: * These module(s)
exist
> but
> > > >> > cannot be loaded as requested: "libpng/1.5.13"
> > > >> >
> > > >> > Try: "module spider libpng/1.5.13" to see how to load
the
> > > module(s).
> > > >> >
> > > >>
> > > >> I've tried loading:
> > > >>
> > > >> - libpng/1.5.13
> > > >> - loading ips first and then load libpng/1.5.13
> > > >> - loading gnu first and then load libpng/1.5.13
> > > >>
> > > >> None of those have worked or have found any libpng/1.5.13.
Since
> > > "module
> > > >> spider" is working for you in your default environment, could
you
> > please
> > > >> take a look and let me know if you can find anything?
> > > >>
> > > >> Thanks,
> > > >> Julie
> > > >>
> > > >> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik
<jpresto at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> > Hi Logan.
> > > >> >
> > > >> > I just wanted to let you know I'm looking into what is
going on.
> I
> > am
> > > >> > able to reproduce the problem you are experiencing with
9.0.1 vs.
> > 8.1.
> > > >> >
> > > >> > I see the following warning in the output, but I'm not sure
if
> it's
> > > the
> > > >> >> culprit:
> > > >> >> "libpng warning: Application built with libpng-1.2.59 but
running
> > > with
> > > >> >> 1.5.13"
> > > >> >>
> > > >> > Thanks for pointing this out. That could be a problem.
This is
> our
> > > >> first
> > > >> > attempt at using the modules on WCOSS for MET's dependent
> libraries
> > > >> instead
> > > >> > of building our own. I see that libpng/1.2.59 is loaded
and not
> > > >> > libpng/1.5.13, so I'm not sure why it is running with
1.5.13. I'm
> > not
> > > >> > entirely sure how all of these work together. When I built
MET
> > > >> > using libpng/1.2.59, I did so because I was using g2c/1.5.0
and I
> > saw
> > > >> > in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-
ips.log
> > that
> > > it
> > > >> > used libpng/1.2.59, so I did the same.
> > > >> >
> > > >> > I will follow up once I have a better idea of what is going
on.
> > > >> >
> > > >> > Julie
> > > >> >
> > > >> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA
Affiliate via
> > RT
> > > <
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> >>
> > > >> >> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
> > > >> >> Transaction: Ticket created by logan.dawson at noaa.gov
> > > >> >> Queue: met_help
> > > >> >> Subject: MRMS data reading with MET-9.0.1 on WCOSS
Mars
> > > >> >> Owner: Nobody
> > > >> >> Requestors: logan.dawson at noaa.gov
> > > >> >> Status: new
> > > >> >> Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
> > > >> >
> > > >> >>
> > > >> >>
> > > >> >> Hi,
> > > >> >>
> > > >> >> I'm running into an issue with MRMS data being read in
MET-9.0.1
> > > >> >> (specifically regrid_data_plane) on Mars since the WCOSS
> production
> > > >> switch
> > > >> >> last week. MET runs successfully, but the output is all
null
> data.
> > > >> >>
> > > >> >> I attached a full example log file, which shows the input
data
> > plane
> > > >> has
> > > >> >> min and max values of -999. That's the value I use to
identify
> > > missing
> > > >> >> values with censor_thresh, so I understand why the output
is all
> > null
> > > >> >> data.
> > > >> >>
> > > >> >> I checked the input data with wgrib2 and ncl_filedump, and
the
> data
> > > >> file
> > > >> >> has realistic values. MET-8.1 also reads the data
correctly, so
> it
> > > >> seems
> > > >> >> like something is incorrect or missing with the MET-9.0.1
build.
> I
> > > see
> > > >> the
> > > >> >> following warning in the output, but I'm not sure if it's
the
> > > culprit:
> > > >> >> "libpng warning: Application built with libpng-1.2.59 but
running
> > > with
> > > >> >> 1.5.13"
> > > >> >>
> > > >> >> Any help on this would be greatly appreciated.
> > > >> >>
> > > >> >> Thanks,
> > > >> >> Logan
> > > >> >>
> > > >> >> --
> > > >> >> Logan C. Dawson, Ph.D.
> > > >> >> Physical Scientist, VPPPG/MEG
> > > >> >> NOAA/NWS/NCEP/EMC
> > > >> >> (301) 683-3944
> > > >> >>
> > > >> >>
> > > >> >
> > > >> > --
> > > >> > Julie Prestopnik
> > > >> > Software Engineer
> > > >> > National Center for Atmospheric Research
> > > >> > Research Applications Laboratory
> > > >> > Phone: 303.497.8399
> > > >> > Email: jpresto at ucar.edu
> > > >> >
> > > >> > My working day may not be your working day. Please do not
feel
> > > obliged
> > > >> to
> > > >> > reply to this email outside of your normal working hours.
> > > >> >
> > > >>
> > > >>
> > > >> --
> > > >> Julie Prestopnik
> > > >> Software Engineer
> > > >> National Center for Atmospheric Research
> > > >> Research Applications Laboratory
> > > >> Phone: 303.497.8399
> > > >> Email: jpresto at ucar.edu
> > > >>
> > > >> My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > >> reply to this email outside of your normal working hours.
> > > >>
> > > >>
> > > >
> > > > --
> > > > Logan C. Dawson, Ph.D.
> > > > Physical Scientist, VPPPG/MEG
> > > > NOAA/NWS/NCEP/EMC
> > > > (301) 683-3944
> > > >
> > >
> > >
> > > --
> > > Logan C. Dawson, Ph.D.
> > > Physical Scientist, VPPPG/MEG
> > > NOAA/NWS/NCEP/EMC
> > > (301) 683-3944
> > >
> > >
> >
> > --
> > Julie Prestopnik
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Logan C. Dawson, Ph.D.
> Physical Scientist, VPPPG/MEG
> NOAA/NWS/NCEP/EMC
> (301) 683-3944
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Logan Dawson - NOAA Affiliate
Time: Wed Jun 17 10:39:43 2020
Hi Julie,
I just ran a MRMS through the 9.0.2 version of regrid_data_plane, and
it
was read correctly! No libpng warning, and the data plane range has
reasonable values. Thanks very much for tracking this down!
Thanks for keeping me in the loop on getting the 'module use' issue
addressed. Fortunately I don't load METplus in my default environment,
so I
don't really see the broken Lmod commands after pointing to your
module
files. I'm happy to test it out on the command line once the Helpdesk
gives
you a fix.
Thanks,
Logan
On Wed, Jun 17, 2020 at 12:14 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Logan.
>
> I believe the problem with MET-9.0.2 on Venus when reading in MRMS
GRIB2
> data is fixed. Could you please take a look and test when you get a
> chance? I had your test files on Mars, but unfortunately did not
copy them
> over to Venus before the switch...
>
> Here is information on what I did in case you're interested. First,
I ran
> ldd on regrid_data_plane, grepped for "png", and sure enough found
> reference to an old libpng file:
>
> > lib*png*15.so.15 => /lib64/lib*png*15.so.15 (0x00002b87eeb1f000)
> >
> So, I added the path to libpng-1.2.59 to LDFLAGS and recompiled
MET.
> Then, I ran ldd on regrid_data_plane, grepped for "png", and sure
enough
> found reference to the libpng file we wanted MET to link with:
>
> > [Julie.Prestopnik at v71a3 exec]$ ldd regrid_data_plane | grep png
> >
> > lib*png*12.so.0 => /usrx/local/prod/packages/gnu/4.8.5/lib*png*
> > /1.2.59/lib/lib*png*12.so.0 (0x00002ad80e8ec000)
> >
>
> So, the issue should be resolved with 9.0.2. Please give it a try
and let
> me know how it goes.
>
> Regarding the modulefile problem, I forwarded an email to you that I
sent
> to WCOSS helpdesk this morning asking for some assistance. It
appears the
> problem occurs after running "module
> use
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/modulefiles/",
> and I don't understand why. Hopefully, they will be able to help
with
> that.
>
> Julie
>
>
> On Thu, Jun 11, 2020 at 3:03 PM Logan Dawson - NOAA Affiliate via RT
<
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
> >
> > Hi Julie,
> >
> > It's good to have confirmation that the problem is isolated to
WCOSS. I
> > agree that the libpng warning is very strange.
> >
> > Also just in case the extra data point is helpful, I attempted to
run
> > 'module spider libpng' after loading metplus/3.0.2, but the
'module
> spider'
> > command still doesn't work for me after metplus is loaded.
> >
> > Thanks,
> > Logan
> >
> > On Thu, Jun 11, 2020 at 4:26 PM Julie Prestopnik via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > > Hi Logan.
> > >
> > > Thank you so much for following up and for providing us with
failure
> and
> > > success files and also the data. I ran your regrid_data_plane
case
> > > successfully using met-9.0 and met-9.0.2 on a local machine, so
it does
> > > appear to be a problem with the build of 9.0.2 on WCOSS. The
> difference
> > in
> > > the builds between 9.0 and 9.0.2 on WCOSS is that 9.0.2 uses any
> > available
> > > modules for the external library dependencies, whereas for 9.0,
I built
> > all
> > > of the external library dependencies myself and it is those that
we are
> > > using. So there must be something a problem with the way MET is
built
> > > using the modules on WCOSS. This is something we need to get
figured
> out
> > > before we release the official installation instructions, so I
am
> > thankful
> > > that you found this issue before we did that.
> > >
> > > I'll continue to look into it and will let you know what I find
out.
> In
> > > the meantime, please let me know if you hear about any other
similar
> > > problems on WCOSS. I find it very strange that this warning in
the
> > output:
> > >
> > > > libpng warning: Application built with libpng-1.2.59 but
running with
> > > > 1.5.13
> > > >
> > > refers to a version of libpng that doesn't appear to be on WCOSS
> > anywhere.
> > >
> > > Julie
> > >
> > >
> > >
> > > On Thu, Jun 11, 2020 at 12:43 PM Logan Dawson - NOAA Affiliate
via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
>
> > > >
> > > > Hi Julie,
> > > >
> > > > As I mentioned on Slack, I'm still getting the same libpng
warning
> with
> > > > MET-9.0.2 on Venus when reading in MRMS GRIB2 data.
> > > >
> > > > I attached METplus log files with the regrid_data_plane output
from
> > both
> > > > versions run on the same data file. You'll see that the
data_plane
> > > function
> > > > in met-9.0.2 reads in all of the data as -999 values.
> > > >
> > > > I thought it might be a useful exercise to see if
regrid_data_plane
> > > > produces the same behavior on a different machine, so I put
the
> sample
> > > file
> > > > and the file I use to define the output grid on the RAL ftp
server:
> > > >
> > > > /incoming/irap/met_help/dawson_data
> > > >
> > > > I thought trying it on a different machine might help us
determine if
> > the
> > > > problem is coming from the WCOSS installation or somewhere
else.
> > > >
> > > > Thanks,
> > > > Logan
> > > >
> > > > On Tue, May 26, 2020 at 5:28 PM Logan Dawson - NOAA Federal <
> > > > logan.dawson at noaa.gov> wrote:
> > > >
> > > > > Hi Julie,
> > > > >
> > > > > Thanks for checking into this issue for me.
> > > > >
> > > > > Here's what I get when I ran 'module spider libpng':
> > > > >
> > > > > Versions:
> > > > >
> > > > > libpng/1.2.44
> > > > >
> > > > > libpng/1.2.59
> > > > >
> > > > > Other possible modules matches:
> > > > >
> > > > > compiler_third/ips/19.0.5/libpng
> > > > >
> > > > >
> > > > > I did a little poking around in the
> > > > > /usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and I
only
> saw
> > > > > those same two versions mentioned above. I didn't see
anything for
> > > libpng
> > > > > under the /usrx/local/prod/packages/ips/18.0.1/ directory
either.
> > > > >
> > > > > Also, I sourced my METplus environment file
> > (/u/Logan.Dawson/.bashrc),
> > > > > and the the correct libpng path
> (/usrx/local/prod/packages/gnu/4.8.5/
> > > > > libpng/1.2.59/bin) shows up there.
> > > > >
> > > > > So I'm not entirely sure where libpng/1.5.13 is coming from
either.
> > > > > Hopefully the WCOSS helpdesk ticket you submitted will be
useful in
> > > > sorting
> > > > > it out.
> > > > >
> > > > > Thanks,
> > > > > Logan
> > > > >
> > > > > On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT <
> > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > >> Hi Logan.
> > > > >>
> > > > >> As you know, "module spider" isn't working for me on mars
right
> now.
> > > I
> > > > >> can't seem to find a version 1.5.13 of libpng. I try
simply
> loading
> > > it,
> > > > >> but it doesn't work:
> > > > >>
> > > > >> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
> > > > >> >
> > > > >> > *Lmod has detected the following error: * These module(s)
exist
> > but
> > > > >> > cannot be loaded as requested: "libpng/1.5.13"
> > > > >> >
> > > > >> > Try: "module spider libpng/1.5.13" to see how to load
the
> > > > module(s).
> > > > >> >
> > > > >>
> > > > >> I've tried loading:
> > > > >>
> > > > >> - libpng/1.5.13
> > > > >> - loading ips first and then load libpng/1.5.13
> > > > >> - loading gnu first and then load libpng/1.5.13
> > > > >>
> > > > >> None of those have worked or have found any libpng/1.5.13.
Since
> > > > "module
> > > > >> spider" is working for you in your default environment,
could you
> > > please
> > > > >> take a look and let me know if you can find anything?
> > > > >>
> > > > >> Thanks,
> > > > >> Julie
> > > > >>
> > > > >> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik <
> jpresto at ucar.edu>
> > > > >> wrote:
> > > > >>
> > > > >> > Hi Logan.
> > > > >> >
> > > > >> > I just wanted to let you know I'm looking into what is
going on.
> > I
> > > am
> > > > >> > able to reproduce the problem you are experiencing with
9.0.1
> vs.
> > > 8.1.
> > > > >> >
> > > > >> > I see the following warning in the output, but I'm not
sure if
> > it's
> > > > the
> > > > >> >> culprit:
> > > > >> >> "libpng warning: Application built with libpng-1.2.59
but
> running
> > > > with
> > > > >> >> 1.5.13"
> > > > >> >>
> > > > >> > Thanks for pointing this out. That could be a problem.
This is
> > our
> > > > >> first
> > > > >> > attempt at using the modules on WCOSS for MET's dependent
> > libraries
> > > > >> instead
> > > > >> > of building our own. I see that libpng/1.2.59 is loaded
and not
> > > > >> > libpng/1.5.13, so I'm not sure why it is running with
1.5.13.
> I'm
> > > not
> > > > >> > entirely sure how all of these work together. When I
built MET
> > > > >> > using libpng/1.2.59, I did so because I was using
g2c/1.5.0 and
> I
> > > saw
> > > > >> > in /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-
ips.log
> > > that
> > > > it
> > > > >> > used libpng/1.2.59, so I did the same.
> > > > >> >
> > > > >> > I will follow up once I have a better idea of what is
going on.
> > > > >> >
> > > > >> > Julie
> > > > >> >
> > > > >> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA
Affiliate
> via
> > > RT
> > > > <
> > > > >> > met_help at ucar.edu> wrote:
> > > > >> >
> > > > >> >>
> > > > >> >> Tue May 26 11:35:49 2020: Request 95364 was acted upon.
> > > > >> >> Transaction: Ticket created by logan.dawson at noaa.gov
> > > > >> >> Queue: met_help
> > > > >> >> Subject: MRMS data reading with MET-9.0.1 on WCOSS
Mars
> > > > >> >> Owner: Nobody
> > > > >> >> Requestors: logan.dawson at noaa.gov
> > > > >> >> Status: new
> > > > >> >> Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
> > > > >> >
> > > > >> >>
> > > > >> >>
> > > > >> >> Hi,
> > > > >> >>
> > > > >> >> I'm running into an issue with MRMS data being read in
> MET-9.0.1
> > > > >> >> (specifically regrid_data_plane) on Mars since the WCOSS
> > production
> > > > >> switch
> > > > >> >> last week. MET runs successfully, but the output is all
null
> > data.
> > > > >> >>
> > > > >> >> I attached a full example log file, which shows the
input data
> > > plane
> > > > >> has
> > > > >> >> min and max values of -999. That's the value I use to
identify
> > > > missing
> > > > >> >> values with censor_thresh, so I understand why the
output is
> all
> > > null
> > > > >> >> data.
> > > > >> >>
> > > > >> >> I checked the input data with wgrib2 and ncl_filedump,
and the
> > data
> > > > >> file
> > > > >> >> has realistic values. MET-8.1 also reads the data
correctly, so
> > it
> > > > >> seems
> > > > >> >> like something is incorrect or missing with the MET-
9.0.1
> build.
> > I
> > > > see
> > > > >> the
> > > > >> >> following warning in the output, but I'm not sure if
it's the
> > > > culprit:
> > > > >> >> "libpng warning: Application built with libpng-1.2.59
but
> running
> > > > with
> > > > >> >> 1.5.13"
> > > > >> >>
> > > > >> >> Any help on this would be greatly appreciated.
> > > > >> >>
> > > > >> >> Thanks,
> > > > >> >> Logan
> > > > >> >>
> > > > >> >> --
> > > > >> >> Logan C. Dawson, Ph.D.
> > > > >> >> Physical Scientist, VPPPG/MEG
> > > > >> >> NOAA/NWS/NCEP/EMC
> > > > >> >> (301) 683-3944
> > > > >> >>
> > > > >> >>
> > > > >> >
> > > > >> > --
> > > > >> > Julie Prestopnik
> > > > >> > Software Engineer
> > > > >> > National Center for Atmospheric Research
> > > > >> > Research Applications Laboratory
> > > > >> > Phone: 303.497.8399
> > > > >> > Email: jpresto at ucar.edu
> > > > >> >
> > > > >> > My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > >> to
> > > > >> > reply to this email outside of your normal working hours.
> > > > >> >
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Julie Prestopnik
> > > > >> Software Engineer
> > > > >> National Center for Atmospheric Research
> > > > >> Research Applications Laboratory
> > > > >> Phone: 303.497.8399
> > > > >> Email: jpresto at ucar.edu
> > > > >>
> > > > >> My working day may not be your working day. Please do not
feel
> > > obliged
> > > > to
> > > > >> reply to this email outside of your normal working hours.
> > > > >>
> > > > >>
> > > > >
> > > > > --
> > > > > Logan C. Dawson, Ph.D.
> > > > > Physical Scientist, VPPPG/MEG
> > > > > NOAA/NWS/NCEP/EMC
> > > > > (301) 683-3944
> > > > >
> > > >
> > > >
> > > > --
> > > > Logan C. Dawson, Ph.D.
> > > > Physical Scientist, VPPPG/MEG
> > > > NOAA/NWS/NCEP/EMC
> > > > (301) 683-3944
> > > >
> > > >
> > >
> > > --
> > > Julie Prestopnik
> > > Software Engineer
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Phone: 303.497.8399
> > > Email: jpresto at ucar.edu
> > >
> > > My working day may not be your working day. Please do not feel
obliged
> > to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Logan C. Dawson, Ph.D.
> > Physical Scientist, VPPPG/MEG
> > NOAA/NWS/NCEP/EMC
> > (301) 683-3944
> >
> >
>
> --
> Julie Prestopnik
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Phone: 303.497.8399
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Logan C. Dawson, Ph.D.
Physical Scientist, VPPPG/MEG
NOAA/NWS/NCEP/EMC
(301) 683-3944
------------------------------------------------
Subject: MRMS data reading with MET-9.0.1 on WCOSS Mars
From: Julie Prestopnik
Time: Wed Jun 17 10:50:43 2020
Hi Logan.
That's great news! Thank you so much for testing. After the
production switch, I'll reinstall on Mars as well. I'll go ahead and
close
this ticket and will keep you posted on the modulefile through other
means,
either slack, email, or our bi-weekly METplus users meetings.
Julie
On Wed, Jun 17, 2020 at 10:39 AM Logan Dawson - NOAA Affiliate via RT
<
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
>
> Hi Julie,
>
> I just ran a MRMS through the 9.0.2 version of regrid_data_plane,
and it
> was read correctly! No libpng warning, and the data plane range has
> reasonable values. Thanks very much for tracking this down!
>
> Thanks for keeping me in the loop on getting the 'module use' issue
> addressed. Fortunately I don't load METplus in my default
environment, so I
> don't really see the broken Lmod commands after pointing to your
module
> files. I'm happy to test it out on the command line once the
Helpdesk gives
> you a fix.
>
> Thanks,
> Logan
>
> On Wed, Jun 17, 2020 at 12:14 PM Julie Prestopnik via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Logan.
> >
> > I believe the problem with MET-9.0.2 on Venus when reading in MRMS
GRIB2
> > data is fixed. Could you please take a look and test when you get
a
> > chance? I had your test files on Mars, but unfortunately did not
copy
> them
> > over to Venus before the switch...
> >
> > Here is information on what I did in case you're interested.
First, I
> ran
> > ldd on regrid_data_plane, grepped for "png", and sure enough found
> > reference to an old libpng file:
> >
> > > lib*png*15.so.15 => /lib64/lib*png*15.so.15 (0x00002b87eeb1f000)
> > >
> > So, I added the path to libpng-1.2.59 to LDFLAGS and recompiled
MET.
> > Then, I ran ldd on regrid_data_plane, grepped for "png", and sure
enough
> > found reference to the libpng file we wanted MET to link with:
> >
> > > [Julie.Prestopnik at v71a3 exec]$ ldd regrid_data_plane | grep png
> > >
> > > lib*png*12.so.0 => /usrx/local/prod/packages/gnu/4.8.5/lib*png*
> > > /1.2.59/lib/lib*png*12.so.0 (0x00002ad80e8ec000)
> > >
> >
> > So, the issue should be resolved with 9.0.2. Please give it a try
and
> let
> > me know how it goes.
> >
> > Regarding the modulefile problem, I forwarded an email to you that
I sent
> > to WCOSS helpdesk this morning asking for some assistance. It
appears
> the
> > problem occurs after running "module
> > use
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/modulefiles/",
> > and I don't understand why. Hopefully, they will be able to help
with
> > that.
> >
> > Julie
> >
> >
> > On Thu, Jun 11, 2020 at 3:03 PM Logan Dawson - NOAA Affiliate via
RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
> > >
> > > Hi Julie,
> > >
> > > It's good to have confirmation that the problem is isolated to
WCOSS. I
> > > agree that the libpng warning is very strange.
> > >
> > > Also just in case the extra data point is helpful, I attempted
to run
> > > 'module spider libpng' after loading metplus/3.0.2, but the
'module
> > spider'
> > > command still doesn't work for me after metplus is loaded.
> > >
> > > Thanks,
> > > Logan
> > >
> > > On Thu, Jun 11, 2020 at 4:26 PM Julie Prestopnik via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > > Hi Logan.
> > > >
> > > > Thank you so much for following up and for providing us with
failure
> > and
> > > > success files and also the data. I ran your regrid_data_plane
case
> > > > successfully using met-9.0 and met-9.0.2 on a local machine,
so it
> does
> > > > appear to be a problem with the build of 9.0.2 on WCOSS. The
> > difference
> > > in
> > > > the builds between 9.0 and 9.0.2 on WCOSS is that 9.0.2 uses
any
> > > available
> > > > modules for the external library dependencies, whereas for
9.0, I
> built
> > > all
> > > > of the external library dependencies myself and it is those
that we
> are
> > > > using. So there must be something a problem with the way MET
is
> built
> > > > using the modules on WCOSS. This is something we need to get
figured
> > out
> > > > before we release the official installation instructions, so I
am
> > > thankful
> > > > that you found this issue before we did that.
> > > >
> > > > I'll continue to look into it and will let you know what I
find out.
> > In
> > > > the meantime, please let me know if you hear about any other
similar
> > > > problems on WCOSS. I find it very strange that this warning
in the
> > > output:
> > > >
> > > > > libpng warning: Application built with libpng-1.2.59 but
running
> with
> > > > > 1.5.13
> > > > >
> > > > refers to a version of libpng that doesn't appear to be on
WCOSS
> > > anywhere.
> > > >
> > > > Julie
> > > >
> > > >
> > > >
> > > > On Thu, Jun 11, 2020 at 12:43 PM Logan Dawson - NOAA Affiliate
via
> RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364 >
> > > > >
> > > > > Hi Julie,
> > > > >
> > > > > As I mentioned on Slack, I'm still getting the same libpng
warning
> > with
> > > > > MET-9.0.2 on Venus when reading in MRMS GRIB2 data.
> > > > >
> > > > > I attached METplus log files with the regrid_data_plane
output from
> > > both
> > > > > versions run on the same data file. You'll see that the
data_plane
> > > > function
> > > > > in met-9.0.2 reads in all of the data as -999 values.
> > > > >
> > > > > I thought it might be a useful exercise to see if
regrid_data_plane
> > > > > produces the same behavior on a different machine, so I put
the
> > sample
> > > > file
> > > > > and the file I use to define the output grid on the RAL ftp
server:
> > > > >
> > > > > /incoming/irap/met_help/dawson_data
> > > > >
> > > > > I thought trying it on a different machine might help us
determine
> if
> > > the
> > > > > problem is coming from the WCOSS installation or somewhere
else.
> > > > >
> > > > > Thanks,
> > > > > Logan
> > > > >
> > > > > On Tue, May 26, 2020 at 5:28 PM Logan Dawson - NOAA Federal
<
> > > > > logan.dawson at noaa.gov> wrote:
> > > > >
> > > > > > Hi Julie,
> > > > > >
> > > > > > Thanks for checking into this issue for me.
> > > > > >
> > > > > > Here's what I get when I ran 'module spider libpng':
> > > > > >
> > > > > > Versions:
> > > > > >
> > > > > > libpng/1.2.44
> > > > > >
> > > > > > libpng/1.2.59
> > > > > >
> > > > > > Other possible modules matches:
> > > > > >
> > > > > > compiler_third/ips/19.0.5/libpng
> > > > > >
> > > > > >
> > > > > > I did a little poking around in the
> > > > > > /usrx/local/prod/packages/gnu/4.8.5/libpng/ directory, and
I only
> > saw
> > > > > > those same two versions mentioned above. I didn't see
anything
> for
> > > > libpng
> > > > > > under the /usrx/local/prod/packages/ips/18.0.1/ directory
either.
> > > > > >
> > > > > > Also, I sourced my METplus environment file
> > > (/u/Logan.Dawson/.bashrc),
> > > > > > and the the correct libpng path
> > (/usrx/local/prod/packages/gnu/4.8.5/
> > > > > > libpng/1.2.59/bin) shows up there.
> > > > > >
> > > > > > So I'm not entirely sure where libpng/1.5.13 is coming
from
> either.
> > > > > > Hopefully the WCOSS helpdesk ticket you submitted will be
useful
> in
> > > > > sorting
> > > > > > it out.
> > > > > >
> > > > > > Thanks,
> > > > > > Logan
> > > > > >
> > > > > > On Tue, May 26, 2020 at 5:04 PM Julie Prestopnik via RT <
> > > > > met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > >> Hi Logan.
> > > > > >>
> > > > > >> As you know, "module spider" isn't working for me on mars
right
> > now.
> > > > I
> > > > > >> can't seem to find a version 1.5.13 of libpng. I try
simply
> > loading
> > > > it,
> > > > > >> but it doesn't work:
> > > > > >>
> > > > > >> > [Julie.Prestopnik at m71a1 ~]$ module load libpng/1.5.13
> > > > > >> >
> > > > > >> > *Lmod has detected the following error: * These
module(s)
> exist
> > > but
> > > > > >> > cannot be loaded as requested: "libpng/1.5.13"
> > > > > >> >
> > > > > >> > Try: "module spider libpng/1.5.13" to see how to
load the
> > > > > module(s).
> > > > > >> >
> > > > > >>
> > > > > >> I've tried loading:
> > > > > >>
> > > > > >> - libpng/1.5.13
> > > > > >> - loading ips first and then load libpng/1.5.13
> > > > > >> - loading gnu first and then load libpng/1.5.13
> > > > > >>
> > > > > >> None of those have worked or have found any
libpng/1.5.13.
> Since
> > > > > "module
> > > > > >> spider" is working for you in your default environment,
could
> you
> > > > please
> > > > > >> take a look and let me know if you can find anything?
> > > > > >>
> > > > > >> Thanks,
> > > > > >> Julie
> > > > > >>
> > > > > >> On Tue, May 26, 2020 at 2:27 PM Julie Prestopnik <
> > jpresto at ucar.edu>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Hi Logan.
> > > > > >> >
> > > > > >> > I just wanted to let you know I'm looking into what is
going
> on.
> > > I
> > > > am
> > > > > >> > able to reproduce the problem you are experiencing with
9.0.1
> > vs.
> > > > 8.1.
> > > > > >> >
> > > > > >> > I see the following warning in the output, but I'm not
sure if
> > > it's
> > > > > the
> > > > > >> >> culprit:
> > > > > >> >> "libpng warning: Application built with libpng-1.2.59
but
> > running
> > > > > with
> > > > > >> >> 1.5.13"
> > > > > >> >>
> > > > > >> > Thanks for pointing this out. That could be a problem.
This
> is
> > > our
> > > > > >> first
> > > > > >> > attempt at using the modules on WCOSS for MET's
dependent
> > > libraries
> > > > > >> instead
> > > > > >> > of building our own. I see that libpng/1.2.59 is
loaded and
> not
> > > > > >> > libpng/1.5.13, so I'm not sure why it is running with
1.5.13.
> > I'm
> > > > not
> > > > > >> > entirely sure how all of these work together. When I
built
> MET
> > > > > >> > using libpng/1.2.59, I did so because I was using
g2c/1.5.0
> and
> > I
> > > > saw
> > > > > >> > in
> /gpfs/dell1/nco/ops/nwprod/lib/g2c/v1.5.0/src/compile-ips.log
> > > > that
> > > > > it
> > > > > >> > used libpng/1.2.59, so I did the same.
> > > > > >> >
> > > > > >> > I will follow up once I have a better idea of what is
going
> on.
> > > > > >> >
> > > > > >> > Julie
> > > > > >> >
> > > > > >> > On Tue, May 26, 2020 at 11:35 AM Logan Dawson - NOAA
Affiliate
> > via
> > > > RT
> > > > > <
> > > > > >> > met_help at ucar.edu> wrote:
> > > > > >> >
> > > > > >> >>
> > > > > >> >> Tue May 26 11:35:49 2020: Request 95364 was acted
upon.
> > > > > >> >> Transaction: Ticket created by logan.dawson at noaa.gov
> > > > > >> >> Queue: met_help
> > > > > >> >> Subject: MRMS data reading with MET-9.0.1 on
WCOSS Mars
> > > > > >> >> Owner: Nobody
> > > > > >> >> Requestors: logan.dawson at noaa.gov
> > > > > >> >> Status: new
> > > > > >> >> Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=95364
> > > > > >> >
> > > > > >> >>
> > > > > >> >>
> > > > > >> >> Hi,
> > > > > >> >>
> > > > > >> >> I'm running into an issue with MRMS data being read in
> > MET-9.0.1
> > > > > >> >> (specifically regrid_data_plane) on Mars since the
WCOSS
> > > production
> > > > > >> switch
> > > > > >> >> last week. MET runs successfully, but the output is
all null
> > > data.
> > > > > >> >>
> > > > > >> >> I attached a full example log file, which shows the
input
> data
> > > > plane
> > > > > >> has
> > > > > >> >> min and max values of -999. That's the value I use to
> identify
> > > > > missing
> > > > > >> >> values with censor_thresh, so I understand why the
output is
> > all
> > > > null
> > > > > >> >> data.
> > > > > >> >>
> > > > > >> >> I checked the input data with wgrib2 and ncl_filedump,
and
> the
> > > data
> > > > > >> file
> > > > > >> >> has realistic values. MET-8.1 also reads the data
correctly,
> so
> > > it
> > > > > >> seems
> > > > > >> >> like something is incorrect or missing with the MET-
9.0.1
> > build.
> > > I
> > > > > see
> > > > > >> the
> > > > > >> >> following warning in the output, but I'm not sure if
it's the
> > > > > culprit:
> > > > > >> >> "libpng warning: Application built with libpng-1.2.59
but
> > running
> > > > > with
> > > > > >> >> 1.5.13"
> > > > > >> >>
> > > > > >> >> Any help on this would be greatly appreciated.
> > > > > >> >>
> > > > > >> >> Thanks,
> > > > > >> >> Logan
> > > > > >> >>
> > > > > >> >> --
> > > > > >> >> Logan C. Dawson, Ph.D.
> > > > > >> >> Physical Scientist, VPPPG/MEG
> > > > > >> >> NOAA/NWS/NCEP/EMC
> > > > > >> >> (301) 683-3944
> > > > > >> >>
> > > > > >> >>
> > > > > >> >
> > > > > >> > --
> > > > > >> > Julie Prestopnik
> > > > > >> > Software Engineer
> > > > > >> > National Center for Atmospheric Research
> > > > > >> > Research Applications Laboratory
> > > > > >> > Phone: 303.497.8399
> > > > > >> > Email: jpresto at ucar.edu
> > > > > >> >
> > > > > >> > My working day may not be your working day. Please do
not
> feel
> > > > > obliged
> > > > > >> to
> > > > > >> > reply to this email outside of your normal working
hours.
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >> --
> > > > > >> Julie Prestopnik
> > > > > >> Software Engineer
> > > > > >> National Center for Atmospheric Research
> > > > > >> Research Applications Laboratory
> > > > > >> Phone: 303.497.8399
> > > > > >> Email: jpresto at ucar.edu
> > > > > >>
> > > > > >> My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > to
> > > > > >> reply to this email outside of your normal working hours.
> > > > > >>
> > > > > >>
> > > > > >
> > > > > > --
> > > > > > Logan C. Dawson, Ph.D.
> > > > > > Physical Scientist, VPPPG/MEG
> > > > > > NOAA/NWS/NCEP/EMC
> > > > > > (301) 683-3944
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Logan C. Dawson, Ph.D.
> > > > > Physical Scientist, VPPPG/MEG
> > > > > NOAA/NWS/NCEP/EMC
> > > > > (301) 683-3944
> > > > >
> > > > >
> > > >
> > > > --
> > > > Julie Prestopnik
> > > > Software Engineer
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Phone: 303.497.8399
> > > > Email: jpresto at ucar.edu
> > > >
> > > > My working day may not be your working day. Please do not
feel
> obliged
> > > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > > --
> > > Logan C. Dawson, Ph.D.
> > > Physical Scientist, VPPPG/MEG
> > > NOAA/NWS/NCEP/EMC
> > > (301) 683-3944
> > >
> > >
> >
> > --
> > Julie Prestopnik
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Phone: 303.497.8399
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Logan C. Dawson, Ph.D.
> Physical Scientist, VPPPG/MEG
> NOAA/NWS/NCEP/EMC
> (301) 683-3944
>
>
--
Julie Prestopnik
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Phone: 303.497.8399
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
More information about the Met_help
mailing list