[Met_help] [rt.rap.ucar.edu #98122] History for metplus error
Julie Prestopnik via RT
met_help at ucar.edu
Thu Feb 25 09:12:38 MST 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I am trying to use METPlus to verify PM2.5 dataset against observation and
having some issues. Any help on this is appreciated.
Location in wcoss :
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
.conf is : metplus_gefs_pb2nc_pointstat.conf
When I am trying to run it I am seeing the following problem :
run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032) MET command
returned a non-zero return code: pb2nc -v 7
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
Thanks
Partha
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: metplus error
From: Julie Prestopnik
Time: Tue Jan 05 14:50:40 2021
Hi Partha.
I see that you are having trouble running pb2nc using METplus on
WCOSS. I
logged on to WCOSS and took a look at
your
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
file.
First, I see that you are using METplus located
at
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
We are asking users to stop using the installations
at /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus and
instead use the emc.metplus locations, which can be found on our
Existing
Builds
<https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds> page
for our latest release. In this case for WCOSS (Mars/Venus), you'd
want to
use the following:
> module use
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> module load metplus/3.1.1
>
Next, searching in your log file for "error", I found many (72)
instances
of the following:
> ERROR :
> ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> Nothing to write.
> ERROR :
Looking up in the file from the first error message I see the
following:
> DEBUG 2: Total Messages processed = 24744
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 0
> DEBUG 2: Rejected based on masking grid = 384
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 24360
> DEBUG 2: Total Messages retained = 0
> DEBUG 2: Total observations retained or derived = 0
> DEBUG 1: Obs time between 20201230_010000 and 20201231_000000
> DEBUG 5: Filtered time:
>
So, it looks like MET is not finding any observations. Please review
the
observation information to see if you can determine why the
observations
are being rejected. Please let us know how it goes and let us know if
you
need any assistance.
Julie
On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> Queue: met_help
> Subject: metplus error
> Owner: Nobody
> Requestors: partha.bhattacharjee at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
>
> Hi,
> I am trying to use METPlus to verify PM2.5 dataset against
observation and
> having some issues. Any help on this is appreciated.
> Location in wcoss :
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> .conf is : metplus_gefs_pb2nc_pointstat.conf
> When I am trying to run it I am seeing the following problem :
> run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032) MET
command
> returned a non-zero return code: pb2nc -v 7
>
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
>
> Thanks
> Partha
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: metplus error
From: Partha Bhattacharjee - NOAA Affiliate
Time: Tue Jan 05 22:20:17 2021
Thanks Julie for looking into it. I updated metplus location in Mars.
But I need some help to find why the ERROR in logfile happening :
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
I have tested valid input files, but not sure why no Obs retained
after
pb2nc step.
Partha
On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Partha.
>
> I see that you are having trouble running pb2nc using METplus on
WCOSS. I
> logged on to WCOSS and took a look at
> your
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> file.
>
> First, I see that you are using METplus located
> at
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> We are asking users to stop using the installations
> at /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus and
> instead use the emc.metplus locations, which can be found on our
Existing
> Builds
> <https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds>
> page
> for our latest release. In this case for WCOSS (Mars/Venus), you'd
want to
> use the following:
>
> > module use
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > module load metplus/3.1.1
> >
>
> Next, searching in your log file for "error", I found many (72)
instances
> of the following:
>
> > ERROR :
> > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages retained.
> > Nothing to write.
> > ERROR :
>
>
> Looking up in the file from the first error message I see the
following:
>
> > DEBUG 2: Total Messages processed = 24744
> > DEBUG 2: Rejected based on message type = 0
> > DEBUG 2: Rejected based on station id = 0
> > DEBUG 2: Rejected based on valid time = 0
> > DEBUG 2: Rejected based on masking grid = 384
> > DEBUG 2: Rejected based on masking polygon = 0
> > DEBUG 2: Rejected based on elevation = 0
> > DEBUG 2: Rejected based on pb report type = 0
> > DEBUG 2: Rejected based on input report type = 0
> > DEBUG 2: Rejected based on instrument type = 0
> > DEBUG 2: Rejected based on zero observations = 24360
> > DEBUG 2: Total Messages retained = 0
> > DEBUG 2: Total observations retained or derived = 0
> > DEBUG 1: Obs time between 20201230_010000 and 20201231_000000
> > DEBUG 5: Filtered time:
> >
>
> So, it looks like MET is not finding any observations. Please
review the
> observation information to see if you can determine why the
observations
> are being rejected. Please let us know how it goes and let us know
if you
> need any assistance.
>
> Julie
>
> On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA Affiliate
via RT
> <met_help at ucar.edu> wrote:
>
> >
> > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > Queue: met_help
> > Subject: metplus error
> > Owner: Nobody
> > Requestors: partha.bhattacharjee at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> >
> >
> > Hi,
> > I am trying to use METPlus to verify PM2.5 dataset against
observation
> and
> > having some issues. Any help on this is appreciated.
> > Location in wcoss :
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > When I am trying to run it I am seeing the following problem :
> > run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032) MET
command
> > returned a non-zero return code: pb2nc -v 7
> >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> >
> > Thanks
> > Partha
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: metplus error
From: Julie Prestopnik
Time: Wed Jan 06 09:59:02 2021
Thank you for letting me know Partha. I will follow up once I have
more
information.
Julie
On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
> Thanks Julie for looking into it. I updated metplus location in
Mars.
> But I need some help to find why the ERROR in logfile happening :
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> I have tested valid input files, but not sure why no Obs retained
after
> pb2nc step.
>
> Partha
>
> On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Partha.
> >
> > I see that you are having trouble running pb2nc using METplus on
WCOSS.
> I
> > logged on to WCOSS and took a look at
> > your
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > file.
> >
> > First, I see that you are using METplus located
> > at
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > We are asking users to stop using the installations
> > at /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
and
> > instead use the emc.metplus locations, which can be found on our
Existing
> > Builds
> > <https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> >
> > page
> > for our latest release. In this case for WCOSS (Mars/Venus),
you'd want
> to
> > use the following:
> >
> > > module use
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > module load metplus/3.1.1
> > >
> >
> > Next, searching in your log file for "error", I found many (72)
instances
> > of the following:
> >
> > > ERROR :
> > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > Nothing to write.
> > > ERROR :
> >
> >
> > Looking up in the file from the first error message I see the
following:
> >
> > > DEBUG 2: Total Messages processed = 24744
> > > DEBUG 2: Rejected based on message type = 0
> > > DEBUG 2: Rejected based on station id = 0
> > > DEBUG 2: Rejected based on valid time = 0
> > > DEBUG 2: Rejected based on masking grid = 384
> > > DEBUG 2: Rejected based on masking polygon = 0
> > > DEBUG 2: Rejected based on elevation = 0
> > > DEBUG 2: Rejected based on pb report type = 0
> > > DEBUG 2: Rejected based on input report type = 0
> > > DEBUG 2: Rejected based on instrument type = 0
> > > DEBUG 2: Rejected based on zero observations = 24360
> > > DEBUG 2: Total Messages retained = 0
> > > DEBUG 2: Total observations retained or derived = 0
> > > DEBUG 1: Obs time between 20201230_010000 and 20201231_000000
> > > DEBUG 5: Filtered time:
> > >
> >
> > So, it looks like MET is not finding any observations. Please
review the
> > observation information to see if you can determine why the
observations
> > are being rejected. Please let us know how it goes and let us
know if
> you
> > need any assistance.
> >
> > Julie
> >
> > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA
Affiliate via
> RT
> > <met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > > Queue: met_help
> > > Subject: metplus error
> > > Owner: Nobody
> > > Requestors: partha.bhattacharjee at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> >
> > >
> > >
> > > Hi,
> > > I am trying to use METPlus to verify PM2.5 dataset against
observation
> > and
> > > having some issues. Any help on this is appreciated.
> > > Location in wcoss :
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > When I am trying to run it I am seeing the following problem :
> > > run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032) MET
> command
> > > returned a non-zero return code: pb2nc -v 7
> > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > >
> > > Thanks
> > > Partha
> > >
> > >
> >
> > --
> > Julie Prestopnik (she/her)
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: metplus error
From: Julie Prestopnik
Time: Wed Jan 06 11:15:06 2021
Hi Partha.
I thought it would be a good idea to eliminate the METplus
infrastructure
and run one case of pb2nc to see if the results were the same, so I
created
a run script that just runs the first pb2nc run. It did produce the
same
results.
You can take a look at the script if you'd like. It is in
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
The question is... why are we getting 0 observations from PB2NC.
Looking in
test_run.sh, we see you are trying to retain only a variable named
"COPO":
*export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
We should check to see what observation variables are actually present
in
this file. We can do that by running pb2nc with the "-index" command
line
option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's the log
messages
that produces:
> DEBUG 1: Header variables (8) :
> DEBUG 1: XOB: LONGITUDE
> DEBUG 1: YOB: LATITUDE
> DEBUG 1: YEAR:
> DEBUG 1: MNTH:
> DEBUG 1: DAYS:
> DEBUG 1: HOUR:
> DEBUG 1: MINU:
> DEBUG 1: SECO:
> DEBUG 1:
> DEBUG 1: Observation variables (9) Name: Description
> Types:
> DEBUG 1: TYPO: TYPE OF POLLUTANT
> ANOWPM
> DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
ANOWPM
> DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN (OBTAINED FROM
SCRIPT)
> ANOWPM
> DEBUG 1: SQN: REPORT SEQUENCE NUMBER
ANOWPM
> DEBUG 1: TSIG: TIME SIGNIFICANCE
> ANOWPM
> DEBUG 1: RPT: REPORTED OBSERVATION TIME
ANOWPM
> DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
ANOWPM
> DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT (PARTICULATE MATTER
DENSITY)
> ANOWPM
> DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF FOLLOWING DATA
> ANOWPM
Note, that there is no variable named "*COPO*" but there is one named
"
*COPOPM*".
Changing COPO to COPOPM and removing the -index command line option
and
rerunning, pb2nc does now retain obs:
> DEBUG 2: Total Messages processed = 24744
> DEBUG 2: Rejected based on message type = 0
> DEBUG 2: Rejected based on station id = 0
> DEBUG 2: Rejected based on valid time = 0
> DEBUG 2: Rejected based on masking grid = 384
> DEBUG 2: Rejected based on masking polygon = 0
> DEBUG 2: Rejected based on elevation = 0
> DEBUG 2: Rejected based on pb report type = 0
> DEBUG 2: Rejected based on input report type = 0
> DEBUG 2: Rejected based on instrument type = 0
> DEBUG 2: Rejected based on zero observations = 2591
> DEBUG 2: Total Messages retained = 21769
> DEBUG 2: Total observations retained or derived = 21769
So, it looks like you need to update the variable to "COPOPM" in your
METplus file and hopefully, you will see better results. Please let
us
know how it goes.
Julie
On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
> Thanks Julie for looking into it. I updated metplus location in
Mars.
> But I need some help to find why the ERROR in logfile happening :
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> I have tested valid input files, but not sure why no Obs retained
after
> pb2nc step.
>
> Partha
>
> On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Partha.
> >
> > I see that you are having trouble running pb2nc using METplus on
WCOSS.
> I
> > logged on to WCOSS and took a look at
> > your
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > file.
> >
> > First, I see that you are using METplus located
> > at
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > We are asking users to stop using the installations
> > at /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
and
> > instead use the emc.metplus locations, which can be found on our
Existing
> > Builds
> > <https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> >
> > page
> > for our latest release. In this case for WCOSS (Mars/Venus),
you'd want
> to
> > use the following:
> >
> > > module use
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > module load metplus/3.1.1
> > >
> >
> > Next, searching in your log file for "error", I found many (72)
instances
> > of the following:
> >
> > > ERROR :
> > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > Nothing to write.
> > > ERROR :
> >
> >
> > Looking up in the file from the first error message I see the
following:
> >
> > > DEBUG 2: Total Messages processed = 24744
> > > DEBUG 2: Rejected based on message type = 0
> > > DEBUG 2: Rejected based on station id = 0
> > > DEBUG 2: Rejected based on valid time = 0
> > > DEBUG 2: Rejected based on masking grid = 384
> > > DEBUG 2: Rejected based on masking polygon = 0
> > > DEBUG 2: Rejected based on elevation = 0
> > > DEBUG 2: Rejected based on pb report type = 0
> > > DEBUG 2: Rejected based on input report type = 0
> > > DEBUG 2: Rejected based on instrument type = 0
> > > DEBUG 2: Rejected based on zero observations = 24360
> > > DEBUG 2: Total Messages retained = 0
> > > DEBUG 2: Total observations retained or derived = 0
> > > DEBUG 1: Obs time between 20201230_010000 and 20201231_000000
> > > DEBUG 5: Filtered time:
> > >
> >
> > So, it looks like MET is not finding any observations. Please
review the
> > observation information to see if you can determine why the
observations
> > are being rejected. Please let us know how it goes and let us
know if
> you
> > need any assistance.
> >
> > Julie
> >
> > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA
Affiliate via
> RT
> > <met_help at ucar.edu> wrote:
> >
> > >
> > > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > > Queue: met_help
> > > Subject: metplus error
> > > Owner: Nobody
> > > Requestors: partha.bhattacharjee at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> >
> > >
> > >
> > > Hi,
> > > I am trying to use METPlus to verify PM2.5 dataset against
observation
> > and
> > > having some issues. Any help on this is appreciated.
> > > Location in wcoss :
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > When I am trying to run it I am seeing the following problem :
> > > run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032) MET
> command
> > > returned a non-zero return code: pb2nc -v 7
> > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > >
> > > Thanks
> > > Partha
> > >
> > >
> >
> > --
> > Julie Prestopnik (she/her)
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: metplus error
From: Partha Bhattacharjee - NOAA Affiliate
Time: Fri Jan 08 15:03:42 2021
Many thanks Julie for pointing out that error. I have fixed it and am
able
to create an obs file with valid values. However, I am having problems
finding the matched pair between forecast and obs file. I checked MET
that
read the model and obs file fine but finding no matched pair in the
grid.
Reference LOG file
:
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
line 13772 onward.
Any suggestion on this is appreciated
Thanks
Partha
On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT
<met_help at ucar.edu>
wrote:
> Hi Partha.
>
> I thought it would be a good idea to eliminate the METplus
infrastructure
> and run one case of pb2nc to see if the results were the same, so I
created
> a run script that just runs the first pb2nc run. It did produce the
same
> results.
>
> You can take a look at the script if you'd like. It is in
>
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
>
> The question is... why are we getting 0 observations from PB2NC.
Looking in
> test_run.sh, we see you are trying to retain only a variable named
"COPO":
> *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
>
> We should check to see what observation variables are actually
present in
> this file. We can do that by running pb2nc with the "-index" command
line
> option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's the log
messages
> that produces:
>
> > DEBUG 1: Header variables (8) :
> > DEBUG 1: XOB: LONGITUDE
> > DEBUG 1: YOB: LATITUDE
> > DEBUG 1: YEAR:
> > DEBUG 1: MNTH:
> > DEBUG 1: DAYS:
> > DEBUG 1: HOUR:
> > DEBUG 1: MINU:
> > DEBUG 1: SECO:
> > DEBUG 1:
> > DEBUG 1: Observation variables (9) Name: Description
> > Types:
> > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > ANOWPM
> > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
ANOWPM
> > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN (OBTAINED FROM
SCRIPT)
> > ANOWPM
> > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
ANOWPM
> > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > ANOWPM
> > DEBUG 1: RPT: REPORTED OBSERVATION TIME
ANOWPM
> > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
ANOWPM
> > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT (PARTICULATE MATTER
> DENSITY)
> > ANOWPM
> > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF FOLLOWING DATA
> > ANOWPM
>
>
> Note, that there is no variable named "*COPO*" but there is one
named "
> *COPOPM*".
>
> Changing COPO to COPOPM and removing the -index command line option
and
> rerunning, pb2nc does now retain obs:
>
> > DEBUG 2: Total Messages processed = 24744
> > DEBUG 2: Rejected based on message type = 0
> > DEBUG 2: Rejected based on station id = 0
> > DEBUG 2: Rejected based on valid time = 0
> > DEBUG 2: Rejected based on masking grid = 384
> > DEBUG 2: Rejected based on masking polygon = 0
> > DEBUG 2: Rejected based on elevation = 0
> > DEBUG 2: Rejected based on pb report type = 0
> > DEBUG 2: Rejected based on input report type = 0
> > DEBUG 2: Rejected based on instrument type = 0
> > DEBUG 2: Rejected based on zero observations = 2591
> > DEBUG 2: Total Messages retained = 21769
> > DEBUG 2: Total observations retained or derived = 21769
>
>
> So, it looks like you need to update the variable to "COPOPM" in
your
> METplus file and hopefully, you will see better results. Please let
us
> know how it goes.
>
> Julie
>
> On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> >
> > Thanks Julie for looking into it. I updated metplus location in
Mars.
> > But I need some help to find why the ERROR in logfile happening :
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > I have tested valid input files, but not sure why no Obs retained
after
> > pb2nc step.
> >
> > Partha
> >
> > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT <
> met_help at ucar.edu>
> > wrote:
> >
> > > Hi Partha.
> > >
> > > I see that you are having trouble running pb2nc using METplus on
WCOSS.
> > I
> > > logged on to WCOSS and took a look at
> > > your
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > file.
> > >
> > > First, I see that you are using METplus located
> > > at
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > We are asking users to stop using the installations
> > > at /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
and
> > > instead use the emc.metplus locations, which can be found on our
> Existing
> > > Builds
> > > <
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > >
> > > page
> > > for our latest release. In this case for WCOSS (Mars/Venus),
you'd
> want
> > to
> > > use the following:
> > >
> > > > module use
> /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > module load metplus/3.1.1
> > > >
> > >
> > > Next, searching in your log file for "error", I found many (72)
> instances
> > > of the following:
> > >
> > > > ERROR :
> > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > Nothing to write.
> > > > ERROR :
> > >
> > >
> > > Looking up in the file from the first error message I see the
> following:
> > >
> > > > DEBUG 2: Total Messages processed = 24744
> > > > DEBUG 2: Rejected based on message type = 0
> > > > DEBUG 2: Rejected based on station id = 0
> > > > DEBUG 2: Rejected based on valid time = 0
> > > > DEBUG 2: Rejected based on masking grid = 384
> > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > DEBUG 2: Rejected based on elevation = 0
> > > > DEBUG 2: Rejected based on pb report type = 0
> > > > DEBUG 2: Rejected based on input report type = 0
> > > > DEBUG 2: Rejected based on instrument type = 0
> > > > DEBUG 2: Rejected based on zero observations = 24360
> > > > DEBUG 2: Total Messages retained = 0
> > > > DEBUG 2: Total observations retained or derived = 0
> > > > DEBUG 1: Obs time between 20201230_010000 and 20201231_000000
> > > > DEBUG 5: Filtered time:
> > > >
> > >
> > > So, it looks like MET is not finding any observations. Please
review
> the
> > > observation information to see if you can determine why the
> observations
> > > are being rejected. Please let us know how it goes and let us
know if
> > you
> > > need any assistance.
> > >
> > > Julie
> > >
> > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA
Affiliate
> via
> > RT
> > > <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > > > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > > > Queue: met_help
> > > > Subject: metplus error
> > > > Owner: Nobody
> > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > >
> > > >
> > > >
> > > > Hi,
> > > > I am trying to use METPlus to verify PM2.5 dataset against
> observation
> > > and
> > > > having some issues. Any help on this is appreciated.
> > > > Location in wcoss :
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > When I am trying to run it I am seeing the following problem :
> > > > run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032)
MET
> > command
> > > > returned a non-zero return code: pb2nc -v 7
> > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > >
> > > > Thanks
> > > > Partha
> > > >
> > > >
> > >
> > > --
> > > Julie Prestopnik (she/her)
> > > Software Engineer
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Email: jpresto at ucar.edu
> > >
> > > My working day may not be your working day. Please do not feel
obliged
> > to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Partha S. Bhattacharjee, Ph.D.
> > I.M. Systems Group
> > Environmental Modeling Centre
> > NCWCP
> > 5830 University Research Court.
> > College Park, MD 20740
> >
> >
>
> --
> Julie Prestopnik (she/her)
> Software Engineer
> National Center for Atmospheric Research
> Research Applications Laboratory
> Email: jpresto at ucar.edu
>
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: metplus error
From: John Halley Gotway
Time: Mon Jan 11 14:03:11 2021
Hi Partha,
This is John Halley Gotway. Julie asked me to take a look at this
latest
issue. Wanted to let you know that I'm logging on this afternoon to
take a
closer look. But please let me know if you've made any more progress.
Thanks,
John
On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA Affiliate
via RT
<met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
> Many thanks Julie for pointing out that error. I have fixed it and
am able
> to create an obs file with valid values. However, I am having
problems
> finding the matched pair between forecast and obs file. I checked
MET that
> read the model and obs file fine but finding no matched pair in the
grid.
> Reference LOG file
> :
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> line 13772 onward.
>
> Any suggestion on this is appreciated
> Thanks
> Partha
>
> On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Partha.
> >
> > I thought it would be a good idea to eliminate the METplus
infrastructure
> > and run one case of pb2nc to see if the results were the same, so
I
> created
> > a run script that just runs the first pb2nc run. It did produce
the same
> > results.
> >
> > You can take a look at the script if you'd like. It is in
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> >
> > The question is... why are we getting 0 observations from PB2NC.
Looking
> in
> > test_run.sh, we see you are trying to retain only a variable named
> "COPO":
> > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> >
> > We should check to see what observation variables are actually
present in
> > this file. We can do that by running pb2nc with the "-index"
command line
> > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's the log
messages
> > that produces:
> >
> > > DEBUG 1: Header variables (8) :
> > > DEBUG 1: XOB: LONGITUDE
> > > DEBUG 1: YOB: LATITUDE
> > > DEBUG 1: YEAR:
> > > DEBUG 1: MNTH:
> > > DEBUG 1: DAYS:
> > > DEBUG 1: HOUR:
> > > DEBUG 1: MINU:
> > > DEBUG 1: SECO:
> > > DEBUG 1:
> > > DEBUG 1: Observation variables (9) Name: Description
> > > Types:
> > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > ANOWPM
> > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
ANOWPM
> > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN (OBTAINED
FROM
> SCRIPT)
> > > ANOWPM
> > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> ANOWPM
> > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > ANOWPM
> > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> ANOWPM
> > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
ANOWPM
> > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT (PARTICULATE
MATTER
> > DENSITY)
> > > ANOWPM
> > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF FOLLOWING DATA
> > > ANOWPM
> >
> >
> > Note, that there is no variable named "*COPO*" but there is one
named "
> > *COPOPM*".
> >
> > Changing COPO to COPOPM and removing the -index command line
option and
> > rerunning, pb2nc does now retain obs:
> >
> > > DEBUG 2: Total Messages processed = 24744
> > > DEBUG 2: Rejected based on message type = 0
> > > DEBUG 2: Rejected based on station id = 0
> > > DEBUG 2: Rejected based on valid time = 0
> > > DEBUG 2: Rejected based on masking grid = 384
> > > DEBUG 2: Rejected based on masking polygon = 0
> > > DEBUG 2: Rejected based on elevation = 0
> > > DEBUG 2: Rejected based on pb report type = 0
> > > DEBUG 2: Rejected based on input report type = 0
> > > DEBUG 2: Rejected based on instrument type = 0
> > > DEBUG 2: Rejected based on zero observations = 2591
> > > DEBUG 2: Total Messages retained = 21769
> > > DEBUG 2: Total observations retained or derived = 21769
> >
> >
> > So, it looks like you need to update the variable to "COPOPM" in
your
> > METplus file and hopefully, you will see better results. Please
let us
> > know how it goes.
> >
> > Julie
> >
> > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA
Affiliate via
> > RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > >
> > > Thanks Julie for looking into it. I updated metplus location in
Mars.
> > > But I need some help to find why the ERROR in logfile happening
:
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > I have tested valid input files, but not sure why no Obs
retained after
> > > pb2nc step.
> > >
> > > Partha
> > >
> > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Partha.
> > > >
> > > > I see that you are having trouble running pb2nc using METplus
on
> WCOSS.
> > > I
> > > > logged on to WCOSS and took a look at
> > > > your
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > file.
> > > >
> > > > First, I see that you are using METplus located
> > > > at
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > We are asking users to stop using the installations
> > > > at
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus and
> > > > instead use the emc.metplus locations, which can be found on
our
> > Existing
> > > > Builds
> > > > <
> > https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > >
> > > > page
> > > > for our latest release. In this case for WCOSS (Mars/Venus),
you'd
> > want
> > > to
> > > > use the following:
> > > >
> > > > > module use
> > /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > module load metplus/3.1.1
> > > > >
> > > >
> > > > Next, searching in your log file for "error", I found many
(72)
> > instances
> > > > of the following:
> > > >
> > > > > ERROR :
> > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
retained.
> > > > > Nothing to write.
> > > > > ERROR :
> > > >
> > > >
> > > > Looking up in the file from the first error message I see the
> > following:
> > > >
> > > > > DEBUG 2: Total Messages processed = 24744
> > > > > DEBUG 2: Rejected based on message type = 0
> > > > > DEBUG 2: Rejected based on station id = 0
> > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > DEBUG 2: Rejected based on zero observations = 24360
> > > > > DEBUG 2: Total Messages retained = 0
> > > > > DEBUG 2: Total observations retained or derived = 0
> > > > > DEBUG 1: Obs time between 20201230_010000 and
20201231_000000
> > > > > DEBUG 5: Filtered time:
> > > > >
> > > >
> > > > So, it looks like MET is not finding any observations. Please
review
> > the
> > > > observation information to see if you can determine why the
> > observations
> > > > are being rejected. Please let us know how it goes and let us
know
> if
> > > you
> > > > need any assistance.
> > > >
> > > > Julie
> > > >
> > > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA
Affiliate
> > via
> > > RT
> > > > <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > > > > Transaction: Ticket created by partha.bhattacharjee at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: metplus error
> > > > > Owner: Nobody
> > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > >
> > > > >
> > > > >
> > > > > Hi,
> > > > > I am trying to use METPlus to verify PM2.5 dataset against
> > observation
> > > > and
> > > > > having some issues. Any help on this is appreciated.
> > > > > Location in wcoss :
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > When I am trying to run it I am seeing the following problem
:
> > > > > run-METplus-metplus.PB2NC: ERROR: (command_builder.py:1032)
MET
> > > command
> > > > > returned a non-zero return code: pb2nc -v 7
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > >
> > > > > Thanks
> > > > > Partha
> > > > >
> > > > >
> > > >
> > > > --
> > > > Julie Prestopnik (she/her)
> > > > Software Engineer
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Email: jpresto at ucar.edu
> > > >
> > > > My working day may not be your working day. Please do not
feel
> obliged
> > > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > > --
> > > Partha S. Bhattacharjee, Ph.D.
> > > I.M. Systems Group
> > > Environmental Modeling Centre
> > > NCWCP
> > > 5830 University Research Court.
> > > College Park, MD 20740
> > >
> > >
> >
> > --
> > Julie Prestopnik (she/her)
> > Software Engineer
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > Email: jpresto at ucar.edu
> >
> > My working day may not be your working day. Please do not feel
obliged
> to
> > reply to this email outside of your normal working hours.
> >
> >
>
> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
------------------------------------------------
Subject: metplus error
From: Partha Bhattacharjee - NOAA Affiliate
Time: Mon Jan 11 14:12:51 2021
Thanks John. No I am not able to make progress on this. I checked both
input values, which seems to be valid. But no getting matched pairs.
Partha
On Mon, Jan 11, 2021 at 4:03 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Hi Partha,
>
> This is John Halley Gotway. Julie asked me to take a look at this
latest
> issue. Wanted to let you know that I'm logging on this afternoon to
take a
> closer look. But please let me know if you've made any more
progress.
>
> Thanks,
> John
>
> On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA Affiliate
via RT
> <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> >
> > Many thanks Julie for pointing out that error. I have fixed it and
am
> able
> > to create an obs file with valid values. However, I am having
problems
> > finding the matched pair between forecast and obs file. I checked
MET
> that
> > read the model and obs file fine but finding no matched pair in
the grid.
> > Reference LOG file
> > :
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > line 13772 onward.
> >
> > Any suggestion on this is appreciated
> > Thanks
> > Partha
> >
> > On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT <
> met_help at ucar.edu>
> > wrote:
> >
> > > Hi Partha.
> > >
> > > I thought it would be a good idea to eliminate the METplus
> infrastructure
> > > and run one case of pb2nc to see if the results were the same,
so I
> > created
> > > a run script that just runs the first pb2nc run. It did produce
the
> same
> > > results.
> > >
> > > You can take a look at the script if you'd like. It is in
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> > >
> > > The question is... why are we getting 0 observations from PB2NC.
> Looking
> > in
> > > test_run.sh, we see you are trying to retain only a variable
named
> > "COPO":
> > > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> > >
> > > We should check to see what observation variables are actually
present
> in
> > > this file. We can do that by running pb2nc with the "-index"
command
> line
> > > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's the log
> messages
> > > that produces:
> > >
> > > > DEBUG 1: Header variables (8) :
> > > > DEBUG 1: XOB: LONGITUDE
> > > > DEBUG 1: YOB: LATITUDE
> > > > DEBUG 1: YEAR:
> > > > DEBUG 1: MNTH:
> > > > DEBUG 1: DAYS:
> > > > DEBUG 1: HOUR:
> > > > DEBUG 1: MINU:
> > > > DEBUG 1: SECO:
> > > > DEBUG 1:
> > > > DEBUG 1: Observation variables (9) Name: Description
> > > > Types:
> > > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > > ANOWPM
> > > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
ANOWPM
> > > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN (OBTAINED
FROM
> > SCRIPT)
> > > > ANOWPM
> > > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> > ANOWPM
> > > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > > ANOWPM
> > > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> > ANOWPM
> > > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
> ANOWPM
> > > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT (PARTICULATE
MATTER
> > > DENSITY)
> > > > ANOWPM
> > > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF FOLLOWING
DATA
> > > > ANOWPM
> > >
> > >
> > > Note, that there is no variable named "*COPO*" but there is one
named "
> > > *COPOPM*".
> > >
> > > Changing COPO to COPOPM and removing the -index command line
option and
> > > rerunning, pb2nc does now retain obs:
> > >
> > > > DEBUG 2: Total Messages processed = 24744
> > > > DEBUG 2: Rejected based on message type = 0
> > > > DEBUG 2: Rejected based on station id = 0
> > > > DEBUG 2: Rejected based on valid time = 0
> > > > DEBUG 2: Rejected based on masking grid = 384
> > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > DEBUG 2: Rejected based on elevation = 0
> > > > DEBUG 2: Rejected based on pb report type = 0
> > > > DEBUG 2: Rejected based on input report type = 0
> > > > DEBUG 2: Rejected based on instrument type = 0
> > > > DEBUG 2: Rejected based on zero observations = 2591
> > > > DEBUG 2: Total Messages retained = 21769
> > > > DEBUG 2: Total observations retained or derived = 21769
> > >
> > >
> > > So, it looks like you need to update the variable to "COPOPM" in
your
> > > METplus file and hopefully, you will see better results. Please
let us
> > > know how it goes.
> > >
> > > Julie
> > >
> > > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA
Affiliate
> via
> > > RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
>
> > > >
> > > > Thanks Julie for looking into it. I updated metplus location
in Mars.
> > > > But I need some help to find why the ERROR in logfile
happening :
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > > I have tested valid input files, but not sure why no Obs
retained
> after
> > > > pb2nc step.
> > > >
> > > > Partha
> > > >
> > > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT <
> > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Partha.
> > > > >
> > > > > I see that you are having trouble running pb2nc using
METplus on
> > WCOSS.
> > > > I
> > > > > logged on to WCOSS and took a look at
> > > > > your
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > > file.
> > > > >
> > > > > First, I see that you are using METplus located
> > > > > at
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > > We are asking users to stop using the installations
> > > > > at
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
> and
> > > > > instead use the emc.metplus locations, which can be found on
our
> > > Existing
> > > > > Builds
> > > > > <
> > >
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > > >
> > > > > page
> > > > > for our latest release. In this case for WCOSS
(Mars/Venus), you'd
> > > want
> > > > to
> > > > > use the following:
> > > > >
> > > > > > module use
> > > /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > > module load metplus/3.1.1
> > > > > >
> > > > >
> > > > > Next, searching in your log file for "error", I found many
(72)
> > > instances
> > > > > of the following:
> > > > >
> > > > > > ERROR :
> > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> retained.
> > > > > > Nothing to write.
> > > > > > ERROR :
> > > > >
> > > > >
> > > > > Looking up in the file from the first error message I see
the
> > > following:
> > > > >
> > > > > > DEBUG 2: Total Messages processed = 24744
> > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > DEBUG 2: Rejected based on zero observations = 24360
> > > > > > DEBUG 2: Total Messages retained = 0
> > > > > > DEBUG 2: Total observations retained or derived = 0
> > > > > > DEBUG 1: Obs time between 20201230_010000 and
20201231_000000
> > > > > > DEBUG 5: Filtered time:
> > > > > >
> > > > >
> > > > > So, it looks like MET is not finding any observations.
Please
> review
> > > the
> > > > > observation information to see if you can determine why the
> > > observations
> > > > > are being rejected. Please let us know how it goes and let
us know
> > if
> > > > you
> > > > > need any assistance.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA
> Affiliate
> > > via
> > > > RT
> > > > > <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > > > > > Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: metplus error
> > > > > > Owner: Nobody
> > > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > > >
> > > > > >
> > > > > >
> > > > > > Hi,
> > > > > > I am trying to use METPlus to verify PM2.5 dataset against
> > > observation
> > > > > and
> > > > > > having some issues. Any help on this is appreciated.
> > > > > > Location in wcoss :
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > > When I am trying to run it I am seeing the following
problem :
> > > > > > run-METplus-metplus.PB2NC: ERROR:
(command_builder.py:1032) MET
> > > > command
> > > > > > returned a non-zero return code: pb2nc -v 7
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > > prepufr.aqm.20201230.nc <http://prepbufr.aqm.20201230.nc/>
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > > >
> > > > > > Thanks
> > > > > > Partha
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik (she/her)
> > > > > Software Engineer
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > > >
> > > >
> > > > --
> > > > Partha S. Bhattacharjee, Ph.D.
> > > > I.M. Systems Group
> > > > Environmental Modeling Centre
> > > > NCWCP
> > > > 5830 University Research Court.
> > > > College Park, MD 20740
> > > >
> > > >
> > >
> > > --
> > > Julie Prestopnik (she/her)
> > > Software Engineer
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > Email: jpresto at ucar.edu
> > >
> > > My working day may not be your working day. Please do not feel
obliged
> > to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> > --
> > Partha S. Bhattacharjee, Ph.D.
> > I.M. Systems Group
> > Environmental Modeling Centre
> > NCWCP
> > 5830 University Research Court.
> > College Park, MD 20740
> >
> >
>
> --
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: metplus error
From: John Halley Gotway
Time: Mon Jan 11 14:44:15 2021
Partha,
OK, I got matched pairs. Not sure exactly what details to tell you
about.
Let me start with the punchline. After setting up a testing area
in /gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111, I had
to
make 2 changes to your config file: *PointStatConfig_AIRNOW*
(1) In the obs dictionary, change...
*FROM: { name = "COPOPM"; level = "A0";' }*
*TO: { name = "COPOPM"; level = "A1";' }*
(2) Change the message type...
*FROM: message_type = [ "AIRNOW" ];*
*TO: message_type = [ "ANOWPM" ];*
Run this to confirm that the message type for these obs is ANOWPM:
ncdump -v hdr_typ_table
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
prepbufr.aqm.20210104.nc
hdr_typ_table =
"ANOWPM" ;
And now I get matched pairs:
DEBUG 2: Processing PMTF/A0 versus COPOPM/A1, for observation type
ANOWPM,
over region FULL, for interpolation method BILIN(4), using 19192
matched
pairs.
DEBUG 3: Number of matched pairs = 19192
DEBUG 3: Observations processed = 20954
Next, all the details...
*(1) Copyable METplus environment:*
One very useful feature of the METplus log file is being able to
copy/paste
the environment and run command for point-stat. I looked in...
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
I went to line 13772, like you told us. And then searched BACKWARDS
for
"point_stat". Line numbers 11988 and 11989 contain a copyable
environment
and run command. So I extracted that content and copied it to:
/gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111/run_cmd.sh
I had to change a couple of paths due to permissions, but was able to
get
this test case to run.
*(2) Run Gen-Vx-Mask first instead of using .poly files:*
I did notice that it takes several seconds to apply all those lat/lon
polylines to your current vx domain. It'd run much faster if you ran
gen_vx_mask to generate NetCDF files for each of those masking regions
instead.
*(3) METplus config file:*
I was confused when testing because I was modifying the OBS_FIELD
environment variable at the top of run_cmd.sh. But no matter what I
changed, nothing changed in the output. That's when I realized that
your
Point-Stat config file is hard-coded! It makes no reference to
$OBS_FIELD.
These types of environment variables are how METplus communicates with
the
MET tools. If they don't appear in the Point-Stat config file, then no
communication occurs. I'd say you're stuck halfway between using and
not
using the METplus wrappers.
Here's the standard METplus-wrapped Point-Stat config file:
*https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
<https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped>*
Ideally you would configure ALL of your settings for Point-Stat via
the
METplus config file and not touch the Point-Stat config file at all.
Hope that helps clarify.
Thanks,
John
On Mon, Jan 11, 2021 at 2:13 PM Partha Bhattacharjee - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
> Thanks John. No I am not able to make progress on this. I checked
both
> input values, which seems to be valid. But no getting matched pairs.
> Partha
>
> On Mon, Jan 11, 2021 at 4:03 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Hi Partha,
> >
> > This is John Halley Gotway. Julie asked me to take a look at this
latest
> > issue. Wanted to let you know that I'm logging on this afternoon
to take
> a
> > closer look. But please let me know if you've made any more
progress.
> >
> > Thanks,
> > John
> >
> > On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA
Affiliate via
> RT
> > <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > >
> > > Many thanks Julie for pointing out that error. I have fixed it
and am
> > able
> > > to create an obs file with valid values. However, I am having
problems
> > > finding the matched pair between forecast and obs file. I
checked MET
> > that
> > > read the model and obs file fine but finding no matched pair in
the
> grid.
> > > Reference LOG file
> > > :
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > > line 13772 onward.
> > >
> > > Any suggestion on this is appreciated
> > > Thanks
> > > Partha
> > >
> > > On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Partha.
> > > >
> > > > I thought it would be a good idea to eliminate the METplus
> > infrastructure
> > > > and run one case of pb2nc to see if the results were the same,
so I
> > > created
> > > > a run script that just runs the first pb2nc run. It did
produce the
> > same
> > > > results.
> > > >
> > > > You can take a look at the script if you'd like. It is in
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> > > >
> > > > The question is... why are we getting 0 observations from
PB2NC.
> > Looking
> > > in
> > > > test_run.sh, we see you are trying to retain only a variable
named
> > > "COPO":
> > > > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> > > >
> > > > We should check to see what observation variables are actually
> present
> > in
> > > > this file. We can do that by running pb2nc with the "-index"
command
> > line
> > > > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's the
log
> > messages
> > > > that produces:
> > > >
> > > > > DEBUG 1: Header variables (8) :
> > > > > DEBUG 1: XOB: LONGITUDE
> > > > > DEBUG 1: YOB: LATITUDE
> > > > > DEBUG 1: YEAR:
> > > > > DEBUG 1: MNTH:
> > > > > DEBUG 1: DAYS:
> > > > > DEBUG 1: HOUR:
> > > > > DEBUG 1: MINU:
> > > > > DEBUG 1: SECO:
> > > > > DEBUG 1:
> > > > > DEBUG 1: Observation variables (9) Name: Description
> > > > > Types:
> > > > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > > > ANOWPM
> > > > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
> ANOWPM
> > > > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN (OBTAINED
FROM
> > > SCRIPT)
> > > > > ANOWPM
> > > > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> > > ANOWPM
> > > > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > > > ANOWPM
> > > > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> > > ANOWPM
> > > > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
> > ANOWPM
> > > > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT (PARTICULATE
MATTER
> > > > DENSITY)
> > > > > ANOWPM
> > > > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF FOLLOWING
DATA
> > > > > ANOWPM
> > > >
> > > >
> > > > Note, that there is no variable named "*COPO*" but there is
one
> named "
> > > > *COPOPM*".
> > > >
> > > > Changing COPO to COPOPM and removing the -index command line
option
> and
> > > > rerunning, pb2nc does now retain obs:
> > > >
> > > > > DEBUG 2: Total Messages processed = 24744
> > > > > DEBUG 2: Rejected based on message type = 0
> > > > > DEBUG 2: Rejected based on station id = 0
> > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > DEBUG 2: Rejected based on zero observations = 2591
> > > > > DEBUG 2: Total Messages retained = 21769
> > > > > DEBUG 2: Total observations retained or derived = 21769
> > > >
> > > >
> > > > So, it looks like you need to update the variable to "COPOPM"
in your
> > > > METplus file and hopefully, you will see better results.
Please let
> us
> > > > know how it goes.
> > > >
> > > > Julie
> > > >
> > > > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA
Affiliate
> > via
> > > > RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > > > >
> > > > > Thanks Julie for looking into it. I updated metplus location
in
> Mars.
> > > > > But I need some help to find why the ERROR in logfile
happening :
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > > > I have tested valid input files, but not sure why no Obs
retained
> > after
> > > > > pb2nc step.
> > > > >
> > > > > Partha
> > > > >
> > > > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT <
> > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Hi Partha.
> > > > > >
> > > > > > I see that you are having trouble running pb2nc using
METplus on
> > > WCOSS.
> > > > > I
> > > > > > logged on to WCOSS and took a look at
> > > > > > your
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > > > file.
> > > > > >
> > > > > > First, I see that you are using METplus located
> > > > > > at
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > > > We are asking users to stop using the installations
> > > > > > at
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
> > and
> > > > > > instead use the emc.metplus locations, which can be found
on our
> > > > Existing
> > > > > > Builds
> > > > > > <
> > > >
> > https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > > > >
> > > > > > page
> > > > > > for our latest release. In this case for WCOSS
(Mars/Venus),
> you'd
> > > > want
> > > > > to
> > > > > > use the following:
> > > > > >
> > > > > > > module use
> > > > /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > > > module load metplus/3.1.1
> > > > > > >
> > > > > >
> > > > > > Next, searching in your log file for "error", I found many
(72)
> > > > instances
> > > > > > of the following:
> > > > > >
> > > > > > > ERROR :
> > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr messages
> > retained.
> > > > > > > Nothing to write.
> > > > > > > ERROR :
> > > > > >
> > > > > >
> > > > > > Looking up in the file from the first error message I see
the
> > > > following:
> > > > > >
> > > > > > > DEBUG 2: Total Messages processed = 24744
> > > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > > DEBUG 2: Rejected based on zero observations = 24360
> > > > > > > DEBUG 2: Total Messages retained = 0
> > > > > > > DEBUG 2: Total observations retained or derived = 0
> > > > > > > DEBUG 1: Obs time between 20201230_010000 and
20201231_000000
> > > > > > > DEBUG 5: Filtered time:
> > > > > > >
> > > > > >
> > > > > > So, it looks like MET is not finding any observations.
Please
> > review
> > > > the
> > > > > > observation information to see if you can determine why
the
> > > > observations
> > > > > > are being rejected. Please let us know how it goes and
let us
> know
> > > if
> > > > > you
> > > > > > need any assistance.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee - NOAA
> > Affiliate
> > > > via
> > > > > RT
> > > > > > <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted upon.
> > > > > > > Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> > > > > > > Queue: met_help
> > > > > > > Subject: metplus error
> > > > > > > Owner: Nobody
> > > > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > > > Status: new
> > > > > > > Ticket <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Hi,
> > > > > > > I am trying to use METPlus to verify PM2.5 dataset
against
> > > > observation
> > > > > > and
> > > > > > > having some issues. Any help on this is appreciated.
> > > > > > > Location in wcoss :
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > > > When I am trying to run it I am seeing the following
problem :
> > > > > > > run-METplus-metplus.PB2NC: ERROR:
(command_builder.py:1032)
> MET
> > > > > command
> > > > > > > returned a non-zero return code: pb2nc -v 7
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > > > prepufr.aqm.20201230.nc
<http://prepbufr.aqm.20201230.nc/>
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > > > >
> > > > > > > Thanks
> > > > > > > Partha
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik (she/her)
> > > > > > Software Engineer
> > > > > > National Center for Atmospheric Research
> > > > > > Research Applications Laboratory
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > My working day may not be your working day. Please do not
feel
> > > obliged
> > > > > to
> > > > > > reply to this email outside of your normal working hours.
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > I.M. Systems Group
> > > > > Environmental Modeling Centre
> > > > > NCWCP
> > > > > 5830 University Research Court.
> > > > > College Park, MD 20740
> > > > >
> > > > >
> > > >
> > > > --
> > > > Julie Prestopnik (she/her)
> > > > Software Engineer
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > Email: jpresto at ucar.edu
> > > >
> > > > My working day may not be your working day. Please do not
feel
> obliged
> > > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > > --
> > > Partha S. Bhattacharjee, Ph.D.
> > > I.M. Systems Group
> > > Environmental Modeling Centre
> > > NCWCP
> > > 5830 University Research Court.
> > > College Park, MD 20740
> > >
> > >
> >
> > --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
------------------------------------------------
Subject: metplus error
From: Partha Bhattacharjee - NOAA Affiliate
Time: Tue Jan 12 20:35:27 2021
Thanks John for all your help. I made the corrections and was able to
generate valid STAT files.
I have a question about the metplus config file you have mentioned. I
am
using this file metplus_gefs_pb2nc_pointstat.conf to run both pb2nc
and
pointstat and using the following command to run
master_metplus.py -c
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1/parm/use_cases/met_tool_wrapper/Example/Example.conf
-c
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/metplus_gefs_pb2nc_pointstat.conf
which uses PB2NCConfig_gefs and PointStatConfig_ANOWPM
How do I use or point to METplus-wrapped Point-Stat in there ?
2. Another question about .STAT file generated from this run. Is there
any
option available to make .stat in netcdf format ?
Thanks
Partha
On Mon, Jan 11, 2021 at 4:44 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Partha,
>
> OK, I got matched pairs. Not sure exactly what details to tell you
about.
> Let me start with the punchline. After setting up a testing area
> in /gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111, I
had to
> make 2 changes to your config file: *PointStatConfig_AIRNOW*
>
> (1) In the obs dictionary, change...
> *FROM: { name = "COPOPM"; level = "A0";' }*
> *TO: { name = "COPOPM"; level = "A1";' }*
>
> (2) Change the message type...
> *FROM: message_type = [ "AIRNOW" ];*
> *TO: message_type = [ "ANOWPM" ];*
>
> Run this to confirm that the message type for these obs is ANOWPM:
> ncdump -v hdr_typ_table
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> prepbufr.aqm.20210104.nc
>
> hdr_typ_table =
> "ANOWPM" ;
>
> And now I get matched pairs:
>
> DEBUG 2: Processing PMTF/A0 versus COPOPM/A1, for observation type
ANOWPM,
> over region FULL, for interpolation method BILIN(4), using 19192
matched
> pairs.
> DEBUG 3: Number of matched pairs = 19192
> DEBUG 3: Observations processed = 20954
>
> Next, all the details...
>
> *(1) Copyable METplus environment:*
>
> One very useful feature of the METplus log file is being able to
copy/paste
> the environment and run command for point-stat. I looked in...
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
>
> I went to line 13772, like you told us. And then searched BACKWARDS
for
> "point_stat". Line numbers 11988 and 11989 contain a copyable
environment
> and run command. So I extracted that content and copied it to:
>
/gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111/run_cmd.sh
>
> I had to change a couple of paths due to permissions, but was able
to get
> this test case to run.
>
> *(2) Run Gen-Vx-Mask first instead of using .poly files:*
>
> I did notice that it takes several seconds to apply all those
lat/lon
> polylines to your current vx domain. It'd run much faster if you ran
> gen_vx_mask to generate NetCDF files for each of those masking
regions
> instead.
>
> *(3) METplus config file:*
>
> I was confused when testing because I was modifying the OBS_FIELD
> environment variable at the top of run_cmd.sh. But no matter what I
> changed, nothing changed in the output. That's when I realized that
your
> Point-Stat config file is hard-coded! It makes no reference to
$OBS_FIELD.
> These types of environment variables are how METplus communicates
with the
> MET tools. If they don't appear in the Point-Stat config file, then
no
> communication occurs. I'd say you're stuck halfway between using and
not
> using the METplus wrappers.
>
> Here's the standard METplus-wrapped Point-Stat config file:
> *
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> <
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> >*
>
> Ideally you would configure ALL of your settings for Point-Stat via
the
> METplus config file and not touch the Point-Stat config file at all.
>
> Hope that helps clarify.
>
> Thanks,
> John
>
>
> On Mon, Jan 11, 2021 at 2:13 PM Partha Bhattacharjee - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> >
> > Thanks John. No I am not able to make progress on this. I checked
both
> > input values, which seems to be valid. But no getting matched
pairs.
> > Partha
> >
> > On Mon, Jan 11, 2021 at 4:03 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Hi Partha,
> > >
> > > This is John Halley Gotway. Julie asked me to take a look at
this
> latest
> > > issue. Wanted to let you know that I'm logging on this afternoon
to
> take
> > a
> > > closer look. But please let me know if you've made any more
progress.
> > >
> > > Thanks,
> > > John
> > >
> > > On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA
Affiliate
> via
> > RT
> > > <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
>
> > > >
> > > > Many thanks Julie for pointing out that error. I have fixed it
and am
> > > able
> > > > to create an obs file with valid values. However, I am having
> problems
> > > > finding the matched pair between forecast and obs file. I
checked MET
> > > that
> > > > read the model and obs file fine but finding no matched pair
in the
> > grid.
> > > > Reference LOG file
> > > > :
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > > > line 13772 onward.
> > > >
> > > > Any suggestion on this is appreciated
> > > > Thanks
> > > > Partha
> > > >
> > > > On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT <
> > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Partha.
> > > > >
> > > > > I thought it would be a good idea to eliminate the METplus
> > > infrastructure
> > > > > and run one case of pb2nc to see if the results were the
same, so I
> > > > created
> > > > > a run script that just runs the first pb2nc run. It did
produce the
> > > same
> > > > > results.
> > > > >
> > > > > You can take a look at the script if you'd like. It is in
> > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> > > > >
> > > > > The question is... why are we getting 0 observations from
PB2NC.
> > > Looking
> > > > in
> > > > > test_run.sh, we see you are trying to retain only a variable
named
> > > > "COPO":
> > > > > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> > > > >
> > > > > We should check to see what observation variables are
actually
> > present
> > > in
> > > > > this file. We can do that by running pb2nc with the "-index"
> command
> > > line
> > > > > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's the
log
> > > messages
> > > > > that produces:
> > > > >
> > > > > > DEBUG 1: Header variables (8) :
> > > > > > DEBUG 1: XOB: LONGITUDE
> > > > > > DEBUG 1: YOB: LATITUDE
> > > > > > DEBUG 1: YEAR:
> > > > > > DEBUG 1: MNTH:
> > > > > > DEBUG 1: DAYS:
> > > > > > DEBUG 1: HOUR:
> > > > > > DEBUG 1: MINU:
> > > > > > DEBUG 1: SECO:
> > > > > > DEBUG 1:
> > > > > > DEBUG 1: Observation variables (9) Name: Description
> > > > > > Types:
> > > > > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > > > > ANOWPM
> > > > > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
> > ANOWPM
> > > > > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN
(OBTAINED FROM
> > > > SCRIPT)
> > > > > > ANOWPM
> > > > > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> > > > ANOWPM
> > > > > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > > > > ANOWPM
> > > > > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> > > > ANOWPM
> > > > > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
> > > ANOWPM
> > > > > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT (PARTICULATE
MATTER
> > > > > DENSITY)
> > > > > > ANOWPM
> > > > > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF FOLLOWING
DATA
> > > > > > ANOWPM
> > > > >
> > > > >
> > > > > Note, that there is no variable named "*COPO*" but there is
one
> > named "
> > > > > *COPOPM*".
> > > > >
> > > > > Changing COPO to COPOPM and removing the -index command line
option
> > and
> > > > > rerunning, pb2nc does now retain obs:
> > > > >
> > > > > > DEBUG 2: Total Messages processed = 24744
> > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > DEBUG 2: Rejected based on zero observations = 2591
> > > > > > DEBUG 2: Total Messages retained = 21769
> > > > > > DEBUG 2: Total observations retained or derived = 21769
> > > > >
> > > > >
> > > > > So, it looks like you need to update the variable to
"COPOPM" in
> your
> > > > > METplus file and hopefully, you will see better results.
Please
> let
> > us
> > > > > know how it goes.
> > > > >
> > > > > Julie
> > > > >
> > > > > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee - NOAA
> Affiliate
> > > via
> > > > > RT <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > > > > >
> > > > > > Thanks Julie for looking into it. I updated metplus
location in
> > Mars.
> > > > > > But I need some help to find why the ERROR in logfile
happening :
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > > > > I have tested valid input files, but not sure why no Obs
retained
> > > after
> > > > > > pb2nc step.
> > > > > >
> > > > > > Partha
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT <
> > > > > met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi Partha.
> > > > > > >
> > > > > > > I see that you are having trouble running pb2nc using
METplus
> on
> > > > WCOSS.
> > > > > > I
> > > > > > > logged on to WCOSS and took a look at
> > > > > > > your
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > > > > file.
> > > > > > >
> > > > > > > First, I see that you are using METplus located
> > > > > > > at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > > > > We are asking users to stop using the installations
> > > > > > > at
> /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
> > > and
> > > > > > > instead use the emc.metplus locations, which can be
found on
> our
> > > > > Existing
> > > > > > > Builds
> > > > > > > <
> > > > >
> > >
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > > > > >
> > > > > > > page
> > > > > > > for our latest release. In this case for WCOSS
(Mars/Venus),
> > you'd
> > > > > want
> > > > > > to
> > > > > > > use the following:
> > > > > > >
> > > > > > > > module use
> > > > > /gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > > > > module load metplus/3.1.1
> > > > > > > >
> > > > > > >
> > > > > > > Next, searching in your log file for "error", I found
many (72)
> > > > > instances
> > > > > > > of the following:
> > > > > > >
> > > > > > > > ERROR :
> > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
messages
> > > retained.
> > > > > > > > Nothing to write.
> > > > > > > > ERROR :
> > > > > > >
> > > > > > >
> > > > > > > Looking up in the file from the first error message I
see the
> > > > > following:
> > > > > > >
> > > > > > > > DEBUG 2: Total Messages processed =
24744
> > > > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > > > DEBUG 2: Rejected based on zero observations =
24360
> > > > > > > > DEBUG 2: Total Messages retained = 0
> > > > > > > > DEBUG 2: Total observations retained or derived = 0
> > > > > > > > DEBUG 1: Obs time between 20201230_010000 and
20201231_000000
> > > > > > > > DEBUG 5: Filtered time:
> > > > > > > >
> > > > > > >
> > > > > > > So, it looks like MET is not finding any observations.
Please
> > > review
> > > > > the
> > > > > > > observation information to see if you can determine why
the
> > > > > observations
> > > > > > > are being rejected. Please let us know how it goes and
let us
> > know
> > > > if
> > > > > > you
> > > > > > > need any assistance.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee -
NOAA
> > > Affiliate
> > > > > via
> > > > > > RT
> > > > > > > <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted
upon.
> > > > > > > > Transaction: Ticket created by
partha.bhattacharjee at noaa.gov
> > > > > > > > Queue: met_help
> > > > > > > > Subject: metplus error
> > > > > > > > Owner: Nobody
> > > > > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > > > > Status: new
> > > > > > > > Ticket <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Hi,
> > > > > > > > I am trying to use METPlus to verify PM2.5 dataset
against
> > > > > observation
> > > > > > > and
> > > > > > > > having some issues. Any help on this is appreciated.
> > > > > > > > Location in wcoss :
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > > > > When I am trying to run it I am seeing the following
problem
> :
> > > > > > > > run-METplus-metplus.PB2NC: ERROR:
(command_builder.py:1032)
> > MET
> > > > > > command
> > > > > > > > returned a non-zero return code: pb2nc -v 7
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > > > > prepufr.aqm.20201230.nc
<http://prepbufr.aqm.20201230.nc/>
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > > > > >
> > > > > > > > Thanks
> > > > > > > > Partha
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik (she/her)
> > > > > > > Software Engineer
> > > > > > > National Center for Atmospheric Research
> > > > > > > Research Applications Laboratory
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > > to
> > > > > > > reply to this email outside of your normal working
hours.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > > I.M. Systems Group
> > > > > > Environmental Modeling Centre
> > > > > > NCWCP
> > > > > > 5830 University Research Court.
> > > > > > College Park, MD 20740
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > Julie Prestopnik (she/her)
> > > > > Software Engineer
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > Email: jpresto at ucar.edu
> > > > >
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > > >
> > > >
> > > > --
> > > > Partha S. Bhattacharjee, Ph.D.
> > > > I.M. Systems Group
> > > > Environmental Modeling Centre
> > > > NCWCP
> > > > 5830 University Research Court.
> > > > College Park, MD 20740
> > > >
> > > >
> > >
> > > --
> > Partha S. Bhattacharjee, Ph.D.
> > I.M. Systems Group
> > Environmental Modeling Centre
> > NCWCP
> > 5830 University Research Court.
> > College Park, MD 20740
> >
> >
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: metplus error
From: John Halley Gotway
Time: Wed Jan 13 08:58:51 2021
Partha,
The answer to your second question is no. The .stat output files
created by
point-stat are in ascii format. There is no NetCDF variant of that,
nor do
we have development plans for doing that.
The series-analysis tool, which compares a time series of gridded
forecasts
to a time series of gridded analysis fields, does write a NetCDF
output
file. It contains fields of statistics which are computed separately
for
each grid point. But that doesn't apply to your data since you're
verifying
against point observations rather than gridded analyses.
I've asked George McCabe to provide some advice on your first
question,
about transitioning over to using the "wrapped" MET config file for
METplus.
Thanks,
John
On Tue, Jan 12, 2021 at 8:35 PM Partha Bhattacharjee - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
> Thanks John for all your help. I made the corrections and was able
to
> generate valid STAT files.
> I have a question about the metplus config file you have mentioned.
I am
> using this file metplus_gefs_pb2nc_pointstat.conf to run both pb2nc
and
> pointstat and using the following command to run
> master_metplus.py -c
>
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1/parm/use_cases/met_tool_wrapper/Example/Example.conf
> -c
>
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/metplus_gefs_pb2nc_pointstat.conf
>
> which uses PB2NCConfig_gefs and PointStatConfig_ANOWPM
> How do I use or point to METplus-wrapped Point-Stat in there ?
>
> 2. Another question about .STAT file generated from this run. Is
there any
> option available to make .stat in netcdf format ?
>
> Thanks
> Partha
>
>
> On Mon, Jan 11, 2021 at 4:44 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Partha,
> >
> > OK, I got matched pairs. Not sure exactly what details to tell you
about.
> > Let me start with the punchline. After setting up a testing area
> > in /gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111, I
had to
> > make 2 changes to your config file: *PointStatConfig_AIRNOW*
> >
> > (1) In the obs dictionary, change...
> > *FROM: { name = "COPOPM"; level = "A0";' }*
> > *TO: { name = "COPOPM"; level = "A1";' }*
> >
> > (2) Change the message type...
> > *FROM: message_type = [ "AIRNOW" ];*
> > *TO: message_type = [ "ANOWPM" ];*
> >
> > Run this to confirm that the message type for these obs is ANOWPM:
> > ncdump -v hdr_typ_table
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > prepbufr.aqm.20210104.nc
> >
> > hdr_typ_table =
> > "ANOWPM" ;
> >
> > And now I get matched pairs:
> >
> > DEBUG 2: Processing PMTF/A0 versus COPOPM/A1, for observation type
> ANOWPM,
> > over region FULL, for interpolation method BILIN(4), using 19192
matched
> > pairs.
> > DEBUG 3: Number of matched pairs = 19192
> > DEBUG 3: Observations processed = 20954
> >
> > Next, all the details...
> >
> > *(1) Copyable METplus environment:*
> >
> > One very useful feature of the METplus log file is being able to
> copy/paste
> > the environment and run command for point-stat. I looked in...
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> >
> > I went to line 13772, like you told us. And then searched
BACKWARDS for
> > "point_stat". Line numbers 11988 and 11989 contain a copyable
environment
> > and run command. So I extracted that content and copied it to:
> >
>
/gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111/run_cmd.sh
> >
> > I had to change a couple of paths due to permissions, but was able
to get
> > this test case to run.
> >
> > *(2) Run Gen-Vx-Mask first instead of using .poly files:*
> >
> > I did notice that it takes several seconds to apply all those
lat/lon
> > polylines to your current vx domain. It'd run much faster if you
ran
> > gen_vx_mask to generate NetCDF files for each of those masking
regions
> > instead.
> >
> > *(3) METplus config file:*
> >
> > I was confused when testing because I was modifying the OBS_FIELD
> > environment variable at the top of run_cmd.sh. But no matter what
I
> > changed, nothing changed in the output. That's when I realized
that your
> > Point-Stat config file is hard-coded! It makes no reference to
> $OBS_FIELD.
> > These types of environment variables are how METplus communicates
with
> the
> > MET tools. If they don't appear in the Point-Stat config file,
then no
> > communication occurs. I'd say you're stuck halfway between using
and not
> > using the METplus wrappers.
> >
> > Here's the standard METplus-wrapped Point-Stat config file:
> > *
> >
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> > <
> >
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> > >*
> >
> > Ideally you would configure ALL of your settings for Point-Stat
via the
> > METplus config file and not touch the Point-Stat config file at
all.
> >
> > Hope that helps clarify.
> >
> > Thanks,
> > John
> >
> >
> > On Mon, Jan 11, 2021 at 2:13 PM Partha Bhattacharjee - NOAA
Affiliate via
> > RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > >
> > > Thanks John. No I am not able to make progress on this. I
checked both
> > > input values, which seems to be valid. But no getting matched
pairs.
> > > Partha
> > >
> > > On Mon, Jan 11, 2021 at 4:03 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Partha,
> > > >
> > > > This is John Halley Gotway. Julie asked me to take a look at
this
> > latest
> > > > issue. Wanted to let you know that I'm logging on this
afternoon to
> > take
> > > a
> > > > closer look. But please let me know if you've made any more
progress.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA
Affiliate
> > via
> > > RT
> > > > <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > > > >
> > > > > Many thanks Julie for pointing out that error. I have fixed
it and
> am
> > > > able
> > > > > to create an obs file with valid values. However, I am
having
> > problems
> > > > > finding the matched pair between forecast and obs file. I
checked
> MET
> > > > that
> > > > > read the model and obs file fine but finding no matched pair
in the
> > > grid.
> > > > > Reference LOG file
> > > > > :
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > > > > line 13772 onward.
> > > > >
> > > > > Any suggestion on this is appreciated
> > > > > Thanks
> > > > > Partha
> > > > >
> > > > > On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT <
> > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Hi Partha.
> > > > > >
> > > > > > I thought it would be a good idea to eliminate the METplus
> > > > infrastructure
> > > > > > and run one case of pb2nc to see if the results were the
same,
> so I
> > > > > created
> > > > > > a run script that just runs the first pb2nc run. It did
produce
> the
> > > > same
> > > > > > results.
> > > > > >
> > > > > > You can take a look at the script if you'd like. It is in
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> > > > > >
> > > > > > The question is... why are we getting 0 observations from
PB2NC.
> > > > Looking
> > > > > in
> > > > > > test_run.sh, we see you are trying to retain only a
variable
> named
> > > > > "COPO":
> > > > > > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> > > > > >
> > > > > > We should check to see what observation variables are
actually
> > > present
> > > > in
> > > > > > this file. We can do that by running pb2nc with the "-
index"
> > command
> > > > line
> > > > > > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's
the log
> > > > messages
> > > > > > that produces:
> > > > > >
> > > > > > > DEBUG 1: Header variables (8) :
> > > > > > > DEBUG 1: XOB: LONGITUDE
> > > > > > > DEBUG 1: YOB: LATITUDE
> > > > > > > DEBUG 1: YEAR:
> > > > > > > DEBUG 1: MNTH:
> > > > > > > DEBUG 1: DAYS:
> > > > > > > DEBUG 1: HOUR:
> > > > > > > DEBUG 1: MINU:
> > > > > > > DEBUG 1: SECO:
> > > > > > > DEBUG 1:
> > > > > > > DEBUG 1: Observation variables (9) Name: Description
> > > > > > > Types:
> > > > > > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > > > > > ANOWPM
> > > > > > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
> > > ANOWPM
> > > > > > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN
(OBTAINED
> FROM
> > > > > SCRIPT)
> > > > > > > ANOWPM
> > > > > > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> > > > > ANOWPM
> > > > > > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > > > > > ANOWPM
> > > > > > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> > > > > ANOWPM
> > > > > > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
> > > > ANOWPM
> > > > > > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT
(PARTICULATE
> MATTER
> > > > > > DENSITY)
> > > > > > > ANOWPM
> > > > > > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF
FOLLOWING DATA
> > > > > > > ANOWPM
> > > > > >
> > > > > >
> > > > > > Note, that there is no variable named "*COPO*" but there
is one
> > > named "
> > > > > > *COPOPM*".
> > > > > >
> > > > > > Changing COPO to COPOPM and removing the -index command
line
> option
> > > and
> > > > > > rerunning, pb2nc does now retain obs:
> > > > > >
> > > > > > > DEBUG 2: Total Messages processed = 24744
> > > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > > DEBUG 2: Rejected based on zero observations = 2591
> > > > > > > DEBUG 2: Total Messages retained = 21769
> > > > > > > DEBUG 2: Total observations retained or derived = 21769
> > > > > >
> > > > > >
> > > > > > So, it looks like you need to update the variable to
"COPOPM" in
> > your
> > > > > > METplus file and hopefully, you will see better results.
Please
> > let
> > > us
> > > > > > know how it goes.
> > > > > >
> > > > > > Julie
> > > > > >
> > > > > > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee -
NOAA
> > Affiliate
> > > > via
> > > > > > RT <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> >
> > > > > > >
> > > > > > > Thanks Julie for looking into it. I updated metplus
location in
> > > Mars.
> > > > > > > But I need some help to find why the ERROR in logfile
> happening :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > > > > > I have tested valid input files, but not sure why no Obs
> retained
> > > > after
> > > > > > > pb2nc step.
> > > > > > >
> > > > > > > Partha
> > > > > > >
> > > > > > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT <
> > > > > > met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi Partha.
> > > > > > > >
> > > > > > > > I see that you are having trouble running pb2nc using
METplus
> > on
> > > > > WCOSS.
> > > > > > > I
> > > > > > > > logged on to WCOSS and took a look at
> > > > > > > > your
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > > > > > file.
> > > > > > > >
> > > > > > > > First, I see that you are using METplus located
> > > > > > > > at
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > > > > > We are asking users to stop using the installations
> > > > > > > > at
> > /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
> > > > and
> > > > > > > > instead use the emc.metplus locations, which can be
found on
> > our
> > > > > > Existing
> > > > > > > > Builds
> > > > > > > > <
> > > > > >
> > > >
> > https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > > > > > >
> > > > > > > > page
> > > > > > > > for our latest release. In this case for WCOSS
(Mars/Venus),
> > > you'd
> > > > > > want
> > > > > > > to
> > > > > > > > use the following:
> > > > > > > >
> > > > > > > > > module use
> > > > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > > > > > module load metplus/3.1.1
> > > > > > > > >
> > > > > > > >
> > > > > > > > Next, searching in your log file for "error", I found
many
> (72)
> > > > > > instances
> > > > > > > > of the following:
> > > > > > > >
> > > > > > > > > ERROR :
> > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
messages
> > > > retained.
> > > > > > > > > Nothing to write.
> > > > > > > > > ERROR :
> > > > > > > >
> > > > > > > >
> > > > > > > > Looking up in the file from the first error message I
see the
> > > > > > following:
> > > > > > > >
> > > > > > > > > DEBUG 2: Total Messages processed =
24744
> > > > > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > > > > DEBUG 2: Rejected based on masking grid =
384
> > > > > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > > > > DEBUG 2: Rejected based on zero observations =
24360
> > > > > > > > > DEBUG 2: Total Messages retained = 0
> > > > > > > > > DEBUG 2: Total observations retained or derived = 0
> > > > > > > > > DEBUG 1: Obs time between 20201230_010000 and
> 20201231_000000
> > > > > > > > > DEBUG 5: Filtered time:
> > > > > > > > >
> > > > > > > >
> > > > > > > > So, it looks like MET is not finding any observations.
> Please
> > > > review
> > > > > > the
> > > > > > > > observation information to see if you can determine
why the
> > > > > > observations
> > > > > > > > are being rejected. Please let us know how it goes
and let
> us
> > > know
> > > > > if
> > > > > > > you
> > > > > > > > need any assistance.
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee -
NOAA
> > > > Affiliate
> > > > > > via
> > > > > > > RT
> > > > > > > > <met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted
upon.
> > > > > > > > > Transaction: Ticket created by
> partha.bhattacharjee at noaa.gov
> > > > > > > > > Queue: met_help
> > > > > > > > > Subject: metplus error
> > > > > > > > > Owner: Nobody
> > > > > > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > > > > > Status: new
> > > > > > > > > Ticket <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > > I am trying to use METPlus to verify PM2.5 dataset
against
> > > > > > observation
> > > > > > > > and
> > > > > > > > > having some issues. Any help on this is appreciated.
> > > > > > > > > Location in wcoss :
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > > > > > When I am trying to run it I am seeing the following
> problem
> > :
> > > > > > > > > run-METplus-metplus.PB2NC: ERROR:
> (command_builder.py:1032)
> > > MET
> > > > > > > command
> > > > > > > > > returned a non-zero return code: pb2nc -v 7
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > > > > > prepufr.aqm.20201230.nc
<http://prepbufr.aqm.20201230.nc/>
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > > > > > >
> > > > > > > > > Thanks
> > > > > > > > > Partha
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik (she/her)
> > > > > > > > Software Engineer
> > > > > > > > National Center for Atmospheric Research
> > > > > > > > Research Applications Laboratory
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > My working day may not be your working day. Please do
not
> feel
> > > > > obliged
> > > > > > > to
> > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > > > I.M. Systems Group
> > > > > > > Environmental Modeling Centre
> > > > > > > NCWCP
> > > > > > > 5830 University Research Court.
> > > > > > > College Park, MD 20740
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > Julie Prestopnik (she/her)
> > > > > > Software Engineer
> > > > > > National Center for Atmospheric Research
> > > > > > Research Applications Laboratory
> > > > > > Email: jpresto at ucar.edu
> > > > > >
> > > > > > My working day may not be your working day. Please do not
feel
> > > obliged
> > > > > to
> > > > > > reply to this email outside of your normal working hours.
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > I.M. Systems Group
> > > > > Environmental Modeling Centre
> > > > > NCWCP
> > > > > 5830 University Research Court.
> > > > > College Park, MD 20740
> > > > >
> > > > >
> > > >
> > > > --
> > > Partha S. Bhattacharjee, Ph.D.
> > > I.M. Systems Group
> > > Environmental Modeling Centre
> > > NCWCP
> > > 5830 University Research Court.
> > > College Park, MD 20740
> > >
> > >
> >
> >
>
> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
------------------------------------------------
Subject: metplus error
From: Partha Bhattacharjee - NOAA Affiliate
Time: Wed Jan 13 09:00:17 2021
Thanks John.
Partha
On Wed, Jan 13, 2021 at 10:58 AM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Partha,
>
> The answer to your second question is no. The .stat output files
created by
> point-stat are in ascii format. There is no NetCDF variant of that,
nor do
> we have development plans for doing that.
>
> The series-analysis tool, which compares a time series of gridded
forecasts
> to a time series of gridded analysis fields, does write a NetCDF
output
> file. It contains fields of statistics which are computed separately
for
> each grid point. But that doesn't apply to your data since you're
verifying
> against point observations rather than gridded analyses.
>
> I've asked George McCabe to provide some advice on your first
question,
> about transitioning over to using the "wrapped" MET config file for
> METplus.
>
> Thanks,
> John
>
> On Tue, Jan 12, 2021 at 8:35 PM Partha Bhattacharjee - NOAA
Affiliate via
> RT <met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> >
> > Thanks John for all your help. I made the corrections and was able
to
> > generate valid STAT files.
> > I have a question about the metplus config file you have
mentioned. I am
> > using this file metplus_gefs_pb2nc_pointstat.conf to run both
pb2nc and
> > pointstat and using the following command to run
> > master_metplus.py -c
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1/parm/use_cases/met_tool_wrapper/Example/Example.conf
> > -c
> >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/metplus_gefs_pb2nc_pointstat.conf
> >
> > which uses PB2NCConfig_gefs and PointStatConfig_ANOWPM
> > How do I use or point to METplus-wrapped Point-Stat in there ?
> >
> > 2. Another question about .STAT file generated from this run. Is
there
> any
> > option available to make .stat in netcdf format ?
> >
> > Thanks
> > Partha
> >
> >
> > On Mon, Jan 11, 2021 at 4:44 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Partha,
> > >
> > > OK, I got matched pairs. Not sure exactly what details to tell
you
> about.
> > > Let me start with the punchline. After setting up a testing area
> > > in /gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111,
I had
> to
> > > make 2 changes to your config file: *PointStatConfig_AIRNOW*
> > >
> > > (1) In the obs dictionary, change...
> > > *FROM: { name = "COPOPM"; level = "A0";' }*
> > > *TO: { name = "COPOPM"; level = "A1";' }*
> > >
> > > (2) Change the message type...
> > > *FROM: message_type = [ "AIRNOW" ];*
> > > *TO: message_type = [ "ANOWPM" ];*
> > >
> > > Run this to confirm that the message type for these obs is
ANOWPM:
> > > ncdump -v hdr_typ_table
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > prepbufr.aqm.20210104.nc
> > >
> > > hdr_typ_table =
> > > "ANOWPM" ;
> > >
> > > And now I get matched pairs:
> > >
> > > DEBUG 2: Processing PMTF/A0 versus COPOPM/A1, for observation
type
> > ANOWPM,
> > > over region FULL, for interpolation method BILIN(4), using 19192
> matched
> > > pairs.
> > > DEBUG 3: Number of matched pairs = 19192
> > > DEBUG 3: Observations processed = 20954
> > >
> > > Next, all the details...
> > >
> > > *(1) Copyable METplus environment:*
> > >
> > > One very useful feature of the METplus log file is being able to
> > copy/paste
> > > the environment and run command for point-stat. I looked in...
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > >
> > > I went to line 13772, like you told us. And then searched
BACKWARDS for
> > > "point_stat". Line numbers 11988 and 11989 contain a copyable
> environment
> > > and run command. So I extracted that content and copied it to:
> > >
> >
/gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111/run_cmd.sh
> > >
> > > I had to change a couple of paths due to permissions, but was
able to
> get
> > > this test case to run.
> > >
> > > *(2) Run Gen-Vx-Mask first instead of using .poly files:*
> > >
> > > I did notice that it takes several seconds to apply all those
lat/lon
> > > polylines to your current vx domain. It'd run much faster if you
ran
> > > gen_vx_mask to generate NetCDF files for each of those masking
regions
> > > instead.
> > >
> > > *(3) METplus config file:*
> > >
> > > I was confused when testing because I was modifying the
OBS_FIELD
> > > environment variable at the top of run_cmd.sh. But no matter
what I
> > > changed, nothing changed in the output. That's when I realized
that
> your
> > > Point-Stat config file is hard-coded! It makes no reference to
> > $OBS_FIELD.
> > > These types of environment variables are how METplus
communicates with
> > the
> > > MET tools. If they don't appear in the Point-Stat config file,
then no
> > > communication occurs. I'd say you're stuck halfway between using
and
> not
> > > using the METplus wrappers.
> > >
> > > Here's the standard METplus-wrapped Point-Stat config file:
> > > *
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> > > <
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> > > >*
> > >
> > > Ideally you would configure ALL of your settings for Point-Stat
via the
> > > METplus config file and not touch the Point-Stat config file at
all.
> > >
> > > Hope that helps clarify.
> > >
> > > Thanks,
> > > John
> > >
> > >
> > > On Mon, Jan 11, 2021 at 2:13 PM Partha Bhattacharjee - NOAA
Affiliate
> via
> > > RT <met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
>
> > > >
> > > > Thanks John. No I am not able to make progress on this. I
checked
> both
> > > > input values, which seems to be valid. But no getting matched
pairs.
> > > > Partha
> > > >
> > > > On Mon, Jan 11, 2021 at 4:03 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Partha,
> > > > >
> > > > > This is John Halley Gotway. Julie asked me to take a look at
this
> > > latest
> > > > > issue. Wanted to let you know that I'm logging on this
afternoon to
> > > take
> > > > a
> > > > > closer look. But please let me know if you've made any more
> progress.
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA
> Affiliate
> > > via
> > > > RT
> > > > > <met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > > > > >
> > > > > > Many thanks Julie for pointing out that error. I have
fixed it
> and
> > am
> > > > > able
> > > > > > to create an obs file with valid values. However, I am
having
> > > problems
> > > > > > finding the matched pair between forecast and obs file. I
checked
> > MET
> > > > > that
> > > > > > read the model and obs file fine but finding no matched
pair in
> the
> > > > grid.
> > > > > > Reference LOG file
> > > > > > :
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > > > > > line 13772 onward.
> > > > > >
> > > > > > Any suggestion on this is appreciated
> > > > > > Thanks
> > > > > > Partha
> > > > > >
> > > > > > On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT <
> > > > > met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Hi Partha.
> > > > > > >
> > > > > > > I thought it would be a good idea to eliminate the
METplus
> > > > > infrastructure
> > > > > > > and run one case of pb2nc to see if the results were the
same,
> > so I
> > > > > > created
> > > > > > > a run script that just runs the first pb2nc run. It did
produce
> > the
> > > > > same
> > > > > > > results.
> > > > > > >
> > > > > > > You can take a look at the script if you'd like. It is
in
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> > > > > > >
> > > > > > > The question is... why are we getting 0 observations
from
> PB2NC.
> > > > > Looking
> > > > > > in
> > > > > > > test_run.sh, we see you are trying to retain only a
variable
> > named
> > > > > > "COPO":
> > > > > > > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> > > > > > >
> > > > > > > We should check to see what observation variables are
actually
> > > > present
> > > > > in
> > > > > > > this file. We can do that by running pb2nc with the "-
index"
> > > command
> > > > > line
> > > > > > > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index). Here's
the log
> > > > > messages
> > > > > > > that produces:
> > > > > > >
> > > > > > > > DEBUG 1: Header variables (8) :
> > > > > > > > DEBUG 1: XOB: LONGITUDE
> > > > > > > > DEBUG 1: YOB: LATITUDE
> > > > > > > > DEBUG 1: YEAR:
> > > > > > > > DEBUG 1: MNTH:
> > > > > > > > DEBUG 1: DAYS:
> > > > > > > > DEBUG 1: HOUR:
> > > > > > > > DEBUG 1: MINU:
> > > > > > > > DEBUG 1: SECO:
> > > > > > > > DEBUG 1:
> > > > > > > > DEBUG 1: Observation variables (9) Name:
Description
> > > > > > > > Types:
> > > > > > > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > > > > > > ANOWPM
> > > > > > > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
> > > > ANOWPM
> > > > > > > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN
(OBTAINED
> > FROM
> > > > > > SCRIPT)
> > > > > > > > ANOWPM
> > > > > > > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> > > > > > ANOWPM
> > > > > > > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > > > > > > ANOWPM
> > > > > > > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> > > > > > ANOWPM
> > > > > > > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
> > > > > ANOWPM
> > > > > > > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT
(PARTICULATE
> > MATTER
> > > > > > > DENSITY)
> > > > > > > > ANOWPM
> > > > > > > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF
FOLLOWING
> DATA
> > > > > > > > ANOWPM
> > > > > > >
> > > > > > >
> > > > > > > Note, that there is no variable named "*COPO*" but there
is one
> > > > named "
> > > > > > > *COPOPM*".
> > > > > > >
> > > > > > > Changing COPO to COPOPM and removing the -index command
line
> > option
> > > > and
> > > > > > > rerunning, pb2nc does now retain obs:
> > > > > > >
> > > > > > > > DEBUG 2: Total Messages processed = 24744
> > > > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > > > DEBUG 2: Rejected based on zero observations = 2591
> > > > > > > > DEBUG 2: Total Messages retained = 21769
> > > > > > > > DEBUG 2: Total observations retained or derived =
21769
> > > > > > >
> > > > > > >
> > > > > > > So, it looks like you need to update the variable to
"COPOPM"
> in
> > > your
> > > > > > > METplus file and hopefully, you will see better results.
> Please
> > > let
> > > > us
> > > > > > > know how it goes.
> > > > > > >
> > > > > > > Julie
> > > > > > >
> > > > > > > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee -
NOAA
> > > Affiliate
> > > > > via
> > > > > > > RT <met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > > >
> > > > > > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > >
> > > > > > > >
> > > > > > > > Thanks Julie for looking into it. I updated metplus
location
> in
> > > > Mars.
> > > > > > > > But I need some help to find why the ERROR in logfile
> > happening :
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > > > > > > I have tested valid input files, but not sure why no
Obs
> > retained
> > > > > after
> > > > > > > > pb2nc step.
> > > > > > > >
> > > > > > > > Partha
> > > > > > > >
> > > > > > > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via RT
<
> > > > > > > met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi Partha.
> > > > > > > > >
> > > > > > > > > I see that you are having trouble running pb2nc
using
> METplus
> > > on
> > > > > > WCOSS.
> > > > > > > > I
> > > > > > > > > logged on to WCOSS and took a look at
> > > > > > > > > your
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > > > > > > file.
> > > > > > > > >
> > > > > > > > > First, I see that you are using METplus located
> > > > > > > > > at
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > > > > > > We are asking users to stop using the installations
> > > > > > > > > at
> > > /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
> > > > > and
> > > > > > > > > instead use the emc.metplus locations, which can be
found
> on
> > > our
> > > > > > > Existing
> > > > > > > > > Builds
> > > > > > > > > <
> > > > > > >
> > > > >
> > >
> https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > > > > > > >
> > > > > > > > > page
> > > > > > > > > for our latest release. In this case for WCOSS
> (Mars/Venus),
> > > > you'd
> > > > > > > want
> > > > > > > > to
> > > > > > > > > use the following:
> > > > > > > > >
> > > > > > > > > > module use
> > > > > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > > > > > > module load metplus/3.1.1
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > Next, searching in your log file for "error", I
found many
> > (72)
> > > > > > > instances
> > > > > > > > > of the following:
> > > > > > > > >
> > > > > > > > > > ERROR :
> > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
messages
> > > > > retained.
> > > > > > > > > > Nothing to write.
> > > > > > > > > > ERROR :
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Looking up in the file from the first error message
I see
> the
> > > > > > > following:
> > > > > > > > >
> > > > > > > > > > DEBUG 2: Total Messages processed =
24744
> > > > > > > > > > DEBUG 2: Rejected based on message type =
0
> > > > > > > > > > DEBUG 2: Rejected based on station id =
0
> > > > > > > > > > DEBUG 2: Rejected based on valid time =
0
> > > > > > > > > > DEBUG 2: Rejected based on masking grid =
384
> > > > > > > > > > DEBUG 2: Rejected based on masking polygon =
0
> > > > > > > > > > DEBUG 2: Rejected based on elevation =
0
> > > > > > > > > > DEBUG 2: Rejected based on pb report type =
0
> > > > > > > > > > DEBUG 2: Rejected based on input report type =
0
> > > > > > > > > > DEBUG 2: Rejected based on instrument type =
0
> > > > > > > > > > DEBUG 2: Rejected based on zero observations =
24360
> > > > > > > > > > DEBUG 2: Total Messages retained =
0
> > > > > > > > > > DEBUG 2: Total observations retained or derived =
0
> > > > > > > > > > DEBUG 1: Obs time between 20201230_010000 and
> > 20201231_000000
> > > > > > > > > > DEBUG 5: Filtered time:
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > So, it looks like MET is not finding any
observations.
> > Please
> > > > > review
> > > > > > > the
> > > > > > > > > observation information to see if you can determine
why the
> > > > > > > observations
> > > > > > > > > are being rejected. Please let us know how it goes
and let
> > us
> > > > know
> > > > > > if
> > > > > > > > you
> > > > > > > > > need any assistance.
> > > > > > > > >
> > > > > > > > > Julie
> > > > > > > > >
> > > > > > > > > On Tue, Jan 5, 2021 at 2:32 PM Partha Bhattacharjee
- NOAA
> > > > > Affiliate
> > > > > > > via
> > > > > > > > RT
> > > > > > > > > <met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Tue Jan 05 14:32:25 2021: Request 98122 was acted
upon.
> > > > > > > > > > Transaction: Ticket created by
> > partha.bhattacharjee at noaa.gov
> > > > > > > > > > Queue: met_help
> > > > > > > > > > Subject: metplus error
> > > > > > > > > > Owner: Nobody
> > > > > > > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > > > > > > Status: new
> > > > > > > > > > Ticket <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > > I am trying to use METPlus to verify PM2.5 dataset
> against
> > > > > > > observation
> > > > > > > > > and
> > > > > > > > > > having some issues. Any help on this is
appreciated.
> > > > > > > > > > Location in wcoss :
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > > > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > > > > > > When I am trying to run it I am seeing the
following
> > problem
> > > :
> > > > > > > > > > run-METplus-metplus.PB2NC: ERROR:
> > (command_builder.py:1032)
> > > > MET
> > > > > > > > command
> > > > > > > > > > returned a non-zero return code: pb2nc -v 7
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > > > > > > prepufr.aqm.20201230.nc <
> http://prepbufr.aqm.20201230.nc/>
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > > > > > > >
> > > > > > > > > > Thanks
> > > > > > > > > > Partha
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Julie Prestopnik (she/her)
> > > > > > > > > Software Engineer
> > > > > > > > > National Center for Atmospheric Research
> > > > > > > > > Research Applications Laboratory
> > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > >
> > > > > > > > > My working day may not be your working day. Please
do not
> > feel
> > > > > > obliged
> > > > > > > > to
> > > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > > > > I.M. Systems Group
> > > > > > > > Environmental Modeling Centre
> > > > > > > > NCWCP
> > > > > > > > 5830 University Research Court.
> > > > > > > > College Park, MD 20740
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Julie Prestopnik (she/her)
> > > > > > > Software Engineer
> > > > > > > National Center for Atmospheric Research
> > > > > > > Research Applications Laboratory
> > > > > > > Email: jpresto at ucar.edu
> > > > > > >
> > > > > > > My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > > to
> > > > > > > reply to this email outside of your normal working
hours.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > > I.M. Systems Group
> > > > > > Environmental Modeling Centre
> > > > > > NCWCP
> > > > > > 5830 University Research Court.
> > > > > > College Park, MD 20740
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > Partha S. Bhattacharjee, Ph.D.
> > > > I.M. Systems Group
> > > > Environmental Modeling Centre
> > > > NCWCP
> > > > 5830 University Research Court.
> > > > College Park, MD 20740
> > > >
> > > >
> > >
> > >
> >
> > --
> > Partha S. Bhattacharjee, Ph.D.
> > I.M. Systems Group
> > Environmental Modeling Centre
> > NCWCP
> > 5830 University Research Court.
> > College Park, MD 20740
> >
> >
>
>
--
Partha S. Bhattacharjee, Ph.D.
I.M. Systems Group
Environmental Modeling Centre
NCWCP
5830 University Research Court.
College Park, MD 20740
------------------------------------------------
Subject: metplus error
From: George McCabe
Time: Wed Jan 13 10:58:26 2021
Hi Partha,
I see you are trying to transition to using the wrapped MET config
file for
METplus. Here is the section of the documentation that shows the
content of
the default wrapped PointStat config file:
https://dtcenter.github.io/METplus/latest/generated/met_tool_wrapper/PointStat/PointStat.html#met-
configuration
The file is found in the METplus repository here:
parm/met_config/PointStatConfig_wrapped
I would start by running diff to compare this file to your PointStat
config
file to see what differs between them.
Any values that are set in your file that are set using an environment
variable in the wrapped file can be set in the METplus config file
instead.
There is a list of the environment variables and the corresponding
METplus
config variables at the end of this section in the User's Guide.
For example, if your file has:
*output_prefix = "my_prefix";*
and the wrapped file has:
*output_prefix = "${OUTPUT_PREFIX}";*
Then in your METplus config file, set:
*POINT_STAT_OUTPUT_PREFIX = my_prefix*
If all of the differences are controlled by environment variables in
the
wrapped file, then you can use that file as your config file. In this
case,
in your METplus config file, set:
*POINT_STAT_CONFIG_FILE
={PARM_BASE}/met_config/PointStatConfig_wrapped*
If there are any values that differ from the default values that are
not
set using environment variables, then you will have to copy the
wrapped
file into your working area, then modify the values to match your
config
file. You will also have to set POINT_STAT_CONFIG_FILE to the location
of
this new file in your METplus config. If this is the case, then please
let
me know which settings were not supported through METplus so that we
can
make a note to add support in the next release.
Please feel free to let me know if you have any other questions or
issues
getting this set up and I can take a closer look with you.
Thanks,
George
On Wed, Jan 13, 2021 at 9:00 AM Partha Bhattacharjee - NOAA Affiliate
via
RT <met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
>
> Thanks John.
>
> Partha
>
> On Wed, Jan 13, 2021 at 10:58 AM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Partha,
> >
> > The answer to your second question is no. The .stat output files
created
> by
> > point-stat are in ascii format. There is no NetCDF variant of
that, nor
> do
> > we have development plans for doing that.
> >
> > The series-analysis tool, which compares a time series of gridded
> forecasts
> > to a time series of gridded analysis fields, does write a NetCDF
output
> > file. It contains fields of statistics which are computed
separately for
> > each grid point. But that doesn't apply to your data since you're
> verifying
> > against point observations rather than gridded analyses.
> >
> > I've asked George McCabe to provide some advice on your first
question,
> > about transitioning over to using the "wrapped" MET config file
for
> > METplus.
> >
> > Thanks,
> > John
> >
> > On Tue, Jan 12, 2021 at 8:35 PM Partha Bhattacharjee - NOAA
Affiliate via
> > RT <met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > >
> > > Thanks John for all your help. I made the corrections and was
able to
> > > generate valid STAT files.
> > > I have a question about the metplus config file you have
mentioned. I
> am
> > > using this file metplus_gefs_pb2nc_pointstat.conf to run both
pb2nc and
> > > pointstat and using the following command to run
> > > master_metplus.py -c
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1/parm/use_cases/met_tool_wrapper/Example/Example.conf
> > > -c
> > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/metplus_gefs_pb2nc_pointstat.conf
> > >
> > > which uses PB2NCConfig_gefs and PointStatConfig_ANOWPM
> > > How do I use or point to METplus-wrapped Point-Stat in there ?
> > >
> > > 2. Another question about .STAT file generated from this run. Is
there
> > any
> > > option available to make .stat in netcdf format ?
> > >
> > > Thanks
> > > Partha
> > >
> > >
> > > On Mon, Jan 11, 2021 at 4:44 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Partha,
> > > >
> > > > OK, I got matched pairs. Not sure exactly what details to tell
you
> > about.
> > > > Let me start with the punchline. After setting up a testing
area
> > > > in
/gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111, I
> had
> > to
> > > > make 2 changes to your config file: *PointStatConfig_AIRNOW*
> > > >
> > > > (1) In the obs dictionary, change...
> > > > *FROM: { name = "COPOPM"; level = "A0";' }*
> > > > *TO: { name = "COPOPM"; level = "A1";' }*
> > > >
> > > > (2) Change the message type...
> > > > *FROM: message_type = [ "AIRNOW" ];*
> > > > *TO: message_type = [ "ANOWPM" ];*
> > > >
> > > > Run this to confirm that the message type for these obs is
ANOWPM:
> > > > ncdump -v hdr_typ_table
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > prepbufr.aqm.20210104.nc
> > > >
> > > > hdr_typ_table =
> > > > "ANOWPM" ;
> > > >
> > > > And now I get matched pairs:
> > > >
> > > > DEBUG 2: Processing PMTF/A0 versus COPOPM/A1, for observation
type
> > > ANOWPM,
> > > > over region FULL, for interpolation method BILIN(4), using
19192
> > matched
> > > > pairs.
> > > > DEBUG 3: Number of matched pairs = 19192
> > > > DEBUG 3: Observations processed = 20954
> > > >
> > > > Next, all the details...
> > > >
> > > > *(1) Copyable METplus environment:*
> > > >
> > > > One very useful feature of the METplus log file is being able
to
> > > copy/paste
> > > > the environment and run command for point-stat. I looked in...
> > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > > >
> > > > I went to line 13772, like you told us. And then searched
BACKWARDS
> for
> > > > "point_stat". Line numbers 11988 and 11989 contain a copyable
> > environment
> > > > and run command. So I extracted that content and copied it to:
> > > >
> > >
/gpfs/dell2/ptmp/John.H.Gotway/MET_Help/partha_data_20210111/run_cmd.sh
> > > >
> > > > I had to change a couple of paths due to permissions, but was
able to
> > get
> > > > this test case to run.
> > > >
> > > > *(2) Run Gen-Vx-Mask first instead of using .poly files:*
> > > >
> > > > I did notice that it takes several seconds to apply all those
lat/lon
> > > > polylines to your current vx domain. It'd run much faster if
you ran
> > > > gen_vx_mask to generate NetCDF files for each of those masking
> regions
> > > > instead.
> > > >
> > > > *(3) METplus config file:*
> > > >
> > > > I was confused when testing because I was modifying the
OBS_FIELD
> > > > environment variable at the top of run_cmd.sh. But no matter
what I
> > > > changed, nothing changed in the output. That's when I realized
that
> > your
> > > > Point-Stat config file is hard-coded! It makes no reference to
> > > $OBS_FIELD.
> > > > These types of environment variables are how METplus
communicates
> with
> > > the
> > > > MET tools. If they don't appear in the Point-Stat config file,
then
> no
> > > > communication occurs. I'd say you're stuck halfway between
using and
> > not
> > > > using the METplus wrappers.
> > > >
> > > > Here's the standard METplus-wrapped Point-Stat config file:
> > > > *
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> > > > <
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v3.1/parm/met_config/PointStatConfig_wrapped
> > > > >*
> > > >
> > > > Ideally you would configure ALL of your settings for Point-
Stat via
> the
> > > > METplus config file and not touch the Point-Stat config file
at all.
> > > >
> > > > Hope that helps clarify.
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > >
> > > > On Mon, Jan 11, 2021 at 2:13 PM Partha Bhattacharjee - NOAA
Affiliate
> > via
> > > > RT <met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122 >
> > > > >
> > > > > Thanks John. No I am not able to make progress on this. I
checked
> > both
> > > > > input values, which seems to be valid. But no getting
matched
> pairs.
> > > > > Partha
> > > > >
> > > > > On Mon, Jan 11, 2021 at 4:03 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Hi Partha,
> > > > > >
> > > > > > This is John Halley Gotway. Julie asked me to take a look
at this
> > > > latest
> > > > > > issue. Wanted to let you know that I'm logging on this
afternoon
> to
> > > > take
> > > > > a
> > > > > > closer look. But please let me know if you've made any
more
> > progress.
> > > > > >
> > > > > > Thanks,
> > > > > > John
> > > > > >
> > > > > > On Fri, Jan 8, 2021 at 3:03 PM Partha Bhattacharjee - NOAA
> > Affiliate
> > > > via
> > > > > RT
> > > > > > <met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> >
> > > > > > >
> > > > > > > Many thanks Julie for pointing out that error. I have
fixed it
> > and
> > > am
> > > > > > able
> > > > > > > to create an obs file with valid values. However, I am
having
> > > > problems
> > > > > > > finding the matched pair between forecast and obs file.
I
> checked
> > > MET
> > > > > > that
> > > > > > > read the model and obs file fine but finding no matched
pair in
> > the
> > > > > grid.
> > > > > > > Reference LOG file
> > > > > > > :
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20210420060831
> > > > > > > line 13772 onward.
> > > > > > >
> > > > > > > Any suggestion on this is appreciated
> > > > > > > Thanks
> > > > > > > Partha
> > > > > > >
> > > > > > > On Wed, Jan 6, 2021 at 1:15 PM Julie Prestopnik via RT <
> > > > > > met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi Partha.
> > > > > > > >
> > > > > > > > I thought it would be a good idea to eliminate the
METplus
> > > > > > infrastructure
> > > > > > > > and run one case of pb2nc to see if the results were
the
> same,
> > > so I
> > > > > > > created
> > > > > > > > a run script that just runs the first pb2nc run. It
did
> produce
> > > the
> > > > > > same
> > > > > > > > results.
> > > > > > > >
> > > > > > > > You can take a look at the script if you'd like. It
is in
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/met_help/partha_20210105/test_run.sh.
> > > > > > > >
> > > > > > > > The question is... why are we getting 0 observations
from
> > PB2NC.
> > > > > > Looking
> > > > > > > in
> > > > > > > > test_run.sh, we see you are trying to retain only a
variable
> > > named
> > > > > > > "COPO":
> > > > > > > > *export OBS_BUFR_VAR_LIST="[\"COPO\"]";*
> > > > > > > >
> > > > > > > > We should check to see what observation variables are
> actually
> > > > > present
> > > > > > in
> > > > > > > > this file. We can do that by running pb2nc with the "-
index"
> > > > command
> > > > > > line
> > > > > > > > option (pb2nc aqm.t12z.anowpm.pb.tm024 -index).
Here's the
> log
> > > > > > messages
> > > > > > > > that produces:
> > > > > > > >
> > > > > > > > > DEBUG 1: Header variables (8) :
> > > > > > > > > DEBUG 1: XOB: LONGITUDE
> > > > > > > > > DEBUG 1: YOB: LATITUDE
> > > > > > > > > DEBUG 1: YEAR:
> > > > > > > > > DEBUG 1: MNTH:
> > > > > > > > > DEBUG 1: DAYS:
> > > > > > > > > DEBUG 1: HOUR:
> > > > > > > > > DEBUG 1: MINU:
> > > > > > > > > DEBUG 1: SECO:
> > > > > > > > > DEBUG 1:
> > > > > > > > > DEBUG 1: Observation variables (9) Name:
Description
> > > > > > > > > Types:
> > > > > > > > > DEBUG 1: TYPO: TYPE OF POLLUTANT
> > > > > > > > > ANOWPM
> > > > > > > > > DEBUG 1: CAT: PREPBUFR DATA LEVEL CATEGORY
> > > > > ANOWPM
> > > > > > > > > DEBUG 1: PROCN: PROCESS NUMBER FOR THIS MPI RUN
> (OBTAINED
> > > FROM
> > > > > > > SCRIPT)
> > > > > > > > > ANOWPM
> > > > > > > > > DEBUG 1: SQN: REPORT SEQUENCE NUMBER
> > > > > > > ANOWPM
> > > > > > > > > DEBUG 1: TSIG: TIME SIGNIFICANCE
> > > > > > > > > ANOWPM
> > > > > > > > > DEBUG 1: RPT: REPORTED OBSERVATION TIME
> > > > > > > ANOWPM
> > > > > > > > > DEBUG 1: TPHR: TIME PERIOD OR DISPLACEMENT
> > > > > > ANOWPM
> > > > > > > > > DEBUG 1: COPOPM: CONCENTRATION OF POLLUTANT
(PARTICULATE
> > > MATTER
> > > > > > > > DENSITY)
> > > > > > > > > ANOWPM
> > > > > > > > > DEBUG 1: QCIND: QUALITY CONTROL INDICATION OF
FOLLOWING
> > DATA
> > > > > > > > > ANOWPM
> > > > > > > >
> > > > > > > >
> > > > > > > > Note, that there is no variable named "*COPO*" but
there is
> one
> > > > > named "
> > > > > > > > *COPOPM*".
> > > > > > > >
> > > > > > > > Changing COPO to COPOPM and removing the -index
command line
> > > option
> > > > > and
> > > > > > > > rerunning, pb2nc does now retain obs:
> > > > > > > >
> > > > > > > > > DEBUG 2: Total Messages processed = 24744
> > > > > > > > > DEBUG 2: Rejected based on message type = 0
> > > > > > > > > DEBUG 2: Rejected based on station id = 0
> > > > > > > > > DEBUG 2: Rejected based on valid time = 0
> > > > > > > > > DEBUG 2: Rejected based on masking grid = 384
> > > > > > > > > DEBUG 2: Rejected based on masking polygon = 0
> > > > > > > > > DEBUG 2: Rejected based on elevation = 0
> > > > > > > > > DEBUG 2: Rejected based on pb report type = 0
> > > > > > > > > DEBUG 2: Rejected based on input report type = 0
> > > > > > > > > DEBUG 2: Rejected based on instrument type = 0
> > > > > > > > > DEBUG 2: Rejected based on zero observations = 2591
> > > > > > > > > DEBUG 2: Total Messages retained = 21769
> > > > > > > > > DEBUG 2: Total observations retained or derived =
21769
> > > > > > > >
> > > > > > > >
> > > > > > > > So, it looks like you need to update the variable to
"COPOPM"
> > in
> > > > your
> > > > > > > > METplus file and hopefully, you will see better
results.
> > Please
> > > > let
> > > > > us
> > > > > > > > know how it goes.
> > > > > > > >
> > > > > > > > Julie
> > > > > > > >
> > > > > > > > On Tue, Jan 5, 2021 at 10:20 PM Partha Bhattacharjee -
NOAA
> > > > Affiliate
> > > > > > via
> > > > > > > > RT <met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > > >
> > > > > > > > > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > >
> > > > > > > > >
> > > > > > > > > Thanks Julie for looking into it. I updated metplus
> location
> > in
> > > > > Mars.
> > > > > > > > > But I need some help to find why the ERROR in
logfile
> > > happening :
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060831
> > > > > > > > > I have tested valid input files, but not sure why no
Obs
> > > retained
> > > > > > after
> > > > > > > > > pb2nc step.
> > > > > > > > >
> > > > > > > > > Partha
> > > > > > > > >
> > > > > > > > > On Tue, Jan 5, 2021 at 4:50 PM Julie Prestopnik via
RT <
> > > > > > > > met_help at ucar.edu>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > > > Hi Partha.
> > > > > > > > > >
> > > > > > > > > > I see that you are having trouble running pb2nc
using
> > METplus
> > > > on
> > > > > > > WCOSS.
> > > > > > > > > I
> > > > > > > > > > logged on to WCOSS and took a look at
> > > > > > > > > > your
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/LOG/master_metplus.log.20201220060829
> > > > > > > > > > file.
> > > > > > > > > >
> > > > > > > > > > First, I see that you are using METplus located
> > > > > > > > > > at
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus/METplus-
3.1.
> > > > > > > > > > We are asking users to stop using the
installations
> > > > > > > > > > at
> > > > /gpfs/dell2/emc/verification/noscrub/Julie.Prestopnik/METplus
> > > > > > and
> > > > > > > > > > instead use the emc.metplus locations, which can
be found
> > on
> > > > our
> > > > > > > > Existing
> > > > > > > > > > Builds
> > > > > > > > > > <
> > > > > > > >
> > > > > >
> > > >
> > https://dtcenter.org/community-code/metplus/metplus-3-1-existing-
builds
> > > > > > > > > >
> > > > > > > > > > page
> > > > > > > > > > for our latest release. In this case for WCOSS
> > (Mars/Venus),
> > > > > you'd
> > > > > > > > want
> > > > > > > > > to
> > > > > > > > > > use the following:
> > > > > > > > > >
> > > > > > > > > > > module use
> > > > > > > >
/gpfs/dell2/emc/verification/noscrub/emc.metplus/modulefiles
> > > > > > > > > > > module load metplus/3.1.1
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Next, searching in your log file for "error", I
found
> many
> > > (72)
> > > > > > > > instances
> > > > > > > > > > of the following:
> > > > > > > > > >
> > > > > > > > > > > ERROR :
> > > > > > > > > > > ERROR : write_netcdf_hdr_data() -> No PrepBufr
> messages
> > > > > > retained.
> > > > > > > > > > > Nothing to write.
> > > > > > > > > > > ERROR :
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Looking up in the file from the first error
message I see
> > the
> > > > > > > > following:
> > > > > > > > > >
> > > > > > > > > > > DEBUG 2: Total Messages processed
= 24744
> > > > > > > > > > > DEBUG 2: Rejected based on message type
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on station id
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on valid time
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on masking grid
= 384
> > > > > > > > > > > DEBUG 2: Rejected based on masking polygon
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on elevation
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on pb report type
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on input report type
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on instrument type
= 0
> > > > > > > > > > > DEBUG 2: Rejected based on zero observations
= 24360
> > > > > > > > > > > DEBUG 2: Total Messages retained
= 0
> > > > > > > > > > > DEBUG 2: Total observations retained or derived
= 0
> > > > > > > > > > > DEBUG 1: Obs time between 20201230_010000 and
> > > 20201231_000000
> > > > > > > > > > > DEBUG 5: Filtered time:
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > So, it looks like MET is not finding any
observations.
> > > Please
> > > > > > review
> > > > > > > > the
> > > > > > > > > > observation information to see if you can
determine why
> the
> > > > > > > > observations
> > > > > > > > > > are being rejected. Please let us know how it
goes and
> let
> > > us
> > > > > know
> > > > > > > if
> > > > > > > > > you
> > > > > > > > > > need any assistance.
> > > > > > > > > >
> > > > > > > > > > Julie
> > > > > > > > > >
> > > > > > > > > > On Tue, Jan 5, 2021 at 2:32 PM Partha
Bhattacharjee -
> NOAA
> > > > > > Affiliate
> > > > > > > > via
> > > > > > > > > RT
> > > > > > > > > > <met_help at ucar.edu> wrote:
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Tue Jan 05 14:32:25 2021: Request 98122 was
acted upon.
> > > > > > > > > > > Transaction: Ticket created by
> > > partha.bhattacharjee at noaa.gov
> > > > > > > > > > > Queue: met_help
> > > > > > > > > > > Subject: metplus error
> > > > > > > > > > > Owner: Nobody
> > > > > > > > > > > Requestors: partha.bhattacharjee at noaa.gov
> > > > > > > > > > > Status: new
> > > > > > > > > > > Ticket <URL:
> > > > > > > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98122
> > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > > > Hi,
> > > > > > > > > > > I am trying to use METPlus to verify PM2.5
dataset
> > against
> > > > > > > > observation
> > > > > > > > > > and
> > > > > > > > > > > having some issues. Any help on this is
appreciated.
> > > > > > > > > > > Location in wcoss :
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri
> > > > > > > > > > > .conf is : metplus_gefs_pb2nc_pointstat.conf
> > > > > > > > > > > When I am trying to run it I am seeing the
following
> > > problem
> > > > :
> > > > > > > > > > > run-METplus-metplus.PB2NC: ERROR:
> > > (command_builder.py:1032)
> > > > > MET
> > > > > > > > > command
> > > > > > > > > > > returned a non-zero return code: pb2nc -v 7
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell1/nco/ops/com/hourly/prod/hourly.20201231/aqm.t12z.anowpm.pb.tm024
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/tmp/aq/
> > > > > > > > > > > prepufr.aqm.20201230.nc <
> > http://prepbufr.aqm.20201230.nc/>
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/gpfs/dell2/emc/verification/noscrub/Partha.Bhattacharjee/Aerosol/PM25_veri/PB2NCConfig_gefs
> > > > > > > > > > >
> > > > > > > > > > > Thanks
> > > > > > > > > > > Partha
> > > > > > > > > > >
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > --
> > > > > > > > > > Julie Prestopnik (she/her)
> > > > > > > > > > Software Engineer
> > > > > > > > > > National Center for Atmospheric Research
> > > > > > > > > > Research Applications Laboratory
> > > > > > > > > > Email: jpresto at ucar.edu
> > > > > > > > > >
> > > > > > > > > > My working day may not be your working day.
Please do
> not
> > > feel
> > > > > > > obliged
> > > > > > > > > to
> > > > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > > > > > I.M. Systems Group
> > > > > > > > > Environmental Modeling Centre
> > > > > > > > > NCWCP
> > > > > > > > > 5830 University Research Court.
> > > > > > > > > College Park, MD 20740
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Julie Prestopnik (she/her)
> > > > > > > > Software Engineer
> > > > > > > > National Center for Atmospheric Research
> > > > > > > > Research Applications Laboratory
> > > > > > > > Email: jpresto at ucar.edu
> > > > > > > >
> > > > > > > > My working day may not be your working day. Please do
not
> feel
> > > > > obliged
> > > > > > > to
> > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > > > I.M. Systems Group
> > > > > > > Environmental Modeling Centre
> > > > > > > NCWCP
> > > > > > > 5830 University Research Court.
> > > > > > > College Park, MD 20740
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > Partha S. Bhattacharjee, Ph.D.
> > > > > I.M. Systems Group
> > > > > Environmental Modeling Centre
> > > > > NCWCP
> > > > > 5830 University Research Court.
> > > > > College Park, MD 20740
> > > > >
> > > > >
> > > >
> > > >
> > >
> > > --
> > > Partha S. Bhattacharjee, Ph.D.
> > > I.M. Systems Group
> > > Environmental Modeling Centre
> > > NCWCP
> > > 5830 University Research Court.
> > > College Park, MD 20740
> > >
> > >
> >
> >
>
> --
> Partha S. Bhattacharjee, Ph.D.
> I.M. Systems Group
> Environmental Modeling Centre
> NCWCP
> 5830 University Research Court.
> College Park, MD 20740
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
More information about the Met_help
mailing list