[Met_help] [rt.rap.ucar.edu #98972] History for East, west, and CONUS are not being processed in metviewer
Tatiana Burek via RT
met_help at ucar.edu
Thu Apr 22 14:49:10 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Good morning,
I recently put up a website
<https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/>
with all the stats for different regions. Some noticed that there were no
changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in the website for
skill score type plots and performance diagrams. I was able to determine
that there was no data being processed for those regions which I suspect is
the reason for this issue. Realizing this, I went back and found that the
pointstat_config files did not contain those regions. After adding those
regions in I reprocessed everything and now have stats for east, west, and
CONUS regions. I thought everything would have plotted successfully for
those regions but found that this wasn't so.. In fact, I still get the same
error which is quite surprising to me. These regions have been requested
as essential for identifying the broader performance and will aid in
decision making. I will have to get these up soon... I was wondering if
there was something that stood out to you. Here's the error that keeps
coming up:
020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30 10:00:00',
'2020-08-30 11:00:00', '2020-08-30 12:00:00')
AND BINARY if( (select fcst_lead_offset FROM model_fcst_lead_offset
WHERE model = h.model) is NULL , ld.fcst_lead , ld.fcst_lead + (select
fcst_lead_offset FROM model_fcst_lead_offset WHERE model = h.model) ) IN
('0', '10000', '20000', '30000', '40000', '50000', '60000', '70000',
'80000', '90000', '100000', '110000', '120000', '130000', '140000',
'150000', '160000', '170000', '180000', '190000', '200000', '210000',
'220000', '230000', '240000', '250000', '260000', '270000', '280000',
'290000', '300000', '310000', '320000', '330000', '340000', '350000',
'360000', '370000', '380000', '390000', '400000', '410000', '420000',
'430000', '440000', '450000', '460000', '470000', '480000')
AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD', 'PROD_BC')
AND BINARY h.obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85',
'>105', '>125', '>150')
AND BINARY h.fcst_var = 'OZMAX8'
AND ld.stat_header_id = h.stat_header_id;
No data was returned from database
2021-03-09
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
Source) -1 printFormattedTable - ** ERROR: Caught class
edu.ucar.metviewer.EmptyResultSetException in printFormattedTable(ResultSet
res): result set contained no data
** ERROR: Caught class edu.ucar.metviewer.EmptyResultSetException in
printFormattedTable(ResultSet res): result set contained no data
** ERROR: Caught class edu.ucar.metviewer.EmptyResultSetException in
printFormattedTable(ResultSet res): result set contained no data
Database query time for mv_cmaq_metplus 0:00:00.016
Save to file time for mv_cmaq_metplus 0:00:00.000
You can view the stat files of those fields here:
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
The corresponding tags to those files are something like this:
PARA6C_AQMAX1*
PARA6C_AQMAX8*
PARA6C_BC_PMMAX*
PARA6C_BC_PMAVE*
I have similar plots for PARA6C, PARA6C_BC, PROD, and PROD_BC. I've
checked these files and these regions (i.e. EAST, WEST, CONUS) appear
tabulated for ctc stats.
Additionally, my files have been updated to match the inclusion of these
regions:
poly = [ "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
"MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
"MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
"MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
"MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
"MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
"MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
"MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
"MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
The files that I'm using definitely have these regions as well as seen
here:
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
I'm somewhat at a loss of what to do since everything else seems fine. Has
this been seen before?
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Tue Mar 09 07:43:13 2021
Ed,
What is the name of the database that contains your data?
Tatiana
On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov wrote:
> Good morning,
>
> I recently put up a website
>
<https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/>
> with all the stats for different regions. Some noticed that there
> were no
> changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in the
website
> for
> skill score type plots and performance diagrams. I was able to
> determine
> that there was no data being processed for those regions which I
> suspect is
> the reason for this issue. Realizing this, I went back and found
that
> the
> pointstat_config files did not contain those regions. After adding
> those
> regions in I reprocessed everything and now have stats for east,
west,
> and
> CONUS regions. I thought everything would have plotted successfully
> for
> those regions but found that this wasn't so.. In fact, I still get
the
> same
> error which is quite surprising to me. These regions have been
> requested
> as essential for identifying the broader performance and will aid in
> decision making. I will have to get these up soon... I was
wondering
> if
> there was something that stood out to you. Here's the error that
> keeps
> coming up:
>
> 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30 10:00:00',
> '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> AND BINARY if( (select fcst_lead_offset FROM
> model_fcst_lead_offset
> WHERE model = h.model) is NULL , ld.fcst_lead , ld.fcst_lead +
(select
> fcst_lead_offset FROM model_fcst_lead_offset WHERE model = h.model)
)
> IN
> ('0', '10000', '20000', '30000', '40000', '50000', '60000', '70000',
> '80000', '90000', '100000', '110000', '120000', '130000', '140000',
> '150000', '160000', '170000', '180000', '190000', '200000',
'210000',
> '220000', '230000', '240000', '250000', '260000', '270000',
'280000',
> '290000', '300000', '310000', '320000', '330000', '340000',
'350000',
> '360000', '370000', '380000', '390000', '400000', '410000',
'420000',
> '430000', '440000', '450000', '460000', '470000', '480000')
> AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD', 'PROD_BC')
> AND BINARY h.obs_thresh IN ('>50', '>60', '>65', '>70', '>75',
> '>85',
> '>105', '>125', '>150')
> AND BINARY h.fcst_var = 'OZMAX8'
> AND ld.stat_header_id = h.stat_header_id;
>
> No data was returned from database
> 2021-03-09
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> Source) -1 printFormattedTable - ** ERROR: Caught class
> edu.ucar.metviewer.EmptyResultSetException in
> printFormattedTable(ResultSet
> res): result set contained no data
> ** ERROR: Caught class edu.ucar.metviewer.EmptyResultSetException
> in
> printFormattedTable(ResultSet res): result set contained no data
> ** ERROR: Caught class edu.ucar.metviewer.EmptyResultSetException
> in
> printFormattedTable(ResultSet res): result set contained no data
> Database query time for mv_cmaq_metplus 0:00:00.016
> Save to file time for mv_cmaq_metplus 0:00:00.000
>
> You can view the stat files of those fields here:
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
>
> The corresponding tags to those files are something like this:
> PARA6C_AQMAX1*
> PARA6C_AQMAX8*
> PARA6C_BC_PMMAX*
> PARA6C_BC_PMAVE*
>
> I have similar plots for PARA6C, PARA6C_BC, PROD, and PROD_BC. I've
> checked these files and these regions (i.e. EAST, WEST, CONUS)
appear
> tabulated for ctc stats.
>
> Additionally, my files have been updated to match the inclusion of
> these
> regions:
> poly = [ "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
>
> The files that I'm using definitely have these regions as well as
seen
> here:
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
>
> PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
>
> I'm somewhat at a loss of what to do since everything else seems
fine.
> Has
> this been seen before?
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Tue Mar 09 07:55:16 2021
The database is mv_cmaq_metplus which should be under the group name
Ed_Strobach. I did realize that my inputs were switched around such
that
my group name was being designated as add instead of Ed_Strobach. I
have
since switched around the inputs but I don't think that should be the
issue, at least I don't think so since the other data was uploaded
successfully. I was loading data this way:
python load_to_metviewer_AWS.py mv_cmaq_metplus add Ed_Strobach
but should have instead been
python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach add
Not recognizing Ed_Strobach as an option (i.e. should have been "add"
or
"new") it defaulted to add I think; but again, I'm not sure that this
caused the issue..
On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Ed,
> What is the name of the database that contains your data?
>
> Tatiana
>
> On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov wrote:
> > Good morning,
> >
> > I recently put up a website
> > <
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> >
> > with all the stats for different regions. Some noticed that there
> > were no
> > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in the
website
> > for
> > skill score type plots and performance diagrams. I was able to
> > determine
> > that there was no data being processed for those regions which I
> > suspect is
> > the reason for this issue. Realizing this, I went back and found
that
> > the
> > pointstat_config files did not contain those regions. After
adding
> > those
> > regions in I reprocessed everything and now have stats for east,
west,
> > and
> > CONUS regions. I thought everything would have plotted
successfully
> > for
> > those regions but found that this wasn't so.. In fact, I still get
the
> > same
> > error which is quite surprising to me. These regions have been
> > requested
> > as essential for identifying the broader performance and will aid
in
> > decision making. I will have to get these up soon... I was
wondering
> > if
> > there was something that stood out to you. Here's the error that
> > keeps
> > coming up:
> >
> > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30 10:00:00',
> > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > AND BINARY if( (select fcst_lead_offset FROM
> > model_fcst_lead_offset
> > WHERE model = h.model) is NULL , ld.fcst_lead , ld.fcst_lead +
(select
> > fcst_lead_offset FROM model_fcst_lead_offset WHERE model =
h.model) )
> > IN
> > ('0', '10000', '20000', '30000', '40000', '50000', '60000',
'70000',
> > '80000', '90000', '100000', '110000', '120000', '130000',
'140000',
> > '150000', '160000', '170000', '180000', '190000', '200000',
'210000',
> > '220000', '230000', '240000', '250000', '260000', '270000',
'280000',
> > '290000', '300000', '310000', '320000', '330000', '340000',
'350000',
> > '360000', '370000', '380000', '390000', '400000', '410000',
'420000',
> > '430000', '440000', '450000', '460000', '470000', '480000')
> > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD',
'PROD_BC')
> > AND BINARY h.obs_thresh IN ('>50', '>60', '>65', '>70', '>75',
> > '>85',
> > '>105', '>125', '>150')
> > AND BINARY h.fcst_var = 'OZMAX8'
> > AND ld.stat_header_id = h.stat_header_id;
> >
> > No data was returned from database
> > 2021-03-09
> >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > Source) -1 printFormattedTable - ** ERROR: Caught class
> > edu.ucar.metviewer.EmptyResultSetException in
> > printFormattedTable(ResultSet
> > res): result set contained no data
> > ** ERROR: Caught class
edu.ucar.metviewer.EmptyResultSetException
> > in
> > printFormattedTable(ResultSet res): result set contained no data
> > ** ERROR: Caught class
edu.ucar.metviewer.EmptyResultSetException
> > in
> > printFormattedTable(ResultSet res): result set contained no data
> > Database query time for mv_cmaq_metplus 0:00:00.016
> > Save to file time for mv_cmaq_metplus 0:00:00.000
> >
> > You can view the stat files of those fields here:
> >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> >
> > The corresponding tags to those files are something like this:
> > PARA6C_AQMAX1*
> > PARA6C_AQMAX8*
> > PARA6C_BC_PMMAX*
> > PARA6C_BC_PMAVE*
> >
> > I have similar plots for PARA6C, PARA6C_BC, PROD, and PROD_BC.
I've
> > checked these files and these regions (i.e. EAST, WEST, CONUS)
appear
> > tabulated for ctc stats.
> >
> > Additionally, my files have been updated to match the inclusion of
> > these
> > regions:
> > poly = [ "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
> >
> > The files that I'm using definitely have these regions as well as
seen
> > here:
> >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> >
> > PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
> >
> > I'm somewhat at a loss of what to do since everything else seems
fine.
> > Has
> > this been seen before?
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Tue Mar 09 12:24:14 2021
Ed,
It also would be helpful to see XML but I was able to use some info
from the part of the query that you sent.
I assume that you are interested on some agg stat calculations and use
the data from sl1l2 table. The data in this table has only one
obs_thresh value - NA. That is why when you include other values like
">50' the query returns no data.
Tatiana
On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov wrote:
> The database is mv_cmaq_metplus which should be under the group name
> Ed_Strobach. I did realize that my inputs were switched around such
> that
> my group name was being designated as add instead of Ed_Strobach. I
> have
> since switched around the inputs but I don't think that should be
the
> issue, at least I don't think so since the other data was uploaded
> successfully. I was loading data this way:
>
> python load_to_metviewer_AWS.py mv_cmaq_metplus add Ed_Strobach
>
> but should have instead been
>
> python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach add
>
> Not recognizing Ed_Strobach as an option (i.e. should have been
"add"
> or
> "new") it defaulted to add I think; but again, I'm not sure that
this
> caused the issue..
>
> On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Ed,
> > What is the name of the database that contains your data?
> >
> > Tatiana
> >
> > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov wrote:
> > > Good morning,
> > >
> > > I recently put up a website
> > > <
> >
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > >
> > > with all the stats for different regions. Some noticed that
there
> > > were no
> > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in the
> > > website
> > > for
> > > skill score type plots and performance diagrams. I was able to
> > > determine
> > > that there was no data being processed for those regions which I
> > > suspect is
> > > the reason for this issue. Realizing this, I went back and
found
> > > that
> > > the
> > > pointstat_config files did not contain those regions. After
adding
> > > those
> > > regions in I reprocessed everything and now have stats for east,
> > > west,
> > > and
> > > CONUS regions. I thought everything would have plotted
> > > successfully
> > > for
> > > those regions but found that this wasn't so.. In fact, I still
get
> > > the
> > > same
> > > error which is quite surprising to me. These regions have been
> > > requested
> > > as essential for identifying the broader performance and will
aid
> > > in
> > > decision making. I will have to get these up soon... I was
> > > wondering
> > > if
> > > there was something that stood out to you. Here's the error
that
> > > keeps
> > > coming up:
> > >
> > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30
10:00:00',
> > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > AND BINARY if( (select fcst_lead_offset FROM
> > > model_fcst_lead_offset
> > > WHERE model = h.model) is NULL , ld.fcst_lead , ld.fcst_lead +
> > > (select
> > > fcst_lead_offset FROM model_fcst_lead_offset WHERE model =
h.model)
> > > )
> > > IN
> > > ('0', '10000', '20000', '30000', '40000', '50000', '60000',
> > > '70000',
> > > '80000', '90000', '100000', '110000', '120000', '130000',
'140000',
> > > '150000', '160000', '170000', '180000', '190000', '200000',
> > > '210000',
> > > '220000', '230000', '240000', '250000', '260000', '270000',
> > > '280000',
> > > '290000', '300000', '310000', '320000', '330000', '340000',
> > > '350000',
> > > '360000', '370000', '380000', '390000', '400000', '410000',
> > > '420000',
> > > '430000', '440000', '450000', '460000', '470000', '480000')
> > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD',
> > > 'PROD_BC')
> > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65', '>70',
'>75',
> > > '>85',
> > > '>105', '>125', '>150')
> > > AND BINARY h.fcst_var = 'OZMAX8'
> > > AND ld.stat_header_id = h.stat_header_id;
> > >
> > > No data was returned from database
> > > 2021-03-09
> > >
> >
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > Source) -1 printFormattedTable - ** ERROR: Caught class
> > > edu.ucar.metviewer.EmptyResultSetException in
> > > printFormattedTable(ResultSet
> > > res): result set contained no data
> > > ** ERROR: Caught class
> > > edu.ucar.metviewer.EmptyResultSetException
> > > in
> > > printFormattedTable(ResultSet res): result set contained no data
> > > ** ERROR: Caught class
> > > edu.ucar.metviewer.EmptyResultSetException
> > > in
> > > printFormattedTable(ResultSet res): result set contained no data
> > > Database query time for mv_cmaq_metplus 0:00:00.016
> > > Save to file time for mv_cmaq_metplus 0:00:00.000
> > >
> > > You can view the stat files of those fields here:
> > >
> >
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > >
> > > The corresponding tags to those files are something like this:
> > > PARA6C_AQMAX1*
> > > PARA6C_AQMAX8*
> > > PARA6C_BC_PMMAX*
> > > PARA6C_BC_PMAVE*
> > >
> > > I have similar plots for PARA6C, PARA6C_BC, PROD, and PROD_BC.
> > > I've
> > > checked these files and these regions (i.e. EAST, WEST, CONUS)
> > > appear
> > > tabulated for ctc stats.
> > >
> > > Additionally, my files have been updated to match the inclusion
of
> > > these
> > > regions:
> > > poly = [
"MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
> > >
> > > The files that I'm using definitely have these regions as well
as
> > > seen
> > > here:
> > >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > >
> > > PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
> > >
> > > I'm somewhat at a loss of what to do since everything else seems
> > > fine.
> > > Has
> > > this been seen before?
> >
> >
> >
> >
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Tue Mar 09 12:35:05 2021
I'm not really sure I follow. Wouldn't this occur for all regions
then,
not just East, West, and CONUS? The other regions report these
thresholds
with all models being compared. The Pointstat configure file that I
use
for these stats also confirms the thresholding exists in that file.
Moreover, I use ctc when processing plots such as CSI, FAR, etc, which
is
done on the thresholds I set in pointstat and the xml files.
On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Ed,
> It also would be helpful to see XML but I was able to use some info
from
> the part of the query that you sent.
> I assume that you are interested on some agg stat calculations and
use the
> data from sl1l2 table. The data in this table has only one
obs_thresh value
> - NA. That is why when you include other values like ">50' the query
> returns no data.
>
> Tatiana
>
> On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov wrote:
> > The database is mv_cmaq_metplus which should be under the group
name
> > Ed_Strobach. I did realize that my inputs were switched around
such
> > that
> > my group name was being designated as add instead of Ed_Strobach.
I
> > have
> > since switched around the inputs but I don't think that should be
the
> > issue, at least I don't think so since the other data was uploaded
> > successfully. I was loading data this way:
> >
> > python load_to_metviewer_AWS.py mv_cmaq_metplus add Ed_Strobach
> >
> > but should have instead been
> >
> > python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach add
> >
> > Not recognizing Ed_Strobach as an option (i.e. should have been
"add"
> > or
> > "new") it defaulted to add I think; but again, I'm not sure that
this
> > caused the issue..
> >
> > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Ed,
> > > What is the name of the database that contains your data?
> > >
> > > Tatiana
> > >
> > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov wrote:
> > > > Good morning,
> > > >
> > > > I recently put up a website
> > > > <
> > >
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > >
> > > > with all the stats for different regions. Some noticed that
there
> > > > were no
> > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in the
> > > > website
> > > > for
> > > > skill score type plots and performance diagrams. I was able
to
> > > > determine
> > > > that there was no data being processed for those regions which
I
> > > > suspect is
> > > > the reason for this issue. Realizing this, I went back and
found
> > > > that
> > > > the
> > > > pointstat_config files did not contain those regions. After
adding
> > > > those
> > > > regions in I reprocessed everything and now have stats for
east,
> > > > west,
> > > > and
> > > > CONUS regions. I thought everything would have plotted
> > > > successfully
> > > > for
> > > > those regions but found that this wasn't so.. In fact, I still
get
> > > > the
> > > > same
> > > > error which is quite surprising to me. These regions have
been
> > > > requested
> > > > as essential for identifying the broader performance and will
aid
> > > > in
> > > > decision making. I will have to get these up soon... I was
> > > > wondering
> > > > if
> > > > there was something that stood out to you. Here's the error
that
> > > > keeps
> > > > coming up:
> > > >
> > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30
10:00:00',
> > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > > AND BINARY if( (select fcst_lead_offset FROM
> > > > model_fcst_lead_offset
> > > > WHERE model = h.model) is NULL , ld.fcst_lead , ld.fcst_lead +
> > > > (select
> > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE model =
h.model)
> > > > )
> > > > IN
> > > > ('0', '10000', '20000', '30000', '40000', '50000', '60000',
> > > > '70000',
> > > > '80000', '90000', '100000', '110000', '120000', '130000',
'140000',
> > > > '150000', '160000', '170000', '180000', '190000', '200000',
> > > > '210000',
> > > > '220000', '230000', '240000', '250000', '260000', '270000',
> > > > '280000',
> > > > '290000', '300000', '310000', '320000', '330000', '340000',
> > > > '350000',
> > > > '360000', '370000', '380000', '390000', '400000', '410000',
> > > > '420000',
> > > > '430000', '440000', '450000', '460000', '470000', '480000')
> > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD',
> > > > 'PROD_BC')
> > > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65', '>70',
'>75',
> > > > '>85',
> > > > '>105', '>125', '>150')
> > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > AND ld.stat_header_id = h.stat_header_id;
> > > >
> > > > No data was returned from database
> > > > 2021-03-09
> > > >
> > >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > Source) -1 printFormattedTable - ** ERROR: Caught class
> > > > edu.ucar.metviewer.EmptyResultSetException in
> > > > printFormattedTable(ResultSet
> > > > res): result set contained no data
> > > > ** ERROR: Caught class
> > > > edu.ucar.metviewer.EmptyResultSetException
> > > > in
> > > > printFormattedTable(ResultSet res): result set contained no
data
> > > > ** ERROR: Caught class
> > > > edu.ucar.metviewer.EmptyResultSetException
> > > > in
> > > > printFormattedTable(ResultSet res): result set contained no
data
> > > > Database query time for mv_cmaq_metplus 0:00:00.016
> > > > Save to file time for mv_cmaq_metplus 0:00:00.000
> > > >
> > > > You can view the stat files of those fields here:
> > > >
> > >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > >
> > > > The corresponding tags to those files are something like this:
> > > > PARA6C_AQMAX1*
> > > > PARA6C_AQMAX8*
> > > > PARA6C_BC_PMMAX*
> > > > PARA6C_BC_PMAVE*
> > > >
> > > > I have similar plots for PARA6C, PARA6C_BC, PROD, and PROD_BC.
> > > > I've
> > > > checked these files and these regions (i.e. EAST, WEST, CONUS)
> > > > appear
> > > > tabulated for ctc stats.
> > > >
> > > > Additionally, my files have been updated to match the
inclusion of
> > > > these
> > > > regions:
> > > > poly = [
"MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> > > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
> > > >
> > > > The files that I'm using definitely have these regions as well
as
> > > > seen
> > > > here:
> > > >
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > >
> > > > PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
> > > >
> > > > I'm somewhat at a loss of what to do since everything else
seems
> > > > fine.
> > > > Has
> > > > this been seen before?
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Tue Mar 09 14:46:21 2021
Ed,
Having the XML that you use would be really helpful.
I briefly looked at the data using following fields
August 2020
EAST
PARA6C
obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85', '>105',
'>125', '>150')
OZMAX8
Both tables with CNT and CTC types don't have any data with these
parameters.
Tatiana
On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov wrote:
> I'm not really sure I follow. Wouldn't this occur for all regions
> then,
> not just East, West, and CONUS? The other regions report these
> thresholds
> with all models being compared. The Pointstat configure file that I
> use
> for these stats also confirms the thresholding exists in that file.
> Moreover, I use ctc when processing plots such as CSI, FAR, etc,
which
> is
> done on the thresholds I set in pointstat and the xml files.
>
> On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Ed,
> > It also would be helpful to see XML but I was able to use some
info
> > from
> > the part of the query that you sent.
> > I assume that you are interested on some agg stat calculations and
> > use the
> > data from sl1l2 table. The data in this table has only one
obs_thresh
> > value
> > - NA. That is why when you include other values like ">50' the
query
> > returns no data.
> >
> > Tatiana
> >
> > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov wrote:
> > > The database is mv_cmaq_metplus which should be under the group
> > > name
> > > Ed_Strobach. I did realize that my inputs were switched around
> > > such
> > > that
> > > my group name was being designated as add instead of
Ed_Strobach.
> > > I
> > > have
> > > since switched around the inputs but I don't think that should
be
> > > the
> > > issue, at least I don't think so since the other data was
uploaded
> > > successfully. I was loading data this way:
> > >
> > > python load_to_metviewer_AWS.py mv_cmaq_metplus add Ed_Strobach
> > >
> > > but should have instead been
> > >
> > > python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach add
> > >
> > > Not recognizing Ed_Strobach as an option (i.e. should have been
> > > "add"
> > > or
> > > "new") it defaulted to add I think; but again, I'm not sure that
> > > this
> > > caused the issue..
> > >
> > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > Ed,
> > > > What is the name of the database that contains your data?
> > > >
> > > > Tatiana
> > > >
> > > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov wrote:
> > > > > Good morning,
> > > > >
> > > > > I recently put up a website
> > > > > <
> > > >
> >
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > >
> > > > > with all the stats for different regions. Some noticed that
> > > > > there
> > > > > were no
> > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in
the
> > > > > website
> > > > > for
> > > > > skill score type plots and performance diagrams. I was able
to
> > > > > determine
> > > > > that there was no data being processed for those regions
which
> > > > > I
> > > > > suspect is
> > > > > the reason for this issue. Realizing this, I went back and
> > > > > found
> > > > > that
> > > > > the
> > > > > pointstat_config files did not contain those regions. After
> > > > > adding
> > > > > those
> > > > > regions in I reprocessed everything and now have stats for
> > > > > east,
> > > > > west,
> > > > > and
> > > > > CONUS regions. I thought everything would have plotted
> > > > > successfully
> > > > > for
> > > > > those regions but found that this wasn't so.. In fact, I
still
> > > > > get
> > > > > the
> > > > > same
> > > > > error which is quite surprising to me. These regions have
been
> > > > > requested
> > > > > as essential for identifying the broader performance and
will
> > > > > aid
> > > > > in
> > > > > decision making. I will have to get these up soon... I was
> > > > > wondering
> > > > > if
> > > > > there was something that stood out to you. Here's the error
> > > > > that
> > > > > keeps
> > > > > coming up:
> > > > >
> > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30
> > > > > 10:00:00',
> > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > > > AND BINARY if( (select fcst_lead_offset FROM
> > > > > model_fcst_lead_offset
> > > > > WHERE model = h.model) is NULL , ld.fcst_lead , ld.fcst_lead
+
> > > > > (select
> > > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE model =
> > > > > h.model)
> > > > > )
> > > > > IN
> > > > > ('0', '10000', '20000', '30000', '40000', '50000', '60000',
> > > > > '70000',
> > > > > '80000', '90000', '100000', '110000', '120000', '130000',
> > > > > '140000',
> > > > > '150000', '160000', '170000', '180000', '190000', '200000',
> > > > > '210000',
> > > > > '220000', '230000', '240000', '250000', '260000', '270000',
> > > > > '280000',
> > > > > '290000', '300000', '310000', '320000', '330000', '340000',
> > > > > '350000',
> > > > > '360000', '370000', '380000', '390000', '400000', '410000',
> > > > > '420000',
> > > > > '430000', '440000', '450000', '460000', '470000', '480000')
> > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD',
> > > > > 'PROD_BC')
> > > > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65', '>70',
> > > > > '>75',
> > > > > '>85',
> > > > > '>105', '>125', '>150')
> > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > AND ld.stat_header_id = h.stat_header_id;
> > > > >
> > > > > No data was returned from database
> > > > > 2021-03-09
> > > > >
> > > >
> >
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > Source) -1 printFormattedTable - ** ERROR: Caught class
> > > > > edu.ucar.metviewer.EmptyResultSetException in
> > > > > printFormattedTable(ResultSet
> > > > > res): result set contained no data
> > > > > ** ERROR: Caught class
> > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > in
> > > > > printFormattedTable(ResultSet res): result set contained no
> > > > > data
> > > > > ** ERROR: Caught class
> > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > in
> > > > > printFormattedTable(ResultSet res): result set contained no
> > > > > data
> > > > > Database query time for mv_cmaq_metplus 0:00:00.016
> > > > > Save to file time for mv_cmaq_metplus 0:00:00.000
> > > > >
> > > > > You can view the stat files of those fields here:
> > > > >
> > > >
> >
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > >
> > > > > The corresponding tags to those files are something like
this:
> > > > > PARA6C_AQMAX1*
> > > > > PARA6C_AQMAX8*
> > > > > PARA6C_BC_PMMAX*
> > > > > PARA6C_BC_PMAVE*
> > > > >
> > > > > I have similar plots for PARA6C, PARA6C_BC, PROD, and
PROD_BC.
> > > > > I've
> > > > > checked these files and these regions (i.e. EAST, WEST,
CONUS)
> > > > > appear
> > > > > tabulated for ctc stats.
> > > > >
> > > > > Additionally, my files have been updated to match the
inclusion
> > > > > of
> > > > > these
> > > > > regions:
> > > > > poly = [
> > > > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > > > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> > > > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
> > > > >
> > > > > The files that I'm using definitely have these regions as
well
> > > > > as
> > > > > seen
> > > > > here:
> > > > >
> >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > >
> > > > > PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
> > > > >
> > > > > I'm somewhat at a loss of what to do since everything else
> > > > > seems
> > > > > fine.
> > > > > Has
> > > > > this been seen before?
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Tue Mar 09 15:49:08 2021
I'm guessing you don't have access to WCOSS? If not, I can copy a
file
over for you.
On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Ed,
> Having the XML that you use would be really helpful.
> I briefly looked at the data using following fields
> August 2020
> EAST
> PARA6C
> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85', '>105',
'>125',
> '>150')
> OZMAX8
>
> Both tables with CNT and CTC types don't have any data with these
> parameters.
>
> Tatiana
>
>
> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov wrote:
> > I'm not really sure I follow. Wouldn't this occur for all regions
> > then,
> > not just East, West, and CONUS? The other regions report these
> > thresholds
> > with all models being compared. The Pointstat configure file that
I
> > use
> > for these stats also confirms the thresholding exists in that
file.
> > Moreover, I use ctc when processing plots such as CSI, FAR, etc,
which
> > is
> > done on the thresholds I set in pointstat and the xml files.
> >
> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Ed,
> > > It also would be helpful to see XML but I was able to use some
info
> > > from
> > > the part of the query that you sent.
> > > I assume that you are interested on some agg stat calculations
and
> > > use the
> > > data from sl1l2 table. The data in this table has only one
obs_thresh
> > > value
> > > - NA. That is why when you include other values like ">50' the
query
> > > returns no data.
> > >
> > > Tatiana
> > >
> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov wrote:
> > > > The database is mv_cmaq_metplus which should be under the
group
> > > > name
> > > > Ed_Strobach. I did realize that my inputs were switched
around
> > > > such
> > > > that
> > > > my group name was being designated as add instead of
Ed_Strobach.
> > > > I
> > > > have
> > > > since switched around the inputs but I don't think that should
be
> > > > the
> > > > issue, at least I don't think so since the other data was
uploaded
> > > > successfully. I was loading data this way:
> > > >
> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
Ed_Strobach
> > > >
> > > > but should have instead been
> > > >
> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach
add
> > > >
> > > > Not recognizing Ed_Strobach as an option (i.e. should have
been
> > > > "add"
> > > > or
> > > > "new") it defaulted to add I think; but again, I'm not sure
that
> > > > this
> > > > caused the issue..
> > > >
> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Ed,
> > > > > What is the name of the database that contains your data?
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov wrote:
> > > > > > Good morning,
> > > > > >
> > > > > > I recently put up a website
> > > > > > <
> > > > >
> > >
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > >
> > > > > > with all the stats for different regions. Some noticed
that
> > > > > > there
> > > > > > were no
> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields in
the
> > > > > > website
> > > > > > for
> > > > > > skill score type plots and performance diagrams. I was
able to
> > > > > > determine
> > > > > > that there was no data being processed for those regions
which
> > > > > > I
> > > > > > suspect is
> > > > > > the reason for this issue. Realizing this, I went back
and
> > > > > > found
> > > > > > that
> > > > > > the
> > > > > > pointstat_config files did not contain those regions.
After
> > > > > > adding
> > > > > > those
> > > > > > regions in I reprocessed everything and now have stats for
> > > > > > east,
> > > > > > west,
> > > > > > and
> > > > > > CONUS regions. I thought everything would have plotted
> > > > > > successfully
> > > > > > for
> > > > > > those regions but found that this wasn't so.. In fact, I
still
> > > > > > get
> > > > > > the
> > > > > > same
> > > > > > error which is quite surprising to me. These regions have
been
> > > > > > requested
> > > > > > as essential for identifying the broader performance and
will
> > > > > > aid
> > > > > > in
> > > > > > decision making. I will have to get these up soon... I
was
> > > > > > wondering
> > > > > > if
> > > > > > there was something that stood out to you. Here's the
error
> > > > > > that
> > > > > > keeps
> > > > > > coming up:
> > > > > >
> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30
> > > > > > 10:00:00',
> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > > > > AND BINARY if( (select fcst_lead_offset FROM
> > > > > > model_fcst_lead_offset
> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
ld.fcst_lead +
> > > > > > (select
> > > > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE model =
> > > > > > h.model)
> > > > > > )
> > > > > > IN
> > > > > > ('0', '10000', '20000', '30000', '40000', '50000',
'60000',
> > > > > > '70000',
> > > > > > '80000', '90000', '100000', '110000', '120000', '130000',
> > > > > > '140000',
> > > > > > '150000', '160000', '170000', '180000', '190000',
'200000',
> > > > > > '210000',
> > > > > > '220000', '230000', '240000', '250000', '260000',
'270000',
> > > > > > '280000',
> > > > > > '290000', '300000', '310000', '320000', '330000',
'340000',
> > > > > > '350000',
> > > > > > '360000', '370000', '380000', '390000', '400000',
'410000',
> > > > > > '420000',
> > > > > > '430000', '440000', '450000', '460000', '470000',
'480000')
> > > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD',
> > > > > > 'PROD_BC')
> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65',
'>70',
> > > > > > '>75',
> > > > > > '>85',
> > > > > > '>105', '>125', '>150')
> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > > > > >
> > > > > > No data was returned from database
> > > > > > 2021-03-09
> > > > > >
> > > > >
> > >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > > Source) -1 printFormattedTable - ** ERROR: Caught class
> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> > > > > > printFormattedTable(ResultSet
> > > > > > res): result set contained no data
> > > > > > ** ERROR: Caught class
> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > > in
> > > > > > printFormattedTable(ResultSet res): result set contained
no
> > > > > > data
> > > > > > ** ERROR: Caught class
> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > > in
> > > > > > printFormattedTable(ResultSet res): result set contained
no
> > > > > > data
> > > > > > Database query time for mv_cmaq_metplus 0:00:00.016
> > > > > > Save to file time for mv_cmaq_metplus 0:00:00.000
> > > > > >
> > > > > > You can view the stat files of those fields here:
> > > > > >
> > > > >
> > >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > >
> > > > > > The corresponding tags to those files are something like
this:
> > > > > > PARA6C_AQMAX1*
> > > > > > PARA6C_AQMAX8*
> > > > > > PARA6C_BC_PMMAX*
> > > > > > PARA6C_BC_PMAVE*
> > > > > >
> > > > > > I have similar plots for PARA6C, PARA6C_BC, PROD, and
PROD_BC.
> > > > > > I've
> > > > > > checked these files and these regions (i.e. EAST, WEST,
CONUS)
> > > > > > appear
> > > > > > tabulated for ctc stats.
> > > > > >
> > > > > > Additionally, my files have been updated to match the
inclusion
> > > > > > of
> > > > > > these
> > > > > > regions:
> > > > > > poly = [
> > > > > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > > > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > > > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > > > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > > > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > > > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > > > > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> > > > > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
> > > > > >
> > > > > > The files that I'm using definitely have these regions as
well
> > > > > > as
> > > > > > seen
> > > > > > here:
> > > > > >
> > >
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > >
> > > > > > PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
> > > > > >
> > > > > > I'm somewhat at a loss of what to do since everything else
> > > > > > seems
> > > > > > fine.
> > > > > > Has
> > > > > > this been seen before?
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Wed Mar 10 02:31:00 2021
Here's a CSI example for ozmax8, one of the fields not being plotted
for
east, west, and CONUS.
On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA Affiliate <
edward.strobach at noaa.gov> wrote:
> I'm guessing you don't have access to WCOSS? If not, I can copy a
file
> over for you.
>
> On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
>> Ed,
>> Having the XML that you use would be really helpful.
>> I briefly looked at the data using following fields
>> August 2020
>> EAST
>> PARA6C
>> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85', '>105',
'>125',
>> '>150')
>> OZMAX8
>>
>> Both tables with CNT and CTC types don't have any data with these
>> parameters.
>>
>> Tatiana
>>
>>
>> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov wrote:
>> > I'm not really sure I follow. Wouldn't this occur for all
regions
>> > then,
>> > not just East, West, and CONUS? The other regions report these
>> > thresholds
>> > with all models being compared. The Pointstat configure file
that I
>> > use
>> > for these stats also confirms the thresholding exists in that
file.
>> > Moreover, I use ctc when processing plots such as CSI, FAR, etc,
which
>> > is
>> > done on the thresholds I set in pointstat and the xml files.
>> >
>> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
>> > <met_help at ucar.edu>
>> > wrote:
>> >
>> > > Ed,
>> > > It also would be helpful to see XML but I was able to use some
info
>> > > from
>> > > the part of the query that you sent.
>> > > I assume that you are interested on some agg stat calculations
and
>> > > use the
>> > > data from sl1l2 table. The data in this table has only one
obs_thresh
>> > > value
>> > > - NA. That is why when you include other values like ">50' the
query
>> > > returns no data.
>> > >
>> > > Tatiana
>> > >
>> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov wrote:
>> > > > The database is mv_cmaq_metplus which should be under the
group
>> > > > name
>> > > > Ed_Strobach. I did realize that my inputs were switched
around
>> > > > such
>> > > > that
>> > > > my group name was being designated as add instead of
Ed_Strobach.
>> > > > I
>> > > > have
>> > > > since switched around the inputs but I don't think that
should be
>> > > > the
>> > > > issue, at least I don't think so since the other data was
uploaded
>> > > > successfully. I was loading data this way:
>> > > >
>> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
Ed_Strobach
>> > > >
>> > > > but should have instead been
>> > > >
>> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach
add
>> > > >
>> > > > Not recognizing Ed_Strobach as an option (i.e. should have
been
>> > > > "add"
>> > > > or
>> > > > "new") it defaulted to add I think; but again, I'm not sure
that
>> > > > this
>> > > > caused the issue..
>> > > >
>> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
>> > > > <met_help at ucar.edu>
>> > > > wrote:
>> > > >
>> > > > > Ed,
>> > > > > What is the name of the database that contains your data?
>> > > > >
>> > > > > Tatiana
>> > > > >
>> > > > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov
wrote:
>> > > > > > Good morning,
>> > > > > >
>> > > > > > I recently put up a website
>> > > > > > <
>> > > > >
>> > >
>>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
>> > > > > >
>> > > > > > with all the stats for different regions. Some noticed
that
>> > > > > > there
>> > > > > > were no
>> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields
in the
>> > > > > > website
>> > > > > > for
>> > > > > > skill score type plots and performance diagrams. I was
able to
>> > > > > > determine
>> > > > > > that there was no data being processed for those regions
which
>> > > > > > I
>> > > > > > suspect is
>> > > > > > the reason for this issue. Realizing this, I went back
and
>> > > > > > found
>> > > > > > that
>> > > > > > the
>> > > > > > pointstat_config files did not contain those regions.
After
>> > > > > > adding
>> > > > > > those
>> > > > > > regions in I reprocessed everything and now have stats
for
>> > > > > > east,
>> > > > > > west,
>> > > > > > and
>> > > > > > CONUS regions. I thought everything would have plotted
>> > > > > > successfully
>> > > > > > for
>> > > > > > those regions but found that this wasn't so.. In fact, I
still
>> > > > > > get
>> > > > > > the
>> > > > > > same
>> > > > > > error which is quite surprising to me. These regions
have been
>> > > > > > requested
>> > > > > > as essential for identifying the broader performance and
will
>> > > > > > aid
>> > > > > > in
>> > > > > > decision making. I will have to get these up soon... I
was
>> > > > > > wondering
>> > > > > > if
>> > > > > > there was something that stood out to you. Here's the
error
>> > > > > > that
>> > > > > > keeps
>> > > > > > coming up:
>> > > > > >
>> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30
>> > > > > > 10:00:00',
>> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
>> > > > > > AND BINARY if( (select fcst_lead_offset FROM
>> > > > > > model_fcst_lead_offset
>> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
ld.fcst_lead +
>> > > > > > (select
>> > > > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE model
=
>> > > > > > h.model)
>> > > > > > )
>> > > > > > IN
>> > > > > > ('0', '10000', '20000', '30000', '40000', '50000',
'60000',
>> > > > > > '70000',
>> > > > > > '80000', '90000', '100000', '110000', '120000', '130000',
>> > > > > > '140000',
>> > > > > > '150000', '160000', '170000', '180000', '190000',
'200000',
>> > > > > > '210000',
>> > > > > > '220000', '230000', '240000', '250000', '260000',
'270000',
>> > > > > > '280000',
>> > > > > > '290000', '300000', '310000', '320000', '330000',
'340000',
>> > > > > > '350000',
>> > > > > > '360000', '370000', '380000', '390000', '400000',
'410000',
>> > > > > > '420000',
>> > > > > > '430000', '440000', '450000', '460000', '470000',
'480000')
>> > > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC', 'PROD',
>> > > > > > 'PROD_BC')
>> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65',
'>70',
>> > > > > > '>75',
>> > > > > > '>85',
>> > > > > > '>105', '>125', '>150')
>> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
>> > > > > > AND ld.stat_header_id = h.stat_header_id;
>> > > > > >
>> > > > > > No data was returned from database
>> > > > > > 2021-03-09
>> > > > > >
>> > > > >
>> > >
>>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
>> > > > > > Source) -1 printFormattedTable - ** ERROR: Caught
class
>> > > > > > edu.ucar.metviewer.EmptyResultSetException in
>> > > > > > printFormattedTable(ResultSet
>> > > > > > res): result set contained no data
>> > > > > > ** ERROR: Caught class
>> > > > > > edu.ucar.metviewer.EmptyResultSetException
>> > > > > > in
>> > > > > > printFormattedTable(ResultSet res): result set contained
no
>> > > > > > data
>> > > > > > ** ERROR: Caught class
>> > > > > > edu.ucar.metviewer.EmptyResultSetException
>> > > > > > in
>> > > > > > printFormattedTable(ResultSet res): result set contained
no
>> > > > > > data
>> > > > > > Database query time for mv_cmaq_metplus 0:00:00.016
>> > > > > > Save to file time for mv_cmaq_metplus 0:00:00.000
>> > > > > >
>> > > > > > You can view the stat files of those fields here:
>> > > > > >
>> > > > >
>> > >
>>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
>> > > > > >
>> > > > > > The corresponding tags to those files are something like
this:
>> > > > > > PARA6C_AQMAX1*
>> > > > > > PARA6C_AQMAX8*
>> > > > > > PARA6C_BC_PMMAX*
>> > > > > > PARA6C_BC_PMAVE*
>> > > > > >
>> > > > > > I have similar plots for PARA6C, PARA6C_BC, PROD, and
PROD_BC.
>> > > > > > I've
>> > > > > > checked these files and these regions (i.e. EAST, WEST,
CONUS)
>> > > > > > appear
>> > > > > > tabulated for ctc stats.
>> > > > > >
>> > > > > > Additionally, my files have been updated to match the
inclusion
>> > > > > > of
>> > > > > > these
>> > > > > > regions:
>> > > > > > poly = [
>> > > > > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
>> > > > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
>> > > > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
>> > > > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
>> > > > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
>> > > > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
>> > > > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
>> > > > > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
>> > > > > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly" ];
>> > > > > >
>> > > > > > The files that I'm using definitely have these regions as
well
>> > > > > > as
>> > > > > > seen
>> > > > > > here:
>> > > > > >
>> > >
>>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
>> > > > > >
>> > > > > > PointStatConfig_AIRNOW_max and PointStatConfig_ANOWPM_max
>> > > > > >
>> > > > > > I'm somewhat at a loss of what to do since everything
else
>> > > > > > seems
>> > > > > > fine.
>> > > > > > Has
>> > > > > > this been seen before?
>> > > > >
>> > > > >
>> > > > >
>> > > > >
>> > >
>> > >
>> > >
>> > >
>>
>>
>>
>>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Wed Mar 10 12:45:09 2021
Ed,
I recreated the XML that you sent me on the web app page and produced
the plot: #20210310_193603
Please note that this XML contains all vx_mask not just east, west,
and CONUS.
If I select only those masks - I still get the plot:
# 20210310_194052
Tatiana
On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov wrote:
> Here's a CSI example for ozmax8, one of the fields not being plotted
> for
> east, west, and CONUS.
>
> On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA Affiliate <
> edward.strobach at noaa.gov> wrote:
>
> > I'm guessing you don't have access to WCOSS? If not, I can copy a
> > file
> > over for you.
> >
> > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> >> Ed,
> >> Having the XML that you use would be really helpful.
> >> I briefly looked at the data using following fields
> >> August 2020
> >> EAST
> >> PARA6C
> >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85', '>105',
> >> '>125',
> >> '>150')
> >> OZMAX8
> >>
> >> Both tables with CNT and CTC types don't have any data with these
> >> parameters.
> >>
> >> Tatiana
> >>
> >>
> >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov wrote:
> >> > I'm not really sure I follow. Wouldn't this occur for all
regions
> >> > then,
> >> > not just East, West, and CONUS? The other regions report these
> >> > thresholds
> >> > with all models being compared. The Pointstat configure file
that
> >> > I
> >> > use
> >> > for these stats also confirms the thresholding exists in that
> >> > file.
> >> > Moreover, I use ctc when processing plots such as CSI, FAR,
etc,
> >> > which
> >> > is
> >> > done on the thresholds I set in pointstat and the xml files.
> >> >
> >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> >> > <met_help at ucar.edu>
> >> > wrote:
> >> >
> >> > > Ed,
> >> > > It also would be helpful to see XML but I was able to use
some
> >> > > info
> >> > > from
> >> > > the part of the query that you sent.
> >> > > I assume that you are interested on some agg stat
calculations
> >> > > and
> >> > > use the
> >> > > data from sl1l2 table. The data in this table has only one
> >> > > obs_thresh
> >> > > value
> >> > > - NA. That is why when you include other values like ">50'
the
> >> > > query
> >> > > returns no data.
> >> > >
> >> > > Tatiana
> >> > >
> >> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov wrote:
> >> > > > The database is mv_cmaq_metplus which should be under the
> >> > > > group
> >> > > > name
> >> > > > Ed_Strobach. I did realize that my inputs were switched
> >> > > > around
> >> > > > such
> >> > > > that
> >> > > > my group name was being designated as add instead of
> >> > > > Ed_Strobach.
> >> > > > I
> >> > > > have
> >> > > > since switched around the inputs but I don't think that
should
> >> > > > be
> >> > > > the
> >> > > > issue, at least I don't think so since the other data was
> >> > > > uploaded
> >> > > > successfully. I was loading data this way:
> >> > > >
> >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
> >> > > > Ed_Strobach
> >> > > >
> >> > > > but should have instead been
> >> > > >
> >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus Ed_Strobach
> >> > > > add
> >> > > >
> >> > > > Not recognizing Ed_Strobach as an option (i.e. should have
> >> > > > been
> >> > > > "add"
> >> > > > or
> >> > > > "new") it defaulted to add I think; but again, I'm not sure
> >> > > > that
> >> > > > this
> >> > > > caused the issue..
> >> > > >
> >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> >> > > > <met_help at ucar.edu>
> >> > > > wrote:
> >> > > >
> >> > > > > Ed,
> >> > > > > What is the name of the database that contains your data?
> >> > > > >
> >> > > > > Tatiana
> >> > > > >
> >> > > > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov
wrote:
> >> > > > > > Good morning,
> >> > > > > >
> >> > > > > > I recently put up a website
> >> > > > > > <
> >> > > > >
> >> > >
> >>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> >> > > > > >
> >> > > > > > with all the stats for different regions. Some noticed
> >> > > > > > that
> >> > > > > > there
> >> > > > > > were no
> >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1 fields
in
> >> > > > > > the
> >> > > > > > website
> >> > > > > > for
> >> > > > > > skill score type plots and performance diagrams. I was
> >> > > > > > able to
> >> > > > > > determine
> >> > > > > > that there was no data being processed for those
regions
> >> > > > > > which
> >> > > > > > I
> >> > > > > > suspect is
> >> > > > > > the reason for this issue. Realizing this, I went back
> >> > > > > > and
> >> > > > > > found
> >> > > > > > that
> >> > > > > > the
> >> > > > > > pointstat_config files did not contain those regions.
> >> > > > > > After
> >> > > > > > adding
> >> > > > > > those
> >> > > > > > regions in I reprocessed everything and now have stats
for
> >> > > > > > east,
> >> > > > > > west,
> >> > > > > > and
> >> > > > > > CONUS regions. I thought everything would have plotted
> >> > > > > > successfully
> >> > > > > > for
> >> > > > > > those regions but found that this wasn't so.. In fact,
I
> >> > > > > > still
> >> > > > > > get
> >> > > > > > the
> >> > > > > > same
> >> > > > > > error which is quite surprising to me. These regions
have
> >> > > > > > been
> >> > > > > > requested
> >> > > > > > as essential for identifying the broader performance
and
> >> > > > > > will
> >> > > > > > aid
> >> > > > > > in
> >> > > > > > decision making. I will have to get these up soon... I
> >> > > > > > was
> >> > > > > > wondering
> >> > > > > > if
> >> > > > > > there was something that stood out to you. Here's the
> >> > > > > > error
> >> > > > > > that
> >> > > > > > keeps
> >> > > > > > coming up:
> >> > > > > >
> >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-30
> >> > > > > > 10:00:00',
> >> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> >> > > > > > AND BINARY if( (select fcst_lead_offset FROM
> >> > > > > > model_fcst_lead_offset
> >> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
> >> > > > > > ld.fcst_lead +
> >> > > > > > (select
> >> > > > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE
model =
> >> > > > > > h.model)
> >> > > > > > )
> >> > > > > > IN
> >> > > > > > ('0', '10000', '20000', '30000', '40000', '50000',
> >> > > > > > '60000',
> >> > > > > > '70000',
> >> > > > > > '80000', '90000', '100000', '110000', '120000',
'130000',
> >> > > > > > '140000',
> >> > > > > > '150000', '160000', '170000', '180000', '190000',
> >> > > > > > '200000',
> >> > > > > > '210000',
> >> > > > > > '220000', '230000', '240000', '250000', '260000',
> >> > > > > > '270000',
> >> > > > > > '280000',
> >> > > > > > '290000', '300000', '310000', '320000', '330000',
> >> > > > > > '340000',
> >> > > > > > '350000',
> >> > > > > > '360000', '370000', '380000', '390000', '400000',
> >> > > > > > '410000',
> >> > > > > > '420000',
> >> > > > > > '430000', '440000', '450000', '460000', '470000',
> >> > > > > > '480000')
> >> > > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC',
'PROD',
> >> > > > > > 'PROD_BC')
> >> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65',
> >> > > > > > '>70',
> >> > > > > > '>75',
> >> > > > > > '>85',
> >> > > > > > '>105', '>125', '>150')
> >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> >> > > > > >
> >> > > > > > No data was returned from database
> >> > > > > > 2021-03-09
> >> > > > > >
> >> > > > >
> >> > >
> >>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> >> > > > > > Source) -1 printFormattedTable - ** ERROR: Caught
class
> >> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> >> > > > > > printFormattedTable(ResultSet
> >> > > > > > res): result set contained no data
> >> > > > > > ** ERROR: Caught class
> >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> >> > > > > > in
> >> > > > > > printFormattedTable(ResultSet res): result set
contained
> >> > > > > > no
> >> > > > > > data
> >> > > > > > ** ERROR: Caught class
> >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> >> > > > > > in
> >> > > > > > printFormattedTable(ResultSet res): result set
contained
> >> > > > > > no
> >> > > > > > data
> >> > > > > > Database query time for mv_cmaq_metplus 0:00:00.016
> >> > > > > > Save to file time for mv_cmaq_metplus 0:00:00.000
> >> > > > > >
> >> > > > > > You can view the stat files of those fields here:
> >> > > > > >
> >> > > > >
> >> > >
> >>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> >> > > > > >
> >> > > > > > The corresponding tags to those files are something
like
> >> > > > > > this:
> >> > > > > > PARA6C_AQMAX1*
> >> > > > > > PARA6C_AQMAX8*
> >> > > > > > PARA6C_BC_PMMAX*
> >> > > > > > PARA6C_BC_PMAVE*
> >> > > > > >
> >> > > > > > I have similar plots for PARA6C, PARA6C_BC, PROD, and
> >> > > > > > PROD_BC.
> >> > > > > > I've
> >> > > > > > checked these files and these regions (i.e. EAST, WEST,
> >> > > > > > CONUS)
> >> > > > > > appear
> >> > > > > > tabulated for ctc stats.
> >> > > > > >
> >> > > > > > Additionally, my files have been updated to match the
> >> > > > > > inclusion
> >> > > > > > of
> >> > > > > > these
> >> > > > > > regions:
> >> > > > > > poly = [
> >> > > > > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> >> > > > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> >> > > > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> >> > > > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> >> > > > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> >> > > > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> >> > > > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> >> > > > > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> >> > > > > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly"
];
> >> > > > > >
> >> > > > > > The files that I'm using definitely have these regions
as
> >> > > > > > well
> >> > > > > > as
> >> > > > > > seen
> >> > > > > > here:
> >> > > > > >
> >> > >
> >>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> >> > > > > >
> >> > > > > > PointStatConfig_AIRNOW_max and
PointStatConfig_ANOWPM_max
> >> > > > > >
> >> > > > > > I'm somewhat at a loss of what to do since everything
else
> >> > > > > > seems
> >> > > > > > fine.
> >> > > > > > Has
> >> > > > > > this been seen before?
> >> > > > >
> >> > > > >
> >> > > > >
> >> > > > >
> >> > >
> >> > >
> >> > >
> >> > >
> >>
> >>
> >>
> >>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Wed Mar 10 13:37:58 2021
Thanks... I'm hoping that I can get an explanation on why things
didn't
work. I was under the impression from my emails with John that I
could
simply list the regions that I wanted processed under the "fix" tab.
Now
it seems that you are creating two fix fields for vx_mask, one of
which
duplicates EAST, WEST, and CONUS. Why is this the solution? All my
plots
have produced for all regions just fine in the past. If you look at
ozone
(not the max fields of ozone) you will see that all the plots are
being
generated and stored as they always have. The list provided for
vx_mask in
my xml files generates plots for all those regions. For some reason I
am
getting an empty plot for EAST, WEST, and CONUS for OZMAX8, OZMAX1,
PDMAX1,
and PMAVE. I haven't been able to get any clues other than the error
message I originally sent. I have to say that the plot number
reference
that you sent me yielded a CSI curve that I've never seen in any of
the
plots I looked at. Not sure what's going on with that plot.
On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Ed,
> I recreated the XML that you sent me on the web app page and
produced the
> plot: #20210310_193603
> Please note that this XML contains all vx_mask not just east, west,
and
> CONUS.
> If I select only those masks - I still get the plot:
> # 20210310_194052
>
> Tatiana
>
> On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov wrote:
> > Here's a CSI example for ozmax8, one of the fields not being
plotted
> > for
> > east, west, and CONUS.
> >
> > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA Affiliate <
> > edward.strobach at noaa.gov> wrote:
> >
> > > I'm guessing you don't have access to WCOSS? If not, I can copy
a
> > > file
> > > over for you.
> > >
> > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > >> Ed,
> > >> Having the XML that you use would be really helpful.
> > >> I briefly looked at the data using following fields
> > >> August 2020
> > >> EAST
> > >> PARA6C
> > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85',
'>105',
> > >> '>125',
> > >> '>150')
> > >> OZMAX8
> > >>
> > >> Both tables with CNT and CTC types don't have any data with
these
> > >> parameters.
> > >>
> > >> Tatiana
> > >>
> > >>
> > >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov wrote:
> > >> > I'm not really sure I follow. Wouldn't this occur for all
regions
> > >> > then,
> > >> > not just East, West, and CONUS? The other regions report
these
> > >> > thresholds
> > >> > with all models being compared. The Pointstat configure file
that
> > >> > I
> > >> > use
> > >> > for these stats also confirms the thresholding exists in that
> > >> > file.
> > >> > Moreover, I use ctc when processing plots such as CSI, FAR,
etc,
> > >> > which
> > >> > is
> > >> > done on the thresholds I set in pointstat and the xml files.
> > >> >
> > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > >> > <met_help at ucar.edu>
> > >> > wrote:
> > >> >
> > >> > > Ed,
> > >> > > It also would be helpful to see XML but I was able to use
some
> > >> > > info
> > >> > > from
> > >> > > the part of the query that you sent.
> > >> > > I assume that you are interested on some agg stat
calculations
> > >> > > and
> > >> > > use the
> > >> > > data from sl1l2 table. The data in this table has only one
> > >> > > obs_thresh
> > >> > > value
> > >> > > - NA. That is why when you include other values like ">50'
the
> > >> > > query
> > >> > > returns no data.
> > >> > >
> > >> > > Tatiana
> > >> > >
> > >> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov
wrote:
> > >> > > > The database is mv_cmaq_metplus which should be under the
> > >> > > > group
> > >> > > > name
> > >> > > > Ed_Strobach. I did realize that my inputs were switched
> > >> > > > around
> > >> > > > such
> > >> > > > that
> > >> > > > my group name was being designated as add instead of
> > >> > > > Ed_Strobach.
> > >> > > > I
> > >> > > > have
> > >> > > > since switched around the inputs but I don't think that
should
> > >> > > > be
> > >> > > > the
> > >> > > > issue, at least I don't think so since the other data was
> > >> > > > uploaded
> > >> > > > successfully. I was loading data this way:
> > >> > > >
> > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
> > >> > > > Ed_Strobach
> > >> > > >
> > >> > > > but should have instead been
> > >> > > >
> > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
Ed_Strobach
> > >> > > > add
> > >> > > >
> > >> > > > Not recognizing Ed_Strobach as an option (i.e. should
have
> > >> > > > been
> > >> > > > "add"
> > >> > > > or
> > >> > > > "new") it defaulted to add I think; but again, I'm not
sure
> > >> > > > that
> > >> > > > this
> > >> > > > caused the issue..
> > >> > > >
> > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > >> > > > <met_help at ucar.edu>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > Ed,
> > >> > > > > What is the name of the database that contains your
data?
> > >> > > > >
> > >> > > > > Tatiana
> > >> > > > >
> > >> > > > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov
wrote:
> > >> > > > > > Good morning,
> > >> > > > > >
> > >> > > > > > I recently put up a website
> > >> > > > > > <
> > >> > > > >
> > >> > >
> > >>
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > >> > > > > >
> > >> > > > > > with all the stats for different regions. Some
noticed
> > >> > > > > > that
> > >> > > > > > there
> > >> > > > > > were no
> > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1
fields in
> > >> > > > > > the
> > >> > > > > > website
> > >> > > > > > for
> > >> > > > > > skill score type plots and performance diagrams. I
was
> > >> > > > > > able to
> > >> > > > > > determine
> > >> > > > > > that there was no data being processed for those
regions
> > >> > > > > > which
> > >> > > > > > I
> > >> > > > > > suspect is
> > >> > > > > > the reason for this issue. Realizing this, I went
back
> > >> > > > > > and
> > >> > > > > > found
> > >> > > > > > that
> > >> > > > > > the
> > >> > > > > > pointstat_config files did not contain those regions.
> > >> > > > > > After
> > >> > > > > > adding
> > >> > > > > > those
> > >> > > > > > regions in I reprocessed everything and now have
stats for
> > >> > > > > > east,
> > >> > > > > > west,
> > >> > > > > > and
> > >> > > > > > CONUS regions. I thought everything would have
plotted
> > >> > > > > > successfully
> > >> > > > > > for
> > >> > > > > > those regions but found that this wasn't so.. In
fact, I
> > >> > > > > > still
> > >> > > > > > get
> > >> > > > > > the
> > >> > > > > > same
> > >> > > > > > error which is quite surprising to me. These regions
have
> > >> > > > > > been
> > >> > > > > > requested
> > >> > > > > > as essential for identifying the broader performance
and
> > >> > > > > > will
> > >> > > > > > aid
> > >> > > > > > in
> > >> > > > > > decision making. I will have to get these up soon...
I
> > >> > > > > > was
> > >> > > > > > wondering
> > >> > > > > > if
> > >> > > > > > there was something that stood out to you. Here's
the
> > >> > > > > > error
> > >> > > > > > that
> > >> > > > > > keeps
> > >> > > > > > coming up:
> > >> > > > > >
> > >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-08-
30
> > >> > > > > > 10:00:00',
> > >> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > >> > > > > > AND BINARY if( (select fcst_lead_offset FROM
> > >> > > > > > model_fcst_lead_offset
> > >> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
> > >> > > > > > ld.fcst_lead +
> > >> > > > > > (select
> > >> > > > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE
model =
> > >> > > > > > h.model)
> > >> > > > > > )
> > >> > > > > > IN
> > >> > > > > > ('0', '10000', '20000', '30000', '40000', '50000',
> > >> > > > > > '60000',
> > >> > > > > > '70000',
> > >> > > > > > '80000', '90000', '100000', '110000', '120000',
'130000',
> > >> > > > > > '140000',
> > >> > > > > > '150000', '160000', '170000', '180000', '190000',
> > >> > > > > > '200000',
> > >> > > > > > '210000',
> > >> > > > > > '220000', '230000', '240000', '250000', '260000',
> > >> > > > > > '270000',
> > >> > > > > > '280000',
> > >> > > > > > '290000', '300000', '310000', '320000', '330000',
> > >> > > > > > '340000',
> > >> > > > > > '350000',
> > >> > > > > > '360000', '370000', '380000', '390000', '400000',
> > >> > > > > > '410000',
> > >> > > > > > '420000',
> > >> > > > > > '430000', '440000', '450000', '460000', '470000',
> > >> > > > > > '480000')
> > >> > > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC',
'PROD',
> > >> > > > > > 'PROD_BC')
> > >> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60', '>65',
> > >> > > > > > '>70',
> > >> > > > > > '>75',
> > >> > > > > > '>85',
> > >> > > > > > '>105', '>125', '>150')
> > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > >> > > > > >
> > >> > > > > > No data was returned from database
> > >> > > > > > 2021-03-09
> > >> > > > > >
> > >> > > > >
> > >> > >
> > >>
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > >> > > > > > Source) -1 printFormattedTable - ** ERROR: Caught
class
> > >> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> > >> > > > > > printFormattedTable(ResultSet
> > >> > > > > > res): result set contained no data
> > >> > > > > > ** ERROR: Caught class
> > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > >> > > > > > in
> > >> > > > > > printFormattedTable(ResultSet res): result set
contained
> > >> > > > > > no
> > >> > > > > > data
> > >> > > > > > ** ERROR: Caught class
> > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > >> > > > > > in
> > >> > > > > > printFormattedTable(ResultSet res): result set
contained
> > >> > > > > > no
> > >> > > > > > data
> > >> > > > > > Database query time for mv_cmaq_metplus 0:00:00.016
> > >> > > > > > Save to file time for mv_cmaq_metplus 0:00:00.000
> > >> > > > > >
> > >> > > > > > You can view the stat files of those fields here:
> > >> > > > > >
> > >> > > > >
> > >> > >
> > >>
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > >> > > > > >
> > >> > > > > > The corresponding tags to those files are something
like
> > >> > > > > > this:
> > >> > > > > > PARA6C_AQMAX1*
> > >> > > > > > PARA6C_AQMAX8*
> > >> > > > > > PARA6C_BC_PMMAX*
> > >> > > > > > PARA6C_BC_PMAVE*
> > >> > > > > >
> > >> > > > > > I have similar plots for PARA6C, PARA6C_BC, PROD, and
> > >> > > > > > PROD_BC.
> > >> > > > > > I've
> > >> > > > > > checked these files and these regions (i.e. EAST,
WEST,
> > >> > > > > > CONUS)
> > >> > > > > > appear
> > >> > > > > > tabulated for ctc stats.
> > >> > > > > >
> > >> > > > > > Additionally, my files have been updated to match the
> > >> > > > > > inclusion
> > >> > > > > > of
> > >> > > > > > these
> > >> > > > > > regions:
> > >> > > > > > poly = [
> > >> > > > > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > >> > > > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > >> > > > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > >> > > > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > >> > > > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > >> > > > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > >> > > > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > >> > > > > > "MET_BASE/poly/APL.poly", "MET_BASE/poly/EAST.poly",
> > >> > > > > > "MET_BASE/poly/WEST.poly", "MET_BASE/poly/CONUS.poly"
];
> > >> > > > > >
> > >> > > > > > The files that I'm using definitely have these
regions as
> > >> > > > > > well
> > >> > > > > > as
> > >> > > > > > seen
> > >> > > > > > here:
> > >> > > > > >
> > >> > >
> > >>
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > >> > > > > >
> > >> > > > > > PointStatConfig_AIRNOW_max and
PointStatConfig_ANOWPM_max
> > >> > > > > >
> > >> > > > > > I'm somewhat at a loss of what to do since everything
else
> > >> > > > > > seems
> > >> > > > > > fine.
> > >> > > > > > Has
> > >> > > > > > this been seen before?
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > > > >
> > >> > >
> > >> > >
> > >> > >
> > >> > >
> > >>
> > >>
> > >>
> > >>
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Wed Mar 10 14:40:59 2021
I did not understand your comment about the 'two fix fields for
vx_mask'.
I create one vx_maskk fieldand add 3 values:
<field equalize="false" name="vx_mask">
<set name="vx_mask_0">
<val>CONUS</val>
<val>EAST</val>
<val>WEST</val>
</set>
</field>
this is equal to
<field equalize="false" name="vx_mask">
<val>CONUS</val>
<val>EAST</val>
<val>WEST</val>
</field>
I run the same config OZMAX1 and METviewer also generated a plot but
only for PARA6C and PARA6C_BC models: 20210310_213318
The XML you sent me points METviewer to calculate summary statistics.
If agg statistic is selected - the plot would look differently:
20210310_213917
Tatiana
On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov wrote:
> Thanks... I'm hoping that I can get an explanation on why things
> didn't
> work. I was under the impression from my emails with John that I
> could
> simply list the regions that I wanted processed under the "fix" tab.
> Now
> it seems that you are creating two fix fields for vx_mask, one of
> which
> duplicates EAST, WEST, and CONUS. Why is this the solution? All my
> plots
> have produced for all regions just fine in the past. If you look at
> ozone
> (not the max fields of ozone) you will see that all the plots are
> being
> generated and stored as they always have. The list provided for
> vx_mask in
> my xml files generates plots for all those regions. For some reason
I
> am
> getting an empty plot for EAST, WEST, and CONUS for OZMAX8, OZMAX1,
> PDMAX1,
> and PMAVE. I haven't been able to get any clues other than the
error
> message I originally sent. I have to say that the plot number
> reference
> that you sent me yielded a CSI curve that I've never seen in any of
> the
> plots I looked at. Not sure what's going on with that plot.
>
>
> On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Ed,
> > I recreated the XML that you sent me on the web app page and
produced
> > the
> > plot: #20210310_193603
> > Please note that this XML contains all vx_mask not just east,
west,
> > and
> > CONUS.
> > If I select only those masks - I still get the plot:
> > # 20210310_194052
> >
> > Tatiana
> >
> > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov wrote:
> > > Here's a CSI example for ozmax8, one of the fields not being
> > > plotted
> > > for
> > > east, west, and CONUS.
> > >
> > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA Affiliate
<
> > > edward.strobach at noaa.gov> wrote:
> > >
> > > > I'm guessing you don't have access to WCOSS? If not, I can
copy
> > > > a
> > > > file
> > > > over for you.
> > > >
> > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > >> Ed,
> > > >> Having the XML that you use would be really helpful.
> > > >> I briefly looked at the data using following fields
> > > >> August 2020
> > > >> EAST
> > > >> PARA6C
> > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85',
'>105',
> > > >> '>125',
> > > >> '>150')
> > > >> OZMAX8
> > > >>
> > > >> Both tables with CNT and CTC types don't have any data with
> > > >> these
> > > >> parameters.
> > > >>
> > > >> Tatiana
> > > >>
> > > >>
> > > >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov wrote:
> > > >> > I'm not really sure I follow. Wouldn't this occur for all
> > > >> > regions
> > > >> > then,
> > > >> > not just East, West, and CONUS? The other regions report
> > > >> > these
> > > >> > thresholds
> > > >> > with all models being compared. The Pointstat configure
file
> > > >> > that
> > > >> > I
> > > >> > use
> > > >> > for these stats also confirms the thresholding exists in
that
> > > >> > file.
> > > >> > Moreover, I use ctc when processing plots such as CSI, FAR,
> > > >> > etc,
> > > >> > which
> > > >> > is
> > > >> > done on the thresholds I set in pointstat and the xml
files.
> > > >> >
> > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > > >> > <met_help at ucar.edu>
> > > >> > wrote:
> > > >> >
> > > >> > > Ed,
> > > >> > > It also would be helpful to see XML but I was able to use
> > > >> > > some
> > > >> > > info
> > > >> > > from
> > > >> > > the part of the query that you sent.
> > > >> > > I assume that you are interested on some agg stat
> > > >> > > calculations
> > > >> > > and
> > > >> > > use the
> > > >> > > data from sl1l2 table. The data in this table has only
one
> > > >> > > obs_thresh
> > > >> > > value
> > > >> > > - NA. That is why when you include other values like
">50'
> > > >> > > the
> > > >> > > query
> > > >> > > returns no data.
> > > >> > >
> > > >> > > Tatiana
> > > >> > >
> > > >> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov
wrote:
> > > >> > > > The database is mv_cmaq_metplus which should be under
the
> > > >> > > > group
> > > >> > > > name
> > > >> > > > Ed_Strobach. I did realize that my inputs were
switched
> > > >> > > > around
> > > >> > > > such
> > > >> > > > that
> > > >> > > > my group name was being designated as add instead of
> > > >> > > > Ed_Strobach.
> > > >> > > > I
> > > >> > > > have
> > > >> > > > since switched around the inputs but I don't think that
> > > >> > > > should
> > > >> > > > be
> > > >> > > > the
> > > >> > > > issue, at least I don't think so since the other data
was
> > > >> > > > uploaded
> > > >> > > > successfully. I was loading data this way:
> > > >> > > >
> > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
> > > >> > > > Ed_Strobach
> > > >> > > >
> > > >> > > > but should have instead been
> > > >> > > >
> > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
> > > >> > > > Ed_Strobach
> > > >> > > > add
> > > >> > > >
> > > >> > > > Not recognizing Ed_Strobach as an option (i.e. should
have
> > > >> > > > been
> > > >> > > > "add"
> > > >> > > > or
> > > >> > > > "new") it defaulted to add I think; but again, I'm not
> > > >> > > > sure
> > > >> > > > that
> > > >> > > > this
> > > >> > > > caused the issue..
> > > >> > > >
> > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > > >> > > > <met_help at ucar.edu>
> > > >> > > > wrote:
> > > >> > > >
> > > >> > > > > Ed,
> > > >> > > > > What is the name of the database that contains your
> > > >> > > > > data?
> > > >> > > > >
> > > >> > > > > Tatiana
> > > >> > > > >
> > > >> > > > > On Tue Mar 09 07:00:23 2021, edward.strobach at noaa.gov
> > > >> > > > > wrote:
> > > >> > > > > > Good morning,
> > > >> > > > > >
> > > >> > > > > > I recently put up a website
> > > >> > > > > > <
> > > >> > > > >
> > > >> > >
> > > >>
> >
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > >> > > > > >
> > > >> > > > > > with all the stats for different regions. Some
> > > >> > > > > > noticed
> > > >> > > > > > that
> > > >> > > > > > there
> > > >> > > > > > were no
> > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1
> > > >> > > > > > fields in
> > > >> > > > > > the
> > > >> > > > > > website
> > > >> > > > > > for
> > > >> > > > > > skill score type plots and performance diagrams. I
> > > >> > > > > > was
> > > >> > > > > > able to
> > > >> > > > > > determine
> > > >> > > > > > that there was no data being processed for those
> > > >> > > > > > regions
> > > >> > > > > > which
> > > >> > > > > > I
> > > >> > > > > > suspect is
> > > >> > > > > > the reason for this issue. Realizing this, I went
> > > >> > > > > > back
> > > >> > > > > > and
> > > >> > > > > > found
> > > >> > > > > > that
> > > >> > > > > > the
> > > >> > > > > > pointstat_config files did not contain those
regions.
> > > >> > > > > > After
> > > >> > > > > > adding
> > > >> > > > > > those
> > > >> > > > > > regions in I reprocessed everything and now have
stats
> > > >> > > > > > for
> > > >> > > > > > east,
> > > >> > > > > > west,
> > > >> > > > > > and
> > > >> > > > > > CONUS regions. I thought everything would have
> > > >> > > > > > plotted
> > > >> > > > > > successfully
> > > >> > > > > > for
> > > >> > > > > > those regions but found that this wasn't so.. In
fact,
> > > >> > > > > > I
> > > >> > > > > > still
> > > >> > > > > > get
> > > >> > > > > > the
> > > >> > > > > > same
> > > >> > > > > > error which is quite surprising to me. These
regions
> > > >> > > > > > have
> > > >> > > > > > been
> > > >> > > > > > requested
> > > >> > > > > > as essential for identifying the broader
performance
> > > >> > > > > > and
> > > >> > > > > > will
> > > >> > > > > > aid
> > > >> > > > > > in
> > > >> > > > > > decision making. I will have to get these up
soon...
> > > >> > > > > > I
> > > >> > > > > > was
> > > >> > > > > > wondering
> > > >> > > > > > if
> > > >> > > > > > there was something that stood out to you. Here's
the
> > > >> > > > > > error
> > > >> > > > > > that
> > > >> > > > > > keeps
> > > >> > > > > > coming up:
> > > >> > > > > >
> > > >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00', '2020-
08-
> > > >> > > > > > 30
> > > >> > > > > > 10:00:00',
> > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > >> > > > > > AND BINARY if( (select fcst_lead_offset FROM
> > > >> > > > > > model_fcst_lead_offset
> > > >> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
> > > >> > > > > > ld.fcst_lead +
> > > >> > > > > > (select
> > > >> > > > > > fcst_lead_offset FROM model_fcst_lead_offset WHERE
> > > >> > > > > > model =
> > > >> > > > > > h.model)
> > > >> > > > > > )
> > > >> > > > > > IN
> > > >> > > > > > ('0', '10000', '20000', '30000', '40000', '50000',
> > > >> > > > > > '60000',
> > > >> > > > > > '70000',
> > > >> > > > > > '80000', '90000', '100000', '110000', '120000',
> > > >> > > > > > '130000',
> > > >> > > > > > '140000',
> > > >> > > > > > '150000', '160000', '170000', '180000', '190000',
> > > >> > > > > > '200000',
> > > >> > > > > > '210000',
> > > >> > > > > > '220000', '230000', '240000', '250000', '260000',
> > > >> > > > > > '270000',
> > > >> > > > > > '280000',
> > > >> > > > > > '290000', '300000', '310000', '320000', '330000',
> > > >> > > > > > '340000',
> > > >> > > > > > '350000',
> > > >> > > > > > '360000', '370000', '380000', '390000', '400000',
> > > >> > > > > > '410000',
> > > >> > > > > > '420000',
> > > >> > > > > > '430000', '440000', '450000', '460000', '470000',
> > > >> > > > > > '480000')
> > > >> > > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC',
> > > >> > > > > > 'PROD',
> > > >> > > > > > 'PROD_BC')
> > > >> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60',
'>65',
> > > >> > > > > > '>70',
> > > >> > > > > > '>75',
> > > >> > > > > > '>85',
> > > >> > > > > > '>105', '>125', '>150')
> > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > > >> > > > > >
> > > >> > > > > > No data was returned from database
> > > >> > > > > > 2021-03-09
> > > >> > > > > >
> > > >> > > > >
> > > >> > >
> > > >>
> >
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > >> > > > > > Source) -1 printFormattedTable - ** ERROR:
Caught
> > > >> > > > > > class
> > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> > > >> > > > > > printFormattedTable(ResultSet
> > > >> > > > > > res): result set contained no data
> > > >> > > > > > ** ERROR: Caught class
> > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > >> > > > > > in
> > > >> > > > > > printFormattedTable(ResultSet res): result set
> > > >> > > > > > contained
> > > >> > > > > > no
> > > >> > > > > > data
> > > >> > > > > > ** ERROR: Caught class
> > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > >> > > > > > in
> > > >> > > > > > printFormattedTable(ResultSet res): result set
> > > >> > > > > > contained
> > > >> > > > > > no
> > > >> > > > > > data
> > > >> > > > > > Database query time for mv_cmaq_metplus 0:00:00.016
> > > >> > > > > > Save to file time for mv_cmaq_metplus 0:00:00.000
> > > >> > > > > >
> > > >> > > > > > You can view the stat files of those fields here:
> > > >> > > > > >
> > > >> > > > >
> > > >> > >
> > > >>
> >
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > >> > > > > >
> > > >> > > > > > The corresponding tags to those files are something
> > > >> > > > > > like
> > > >> > > > > > this:
> > > >> > > > > > PARA6C_AQMAX1*
> > > >> > > > > > PARA6C_AQMAX8*
> > > >> > > > > > PARA6C_BC_PMMAX*
> > > >> > > > > > PARA6C_BC_PMAVE*
> > > >> > > > > >
> > > >> > > > > > I have similar plots for PARA6C, PARA6C_BC, PROD,
and
> > > >> > > > > > PROD_BC.
> > > >> > > > > > I've
> > > >> > > > > > checked these files and these regions (i.e. EAST,
> > > >> > > > > > WEST,
> > > >> > > > > > CONUS)
> > > >> > > > > > appear
> > > >> > > > > > tabulated for ctc stats.
> > > >> > > > > >
> > > >> > > > > > Additionally, my files have been updated to match
the
> > > >> > > > > > inclusion
> > > >> > > > > > of
> > > >> > > > > > these
> > > >> > > > > > regions:
> > > >> > > > > > poly = [
> > > >> > > > > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > >> > > > > > "MET_BASE/poly/NWC.poly", "MET_BASE/poly/SWC.poly",
> > > >> > > > > > "MET_BASE/poly/NMT.poly", "MET_BASE/poly/SMT.poly",
> > > >> > > > > > "MET_BASE/poly/GRB.poly", "MET_BASE/poly/SWD.poly",
> > > >> > > > > > "MET_BASE/poly/NPL.poly", "MET_BASE/poly/SPL.poly",
> > > >> > > > > > "MET_BASE/poly/MDW.poly", "MET_BASE/poly/MDW.poly",
> > > >> > > > > > "MET_BASE/poly/LMV.poly", "MET_BASE/poly/GMC.poly",
> > > >> > > > > > "MET_BASE/poly/APL.poly",
"MET_BASE/poly/EAST.poly",
> > > >> > > > > > "MET_BASE/poly/WEST.poly",
"MET_BASE/poly/CONUS.poly"
> > > >> > > > > > ];
> > > >> > > > > >
> > > >> > > > > > The files that I'm using definitely have these
regions
> > > >> > > > > > as
> > > >> > > > > > well
> > > >> > > > > > as
> > > >> > > > > > seen
> > > >> > > > > > here:
> > > >> > > > > >
> > > >> > >
> > > >>
> >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > >> > > > > >
> > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > >> > > > > > PointStatConfig_ANOWPM_max
> > > >> > > > > >
> > > >> > > > > > I'm somewhat at a loss of what to do since
everything
> > > >> > > > > > else
> > > >> > > > > > seems
> > > >> > > > > > fine.
> > > >> > > > > > Has
> > > >> > > > > > this been seen before?
> > > >> > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > >
> > > >> > >
> > > >> > >
> > > >> > >
> > > >>
> > > >>
> > > >>
> > > >>
> >
> >
> >
> >
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Wed Mar 10 14:55:06 2021
I'm sharing a couple of screenshots that led me to this conclusion.
You
can see that there is a vx_mask_0 in one of the attachments and
vx_mask_4
in another. This is all under plot_fix. I got this from one of your
reference numbers: 20210310_194052.
I still just really want to know why. Part of the email I sent before
contains the real item that's in need of addressing; namely, why is
this an
issue for only these fields?
*All my plots have produced for all regions just fine in the past. If
you
look at ozone (not the max fields of ozone) you will see that all the
plots
are being generated and stored as they always have. The list provided
for
vx_mask in my xml files generates plots for all those regions. For
some
reason I am getting an empty plot for EAST, WEST, and CONUS for
OZMAX8,
OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any clues other
than
the error message I originally sent. *
The stat files have these regions with the corresponding statistics
included. If that's true, then what is going on? My point_stat
configure
file that contains the poly files include those regions. Is there
anything
else I can send that might be helpful?
On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> I did not understand your comment about the 'two fix fields for
vx_mask'.
> I create one vx_maskk fieldand add 3 values:
> <field equalize="false" name="vx_mask">
> <set name="vx_mask_0">
> <val>CONUS</val>
> <val>EAST</val>
> <val>WEST</val>
> </set>
> </field>
> this is equal to
> <field equalize="false" name="vx_mask">
> <val>CONUS</val>
> <val>EAST</val>
> <val>WEST</val>
> </field>
>
> I run the same config OZMAX1 and METviewer also generated a plot but
only
> for PARA6C and PARA6C_BC models: 20210310_213318
> The XML you sent me points METviewer to calculate summary
statistics. If
> agg statistic is selected - the plot would look differently:
20210310_213917
>
> Tatiana
>
>
> On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov wrote:
> > Thanks... I'm hoping that I can get an explanation on why things
> > didn't
> > work. I was under the impression from my emails with John that I
> > could
> > simply list the regions that I wanted processed under the "fix"
tab.
> > Now
> > it seems that you are creating two fix fields for vx_mask, one of
> > which
> > duplicates EAST, WEST, and CONUS. Why is this the solution? All
my
> > plots
> > have produced for all regions just fine in the past. If you look
at
> > ozone
> > (not the max fields of ozone) you will see that all the plots are
> > being
> > generated and stored as they always have. The list provided for
> > vx_mask in
> > my xml files generates plots for all those regions. For some
reason I
> > am
> > getting an empty plot for EAST, WEST, and CONUS for OZMAX8,
OZMAX1,
> > PDMAX1,
> > and PMAVE. I haven't been able to get any clues other than the
error
> > message I originally sent. I have to say that the plot number
> > reference
> > that you sent me yielded a CSI curve that I've never seen in any
of
> > the
> > plots I looked at. Not sure what's going on with that plot.
> >
> >
> > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Ed,
> > > I recreated the XML that you sent me on the web app page and
produced
> > > the
> > > plot: #20210310_193603
> > > Please note that this XML contains all vx_mask not just east,
west,
> > > and
> > > CONUS.
> > > If I select only those masks - I still get the plot:
> > > # 20210310_194052
> > >
> > > Tatiana
> > >
> > > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov wrote:
> > > > Here's a CSI example for ozmax8, one of the fields not being
> > > > plotted
> > > > for
> > > > east, west, and CONUS.
> > > >
> > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA
Affiliate <
> > > > edward.strobach at noaa.gov> wrote:
> > > >
> > > > > I'm guessing you don't have access to WCOSS? If not, I can
copy
> > > > > a
> > > > > file
> > > > > over for you.
> > > > >
> > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > >> Ed,
> > > > >> Having the XML that you use would be really helpful.
> > > > >> I briefly looked at the data using following fields
> > > > >> August 2020
> > > > >> EAST
> > > > >> PARA6C
> > > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85',
'>105',
> > > > >> '>125',
> > > > >> '>150')
> > > > >> OZMAX8
> > > > >>
> > > > >> Both tables with CNT and CTC types don't have any data with
> > > > >> these
> > > > >> parameters.
> > > > >>
> > > > >> Tatiana
> > > > >>
> > > > >>
> > > > >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov
wrote:
> > > > >> > I'm not really sure I follow. Wouldn't this occur for
all
> > > > >> > regions
> > > > >> > then,
> > > > >> > not just East, West, and CONUS? The other regions report
> > > > >> > these
> > > > >> > thresholds
> > > > >> > with all models being compared. The Pointstat configure
file
> > > > >> > that
> > > > >> > I
> > > > >> > use
> > > > >> > for these stats also confirms the thresholding exists in
that
> > > > >> > file.
> > > > >> > Moreover, I use ctc when processing plots such as CSI,
FAR,
> > > > >> > etc,
> > > > >> > which
> > > > >> > is
> > > > >> > done on the thresholds I set in pointstat and the xml
files.
> > > > >> >
> > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > > > >> > <met_help at ucar.edu>
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Ed,
> > > > >> > > It also would be helpful to see XML but I was able to
use
> > > > >> > > some
> > > > >> > > info
> > > > >> > > from
> > > > >> > > the part of the query that you sent.
> > > > >> > > I assume that you are interested on some agg stat
> > > > >> > > calculations
> > > > >> > > and
> > > > >> > > use the
> > > > >> > > data from sl1l2 table. The data in this table has only
one
> > > > >> > > obs_thresh
> > > > >> > > value
> > > > >> > > - NA. That is why when you include other values like
">50'
> > > > >> > > the
> > > > >> > > query
> > > > >> > > returns no data.
> > > > >> > >
> > > > >> > > Tatiana
> > > > >> > >
> > > > >> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov
wrote:
> > > > >> > > > The database is mv_cmaq_metplus which should be under
the
> > > > >> > > > group
> > > > >> > > > name
> > > > >> > > > Ed_Strobach. I did realize that my inputs were
switched
> > > > >> > > > around
> > > > >> > > > such
> > > > >> > > > that
> > > > >> > > > my group name was being designated as add instead of
> > > > >> > > > Ed_Strobach.
> > > > >> > > > I
> > > > >> > > > have
> > > > >> > > > since switched around the inputs but I don't think
that
> > > > >> > > > should
> > > > >> > > > be
> > > > >> > > > the
> > > > >> > > > issue, at least I don't think so since the other data
was
> > > > >> > > > uploaded
> > > > >> > > > successfully. I was loading data this way:
> > > > >> > > >
> > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
> > > > >> > > > Ed_Strobach
> > > > >> > > >
> > > > >> > > > but should have instead been
> > > > >> > > >
> > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
> > > > >> > > > Ed_Strobach
> > > > >> > > > add
> > > > >> > > >
> > > > >> > > > Not recognizing Ed_Strobach as an option (i.e. should
have
> > > > >> > > > been
> > > > >> > > > "add"
> > > > >> > > > or
> > > > >> > > > "new") it defaulted to add I think; but again, I'm
not
> > > > >> > > > sure
> > > > >> > > > that
> > > > >> > > > this
> > > > >> > > > caused the issue..
> > > > >> > > >
> > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > > > >> > > > <met_help at ucar.edu>
> > > > >> > > > wrote:
> > > > >> > > >
> > > > >> > > > > Ed,
> > > > >> > > > > What is the name of the database that contains your
> > > > >> > > > > data?
> > > > >> > > > >
> > > > >> > > > > Tatiana
> > > > >> > > > >
> > > > >> > > > > On Tue Mar 09 07:00:23 2021,
edward.strobach at noaa.gov
> > > > >> > > > > wrote:
> > > > >> > > > > > Good morning,
> > > > >> > > > > >
> > > > >> > > > > > I recently put up a website
> > > > >> > > > > > <
> > > > >> > > > >
> > > > >> > >
> > > > >>
> > >
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > >> > > > > >
> > > > >> > > > > > with all the stats for different regions. Some
> > > > >> > > > > > noticed
> > > > >> > > > > > that
> > > > >> > > > > > there
> > > > >> > > > > > were no
> > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and PDMAX1
> > > > >> > > > > > fields in
> > > > >> > > > > > the
> > > > >> > > > > > website
> > > > >> > > > > > for
> > > > >> > > > > > skill score type plots and performance diagrams.
I
> > > > >> > > > > > was
> > > > >> > > > > > able to
> > > > >> > > > > > determine
> > > > >> > > > > > that there was no data being processed for those
> > > > >> > > > > > regions
> > > > >> > > > > > which
> > > > >> > > > > > I
> > > > >> > > > > > suspect is
> > > > >> > > > > > the reason for this issue. Realizing this, I
went
> > > > >> > > > > > back
> > > > >> > > > > > and
> > > > >> > > > > > found
> > > > >> > > > > > that
> > > > >> > > > > > the
> > > > >> > > > > > pointstat_config files did not contain those
regions.
> > > > >> > > > > > After
> > > > >> > > > > > adding
> > > > >> > > > > > those
> > > > >> > > > > > regions in I reprocessed everything and now have
stats
> > > > >> > > > > > for
> > > > >> > > > > > east,
> > > > >> > > > > > west,
> > > > >> > > > > > and
> > > > >> > > > > > CONUS regions. I thought everything would have
> > > > >> > > > > > plotted
> > > > >> > > > > > successfully
> > > > >> > > > > > for
> > > > >> > > > > > those regions but found that this wasn't so.. In
fact,
> > > > >> > > > > > I
> > > > >> > > > > > still
> > > > >> > > > > > get
> > > > >> > > > > > the
> > > > >> > > > > > same
> > > > >> > > > > > error which is quite surprising to me. These
regions
> > > > >> > > > > > have
> > > > >> > > > > > been
> > > > >> > > > > > requested
> > > > >> > > > > > as essential for identifying the broader
performance
> > > > >> > > > > > and
> > > > >> > > > > > will
> > > > >> > > > > > aid
> > > > >> > > > > > in
> > > > >> > > > > > decision making. I will have to get these up
soon...
> > > > >> > > > > > I
> > > > >> > > > > > was
> > > > >> > > > > > wondering
> > > > >> > > > > > if
> > > > >> > > > > > there was something that stood out to you.
Here's the
> > > > >> > > > > > error
> > > > >> > > > > > that
> > > > >> > > > > > keeps
> > > > >> > > > > > coming up:
> > > > >> > > > > >
> > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00',
'2020-08-
> > > > >> > > > > > 30
> > > > >> > > > > > 10:00:00',
> > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > > >> > > > > > AND BINARY if( (select fcst_lead_offset FROM
> > > > >> > > > > > model_fcst_lead_offset
> > > > >> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
> > > > >> > > > > > ld.fcst_lead +
> > > > >> > > > > > (select
> > > > >> > > > > > fcst_lead_offset FROM model_fcst_lead_offset
WHERE
> > > > >> > > > > > model =
> > > > >> > > > > > h.model)
> > > > >> > > > > > )
> > > > >> > > > > > IN
> > > > >> > > > > > ('0', '10000', '20000', '30000', '40000',
'50000',
> > > > >> > > > > > '60000',
> > > > >> > > > > > '70000',
> > > > >> > > > > > '80000', '90000', '100000', '110000', '120000',
> > > > >> > > > > > '130000',
> > > > >> > > > > > '140000',
> > > > >> > > > > > '150000', '160000', '170000', '180000', '190000',
> > > > >> > > > > > '200000',
> > > > >> > > > > > '210000',
> > > > >> > > > > > '220000', '230000', '240000', '250000', '260000',
> > > > >> > > > > > '270000',
> > > > >> > > > > > '280000',
> > > > >> > > > > > '290000', '300000', '310000', '320000', '330000',
> > > > >> > > > > > '340000',
> > > > >> > > > > > '350000',
> > > > >> > > > > > '360000', '370000', '380000', '390000', '400000',
> > > > >> > > > > > '410000',
> > > > >> > > > > > '420000',
> > > > >> > > > > > '430000', '440000', '450000', '460000', '470000',
> > > > >> > > > > > '480000')
> > > > >> > > > > > AND BINARY h.model IN ('PARA6C', 'PARA6C_BC',
> > > > >> > > > > > 'PROD',
> > > > >> > > > > > 'PROD_BC')
> > > > >> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60',
'>65',
> > > > >> > > > > > '>70',
> > > > >> > > > > > '>75',
> > > > >> > > > > > '>85',
> > > > >> > > > > > '>105', '>125', '>150')
> > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > > > >> > > > > >
> > > > >> > > > > > No data was returned from database
> > > > >> > > > > > 2021-03-09
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > >
> > > > >>
> > >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > >> > > > > > Source) -1 printFormattedTable - ** ERROR:
Caught
> > > > >> > > > > > class
> > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> > > > >> > > > > > printFormattedTable(ResultSet
> > > > >> > > > > > res): result set contained no data
> > > > >> > > > > > ** ERROR: Caught class
> > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > >> > > > > > in
> > > > >> > > > > > printFormattedTable(ResultSet res): result set
> > > > >> > > > > > contained
> > > > >> > > > > > no
> > > > >> > > > > > data
> > > > >> > > > > > ** ERROR: Caught class
> > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > >> > > > > > in
> > > > >> > > > > > printFormattedTable(ResultSet res): result set
> > > > >> > > > > > contained
> > > > >> > > > > > no
> > > > >> > > > > > data
> > > > >> > > > > > Database query time for mv_cmaq_metplus
0:00:00.016
> > > > >> > > > > > Save to file time for mv_cmaq_metplus
0:00:00.000
> > > > >> > > > > >
> > > > >> > > > > > You can view the stat files of those fields here:
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > >
> > > > >>
> > >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > >> > > > > >
> > > > >> > > > > > The corresponding tags to those files are
something
> > > > >> > > > > > like
> > > > >> > > > > > this:
> > > > >> > > > > > PARA6C_AQMAX1*
> > > > >> > > > > > PARA6C_AQMAX8*
> > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > >> > > > > >
> > > > >> > > > > > I have similar plots for PARA6C, PARA6C_BC, PROD,
and
> > > > >> > > > > > PROD_BC.
> > > > >> > > > > > I've
> > > > >> > > > > > checked these files and these regions (i.e. EAST,
> > > > >> > > > > > WEST,
> > > > >> > > > > > CONUS)
> > > > >> > > > > > appear
> > > > >> > > > > > tabulated for ctc stats.
> > > > >> > > > > >
> > > > >> > > > > > Additionally, my files have been updated to match
the
> > > > >> > > > > > inclusion
> > > > >> > > > > > of
> > > > >> > > > > > these
> > > > >> > > > > > regions:
> > > > >> > > > > > poly = [
> > > > >> > > > > >
"MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > >> > > > > > "MET_BASE/poly/NWC.poly",
"MET_BASE/poly/SWC.poly",
> > > > >> > > > > > "MET_BASE/poly/NMT.poly",
"MET_BASE/poly/SMT.poly",
> > > > >> > > > > > "MET_BASE/poly/GRB.poly",
"MET_BASE/poly/SWD.poly",
> > > > >> > > > > > "MET_BASE/poly/NPL.poly",
"MET_BASE/poly/SPL.poly",
> > > > >> > > > > > "MET_BASE/poly/MDW.poly",
"MET_BASE/poly/MDW.poly",
> > > > >> > > > > > "MET_BASE/poly/LMV.poly",
"MET_BASE/poly/GMC.poly",
> > > > >> > > > > > "MET_BASE/poly/APL.poly",
"MET_BASE/poly/EAST.poly",
> > > > >> > > > > > "MET_BASE/poly/WEST.poly",
"MET_BASE/poly/CONUS.poly"
> > > > >> > > > > > ];
> > > > >> > > > > >
> > > > >> > > > > > The files that I'm using definitely have these
regions
> > > > >> > > > > > as
> > > > >> > > > > > well
> > > > >> > > > > > as
> > > > >> > > > > > seen
> > > > >> > > > > > here:
> > > > >> > > > > >
> > > > >> > >
> > > > >>
> > >
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > >> > > > > >
> > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > >> > > > > >
> > > > >> > > > > > I'm somewhat at a loss of what to do since
everything
> > > > >> > > > > > else
> > > > >> > > > > > seems
> > > > >> > > > > > fine.
> > > > >> > > > > > Has
> > > > >> > > > > > this been seen before?
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > >
> > > > >> > >
> > > > >> > >
> > > > >> > >
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Mon Mar 15 07:59:17 2021
Ed,
Please, sent the XML file that actually produces the error. With the
XML you sent me before or just creating the plots randomly I always
have a valid plot.
Tatiana
On Wed Mar 10 14:55:06 2021, edward.strobach at noaa.gov wrote:
> I'm sharing a couple of screenshots that led me to this conclusion.
> You
> can see that there is a vx_mask_0 in one of the attachments and
> vx_mask_4
> in another. This is all under plot_fix. I got this from one of
your
> reference numbers: 20210310_194052.
>
> I still just really want to know why. Part of the email I sent
before
> contains the real item that's in need of addressing; namely, why is
> this an
> issue for only these fields?
>
>
> *All my plots have produced for all regions just fine in the past.
If
> you
> look at ozone (not the max fields of ozone) you will see that all
the
> plots
> are being generated and stored as they always have. The list
provided
> for
> vx_mask in my xml files generates plots for all those regions. For
> some
> reason I am getting an empty plot for EAST, WEST, and CONUS for
> OZMAX8,
> OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any clues
other
> than
> the error message I originally sent. *
>
> The stat files have these regions with the corresponding statistics
> included. If that's true, then what is going on? My point_stat
> configure
> file that contains the poly files include those regions. Is there
> anything
> else I can send that might be helpful?
>
> On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > I did not understand your comment about the 'two fix fields for
> > vx_mask'.
> > I create one vx_maskk fieldand add 3 values:
> > <field equalize="false" name="vx_mask">
> > <set name="vx_mask_0">
> > <val>CONUS</val>
> > <val>EAST</val>
> > <val>WEST</val>
> > </set>
> > </field>
> > this is equal to
> > <field equalize="false" name="vx_mask">
> > <val>CONUS</val>
> > <val>EAST</val>
> > <val>WEST</val>
> > </field>
> >
> > I run the same config OZMAX1 and METviewer also generated a plot
but
> > only
> > for PARA6C and PARA6C_BC models: 20210310_213318
> > The XML you sent me points METviewer to calculate summary
statistics.
> > If
> > agg statistic is selected - the plot would look differently:
> > 20210310_213917
> >
> > Tatiana
> >
> >
> > On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov wrote:
> > > Thanks... I'm hoping that I can get an explanation on why things
> > > didn't
> > > work. I was under the impression from my emails with John that
I
> > > could
> > > simply list the regions that I wanted processed under the "fix"
> > > tab.
> > > Now
> > > it seems that you are creating two fix fields for vx_mask, one
of
> > > which
> > > duplicates EAST, WEST, and CONUS. Why is this the solution?
All
> > > my
> > > plots
> > > have produced for all regions just fine in the past. If you
look
> > > at
> > > ozone
> > > (not the max fields of ozone) you will see that all the plots
are
> > > being
> > > generated and stored as they always have. The list provided for
> > > vx_mask in
> > > my xml files generates plots for all those regions. For some
> > > reason I
> > > am
> > > getting an empty plot for EAST, WEST, and CONUS for OZMAX8,
OZMAX1,
> > > PDMAX1,
> > > and PMAVE. I haven't been able to get any clues other than the
> > > error
> > > message I originally sent. I have to say that the plot number
> > > reference
> > > that you sent me yielded a CSI curve that I've never seen in any
of
> > > the
> > > plots I looked at. Not sure what's going on with that plot.
> > >
> > >
> > > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > Ed,
> > > > I recreated the XML that you sent me on the web app page and
> > > > produced
> > > > the
> > > > plot: #20210310_193603
> > > > Please note that this XML contains all vx_mask not just east,
> > > > west,
> > > > and
> > > > CONUS.
> > > > If I select only those masks - I still get the plot:
> > > > # 20210310_194052
> > > >
> > > > Tatiana
> > > >
> > > > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov wrote:
> > > > > Here's a CSI example for ozmax8, one of the fields not being
> > > > > plotted
> > > > > for
> > > > > east, west, and CONUS.
> > > > >
> > > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA
Affiliate
> > > > > <
> > > > > edward.strobach at noaa.gov> wrote:
> > > > >
> > > > > > I'm guessing you don't have access to WCOSS? If not, I
can
> > > > > > copy
> > > > > > a
> > > > > > file
> > > > > > over for you.
> > > > > >
> > > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > >> Ed,
> > > > > >> Having the XML that you use would be really helpful.
> > > > > >> I briefly looked at the data using following fields
> > > > > >> August 2020
> > > > > >> EAST
> > > > > >> PARA6C
> > > > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75', '>85',
> > > > > >> '>105',
> > > > > >> '>125',
> > > > > >> '>150')
> > > > > >> OZMAX8
> > > > > >>
> > > > > >> Both tables with CNT and CTC types don't have any data
with
> > > > > >> these
> > > > > >> parameters.
> > > > > >>
> > > > > >> Tatiana
> > > > > >>
> > > > > >>
> > > > > >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov
wrote:
> > > > > >> > I'm not really sure I follow. Wouldn't this occur for
all
> > > > > >> > regions
> > > > > >> > then,
> > > > > >> > not just East, West, and CONUS? The other regions
report
> > > > > >> > these
> > > > > >> > thresholds
> > > > > >> > with all models being compared. The Pointstat
configure
> > > > > >> > file
> > > > > >> > that
> > > > > >> > I
> > > > > >> > use
> > > > > >> > for these stats also confirms the thresholding exists
in
> > > > > >> > that
> > > > > >> > file.
> > > > > >> > Moreover, I use ctc when processing plots such as CSI,
> > > > > >> > FAR,
> > > > > >> > etc,
> > > > > >> > which
> > > > > >> > is
> > > > > >> > done on the thresholds I set in pointstat and the xml
> > > > > >> > files.
> > > > > >> >
> > > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > > > > >> > <met_help at ucar.edu>
> > > > > >> > wrote:
> > > > > >> >
> > > > > >> > > Ed,
> > > > > >> > > It also would be helpful to see XML but I was able to
> > > > > >> > > use
> > > > > >> > > some
> > > > > >> > > info
> > > > > >> > > from
> > > > > >> > > the part of the query that you sent.
> > > > > >> > > I assume that you are interested on some agg stat
> > > > > >> > > calculations
> > > > > >> > > and
> > > > > >> > > use the
> > > > > >> > > data from sl1l2 table. The data in this table has
only
> > > > > >> > > one
> > > > > >> > > obs_thresh
> > > > > >> > > value
> > > > > >> > > - NA. That is why when you include other values like
> > > > > >> > > ">50'
> > > > > >> > > the
> > > > > >> > > query
> > > > > >> > > returns no data.
> > > > > >> > >
> > > > > >> > > Tatiana
> > > > > >> > >
> > > > > >> > > On Tue Mar 09 07:55:16 2021, edward.strobach at noaa.gov
> > > > > >> > > wrote:
> > > > > >> > > > The database is mv_cmaq_metplus which should be
under
> > > > > >> > > > the
> > > > > >> > > > group
> > > > > >> > > > name
> > > > > >> > > > Ed_Strobach. I did realize that my inputs were
> > > > > >> > > > switched
> > > > > >> > > > around
> > > > > >> > > > such
> > > > > >> > > > that
> > > > > >> > > > my group name was being designated as add instead
of
> > > > > >> > > > Ed_Strobach.
> > > > > >> > > > I
> > > > > >> > > > have
> > > > > >> > > > since switched around the inputs but I don't think
> > > > > >> > > > that
> > > > > >> > > > should
> > > > > >> > > > be
> > > > > >> > > > the
> > > > > >> > > > issue, at least I don't think so since the other
data
> > > > > >> > > > was
> > > > > >> > > > uploaded
> > > > > >> > > > successfully. I was loading data this way:
> > > > > >> > > >
> > > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus add
> > > > > >> > > > Ed_Strobach
> > > > > >> > > >
> > > > > >> > > > but should have instead been
> > > > > >> > > >
> > > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
> > > > > >> > > > Ed_Strobach
> > > > > >> > > > add
> > > > > >> > > >
> > > > > >> > > > Not recognizing Ed_Strobach as an option (i.e.
should
> > > > > >> > > > have
> > > > > >> > > > been
> > > > > >> > > > "add"
> > > > > >> > > > or
> > > > > >> > > > "new") it defaulted to add I think; but again, I'm
not
> > > > > >> > > > sure
> > > > > >> > > > that
> > > > > >> > > > this
> > > > > >> > > > caused the issue..
> > > > > >> > > >
> > > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via RT
> > > > > >> > > > <met_help at ucar.edu>
> > > > > >> > > > wrote:
> > > > > >> > > >
> > > > > >> > > > > Ed,
> > > > > >> > > > > What is the name of the database that contains
your
> > > > > >> > > > > data?
> > > > > >> > > > >
> > > > > >> > > > > Tatiana
> > > > > >> > > > >
> > > > > >> > > > > On Tue Mar 09 07:00:23 2021,
> > > > > >> > > > > edward.strobach at noaa.gov
> > > > > >> > > > > wrote:
> > > > > >> > > > > > Good morning,
> > > > > >> > > > > >
> > > > > >> > > > > > I recently put up a website
> > > > > >> > > > > > <
> > > > > >> > > > >
> > > > > >> > >
> > > > > >>
> > > >
> >
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > >> > > > > >
> > > > > >> > > > > > with all the stats for different regions. Some
> > > > > >> > > > > > noticed
> > > > > >> > > > > > that
> > > > > >> > > > > > there
> > > > > >> > > > > > were no
> > > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and
PDMAX1
> > > > > >> > > > > > fields in
> > > > > >> > > > > > the
> > > > > >> > > > > > website
> > > > > >> > > > > > for
> > > > > >> > > > > > skill score type plots and performance
diagrams.
> > > > > >> > > > > > I
> > > > > >> > > > > > was
> > > > > >> > > > > > able to
> > > > > >> > > > > > determine
> > > > > >> > > > > > that there was no data being processed for
those
> > > > > >> > > > > > regions
> > > > > >> > > > > > which
> > > > > >> > > > > > I
> > > > > >> > > > > > suspect is
> > > > > >> > > > > > the reason for this issue. Realizing this, I
went
> > > > > >> > > > > > back
> > > > > >> > > > > > and
> > > > > >> > > > > > found
> > > > > >> > > > > > that
> > > > > >> > > > > > the
> > > > > >> > > > > > pointstat_config files did not contain those
> > > > > >> > > > > > regions.
> > > > > >> > > > > > After
> > > > > >> > > > > > adding
> > > > > >> > > > > > those
> > > > > >> > > > > > regions in I reprocessed everything and now
have
> > > > > >> > > > > > stats
> > > > > >> > > > > > for
> > > > > >> > > > > > east,
> > > > > >> > > > > > west,
> > > > > >> > > > > > and
> > > > > >> > > > > > CONUS regions. I thought everything would have
> > > > > >> > > > > > plotted
> > > > > >> > > > > > successfully
> > > > > >> > > > > > for
> > > > > >> > > > > > those regions but found that this wasn't so..
In
> > > > > >> > > > > > fact,
> > > > > >> > > > > > I
> > > > > >> > > > > > still
> > > > > >> > > > > > get
> > > > > >> > > > > > the
> > > > > >> > > > > > same
> > > > > >> > > > > > error which is quite surprising to me. These
> > > > > >> > > > > > regions
> > > > > >> > > > > > have
> > > > > >> > > > > > been
> > > > > >> > > > > > requested
> > > > > >> > > > > > as essential for identifying the broader
> > > > > >> > > > > > performance
> > > > > >> > > > > > and
> > > > > >> > > > > > will
> > > > > >> > > > > > aid
> > > > > >> > > > > > in
> > > > > >> > > > > > decision making. I will have to get these up
> > > > > >> > > > > > soon...
> > > > > >> > > > > > I
> > > > > >> > > > > > was
> > > > > >> > > > > > wondering
> > > > > >> > > > > > if
> > > > > >> > > > > > there was something that stood out to you.
Here's
> > > > > >> > > > > > the
> > > > > >> > > > > > error
> > > > > >> > > > > > that
> > > > > >> > > > > > keeps
> > > > > >> > > > > > coming up:
> > > > > >> > > > > >
> > > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00',
'2020-
> > > > > >> > > > > > 08-
> > > > > >> > > > > > 30
> > > > > >> > > > > > 10:00:00',
> > > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > > > >> > > > > > AND BINARY if( (select fcst_lead_offset
FROM
> > > > > >> > > > > > model_fcst_lead_offset
> > > > > >> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead ,
> > > > > >> > > > > > ld.fcst_lead +
> > > > > >> > > > > > (select
> > > > > >> > > > > > fcst_lead_offset FROM model_fcst_lead_offset
WHERE
> > > > > >> > > > > > model =
> > > > > >> > > > > > h.model)
> > > > > >> > > > > > )
> > > > > >> > > > > > IN
> > > > > >> > > > > > ('0', '10000', '20000', '30000', '40000',
'50000',
> > > > > >> > > > > > '60000',
> > > > > >> > > > > > '70000',
> > > > > >> > > > > > '80000', '90000', '100000', '110000', '120000',
> > > > > >> > > > > > '130000',
> > > > > >> > > > > > '140000',
> > > > > >> > > > > > '150000', '160000', '170000', '180000',
'190000',
> > > > > >> > > > > > '200000',
> > > > > >> > > > > > '210000',
> > > > > >> > > > > > '220000', '230000', '240000', '250000',
'260000',
> > > > > >> > > > > > '270000',
> > > > > >> > > > > > '280000',
> > > > > >> > > > > > '290000', '300000', '310000', '320000',
'330000',
> > > > > >> > > > > > '340000',
> > > > > >> > > > > > '350000',
> > > > > >> > > > > > '360000', '370000', '380000', '390000',
'400000',
> > > > > >> > > > > > '410000',
> > > > > >> > > > > > '420000',
> > > > > >> > > > > > '430000', '440000', '450000', '460000',
'470000',
> > > > > >> > > > > > '480000')
> > > > > >> > > > > > AND BINARY h.model IN ('PARA6C',
'PARA6C_BC',
> > > > > >> > > > > > 'PROD',
> > > > > >> > > > > > 'PROD_BC')
> > > > > >> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60',
> > > > > >> > > > > > '>65',
> > > > > >> > > > > > '>70',
> > > > > >> > > > > > '>75',
> > > > > >> > > > > > '>85',
> > > > > >> > > > > > '>105', '>125', '>150')
> > > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > > > > >> > > > > >
> > > > > >> > > > > > No data was returned from database
> > > > > >> > > > > > 2021-03-09
> > > > > >> > > > > >
> > > > > >> > > > >
> > > > > >> > >
> > > > > >>
> > > >
> >
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > >> > > > > > Source) -1 printFormattedTable - ** ERROR:
> > > > > >> > > > > > Caught
> > > > > >> > > > > > class
> > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> > > > > >> > > > > > printFormattedTable(ResultSet
> > > > > >> > > > > > res): result set contained no data
> > > > > >> > > > > > ** ERROR: Caught class
> > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > >> > > > > > in
> > > > > >> > > > > > printFormattedTable(ResultSet res): result set
> > > > > >> > > > > > contained
> > > > > >> > > > > > no
> > > > > >> > > > > > data
> > > > > >> > > > > > ** ERROR: Caught class
> > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > >> > > > > > in
> > > > > >> > > > > > printFormattedTable(ResultSet res): result set
> > > > > >> > > > > > contained
> > > > > >> > > > > > no
> > > > > >> > > > > > data
> > > > > >> > > > > > Database query time for mv_cmaq_metplus
> > > > > >> > > > > > 0:00:00.016
> > > > > >> > > > > > Save to file time for mv_cmaq_metplus
> > > > > >> > > > > > 0:00:00.000
> > > > > >> > > > > >
> > > > > >> > > > > > You can view the stat files of those fields
here:
> > > > > >> > > > > >
> > > > > >> > > > >
> > > > > >> > >
> > > > > >>
> > > >
> >
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > >> > > > > >
> > > > > >> > > > > > The corresponding tags to those files are
> > > > > >> > > > > > something
> > > > > >> > > > > > like
> > > > > >> > > > > > this:
> > > > > >> > > > > > PARA6C_AQMAX1*
> > > > > >> > > > > > PARA6C_AQMAX8*
> > > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > > >> > > > > >
> > > > > >> > > > > > I have similar plots for PARA6C, PARA6C_BC,
PROD,
> > > > > >> > > > > > and
> > > > > >> > > > > > PROD_BC.
> > > > > >> > > > > > I've
> > > > > >> > > > > > checked these files and these regions (i.e.
EAST,
> > > > > >> > > > > > WEST,
> > > > > >> > > > > > CONUS)
> > > > > >> > > > > > appear
> > > > > >> > > > > > tabulated for ctc stats.
> > > > > >> > > > > >
> > > > > >> > > > > > Additionally, my files have been updated to
match
> > > > > >> > > > > > the
> > > > > >> > > > > > inclusion
> > > > > >> > > > > > of
> > > > > >> > > > > > these
> > > > > >> > > > > > regions:
> > > > > >> > > > > > poly = [
> > > > > >> > > > > >
"MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > >> > > > > > "MET_BASE/poly/NWC.poly",
> > > > > >> > > > > > "MET_BASE/poly/SWC.poly",
> > > > > >> > > > > > "MET_BASE/poly/NMT.poly",
> > > > > >> > > > > > "MET_BASE/poly/SMT.poly",
> > > > > >> > > > > > "MET_BASE/poly/GRB.poly",
> > > > > >> > > > > > "MET_BASE/poly/SWD.poly",
> > > > > >> > > > > > "MET_BASE/poly/NPL.poly",
> > > > > >> > > > > > "MET_BASE/poly/SPL.poly",
> > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > >> > > > > > "MET_BASE/poly/LMV.poly",
> > > > > >> > > > > > "MET_BASE/poly/GMC.poly",
> > > > > >> > > > > > "MET_BASE/poly/APL.poly",
> > > > > >> > > > > > "MET_BASE/poly/EAST.poly",
> > > > > >> > > > > > "MET_BASE/poly/WEST.poly",
> > > > > >> > > > > > "MET_BASE/poly/CONUS.poly"
> > > > > >> > > > > > ];
> > > > > >> > > > > >
> > > > > >> > > > > > The files that I'm using definitely have these
> > > > > >> > > > > > regions
> > > > > >> > > > > > as
> > > > > >> > > > > > well
> > > > > >> > > > > > as
> > > > > >> > > > > > seen
> > > > > >> > > > > > here:
> > > > > >> > > > > >
> > > > > >> > >
> > > > > >>
> > > >
> >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > >> > > > > >
> > > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > > >> > > > > >
> > > > > >> > > > > > I'm somewhat at a loss of what to do since
> > > > > >> > > > > > everything
> > > > > >> > > > > > else
> > > > > >> > > > > > seems
> > > > > >> > > > > > fine.
> > > > > >> > > > > > Has
> > > > > >> > > > > > this been seen before?
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > >
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Mon Mar 15 08:34:36 2021
hmm.. I thought I did send an example last week. I'll send the
original
and a new one. So I basically use the same xml file for the following
variables: OZCON, PMTF, OZMAX1, OZMAX8, PDMAX1, and PMAVE. The first
two
fields have no problem producing stats for east, west, and CONUS
(eliminating conus now though so don't worry about that region) while
no
stats are generated for the other fields. This occurs even though the
stats are being populated in the .stat files for these regions.
On Mon, Mar 15, 2021 at 9:59 AM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> Ed,
> Please, sent the XML file that actually produces the error. With the
XML
> you sent me before or just creating the plots randomly I always have
a
> valid plot.
>
> Tatiana
>
> On Wed Mar 10 14:55:06 2021, edward.strobach at noaa.gov wrote:
> > I'm sharing a couple of screenshots that led me to this
conclusion.
> > You
> > can see that there is a vx_mask_0 in one of the attachments and
> > vx_mask_4
> > in another. This is all under plot_fix. I got this from one of
your
> > reference numbers: 20210310_194052.
> >
> > I still just really want to know why. Part of the email I sent
before
> > contains the real item that's in need of addressing; namely, why
is
> > this an
> > issue for only these fields?
> >
> >
> > *All my plots have produced for all regions just fine in the past.
If
> > you
> > look at ozone (not the max fields of ozone) you will see that all
the
> > plots
> > are being generated and stored as they always have. The list
provided
> > for
> > vx_mask in my xml files generates plots for all those regions.
For
> > some
> > reason I am getting an empty plot for EAST, WEST, and CONUS for
> > OZMAX8,
> > OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any clues
other
> > than
> > the error message I originally sent. *
> >
> > The stat files have these regions with the corresponding
statistics
> > included. If that's true, then what is going on? My point_stat
> > configure
> > file that contains the poly files include those regions. Is there
> > anything
> > else I can send that might be helpful?
> >
> > On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > I did not understand your comment about the 'two fix fields for
> > > vx_mask'.
> > > I create one vx_maskk fieldand add 3 values:
> > > <field equalize="false" name="vx_mask">
> > > <set name="vx_mask_0">
> > > <val>CONUS</val>
> > > <val>EAST</val>
> > > <val>WEST</val>
> > > </set>
> > > </field>
> > > this is equal to
> > > <field equalize="false" name="vx_mask">
> > > <val>CONUS</val>
> > > <val>EAST</val>
> > > <val>WEST</val>
> > > </field>
> > >
> > > I run the same config OZMAX1 and METviewer also generated a plot
but
> > > only
> > > for PARA6C and PARA6C_BC models: 20210310_213318
> > > The XML you sent me points METviewer to calculate summary
statistics.
> > > If
> > > agg statistic is selected - the plot would look differently:
> > > 20210310_213917
> > >
> > > Tatiana
> > >
> > >
> > > On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov wrote:
> > > > Thanks... I'm hoping that I can get an explanation on why
things
> > > > didn't
> > > > work. I was under the impression from my emails with John
that I
> > > > could
> > > > simply list the regions that I wanted processed under the
"fix"
> > > > tab.
> > > > Now
> > > > it seems that you are creating two fix fields for vx_mask, one
of
> > > > which
> > > > duplicates EAST, WEST, and CONUS. Why is this the solution?
All
> > > > my
> > > > plots
> > > > have produced for all regions just fine in the past. If you
look
> > > > at
> > > > ozone
> > > > (not the max fields of ozone) you will see that all the plots
are
> > > > being
> > > > generated and stored as they always have. The list provided
for
> > > > vx_mask in
> > > > my xml files generates plots for all those regions. For some
> > > > reason I
> > > > am
> > > > getting an empty plot for EAST, WEST, and CONUS for OZMAX8,
OZMAX1,
> > > > PDMAX1,
> > > > and PMAVE. I haven't been able to get any clues other than
the
> > > > error
> > > > message I originally sent. I have to say that the plot number
> > > > reference
> > > > that you sent me yielded a CSI curve that I've never seen in
any of
> > > > the
> > > > plots I looked at. Not sure what's going on with that plot.
> > > >
> > > >
> > > > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Ed,
> > > > > I recreated the XML that you sent me on the web app page and
> > > > > produced
> > > > > the
> > > > > plot: #20210310_193603
> > > > > Please note that this XML contains all vx_mask not just
east,
> > > > > west,
> > > > > and
> > > > > CONUS.
> > > > > If I select only those masks - I still get the plot:
> > > > > # 20210310_194052
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov wrote:
> > > > > > Here's a CSI example for ozmax8, one of the fields not
being
> > > > > > plotted
> > > > > > for
> > > > > > east, west, and CONUS.
> > > > > >
> > > > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA
Affiliate
> > > > > > <
> > > > > > edward.strobach at noaa.gov> wrote:
> > > > > >
> > > > > > > I'm guessing you don't have access to WCOSS? If not, I
can
> > > > > > > copy
> > > > > > > a
> > > > > > > file
> > > > > > > over for you.
> > > > > > >
> > > > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Ed,
> > > > > > >> Having the XML that you use would be really helpful.
> > > > > > >> I briefly looked at the data using following fields
> > > > > > >> August 2020
> > > > > > >> EAST
> > > > > > >> PARA6C
> > > > > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75',
'>85',
> > > > > > >> '>105',
> > > > > > >> '>125',
> > > > > > >> '>150')
> > > > > > >> OZMAX8
> > > > > > >>
> > > > > > >> Both tables with CNT and CTC types don't have any data
with
> > > > > > >> these
> > > > > > >> parameters.
> > > > > > >>
> > > > > > >> Tatiana
> > > > > > >>
> > > > > > >>
> > > > > > >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov
wrote:
> > > > > > >> > I'm not really sure I follow. Wouldn't this occur
for all
> > > > > > >> > regions
> > > > > > >> > then,
> > > > > > >> > not just East, West, and CONUS? The other regions
report
> > > > > > >> > these
> > > > > > >> > thresholds
> > > > > > >> > with all models being compared. The Pointstat
configure
> > > > > > >> > file
> > > > > > >> > that
> > > > > > >> > I
> > > > > > >> > use
> > > > > > >> > for these stats also confirms the thresholding exists
in
> > > > > > >> > that
> > > > > > >> > file.
> > > > > > >> > Moreover, I use ctc when processing plots such as
CSI,
> > > > > > >> > FAR,
> > > > > > >> > etc,
> > > > > > >> > which
> > > > > > >> > is
> > > > > > >> > done on the thresholds I set in pointstat and the xml
> > > > > > >> > files.
> > > > > > >> >
> > > > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > > > > > >> > <met_help at ucar.edu>
> > > > > > >> > wrote:
> > > > > > >> >
> > > > > > >> > > Ed,
> > > > > > >> > > It also would be helpful to see XML but I was able
to
> > > > > > >> > > use
> > > > > > >> > > some
> > > > > > >> > > info
> > > > > > >> > > from
> > > > > > >> > > the part of the query that you sent.
> > > > > > >> > > I assume that you are interested on some agg stat
> > > > > > >> > > calculations
> > > > > > >> > > and
> > > > > > >> > > use the
> > > > > > >> > > data from sl1l2 table. The data in this table has
only
> > > > > > >> > > one
> > > > > > >> > > obs_thresh
> > > > > > >> > > value
> > > > > > >> > > - NA. That is why when you include other values
like
> > > > > > >> > > ">50'
> > > > > > >> > > the
> > > > > > >> > > query
> > > > > > >> > > returns no data.
> > > > > > >> > >
> > > > > > >> > > Tatiana
> > > > > > >> > >
> > > > > > >> > > On Tue Mar 09 07:55:16 2021,
edward.strobach at noaa.gov
> > > > > > >> > > wrote:
> > > > > > >> > > > The database is mv_cmaq_metplus which should be
under
> > > > > > >> > > > the
> > > > > > >> > > > group
> > > > > > >> > > > name
> > > > > > >> > > > Ed_Strobach. I did realize that my inputs were
> > > > > > >> > > > switched
> > > > > > >> > > > around
> > > > > > >> > > > such
> > > > > > >> > > > that
> > > > > > >> > > > my group name was being designated as add instead
of
> > > > > > >> > > > Ed_Strobach.
> > > > > > >> > > > I
> > > > > > >> > > > have
> > > > > > >> > > > since switched around the inputs but I don't
think
> > > > > > >> > > > that
> > > > > > >> > > > should
> > > > > > >> > > > be
> > > > > > >> > > > the
> > > > > > >> > > > issue, at least I don't think so since the other
data
> > > > > > >> > > > was
> > > > > > >> > > > uploaded
> > > > > > >> > > > successfully. I was loading data this way:
> > > > > > >> > > >
> > > > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
add
> > > > > > >> > > > Ed_Strobach
> > > > > > >> > > >
> > > > > > >> > > > but should have instead been
> > > > > > >> > > >
> > > > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
> > > > > > >> > > > Ed_Strobach
> > > > > > >> > > > add
> > > > > > >> > > >
> > > > > > >> > > > Not recognizing Ed_Strobach as an option (i.e.
should
> > > > > > >> > > > have
> > > > > > >> > > > been
> > > > > > >> > > > "add"
> > > > > > >> > > > or
> > > > > > >> > > > "new") it defaulted to add I think; but again,
I'm not
> > > > > > >> > > > sure
> > > > > > >> > > > that
> > > > > > >> > > > this
> > > > > > >> > > > caused the issue..
> > > > > > >> > > >
> > > > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek via
RT
> > > > > > >> > > > <met_help at ucar.edu>
> > > > > > >> > > > wrote:
> > > > > > >> > > >
> > > > > > >> > > > > Ed,
> > > > > > >> > > > > What is the name of the database that contains
your
> > > > > > >> > > > > data?
> > > > > > >> > > > >
> > > > > > >> > > > > Tatiana
> > > > > > >> > > > >
> > > > > > >> > > > > On Tue Mar 09 07:00:23 2021,
> > > > > > >> > > > > edward.strobach at noaa.gov
> > > > > > >> > > > > wrote:
> > > > > > >> > > > > > Good morning,
> > > > > > >> > > > > >
> > > > > > >> > > > > > I recently put up a website
> > > > > > >> > > > > > <
> > > > > > >> > > > >
> > > > > > >> > >
> > > > > > >>
> > > > >
> > >
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > > >> > > > > >
> > > > > > >> > > > > > with all the stats for different regions.
Some
> > > > > > >> > > > > > noticed
> > > > > > >> > > > > > that
> > > > > > >> > > > > > there
> > > > > > >> > > > > > were no
> > > > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and
PDMAX1
> > > > > > >> > > > > > fields in
> > > > > > >> > > > > > the
> > > > > > >> > > > > > website
> > > > > > >> > > > > > for
> > > > > > >> > > > > > skill score type plots and performance
diagrams.
> > > > > > >> > > > > > I
> > > > > > >> > > > > > was
> > > > > > >> > > > > > able to
> > > > > > >> > > > > > determine
> > > > > > >> > > > > > that there was no data being processed for
those
> > > > > > >> > > > > > regions
> > > > > > >> > > > > > which
> > > > > > >> > > > > > I
> > > > > > >> > > > > > suspect is
> > > > > > >> > > > > > the reason for this issue. Realizing this, I
went
> > > > > > >> > > > > > back
> > > > > > >> > > > > > and
> > > > > > >> > > > > > found
> > > > > > >> > > > > > that
> > > > > > >> > > > > > the
> > > > > > >> > > > > > pointstat_config files did not contain those
> > > > > > >> > > > > > regions.
> > > > > > >> > > > > > After
> > > > > > >> > > > > > adding
> > > > > > >> > > > > > those
> > > > > > >> > > > > > regions in I reprocessed everything and now
have
> > > > > > >> > > > > > stats
> > > > > > >> > > > > > for
> > > > > > >> > > > > > east,
> > > > > > >> > > > > > west,
> > > > > > >> > > > > > and
> > > > > > >> > > > > > CONUS regions. I thought everything would
have
> > > > > > >> > > > > > plotted
> > > > > > >> > > > > > successfully
> > > > > > >> > > > > > for
> > > > > > >> > > > > > those regions but found that this wasn't so..
In
> > > > > > >> > > > > > fact,
> > > > > > >> > > > > > I
> > > > > > >> > > > > > still
> > > > > > >> > > > > > get
> > > > > > >> > > > > > the
> > > > > > >> > > > > > same
> > > > > > >> > > > > > error which is quite surprising to me. These
> > > > > > >> > > > > > regions
> > > > > > >> > > > > > have
> > > > > > >> > > > > > been
> > > > > > >> > > > > > requested
> > > > > > >> > > > > > as essential for identifying the broader
> > > > > > >> > > > > > performance
> > > > > > >> > > > > > and
> > > > > > >> > > > > > will
> > > > > > >> > > > > > aid
> > > > > > >> > > > > > in
> > > > > > >> > > > > > decision making. I will have to get these up
> > > > > > >> > > > > > soon...
> > > > > > >> > > > > > I
> > > > > > >> > > > > > was
> > > > > > >> > > > > > wondering
> > > > > > >> > > > > > if
> > > > > > >> > > > > > there was something that stood out to you.
Here's
> > > > > > >> > > > > > the
> > > > > > >> > > > > > error
> > > > > > >> > > > > > that
> > > > > > >> > > > > > keeps
> > > > > > >> > > > > > coming up:
> > > > > > >> > > > > >
> > > > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00',
'2020-
> > > > > > >> > > > > > 08-
> > > > > > >> > > > > > 30
> > > > > > >> > > > > > 10:00:00',
> > > > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30 12:00:00')
> > > > > > >> > > > > > AND BINARY if( (select fcst_lead_offset
FROM
> > > > > > >> > > > > > model_fcst_lead_offset
> > > > > > >> > > > > > WHERE model = h.model) is NULL , ld.fcst_lead
,
> > > > > > >> > > > > > ld.fcst_lead +
> > > > > > >> > > > > > (select
> > > > > > >> > > > > > fcst_lead_offset FROM model_fcst_lead_offset
WHERE
> > > > > > >> > > > > > model =
> > > > > > >> > > > > > h.model)
> > > > > > >> > > > > > )
> > > > > > >> > > > > > IN
> > > > > > >> > > > > > ('0', '10000', '20000', '30000', '40000',
'50000',
> > > > > > >> > > > > > '60000',
> > > > > > >> > > > > > '70000',
> > > > > > >> > > > > > '80000', '90000', '100000', '110000',
'120000',
> > > > > > >> > > > > > '130000',
> > > > > > >> > > > > > '140000',
> > > > > > >> > > > > > '150000', '160000', '170000', '180000',
'190000',
> > > > > > >> > > > > > '200000',
> > > > > > >> > > > > > '210000',
> > > > > > >> > > > > > '220000', '230000', '240000', '250000',
'260000',
> > > > > > >> > > > > > '270000',
> > > > > > >> > > > > > '280000',
> > > > > > >> > > > > > '290000', '300000', '310000', '320000',
'330000',
> > > > > > >> > > > > > '340000',
> > > > > > >> > > > > > '350000',
> > > > > > >> > > > > > '360000', '370000', '380000', '390000',
'400000',
> > > > > > >> > > > > > '410000',
> > > > > > >> > > > > > '420000',
> > > > > > >> > > > > > '430000', '440000', '450000', '460000',
'470000',
> > > > > > >> > > > > > '480000')
> > > > > > >> > > > > > AND BINARY h.model IN ('PARA6C',
'PARA6C_BC',
> > > > > > >> > > > > > 'PROD',
> > > > > > >> > > > > > 'PROD_BC')
> > > > > > >> > > > > > AND BINARY h.obs_thresh IN ('>50', '>60',
> > > > > > >> > > > > > '>65',
> > > > > > >> > > > > > '>70',
> > > > > > >> > > > > > '>75',
> > > > > > >> > > > > > '>85',
> > > > > > >> > > > > > '>105', '>125', '>150')
> > > > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > > >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > > > > > >> > > > > >
> > > > > > >> > > > > > No data was returned from database
> > > > > > >> > > > > > 2021-03-09
> > > > > > >> > > > > >
> > > > > > >> > > > >
> > > > > > >> > >
> > > > > > >>
> > > > >
> > >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > > >> > > > > > Source) -1 printFormattedTable - ** ERROR:
> > > > > > >> > > > > > Caught
> > > > > > >> > > > > > class
> > > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException in
> > > > > > >> > > > > > printFormattedTable(ResultSet
> > > > > > >> > > > > > res): result set contained no data
> > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > > >> > > > > > in
> > > > > > >> > > > > > printFormattedTable(ResultSet res): result
set
> > > > > > >> > > > > > contained
> > > > > > >> > > > > > no
> > > > > > >> > > > > > data
> > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > > >> > > > > > in
> > > > > > >> > > > > > printFormattedTable(ResultSet res): result
set
> > > > > > >> > > > > > contained
> > > > > > >> > > > > > no
> > > > > > >> > > > > > data
> > > > > > >> > > > > > Database query time for mv_cmaq_metplus
> > > > > > >> > > > > > 0:00:00.016
> > > > > > >> > > > > > Save to file time for mv_cmaq_metplus
> > > > > > >> > > > > > 0:00:00.000
> > > > > > >> > > > > >
> > > > > > >> > > > > > You can view the stat files of those fields
here:
> > > > > > >> > > > > >
> > > > > > >> > > > >
> > > > > > >> > >
> > > > > > >>
> > > > >
> > >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > > >> > > > > >
> > > > > > >> > > > > > The corresponding tags to those files are
> > > > > > >> > > > > > something
> > > > > > >> > > > > > like
> > > > > > >> > > > > > this:
> > > > > > >> > > > > > PARA6C_AQMAX1*
> > > > > > >> > > > > > PARA6C_AQMAX8*
> > > > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > > > >> > > > > >
> > > > > > >> > > > > > I have similar plots for PARA6C, PARA6C_BC,
PROD,
> > > > > > >> > > > > > and
> > > > > > >> > > > > > PROD_BC.
> > > > > > >> > > > > > I've
> > > > > > >> > > > > > checked these files and these regions (i.e.
EAST,
> > > > > > >> > > > > > WEST,
> > > > > > >> > > > > > CONUS)
> > > > > > >> > > > > > appear
> > > > > > >> > > > > > tabulated for ctc stats.
> > > > > > >> > > > > >
> > > > > > >> > > > > > Additionally, my files have been updated to
match
> > > > > > >> > > > > > the
> > > > > > >> > > > > > inclusion
> > > > > > >> > > > > > of
> > > > > > >> > > > > > these
> > > > > > >> > > > > > regions:
> > > > > > >> > > > > > poly = [
> > > > > > >> > > > > >
"MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > > >> > > > > > "MET_BASE/poly/NWC.poly",
> > > > > > >> > > > > > "MET_BASE/poly/SWC.poly",
> > > > > > >> > > > > > "MET_BASE/poly/NMT.poly",
> > > > > > >> > > > > > "MET_BASE/poly/SMT.poly",
> > > > > > >> > > > > > "MET_BASE/poly/GRB.poly",
> > > > > > >> > > > > > "MET_BASE/poly/SWD.poly",
> > > > > > >> > > > > > "MET_BASE/poly/NPL.poly",
> > > > > > >> > > > > > "MET_BASE/poly/SPL.poly",
> > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > >> > > > > > "MET_BASE/poly/LMV.poly",
> > > > > > >> > > > > > "MET_BASE/poly/GMC.poly",
> > > > > > >> > > > > > "MET_BASE/poly/APL.poly",
> > > > > > >> > > > > > "MET_BASE/poly/EAST.poly",
> > > > > > >> > > > > > "MET_BASE/poly/WEST.poly",
> > > > > > >> > > > > > "MET_BASE/poly/CONUS.poly"
> > > > > > >> > > > > > ];
> > > > > > >> > > > > >
> > > > > > >> > > > > > The files that I'm using definitely have
these
> > > > > > >> > > > > > regions
> > > > > > >> > > > > > as
> > > > > > >> > > > > > well
> > > > > > >> > > > > > as
> > > > > > >> > > > > > seen
> > > > > > >> > > > > > here:
> > > > > > >> > > > > >
> > > > > > >> > >
> > > > > > >>
> > > > >
> > >
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > > >> > > > > >
> > > > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > > > >> > > > > >
> > > > > > >> > > > > > I'm somewhat at a loss of what to do since
> > > > > > >> > > > > > everything
> > > > > > >> > > > > > else
> > > > > > >> > > > > > seems
> > > > > > >> > > > > > fine.
> > > > > > >> > > > > > Has
> > > > > > >> > > > > > this been seen before?
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Mon Mar 15 12:45:05 2021
I analyzed data for OZMAX8 variable in CTC table.
This variable has:
fcst_lead : 290000, 530000, 230000,470000
obs_thresh: >50 >60 >65 >70 >75 >85 >105 >125 >150
vx_mask: | FULL NEC SEC NWC SWC NMT SMT GRB SWD NPL SPL MDW LMV GMC
APL EAST WEST CONUS
fcst_init_beg: 2020-08-01 06:00:00 - 2021-02-18 12:00:00
fcst_valid_beg: 2020-08-02 11:00:00 - 2021-02-19 11:00:00
PDMAX1,PMAVE:
fcst_lead : 220000 460000 160000 400000 640000 700000
OZMAX1:
fcst_lead : 220000 460000 160000 400000
If you use on of your XML with OZMAX8, for example, and fcst_lead=(
290000, 530000, 230000,470000) and all field values put in
alphabetical order you should be able to get the plot.
Example: 20210315_182836
Tatiana
On Mon Mar 15 08:34:36 2021, edward.strobach at noaa.gov wrote:
> hmm.. I thought I did send an example last week. I'll send the
> original
> and a new one. So I basically use the same xml file for the
following
> variables: OZCON, PMTF, OZMAX1, OZMAX8, PDMAX1, and PMAVE. The
first
> two
> fields have no problem producing stats for east, west, and CONUS
> (eliminating conus now though so don't worry about that region)
while
> no
> stats are generated for the other fields. This occurs even though
the
> stats are being populated in the .stat files for these regions.
>
> On Mon, Mar 15, 2021 at 9:59 AM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Ed,
> > Please, sent the XML file that actually produces the error. With
the
> > XML
> > you sent me before or just creating the plots randomly I always
have
> > a
> > valid plot.
> >
> > Tatiana
> >
> > On Wed Mar 10 14:55:06 2021, edward.strobach at noaa.gov wrote:
> > > I'm sharing a couple of screenshots that led me to this
conclusion.
> > > You
> > > can see that there is a vx_mask_0 in one of the attachments and
> > > vx_mask_4
> > > in another. This is all under plot_fix. I got this from one of
> > > your
> > > reference numbers: 20210310_194052.
> > >
> > > I still just really want to know why. Part of the email I sent
> > > before
> > > contains the real item that's in need of addressing; namely, why
is
> > > this an
> > > issue for only these fields?
> > >
> > >
> > > *All my plots have produced for all regions just fine in the
past.
> > > If
> > > you
> > > look at ozone (not the max fields of ozone) you will see that
all
> > > the
> > > plots
> > > are being generated and stored as they always have. The list
> > > provided
> > > for
> > > vx_mask in my xml files generates plots for all those regions.
For
> > > some
> > > reason I am getting an empty plot for EAST, WEST, and CONUS for
> > > OZMAX8,
> > > OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any clues
> > > other
> > > than
> > > the error message I originally sent. *
> > >
> > > The stat files have these regions with the corresponding
statistics
> > > included. If that's true, then what is going on? My point_stat
> > > configure
> > > file that contains the poly files include those regions. Is
there
> > > anything
> > > else I can send that might be helpful?
> > >
> > > On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > I did not understand your comment about the 'two fix fields
for
> > > > vx_mask'.
> > > > I create one vx_maskk fieldand add 3 values:
> > > > <field equalize="false" name="vx_mask">
> > > > <set name="vx_mask_0">
> > > > <val>CONUS</val>
> > > > <val>EAST</val>
> > > > <val>WEST</val>
> > > > </set>
> > > > </field>
> > > > this is equal to
> > > > <field equalize="false" name="vx_mask">
> > > > <val>CONUS</val>
> > > > <val>EAST</val>
> > > > <val>WEST</val>
> > > > </field>
> > > >
> > > > I run the same config OZMAX1 and METviewer also generated a
plot
> > > > but
> > > > only
> > > > for PARA6C and PARA6C_BC models: 20210310_213318
> > > > The XML you sent me points METviewer to calculate summary
> > > > statistics.
> > > > If
> > > > agg statistic is selected - the plot would look differently:
> > > > 20210310_213917
> > > >
> > > > Tatiana
> > > >
> > > >
> > > > On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov wrote:
> > > > > Thanks... I'm hoping that I can get an explanation on why
> > > > > things
> > > > > didn't
> > > > > work. I was under the impression from my emails with John
that
> > > > > I
> > > > > could
> > > > > simply list the regions that I wanted processed under the
"fix"
> > > > > tab.
> > > > > Now
> > > > > it seems that you are creating two fix fields for vx_mask,
one
> > > > > of
> > > > > which
> > > > > duplicates EAST, WEST, and CONUS. Why is this the solution?
> > > > > All
> > > > > my
> > > > > plots
> > > > > have produced for all regions just fine in the past. If you
> > > > > look
> > > > > at
> > > > > ozone
> > > > > (not the max fields of ozone) you will see that all the
plots
> > > > > are
> > > > > being
> > > > > generated and stored as they always have. The list provided
> > > > > for
> > > > > vx_mask in
> > > > > my xml files generates plots for all those regions. For
some
> > > > > reason I
> > > > > am
> > > > > getting an empty plot for EAST, WEST, and CONUS for OZMAX8,
> > > > > OZMAX1,
> > > > > PDMAX1,
> > > > > and PMAVE. I haven't been able to get any clues other than
the
> > > > > error
> > > > > message I originally sent. I have to say that the plot
number
> > > > > reference
> > > > > that you sent me yielded a CSI curve that I've never seen in
> > > > > any of
> > > > > the
> > > > > plots I looked at. Not sure what's going on with that plot.
> > > > >
> > > > >
> > > > > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Ed,
> > > > > > I recreated the XML that you sent me on the web app page
and
> > > > > > produced
> > > > > > the
> > > > > > plot: #20210310_193603
> > > > > > Please note that this XML contains all vx_mask not just
east,
> > > > > > west,
> > > > > > and
> > > > > > CONUS.
> > > > > > If I select only those masks - I still get the plot:
> > > > > > # 20210310_194052
> > > > > >
> > > > > > Tatiana
> > > > > >
> > > > > > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov
wrote:
> > > > > > > Here's a CSI example for ozmax8, one of the fields not
> > > > > > > being
> > > > > > > plotted
> > > > > > > for
> > > > > > > east, west, and CONUS.
> > > > > > >
> > > > > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA
> > > > > > > Affiliate
> > > > > > > <
> > > > > > > edward.strobach at noaa.gov> wrote:
> > > > > > >
> > > > > > > > I'm guessing you don't have access to WCOSS? If not,
I
> > > > > > > > can
> > > > > > > > copy
> > > > > > > > a
> > > > > > > > file
> > > > > > > > over for you.
> > > > > > > >
> > > > > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > > > > > > <met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > >> Ed,
> > > > > > > >> Having the XML that you use would be really helpful.
> > > > > > > >> I briefly looked at the data using following fields
> > > > > > > >> August 2020
> > > > > > > >> EAST
> > > > > > > >> PARA6C
> > > > > > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75',
'>85',
> > > > > > > >> '>105',
> > > > > > > >> '>125',
> > > > > > > >> '>150')
> > > > > > > >> OZMAX8
> > > > > > > >>
> > > > > > > >> Both tables with CNT and CTC types don't have any
data
> > > > > > > >> with
> > > > > > > >> these
> > > > > > > >> parameters.
> > > > > > > >>
> > > > > > > >> Tatiana
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> On Tue Mar 09 12:35:05 2021, edward.strobach at noaa.gov
> > > > > > > >> wrote:
> > > > > > > >> > I'm not really sure I follow. Wouldn't this occur
for
> > > > > > > >> > all
> > > > > > > >> > regions
> > > > > > > >> > then,
> > > > > > > >> > not just East, West, and CONUS? The other regions
> > > > > > > >> > report
> > > > > > > >> > these
> > > > > > > >> > thresholds
> > > > > > > >> > with all models being compared. The Pointstat
> > > > > > > >> > configure
> > > > > > > >> > file
> > > > > > > >> > that
> > > > > > > >> > I
> > > > > > > >> > use
> > > > > > > >> > for these stats also confirms the thresholding
exists
> > > > > > > >> > in
> > > > > > > >> > that
> > > > > > > >> > file.
> > > > > > > >> > Moreover, I use ctc when processing plots such as
CSI,
> > > > > > > >> > FAR,
> > > > > > > >> > etc,
> > > > > > > >> > which
> > > > > > > >> > is
> > > > > > > >> > done on the thresholds I set in pointstat and the
xml
> > > > > > > >> > files.
> > > > > > > >> >
> > > > > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via RT
> > > > > > > >> > <met_help at ucar.edu>
> > > > > > > >> > wrote:
> > > > > > > >> >
> > > > > > > >> > > Ed,
> > > > > > > >> > > It also would be helpful to see XML but I was
able
> > > > > > > >> > > to
> > > > > > > >> > > use
> > > > > > > >> > > some
> > > > > > > >> > > info
> > > > > > > >> > > from
> > > > > > > >> > > the part of the query that you sent.
> > > > > > > >> > > I assume that you are interested on some agg stat
> > > > > > > >> > > calculations
> > > > > > > >> > > and
> > > > > > > >> > > use the
> > > > > > > >> > > data from sl1l2 table. The data in this table has
> > > > > > > >> > > only
> > > > > > > >> > > one
> > > > > > > >> > > obs_thresh
> > > > > > > >> > > value
> > > > > > > >> > > - NA. That is why when you include other values
like
> > > > > > > >> > > ">50'
> > > > > > > >> > > the
> > > > > > > >> > > query
> > > > > > > >> > > returns no data.
> > > > > > > >> > >
> > > > > > > >> > > Tatiana
> > > > > > > >> > >
> > > > > > > >> > > On Tue Mar 09 07:55:16 2021,
> > > > > > > >> > > edward.strobach at noaa.gov
> > > > > > > >> > > wrote:
> > > > > > > >> > > > The database is mv_cmaq_metplus which should be
> > > > > > > >> > > > under
> > > > > > > >> > > > the
> > > > > > > >> > > > group
> > > > > > > >> > > > name
> > > > > > > >> > > > Ed_Strobach. I did realize that my inputs were
> > > > > > > >> > > > switched
> > > > > > > >> > > > around
> > > > > > > >> > > > such
> > > > > > > >> > > > that
> > > > > > > >> > > > my group name was being designated as add
instead
> > > > > > > >> > > > of
> > > > > > > >> > > > Ed_Strobach.
> > > > > > > >> > > > I
> > > > > > > >> > > > have
> > > > > > > >> > > > since switched around the inputs but I don't
think
> > > > > > > >> > > > that
> > > > > > > >> > > > should
> > > > > > > >> > > > be
> > > > > > > >> > > > the
> > > > > > > >> > > > issue, at least I don't think so since the
other
> > > > > > > >> > > > data
> > > > > > > >> > > > was
> > > > > > > >> > > > uploaded
> > > > > > > >> > > > successfully. I was loading data this way:
> > > > > > > >> > > >
> > > > > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
> > > > > > > >> > > > add
> > > > > > > >> > > > Ed_Strobach
> > > > > > > >> > > >
> > > > > > > >> > > > but should have instead been
> > > > > > > >> > > >
> > > > > > > >> > > > python load_to_metviewer_AWS.py mv_cmaq_metplus
> > > > > > > >> > > > Ed_Strobach
> > > > > > > >> > > > add
> > > > > > > >> > > >
> > > > > > > >> > > > Not recognizing Ed_Strobach as an option (i.e.
> > > > > > > >> > > > should
> > > > > > > >> > > > have
> > > > > > > >> > > > been
> > > > > > > >> > > > "add"
> > > > > > > >> > > > or
> > > > > > > >> > > > "new") it defaulted to add I think; but again,
I'm
> > > > > > > >> > > > not
> > > > > > > >> > > > sure
> > > > > > > >> > > > that
> > > > > > > >> > > > this
> > > > > > > >> > > > caused the issue..
> > > > > > > >> > > >
> > > > > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek
via
> > > > > > > >> > > > RT
> > > > > > > >> > > > <met_help at ucar.edu>
> > > > > > > >> > > > wrote:
> > > > > > > >> > > >
> > > > > > > >> > > > > Ed,
> > > > > > > >> > > > > What is the name of the database that
contains
> > > > > > > >> > > > > your
> > > > > > > >> > > > > data?
> > > > > > > >> > > > >
> > > > > > > >> > > > > Tatiana
> > > > > > > >> > > > >
> > > > > > > >> > > > > On Tue Mar 09 07:00:23 2021,
> > > > > > > >> > > > > edward.strobach at noaa.gov
> > > > > > > >> > > > > wrote:
> > > > > > > >> > > > > > Good morning,
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > I recently put up a website
> > > > > > > >> > > > > > <
> > > > > > > >> > > > >
> > > > > > > >> > >
> > > > > > > >>
> > > > > >
> > > >
> >
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > with all the stats for different regions.
> > > > > > > >> > > > > > Some
> > > > > > > >> > > > > > noticed
> > > > > > > >> > > > > > that
> > > > > > > >> > > > > > there
> > > > > > > >> > > > > > were no
> > > > > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and
> > > > > > > >> > > > > > PDMAX1
> > > > > > > >> > > > > > fields in
> > > > > > > >> > > > > > the
> > > > > > > >> > > > > > website
> > > > > > > >> > > > > > for
> > > > > > > >> > > > > > skill score type plots and performance
> > > > > > > >> > > > > > diagrams.
> > > > > > > >> > > > > > I
> > > > > > > >> > > > > > was
> > > > > > > >> > > > > > able to
> > > > > > > >> > > > > > determine
> > > > > > > >> > > > > > that there was no data being processed for
> > > > > > > >> > > > > > those
> > > > > > > >> > > > > > regions
> > > > > > > >> > > > > > which
> > > > > > > >> > > > > > I
> > > > > > > >> > > > > > suspect is
> > > > > > > >> > > > > > the reason for this issue. Realizing this,
I
> > > > > > > >> > > > > > went
> > > > > > > >> > > > > > back
> > > > > > > >> > > > > > and
> > > > > > > >> > > > > > found
> > > > > > > >> > > > > > that
> > > > > > > >> > > > > > the
> > > > > > > >> > > > > > pointstat_config files did not contain
those
> > > > > > > >> > > > > > regions.
> > > > > > > >> > > > > > After
> > > > > > > >> > > > > > adding
> > > > > > > >> > > > > > those
> > > > > > > >> > > > > > regions in I reprocessed everything and now
> > > > > > > >> > > > > > have
> > > > > > > >> > > > > > stats
> > > > > > > >> > > > > > for
> > > > > > > >> > > > > > east,
> > > > > > > >> > > > > > west,
> > > > > > > >> > > > > > and
> > > > > > > >> > > > > > CONUS regions. I thought everything would
> > > > > > > >> > > > > > have
> > > > > > > >> > > > > > plotted
> > > > > > > >> > > > > > successfully
> > > > > > > >> > > > > > for
> > > > > > > >> > > > > > those regions but found that this wasn't
so..
> > > > > > > >> > > > > > In
> > > > > > > >> > > > > > fact,
> > > > > > > >> > > > > > I
> > > > > > > >> > > > > > still
> > > > > > > >> > > > > > get
> > > > > > > >> > > > > > the
> > > > > > > >> > > > > > same
> > > > > > > >> > > > > > error which is quite surprising to me.
These
> > > > > > > >> > > > > > regions
> > > > > > > >> > > > > > have
> > > > > > > >> > > > > > been
> > > > > > > >> > > > > > requested
> > > > > > > >> > > > > > as essential for identifying the broader
> > > > > > > >> > > > > > performance
> > > > > > > >> > > > > > and
> > > > > > > >> > > > > > will
> > > > > > > >> > > > > > aid
> > > > > > > >> > > > > > in
> > > > > > > >> > > > > > decision making. I will have to get these
up
> > > > > > > >> > > > > > soon...
> > > > > > > >> > > > > > I
> > > > > > > >> > > > > > was
> > > > > > > >> > > > > > wondering
> > > > > > > >> > > > > > if
> > > > > > > >> > > > > > there was something that stood out to you.
> > > > > > > >> > > > > > Here's
> > > > > > > >> > > > > > the
> > > > > > > >> > > > > > error
> > > > > > > >> > > > > > that
> > > > > > > >> > > > > > keeps
> > > > > > > >> > > > > > coming up:
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30 09:00:00',
> > > > > > > >> > > > > > '2020-
> > > > > > > >> > > > > > 08-
> > > > > > > >> > > > > > 30
> > > > > > > >> > > > > > 10:00:00',
> > > > > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30
12:00:00')
> > > > > > > >> > > > > > AND BINARY if( (select
fcst_lead_offset
> > > > > > > >> > > > > > FROM
> > > > > > > >> > > > > > model_fcst_lead_offset
> > > > > > > >> > > > > > WHERE model = h.model) is NULL ,
ld.fcst_lead
> > > > > > > >> > > > > > ,
> > > > > > > >> > > > > > ld.fcst_lead +
> > > > > > > >> > > > > > (select
> > > > > > > >> > > > > > fcst_lead_offset FROM
model_fcst_lead_offset
> > > > > > > >> > > > > > WHERE
> > > > > > > >> > > > > > model =
> > > > > > > >> > > > > > h.model)
> > > > > > > >> > > > > > )
> > > > > > > >> > > > > > IN
> > > > > > > >> > > > > > ('0', '10000', '20000', '30000', '40000',
> > > > > > > >> > > > > > '50000',
> > > > > > > >> > > > > > '60000',
> > > > > > > >> > > > > > '70000',
> > > > > > > >> > > > > > '80000', '90000', '100000', '110000',
> > > > > > > >> > > > > > '120000',
> > > > > > > >> > > > > > '130000',
> > > > > > > >> > > > > > '140000',
> > > > > > > >> > > > > > '150000', '160000', '170000', '180000',
> > > > > > > >> > > > > > '190000',
> > > > > > > >> > > > > > '200000',
> > > > > > > >> > > > > > '210000',
> > > > > > > >> > > > > > '220000', '230000', '240000', '250000',
> > > > > > > >> > > > > > '260000',
> > > > > > > >> > > > > > '270000',
> > > > > > > >> > > > > > '280000',
> > > > > > > >> > > > > > '290000', '300000', '310000', '320000',
> > > > > > > >> > > > > > '330000',
> > > > > > > >> > > > > > '340000',
> > > > > > > >> > > > > > '350000',
> > > > > > > >> > > > > > '360000', '370000', '380000', '390000',
> > > > > > > >> > > > > > '400000',
> > > > > > > >> > > > > > '410000',
> > > > > > > >> > > > > > '420000',
> > > > > > > >> > > > > > '430000', '440000', '450000', '460000',
> > > > > > > >> > > > > > '470000',
> > > > > > > >> > > > > > '480000')
> > > > > > > >> > > > > > AND BINARY h.model IN ('PARA6C',
> > > > > > > >> > > > > > 'PARA6C_BC',
> > > > > > > >> > > > > > 'PROD',
> > > > > > > >> > > > > > 'PROD_BC')
> > > > > > > >> > > > > > AND BINARY h.obs_thresh IN ('>50',
'>60',
> > > > > > > >> > > > > > '>65',
> > > > > > > >> > > > > > '>70',
> > > > > > > >> > > > > > '>75',
> > > > > > > >> > > > > > '>85',
> > > > > > > >> > > > > > '>105', '>125', '>150')
> > > > > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > > > >> > > > > > AND ld.stat_header_id = h.stat_header_id;
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > No data was returned from database
> > > > > > > >> > > > > > 2021-03-09
> > > > > > > >> > > > > >
> > > > > > > >> > > > >
> > > > > > > >> > >
> > > > > > > >>
> > > > > >
> > > >
> >
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > > > >> > > > > > Source) -1 printFormattedTable - **
ERROR:
> > > > > > > >> > > > > > Caught
> > > > > > > >> > > > > > class
> > > > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
in
> > > > > > > >> > > > > > printFormattedTable(ResultSet
> > > > > > > >> > > > > > res): result set contained no data
> > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > > > >> > > > > > in
> > > > > > > >> > > > > > printFormattedTable(ResultSet res): result
set
> > > > > > > >> > > > > > contained
> > > > > > > >> > > > > > no
> > > > > > > >> > > > > > data
> > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > >> > > > > > edu.ucar.metviewer.EmptyResultSetException
> > > > > > > >> > > > > > in
> > > > > > > >> > > > > > printFormattedTable(ResultSet res): result
set
> > > > > > > >> > > > > > contained
> > > > > > > >> > > > > > no
> > > > > > > >> > > > > > data
> > > > > > > >> > > > > > Database query time for mv_cmaq_metplus
> > > > > > > >> > > > > > 0:00:00.016
> > > > > > > >> > > > > > Save to file time for mv_cmaq_metplus
> > > > > > > >> > > > > > 0:00:00.000
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > You can view the stat files of those fields
> > > > > > > >> > > > > > here:
> > > > > > > >> > > > > >
> > > > > > > >> > > > >
> > > > > > > >> > >
> > > > > > > >>
> > > > > >
> > > >
> >
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > The corresponding tags to those files are
> > > > > > > >> > > > > > something
> > > > > > > >> > > > > > like
> > > > > > > >> > > > > > this:
> > > > > > > >> > > > > > PARA6C_AQMAX1*
> > > > > > > >> > > > > > PARA6C_AQMAX8*
> > > > > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > I have similar plots for PARA6C, PARA6C_BC,
> > > > > > > >> > > > > > PROD,
> > > > > > > >> > > > > > and
> > > > > > > >> > > > > > PROD_BC.
> > > > > > > >> > > > > > I've
> > > > > > > >> > > > > > checked these files and these regions (i.e.
> > > > > > > >> > > > > > EAST,
> > > > > > > >> > > > > > WEST,
> > > > > > > >> > > > > > CONUS)
> > > > > > > >> > > > > > appear
> > > > > > > >> > > > > > tabulated for ctc stats.
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > Additionally, my files have been updated to
> > > > > > > >> > > > > > match
> > > > > > > >> > > > > > the
> > > > > > > >> > > > > > inclusion
> > > > > > > >> > > > > > of
> > > > > > > >> > > > > > these
> > > > > > > >> > > > > > regions:
> > > > > > > >> > > > > > poly = [
> > > > > > > >> > > > > >
"MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/NWC.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/SWC.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/NMT.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/SMT.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/GRB.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/SWD.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/NPL.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/SPL.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/LMV.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/GMC.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/APL.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/EAST.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/WEST.poly",
> > > > > > > >> > > > > > "MET_BASE/poly/CONUS.poly"
> > > > > > > >> > > > > > ];
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > The files that I'm using definitely have
these
> > > > > > > >> > > > > > regions
> > > > > > > >> > > > > > as
> > > > > > > >> > > > > > well
> > > > > > > >> > > > > > as
> > > > > > > >> > > > > > seen
> > > > > > > >> > > > > > here:
> > > > > > > >> > > > > >
> > > > > > > >> > >
> > > > > > > >>
> > > > > >
> > > >
> >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > I'm somewhat at a loss of what to do since
> > > > > > > >> > > > > > everything
> > > > > > > >> > > > > > else
> > > > > > > >> > > > > > seems
> > > > > > > >> > > > > > fine.
> > > > > > > >> > > > > > Has
> > > > > > > >> > > > > > this been seen before?
> > > > > > > >> > > > >
> > > > > > > >> > > > >
> > > > > > > >> > > > >
> > > > > > > >> > > > >
> > > > > > > >> > >
> > > > > > > >> > >
> > > > > > > >> > >
> > > > > > > >> > >
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Edward Strobach - NOAA Affiliate
Time: Thu Mar 25 10:59:51 2021
So the issue that I was having, which wasn't clear until I compared
the
updated plots with a new model, was that I can't reload stat files
onto
Metviewer even if those stat files have been modified to include east
and
west. I extended my thresholding to 65 ug/m3 from 35ug/m3 and
generated
new stat files. However, the plots did not show updated CSI for those
thresholds which led me to this conclusion. The solution was to create
a
new database which has since resolved my issues.
On Mon, Mar 15, 2021 at 2:45 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:
> I analyzed data for OZMAX8 variable in CTC table.
> This variable has:
> fcst_lead : 290000, 530000, 230000,470000
> obs_thresh: >50 >60 >65 >70 >75 >85 >105 >125 >150
> vx_mask: | FULL NEC SEC NWC SWC NMT SMT GRB SWD NPL SPL MDW LMV GMC
APL
> EAST WEST CONUS
> fcst_init_beg: 2020-08-01 06:00:00 - 2021-02-18 12:00:00
> fcst_valid_beg: 2020-08-02 11:00:00 - 2021-02-19 11:00:00
>
> PDMAX1,PMAVE:
> fcst_lead : 220000 460000 160000 400000 640000 700000
>
> OZMAX1:
> fcst_lead : 220000 460000 160000 400000
>
> If you use on of your XML with OZMAX8, for example, and fcst_lead=(
> 290000, 530000, 230000,470000) and all field values put in
alphabetical
> order you should be able to get the plot.
> Example: 20210315_182836
>
> Tatiana
>
> On Mon Mar 15 08:34:36 2021, edward.strobach at noaa.gov wrote:
> > hmm.. I thought I did send an example last week. I'll send the
> > original
> > and a new one. So I basically use the same xml file for the
following
> > variables: OZCON, PMTF, OZMAX1, OZMAX8, PDMAX1, and PMAVE. The
first
> > two
> > fields have no problem producing stats for east, west, and CONUS
> > (eliminating conus now though so don't worry about that region)
while
> > no
> > stats are generated for the other fields. This occurs even though
the
> > stats are being populated in the .stat files for these regions.
> >
> > On Mon, Mar 15, 2021 at 9:59 AM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > Ed,
> > > Please, sent the XML file that actually produces the error. With
the
> > > XML
> > > you sent me before or just creating the plots randomly I always
have
> > > a
> > > valid plot.
> > >
> > > Tatiana
> > >
> > > On Wed Mar 10 14:55:06 2021, edward.strobach at noaa.gov wrote:
> > > > I'm sharing a couple of screenshots that led me to this
conclusion.
> > > > You
> > > > can see that there is a vx_mask_0 in one of the attachments
and
> > > > vx_mask_4
> > > > in another. This is all under plot_fix. I got this from one
of
> > > > your
> > > > reference numbers: 20210310_194052.
> > > >
> > > > I still just really want to know why. Part of the email I
sent
> > > > before
> > > > contains the real item that's in need of addressing; namely,
why is
> > > > this an
> > > > issue for only these fields?
> > > >
> > > >
> > > > *All my plots have produced for all regions just fine in the
past.
> > > > If
> > > > you
> > > > look at ozone (not the max fields of ozone) you will see that
all
> > > > the
> > > > plots
> > > > are being generated and stored as they always have. The list
> > > > provided
> > > > for
> > > > vx_mask in my xml files generates plots for all those regions.
For
> > > > some
> > > > reason I am getting an empty plot for EAST, WEST, and CONUS
for
> > > > OZMAX8,
> > > > OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any
clues
> > > > other
> > > > than
> > > > the error message I originally sent. *
> > > >
> > > > The stat files have these regions with the corresponding
statistics
> > > > included. If that's true, then what is going on? My
point_stat
> > > > configure
> > > > file that contains the poly files include those regions. Is
there
> > > > anything
> > > > else I can send that might be helpful?
> > > >
> > > > On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > I did not understand your comment about the 'two fix fields
for
> > > > > vx_mask'.
> > > > > I create one vx_maskk fieldand add 3 values:
> > > > > <field equalize="false" name="vx_mask">
> > > > > <set name="vx_mask_0">
> > > > > <val>CONUS</val>
> > > > > <val>EAST</val>
> > > > > <val>WEST</val>
> > > > > </set>
> > > > > </field>
> > > > > this is equal to
> > > > > <field equalize="false" name="vx_mask">
> > > > > <val>CONUS</val>
> > > > > <val>EAST</val>
> > > > > <val>WEST</val>
> > > > > </field>
> > > > >
> > > > > I run the same config OZMAX1 and METviewer also generated a
plot
> > > > > but
> > > > > only
> > > > > for PARA6C and PARA6C_BC models: 20210310_213318
> > > > > The XML you sent me points METviewer to calculate summary
> > > > > statistics.
> > > > > If
> > > > > agg statistic is selected - the plot would look differently:
> > > > > 20210310_213917
> > > > >
> > > > > Tatiana
> > > > >
> > > > >
> > > > > On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov wrote:
> > > > > > Thanks... I'm hoping that I can get an explanation on why
> > > > > > things
> > > > > > didn't
> > > > > > work. I was under the impression from my emails with John
that
> > > > > > I
> > > > > > could
> > > > > > simply list the regions that I wanted processed under the
"fix"
> > > > > > tab.
> > > > > > Now
> > > > > > it seems that you are creating two fix fields for vx_mask,
one
> > > > > > of
> > > > > > which
> > > > > > duplicates EAST, WEST, and CONUS. Why is this the
solution?
> > > > > > All
> > > > > > my
> > > > > > plots
> > > > > > have produced for all regions just fine in the past. If
you
> > > > > > look
> > > > > > at
> > > > > > ozone
> > > > > > (not the max fields of ozone) you will see that all the
plots
> > > > > > are
> > > > > > being
> > > > > > generated and stored as they always have. The list
provided
> > > > > > for
> > > > > > vx_mask in
> > > > > > my xml files generates plots for all those regions. For
some
> > > > > > reason I
> > > > > > am
> > > > > > getting an empty plot for EAST, WEST, and CONUS for
OZMAX8,
> > > > > > OZMAX1,
> > > > > > PDMAX1,
> > > > > > and PMAVE. I haven't been able to get any clues other
than the
> > > > > > error
> > > > > > message I originally sent. I have to say that the plot
number
> > > > > > reference
> > > > > > that you sent me yielded a CSI curve that I've never seen
in
> > > > > > any of
> > > > > > the
> > > > > > plots I looked at. Not sure what's going on with that
plot.
> > > > > >
> > > > > >
> > > > > > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > Ed,
> > > > > > > I recreated the XML that you sent me on the web app page
and
> > > > > > > produced
> > > > > > > the
> > > > > > > plot: #20210310_193603
> > > > > > > Please note that this XML contains all vx_mask not just
east,
> > > > > > > west,
> > > > > > > and
> > > > > > > CONUS.
> > > > > > > If I select only those masks - I still get the plot:
> > > > > > > # 20210310_194052
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov
wrote:
> > > > > > > > Here's a CSI example for ozmax8, one of the fields not
> > > > > > > > being
> > > > > > > > plotted
> > > > > > > > for
> > > > > > > > east, west, and CONUS.
> > > > > > > >
> > > > > > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach - NOAA
> > > > > > > > Affiliate
> > > > > > > > <
> > > > > > > > edward.strobach at noaa.gov> wrote:
> > > > > > > >
> > > > > > > > > I'm guessing you don't have access to WCOSS? If
not, I
> > > > > > > > > can
> > > > > > > > > copy
> > > > > > > > > a
> > > > > > > > > file
> > > > > > > > > over for you.
> > > > > > > > >
> > > > > > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via RT
> > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > wrote:
> > > > > > > > >
> > > > > > > > >> Ed,
> > > > > > > > >> Having the XML that you use would be really
helpful.
> > > > > > > > >> I briefly looked at the data using following fields
> > > > > > > > >> August 2020
> > > > > > > > >> EAST
> > > > > > > > >> PARA6C
> > > > > > > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75',
'>85',
> > > > > > > > >> '>105',
> > > > > > > > >> '>125',
> > > > > > > > >> '>150')
> > > > > > > > >> OZMAX8
> > > > > > > > >>
> > > > > > > > >> Both tables with CNT and CTC types don't have any
data
> > > > > > > > >> with
> > > > > > > > >> these
> > > > > > > > >> parameters.
> > > > > > > > >>
> > > > > > > > >> Tatiana
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >> On Tue Mar 09 12:35:05 2021,
edward.strobach at noaa.gov
> > > > > > > > >> wrote:
> > > > > > > > >> > I'm not really sure I follow. Wouldn't this
occur for
> > > > > > > > >> > all
> > > > > > > > >> > regions
> > > > > > > > >> > then,
> > > > > > > > >> > not just East, West, and CONUS? The other
regions
> > > > > > > > >> > report
> > > > > > > > >> > these
> > > > > > > > >> > thresholds
> > > > > > > > >> > with all models being compared. The Pointstat
> > > > > > > > >> > configure
> > > > > > > > >> > file
> > > > > > > > >> > that
> > > > > > > > >> > I
> > > > > > > > >> > use
> > > > > > > > >> > for these stats also confirms the thresholding
exists
> > > > > > > > >> > in
> > > > > > > > >> > that
> > > > > > > > >> > file.
> > > > > > > > >> > Moreover, I use ctc when processing plots such as
CSI,
> > > > > > > > >> > FAR,
> > > > > > > > >> > etc,
> > > > > > > > >> > which
> > > > > > > > >> > is
> > > > > > > > >> > done on the thresholds I set in pointstat and the
xml
> > > > > > > > >> > files.
> > > > > > > > >> >
> > > > > > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek via
RT
> > > > > > > > >> > <met_help at ucar.edu>
> > > > > > > > >> > wrote:
> > > > > > > > >> >
> > > > > > > > >> > > Ed,
> > > > > > > > >> > > It also would be helpful to see XML but I was
able
> > > > > > > > >> > > to
> > > > > > > > >> > > use
> > > > > > > > >> > > some
> > > > > > > > >> > > info
> > > > > > > > >> > > from
> > > > > > > > >> > > the part of the query that you sent.
> > > > > > > > >> > > I assume that you are interested on some agg
stat
> > > > > > > > >> > > calculations
> > > > > > > > >> > > and
> > > > > > > > >> > > use the
> > > > > > > > >> > > data from sl1l2 table. The data in this table
has
> > > > > > > > >> > > only
> > > > > > > > >> > > one
> > > > > > > > >> > > obs_thresh
> > > > > > > > >> > > value
> > > > > > > > >> > > - NA. That is why when you include other values
like
> > > > > > > > >> > > ">50'
> > > > > > > > >> > > the
> > > > > > > > >> > > query
> > > > > > > > >> > > returns no data.
> > > > > > > > >> > >
> > > > > > > > >> > > Tatiana
> > > > > > > > >> > >
> > > > > > > > >> > > On Tue Mar 09 07:55:16 2021,
> > > > > > > > >> > > edward.strobach at noaa.gov
> > > > > > > > >> > > wrote:
> > > > > > > > >> > > > The database is mv_cmaq_metplus which should
be
> > > > > > > > >> > > > under
> > > > > > > > >> > > > the
> > > > > > > > >> > > > group
> > > > > > > > >> > > > name
> > > > > > > > >> > > > Ed_Strobach. I did realize that my inputs
were
> > > > > > > > >> > > > switched
> > > > > > > > >> > > > around
> > > > > > > > >> > > > such
> > > > > > > > >> > > > that
> > > > > > > > >> > > > my group name was being designated as add
instead
> > > > > > > > >> > > > of
> > > > > > > > >> > > > Ed_Strobach.
> > > > > > > > >> > > > I
> > > > > > > > >> > > > have
> > > > > > > > >> > > > since switched around the inputs but I don't
think
> > > > > > > > >> > > > that
> > > > > > > > >> > > > should
> > > > > > > > >> > > > be
> > > > > > > > >> > > > the
> > > > > > > > >> > > > issue, at least I don't think so since the
other
> > > > > > > > >> > > > data
> > > > > > > > >> > > > was
> > > > > > > > >> > > > uploaded
> > > > > > > > >> > > > successfully. I was loading data this way:
> > > > > > > > >> > > >
> > > > > > > > >> > > > python load_to_metviewer_AWS.py
mv_cmaq_metplus
> > > > > > > > >> > > > add
> > > > > > > > >> > > > Ed_Strobach
> > > > > > > > >> > > >
> > > > > > > > >> > > > but should have instead been
> > > > > > > > >> > > >
> > > > > > > > >> > > > python load_to_metviewer_AWS.py
mv_cmaq_metplus
> > > > > > > > >> > > > Ed_Strobach
> > > > > > > > >> > > > add
> > > > > > > > >> > > >
> > > > > > > > >> > > > Not recognizing Ed_Strobach as an option
(i.e.
> > > > > > > > >> > > > should
> > > > > > > > >> > > > have
> > > > > > > > >> > > > been
> > > > > > > > >> > > > "add"
> > > > > > > > >> > > > or
> > > > > > > > >> > > > "new") it defaulted to add I think; but
again, I'm
> > > > > > > > >> > > > not
> > > > > > > > >> > > > sure
> > > > > > > > >> > > > that
> > > > > > > > >> > > > this
> > > > > > > > >> > > > caused the issue..
> > > > > > > > >> > > >
> > > > > > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana Burek
via
> > > > > > > > >> > > > RT
> > > > > > > > >> > > > <met_help at ucar.edu>
> > > > > > > > >> > > > wrote:
> > > > > > > > >> > > >
> > > > > > > > >> > > > > Ed,
> > > > > > > > >> > > > > What is the name of the database that
contains
> > > > > > > > >> > > > > your
> > > > > > > > >> > > > > data?
> > > > > > > > >> > > > >
> > > > > > > > >> > > > > Tatiana
> > > > > > > > >> > > > >
> > > > > > > > >> > > > > On Tue Mar 09 07:00:23 2021,
> > > > > > > > >> > > > > edward.strobach at noaa.gov
> > > > > > > > >> > > > > wrote:
> > > > > > > > >> > > > > > Good morning,
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > I recently put up a website
> > > > > > > > >> > > > > > <
> > > > > > > > >> > > > >
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > > >
> > > > >
> > >
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > with all the stats for different regions.
> > > > > > > > >> > > > > > Some
> > > > > > > > >> > > > > > noticed
> > > > > > > > >> > > > > > that
> > > > > > > > >> > > > > > there
> > > > > > > > >> > > > > > were no
> > > > > > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE, and
> > > > > > > > >> > > > > > PDMAX1
> > > > > > > > >> > > > > > fields in
> > > > > > > > >> > > > > > the
> > > > > > > > >> > > > > > website
> > > > > > > > >> > > > > > for
> > > > > > > > >> > > > > > skill score type plots and performance
> > > > > > > > >> > > > > > diagrams.
> > > > > > > > >> > > > > > I
> > > > > > > > >> > > > > > was
> > > > > > > > >> > > > > > able to
> > > > > > > > >> > > > > > determine
> > > > > > > > >> > > > > > that there was no data being processed
for
> > > > > > > > >> > > > > > those
> > > > > > > > >> > > > > > regions
> > > > > > > > >> > > > > > which
> > > > > > > > >> > > > > > I
> > > > > > > > >> > > > > > suspect is
> > > > > > > > >> > > > > > the reason for this issue. Realizing
this, I
> > > > > > > > >> > > > > > went
> > > > > > > > >> > > > > > back
> > > > > > > > >> > > > > > and
> > > > > > > > >> > > > > > found
> > > > > > > > >> > > > > > that
> > > > > > > > >> > > > > > the
> > > > > > > > >> > > > > > pointstat_config files did not contain
those
> > > > > > > > >> > > > > > regions.
> > > > > > > > >> > > > > > After
> > > > > > > > >> > > > > > adding
> > > > > > > > >> > > > > > those
> > > > > > > > >> > > > > > regions in I reprocessed everything and
now
> > > > > > > > >> > > > > > have
> > > > > > > > >> > > > > > stats
> > > > > > > > >> > > > > > for
> > > > > > > > >> > > > > > east,
> > > > > > > > >> > > > > > west,
> > > > > > > > >> > > > > > and
> > > > > > > > >> > > > > > CONUS regions. I thought everything
would
> > > > > > > > >> > > > > > have
> > > > > > > > >> > > > > > plotted
> > > > > > > > >> > > > > > successfully
> > > > > > > > >> > > > > > for
> > > > > > > > >> > > > > > those regions but found that this wasn't
so..
> > > > > > > > >> > > > > > In
> > > > > > > > >> > > > > > fact,
> > > > > > > > >> > > > > > I
> > > > > > > > >> > > > > > still
> > > > > > > > >> > > > > > get
> > > > > > > > >> > > > > > the
> > > > > > > > >> > > > > > same
> > > > > > > > >> > > > > > error which is quite surprising to me.
These
> > > > > > > > >> > > > > > regions
> > > > > > > > >> > > > > > have
> > > > > > > > >> > > > > > been
> > > > > > > > >> > > > > > requested
> > > > > > > > >> > > > > > as essential for identifying the broader
> > > > > > > > >> > > > > > performance
> > > > > > > > >> > > > > > and
> > > > > > > > >> > > > > > will
> > > > > > > > >> > > > > > aid
> > > > > > > > >> > > > > > in
> > > > > > > > >> > > > > > decision making. I will have to get
these up
> > > > > > > > >> > > > > > soon...
> > > > > > > > >> > > > > > I
> > > > > > > > >> > > > > > was
> > > > > > > > >> > > > > > wondering
> > > > > > > > >> > > > > > if
> > > > > > > > >> > > > > > there was something that stood out to
you.
> > > > > > > > >> > > > > > Here's
> > > > > > > > >> > > > > > the
> > > > > > > > >> > > > > > error
> > > > > > > > >> > > > > > that
> > > > > > > > >> > > > > > keeps
> > > > > > > > >> > > > > > coming up:
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30
09:00:00',
> > > > > > > > >> > > > > > '2020-
> > > > > > > > >> > > > > > 08-
> > > > > > > > >> > > > > > 30
> > > > > > > > >> > > > > > 10:00:00',
> > > > > > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30
12:00:00')
> > > > > > > > >> > > > > > AND BINARY if( (select
fcst_lead_offset
> > > > > > > > >> > > > > > FROM
> > > > > > > > >> > > > > > model_fcst_lead_offset
> > > > > > > > >> > > > > > WHERE model = h.model) is NULL ,
ld.fcst_lead
> > > > > > > > >> > > > > > ,
> > > > > > > > >> > > > > > ld.fcst_lead +
> > > > > > > > >> > > > > > (select
> > > > > > > > >> > > > > > fcst_lead_offset FROM
model_fcst_lead_offset
> > > > > > > > >> > > > > > WHERE
> > > > > > > > >> > > > > > model =
> > > > > > > > >> > > > > > h.model)
> > > > > > > > >> > > > > > )
> > > > > > > > >> > > > > > IN
> > > > > > > > >> > > > > > ('0', '10000', '20000', '30000', '40000',
> > > > > > > > >> > > > > > '50000',
> > > > > > > > >> > > > > > '60000',
> > > > > > > > >> > > > > > '70000',
> > > > > > > > >> > > > > > '80000', '90000', '100000', '110000',
> > > > > > > > >> > > > > > '120000',
> > > > > > > > >> > > > > > '130000',
> > > > > > > > >> > > > > > '140000',
> > > > > > > > >> > > > > > '150000', '160000', '170000', '180000',
> > > > > > > > >> > > > > > '190000',
> > > > > > > > >> > > > > > '200000',
> > > > > > > > >> > > > > > '210000',
> > > > > > > > >> > > > > > '220000', '230000', '240000', '250000',
> > > > > > > > >> > > > > > '260000',
> > > > > > > > >> > > > > > '270000',
> > > > > > > > >> > > > > > '280000',
> > > > > > > > >> > > > > > '290000', '300000', '310000', '320000',
> > > > > > > > >> > > > > > '330000',
> > > > > > > > >> > > > > > '340000',
> > > > > > > > >> > > > > > '350000',
> > > > > > > > >> > > > > > '360000', '370000', '380000', '390000',
> > > > > > > > >> > > > > > '400000',
> > > > > > > > >> > > > > > '410000',
> > > > > > > > >> > > > > > '420000',
> > > > > > > > >> > > > > > '430000', '440000', '450000', '460000',
> > > > > > > > >> > > > > > '470000',
> > > > > > > > >> > > > > > '480000')
> > > > > > > > >> > > > > > AND BINARY h.model IN ('PARA6C',
> > > > > > > > >> > > > > > 'PARA6C_BC',
> > > > > > > > >> > > > > > 'PROD',
> > > > > > > > >> > > > > > 'PROD_BC')
> > > > > > > > >> > > > > > AND BINARY h.obs_thresh IN ('>50',
'>60',
> > > > > > > > >> > > > > > '>65',
> > > > > > > > >> > > > > > '>70',
> > > > > > > > >> > > > > > '>75',
> > > > > > > > >> > > > > > '>85',
> > > > > > > > >> > > > > > '>105', '>125', '>150')
> > > > > > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > > > > >> > > > > > AND ld.stat_header_id =
h.stat_header_id;
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > No data was returned from database
> > > > > > > > >> > > > > > 2021-03-09
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > > >
> > > > >
> > >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > > > > >> > > > > > Source) -1 printFormattedTable - **
ERROR:
> > > > > > > > >> > > > > > Caught
> > > > > > > > >> > > > > > class
> > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException in
> > > > > > > > >> > > > > > printFormattedTable(ResultSet
> > > > > > > > >> > > > > > res): result set contained no data
> > > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > >> > > > > > in
> > > > > > > > >> > > > > > printFormattedTable(ResultSet res):
result set
> > > > > > > > >> > > > > > contained
> > > > > > > > >> > > > > > no
> > > > > > > > >> > > > > > data
> > > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > >> > > > > > in
> > > > > > > > >> > > > > > printFormattedTable(ResultSet res):
result set
> > > > > > > > >> > > > > > contained
> > > > > > > > >> > > > > > no
> > > > > > > > >> > > > > > data
> > > > > > > > >> > > > > > Database query time for mv_cmaq_metplus
> > > > > > > > >> > > > > > 0:00:00.016
> > > > > > > > >> > > > > > Save to file time for mv_cmaq_metplus
> > > > > > > > >> > > > > > 0:00:00.000
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > You can view the stat files of those
fields
> > > > > > > > >> > > > > > here:
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > > >
> > > > >
> > >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > The corresponding tags to those files are
> > > > > > > > >> > > > > > something
> > > > > > > > >> > > > > > like
> > > > > > > > >> > > > > > this:
> > > > > > > > >> > > > > > PARA6C_AQMAX1*
> > > > > > > > >> > > > > > PARA6C_AQMAX8*
> > > > > > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > > > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > I have similar plots for PARA6C,
PARA6C_BC,
> > > > > > > > >> > > > > > PROD,
> > > > > > > > >> > > > > > and
> > > > > > > > >> > > > > > PROD_BC.
> > > > > > > > >> > > > > > I've
> > > > > > > > >> > > > > > checked these files and these regions
(i.e.
> > > > > > > > >> > > > > > EAST,
> > > > > > > > >> > > > > > WEST,
> > > > > > > > >> > > > > > CONUS)
> > > > > > > > >> > > > > > appear
> > > > > > > > >> > > > > > tabulated for ctc stats.
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > Additionally, my files have been updated
to
> > > > > > > > >> > > > > > match
> > > > > > > > >> > > > > > the
> > > > > > > > >> > > > > > inclusion
> > > > > > > > >> > > > > > of
> > > > > > > > >> > > > > > these
> > > > > > > > >> > > > > > regions:
> > > > > > > > >> > > > > > poly = [
> > > > > > > > >> > > > > >
> "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/NWC.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/SWC.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/NMT.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/SMT.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/GRB.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/SWD.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/NPL.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/SPL.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/LMV.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/GMC.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/APL.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/EAST.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/WEST.poly",
> > > > > > > > >> > > > > > "MET_BASE/poly/CONUS.poly"
> > > > > > > > >> > > > > > ];
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > The files that I'm using definitely have
these
> > > > > > > > >> > > > > > regions
> > > > > > > > >> > > > > > as
> > > > > > > > >> > > > > > well
> > > > > > > > >> > > > > > as
> > > > > > > > >> > > > > > seen
> > > > > > > > >> > > > > > here:
> > > > > > > > >> > > > > >
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > > >
> > > > >
> > >
>
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > > > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > > > > > >> > > > > >
> > > > > > > > >> > > > > > I'm somewhat at a loss of what to do
since
> > > > > > > > >> > > > > > everything
> > > > > > > > >> > > > > > else
> > > > > > > > >> > > > > > seems
> > > > > > > > >> > > > > > fine.
> > > > > > > > >> > > > > > Has
> > > > > > > > >> > > > > > this been seen before?
> > > > > > > > >> > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > > > >
> > > > > > > > >> > >
> > > > > > > > >> > >
> > > > > > > > >> > >
> > > > > > > > >> > >
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
>
>
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: John Halley Gotway
Time: Mon Mar 29 12:25:42 2021
Ed,
Thanks for following up with this information. When you load files
into a
METviewer database, it does keep track of the filenames that it's
loaded.
And there is an XML load option which applies to file names that have
already been loaded.
Tatiana, do you have any additional advice for Ed? Obviously, loading
that
data into a different database worked. But is there anything he
should/could have done to load this into his existing database?
Thank,
John
On Thu, Mar 25, 2021 at 11:00 AM Edward Strobach - NOAA Affiliate via
RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98972 >
>
> So the issue that I was having, which wasn't clear until I compared
the
> updated plots with a new model, was that I can't reload stat files
onto
> Metviewer even if those stat files have been modified to include
east and
> west. I extended my thresholding to 65 ug/m3 from 35ug/m3 and
generated
> new stat files. However, the plots did not show updated CSI for
those
> thresholds which led me to this conclusion. The solution was to
create a
> new database which has since resolved my issues.
>
> On Mon, Mar 15, 2021 at 2:45 PM Tatiana Burek via RT
<met_help at ucar.edu>
> wrote:
>
> > I analyzed data for OZMAX8 variable in CTC table.
> > This variable has:
> > fcst_lead : 290000, 530000, 230000,470000
> > obs_thresh: >50 >60 >65 >70 >75 >85 >105 >125 >150
> > vx_mask: | FULL NEC SEC NWC SWC NMT SMT GRB SWD NPL SPL MDW LMV
GMC APL
> > EAST WEST CONUS
> > fcst_init_beg: 2020-08-01 06:00:00 - 2021-02-18 12:00:00
> > fcst_valid_beg: 2020-08-02 11:00:00 - 2021-02-19 11:00:00
> >
> > PDMAX1,PMAVE:
> > fcst_lead : 220000 460000 160000 400000 640000 700000
> >
> > OZMAX1:
> > fcst_lead : 220000 460000 160000 400000
> >
> > If you use on of your XML with OZMAX8, for example, and
fcst_lead=(
> > 290000, 530000, 230000,470000) and all field values put in
alphabetical
> > order you should be able to get the plot.
> > Example: 20210315_182836
> >
> > Tatiana
> >
> > On Mon Mar 15 08:34:36 2021, edward.strobach at noaa.gov wrote:
> > > hmm.. I thought I did send an example last week. I'll send the
> > > original
> > > and a new one. So I basically use the same xml file for the
following
> > > variables: OZCON, PMTF, OZMAX1, OZMAX8, PDMAX1, and PMAVE. The
first
> > > two
> > > fields have no problem producing stats for east, west, and CONUS
> > > (eliminating conus now though so don't worry about that region)
while
> > > no
> > > stats are generated for the other fields. This occurs even
though the
> > > stats are being populated in the .stat files for these regions.
> > >
> > > On Mon, Mar 15, 2021 at 9:59 AM Tatiana Burek via RT
> > > <met_help at ucar.edu>
> > > wrote:
> > >
> > > > Ed,
> > > > Please, sent the XML file that actually produces the error.
With the
> > > > XML
> > > > you sent me before or just creating the plots randomly I
always have
> > > > a
> > > > valid plot.
> > > >
> > > > Tatiana
> > > >
> > > > On Wed Mar 10 14:55:06 2021, edward.strobach at noaa.gov wrote:
> > > > > I'm sharing a couple of screenshots that led me to this
conclusion.
> > > > > You
> > > > > can see that there is a vx_mask_0 in one of the attachments
and
> > > > > vx_mask_4
> > > > > in another. This is all under plot_fix. I got this from
one of
> > > > > your
> > > > > reference numbers: 20210310_194052.
> > > > >
> > > > > I still just really want to know why. Part of the email I
sent
> > > > > before
> > > > > contains the real item that's in need of addressing; namely,
why is
> > > > > this an
> > > > > issue for only these fields?
> > > > >
> > > > >
> > > > > *All my plots have produced for all regions just fine in the
past.
> > > > > If
> > > > > you
> > > > > look at ozone (not the max fields of ozone) you will see
that all
> > > > > the
> > > > > plots
> > > > > are being generated and stored as they always have. The
list
> > > > > provided
> > > > > for
> > > > > vx_mask in my xml files generates plots for all those
regions. For
> > > > > some
> > > > > reason I am getting an empty plot for EAST, WEST, and CONUS
for
> > > > > OZMAX8,
> > > > > OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any
clues
> > > > > other
> > > > > than
> > > > > the error message I originally sent. *
> > > > >
> > > > > The stat files have these regions with the corresponding
statistics
> > > > > included. If that's true, then what is going on? My
point_stat
> > > > > configure
> > > > > file that contains the poly files include those regions. Is
there
> > > > > anything
> > > > > else I can send that might be helpful?
> > > > >
> > > > > On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
> > > > > <met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > I did not understand your comment about the 'two fix
fields for
> > > > > > vx_mask'.
> > > > > > I create one vx_maskk fieldand add 3 values:
> > > > > > <field equalize="false" name="vx_mask">
> > > > > > <set name="vx_mask_0">
> > > > > > <val>CONUS</val>
> > > > > > <val>EAST</val>
> > > > > > <val>WEST</val>
> > > > > > </set>
> > > > > > </field>
> > > > > > this is equal to
> > > > > > <field equalize="false" name="vx_mask">
> > > > > > <val>CONUS</val>
> > > > > > <val>EAST</val>
> > > > > > <val>WEST</val>
> > > > > > </field>
> > > > > >
> > > > > > I run the same config OZMAX1 and METviewer also generated
a plot
> > > > > > but
> > > > > > only
> > > > > > for PARA6C and PARA6C_BC models: 20210310_213318
> > > > > > The XML you sent me points METviewer to calculate summary
> > > > > > statistics.
> > > > > > If
> > > > > > agg statistic is selected - the plot would look
differently:
> > > > > > 20210310_213917
> > > > > >
> > > > > > Tatiana
> > > > > >
> > > > > >
> > > > > > On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov
wrote:
> > > > > > > Thanks... I'm hoping that I can get an explanation on
why
> > > > > > > things
> > > > > > > didn't
> > > > > > > work. I was under the impression from my emails with
John that
> > > > > > > I
> > > > > > > could
> > > > > > > simply list the regions that I wanted processed under
the "fix"
> > > > > > > tab.
> > > > > > > Now
> > > > > > > it seems that you are creating two fix fields for
vx_mask, one
> > > > > > > of
> > > > > > > which
> > > > > > > duplicates EAST, WEST, and CONUS. Why is this the
solution?
> > > > > > > All
> > > > > > > my
> > > > > > > plots
> > > > > > > have produced for all regions just fine in the past. If
you
> > > > > > > look
> > > > > > > at
> > > > > > > ozone
> > > > > > > (not the max fields of ozone) you will see that all the
plots
> > > > > > > are
> > > > > > > being
> > > > > > > generated and stored as they always have. The list
provided
> > > > > > > for
> > > > > > > vx_mask in
> > > > > > > my xml files generates plots for all those regions. For
some
> > > > > > > reason I
> > > > > > > am
> > > > > > > getting an empty plot for EAST, WEST, and CONUS for
OZMAX8,
> > > > > > > OZMAX1,
> > > > > > > PDMAX1,
> > > > > > > and PMAVE. I haven't been able to get any clues other
than the
> > > > > > > error
> > > > > > > message I originally sent. I have to say that the plot
number
> > > > > > > reference
> > > > > > > that you sent me yielded a CSI curve that I've never
seen in
> > > > > > > any of
> > > > > > > the
> > > > > > > plots I looked at. Not sure what's going on with that
plot.
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > > > > > > <met_help at ucar.edu>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Ed,
> > > > > > > > I recreated the XML that you sent me on the web app
page and
> > > > > > > > produced
> > > > > > > > the
> > > > > > > > plot: #20210310_193603
> > > > > > > > Please note that this XML contains all vx_mask not
just east,
> > > > > > > > west,
> > > > > > > > and
> > > > > > > > CONUS.
> > > > > > > > If I select only those masks - I still get the plot:
> > > > > > > > # 20210310_194052
> > > > > > > >
> > > > > > > > Tatiana
> > > > > > > >
> > > > > > > > On Wed Mar 10 02:31:00 2021, edward.strobach at noaa.gov
wrote:
> > > > > > > > > Here's a CSI example for ozmax8, one of the fields
not
> > > > > > > > > being
> > > > > > > > > plotted
> > > > > > > > > for
> > > > > > > > > east, west, and CONUS.
> > > > > > > > >
> > > > > > > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach -
NOAA
> > > > > > > > > Affiliate
> > > > > > > > > <
> > > > > > > > > edward.strobach at noaa.gov> wrote:
> > > > > > > > >
> > > > > > > > > > I'm guessing you don't have access to WCOSS? If
not, I
> > > > > > > > > > can
> > > > > > > > > > copy
> > > > > > > > > > a
> > > > > > > > > > file
> > > > > > > > > > over for you.
> > > > > > > > > >
> > > > > > > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via
RT
> > > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > > wrote:
> > > > > > > > > >
> > > > > > > > > >> Ed,
> > > > > > > > > >> Having the XML that you use would be really
helpful.
> > > > > > > > > >> I briefly looked at the data using following
fields
> > > > > > > > > >> August 2020
> > > > > > > > > >> EAST
> > > > > > > > > >> PARA6C
> > > > > > > > > >> obs_thresh IN ('>50', '>60', '>65', '>70', '>75',
'>85',
> > > > > > > > > >> '>105',
> > > > > > > > > >> '>125',
> > > > > > > > > >> '>150')
> > > > > > > > > >> OZMAX8
> > > > > > > > > >>
> > > > > > > > > >> Both tables with CNT and CTC types don't have any
data
> > > > > > > > > >> with
> > > > > > > > > >> these
> > > > > > > > > >> parameters.
> > > > > > > > > >>
> > > > > > > > > >> Tatiana
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >> On Tue Mar 09 12:35:05 2021,
edward.strobach at noaa.gov
> > > > > > > > > >> wrote:
> > > > > > > > > >> > I'm not really sure I follow. Wouldn't this
occur for
> > > > > > > > > >> > all
> > > > > > > > > >> > regions
> > > > > > > > > >> > then,
> > > > > > > > > >> > not just East, West, and CONUS? The other
regions
> > > > > > > > > >> > report
> > > > > > > > > >> > these
> > > > > > > > > >> > thresholds
> > > > > > > > > >> > with all models being compared. The Pointstat
> > > > > > > > > >> > configure
> > > > > > > > > >> > file
> > > > > > > > > >> > that
> > > > > > > > > >> > I
> > > > > > > > > >> > use
> > > > > > > > > >> > for these stats also confirms the thresholding
exists
> > > > > > > > > >> > in
> > > > > > > > > >> > that
> > > > > > > > > >> > file.
> > > > > > > > > >> > Moreover, I use ctc when processing plots such
as CSI,
> > > > > > > > > >> > FAR,
> > > > > > > > > >> > etc,
> > > > > > > > > >> > which
> > > > > > > > > >> > is
> > > > > > > > > >> > done on the thresholds I set in pointstat and
the xml
> > > > > > > > > >> > files.
> > > > > > > > > >> >
> > > > > > > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek
via RT
> > > > > > > > > >> > <met_help at ucar.edu>
> > > > > > > > > >> > wrote:
> > > > > > > > > >> >
> > > > > > > > > >> > > Ed,
> > > > > > > > > >> > > It also would be helpful to see XML but I was
able
> > > > > > > > > >> > > to
> > > > > > > > > >> > > use
> > > > > > > > > >> > > some
> > > > > > > > > >> > > info
> > > > > > > > > >> > > from
> > > > > > > > > >> > > the part of the query that you sent.
> > > > > > > > > >> > > I assume that you are interested on some agg
stat
> > > > > > > > > >> > > calculations
> > > > > > > > > >> > > and
> > > > > > > > > >> > > use the
> > > > > > > > > >> > > data from sl1l2 table. The data in this table
has
> > > > > > > > > >> > > only
> > > > > > > > > >> > > one
> > > > > > > > > >> > > obs_thresh
> > > > > > > > > >> > > value
> > > > > > > > > >> > > - NA. That is why when you include other
values like
> > > > > > > > > >> > > ">50'
> > > > > > > > > >> > > the
> > > > > > > > > >> > > query
> > > > > > > > > >> > > returns no data.
> > > > > > > > > >> > >
> > > > > > > > > >> > > Tatiana
> > > > > > > > > >> > >
> > > > > > > > > >> > > On Tue Mar 09 07:55:16 2021,
> > > > > > > > > >> > > edward.strobach at noaa.gov
> > > > > > > > > >> > > wrote:
> > > > > > > > > >> > > > The database is mv_cmaq_metplus which
should be
> > > > > > > > > >> > > > under
> > > > > > > > > >> > > > the
> > > > > > > > > >> > > > group
> > > > > > > > > >> > > > name
> > > > > > > > > >> > > > Ed_Strobach. I did realize that my inputs
were
> > > > > > > > > >> > > > switched
> > > > > > > > > >> > > > around
> > > > > > > > > >> > > > such
> > > > > > > > > >> > > > that
> > > > > > > > > >> > > > my group name was being designated as add
instead
> > > > > > > > > >> > > > of
> > > > > > > > > >> > > > Ed_Strobach.
> > > > > > > > > >> > > > I
> > > > > > > > > >> > > > have
> > > > > > > > > >> > > > since switched around the inputs but I
don't think
> > > > > > > > > >> > > > that
> > > > > > > > > >> > > > should
> > > > > > > > > >> > > > be
> > > > > > > > > >> > > > the
> > > > > > > > > >> > > > issue, at least I don't think so since the
other
> > > > > > > > > >> > > > data
> > > > > > > > > >> > > > was
> > > > > > > > > >> > > > uploaded
> > > > > > > > > >> > > > successfully. I was loading data this way:
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > python load_to_metviewer_AWS.py
mv_cmaq_metplus
> > > > > > > > > >> > > > add
> > > > > > > > > >> > > > Ed_Strobach
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > but should have instead been
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > python load_to_metviewer_AWS.py
mv_cmaq_metplus
> > > > > > > > > >> > > > Ed_Strobach
> > > > > > > > > >> > > > add
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > Not recognizing Ed_Strobach as an option
(i.e.
> > > > > > > > > >> > > > should
> > > > > > > > > >> > > > have
> > > > > > > > > >> > > > been
> > > > > > > > > >> > > > "add"
> > > > > > > > > >> > > > or
> > > > > > > > > >> > > > "new") it defaulted to add I think; but
again, I'm
> > > > > > > > > >> > > > not
> > > > > > > > > >> > > > sure
> > > > > > > > > >> > > > that
> > > > > > > > > >> > > > this
> > > > > > > > > >> > > > caused the issue..
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana
Burek via
> > > > > > > > > >> > > > RT
> > > > > > > > > >> > > > <met_help at ucar.edu>
> > > > > > > > > >> > > > wrote:
> > > > > > > > > >> > > >
> > > > > > > > > >> > > > > Ed,
> > > > > > > > > >> > > > > What is the name of the database that
contains
> > > > > > > > > >> > > > > your
> > > > > > > > > >> > > > > data?
> > > > > > > > > >> > > > >
> > > > > > > > > >> > > > > Tatiana
> > > > > > > > > >> > > > >
> > > > > > > > > >> > > > > On Tue Mar 09 07:00:23 2021,
> > > > > > > > > >> > > > > edward.strobach at noaa.gov
> > > > > > > > > >> > > > > wrote:
> > > > > > > > > >> > > > > > Good morning,
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > I recently put up a website
> > > > > > > > > >> > > > > > <
> > > > > > > > > >> > > > >
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> >
>
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > with all the stats for different
regions.
> > > > > > > > > >> > > > > > Some
> > > > > > > > > >> > > > > > noticed
> > > > > > > > > >> > > > > > that
> > > > > > > > > >> > > > > > there
> > > > > > > > > >> > > > > > were no
> > > > > > > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE,
and
> > > > > > > > > >> > > > > > PDMAX1
> > > > > > > > > >> > > > > > fields in
> > > > > > > > > >> > > > > > the
> > > > > > > > > >> > > > > > website
> > > > > > > > > >> > > > > > for
> > > > > > > > > >> > > > > > skill score type plots and performance
> > > > > > > > > >> > > > > > diagrams.
> > > > > > > > > >> > > > > > I
> > > > > > > > > >> > > > > > was
> > > > > > > > > >> > > > > > able to
> > > > > > > > > >> > > > > > determine
> > > > > > > > > >> > > > > > that there was no data being processed
for
> > > > > > > > > >> > > > > > those
> > > > > > > > > >> > > > > > regions
> > > > > > > > > >> > > > > > which
> > > > > > > > > >> > > > > > I
> > > > > > > > > >> > > > > > suspect is
> > > > > > > > > >> > > > > > the reason for this issue. Realizing
this, I
> > > > > > > > > >> > > > > > went
> > > > > > > > > >> > > > > > back
> > > > > > > > > >> > > > > > and
> > > > > > > > > >> > > > > > found
> > > > > > > > > >> > > > > > that
> > > > > > > > > >> > > > > > the
> > > > > > > > > >> > > > > > pointstat_config files did not contain
those
> > > > > > > > > >> > > > > > regions.
> > > > > > > > > >> > > > > > After
> > > > > > > > > >> > > > > > adding
> > > > > > > > > >> > > > > > those
> > > > > > > > > >> > > > > > regions in I reprocessed everything and
now
> > > > > > > > > >> > > > > > have
> > > > > > > > > >> > > > > > stats
> > > > > > > > > >> > > > > > for
> > > > > > > > > >> > > > > > east,
> > > > > > > > > >> > > > > > west,
> > > > > > > > > >> > > > > > and
> > > > > > > > > >> > > > > > CONUS regions. I thought everything
would
> > > > > > > > > >> > > > > > have
> > > > > > > > > >> > > > > > plotted
> > > > > > > > > >> > > > > > successfully
> > > > > > > > > >> > > > > > for
> > > > > > > > > >> > > > > > those regions but found that this
wasn't so..
> > > > > > > > > >> > > > > > In
> > > > > > > > > >> > > > > > fact,
> > > > > > > > > >> > > > > > I
> > > > > > > > > >> > > > > > still
> > > > > > > > > >> > > > > > get
> > > > > > > > > >> > > > > > the
> > > > > > > > > >> > > > > > same
> > > > > > > > > >> > > > > > error which is quite surprising to me.
These
> > > > > > > > > >> > > > > > regions
> > > > > > > > > >> > > > > > have
> > > > > > > > > >> > > > > > been
> > > > > > > > > >> > > > > > requested
> > > > > > > > > >> > > > > > as essential for identifying the
broader
> > > > > > > > > >> > > > > > performance
> > > > > > > > > >> > > > > > and
> > > > > > > > > >> > > > > > will
> > > > > > > > > >> > > > > > aid
> > > > > > > > > >> > > > > > in
> > > > > > > > > >> > > > > > decision making. I will have to get
these up
> > > > > > > > > >> > > > > > soon...
> > > > > > > > > >> > > > > > I
> > > > > > > > > >> > > > > > was
> > > > > > > > > >> > > > > > wondering
> > > > > > > > > >> > > > > > if
> > > > > > > > > >> > > > > > there was something that stood out to
you.
> > > > > > > > > >> > > > > > Here's
> > > > > > > > > >> > > > > > the
> > > > > > > > > >> > > > > > error
> > > > > > > > > >> > > > > > that
> > > > > > > > > >> > > > > > keeps
> > > > > > > > > >> > > > > > coming up:
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30
09:00:00',
> > > > > > > > > >> > > > > > '2020-
> > > > > > > > > >> > > > > > 08-
> > > > > > > > > >> > > > > > 30
> > > > > > > > > >> > > > > > 10:00:00',
> > > > > > > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30
12:00:00')
> > > > > > > > > >> > > > > > AND BINARY if( (select
fcst_lead_offset
> > > > > > > > > >> > > > > > FROM
> > > > > > > > > >> > > > > > model_fcst_lead_offset
> > > > > > > > > >> > > > > > WHERE model = h.model) is NULL ,
ld.fcst_lead
> > > > > > > > > >> > > > > > ,
> > > > > > > > > >> > > > > > ld.fcst_lead +
> > > > > > > > > >> > > > > > (select
> > > > > > > > > >> > > > > > fcst_lead_offset FROM
model_fcst_lead_offset
> > > > > > > > > >> > > > > > WHERE
> > > > > > > > > >> > > > > > model =
> > > > > > > > > >> > > > > > h.model)
> > > > > > > > > >> > > > > > )
> > > > > > > > > >> > > > > > IN
> > > > > > > > > >> > > > > > ('0', '10000', '20000', '30000',
'40000',
> > > > > > > > > >> > > > > > '50000',
> > > > > > > > > >> > > > > > '60000',
> > > > > > > > > >> > > > > > '70000',
> > > > > > > > > >> > > > > > '80000', '90000', '100000', '110000',
> > > > > > > > > >> > > > > > '120000',
> > > > > > > > > >> > > > > > '130000',
> > > > > > > > > >> > > > > > '140000',
> > > > > > > > > >> > > > > > '150000', '160000', '170000', '180000',
> > > > > > > > > >> > > > > > '190000',
> > > > > > > > > >> > > > > > '200000',
> > > > > > > > > >> > > > > > '210000',
> > > > > > > > > >> > > > > > '220000', '230000', '240000', '250000',
> > > > > > > > > >> > > > > > '260000',
> > > > > > > > > >> > > > > > '270000',
> > > > > > > > > >> > > > > > '280000',
> > > > > > > > > >> > > > > > '290000', '300000', '310000', '320000',
> > > > > > > > > >> > > > > > '330000',
> > > > > > > > > >> > > > > > '340000',
> > > > > > > > > >> > > > > > '350000',
> > > > > > > > > >> > > > > > '360000', '370000', '380000', '390000',
> > > > > > > > > >> > > > > > '400000',
> > > > > > > > > >> > > > > > '410000',
> > > > > > > > > >> > > > > > '420000',
> > > > > > > > > >> > > > > > '430000', '440000', '450000', '460000',
> > > > > > > > > >> > > > > > '470000',
> > > > > > > > > >> > > > > > '480000')
> > > > > > > > > >> > > > > > AND BINARY h.model IN ('PARA6C',
> > > > > > > > > >> > > > > > 'PARA6C_BC',
> > > > > > > > > >> > > > > > 'PROD',
> > > > > > > > > >> > > > > > 'PROD_BC')
> > > > > > > > > >> > > > > > AND BINARY h.obs_thresh IN ('>50',
'>60',
> > > > > > > > > >> > > > > > '>65',
> > > > > > > > > >> > > > > > '>70',
> > > > > > > > > >> > > > > > '>75',
> > > > > > > > > >> > > > > > '>85',
> > > > > > > > > >> > > > > > '>105', '>125', '>150')
> > > > > > > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > > > > > >> > > > > > AND ld.stat_header_id =
h.stat_header_id;
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > No data was returned from database
> > > > > > > > > >> > > > > > 2021-03-09
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > >
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> >
>
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > > > > > >> > > > > > Source) -1 printFormattedTable - **
ERROR:
> > > > > > > > > >> > > > > > Caught
> > > > > > > > > >> > > > > > class
> > > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException in
> > > > > > > > > >> > > > > > printFormattedTable(ResultSet
> > > > > > > > > >> > > > > > res): result set contained no data
> > > > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > > >> > > > > > in
> > > > > > > > > >> > > > > > printFormattedTable(ResultSet res):
result set
> > > > > > > > > >> > > > > > contained
> > > > > > > > > >> > > > > > no
> > > > > > > > > >> > > > > > data
> > > > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > > >> > > > > > in
> > > > > > > > > >> > > > > > printFormattedTable(ResultSet res):
result set
> > > > > > > > > >> > > > > > contained
> > > > > > > > > >> > > > > > no
> > > > > > > > > >> > > > > > data
> > > > > > > > > >> > > > > > Database query time for mv_cmaq_metplus
> > > > > > > > > >> > > > > > 0:00:00.016
> > > > > > > > > >> > > > > > Save to file time for mv_cmaq_metplus
> > > > > > > > > >> > > > > > 0:00:00.000
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > You can view the stat files of those
fields
> > > > > > > > > >> > > > > > here:
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > >
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> >
>
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > The corresponding tags to those files
are
> > > > > > > > > >> > > > > > something
> > > > > > > > > >> > > > > > like
> > > > > > > > > >> > > > > > this:
> > > > > > > > > >> > > > > > PARA6C_AQMAX1*
> > > > > > > > > >> > > > > > PARA6C_AQMAX8*
> > > > > > > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > > > > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > I have similar plots for PARA6C,
PARA6C_BC,
> > > > > > > > > >> > > > > > PROD,
> > > > > > > > > >> > > > > > and
> > > > > > > > > >> > > > > > PROD_BC.
> > > > > > > > > >> > > > > > I've
> > > > > > > > > >> > > > > > checked these files and these regions
(i.e.
> > > > > > > > > >> > > > > > EAST,
> > > > > > > > > >> > > > > > WEST,
> > > > > > > > > >> > > > > > CONUS)
> > > > > > > > > >> > > > > > appear
> > > > > > > > > >> > > > > > tabulated for ctc stats.
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > Additionally, my files have been
updated to
> > > > > > > > > >> > > > > > match
> > > > > > > > > >> > > > > > the
> > > > > > > > > >> > > > > > inclusion
> > > > > > > > > >> > > > > > of
> > > > > > > > > >> > > > > > these
> > > > > > > > > >> > > > > > regions:
> > > > > > > > > >> > > > > > poly = [
> > > > > > > > > >> > > > > >
> > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/NWC.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/SWC.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/NMT.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/SMT.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/GRB.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/SWD.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/NPL.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/SPL.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/LMV.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/GMC.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/APL.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/EAST.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/WEST.poly",
> > > > > > > > > >> > > > > > "MET_BASE/poly/CONUS.poly"
> > > > > > > > > >> > > > > > ];
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > The files that I'm using definitely
have these
> > > > > > > > > >> > > > > > regions
> > > > > > > > > >> > > > > > as
> > > > > > > > > >> > > > > > well
> > > > > > > > > >> > > > > > as
> > > > > > > > > >> > > > > > seen
> > > > > > > > > >> > > > > > here:
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > > >
> > > > > >
> > > >
> >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > > > > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > > > > > > >> > > > > >
> > > > > > > > > >> > > > > > I'm somewhat at a loss of what to do
since
> > > > > > > > > >> > > > > > everything
> > > > > > > > > >> > > > > > else
> > > > > > > > > >> > > > > > seems
> > > > > > > > > >> > > > > > fine.
> > > > > > > > > >> > > > > > Has
> > > > > > > > > >> > > > > > this been seen before?
> > > > > > > > > >> > > > >
> > > > > > > > > >> > > > >
> > > > > > > > > >> > > > >
> > > > > > > > > >> > > > >
> > > > > > > > > >> > >
> > > > > > > > > >> > >
> > > > > > > > > >> > >
> > > > > > > > > >> > >
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > > > >>
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> > > >
> > > >
> > > >
> >
> >
> >
> >
>
>
------------------------------------------------
Subject: East, west, and CONUS are not being processed in metviewer
From: Tatiana Burek
Time: Tue Mar 30 09:19:32 2021
Ed,
When you say "I can't reload stat files onto Metviewer" do you mean
that you get a message saying that the file has already exists in the
database and can't be loaded or the file was processed but you can't
see the data?
If it is the 1st case, you could change <force_dup_file> value from
false to true and the data from these files would be appended to the
database.
Tatiana
On Mon Mar 29 12:25:42 2021, johnhg wrote:
> Ed,
>
> Thanks for following up with this information. When you load files
> into a
> METviewer database, it does keep track of the filenames that it's
> loaded.
> And there is an XML load option which applies to file names that
have
> already been loaded.
>
> Tatiana, do you have any additional advice for Ed? Obviously,
loading
> that
> data into a different database worked. But is there anything he
> should/could have done to load this into his existing database?
>
> Thank,
> John
>
> On Thu, Mar 25, 2021 at 11:00 AM Edward Strobach - NOAA Affiliate
via
> RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=98972 >
> >
> > So the issue that I was having, which wasn't clear until I
compared
> > the
> > updated plots with a new model, was that I can't reload stat files
> > onto
> > Metviewer even if those stat files have been modified to include
east
> > and
> > west. I extended my thresholding to 65 ug/m3 from 35ug/m3 and
> > generated
> > new stat files. However, the plots did not show updated CSI for
> > those
> > thresholds which led me to this conclusion. The solution was to
> > create a
> > new database which has since resolved my issues.
> >
> > On Mon, Mar 15, 2021 at 2:45 PM Tatiana Burek via RT
> > <met_help at ucar.edu>
> > wrote:
> >
> > > I analyzed data for OZMAX8 variable in CTC table.
> > > This variable has:
> > > fcst_lead : 290000, 530000, 230000,470000
> > > obs_thresh: >50 >60 >65 >70 >75 >85 >105 >125 >150
> > > vx_mask: | FULL NEC SEC NWC SWC NMT SMT GRB SWD NPL SPL MDW LMV
GMC
> > > APL
> > > EAST WEST CONUS
> > > fcst_init_beg: 2020-08-01 06:00:00 - 2021-02-18 12:00:00
> > > fcst_valid_beg: 2020-08-02 11:00:00 - 2021-02-19 11:00:00
> > >
> > > PDMAX1,PMAVE:
> > > fcst_lead : 220000 460000 160000 400000 640000 700000
> > >
> > > OZMAX1:
> > > fcst_lead : 220000 460000 160000 400000
> > >
> > > If you use on of your XML with OZMAX8, for example, and
fcst_lead=(
> > > 290000, 530000, 230000,470000) and all field values put in
> > > alphabetical
> > > order you should be able to get the plot.
> > > Example: 20210315_182836
> > >
> > > Tatiana
> > >
> > > On Mon Mar 15 08:34:36 2021, edward.strobach at noaa.gov wrote:
> > > > hmm.. I thought I did send an example last week. I'll send
the
> > > > original
> > > > and a new one. So I basically use the same xml file for the
> > > > following
> > > > variables: OZCON, PMTF, OZMAX1, OZMAX8, PDMAX1, and PMAVE.
The
> > > > first
> > > > two
> > > > fields have no problem producing stats for east, west, and
CONUS
> > > > (eliminating conus now though so don't worry about that
region)
> > > > while
> > > > no
> > > > stats are generated for the other fields. This occurs even
> > > > though the
> > > > stats are being populated in the .stat files for these
regions.
> > > >
> > > > On Mon, Mar 15, 2021 at 9:59 AM Tatiana Burek via RT
> > > > <met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Ed,
> > > > > Please, sent the XML file that actually produces the error.
> > > > > With the
> > > > > XML
> > > > > you sent me before or just creating the plots randomly I
always
> > > > > have
> > > > > a
> > > > > valid plot.
> > > > >
> > > > > Tatiana
> > > > >
> > > > > On Wed Mar 10 14:55:06 2021, edward.strobach at noaa.gov wrote:
> > > > > > I'm sharing a couple of screenshots that led me to this
> > > > > > conclusion.
> > > > > > You
> > > > > > can see that there is a vx_mask_0 in one of the
attachments
> > > > > > and
> > > > > > vx_mask_4
> > > > > > in another. This is all under plot_fix. I got this from
one
> > > > > > of
> > > > > > your
> > > > > > reference numbers: 20210310_194052.
> > > > > >
> > > > > > I still just really want to know why. Part of the email I
> > > > > > sent
> > > > > > before
> > > > > > contains the real item that's in need of addressing;
namely,
> > > > > > why is
> > > > > > this an
> > > > > > issue for only these fields?
> > > > > >
> > > > > >
> > > > > > *All my plots have produced for all regions just fine in
the
> > > > > > past.
> > > > > > If
> > > > > > you
> > > > > > look at ozone (not the max fields of ozone) you will see
that
> > > > > > all
> > > > > > the
> > > > > > plots
> > > > > > are being generated and stored as they always have. The
list
> > > > > > provided
> > > > > > for
> > > > > > vx_mask in my xml files generates plots for all those
> > > > > > regions. For
> > > > > > some
> > > > > > reason I am getting an empty plot for EAST, WEST, and
CONUS
> > > > > > for
> > > > > > OZMAX8,
> > > > > > OZMAX1, PDMAX1, and PMAVE. I haven't been able to get any
> > > > > > clues
> > > > > > other
> > > > > > than
> > > > > > the error message I originally sent. *
> > > > > >
> > > > > > The stat files have these regions with the corresponding
> > > > > > statistics
> > > > > > included. If that's true, then what is going on? My
> > > > > > point_stat
> > > > > > configure
> > > > > > file that contains the poly files include those regions.
Is
> > > > > > there
> > > > > > anything
> > > > > > else I can send that might be helpful?
> > > > > >
> > > > > > On Wed, Mar 10, 2021 at 4:41 PM Tatiana Burek via RT
> > > > > > <met_help at ucar.edu>
> > > > > > wrote:
> > > > > >
> > > > > > > I did not understand your comment about the 'two fix
fields
> > > > > > > for
> > > > > > > vx_mask'.
> > > > > > > I create one vx_maskk fieldand add 3 values:
> > > > > > > <field equalize="false" name="vx_mask">
> > > > > > > <set name="vx_mask_0">
> > > > > > > <val>CONUS</val>
> > > > > > > <val>EAST</val>
> > > > > > > <val>WEST</val>
> > > > > > > </set>
> > > > > > > </field>
> > > > > > > this is equal to
> > > > > > > <field equalize="false" name="vx_mask">
> > > > > > > <val>CONUS</val>
> > > > > > > <val>EAST</val>
> > > > > > > <val>WEST</val>
> > > > > > > </field>
> > > > > > >
> > > > > > > I run the same config OZMAX1 and METviewer also
generated a
> > > > > > > plot
> > > > > > > but
> > > > > > > only
> > > > > > > for PARA6C and PARA6C_BC models: 20210310_213318
> > > > > > > The XML you sent me points METviewer to calculate
summary
> > > > > > > statistics.
> > > > > > > If
> > > > > > > agg statistic is selected - the plot would look
> > > > > > > differently:
> > > > > > > 20210310_213917
> > > > > > >
> > > > > > > Tatiana
> > > > > > >
> > > > > > >
> > > > > > > On Wed Mar 10 13:37:58 2021, edward.strobach at noaa.gov
> > > > > > > wrote:
> > > > > > > > Thanks... I'm hoping that I can get an explanation on
why
> > > > > > > > things
> > > > > > > > didn't
> > > > > > > > work. I was under the impression from my emails with
> > > > > > > > John that
> > > > > > > > I
> > > > > > > > could
> > > > > > > > simply list the regions that I wanted processed under
the
> > > > > > > > "fix"
> > > > > > > > tab.
> > > > > > > > Now
> > > > > > > > it seems that you are creating two fix fields for
> > > > > > > > vx_mask, one
> > > > > > > > of
> > > > > > > > which
> > > > > > > > duplicates EAST, WEST, and CONUS. Why is this the
> > > > > > > > solution?
> > > > > > > > All
> > > > > > > > my
> > > > > > > > plots
> > > > > > > > have produced for all regions just fine in the past.
If
> > > > > > > > you
> > > > > > > > look
> > > > > > > > at
> > > > > > > > ozone
> > > > > > > > (not the max fields of ozone) you will see that all
the
> > > > > > > > plots
> > > > > > > > are
> > > > > > > > being
> > > > > > > > generated and stored as they always have. The list
> > > > > > > > provided
> > > > > > > > for
> > > > > > > > vx_mask in
> > > > > > > > my xml files generates plots for all those regions.
For
> > > > > > > > some
> > > > > > > > reason I
> > > > > > > > am
> > > > > > > > getting an empty plot for EAST, WEST, and CONUS for
> > > > > > > > OZMAX8,
> > > > > > > > OZMAX1,
> > > > > > > > PDMAX1,
> > > > > > > > and PMAVE. I haven't been able to get any clues other
> > > > > > > > than the
> > > > > > > > error
> > > > > > > > message I originally sent. I have to say that the
plot
> > > > > > > > number
> > > > > > > > reference
> > > > > > > > that you sent me yielded a CSI curve that I've never
seen
> > > > > > > > in
> > > > > > > > any of
> > > > > > > > the
> > > > > > > > plots I looked at. Not sure what's going on with that
> > > > > > > > plot.
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Mar 10, 2021 at 2:45 PM Tatiana Burek via RT
> > > > > > > > <met_help at ucar.edu>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Ed,
> > > > > > > > > I recreated the XML that you sent me on the web app
> > > > > > > > > page and
> > > > > > > > > produced
> > > > > > > > > the
> > > > > > > > > plot: #20210310_193603
> > > > > > > > > Please note that this XML contains all vx_mask not
just
> > > > > > > > > east,
> > > > > > > > > west,
> > > > > > > > > and
> > > > > > > > > CONUS.
> > > > > > > > > If I select only those masks - I still get the plot:
> > > > > > > > > # 20210310_194052
> > > > > > > > >
> > > > > > > > > Tatiana
> > > > > > > > >
> > > > > > > > > On Wed Mar 10 02:31:00 2021,
edward.strobach at noaa.gov
> > > > > > > > > wrote:
> > > > > > > > > > Here's a CSI example for ozmax8, one of the fields
> > > > > > > > > > not
> > > > > > > > > > being
> > > > > > > > > > plotted
> > > > > > > > > > for
> > > > > > > > > > east, west, and CONUS.
> > > > > > > > > >
> > > > > > > > > > On Tue, Mar 9, 2021 at 5:48 PM Edward Strobach -
NOAA
> > > > > > > > > > Affiliate
> > > > > > > > > > <
> > > > > > > > > > edward.strobach at noaa.gov> wrote:
> > > > > > > > > >
> > > > > > > > > > > I'm guessing you don't have access to WCOSS? If
> > > > > > > > > > > not, I
> > > > > > > > > > > can
> > > > > > > > > > > copy
> > > > > > > > > > > a
> > > > > > > > > > > file
> > > > > > > > > > > over for you.
> > > > > > > > > > >
> > > > > > > > > > > On Tue, Mar 9, 2021 at 4:46 PM Tatiana Burek via
RT
> > > > > > > > > > > <met_help at ucar.edu>
> > > > > > > > > > > wrote:
> > > > > > > > > > >
> > > > > > > > > > >> Ed,
> > > > > > > > > > >> Having the XML that you use would be really
> > > > > > > > > > >> helpful.
> > > > > > > > > > >> I briefly looked at the data using following
> > > > > > > > > > >> fields
> > > > > > > > > > >> August 2020
> > > > > > > > > > >> EAST
> > > > > > > > > > >> PARA6C
> > > > > > > > > > >> obs_thresh IN ('>50', '>60', '>65', '>70',
'>75',
> > > > > > > > > > >> '>85',
> > > > > > > > > > >> '>105',
> > > > > > > > > > >> '>125',
> > > > > > > > > > >> '>150')
> > > > > > > > > > >> OZMAX8
> > > > > > > > > > >>
> > > > > > > > > > >> Both tables with CNT and CTC types don't have
any
> > > > > > > > > > >> data
> > > > > > > > > > >> with
> > > > > > > > > > >> these
> > > > > > > > > > >> parameters.
> > > > > > > > > > >>
> > > > > > > > > > >> Tatiana
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >> On Tue Mar 09 12:35:05 2021,
> > > > > > > > > > >> edward.strobach at noaa.gov
> > > > > > > > > > >> wrote:
> > > > > > > > > > >> > I'm not really sure I follow. Wouldn't this
> > > > > > > > > > >> > occur for
> > > > > > > > > > >> > all
> > > > > > > > > > >> > regions
> > > > > > > > > > >> > then,
> > > > > > > > > > >> > not just East, West, and CONUS? The other
> > > > > > > > > > >> > regions
> > > > > > > > > > >> > report
> > > > > > > > > > >> > these
> > > > > > > > > > >> > thresholds
> > > > > > > > > > >> > with all models being compared. The
Pointstat
> > > > > > > > > > >> > configure
> > > > > > > > > > >> > file
> > > > > > > > > > >> > that
> > > > > > > > > > >> > I
> > > > > > > > > > >> > use
> > > > > > > > > > >> > for these stats also confirms the
thresholding
> > > > > > > > > > >> > exists
> > > > > > > > > > >> > in
> > > > > > > > > > >> > that
> > > > > > > > > > >> > file.
> > > > > > > > > > >> > Moreover, I use ctc when processing plots
such
> > > > > > > > > > >> > as CSI,
> > > > > > > > > > >> > FAR,
> > > > > > > > > > >> > etc,
> > > > > > > > > > >> > which
> > > > > > > > > > >> > is
> > > > > > > > > > >> > done on the thresholds I set in pointstat and
> > > > > > > > > > >> > the xml
> > > > > > > > > > >> > files.
> > > > > > > > > > >> >
> > > > > > > > > > >> > On Tue, Mar 9, 2021 at 2:24 PM Tatiana Burek
via
> > > > > > > > > > >> > RT
> > > > > > > > > > >> > <met_help at ucar.edu>
> > > > > > > > > > >> > wrote:
> > > > > > > > > > >> >
> > > > > > > > > > >> > > Ed,
> > > > > > > > > > >> > > It also would be helpful to see XML but I
was
> > > > > > > > > > >> > > able
> > > > > > > > > > >> > > to
> > > > > > > > > > >> > > use
> > > > > > > > > > >> > > some
> > > > > > > > > > >> > > info
> > > > > > > > > > >> > > from
> > > > > > > > > > >> > > the part of the query that you sent.
> > > > > > > > > > >> > > I assume that you are interested on some
agg
> > > > > > > > > > >> > > stat
> > > > > > > > > > >> > > calculations
> > > > > > > > > > >> > > and
> > > > > > > > > > >> > > use the
> > > > > > > > > > >> > > data from sl1l2 table. The data in this
table
> > > > > > > > > > >> > > has
> > > > > > > > > > >> > > only
> > > > > > > > > > >> > > one
> > > > > > > > > > >> > > obs_thresh
> > > > > > > > > > >> > > value
> > > > > > > > > > >> > > - NA. That is why when you include other
> > > > > > > > > > >> > > values like
> > > > > > > > > > >> > > ">50'
> > > > > > > > > > >> > > the
> > > > > > > > > > >> > > query
> > > > > > > > > > >> > > returns no data.
> > > > > > > > > > >> > >
> > > > > > > > > > >> > > Tatiana
> > > > > > > > > > >> > >
> > > > > > > > > > >> > > On Tue Mar 09 07:55:16 2021,
> > > > > > > > > > >> > > edward.strobach at noaa.gov
> > > > > > > > > > >> > > wrote:
> > > > > > > > > > >> > > > The database is mv_cmaq_metplus which
should
> > > > > > > > > > >> > > > be
> > > > > > > > > > >> > > > under
> > > > > > > > > > >> > > > the
> > > > > > > > > > >> > > > group
> > > > > > > > > > >> > > > name
> > > > > > > > > > >> > > > Ed_Strobach. I did realize that my
inputs
> > > > > > > > > > >> > > > were
> > > > > > > > > > >> > > > switched
> > > > > > > > > > >> > > > around
> > > > > > > > > > >> > > > such
> > > > > > > > > > >> > > > that
> > > > > > > > > > >> > > > my group name was being designated as add
> > > > > > > > > > >> > > > instead
> > > > > > > > > > >> > > > of
> > > > > > > > > > >> > > > Ed_Strobach.
> > > > > > > > > > >> > > > I
> > > > > > > > > > >> > > > have
> > > > > > > > > > >> > > > since switched around the inputs but I
don't
> > > > > > > > > > >> > > > think
> > > > > > > > > > >> > > > that
> > > > > > > > > > >> > > > should
> > > > > > > > > > >> > > > be
> > > > > > > > > > >> > > > the
> > > > > > > > > > >> > > > issue, at least I don't think so since
the
> > > > > > > > > > >> > > > other
> > > > > > > > > > >> > > > data
> > > > > > > > > > >> > > > was
> > > > > > > > > > >> > > > uploaded
> > > > > > > > > > >> > > > successfully. I was loading data this
way:
> > > > > > > > > > >> > > >
> > > > > > > > > > >> > > > python load_to_metviewer_AWS.py
> > > > > > > > > > >> > > > mv_cmaq_metplus
> > > > > > > > > > >> > > > add
> > > > > > > > > > >> > > > Ed_Strobach
> > > > > > > > > > >> > > >
> > > > > > > > > > >> > > > but should have instead been
> > > > > > > > > > >> > > >
> > > > > > > > > > >> > > > python load_to_metviewer_AWS.py
> > > > > > > > > > >> > > > mv_cmaq_metplus
> > > > > > > > > > >> > > > Ed_Strobach
> > > > > > > > > > >> > > > add
> > > > > > > > > > >> > > >
> > > > > > > > > > >> > > > Not recognizing Ed_Strobach as an option
> > > > > > > > > > >> > > > (i.e.
> > > > > > > > > > >> > > > should
> > > > > > > > > > >> > > > have
> > > > > > > > > > >> > > > been
> > > > > > > > > > >> > > > "add"
> > > > > > > > > > >> > > > or
> > > > > > > > > > >> > > > "new") it defaulted to add I think; but
> > > > > > > > > > >> > > > again, I'm
> > > > > > > > > > >> > > > not
> > > > > > > > > > >> > > > sure
> > > > > > > > > > >> > > > that
> > > > > > > > > > >> > > > this
> > > > > > > > > > >> > > > caused the issue..
> > > > > > > > > > >> > > >
> > > > > > > > > > >> > > > On Tue, Mar 9, 2021 at 9:43 AM Tatiana
Burek
> > > > > > > > > > >> > > > via
> > > > > > > > > > >> > > > RT
> > > > > > > > > > >> > > > <met_help at ucar.edu>
> > > > > > > > > > >> > > > wrote:
> > > > > > > > > > >> > > >
> > > > > > > > > > >> > > > > Ed,
> > > > > > > > > > >> > > > > What is the name of the database that
> > > > > > > > > > >> > > > > contains
> > > > > > > > > > >> > > > > your
> > > > > > > > > > >> > > > > data?
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > > > > Tatiana
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > > > > On Tue Mar 09 07:00:23 2021,
> > > > > > > > > > >> > > > > edward.strobach at noaa.gov
> > > > > > > > > > >> > > > > wrote:
> > > > > > > > > > >> > > > > > Good morning,
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > I recently put up a website
> > > > > > > > > > >> > > > > > <
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> >
https://www.emc.ncep.noaa.gov/mmb/aq/verification_diagnostics/cmaq_verf/skill_score/
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > with all the stats for different
> > > > > > > > > > >> > > > > > regions.
> > > > > > > > > > >> > > > > > Some
> > > > > > > > > > >> > > > > > noticed
> > > > > > > > > > >> > > > > > that
> > > > > > > > > > >> > > > > > there
> > > > > > > > > > >> > > > > > were no
> > > > > > > > > > >> > > > > > changes in the OZMAX8, OZMAX1, PMAVE,
> > > > > > > > > > >> > > > > > and
> > > > > > > > > > >> > > > > > PDMAX1
> > > > > > > > > > >> > > > > > fields in
> > > > > > > > > > >> > > > > > the
> > > > > > > > > > >> > > > > > website
> > > > > > > > > > >> > > > > > for
> > > > > > > > > > >> > > > > > skill score type plots and
performance
> > > > > > > > > > >> > > > > > diagrams.
> > > > > > > > > > >> > > > > > I
> > > > > > > > > > >> > > > > > was
> > > > > > > > > > >> > > > > > able to
> > > > > > > > > > >> > > > > > determine
> > > > > > > > > > >> > > > > > that there was no data being
processed
> > > > > > > > > > >> > > > > > for
> > > > > > > > > > >> > > > > > those
> > > > > > > > > > >> > > > > > regions
> > > > > > > > > > >> > > > > > which
> > > > > > > > > > >> > > > > > I
> > > > > > > > > > >> > > > > > suspect is
> > > > > > > > > > >> > > > > > the reason for this issue. Realizing
> > > > > > > > > > >> > > > > > this, I
> > > > > > > > > > >> > > > > > went
> > > > > > > > > > >> > > > > > back
> > > > > > > > > > >> > > > > > and
> > > > > > > > > > >> > > > > > found
> > > > > > > > > > >> > > > > > that
> > > > > > > > > > >> > > > > > the
> > > > > > > > > > >> > > > > > pointstat_config files did not
contain
> > > > > > > > > > >> > > > > > those
> > > > > > > > > > >> > > > > > regions.
> > > > > > > > > > >> > > > > > After
> > > > > > > > > > >> > > > > > adding
> > > > > > > > > > >> > > > > > those
> > > > > > > > > > >> > > > > > regions in I reprocessed everything
and
> > > > > > > > > > >> > > > > > now
> > > > > > > > > > >> > > > > > have
> > > > > > > > > > >> > > > > > stats
> > > > > > > > > > >> > > > > > for
> > > > > > > > > > >> > > > > > east,
> > > > > > > > > > >> > > > > > west,
> > > > > > > > > > >> > > > > > and
> > > > > > > > > > >> > > > > > CONUS regions. I thought everything
> > > > > > > > > > >> > > > > > would
> > > > > > > > > > >> > > > > > have
> > > > > > > > > > >> > > > > > plotted
> > > > > > > > > > >> > > > > > successfully
> > > > > > > > > > >> > > > > > for
> > > > > > > > > > >> > > > > > those regions but found that this
wasn't
> > > > > > > > > > >> > > > > > so..
> > > > > > > > > > >> > > > > > In
> > > > > > > > > > >> > > > > > fact,
> > > > > > > > > > >> > > > > > I
> > > > > > > > > > >> > > > > > still
> > > > > > > > > > >> > > > > > get
> > > > > > > > > > >> > > > > > the
> > > > > > > > > > >> > > > > > same
> > > > > > > > > > >> > > > > > error which is quite surprising to
me.
> > > > > > > > > > >> > > > > > These
> > > > > > > > > > >> > > > > > regions
> > > > > > > > > > >> > > > > > have
> > > > > > > > > > >> > > > > > been
> > > > > > > > > > >> > > > > > requested
> > > > > > > > > > >> > > > > > as essential for identifying the
broader
> > > > > > > > > > >> > > > > > performance
> > > > > > > > > > >> > > > > > and
> > > > > > > > > > >> > > > > > will
> > > > > > > > > > >> > > > > > aid
> > > > > > > > > > >> > > > > > in
> > > > > > > > > > >> > > > > > decision making. I will have to get
> > > > > > > > > > >> > > > > > these up
> > > > > > > > > > >> > > > > > soon...
> > > > > > > > > > >> > > > > > I
> > > > > > > > > > >> > > > > > was
> > > > > > > > > > >> > > > > > wondering
> > > > > > > > > > >> > > > > > if
> > > > > > > > > > >> > > > > > there was something that stood out to
> > > > > > > > > > >> > > > > > you.
> > > > > > > > > > >> > > > > > Here's
> > > > > > > > > > >> > > > > > the
> > > > > > > > > > >> > > > > > error
> > > > > > > > > > >> > > > > > that
> > > > > > > > > > >> > > > > > keeps
> > > > > > > > > > >> > > > > > coming up:
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > 020-08-30 08:00:00', '2020-08-30
> > > > > > > > > > >> > > > > > 09:00:00',
> > > > > > > > > > >> > > > > > '2020-
> > > > > > > > > > >> > > > > > 08-
> > > > > > > > > > >> > > > > > 30
> > > > > > > > > > >> > > > > > 10:00:00',
> > > > > > > > > > >> > > > > > '2020-08-30 11:00:00', '2020-08-30
> > > > > > > > > > >> > > > > > 12:00:00')
> > > > > > > > > > >> > > > > > AND BINARY if( (select
> > > > > > > > > > >> > > > > > fcst_lead_offset
> > > > > > > > > > >> > > > > > FROM
> > > > > > > > > > >> > > > > > model_fcst_lead_offset
> > > > > > > > > > >> > > > > > WHERE model = h.model) is NULL ,
> > > > > > > > > > >> > > > > > ld.fcst_lead
> > > > > > > > > > >> > > > > > ,
> > > > > > > > > > >> > > > > > ld.fcst_lead +
> > > > > > > > > > >> > > > > > (select
> > > > > > > > > > >> > > > > > fcst_lead_offset FROM
> > > > > > > > > > >> > > > > > model_fcst_lead_offset
> > > > > > > > > > >> > > > > > WHERE
> > > > > > > > > > >> > > > > > model =
> > > > > > > > > > >> > > > > > h.model)
> > > > > > > > > > >> > > > > > )
> > > > > > > > > > >> > > > > > IN
> > > > > > > > > > >> > > > > > ('0', '10000', '20000', '30000',
> > > > > > > > > > >> > > > > > '40000',
> > > > > > > > > > >> > > > > > '50000',
> > > > > > > > > > >> > > > > > '60000',
> > > > > > > > > > >> > > > > > '70000',
> > > > > > > > > > >> > > > > > '80000', '90000', '100000', '110000',
> > > > > > > > > > >> > > > > > '120000',
> > > > > > > > > > >> > > > > > '130000',
> > > > > > > > > > >> > > > > > '140000',
> > > > > > > > > > >> > > > > > '150000', '160000', '170000',
'180000',
> > > > > > > > > > >> > > > > > '190000',
> > > > > > > > > > >> > > > > > '200000',
> > > > > > > > > > >> > > > > > '210000',
> > > > > > > > > > >> > > > > > '220000', '230000', '240000',
'250000',
> > > > > > > > > > >> > > > > > '260000',
> > > > > > > > > > >> > > > > > '270000',
> > > > > > > > > > >> > > > > > '280000',
> > > > > > > > > > >> > > > > > '290000', '300000', '310000',
'320000',
> > > > > > > > > > >> > > > > > '330000',
> > > > > > > > > > >> > > > > > '340000',
> > > > > > > > > > >> > > > > > '350000',
> > > > > > > > > > >> > > > > > '360000', '370000', '380000',
'390000',
> > > > > > > > > > >> > > > > > '400000',
> > > > > > > > > > >> > > > > > '410000',
> > > > > > > > > > >> > > > > > '420000',
> > > > > > > > > > >> > > > > > '430000', '440000', '450000',
'460000',
> > > > > > > > > > >> > > > > > '470000',
> > > > > > > > > > >> > > > > > '480000')
> > > > > > > > > > >> > > > > > AND BINARY h.model IN ('PARA6C',
> > > > > > > > > > >> > > > > > 'PARA6C_BC',
> > > > > > > > > > >> > > > > > 'PROD',
> > > > > > > > > > >> > > > > > 'PROD_BC')
> > > > > > > > > > >> > > > > > AND BINARY h.obs_thresh IN
('>50',
> > > > > > > > > > >> > > > > > '>60',
> > > > > > > > > > >> > > > > > '>65',
> > > > > > > > > > >> > > > > > '>70',
> > > > > > > > > > >> > > > > > '>75',
> > > > > > > > > > >> > > > > > '>85',
> > > > > > > > > > >> > > > > > '>105', '>125', '>150')
> > > > > > > > > > >> > > > > > AND BINARY h.fcst_var = 'OZMAX8'
> > > > > > > > > > >> > > > > > AND ld.stat_header_id =
> > > > > > > > > > >> > > > > > h.stat_header_id;
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > No data was returned from database
> > > > > > > > > > >> > > > > > 2021-03-09
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> >
edu.ucar.metviewer.db.mysql.MysqlAppDatabaseManager.printFormattedTable(Unknown
> > > > > > > > > > >> > > > > > Source) -1 printFormattedTable - **
> > > > > > > > > > >> > > > > > ERROR:
> > > > > > > > > > >> > > > > > Caught
> > > > > > > > > > >> > > > > > class
> > > > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > > > >> > > > > > in
> > > > > > > > > > >> > > > > > printFormattedTable(ResultSet
> > > > > > > > > > >> > > > > > res): result set contained no data
> > > > > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > > > >> > > > > > in
> > > > > > > > > > >> > > > > > printFormattedTable(ResultSet res):
> > > > > > > > > > >> > > > > > result set
> > > > > > > > > > >> > > > > > contained
> > > > > > > > > > >> > > > > > no
> > > > > > > > > > >> > > > > > data
> > > > > > > > > > >> > > > > > ** ERROR: Caught class
> > > > > > > > > > >> > > > > >
edu.ucar.metviewer.EmptyResultSetException
> > > > > > > > > > >> > > > > > in
> > > > > > > > > > >> > > > > > printFormattedTable(ResultSet res):
> > > > > > > > > > >> > > > > > result set
> > > > > > > > > > >> > > > > > contained
> > > > > > > > > > >> > > > > > no
> > > > > > > > > > >> > > > > > data
> > > > > > > > > > >> > > > > > Database query time for
mv_cmaq_metplus
> > > > > > > > > > >> > > > > > 0:00:00.016
> > > > > > > > > > >> > > > > > Save to file time for
mv_cmaq_metplus
> > > > > > > > > > >> > > > > > 0:00:00.000
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > You can view the stat files of those
> > > > > > > > > > >> > > > > > fields
> > > > > > > > > > >> > > > > > here:
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> >
*/gpfs/dell2/emc/modeling/noscrub/Edward.Strobach/metplus_aq/CMAQ/stat/aqm/20200820*
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > The corresponding tags to those files
> > > > > > > > > > >> > > > > > are
> > > > > > > > > > >> > > > > > something
> > > > > > > > > > >> > > > > > like
> > > > > > > > > > >> > > > > > this:
> > > > > > > > > > >> > > > > > PARA6C_AQMAX1*
> > > > > > > > > > >> > > > > > PARA6C_AQMAX8*
> > > > > > > > > > >> > > > > > PARA6C_BC_PMMAX*
> > > > > > > > > > >> > > > > > PARA6C_BC_PMAVE*
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > I have similar plots for PARA6C,
> > > > > > > > > > >> > > > > > PARA6C_BC,
> > > > > > > > > > >> > > > > > PROD,
> > > > > > > > > > >> > > > > > and
> > > > > > > > > > >> > > > > > PROD_BC.
> > > > > > > > > > >> > > > > > I've
> > > > > > > > > > >> > > > > > checked these files and these regions
> > > > > > > > > > >> > > > > > (i.e.
> > > > > > > > > > >> > > > > > EAST,
> > > > > > > > > > >> > > > > > WEST,
> > > > > > > > > > >> > > > > > CONUS)
> > > > > > > > > > >> > > > > > appear
> > > > > > > > > > >> > > > > > tabulated for ctc stats.
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > Additionally, my files have been
updated
> > > > > > > > > > >> > > > > > to
> > > > > > > > > > >> > > > > > match
> > > > > > > > > > >> > > > > > the
> > > > > > > > > > >> > > > > > inclusion
> > > > > > > > > > >> > > > > > of
> > > > > > > > > > >> > > > > > these
> > > > > > > > > > >> > > > > > regions:
> > > > > > > > > > >> > > > > > poly = [
> > > > > > > > > > >> > > > > >
> > > "MET_BASE/poly/NEC.poly","MET_BASE/poly/SEC.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/NWC.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/SWC.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/NMT.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/SMT.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/GRB.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/SWD.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/NPL.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/SPL.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/MDW.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/LMV.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/GMC.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/APL.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/EAST.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/WEST.poly",
> > > > > > > > > > >> > > > > > "MET_BASE/poly/CONUS.poly"
> > > > > > > > > > >> > > > > > ];
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > The files that I'm using definitely
have
> > > > > > > > > > >> > > > > > these
> > > > > > > > > > >> > > > > > regions
> > > > > > > > > > >> > > > > > as
> > > > > > > > > > >> > > > > > well
> > > > > > > > > > >> > > > > > as
> > > > > > > > > > >> > > > > > seen
> > > > > > > > > > >> > > > > > here:
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > > >
> > > > > > >
> > > > >
> > >
/gpfs/dell2/emc/modeling/save/Edward.Strobach/MET/METplus/parm/met_config
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > PointStatConfig_AIRNOW_max and
> > > > > > > > > > >> > > > > > PointStatConfig_ANOWPM_max
> > > > > > > > > > >> > > > > >
> > > > > > > > > > >> > > > > > I'm somewhat at a loss of what to do
> > > > > > > > > > >> > > > > > since
> > > > > > > > > > >> > > > > > everything
> > > > > > > > > > >> > > > > > else
> > > > > > > > > > >> > > > > > seems
> > > > > > > > > > >> > > > > > fine.
> > > > > > > > > > >> > > > > > Has
> > > > > > > > > > >> > > > > > this been seen before?
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > > > >
> > > > > > > > > > >> > >
> > > > > > > > > > >> > >
> > > > > > > > > > >> > >
> > > > > > > > > > >> > >
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > > > >>
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > >
> > >
> > >
> > >
> >
> >
------------------------------------------------
More information about the Met_help
mailing list