[Met_help] [rt.rap.ucar.edu #93932] History for METviewer Rscript error with METplus vector wind stats

Thu Apr 2 12:51:12 MDT 2020

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi Tatiana,

I'm having some trouble with vector wind stats on series plots. When using
fcst_lead as the independent variable for UGRD_VGRD, I get the following
Rscript error:

The error doesn't occur if I use valid_hour as the independent variable.
Vector wind stats also seem to work on scorecards, so I don't think it's a
problem with the data (although I wouldn't rule it out). The example errors
are for 10-m wind, but it also affects winds on upper air pressure levels.

*==== Start Rscript error  ====*

*Error in file(file, "rt") : cannot open the connection*

*Calls: read.delim -> read.table -> file*

*In addition: Warning message:*

*In file(file, "rt") :*

*  cannot open file
'/data/mv_data/logan.dawson/data/fv3cam_conus_12z_sfc_UGRD_VGRD_Bias_RMSE.data':
No such file or directory*

*Execution halted*

*====   End Rscript error  ====*

Here are links to the FCST_LEAD XML
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10.xml>
and output
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10_12z_CONUS.out>
and the VALID_HOUR XML
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10.xml>
and output
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10_CONUS.out>.
These files are also attached if those are easier to handle.

Thanks,
Logan
-- 
*Logan C. Dawson, Ph.D.*
NOAA/NWS/NCEP/EMC
5830 University Research Court
College Park, MD 20740
(301) 683-3944

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: METviewer Rscript error with METplus vector wind stats
From: Tatiana Burek
Time: Mon Jan 27 13:33:59 2020

Hi Logan,
I recreates your job on UI using the XML and could not create a plot.
The main reason you get an error message is because the event
equalizer discarded all records.
By looking at your data  I found several duplicated records that could
be one of the reasons for the error.
I modified SQL to remove duplicates.
Another reason for the error is two values for obtype. EE can't
support this.
In UI I selected one or another values and was able to create a plot:
20200127_202058

Tatiana

On Mon Jan 27 10:50:42 2020, logan.dawson at noaa.gov wrote:
> Hi Tatiana,
>
> I'm having some trouble with vector wind stats on series plots. When
> using
> fcst_lead as the independent variable for UGRD_VGRD, I get the
> following
> Rscript error:
>
> The error doesn't occur if I use valid_hour as the independent
> variable.
> Vector wind stats also seem to work on scorecards, so I don't think
> it's a
> problem with the data (although I wouldn't rule it out). The example
> errors
> are for 10-m wind, but it also affects winds on upper air pressure
> levels.
>
> *==== Start Rscript error  ====*
>
> *Error in file(file, "rt") : cannot open the connection*
>
> *Calls: read.delim -> read.table -> file*
>
> *In addition: Warning message:*
>
> *In file(file, "rt") :*
>
> *  cannot open file
>
'/data/mv_data/logan.dawson/data/fv3cam_conus_12z_sfc_UGRD_VGRD_Bias_RMSE.data':
> No such file or directory*
>
> *Execution halted*
>
> *====   End Rscript error  ====*
>
> Here are links to the FCST_LEAD XML
>
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10.xml>
> and output
>
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10_12z_CONUS.out>
> and the VALID_HOUR XML
>
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10.xml>
> and output
>
<https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10_CONUS.out>.
> These files are also attached if those are easier to handle.
>
> Thanks,
> Logan

------------------------------------------------
Subject: METviewer Rscript error with METplus vector wind stats
From: Logan Dawson - NOAA Affiliate
Time: Thu Jan 30 09:58:10 2020

Hi Tatiana,

Sorry for the delay in getting back to you. I was having trouble
accessing
the AWS GUI over the past couple days, but that issue is resolved now.

Based on the example plot and XML you pointed me to, I was able to
determine that I can plot VL1L2_BIAS statistics, but I'm unable to
plot
VL1L2_RMSVE statistics in this same plot configuration. I can get
VCNT_RMSVE to plot though. Is that the more appropriate root mean
square
error statistic to use for vectors?

Thanks,
Logan

On Mon, Jan 27, 2020 at 8:34 PM Tatiana Burek via RT
<met_help at ucar.edu>
wrote:

> Hi Logan,
> I recreates your job on UI using the XML and could not create a
plot.
> The main reason you get an error message is because the event
equalizer
> discarded all records.
> By looking at your data  I found several duplicated records that
could be
> one of the reasons for the error.
> I modified SQL to remove duplicates.
> Another reason for the error is two values for obtype. EE can't
support
> this.
> In UI I selected one or another values and was able to create a
plot:
> 20200127_202058
>
> Tatiana
>
> On Mon Jan 27 10:50:42 2020, logan.dawson at noaa.gov wrote:
> > Hi Tatiana,
> >
> > I'm having some trouble with vector wind stats on series plots.
When
> > using
> > fcst_lead as the independent variable for UGRD_VGRD, I get the
> > following
> > Rscript error:
> >
> > The error doesn't occur if I use valid_hour as the independent
> > variable.
> > Vector wind stats also seem to work on scorecards, so I don't
think
> > it's a
> > problem with the data (although I wouldn't rule it out). The
example
> > errors
> > are for 10-m wind, but it also affects winds on upper air pressure
> > levels.
> >
> > *==== Start Rscript error  ====*
> >
> > *Error in file(file, "rt") : cannot open the connection*
> >
> > *Calls: read.delim -> read.table -> file*
> >
> > *In addition: Warning message:*
> >
> > *In file(file, "rt") :*
> >
> > *  cannot open file
> >
>
'/data/mv_data/logan.dawson/data/fv3cam_conus_12z_sfc_UGRD_VGRD_Bias_RMSE.data':
> > No such file or directory*
> >
> > *Execution halted*
> >
> > *====   End Rscript error  ====*
> >
> > Here are links to the FCST_LEAD XML
> > <
>
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10.xml
> >
> > and output
> > <
>
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10_12z_CONUS.out
> >
> > and the VALID_HOUR XML
> > <
>
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10.xml
> >
> > and output
> > <
>
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10_CONUS.out
> >.
> > These files are also attached if those are easier to handle.
> >
> > Thanks,
> > Logan
>
>
>
>

--
*Logan C. Dawson, Ph.D.*
NOAA/NWS/NCEP/EMC
5830 University Research Court
College Park, MD 20740
(301) 683-3944

------------------------------------------------
Subject: METviewer Rscript error with METplus vector wind stats
From: Tatiana Burek
Time: Thu Jan 30 15:11:47 2020

Logan,

You should be able to create a plot with both stats.
Check plot # 20200130_220823

Tatiana

On Thu Jan 30 09:58:10 2020, logan.dawson at noaa.gov wrote:
> Hi Tatiana,
>
> Sorry for the delay in getting back to you. I was having trouble
> accessing
> the AWS GUI over the past couple days, but that issue is resolved
now.
>
> Based on the example plot and XML you pointed me to, I was able to
> determine that I can plot VL1L2_BIAS statistics, but I'm unable to
> plot
> VL1L2_RMSVE statistics in this same plot configuration. I can get
> VCNT_RMSVE to plot though. Is that the more appropriate root mean
> square
> error statistic to use for vectors?
>
> Thanks,
> Logan
>
> On Mon, Jan 27, 2020 at 8:34 PM Tatiana Burek via RT
> <met_help at ucar.edu>
> wrote:
>
> > Hi Logan,
> > I recreates your job on UI using the XML and could not create a
plot.
> > The main reason you get an error message is because the event
> > equalizer
> > discarded all records.
> > By looking at your data  I found several duplicated records that
> > could be
> > one of the reasons for the error.
> > I modified SQL to remove duplicates.
> > Another reason for the error is two values for obtype. EE can't
> > support
> > this.
> > In UI I selected one or another values and was able to create a
plot:
> > 20200127_202058
> >
> > Tatiana
> >
> > On Mon Jan 27 10:50:42 2020, logan.dawson at noaa.gov wrote:
> > > Hi Tatiana,
> > >
> > > I'm having some trouble with vector wind stats on series plots.
> > > When
> > > using
> > > fcst_lead as the independent variable for UGRD_VGRD, I get the
> > > following
> > > Rscript error:
> > >
> > > The error doesn't occur if I use valid_hour as the independent
> > > variable.
> > > Vector wind stats also seem to work on scorecards, so I don't
think
> > > it's a
> > > problem with the data (although I wouldn't rule it out). The
> > > example
> > > errors
> > > are for 10-m wind, but it also affects winds on upper air
pressure
> > > levels.
> > >
> > > *==== Start Rscript error  ====*
> > >
> > > *Error in file(file, "rt") : cannot open the connection*
> > >
> > > *Calls: read.delim -> read.table -> file*
> > >
> > > *In addition: Warning message:*
> > >
> > > *In file(file, "rt") :*
> > >
> > > *  cannot open file
> > >
> >
'/data/mv_data/logan.dawson/data/fv3cam_conus_12z_sfc_UGRD_VGRD_Bias_RMSE.data':
> > > No such file or directory*
> > >
> > > *Execution halted*
> > >
> > > *====   End Rscript error  ====*
> > >
> > > Here are links to the FCST_LEAD XML
> > > <
> >
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10.xml
> > >
> > > and output
> > > <
> >
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_fcstlead_sfc_z10_12z_CONUS.out
> > >
> > > and the VALID_HOUR XML
> > > <
> >
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10.xml
> > >
> > > and output
> > > <
> >
https://www.emc.ncep.noaa.gov/users/Logan.Dawson/MEG/hold/series_validhour_sfc_z10_CONUS.out
> > > .
> > >  These files are also attached if those are easier to handle.
> > >
> > > Thanks,
> > > Logan
> >
> >
> >
> >

------------------------------------------------