[Met_help] [rt.rap.ucar.edu #99800] History for Plotting multiple models's track errors for extratropcial cyclones
Minna Win via RT
met_help at ucar.edu
Fri Jun 18 14:09:32 MDT 2021
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi Met,
I was trying to plot out several models' track errors on the same frame. I
was wondering if you could help me to edit a proper config file for this
purpose.
The sample case is on Hera:
/scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
Then I issue line command:
master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
usecase_3.conf
The output plots are on
/scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
The plots contain GFS only. What I need is to put all track errors on the
same frame with proper lines and legend. The tracks data is on:
/scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-4.0_sample_data/model_applications/medium_range/track_data/
GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
Your help is much appreciated.
Thanks,
Guang Ping Lou
EMC
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Julie Prestopnik
Time: Wed May 05 11:40:00 2021
I have assigned this ticket to George McCabe who should be able to
better
assist you. Please also a few business days for a response.
Julie
On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> Transaction: Ticket created by guang.ping.lou at noaa.gov
> Queue: met_help
> Subject: Plotting multiple models's track errors for
extratropcial
> cyclones
> Owner: Nobody
> Requestors: guang.ping.lou at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
>
> Hi Met,
>
> I was trying to plot out several models' track errors on the same
frame. I
> was wondering if you could help me to edit a proper config file for
this
> purpose.
> The sample case is on Hera:
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
>
> Then I issue line command:
> master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> usecase_3.conf
>
> The output plots are on
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
>
> The plots contain GFS only. What I need is to put all track errors
on the
> same frame with proper lines and legend. The tracks data is on:
>
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
>
> GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
>
> Your help is much appreciated.
> Thanks,
> Guang Ping Lou
> EMC
>
>
--
Julie Prestopnik (she/her)
Software Engineer
National Center for Atmospheric Research
Research Applications Laboratory
Email: jpresto at ucar.edu
My working day may not be your working day. Please do not feel
obliged to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Wed May 05 12:55:23 2021
Hi Guang Ping,
I reassigned this issue to Minna, another developer on the METplus
team.
She is more familiar with the plotter.
Thanks,
George
On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> Transaction: Ticket created by guang.ping.lou at noaa.gov
> Queue: met_help
> Subject: Plotting multiple models's track errors for
extratropcial
> cyclones
> Owner: Nobody
> Requestors: guang.ping.lou at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
>
> Hi Met,
>
> I was trying to plot out several models' track errors on the same
frame. I
> was wondering if you could help me to edit a proper config file for
this
> purpose.
> The sample case is on Hera:
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
>
> Then I issue line command:
> master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> usecase_3.conf
>
> The output plots are on
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
>
> The plots contain GFS only. What I need is to put all track errors
on the
> same frame with proper lines and legend. The tracks data is on:
>
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
>
> GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
>
> Your help is much appreciated.
> Thanks,
> Guang Ping Lou
> EMC
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Minna Win
Time: Thu May 06 08:23:14 2021
Hi Guang Ping,
I'm taking a look at the R script, and I see an option where you can
request optional filtering to be done by tc-stat (which is invoked
from the
plot_tcmpr.R script). I see that your config file has
TCMPR_PLOTTER_FILTER
set to nothing, which instructs the R script (and tc-stat) that
everything
should be considered (amodel, bmodel, stormid, basin,etc). I would
expect
that by the way your config file is set up, you should be seeing all
your
models getting plotted on one plot (ie all models on your mean plot,
all
models on your median plot, etc)
I don't have access to 'hera', but George downloaded
your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
mlq2020010100.gfso.0002.tcst
(which looks like only GFS) for me to reproduce some plots. I think
I'll
need another tcst file with another model, can you recommend which one
should be downloaded so I have input files with different models?
I'll
also check with John Halley Gotway to verify if my assessment is
correct.
Thanks for your patience while we troubleshoot this issue.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> Transaction: Ticket created by guang.ping.lou at noaa.gov
> Queue: met_help
> Subject: Plotting multiple models's track errors for
extratropcial
> cyclones
> Owner: Nobody
> Requestors: guang.ping.lou at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
>
> Hi Met,
>
> I was trying to plot out several models' track errors on the same
frame. I
> was wondering if you could help me to edit a proper config file for
this
> purpose.
> The sample case is on Hera:
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
>
> Then I issue line command:
> master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> usecase_3.conf
>
> The output plots are on
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
>
> The plots contain GFS only. What I need is to put all track errors
on the
> same frame with proper lines and legend. The tracks data is on:
>
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
>
> GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
>
> Your help is much appreciated.
> Thanks,
> Guang Ping Lou
> EMC
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Thu May 06 09:13:02 2021
Hi Minna,
Thanks for helping out.
I generated .tcst files for ECMWF and CMC models. Here they are on
Hera:
ls -l
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
Please let me know if you need more data.
Thanks,
Guang Ping
On Thu, May 6, 2021 at 10:23 AM Minna Win via RT <met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> I'm taking a look at the R script, and I see an option where you can
> request optional filtering to be done by tc-stat (which is invoked
from the
> plot_tcmpr.R script). I see that your config file has
TCMPR_PLOTTER_FILTER
> set to nothing, which instructs the R script (and tc-stat) that
everything
> should be considered (amodel, bmodel, stormid, basin,etc). I would
expect
> that by the way your config file is set up, you should be seeing all
your
> models getting plotted on one plot (ie all models on your mean
plot, all
> models on your median plot, etc)
>
> I don't have access to 'hera', but George downloaded
> your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
mlq2020010100.gfso.0002.tcst
> (which looks like only GFS) for me to reproduce some plots. I think
I'll
> need another tcst file with another model, can you recommend which
one
> should be downloaded so I have input files with different models?
I'll
> also check with John Halley Gotway to verify if my assessment is
correct.
> Thanks for your patience while we troubleshoot this issue.
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > Queue: met_help
> > Subject: Plotting multiple models's track errors for
extratropcial
> > cyclones
> > Owner: Nobody
> > Requestors: guang.ping.lou at noaa.gov
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> >
> > Hi Met,
> >
> > I was trying to plot out several models' track errors on the same
frame.
> I
> > was wondering if you could help me to edit a proper config file
for this
> > purpose.
> > The sample case is on Hera:
> > /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
> >
> > Then I issue line command:
> > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> > usecase_3.conf
> >
> > The output plots are on
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> >
> > The plots contain GFS only. What I need is to put all track errors
on the
> > same frame with proper lines and legend. The tracks data is on:
> >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> >
> > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> >
> > Your help is much appreciated.
> > Thanks,
> > Guang Ping Lou
> > EMC
> >
> >
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Thu May 06 09:28:32 2021
Hi Minna,
I have downloaded some additional tcst files that correspond to the
gfso
files I pulled earlier. They are in the same directory as the rest of
the
data. Please let me know if you need more data and I can pull more
files.
Thanks,
George
On Thu, May 6, 2021 at 9:13 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi Minna,
>
> Thanks for helping out.
> I generated .tcst files for ECMWF and CMC models. Here they are on
Hera:
> ls -l
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
>
> Please let me know if you need more data.
> Thanks,
> Guang Ping
>
> On Thu, May 6, 2021 at 10:23 AM Minna Win via RT <met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > I'm taking a look at the R script, and I see an option where you
can
> > request optional filtering to be done by tc-stat (which is invoked
from
> the
> > plot_tcmpr.R script). I see that your config file has
> TCMPR_PLOTTER_FILTER
> > set to nothing, which instructs the R script (and tc-stat) that
> everything
> > should be considered (amodel, bmodel, stormid, basin,etc). I
would
> expect
> > that by the way your config file is set up, you should be seeing
all your
> > models getting plotted on one plot (ie all models on your mean
plot, all
> > models on your median plot, etc)
> >
> > I don't have access to 'hera', but George downloaded
> > your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
> mlq2020010100.gfso.0002.tcst
> > (which looks like only GFS) for me to reproduce some plots. I
think I'll
> > need another tcst file with another model, can you recommend which
one
> > should be downloaded so I have input files with different models?
I'll
> > also check with John Halley Gotway to verify if my assessment is
correct.
> > Thanks for your patience while we troubleshoot this issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > > Queue: met_help
> > > Subject: Plotting multiple models's track errors for
extratropcial
> > > cyclones
> > > Owner: Nobody
> > > Requestors: guang.ping.lou at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> > >
> > >
> > > Hi Met,
> > >
> > > I was trying to plot out several models' track errors on the
same
> frame.
> > I
> > > was wondering if you could help me to edit a proper config file
for
> this
> > > purpose.
> > > The sample case is on Hera:
> > > /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
> > >
> > > Then I issue line command:
> > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> > > usecase_3.conf
> > >
> > > The output plots are on
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> > >
> > > The plots contain GFS only. What I need is to put all track
errors on
> the
> > > same frame with proper lines and legend. The tracks data is on:
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> > >
> > > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> > >
> > > Your help is much appreciated.
> > > Thanks,
> > > Guang Ping Lou
> > > EMC
> > >
> > >
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Minna Win
Time: Thu May 06 17:47:47 2021
Hi Guang Ping,
What I did was use your CMC, EMX, and GFSO .tcst files that were
created as
output from TC-Pairs. These three files reside in the same directory
and
then I invoked the master_metplus.py command similar to what you ran.
Ideally, the plot_tcmpr.R script will use all the files corresponding
to
the TCMPR_PLOTTER_TCMPR_DATA_DIR setting. For each line in the .tcst
file
(hence every model), it will plot something corresponding to that
information. When I attempt to use just the CMC, EMX, and GFSO .tcst
files, I get an error message. I'm wondering if you have something
similar in your run, which is preventing some of your model data from
getting included in the plot.
Can you please email me your log file from your run? I would like to
see
the command that the tcmpr_plotter_wrapper is creating to call
plot_tcmpr.R
and see if there are any anomalies.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Thu, May 6, 2021 at 9:13 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi Minna,
>
> Thanks for helping out.
> I generated .tcst files for ECMWF and CMC models. Here they are on
Hera:
> ls -l
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
>
> Please let me know if you need more data.
> Thanks,
> Guang Ping
>
> On Thu, May 6, 2021 at 10:23 AM Minna Win via RT <met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > I'm taking a look at the R script, and I see an option where you
can
> > request optional filtering to be done by tc-stat (which is invoked
from
> the
> > plot_tcmpr.R script). I see that your config file has
> TCMPR_PLOTTER_FILTER
> > set to nothing, which instructs the R script (and tc-stat) that
> everything
> > should be considered (amodel, bmodel, stormid, basin,etc). I
would
> expect
> > that by the way your config file is set up, you should be seeing
all your
> > models getting plotted on one plot (ie all models on your mean
plot, all
> > models on your median plot, etc)
> >
> > I don't have access to 'hera', but George downloaded
> > your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
> mlq2020010100.gfso.0002.tcst
> > (which looks like only GFS) for me to reproduce some plots. I
think I'll
> > need another tcst file with another model, can you recommend which
one
> > should be downloaded so I have input files with different models?
I'll
> > also check with John Halley Gotway to verify if my assessment is
correct.
> > Thanks for your patience while we troubleshoot this issue.
> >
> > Regards,
> > Minna
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > > Queue: met_help
> > > Subject: Plotting multiple models's track errors for
extratropcial
> > > cyclones
> > > Owner: Nobody
> > > Requestors: guang.ping.lou at noaa.gov
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> > >
> > >
> > > Hi Met,
> > >
> > > I was trying to plot out several models' track errors on the
same
> frame.
> > I
> > > was wondering if you could help me to edit a proper config file
for
> this
> > > purpose.
> > > The sample case is on Hera:
> > > /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
> > >
> > > Then I issue line command:
> > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> > > usecase_3.conf
> > >
> > > The output plots are on
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> > >
> > > The plots contain GFS only. What I need is to put all track
errors on
> the
> > > same frame with proper lines and legend. The tracks data is on:
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> > >
> > > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> > >
> > > Your help is much appreciated.
> > > Thanks,
> > > Guang Ping Lou
> > > EMC
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Fri May 07 06:48:43 2021
Hi Minna,
I followed your instructions putting GFS, EMX and CMC .tcst files into
one
directory and ran "master_metplus.py" with " TCMPRPlotter". The log
file is
attached.
Thanks a lot!
Guang Ping
On Thu, May 6, 2021 at 7:47 PM Minna Win via RT <met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> What I did was use your CMC, EMX, and GFSO .tcst files that were
created as
> output from TC-Pairs. These three files reside in the same
directory and
> then I invoked the master_metplus.py command similar to what you
ran.
> Ideally, the plot_tcmpr.R script will use all the files
corresponding to
> the TCMPR_PLOTTER_TCMPR_DATA_DIR setting. For each line in the
.tcst file
> (hence every model), it will plot something corresponding to that
> information. When I attempt to use just the CMC, EMX, and GFSO
.tcst
> files, I get an error message. I'm wondering if you have something
> similar in your run, which is preventing some of your model data
from
> getting included in the plot.
>
> Can you please email me your log file from your run? I would like
to see
> the command that the tcmpr_plotter_wrapper is creating to call
plot_tcmpr.R
> and see if there are any anomalies.
>
> Regards,
> Minna
>
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Thu, May 6, 2021 at 9:13 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi Minna,
> >
> > Thanks for helping out.
> > I generated .tcst files for ECMWF and CMC models. Here they are on
Hera:
> > ls -l
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
> >
> > Please let me know if you need more data.
> > Thanks,
> > Guang Ping
> >
> > On Thu, May 6, 2021 at 10:23 AM Minna Win via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Guang Ping,
> > >
> > > I'm taking a look at the R script, and I see an option where you
can
> > > request optional filtering to be done by tc-stat (which is
invoked from
> > the
> > > plot_tcmpr.R script). I see that your config file has
> > TCMPR_PLOTTER_FILTER
> > > set to nothing, which instructs the R script (and tc-stat) that
> > everything
> > > should be considered (amodel, bmodel, stormid, basin,etc). I
would
> > expect
> > > that by the way your config file is set up, you should be seeing
all
> your
> > > models getting plotted on one plot (ie all models on your mean
plot,
> all
> > > models on your median plot, etc)
> > >
> > > I don't have access to 'hera', but George downloaded
> > > your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
> > mlq2020010100.gfso.0002.tcst
> > > (which looks like only GFS) for me to reproduce some plots. I
think
> I'll
> > > need another tcst file with another model, can you recommend
which one
> > > should be downloaded so I have input files with different
models? I'll
> > > also check with John Halley Gotway to verify if my assessment is
> correct.
> > > Thanks for your patience while we troubleshoot this issue.
> > >
> > > Regards,
> > > Minna
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research
> > > Developmental Testbed Center
> > > Phone: 303-497-8423
> > > Fax: 303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > > > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > > > Queue: met_help
> > > > Subject: Plotting multiple models's track errors for
> extratropcial
> > > > cyclones
> > > > Owner: Nobody
> > > > Requestors: guang.ping.lou at noaa.gov
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > >
> > > >
> > > >
> > > > Hi Met,
> > > >
> > > > I was trying to plot out several models' track errors on the
same
> > frame.
> > > I
> > > > was wondering if you could help me to edit a proper config
file for
> > this
> > > > purpose.
> > > > The sample case is on Hera:
> > > > /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test2
> > > >
> > > > Then I issue line command:
> > > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf
-c
> > > > usecase_3.conf
> > > >
> > > > The output plots are on
> > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> > > >
> > > > The plots contain GFS only. What I need is to put all track
errors on
> > the
> > > > same frame with proper lines and legend. The tracks data is
on:
> > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> > > >
> > > > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> > > >
> > > > Your help is much appreciated.
> > > > Thanks,
> > > > Guang Ping Lou
> > > > EMC
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Minna Win
Time: Fri May 07 08:29:05 2021
Thank you for that information, we are both seeing the same error.
Now I
can proceed with further debugging.
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Fri, May 7, 2021 at 6:49 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi Minna,
>
> I followed your instructions putting GFS, EMX and CMC .tcst files
into one
> directory and ran "master_metplus.py" with " TCMPRPlotter". The log
file is
> attached.
>
> Thanks a lot!
> Guang Ping
>
>
> On Thu, May 6, 2021 at 7:47 PM Minna Win via RT <met_help at ucar.edu>
wrote:
>
> > Hi Guang Ping,
> >
> > What I did was use your CMC, EMX, and GFSO .tcst files that were
created
> as
> > output from TC-Pairs. These three files reside in the same
directory and
> > then I invoked the master_metplus.py command similar to what you
ran.
> > Ideally, the plot_tcmpr.R script will use all the files
corresponding to
> > the TCMPR_PLOTTER_TCMPR_DATA_DIR setting. For each line in the
.tcst
> file
> > (hence every model), it will plot something corresponding to that
> > information. When I attempt to use just the CMC, EMX, and GFSO
.tcst
> > files, I get an error message. I'm wondering if you have
something
> > similar in your run, which is preventing some of your model data
from
> > getting included in the plot.
> >
> > Can you please email me your log file from your run? I would like
to see
> > the command that the tcmpr_plotter_wrapper is creating to call
> plot_tcmpr.R
> > and see if there are any anomalies.
> >
> > Regards,
> > Minna
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, May 6, 2021 at 9:13 AM Guang Lou - NOAA Affiliate via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi Minna,
> > >
> > > Thanks for helping out.
> > > I generated .tcst files for ECMWF and CMC models. Here they are
on
> Hera:
> > > ls -l
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
> > >
> > > Please let me know if you need more data.
> > > Thanks,
> > > Guang Ping
> > >
> > > On Thu, May 6, 2021 at 10:23 AM Minna Win via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > I'm taking a look at the R script, and I see an option where
you can
> > > > request optional filtering to be done by tc-stat (which is
invoked
> from
> > > the
> > > > plot_tcmpr.R script). I see that your config file has
> > > TCMPR_PLOTTER_FILTER
> > > > set to nothing, which instructs the R script (and tc-stat)
that
> > > everything
> > > > should be considered (amodel, bmodel, stormid, basin,etc). I
would
> > > expect
> > > > that by the way your config file is set up, you should be
seeing all
> > your
> > > > models getting plotted on one plot (ie all models on your
mean plot,
> > all
> > > > models on your median plot, etc)
> > > >
> > > > I don't have access to 'hera', but George downloaded
> > > > your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
> > > mlq2020010100.gfso.0002.tcst
> > > > (which looks like only GFS) for me to reproduce some plots. I
think
> > I'll
> > > > need another tcst file with another model, can you recommend
which
> one
> > > > should be downloaded so I have input files with different
models?
> I'll
> > > > also check with John Halley Gotway to verify if my assessment
is
> > correct.
> > > > Thanks for your patience while we troubleshoot this issue.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research
> > > > Developmental Testbed Center
> > > > Phone: 303-497-8423
> > > > Fax: 303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via
RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > > > > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: Plotting multiple models's track errors for
> > extratropcial
> > > > > cyclones
> > > > > Owner: Nobody
> > > > > Requestors: guang.ping.lou at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > >
> > > > >
> > > > >
> > > > > Hi Met,
> > > > >
> > > > > I was trying to plot out several models' track errors on the
same
> > > frame.
> > > > I
> > > > > was wondering if you could help me to edit a proper config
file for
> > > this
> > > > > purpose.
> > > > > The sample case is on Hera:
> > > > > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2
> > > > >
> > > > > Then I issue line command:
> > > > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf
-c
> > > > > usecase_3.conf
> > > > >
> > > > > The output plots are on
> > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> > > > >
> > > > > The plots contain GFS only. What I need is to put all track
errors
> on
> > > the
> > > > > same frame with proper lines and legend. The tracks data is
on:
> > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> > > > >
> > > > > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> > > > >
> > > > > Your help is much appreciated.
> > > > > Thanks,
> > > > > Guang Ping Lou
> > > > > EMC
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Minna Win
Time: Thu May 13 14:18:59 2021
Hi Guang Ping,
Here's an update: It looks like the data you are using wasn't
generating
any plots because event equalization (by default) is turned on and
there
were no matching times found. You will need to update
your Plotter_fcstGFS_obsGFS_RPlotting_3.conf file:
TCMPR_PLOTTER_NO_EE = yes
and use a modified version of plot_tcmpr.R
George is assisting Yan with the same issue and is testing this
modified
version of plot_tcmpr.R out on 'jet'. The plots can't be generated
using
the wrapper- we're still trying to figure out why. The command that
the
wrapper creates is correct, as running it from the command line
generates
plots with multiple models:
[image: TK_ERR_mean.png]
I hope this is the type of plot you were hoping to generate (for
example,
this is the TK_ERR_mean plot).
Regards,
Minna
---------------
Minna Win
National Center for Atmospheric Research
Developmental Testbed Center
Phone: 303-497-8423
Fax: 303-497-8401
---------------
Pronouns: she/her
On Fri, May 7, 2021 at 6:49 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi Minna,
>
> I followed your instructions putting GFS, EMX and CMC .tcst files
into one
> directory and ran "master_metplus.py" with " TCMPRPlotter". The log
file is
> attached.
>
> Thanks a lot!
> Guang Ping
>
>
> On Thu, May 6, 2021 at 7:47 PM Minna Win via RT <met_help at ucar.edu>
wrote:
>
> > Hi Guang Ping,
> >
> > What I did was use your CMC, EMX, and GFSO .tcst files that were
created
> as
> > output from TC-Pairs. These three files reside in the same
directory and
> > then I invoked the master_metplus.py command similar to what you
ran.
> > Ideally, the plot_tcmpr.R script will use all the files
corresponding to
> > the TCMPR_PLOTTER_TCMPR_DATA_DIR setting. For each line in the
.tcst
> file
> > (hence every model), it will plot something corresponding to that
> > information. When I attempt to use just the CMC, EMX, and GFSO
.tcst
> > files, I get an error message. I'm wondering if you have
something
> > similar in your run, which is preventing some of your model data
from
> > getting included in the plot.
> >
> > Can you please email me your log file from your run? I would like
to see
> > the command that the tcmpr_plotter_wrapper is creating to call
> plot_tcmpr.R
> > and see if there are any anomalies.
> >
> > Regards,
> > Minna
> >
> > ---------------
> > Minna Win
> > National Center for Atmospheric Research
> > Developmental Testbed Center
> > Phone: 303-497-8423
> > Fax: 303-497-8401
> > ---------------
> > Pronouns: she/her
> >
> >
> > On Thu, May 6, 2021 at 9:13 AM Guang Lou - NOAA Affiliate via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi Minna,
> > >
> > > Thanks for helping out.
> > > I generated .tcst files for ECMWF and CMC models. Here they are
on
> Hera:
> > > ls -l
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
> > >
> > > Please let me know if you need more data.
> > > Thanks,
> > > Guang Ping
> > >
> > > On Thu, May 6, 2021 at 10:23 AM Minna Win via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > I'm taking a look at the R script, and I see an option where
you can
> > > > request optional filtering to be done by tc-stat (which is
invoked
> from
> > > the
> > > > plot_tcmpr.R script). I see that your config file has
> > > TCMPR_PLOTTER_FILTER
> > > > set to nothing, which instructs the R script (and tc-stat)
that
> > > everything
> > > > should be considered (amodel, bmodel, stormid, basin,etc). I
would
> > > expect
> > > > that by the way your config file is set up, you should be
seeing all
> > your
> > > > models getting plotted on one plot (ie all models on your
mean plot,
> > all
> > > > models on your median plot, etc)
> > > >
> > > > I don't have access to 'hera', but George downloaded
> > > > your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
> > > mlq2020010100.gfso.0002.tcst
> > > > (which looks like only GFS) for me to reproduce some plots. I
think
> > I'll
> > > > need another tcst file with another model, can you recommend
which
> one
> > > > should be downloaded so I have input files with different
models?
> I'll
> > > > also check with John Halley Gotway to verify if my assessment
is
> > correct.
> > > > Thanks for your patience while we troubleshoot this issue.
> > > >
> > > > Regards,
> > > > Minna
> > > > ---------------
> > > > Minna Win
> > > > National Center for Atmospheric Research
> > > > Developmental Testbed Center
> > > > Phone: 303-497-8423
> > > > Fax: 303-497-8401
> > > > ---------------
> > > > Pronouns: she/her
> > > >
> > > >
> > > > On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate via
RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > > > > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > > > > Queue: met_help
> > > > > Subject: Plotting multiple models's track errors for
> > extratropcial
> > > > > cyclones
> > > > > Owner: Nobody
> > > > > Requestors: guang.ping.lou at noaa.gov
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > >
> > > > >
> > > > >
> > > > > Hi Met,
> > > > >
> > > > > I was trying to plot out several models' track errors on the
same
> > > frame.
> > > > I
> > > > > was wondering if you could help me to edit a proper config
file for
> > > this
> > > > > purpose.
> > > > > The sample case is on Hera:
> > > > > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2
> > > > >
> > > > > Then I issue line command:
> > > > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_3.conf
-c
> > > > > usecase_3.conf
> > > > >
> > > > > The output plots are on
> > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> > > > >
> > > > > The plots contain GFS only. What I need is to put all track
errors
> on
> > > the
> > > > > same frame with proper lines and legend. The tracks data is
on:
> > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> > > > >
> > > > > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> > > > >
> > > > > Your help is much appreciated.
> > > > > Thanks,
> > > > > Guang Ping Lou
> > > > > EMC
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Fri May 14 08:04:26 2021
Hi Minna,
Thanks for the update. Yes, the plot you attached is what I wanted
indeed.
I'll wait for what you and George are working on and installed on
Hera.
Per John Gotway, DTC is transitioning to METcalc.py and METplot.py
from
R-script plot_tcmpr.R.
Hopefully METplot.py will be able to generate more cyclone plots.
Your help is much appreciated!
Guang Ping
On Thu, May 13, 2021 at 4:28 PM Minna Win via RT <met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> Here's an update: It looks like the data you are using wasn't
generating
> any plots because event equalization (by default) is turned on and
there
> were no matching times found. You will need to update
> your Plotter_fcstGFS_obsGFS_RPlotting_3.conf file:
>
> TCMPR_PLOTTER_NO_EE = yes
>
> and use a modified version of plot_tcmpr.R
>
> George is assisting Yan with the same issue and is testing this
modified
> version of plot_tcmpr.R out on 'jet'. The plots can't be generated
using
> the wrapper- we're still trying to figure out why. The command that
the
> wrapper creates is correct, as running it from the command line
generates
> plots with multiple models:
> [image: TK_ERR_mean.png]
>
> I hope this is the type of plot you were hoping to generate (for
example,
> this is the TK_ERR_mean plot).
>
> Regards,
> Minna
> ---------------
> Minna Win
> National Center for Atmospheric Research
> Developmental Testbed Center
> Phone: 303-497-8423
> Fax: 303-497-8401
> ---------------
> Pronouns: she/her
>
>
> On Fri, May 7, 2021 at 6:49 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi Minna,
> >
> > I followed your instructions putting GFS, EMX and CMC .tcst files
into
> one
> > directory and ran "master_metplus.py" with " TCMPRPlotter". The
log file
> is
> > attached.
> >
> > Thanks a lot!
> > Guang Ping
> >
> >
> > On Thu, May 6, 2021 at 7:47 PM Minna Win via RT
<met_help at ucar.edu>
> wrote:
> >
> > > Hi Guang Ping,
> > >
> > > What I did was use your CMC, EMX, and GFSO .tcst files that were
> created
> > as
> > > output from TC-Pairs. These three files reside in the same
directory
> and
> > > then I invoked the master_metplus.py command similar to what you
ran.
> > > Ideally, the plot_tcmpr.R script will use all the files
corresponding
> to
> > > the TCMPR_PLOTTER_TCMPR_DATA_DIR setting. For each line in the
.tcst
> > file
> > > (hence every model), it will plot something corresponding to
that
> > > information. When I attempt to use just the CMC, EMX, and GFSO
.tcst
> > > files, I get an error message. I'm wondering if you have
something
> > > similar in your run, which is preventing some of your model data
from
> > > getting included in the plot.
> > >
> > > Can you please email me your log file from your run? I would
like to
> see
> > > the command that the tcmpr_plotter_wrapper is creating to call
> > plot_tcmpr.R
> > > and see if there are any anomalies.
> > >
> > > Regards,
> > > Minna
> > >
> > > ---------------
> > > Minna Win
> > > National Center for Atmospheric Research
> > > Developmental Testbed Center
> > > Phone: 303-497-8423
> > > Fax: 303-497-8401
> > > ---------------
> > > Pronouns: she/her
> > >
> > >
> > > On Thu, May 6, 2021 at 9:13 AM Guang Lou - NOAA Affiliate via RT
<
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> > > >
> > > > Hi Minna,
> > > >
> > > > Thanks for helping out.
> > > > I generated .tcst files for ECMWF and CMC models. Here they
are on
> > Hera:
> > > > ls -l
> > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out*/tc_pairs/202001/*tcst
> > > >
> > > > Please let me know if you need more data.
> > > > Thanks,
> > > > Guang Ping
> > > >
> > > > On Thu, May 6, 2021 at 10:23 AM Minna Win via RT
<met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Guang Ping,
> > > > >
> > > > > I'm taking a look at the R script, and I see an option where
you
> can
> > > > > request optional filtering to be done by tc-stat (which is
invoked
> > from
> > > > the
> > > > > plot_tcmpr.R script). I see that your config file has
> > > > TCMPR_PLOTTER_FILTER
> > > > > set to nothing, which instructs the R script (and tc-stat)
that
> > > > everything
> > > > > should be considered (amodel, bmodel, stormid, basin,etc).
I would
> > > > expect
> > > > > that by the way your config file is set up, you should be
seeing
> all
> > > your
> > > > > models getting plotted on one plot (ie all models on your
mean
> plot,
> > > all
> > > > > models on your median plot, etc)
> > > > >
> > > > > I don't have access to 'hera', but George downloaded
> > > > > your Plotter_fcstGFS_obsGFS_RPlotting_3.conf,
> > > > mlq2020010100.gfso.0002.tcst
> > > > > (which looks like only GFS) for me to reproduce some plots.
I
> think
> > > I'll
> > > > > need another tcst file with another model, can you recommend
which
> > one
> > > > > should be downloaded so I have input files with different
models?
> > I'll
> > > > > also check with John Halley Gotway to verify if my
assessment is
> > > correct.
> > > > > Thanks for your patience while we troubleshoot this issue.
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > > ---------------
> > > > > Minna Win
> > > > > National Center for Atmospheric Research
> > > > > Developmental Testbed Center
> > > > > Phone: 303-497-8423
> > > > > Fax: 303-497-8401
> > > > > ---------------
> > > > > Pronouns: she/her
> > > > >
> > > > >
> > > > > On Wed, May 5, 2021 at 11:26 AM Guang Lou - NOAA Affiliate
via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > Wed May 05 11:26:20 2021: Request 99800 was acted upon.
> > > > > > Transaction: Ticket created by guang.ping.lou at noaa.gov
> > > > > > Queue: met_help
> > > > > > Subject: Plotting multiple models's track errors for
> > > extratropcial
> > > > > > cyclones
> > > > > > Owner: Nobody
> > > > > > Requestors: guang.ping.lou at noaa.gov
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > >
> > > > > >
> > > > > >
> > > > > > Hi Met,
> > > > > >
> > > > > > I was trying to plot out several models' track errors on
the same
> > > > frame.
> > > > > I
> > > > > > was wondering if you could help me to edit a proper config
file
> for
> > > > this
> > > > > > purpose.
> > > > > > The sample case is on Hera:
> > > > > > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2
> > > > > >
> > > > > > Then I issue line command:
> > > > > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_3.conf -c
> > > > > > usecase_3.conf
> > > > > >
> > > > > > The output plots are on
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out4/tcmpr_plots
> > > > > >
> > > > > > The plots contain GFS only. What I need is to put all
track
> errors
> > on
> > > > the
> > > > > > same frame with proper lines and legend. The tracks data
is on:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/METplus/METplus-
4.0_sample_data/model_applications/medium_range/track_data/
> > > > > >
> > > > > > GFS, NAM, EMX, UKX, CMC and NGX tracks are included.
> > > > > >
> > > > > > Your help is much appreciated.
> > > > > > Thanks,
> > > > > > Guang Ping Lou
> > > > > > EMC
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Minna Win
Time: Fri May 21 14:22:13 2021
Hello Guang Ping,
Julie has successfully installed the changes to the plot_tcmpr.R
script on 'hera', with the following instructions:
-------
The changes to the plot_tcmpr.R script are now installed on hera.
The user can run the following to access this new version of MET:
module use -a /contrib/anaconda/modulefiles
module load intel/18.0.5.274
module load anaconda/latest
module use /contrib/met/modulefiles
module load met/10.0.0_test
If they are using METplus, they will need to run:
module use /contrib/METplus/modulefiles
module load metplus/4.0.0
module use /contrib/met/modulefiles/
module load met/10.0.0_test
And they will need to set MET_INSTALL_DIR to /contrib/met/10.0.0_test
in their user config file.
If using the METplus wrapper to generate the plots with all the model
points, you will need to turn off event equalization in your
Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting the following:
TCMPR_PLOTTER_NO_EE = yes
This will disable the event equalization. Your sample data didn't
have any overlapping tracks so no plots were generated when event
equalization was enabled. You can leave MODEL unassigned so that all
models will be used (as long as all your tc-pairs .tcst files are in
the same directory). If you want a subset of models, you can set the
following:
MODEL = GFSO,CMC,EMX
TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
to explicitly include only the GFSO, CMC and EMX models (or whatever
models you wish) on your plots.
Regards,
Minna
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Wed May 26 11:51:32 2021
Hi Minna,
Thanks for the update. I followed your suggestion and there was an
error
that says:
------------------------------------------------------------------
File "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py", line
159,
in run_metplus
new_commands = process.run_all_times()
File
"/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
line 261, in run_all_times
except produtil.run.ExitStatusException as ese:
NameError: name 'produtil' is not defined
---------------------------------------------------------------------------
I looked up modules that related to the produtil, but could not find
any.
here is the Hera:
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
my line command is:
master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
usecase_7.conf
Thanks,
Guang Ping
On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <met_help at ucar.edu>
wrote:
> Hello Guang Ping,
>
> Julie has successfully installed the changes to the plot_tcmpr.R
script on
> 'hera', with the following instructions:
>
> -------
> The changes to the plot_tcmpr.R script are now installed on hera.
>
> The user can run the following to access this new version of MET:
> module use -a /contrib/anaconda/modulefiles
> module load intel/18.0.5.274
> module load anaconda/latest
> module use /contrib/met/modulefiles
> module load met/10.0.0_test
>
> If they are using METplus, they will need to run:
> module use /contrib/METplus/modulefiles
> module load metplus/4.0.0
> module use /contrib/met/modulefiles/
> module load met/10.0.0_test
> And they will need to set MET_INSTALL_DIR to
/contrib/met/10.0.0_test in
> their user config file.
>
>
>
> If using the METplus wrapper to generate the plots with all the
model
> points, you will need to turn off event equalization in your
> Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting the
following:
>
> TCMPR_PLOTTER_NO_EE = yes
>
> This will disable the event equalization. Your sample data didn't
have
> any overlapping tracks so no plots were generated when event
equalization
> was enabled. You can leave MODEL unassigned so that all models will
be
> used (as long as all your tc-pairs .tcst files are in the same
directory).
> If you want a subset of models, you can set the following:
>
> MODEL = GFSO,CMC,EMX
> TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
>
> to explicitly include only the GFSO, CMC and EMX models (or whatever
> models you wish) on your plots.
>
>
> Regards,
> Minna
>
>
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Wed May 26 12:13:14 2021
Hi Guang Ping,
This error is due to a bug in the logic to report an error in the
wrapper.
This error is most likely happening because the input files passed to
the
plotter are empty. You will need to change the configuration of
TCPairs to
get output lines. The error will go away if there is data available to
process.
- George
On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi Minna,
>
> Thanks for the update. I followed your suggestion and there was an
error
> that says:
> ------------------------------------------------------------------
> File "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
line 159,
> in run_metplus
> new_commands = process.run_all_times()
> File
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> line 261, in run_all_times
> except produtil.run.ExitStatusException as ese:
> NameError: name 'produtil' is not defined
>
---------------------------------------------------------------------------
>
> I looked up modules that related to the produtil, but could not find
any.
> here is the Hera:
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> my line command is:
> master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> usecase_7.conf
>
> Thanks,
> Guang Ping
>
>
> On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <met_help at ucar.edu>
> wrote:
>
> > Hello Guang Ping,
> >
> > Julie has successfully installed the changes to the plot_tcmpr.R
script
> on
> > 'hera', with the following instructions:
> >
> > -------
> > The changes to the plot_tcmpr.R script are now installed on hera.
> >
> > The user can run the following to access this new version of MET:
> > module use -a /contrib/anaconda/modulefiles
> > module load intel/18.0.5.274
> > module load anaconda/latest
> > module use /contrib/met/modulefiles
> > module load met/10.0.0_test
> >
> > If they are using METplus, they will need to run:
> > module use /contrib/METplus/modulefiles
> > module load metplus/4.0.0
> > module use /contrib/met/modulefiles/
> > module load met/10.0.0_test
> > And they will need to set MET_INSTALL_DIR to
/contrib/met/10.0.0_test in
> > their user config file.
> >
> >
> >
> > If using the METplus wrapper to generate the plots with all the
model
> > points, you will need to turn off event equalization in your
> > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting the
following:
> >
> > TCMPR_PLOTTER_NO_EE = yes
> >
> > This will disable the event equalization. Your sample data didn't
have
> > any overlapping tracks so no plots were generated when event
equalization
> > was enabled. You can leave MODEL unassigned so that all models
will be
> > used (as long as all your tc-pairs .tcst files are in the same
> directory).
> > If you want a subset of models, you can set the following:
> >
> > MODEL = GFSO,CMC,EMX
> > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> >
> > to explicitly include only the GFSO, CMC and EMX models (or
whatever
> > models you wish) on your plots.
> >
> >
> > Regards,
> > Minna
> >
> >
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Wed May 26 13:19:03 2021
Hi George,
Thanks for the info. But the plotting is supposed to follow the
conversion
from regular pairs to .tcst pairs, which are generated by the command
line.
All the .tcst pairs are in
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
after the command line:
master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
usecase_7.conf
If that is not the case , where should the path be specified?
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
Thanks,
Guang Ping
On Wed, May 26, 2021 at 2:13 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> This error is due to a bug in the logic to report an error in the
wrapper.
> This error is most likely happening because the input files passed
to the
> plotter are empty. You will need to change the configuration of
TCPairs to
> get output lines. The error will go away if there is data available
to
> process.
>
> - George
>
> On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi Minna,
> >
> > Thanks for the update. I followed your suggestion and there was an
error
> > that says:
> > ------------------------------------------------------------------
> > File "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
line
> 159,
> > in run_metplus
> > new_commands = process.run_all_times()
> > File
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > line 261, in run_all_times
> > except produtil.run.ExitStatusException as ese:
> > NameError: name 'produtil' is not defined
> >
>
---------------------------------------------------------------------------
> >
> > I looked up modules that related to the produtil, but could not
find any.
> > here is the Hera:
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > my line command is:
> > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > usecase_7.conf
> >
> > Thanks,
> > Guang Ping
> >
> >
> > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hello Guang Ping,
> > >
> > > Julie has successfully installed the changes to the plot_tcmpr.R
script
> > on
> > > 'hera', with the following instructions:
> > >
> > > -------
> > > The changes to the plot_tcmpr.R script are now installed on
hera.
> > >
> > > The user can run the following to access this new version of
MET:
> > > module use -a /contrib/anaconda/modulefiles
> > > module load intel/18.0.5.274
> > > module load anaconda/latest
> > > module use /contrib/met/modulefiles
> > > module load met/10.0.0_test
> > >
> > > If they are using METplus, they will need to run:
> > > module use /contrib/METplus/modulefiles
> > > module load metplus/4.0.0
> > > module use /contrib/met/modulefiles/
> > > module load met/10.0.0_test
> > > And they will need to set MET_INSTALL_DIR to
/contrib/met/10.0.0_test
> in
> > > their user config file.
> > >
> > >
> > >
> > > If using the METplus wrapper to generate the plots with all the
model
> > > points, you will need to turn off event equalization in your
> > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting the
following:
> > >
> > > TCMPR_PLOTTER_NO_EE = yes
> > >
> > > This will disable the event equalization. Your sample data
didn't have
> > > any overlapping tracks so no plots were generated when event
> equalization
> > > was enabled. You can leave MODEL unassigned so that all models
will be
> > > used (as long as all your tc-pairs .tcst files are in the same
> > directory).
> > > If you want a subset of models, you can set the following:
> > >
> > > MODEL = GFSO,CMC,EMX
> > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > >
> > > to explicitly include only the GFSO, CMC and EMX models (or
whatever
> > > models you wish) on your plots.
> > >
> > >
> > > Regards,
> > > Minna
> > >
> > >
> > >
> > >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Wed May 26 13:54:08 2021
Hi Guang Ping,
Sorry, I mistakenly thought the error in the plotter was due to
missing
data. It looks like it is failing because it is not reading the
-filter
options properly. Please try putting quotation marks around the value
for
TCMPR_PLOTTER_FILTER to see if that helps.
TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
Let me know if that does not work. If not, the wrapper will have to be
updated to add quotation marks around it. It should really do this
automatically, so I can make that change when I update the wrapper. I
will
also modify it to output the log output and make it easier to copy the
Rscript command to rerun it on the command line for testing purposes.
I was
able to get output by running the following command (using only 1
input
file):
Rscript /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
-config
/contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
-title "Extratropical Cyclone Track Error" -subtitle "Forecast Hours"
-ylab
"Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
MEAN,MEDIAN,BOXPLOT -no_ee -lookin
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
-outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
Thanks,
George
On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi George,
>
> Thanks for the info. But the plotting is supposed to follow the
conversion
> from regular pairs to .tcst pairs, which are generated by the
command line.
> All the .tcst pairs are in
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> after the command line:
> master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> usecase_7.conf
>
> If that is not the case , where should the path be specified?
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
>
> Thanks,
> Guang Ping
>
> On Wed, May 26, 2021 at 2:13 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > This error is due to a bug in the logic to report an error in the
> wrapper.
> > This error is most likely happening because the input files passed
to the
> > plotter are empty. You will need to change the configuration of
TCPairs
> to
> > get output lines. The error will go away if there is data
available to
> > process.
> >
> > - George
> >
> > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi Minna,
> > >
> > > Thanks for the update. I followed your suggestion and there was
an
> error
> > > that says:
> > >
------------------------------------------------------------------
> > > File "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py", line
> > 159,
> > > in run_metplus
> > > new_commands = process.run_all_times()
> > > File
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > line 261, in run_all_times
> > > except produtil.run.ExitStatusException as ese:
> > > NameError: name 'produtil' is not defined
> > >
> >
>
---------------------------------------------------------------------------
> > >
> > > I looked up modules that related to the produtil, but could not
find
> any.
> > > here is the Hera:
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > my line command is:
> > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > usecase_7.conf
> > >
> > > Thanks,
> > > Guang Ping
> > >
> > >
> > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT
<met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hello Guang Ping,
> > > >
> > > > Julie has successfully installed the changes to the
plot_tcmpr.R
> script
> > > on
> > > > 'hera', with the following instructions:
> > > >
> > > > -------
> > > > The changes to the plot_tcmpr.R script are now installed on
hera.
> > > >
> > > > The user can run the following to access this new version of
MET:
> > > > module use -a /contrib/anaconda/modulefiles
> > > > module load intel/18.0.5.274
> > > > module load anaconda/latest
> > > > module use /contrib/met/modulefiles
> > > > module load met/10.0.0_test
> > > >
> > > > If they are using METplus, they will need to run:
> > > > module use /contrib/METplus/modulefiles
> > > > module load metplus/4.0.0
> > > > module use /contrib/met/modulefiles/
> > > > module load met/10.0.0_test
> > > > And they will need to set MET_INSTALL_DIR to
> /contrib/met/10.0.0_test
> > in
> > > > their user config file.
> > > >
> > > >
> > > >
> > > > If using the METplus wrapper to generate the plots with all
the model
> > > > points, you will need to turn off event equalization in your
> > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting the
> following:
> > > >
> > > > TCMPR_PLOTTER_NO_EE = yes
> > > >
> > > > This will disable the event equalization. Your sample data
didn't
> have
> > > > any overlapping tracks so no plots were generated when event
> > equalization
> > > > was enabled. You can leave MODEL unassigned so that all
models will
> be
> > > > used (as long as all your tc-pairs .tcst files are in the same
> > > directory).
> > > > If you want a subset of models, you can set the following:
> > > >
> > > > MODEL = GFSO,CMC,EMX
> > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > > >
> > > > to explicitly include only the GFSO, CMC and EMX models (or
whatever
> > > > models you wish) on your plots.
> > > >
> > > >
> > > > Regards,
> > > > Minna
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Wed May 26 14:19:30 2021
Hi George,
Thanks for your quick response.
I modified the config file
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
and still got the same error messages:
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
In your plot, you plotted only 1 model. What I wanted is all 3 models'
stats be plotted on the same frame.
Thanks again,
Guang Ping
On Wed, May 26, 2021 at 3:54 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> Sorry, I mistakenly thought the error in the plotter was due to
missing
> data. It looks like it is failing because it is not reading the
-filter
> options properly. Please try putting quotation marks around the
value for
> TCMPR_PLOTTER_FILTER to see if that helps.
>
> TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
>
> Let me know if that does not work. If not, the wrapper will have to
be
> updated to add quotation marks around it. It should really do this
> automatically, so I can make that change when I update the wrapper.
I will
> also modify it to output the log output and make it easier to copy
the
> Rscript command to rerun it on the command line for testing
purposes. I was
> able to get output by running the following command (using only 1
input
> file):
>
> Rscript /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
-config
>
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> -title "Extratropical Cyclone Track Error" -subtitle "Forecast
Hours" -ylab
> "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
> MEAN,MEDIAN,BOXPLOT -no_ee -lookin
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
>
> Thanks,
> George
>
> On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi George,
> >
> > Thanks for the info. But the plotting is supposed to follow the
> conversion
> > from regular pairs to .tcst pairs, which are generated by the
command
> line.
> > All the .tcst pairs are in
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > after the command line:
> > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > usecase_7.conf
> >
> > If that is not the case , where should the path be specified?
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> >
> > Thanks,
> > Guang Ping
> >
> > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Guang Ping,
> > >
> > > This error is due to a bug in the logic to report an error in
the
> > wrapper.
> > > This error is most likely happening because the input files
passed to
> the
> > > plotter are empty. You will need to change the configuration of
TCPairs
> > to
> > > get output lines. The error will go away if there is data
available to
> > > process.
> > >
> > > - George
> > >
> > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> > > >
> > > > Hi Minna,
> > > >
> > > > Thanks for the update. I followed your suggestion and there
was an
> > error
> > > > that says:
> > > >
------------------------------------------------------------------
> > > > File "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
> line
> > > 159,
> > > > in run_metplus
> > > > new_commands = process.run_all_times()
> > > > File
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > line 261, in run_all_times
> > > > except produtil.run.ExitStatusException as ese:
> > > > NameError: name 'produtil' is not defined
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > >
> > > > I looked up modules that related to the produtil, but could
not find
> > any.
> > > > here is the Hera:
> > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > my line command is:
> > > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf
-c
> > > > usecase_7.conf
> > > >
> > > > Thanks,
> > > > Guang Ping
> > > >
> > > >
> > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT
<met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hello Guang Ping,
> > > > >
> > > > > Julie has successfully installed the changes to the
plot_tcmpr.R
> > script
> > > > on
> > > > > 'hera', with the following instructions:
> > > > >
> > > > > -------
> > > > > The changes to the plot_tcmpr.R script are now installed on
hera.
> > > > >
> > > > > The user can run the following to access this new version of
MET:
> > > > > module use -a /contrib/anaconda/modulefiles
> > > > > module load intel/18.0.5.274
> > > > > module load anaconda/latest
> > > > > module use /contrib/met/modulefiles
> > > > > module load met/10.0.0_test
> > > > >
> > > > > If they are using METplus, they will need to run:
> > > > > module use /contrib/METplus/modulefiles
> > > > > module load metplus/4.0.0
> > > > > module use /contrib/met/modulefiles/
> > > > > module load met/10.0.0_test
> > > > > And they will need to set MET_INSTALL_DIR to
> > /contrib/met/10.0.0_test
> > > in
> > > > > their user config file.
> > > > >
> > > > >
> > > > >
> > > > > If using the METplus wrapper to generate the plots with all
the
> model
> > > > > points, you will need to turn off event equalization in your
> > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting the
> > following:
> > > > >
> > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > >
> > > > > This will disable the event equalization. Your sample data
didn't
> > have
> > > > > any overlapping tracks so no plots were generated when event
> > > equalization
> > > > > was enabled. You can leave MODEL unassigned so that all
models
> will
> > be
> > > > > used (as long as all your tc-pairs .tcst files are in the
same
> > > > directory).
> > > > > If you want a subset of models, you can set the following:
> > > > >
> > > > > MODEL = GFSO,CMC,EMX
> > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > > > >
> > > > > to explicitly include only the GFSO, CMC and EMX models (or
> whatever
> > > > > models you wish) on your plots.
> > > > >
> > > > >
> > > > > Regards,
> > > > > Minna
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Wed May 26 14:59:53 2021
Hi Guang Ping,
I will make some modifications to the wrapper to make it easier to
debug
the error, as it is difficult to see what is happening. I can put the
changes on Hera so you can use that version to test. I will let you
know
when that is ready.
Thanks,
George
On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi George,
>
> Thanks for your quick response.
> I modified the config file
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> and still got the same error messages:
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
>
> In your plot, you plotted only 1 model. What I wanted is all 3
models'
> stats be plotted on the same frame.
>
> Thanks again,
> Guang Ping
>
>
>
> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > Sorry, I mistakenly thought the error in the plotter was due to
missing
> > data. It looks like it is failing because it is not reading the
-filter
> > options properly. Please try putting quotation marks around the
value for
> > TCMPR_PLOTTER_FILTER to see if that helps.
> >
> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> >
> > Let me know if that does not work. If not, the wrapper will have
to be
> > updated to add quotation marks around it. It should really do this
> > automatically, so I can make that change when I update the
wrapper. I
> will
> > also modify it to output the log output and make it easier to copy
the
> > Rscript command to rerun it on the command line for testing
purposes. I
> was
> > able to get output by running the following command (using only 1
input
> > file):
> >
> > Rscript /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
-config
> >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > -title "Extratropical Cyclone Track Error" -subtitle "Forecast
Hours"
> -ylab
> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> >
> > Thanks,
> > George
> >
> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi George,
> > >
> > > Thanks for the info. But the plotting is supposed to follow the
> > conversion
> > > from regular pairs to .tcst pairs, which are generated by the
command
> > line.
> > > All the .tcst pairs are in
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > after the command line:
> > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > usecase_7.conf
> > >
> > > If that is not the case , where should the path be specified?
> > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > >
> > > Thanks,
> > > Guang Ping
> > >
> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > This error is due to a bug in the logic to report an error in
the
> > > wrapper.
> > > > This error is most likely happening because the input files
passed to
> > the
> > > > plotter are empty. You will need to change the configuration
of
> TCPairs
> > > to
> > > > get output lines. The error will go away if there is data
available
> to
> > > > process.
> > > >
> > > > - George
> > > >
> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate
via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > >
> > > > > Hi Minna,
> > > > >
> > > > > Thanks for the update. I followed your suggestion and there
was an
> > > error
> > > > > that says:
> > > > >
------------------------------------------------------------------
> > > > > File "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
> > line
> > > > 159,
> > > > > in run_metplus
> > > > > new_commands = process.run_all_times()
> > > > > File
> > > > >
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > > line 261, in run_all_times
> > > > > except produtil.run.ExitStatusException as ese:
> > > > > NameError: name 'produtil' is not defined
> > > > >
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > > >
> > > > > I looked up modules that related to the produtil, but could
not
> find
> > > any.
> > > > > here is the Hera:
> > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > > my line command is:
> > > > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > > > usecase_7.conf
> > > > >
> > > > > Thanks,
> > > > > Guang Ping
> > > > >
> > > > >
> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
> met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Hello Guang Ping,
> > > > > >
> > > > > > Julie has successfully installed the changes to the
plot_tcmpr.R
> > > script
> > > > > on
> > > > > > 'hera', with the following instructions:
> > > > > >
> > > > > > -------
> > > > > > The changes to the plot_tcmpr.R script are now installed
on hera.
> > > > > >
> > > > > > The user can run the following to access this new version
of MET:
> > > > > > module use -a /contrib/anaconda/modulefiles
> > > > > > module load intel/18.0.5.274
> > > > > > module load anaconda/latest
> > > > > > module use /contrib/met/modulefiles
> > > > > > module load met/10.0.0_test
> > > > > >
> > > > > > If they are using METplus, they will need to run:
> > > > > > module use /contrib/METplus/modulefiles
> > > > > > module load metplus/4.0.0
> > > > > > module use /contrib/met/modulefiles/
> > > > > > module load met/10.0.0_test
> > > > > > And they will need to set MET_INSTALL_DIR to
> > > /contrib/met/10.0.0_test
> > > > in
> > > > > > their user config file.
> > > > > >
> > > > > >
> > > > > >
> > > > > > If using the METplus wrapper to generate the plots with
all the
> > model
> > > > > > points, you will need to turn off event equalization in
your
> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting
the
> > > following:
> > > > > >
> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > > >
> > > > > > This will disable the event equalization. Your sample
data
> didn't
> > > have
> > > > > > any overlapping tracks so no plots were generated when
event
> > > > equalization
> > > > > > was enabled. You can leave MODEL unassigned so that all
models
> > will
> > > be
> > > > > > used (as long as all your tc-pairs .tcst files are in the
same
> > > > > directory).
> > > > > > If you want a subset of models, you can set the following:
> > > > > >
> > > > > > MODEL = GFSO,CMC,EMX
> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > > > > >
> > > > > > to explicitly include only the GFSO, CMC and EMX models
(or
> > whatever
> > > > > > models you wish) on your plots.
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Minna
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Thu May 27 08:45:56 2021
Hi Guang Ping,
I put a version of METplus for you to test using TCMPRPlotter. To use
this
version, run the module commands to set up METplus, then instead of
calling
run_metplus.py from the path, call the version in my scratch
directory,
passing in your config files normally.
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
I ran using your config file from your previous email and was able to
view
the log output from the R script in the METplus log file. The first
attempt
failed due to the bug that requires -bmodel to be set, so I changed
the
default configuration to use the testing version of MET that Minna and
Julie made available on Hera (/contrib/met/10.0.0_test). Calling this
version of run_metplus.py will automatically use the test version of
MET
unless you are overriding MET_INSTALL_DIR in your config files.
I generated images here:
/home/George.Mccabe/scratch1_George.Mccabe/tcmpr-test/tcmpr_plots
Please take a look and verify that the output looks correct. Let me
know if
you have any other questions or issues.
Thanks,
George
On Wed, May 26, 2021 at 2:59 PM George McCabe <mccabe at ucar.edu> wrote:
> Hi Guang Ping,
>
> I will make some modifications to the wrapper to make it easier to
debug
> the error, as it is difficult to see what is happening. I can put
the
> changes on Hera so you can use that version to test. I will let you
know
> when that is ready.
>
> Thanks,
> George
>
> On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>>
>> Hi George,
>>
>> Thanks for your quick response.
>> I modified the config file
>>
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
>> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
>> and still got the same error messages:
>>
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
>>
>> In your plot, you plotted only 1 model. What I wanted is all 3
models'
>> stats be plotted on the same frame.
>>
>> Thanks again,
>> Guang Ping
>>
>>
>>
>> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>
>> > Hi Guang Ping,
>> >
>> > Sorry, I mistakenly thought the error in the plotter was due to
missing
>> > data. It looks like it is failing because it is not reading the
-filter
>> > options properly. Please try putting quotation marks around the
value
>> for
>> > TCMPR_PLOTTER_FILTER to see if that helps.
>> >
>> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
>> >
>> > Let me know if that does not work. If not, the wrapper will have
to be
>> > updated to add quotation marks around it. It should really do
this
>> > automatically, so I can make that change when I update the
wrapper. I
>> will
>> > also modify it to output the log output and make it easier to
copy the
>> > Rscript command to rerun it on the command line for testing
purposes. I
>> was
>> > able to get output by running the following command (using only 1
input
>> > file):
>> >
>> > Rscript /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
-config
>> >
>> >
>> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
>> > -title "Extratropical Cyclone Track Error" -subtitle "Forecast
Hours"
>> -ylab
>> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
>> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
>> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
>> >
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
>> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
>> >
>> > Thanks,
>> > George
>> >
>> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate via RT
<
>> > met_help at ucar.edu> wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>> > >
>> > > Hi George,
>> > >
>> > > Thanks for the info. But the plotting is supposed to follow the
>> > conversion
>> > > from regular pairs to .tcst pairs, which are generated by the
command
>> > line.
>> > > All the .tcst pairs are in
>> > >
>> > >
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
>> > > after the command line:
>> > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
>> > > usecase_7.conf
>> > >
>> > > If that is not the case , where should the path be specified?
>> > >
>> > >
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
>> > >
>> > > Thanks,
>> > > Guang Ping
>> > >
>> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
>> met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > > Hi Guang Ping,
>> > > >
>> > > > This error is due to a bug in the logic to report an error in
the
>> > > wrapper.
>> > > > This error is most likely happening because the input files
passed
>> to
>> > the
>> > > > plotter are empty. You will need to change the configuration
of
>> TCPairs
>> > > to
>> > > > get output lines. The error will go away if there is data
available
>> to
>> > > > process.
>> > > >
>> > > > - George
>> > > >
>> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate
via RT <
>> > > > met_help at ucar.edu> wrote:
>> > > >
>> > > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>> > > > >
>> > > > > Hi Minna,
>> > > > >
>> > > > > Thanks for the update. I followed your suggestion and there
was an
>> > > error
>> > > > > that says:
>> > > > >
------------------------------------------------------------------
>> > > > > File "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
>> > line
>> > > > 159,
>> > > > > in run_metplus
>> > > > > new_commands = process.run_all_times()
>> > > > > File
>> > > > >
>> > > >
>> > >
>> >
>> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
>> > > > > line 261, in run_all_times
>> > > > > except produtil.run.ExitStatusException as ese:
>> > > > > NameError: name 'produtil' is not defined
>> > > > >
>> > > >
>> > >
>> >
>>
---------------------------------------------------------------------------
>> > > > >
>> > > > > I looked up modules that related to the produtil, but could
not
>> find
>> > > any.
>> > > > > here is the Hera:
>> > > > >
>> > > > >
>> > > >
>> > >
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
>> > > > > my line command is:
>> > > > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
>> > > > > usecase_7.conf
>> > > > >
>> > > > > Thanks,
>> > > > > Guang Ping
>> > > > >
>> > > > >
>> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
>> met_help at ucar.edu>
>> > > > > wrote:
>> > > > >
>> > > > > > Hello Guang Ping,
>> > > > > >
>> > > > > > Julie has successfully installed the changes to the
plot_tcmpr.R
>> > > script
>> > > > > on
>> > > > > > 'hera', with the following instructions:
>> > > > > >
>> > > > > > -------
>> > > > > > The changes to the plot_tcmpr.R script are now installed
on
>> hera.
>> > > > > >
>> > > > > > The user can run the following to access this new version
of
>> MET:
>> > > > > > module use -a /contrib/anaconda/modulefiles
>> > > > > > module load intel/18.0.5.274
>> > > > > > module load anaconda/latest
>> > > > > > module use /contrib/met/modulefiles
>> > > > > > module load met/10.0.0_test
>> > > > > >
>> > > > > > If they are using METplus, they will need to run:
>> > > > > > module use /contrib/METplus/modulefiles
>> > > > > > module load metplus/4.0.0
>> > > > > > module use /contrib/met/modulefiles/
>> > > > > > module load met/10.0.0_test
>> > > > > > And they will need to set MET_INSTALL_DIR to
>> > > /contrib/met/10.0.0_test
>> > > > in
>> > > > > > their user config file.
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > If using the METplus wrapper to generate the plots with
all the
>> > model
>> > > > > > points, you will need to turn off event equalization in
your
>> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting
the
>> > > following:
>> > > > > >
>> > > > > > TCMPR_PLOTTER_NO_EE = yes
>> > > > > >
>> > > > > > This will disable the event equalization. Your sample
data
>> didn't
>> > > have
>> > > > > > any overlapping tracks so no plots were generated when
event
>> > > > equalization
>> > > > > > was enabled. You can leave MODEL unassigned so that all
models
>> > will
>> > > be
>> > > > > > used (as long as all your tc-pairs .tcst files are in the
same
>> > > > > directory).
>> > > > > > If you want a subset of models, you can set the
following:
>> > > > > >
>> > > > > > MODEL = GFSO,CMC,EMX
>> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
>> > > > > >
>> > > > > > to explicitly include only the GFSO, CMC and EMX models
(or
>> > whatever
>> > > > > > models you wish) on your plots.
>> > > > > >
>> > > > > >
>> > > > > > Regards,
>> > > > > > Minna
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > > --
>> > > > George McCabe - Software Engineer III
>> > > > National Center for Atmospheric Research
>> > > > Research Applications Laboratory
>> > > > 303-497-2768
>> > > > ---
>> > > > My working day may not be your working day. Please do not
feel
>> obliged
>> > to
>> > > > reply to this email outside of your normal working hours.
>> > > >
>> > > >
>> > >
>> > >
>> >
>> > --
>> > George McCabe - Software Engineer III
>> > National Center for Atmospheric Research
>> > Research Applications Laboratory
>> > 303-497-2768
>> > ---
>> > My working day may not be your working day. Please do not feel
obliged
>> to
>> > reply to this email outside of your normal working hours.
>> >
>> >
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Thu May 27 12:32:00 2021
Hi George,
Thank you so much for making it work!
I ran your temporary script
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
and it was able to generate multiple lines in the same frame. Please
see:
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-BMSLP_mean.png
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
Now there are some finer points that I would like to ask you:
1. The plots become huge if we click the picture to zoom in. This is
true
when we use the "display" command on Hera or other machines.
I think the original plots that were generated by the earlier
scripts
do not have this issue.
2. The X-Y labels are all the same. How do we change the label
according to
the variables?
In the config file,
TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
TCMPR_PLOTTER_SUBTITLE = Forecast Hours
TCMPR_PLOTTER_XLAB =
TCMPR_PLOTTER_YLAB = Track error (NM)
All plots have the same labels assigned above. How can I assign
different labels for different variable plots?
3. Your new version works on Hera, I am assuming that it will not work
on
WCOSS because WCOSS does not have the R-library, Am I correct?
John (Gotway) mentioned that MET is going to use METcalcpy and
METplotpy in
the future, would this include the cyclone plots?
Sorry that I have so many questions. I deeply appreciate your help.
Thanks,
Guang Ping
On Thu, May 27, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> I put a version of METplus for you to test using TCMPRPlotter. To
use this
> version, run the module commands to set up METplus, then instead of
calling
> run_metplus.py from the path, call the version in my scratch
directory,
> passing in your config files normally.
>
>
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
>
> I ran using your config file from your previous email and was able
to view
> the log output from the R script in the METplus log file. The first
attempt
> failed due to the bug that requires -bmodel to be set, so I changed
the
> default configuration to use the testing version of MET that Minna
and
> Julie made available on Hera (/contrib/met/10.0.0_test). Calling
this
> version of run_metplus.py will automatically use the test version of
MET
> unless you are overriding MET_INSTALL_DIR in your config files.
>
> I generated images here:
> /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-test/tcmpr_plots
>
> Please take a look and verify that the output looks correct. Let me
know if
> you have any other questions or issues.
>
> Thanks,
> George
>
> On Wed, May 26, 2021 at 2:59 PM George McCabe <mccabe at ucar.edu>
wrote:
>
> > Hi Guang Ping,
> >
> > I will make some modifications to the wrapper to make it easier to
debug
> > the error, as it is difficult to see what is happening. I can put
the
> > changes on Hera so you can use that version to test. I will let
you know
> > when that is ready.
> >
> > Thanks,
> > George
> >
> > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >>
> >> Hi George,
> >>
> >> Thanks for your quick response.
> >> I modified the config file
> >>
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> >> and still got the same error messages:
> >>
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> >>
> >> In your plot, you plotted only 1 model. What I wanted is all 3
models'
> >> stats be plotted on the same frame.
> >>
> >> Thanks again,
> >> Guang Ping
> >>
> >>
> >>
> >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT
<met_help at ucar.edu
> >
> >> wrote:
> >>
> >> > Hi Guang Ping,
> >> >
> >> > Sorry, I mistakenly thought the error in the plotter was due to
> missing
> >> > data. It looks like it is failing because it is not reading the
> -filter
> >> > options properly. Please try putting quotation marks around the
value
> >> for
> >> > TCMPR_PLOTTER_FILTER to see if that helps.
> >> >
> >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> >> >
> >> > Let me know if that does not work. If not, the wrapper will
have to be
> >> > updated to add quotation marks around it. It should really do
this
> >> > automatically, so I can make that change when I update the
wrapper. I
> >> will
> >> > also modify it to output the log output and make it easier to
copy the
> >> > Rscript command to rerun it on the command line for testing
purposes.
> I
> >> was
> >> > able to get output by running the following command (using only
1
> input
> >> > file):
> >> >
> >> > Rscript
/contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> -config
> >> >
> >> >
> >>
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> >> > -title "Extratropical Cyclone Track Error" -subtitle "Forecast
Hours"
> >> -ylab
> >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
> >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> >> >
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> >> >
> >> > Thanks,
> >> > George
> >> >
> >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate via
RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > >
> >> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> >> > >
> >> > > Hi George,
> >> > >
> >> > > Thanks for the info. But the plotting is supposed to follow
the
> >> > conversion
> >> > > from regular pairs to .tcst pairs, which are generated by the
> command
> >> > line.
> >> > > All the .tcst pairs are in
> >> > >
> >> > >
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> >> > > after the command line:
> >> > > master_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_7.conf
-c
> >> > > usecase_7.conf
> >> > >
> >> > > If that is not the case , where should the path be specified?
> >> > >
> >> > >
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> >> > >
> >> > > Thanks,
> >> > > Guang Ping
> >> > >
> >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
> >> met_help at ucar.edu>
> >> > > wrote:
> >> > >
> >> > > > Hi Guang Ping,
> >> > > >
> >> > > > This error is due to a bug in the logic to report an error
in the
> >> > > wrapper.
> >> > > > This error is most likely happening because the input files
passed
> >> to
> >> > the
> >> > > > plotter are empty. You will need to change the
configuration of
> >> TCPairs
> >> > > to
> >> > > > get output lines. The error will go away if there is data
> available
> >> to
> >> > > > process.
> >> > > >
> >> > > > - George
> >> > > >
> >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA Affiliate
via
> RT <
> >> > > > met_help at ucar.edu> wrote:
> >> > > >
> >> > > > >
> >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >> > > > >
> >> > > > > Hi Minna,
> >> > > > >
> >> > > > > Thanks for the update. I followed your suggestion and
there was
> an
> >> > > error
> >> > > > > that says:
> >> > > > >
> ------------------------------------------------------------------
> >> > > > > File
> "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
> >> > line
> >> > > > 159,
> >> > > > > in run_metplus
> >> > > > > new_commands = process.run_all_times()
> >> > > > > File
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> >> > > > > line 261, in run_all_times
> >> > > > > except produtil.run.ExitStatusException as ese:
> >> > > > > NameError: name 'produtil' is not defined
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
>
---------------------------------------------------------------------------
> >> > > > >
> >> > > > > I looked up modules that related to the produtil, but
could not
> >> find
> >> > > any.
> >> > > > > here is the Hera:
> >> > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> >> > > > > my line command is:
> >> > > > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> >> > > > > usecase_7.conf
> >> > > > >
> >> > > > > Thanks,
> >> > > > > Guang Ping
> >> > > > >
> >> > > > >
> >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
> >> met_help at ucar.edu>
> >> > > > > wrote:
> >> > > > >
> >> > > > > > Hello Guang Ping,
> >> > > > > >
> >> > > > > > Julie has successfully installed the changes to the
> plot_tcmpr.R
> >> > > script
> >> > > > > on
> >> > > > > > 'hera', with the following instructions:
> >> > > > > >
> >> > > > > > -------
> >> > > > > > The changes to the plot_tcmpr.R script are now
installed on
> >> hera.
> >> > > > > >
> >> > > > > > The user can run the following to access this new
version of
> >> MET:
> >> > > > > > module use -a /contrib/anaconda/modulefiles
> >> > > > > > module load intel/18.0.5.274
> >> > > > > > module load anaconda/latest
> >> > > > > > module use /contrib/met/modulefiles
> >> > > > > > module load met/10.0.0_test
> >> > > > > >
> >> > > > > > If they are using METplus, they will need to run:
> >> > > > > > module use /contrib/METplus/modulefiles
> >> > > > > > module load metplus/4.0.0
> >> > > > > > module use /contrib/met/modulefiles/
> >> > > > > > module load met/10.0.0_test
> >> > > > > > And they will need to set MET_INSTALL_DIR to
> >> > > /contrib/met/10.0.0_test
> >> > > > in
> >> > > > > > their user config file.
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > If using the METplus wrapper to generate the plots with
all
> the
> >> > model
> >> > > > > > points, you will need to turn off event equalization in
your
> >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by setting
the
> >> > > following:
> >> > > > > >
> >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> >> > > > > >
> >> > > > > > This will disable the event equalization. Your sample
data
> >> didn't
> >> > > have
> >> > > > > > any overlapping tracks so no plots were generated when
event
> >> > > > equalization
> >> > > > > > was enabled. You can leave MODEL unassigned so that
all
> models
> >> > will
> >> > > be
> >> > > > > > used (as long as all your tc-pairs .tcst files are in
the same
> >> > > > > directory).
> >> > > > > > If you want a subset of models, you can set the
following:
> >> > > > > >
> >> > > > > > MODEL = GFSO,CMC,EMX
> >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> >> > > > > >
> >> > > > > > to explicitly include only the GFSO, CMC and EMX models
(or
> >> > whatever
> >> > > > > > models you wish) on your plots.
> >> > > > > >
> >> > > > > >
> >> > > > > > Regards,
> >> > > > > > Minna
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > > >
> >> > > >
> >> > > > --
> >> > > > George McCabe - Software Engineer III
> >> > > > National Center for Atmospheric Research
> >> > > > Research Applications Laboratory
> >> > > > 303-497-2768
> >> > > > ---
> >> > > > My working day may not be your working day. Please do not
feel
> >> obliged
> >> > to
> >> > > > reply to this email outside of your normal working hours.
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> > --
> >> > George McCabe - Software Engineer III
> >> > National Center for Atmospheric Research
> >> > Research Applications Laboratory
> >> > 303-497-2768
> >> > ---
> >> > My working day may not be your working day. Please do not feel
obliged
> >> to
> >> > reply to this email outside of your normal working hours.
> >> >
> >> >
> >>
> >>
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Thu May 27 12:56:55 2021
Hi Guang Ping,
1.
The image size is controlled by a variable in the TCMPR config file.
Here
is the setting that was used in the original that sets it:
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
img_res = 72;
2.
This is the same issue that Yan ran into on another MET help ticket. I
provided a work around to change the plot info and filenames for each
variable. I am modifying TCMPRPlotter to loop over the variables to
run
once for each and add a way to specify the label to use for each. This
would allow you to use that label in the YLAB value. I can send you
the
updated version to test when that is ready.
3.
Yes, if R is not available then the TCMPRPlotter will not work. The
eventual plan is to migrate the R scripts to Python, but this may not
happen for a while unless this is needed more urgently.
Thanks,
George
On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi George,
>
> Thank you so much for making it work!
> I ran your temporary script
>
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
>
> and it was able to generate multiple lines in the same frame. Please
see:
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
>
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
>
> Now there are some finer points that I would like to ask you:
> 1. The plots become huge if we click the picture to zoom in. This is
true
> when we use the "display" command on Hera or other machines.
> I think the original plots that were generated by the earlier
scripts
> do not have this issue.
> 2. The X-Y labels are all the same. How do we change the label
according to
> the variables?
> In the config file,
> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> TCMPR_PLOTTER_XLAB =
> TCMPR_PLOTTER_YLAB = Track error (NM)
> All plots have the same labels assigned above. How can I assign
> different labels for different variable plots?
> 3. Your new version works on Hera, I am assuming that it will not
work on
> WCOSS because WCOSS does not have the R-library, Am I correct?
> John (Gotway) mentioned that MET is going to use METcalcpy and
METplotpy in
> the future, would this include the cyclone plots?
>
> Sorry that I have so many questions. I deeply appreciate your help.
>
> Thanks,
> Guang Ping
>
>
>
> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > I put a version of METplus for you to test using TCMPRPlotter. To
use
> this
> > version, run the module commands to set up METplus, then instead
of
> calling
> > run_metplus.py from the path, call the version in my scratch
directory,
> > passing in your config files normally.
> >
> >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> >
> > I ran using your config file from your previous email and was able
to
> view
> > the log output from the R script in the METplus log file. The
first
> attempt
> > failed due to the bug that requires -bmodel to be set, so I
changed the
> > default configuration to use the testing version of MET that Minna
and
> > Julie made available on Hera (/contrib/met/10.0.0_test). Calling
this
> > version of run_metplus.py will automatically use the test version
of MET
> > unless you are overriding MET_INSTALL_DIR in your config files.
> >
> > I generated images here:
> > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-test/tcmpr_plots
> >
> > Please take a look and verify that the output looks correct. Let
me know
> if
> > you have any other questions or issues.
> >
> > Thanks,
> > George
> >
> > On Wed, May 26, 2021 at 2:59 PM George McCabe <mccabe at ucar.edu>
wrote:
> >
> > > Hi Guang Ping,
> > >
> > > I will make some modifications to the wrapper to make it easier
to
> debug
> > > the error, as it is difficult to see what is happening. I can
put the
> > > changes on Hera so you can use that version to test. I will let
you
> know
> > > when that is ready.
> > >
> > > Thanks,
> > > George
> > >
> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >>
> > >> Hi George,
> > >>
> > >> Thanks for your quick response.
> > >> I modified the config file
> > >>
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > >> and still got the same error messages:
> > >>
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > >>
> > >> In your plot, you plotted only 1 model. What I wanted is all 3
models'
> > >> stats be plotted on the same frame.
> > >>
> > >> Thanks again,
> > >> Guang Ping
> > >>
> > >>
> > >>
> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT <
> met_help at ucar.edu
> > >
> > >> wrote:
> > >>
> > >> > Hi Guang Ping,
> > >> >
> > >> > Sorry, I mistakenly thought the error in the plotter was due
to
> > missing
> > >> > data. It looks like it is failing because it is not reading
the
> > -filter
> > >> > options properly. Please try putting quotation marks around
the
> value
> > >> for
> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > >> >
> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > >> >
> > >> > Let me know if that does not work. If not, the wrapper will
have to
> be
> > >> > updated to add quotation marks around it. It should really do
this
> > >> > automatically, so I can make that change when I update the
wrapper.
> I
> > >> will
> > >> > also modify it to output the log output and make it easier to
copy
> the
> > >> > Rscript command to rerun it on the command line for testing
> purposes.
> > I
> > >> was
> > >> > able to get output by running the following command (using
only 1
> > input
> > >> > file):
> > >> >
> > >> > Rscript
/contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > -config
> > >> >
> > >> >
> > >>
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > >> > -title "Extratropical Cyclone Track Error" -subtitle
"Forecast
> Hours"
> > >> -ylab
> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > >> >
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> > >> >
> > >> > Thanks,
> > >> > George
> > >> >
> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate
via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > >
> > >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >> > >
> > >> > > Hi George,
> > >> > >
> > >> > > Thanks for the info. But the plotting is supposed to follow
the
> > >> > conversion
> > >> > > from regular pairs to .tcst pairs, which are generated by
the
> > command
> > >> > line.
> > >> > > All the .tcst pairs are in
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > >> > > after the command line:
> > >> > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > >> > > usecase_7.conf
> > >> > >
> > >> > > If that is not the case , where should the path be
specified?
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > >> > >
> > >> > > Thanks,
> > >> > > Guang Ping
> > >> > >
> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
> > >> met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > > > Hi Guang Ping,
> > >> > > >
> > >> > > > This error is due to a bug in the logic to report an
error in
> the
> > >> > > wrapper.
> > >> > > > This error is most likely happening because the input
files
> passed
> > >> to
> > >> > the
> > >> > > > plotter are empty. You will need to change the
configuration of
> > >> TCPairs
> > >> > > to
> > >> > > > get output lines. The error will go away if there is data
> > available
> > >> to
> > >> > > > process.
> > >> > > >
> > >> > > > - George
> > >> > > >
> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA
Affiliate via
> > RT <
> > >> > > > met_help at ucar.edu> wrote:
> > >> > > >
> > >> > > > >
> > >> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> > >> > > > >
> > >> > > > > Hi Minna,
> > >> > > > >
> > >> > > > > Thanks for the update. I followed your suggestion and
there
> was
> > an
> > >> > > error
> > >> > > > > that says:
> > >> > > > >
> > ------------------------------------------------------------------
> > >> > > > > File
> > "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
> > >> > line
> > >> > > > 159,
> > >> > > > > in run_metplus
> > >> > > > > new_commands = process.run_all_times()
> > >> > > > > File
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > >> > > > > line 261, in run_all_times
> > >> > > > > except produtil.run.ExitStatusException as ese:
> > >> > > > > NameError: name 'produtil' is not defined
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
>
---------------------------------------------------------------------------
> > >> > > > >
> > >> > > > > I looked up modules that related to the produtil, but
could
> not
> > >> find
> > >> > > any.
> > >> > > > > here is the Hera:
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > >> > > > > my line command is:
> > >> > > > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> -c
> > >> > > > > usecase_7.conf
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > Guang Ping
> > >> > > > >
> > >> > > > >
> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
> > >> met_help at ucar.edu>
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > > Hello Guang Ping,
> > >> > > > > >
> > >> > > > > > Julie has successfully installed the changes to the
> > plot_tcmpr.R
> > >> > > script
> > >> > > > > on
> > >> > > > > > 'hera', with the following instructions:
> > >> > > > > >
> > >> > > > > > -------
> > >> > > > > > The changes to the plot_tcmpr.R script are now
installed on
> > >> hera.
> > >> > > > > >
> > >> > > > > > The user can run the following to access this new
version of
> > >> MET:
> > >> > > > > > module use -a /contrib/anaconda/modulefiles
> > >> > > > > > module load intel/18.0.5.274
> > >> > > > > > module load anaconda/latest
> > >> > > > > > module use /contrib/met/modulefiles
> > >> > > > > > module load met/10.0.0_test
> > >> > > > > >
> > >> > > > > > If they are using METplus, they will need to run:
> > >> > > > > > module use /contrib/METplus/modulefiles
> > >> > > > > > module load metplus/4.0.0
> > >> > > > > > module use /contrib/met/modulefiles/
> > >> > > > > > module load met/10.0.0_test
> > >> > > > > > And they will need to set MET_INSTALL_DIR to
> > >> > > /contrib/met/10.0.0_test
> > >> > > > in
> > >> > > > > > their user config file.
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > If using the METplus wrapper to generate the plots
with all
> > the
> > >> > model
> > >> > > > > > points, you will need to turn off event equalization
in your
> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by
setting the
> > >> > > following:
> > >> > > > > >
> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > >> > > > > >
> > >> > > > > > This will disable the event equalization. Your
sample data
> > >> didn't
> > >> > > have
> > >> > > > > > any overlapping tracks so no plots were generated
when event
> > >> > > > equalization
> > >> > > > > > was enabled. You can leave MODEL unassigned so that
all
> > models
> > >> > will
> > >> > > be
> > >> > > > > > used (as long as all your tc-pairs .tcst files are in
the
> same
> > >> > > > > directory).
> > >> > > > > > If you want a subset of models, you can set the
following:
> > >> > > > > >
> > >> > > > > > MODEL = GFSO,CMC,EMX
> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > >> > > > > >
> > >> > > > > > to explicitly include only the GFSO, CMC and EMX
models (or
> > >> > whatever
> > >> > > > > > models you wish) on your plots.
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Regards,
> > >> > > > > > Minna
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > > --
> > >> > > > George McCabe - Software Engineer III
> > >> > > > National Center for Atmospheric Research
> > >> > > > Research Applications Laboratory
> > >> > > > 303-497-2768
> > >> > > > ---
> > >> > > > My working day may not be your working day. Please do not
feel
> > >> obliged
> > >> > to
> > >> > > > reply to this email outside of your normal working hours.
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> > --
> > >> > George McCabe - Software Engineer III
> > >> > National Center for Atmospheric Research
> > >> > Research Applications Laboratory
> > >> > 303-497-2768
> > >> > ---
> > >> > My working day may not be your working day. Please do not
feel
> obliged
> > >> to
> > >> > reply to this email outside of your normal working hours.
> > >> >
> > >> >
> > >>
> > >>
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Tue Jun 01 16:28:39 2021
Hi Guang Ping,
I updated the version of METplus on Hera to include the latest
changes.
With this version, you can reference the dep/plot labels for each run:
TCMPR_PLOTTER_DEP_VARS = TK_ERR
TCMPR_PLOTTER_DEP_LABELS = Track Error
TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
TCMPR_PLOTTER_SUBTITLE = Forecast Hours
TCMPR_PLOTTER_XLAB =
TCMPR_PLOTTER_YLAB = {dep_label} (NM)
{dep_label} will be substituted with the value of the
TCMPR_PLOTTER_DEP_LABELS list for the corresponding
TCMPR_PLOTTER_DEP_VARS
value. The 2 lists should be the same length.
You can similarly use {plot_labels} if you set
TCMPR_PLOTTER_PLOT_LABELS.
Let me know if you have any issues setting that up.
Thanks,
George
On Thu, May 27, 2021 at 12:56 PM George McCabe <mccabe at ucar.edu>
wrote:
> Hi Guang Ping,
>
> 1.
> The image size is controlled by a variable in the TCMPR config file.
Here
> is the setting that was used in the original that sets it:
>
>
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
>
> img_res = 72;
>
> 2.
> This is the same issue that Yan ran into on another MET help ticket.
I
> provided a work around to change the plot info and filenames for
each
> variable. I am modifying TCMPRPlotter to loop over the variables to
run
> once for each and add a way to specify the label to use for each.
This
> would allow you to use that label in the YLAB value. I can send you
the
> updated version to test when that is ready.
>
> 3.
> Yes, if R is not available then the TCMPRPlotter will not work. The
> eventual plan is to migrate the R scripts to Python, but this may
not
> happen for a while unless this is needed more urgently.
>
> Thanks,
> George
>
> On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>>
>> Hi George,
>>
>> Thank you so much for making it work!
>> I ran your temporary script
>>
>>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
>>
>> and it was able to generate multiple lines in the same frame.
Please see:
>> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
>> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
>>
>> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
>>
>> Now there are some finer points that I would like to ask you:
>> 1. The plots become huge if we click the picture to zoom in. This
is true
>> when we use the "display" command on Hera or other machines.
>> I think the original plots that were generated by the earlier
scripts
>> do not have this issue.
>> 2. The X-Y labels are all the same. How do we change the label
according
>> to
>> the variables?
>> In the config file,
>> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
>> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
>> TCMPR_PLOTTER_XLAB =
>> TCMPR_PLOTTER_YLAB = Track error (NM)
>> All plots have the same labels assigned above. How can I assign
>> different labels for different variable plots?
>> 3. Your new version works on Hera, I am assuming that it will not
work on
>> WCOSS because WCOSS does not have the R-library, Am I correct?
>> John (Gotway) mentioned that MET is going to use METcalcpy and
METplotpy
>> in
>> the future, would this include the cyclone plots?
>>
>> Sorry that I have so many questions. I deeply appreciate your
help.
>>
>> Thanks,
>> Guang Ping
>>
>>
>>
>> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT
<met_help at ucar.edu>
>> wrote:
>>
>> > Hi Guang Ping,
>> >
>> > I put a version of METplus for you to test using TCMPRPlotter. To
use
>> this
>> > version, run the module commands to set up METplus, then instead
of
>> calling
>> > run_metplus.py from the path, call the version in my scratch
directory,
>> > passing in your config files normally.
>> >
>> >
>> >
>>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
>> >
>> > I ran using your config file from your previous email and was
able to
>> view
>> > the log output from the R script in the METplus log file. The
first
>> attempt
>> > failed due to the bug that requires -bmodel to be set, so I
changed the
>> > default configuration to use the testing version of MET that
Minna and
>> > Julie made available on Hera (/contrib/met/10.0.0_test). Calling
this
>> > version of run_metplus.py will automatically use the test version
of MET
>> > unless you are overriding MET_INSTALL_DIR in your config files.
>> >
>> > I generated images here:
>> > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-test/tcmpr_plots
>> >
>> > Please take a look and verify that the output looks correct. Let
me
>> know if
>> > you have any other questions or issues.
>> >
>> > Thanks,
>> > George
>> >
>> > On Wed, May 26, 2021 at 2:59 PM George McCabe <mccabe at ucar.edu>
wrote:
>> >
>> > > Hi Guang Ping,
>> > >
>> > > I will make some modifications to the wrapper to make it easier
to
>> debug
>> > > the error, as it is difficult to see what is happening. I can
put the
>> > > changes on Hera so you can use that version to test. I will let
you
>> know
>> > > when that is ready.
>> > >
>> > > Thanks,
>> > > George
>> > >
>> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate via
RT <
>> > > met_help at ucar.edu> wrote:
>> > >
>> > >>
>> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
>> > >>
>> > >> Hi George,
>> > >>
>> > >> Thanks for your quick response.
>> > >> I modified the config file
>> > >>
>> > >>
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
>> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
>> > >> and still got the same error messages:
>> > >>
>> > >>
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
>> > >>
>> > >> In your plot, you plotted only 1 model. What I wanted is all 3
>> models'
>> > >> stats be plotted on the same frame.
>> > >>
>> > >> Thanks again,
>> > >> Guang Ping
>> > >>
>> > >>
>> > >>
>> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT <
>> met_help at ucar.edu
>> > >
>> > >> wrote:
>> > >>
>> > >> > Hi Guang Ping,
>> > >> >
>> > >> > Sorry, I mistakenly thought the error in the plotter was due
to
>> > missing
>> > >> > data. It looks like it is failing because it is not reading
the
>> > -filter
>> > >> > options properly. Please try putting quotation marks around
the
>> value
>> > >> for
>> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
>> > >> >
>> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
>> > >> >
>> > >> > Let me know if that does not work. If not, the wrapper will
have
>> to be
>> > >> > updated to add quotation marks around it. It should really
do this
>> > >> > automatically, so I can make that change when I update the
>> wrapper. I
>> > >> will
>> > >> > also modify it to output the log output and make it easier
to copy
>> the
>> > >> > Rscript command to rerun it on the command line for testing
>> purposes.
>> > I
>> > >> was
>> > >> > able to get output by running the following command (using
only 1
>> > input
>> > >> > file):
>> > >> >
>> > >> > Rscript
/contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
>> > -config
>> > >> >
>> > >> >
>> > >>
>> >
>> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
>> > >> > -title "Extratropical Cyclone Track Error" -subtitle
"Forecast
>> Hours"
>> > >> -ylab
>> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
>> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
>> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
>> > >> >
>> > >> >
>> > >>
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
>> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
>> > >> >
>> > >> > Thanks,
>> > >> > George
>> > >> >
>> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate
via RT <
>> > >> > met_help at ucar.edu> wrote:
>> > >> >
>> > >> > >
>> > >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>> > >> > >
>> > >> > > Hi George,
>> > >> > >
>> > >> > > Thanks for the info. But the plotting is supposed to
follow the
>> > >> > conversion
>> > >> > > from regular pairs to .tcst pairs, which are generated by
the
>> > command
>> > >> > line.
>> > >> > > All the .tcst pairs are in
>> > >> > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
>> > >> > > after the command line:
>> > >> > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
>> > >> > > usecase_7.conf
>> > >> > >
>> > >> > > If that is not the case , where should the path be
specified?
>> > >> > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
>> > >> > >
>> > >> > > Thanks,
>> > >> > > Guang Ping
>> > >> > >
>> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
>> > >> met_help at ucar.edu>
>> > >> > > wrote:
>> > >> > >
>> > >> > > > Hi Guang Ping,
>> > >> > > >
>> > >> > > > This error is due to a bug in the logic to report an
error in
>> the
>> > >> > > wrapper.
>> > >> > > > This error is most likely happening because the input
files
>> passed
>> > >> to
>> > >> > the
>> > >> > > > plotter are empty. You will need to change the
configuration of
>> > >> TCPairs
>> > >> > > to
>> > >> > > > get output lines. The error will go away if there is
data
>> > available
>> > >> to
>> > >> > > > process.
>> > >> > > >
>> > >> > > > - George
>> > >> > > >
>> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA
Affiliate via
>> > RT <
>> > >> > > > met_help at ucar.edu> wrote:
>> > >> > > >
>> > >> > > > >
>> > >> > > > > <URL:
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>> > >> > > > >
>> > >> > > > > Hi Minna,
>> > >> > > > >
>> > >> > > > > Thanks for the update. I followed your suggestion and
there
>> was
>> > an
>> > >> > > error
>> > >> > > > > that says:
>> > >> > > > >
>> >
------------------------------------------------------------------
>> > >> > > > > File
>> > "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
>> > >> > line
>> > >> > > > 159,
>> > >> > > > > in run_metplus
>> > >> > > > > new_commands = process.run_all_times()
>> > >> > > > > File
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
>> > >> > > > > line 261, in run_all_times
>> > >> > > > > except produtil.run.ExitStatusException as ese:
>> > >> > > > > NameError: name 'produtil' is not defined
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>>
---------------------------------------------------------------------------
>> > >> > > > >
>> > >> > > > > I looked up modules that related to the produtil, but
could
>> not
>> > >> find
>> > >> > > any.
>> > >> > > > > here is the Hera:
>> > >> > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > >
>> > >> >
>> > >>
>> >
>> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
>> > >> > > > > my line command is:
>> > >> > > > > master_metplus.py -c
>> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
>> > >> > > > > usecase_7.conf
>> > >> > > > >
>> > >> > > > > Thanks,
>> > >> > > > > Guang Ping
>> > >> > > > >
>> > >> > > > >
>> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
>> > >> met_help at ucar.edu>
>> > >> > > > > wrote:
>> > >> > > > >
>> > >> > > > > > Hello Guang Ping,
>> > >> > > > > >
>> > >> > > > > > Julie has successfully installed the changes to the
>> > plot_tcmpr.R
>> > >> > > script
>> > >> > > > > on
>> > >> > > > > > 'hera', with the following instructions:
>> > >> > > > > >
>> > >> > > > > > -------
>> > >> > > > > > The changes to the plot_tcmpr.R script are now
installed on
>> > >> hera.
>> > >> > > > > >
>> > >> > > > > > The user can run the following to access this new
version
>> of
>> > >> MET:
>> > >> > > > > > module use -a /contrib/anaconda/modulefiles
>> > >> > > > > > module load intel/18.0.5.274
>> > >> > > > > > module load anaconda/latest
>> > >> > > > > > module use /contrib/met/modulefiles
>> > >> > > > > > module load met/10.0.0_test
>> > >> > > > > >
>> > >> > > > > > If they are using METplus, they will need to run:
>> > >> > > > > > module use /contrib/METplus/modulefiles
>> > >> > > > > > module load metplus/4.0.0
>> > >> > > > > > module use /contrib/met/modulefiles/
>> > >> > > > > > module load met/10.0.0_test
>> > >> > > > > > And they will need to set MET_INSTALL_DIR to
>> > >> > > /contrib/met/10.0.0_test
>> > >> > > > in
>> > >> > > > > > their user config file.
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > If using the METplus wrapper to generate the plots
with all
>> > the
>> > >> > model
>> > >> > > > > > points, you will need to turn off event equalization
in
>> your
>> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by
setting the
>> > >> > > following:
>> > >> > > > > >
>> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
>> > >> > > > > >
>> > >> > > > > > This will disable the event equalization. Your
sample data
>> > >> didn't
>> > >> > > have
>> > >> > > > > > any overlapping tracks so no plots were generated
when
>> event
>> > >> > > > equalization
>> > >> > > > > > was enabled. You can leave MODEL unassigned so that
all
>> > models
>> > >> > will
>> > >> > > be
>> > >> > > > > > used (as long as all your tc-pairs .tcst files are
in the
>> same
>> > >> > > > > directory).
>> > >> > > > > > If you want a subset of models, you can set the
following:
>> > >> > > > > >
>> > >> > > > > > MODEL = GFSO,CMC,EMX
>> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
>> > >> > > > > >
>> > >> > > > > > to explicitly include only the GFSO, CMC and EMX
models (or
>> > >> > whatever
>> > >> > > > > > models you wish) on your plots.
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > > Regards,
>> > >> > > > > > Minna
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > > >
>> > >> > > > >
>> > >> > > > >
>> > >> > > >
>> > >> > > > --
>> > >> > > > George McCabe - Software Engineer III
>> > >> > > > National Center for Atmospheric Research
>> > >> > > > Research Applications Laboratory
>> > >> > > > 303-497-2768
>> > >> > > > ---
>> > >> > > > My working day may not be your working day. Please do
not feel
>> > >> obliged
>> > >> > to
>> > >> > > > reply to this email outside of your normal working
hours.
>> > >> > > >
>> > >> > > >
>> > >> > >
>> > >> > >
>> > >> >
>> > >> > --
>> > >> > George McCabe - Software Engineer III
>> > >> > National Center for Atmospheric Research
>> > >> > Research Applications Laboratory
>> > >> > 303-497-2768
>> > >> > ---
>> > >> > My working day may not be your working day. Please do not
feel
>> obliged
>> > >> to
>> > >> > reply to this email outside of your normal working hours.
>> > >> >
>> > >> >
>> > >>
>> > >>
>> > >
>> > > --
>> > > George McCabe - Software Engineer III
>> > > National Center for Atmospheric Research
>> > > Research Applications Laboratory
>> > > 303-497-2768
>> > > ---
>> > > My working day may not be your working day. Please do not feel
>> obliged to
>> > > reply to this email outside of your normal working hours.
>> > >
>> >
>> >
>> > --
>> > George McCabe - Software Engineer III
>> > National Center for Atmospheric Research
>> > Research Applications Laboratory
>> > 303-497-2768
>> > ---
>> > My working day may not be your working day. Please do not feel
obliged
>> to
>> > reply to this email outside of your normal working hours.
>> >
>> >
>>
>>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Fri Jun 04 09:26:03 2021
Hi George,
I was wondering if you could give me an example of the config files
running
your new installation with your new label setup. I was getting error
messages when I ran. I assume your new installation is still met10.0.0
and
Metplus-4.0.0.
Thanks a lot!
Guang Ping
On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> I updated the version of METplus on Hera to include the latest
changes.
> With this version, you can reference the dep/plot labels for each
run:
>
> TCMPR_PLOTTER_DEP_VARS = TK_ERR
> TCMPR_PLOTTER_DEP_LABELS = Track Error
>
> TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> TCMPR_PLOTTER_XLAB =
> TCMPR_PLOTTER_YLAB = {dep_label} (NM)
>
> {dep_label} will be substituted with the value of the
> TCMPR_PLOTTER_DEP_LABELS list for the corresponding
TCMPR_PLOTTER_DEP_VARS
> value. The 2 lists should be the same length.
>
> You can similarly use {plot_labels} if you set
TCMPR_PLOTTER_PLOT_LABELS.
>
> Let me know if you have any issues setting that up.
>
> Thanks,
> George
>
> On Thu, May 27, 2021 at 12:56 PM George McCabe <mccabe at ucar.edu>
wrote:
>
> > Hi Guang Ping,
> >
> > 1.
> > The image size is controlled by a variable in the TCMPR config
file. Here
> > is the setting that was used in the original that sets it:
> >
> >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> >
> > img_res = 72;
> >
> > 2.
> > This is the same issue that Yan ran into on another MET help
ticket. I
> > provided a work around to change the plot info and filenames for
each
> > variable. I am modifying TCMPRPlotter to loop over the variables
to run
> > once for each and add a way to specify the label to use for each.
This
> > would allow you to use that label in the YLAB value. I can send
you the
> > updated version to test when that is ready.
> >
> > 3.
> > Yes, if R is not available then the TCMPRPlotter will not work.
The
> > eventual plan is to migrate the R scripts to Python, but this may
not
> > happen for a while unless this is needed more urgently.
> >
> > Thanks,
> > George
> >
> > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> >>
> >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >>
> >> Hi George,
> >>
> >> Thank you so much for making it work!
> >> I ran your temporary script
> >>
> >>
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> >>
> >> and it was able to generate multiple lines in the same frame.
Please
> see:
> >> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> >> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> >>
> >>
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> >>
> >> Now there are some finer points that I would like to ask you:
> >> 1. The plots become huge if we click the picture to zoom in. This
is
> true
> >> when we use the "display" command on Hera or other machines.
> >> I think the original plots that were generated by the
earlier
> scripts
> >> do not have this issue.
> >> 2. The X-Y labels are all the same. How do we change the label
according
> >> to
> >> the variables?
> >> In the config file,
> >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> >> TCMPR_PLOTTER_XLAB =
> >> TCMPR_PLOTTER_YLAB = Track error (NM)
> >> All plots have the same labels assigned above. How can I
assign
> >> different labels for different variable plots?
> >> 3. Your new version works on Hera, I am assuming that it will not
work
> on
> >> WCOSS because WCOSS does not have the R-library, Am I correct?
> >> John (Gotway) mentioned that MET is going to use METcalcpy and
METplotpy
> >> in
> >> the future, would this include the cyclone plots?
> >>
> >> Sorry that I have so many questions. I deeply appreciate your
help.
> >>
> >> Thanks,
> >> Guang Ping
> >>
> >>
> >>
> >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT <
> met_help at ucar.edu>
> >> wrote:
> >>
> >> > Hi Guang Ping,
> >> >
> >> > I put a version of METplus for you to test using TCMPRPlotter.
To use
> >> this
> >> > version, run the module commands to set up METplus, then
instead of
> >> calling
> >> > run_metplus.py from the path, call the version in my scratch
> directory,
> >> > passing in your config files normally.
> >> >
> >> >
> >> >
> >>
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> >> >
> >> > I ran using your config file from your previous email and was
able to
> >> view
> >> > the log output from the R script in the METplus log file. The
first
> >> attempt
> >> > failed due to the bug that requires -bmodel to be set, so I
changed
> the
> >> > default configuration to use the testing version of MET that
Minna and
> >> > Julie made available on Hera (/contrib/met/10.0.0_test).
Calling this
> >> > version of run_metplus.py will automatically use the test
version of
> MET
> >> > unless you are overriding MET_INSTALL_DIR in your config files.
> >> >
> >> > I generated images here:
> >> > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-
test/tcmpr_plots
> >> >
> >> > Please take a look and verify that the output looks correct.
Let me
> >> know if
> >> > you have any other questions or issues.
> >> >
> >> > Thanks,
> >> > George
> >> >
> >> > On Wed, May 26, 2021 at 2:59 PM George McCabe <mccabe at ucar.edu>
> wrote:
> >> >
> >> > > Hi Guang Ping,
> >> > >
> >> > > I will make some modifications to the wrapper to make it
easier to
> >> debug
> >> > > the error, as it is difficult to see what is happening. I can
put
> the
> >> > > changes on Hera so you can use that version to test. I will
let you
> >> know
> >> > > when that is ready.
> >> > >
> >> > > Thanks,
> >> > > George
> >> > >
> >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate
via RT <
> >> > > met_help at ucar.edu> wrote:
> >> > >
> >> > >>
> >> > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >> > >>
> >> > >> Hi George,
> >> > >>
> >> > >> Thanks for your quick response.
> >> > >> I modified the config file
> >> > >>
> >> > >>
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> >> > >> and still got the same error messages:
> >> > >>
> >> > >>
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> >> > >>
> >> > >> In your plot, you plotted only 1 model. What I wanted is all
3
> >> models'
> >> > >> stats be plotted on the same frame.
> >> > >>
> >> > >> Thanks again,
> >> > >> Guang Ping
> >> > >>
> >> > >>
> >> > >>
> >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT <
> >> met_help at ucar.edu
> >> > >
> >> > >> wrote:
> >> > >>
> >> > >> > Hi Guang Ping,
> >> > >> >
> >> > >> > Sorry, I mistakenly thought the error in the plotter was
due to
> >> > missing
> >> > >> > data. It looks like it is failing because it is not
reading the
> >> > -filter
> >> > >> > options properly. Please try putting quotation marks
around the
> >> value
> >> > >> for
> >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> >> > >> >
> >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> >> > >> >
> >> > >> > Let me know if that does not work. If not, the wrapper
will have
> >> to be
> >> > >> > updated to add quotation marks around it. It should really
do
> this
> >> > >> > automatically, so I can make that change when I update the
> >> wrapper. I
> >> > >> will
> >> > >> > also modify it to output the log output and make it easier
to
> copy
> >> the
> >> > >> > Rscript command to rerun it on the command line for
testing
> >> purposes.
> >> > I
> >> > >> was
> >> > >> > able to get output by running the following command (using
only 1
> >> > input
> >> > >> > file):
> >> > >> >
> >> > >> > Rscript
/contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> >> > -config
> >> > >> >
> >> > >> >
> >> > >>
> >> >
> >>
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> >> > >> > -title "Extratropical Cyclone Track Error" -subtitle
"Forecast
> >> Hours"
> >> > >> -ylab
> >> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS" -plot
> >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> >> > >> >
> >> > >> >
> >> > >>
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> >> > >> >
> >> > >> > Thanks,
> >> > >> > George
> >> > >> >
> >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA Affiliate
via
> RT <
> >> > >> > met_help at ucar.edu> wrote:
> >> > >> >
> >> > >> > >
> >> > >> > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> >> > >> > >
> >> > >> > > Hi George,
> >> > >> > >
> >> > >> > > Thanks for the info. But the plotting is supposed to
follow the
> >> > >> > conversion
> >> > >> > > from regular pairs to .tcst pairs, which are generated
by the
> >> > command
> >> > >> > line.
> >> > >> > > All the .tcst pairs are in
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> >> > >> > > after the command line:
> >> > >> > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> >> > >> > > usecase_7.conf
> >> > >> > >
> >> > >> > > If that is not the case , where should the path be
specified?
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> >> > >> > >
> >> > >> > > Thanks,
> >> > >> > > Guang Ping
> >> > >> > >
> >> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
> >> > >> met_help at ucar.edu>
> >> > >> > > wrote:
> >> > >> > >
> >> > >> > > > Hi Guang Ping,
> >> > >> > > >
> >> > >> > > > This error is due to a bug in the logic to report an
error in
> >> the
> >> > >> > > wrapper.
> >> > >> > > > This error is most likely happening because the input
files
> >> passed
> >> > >> to
> >> > >> > the
> >> > >> > > > plotter are empty. You will need to change the
configuration
> of
> >> > >> TCPairs
> >> > >> > > to
> >> > >> > > > get output lines. The error will go away if there is
data
> >> > available
> >> > >> to
> >> > >> > > > process.
> >> > >> > > >
> >> > >> > > > - George
> >> > >> > > >
> >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA
Affiliate
> via
> >> > RT <
> >> > >> > > > met_help at ucar.edu> wrote:
> >> > >> > > >
> >> > >> > > > >
> >> > >> > > > > <URL:
> >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >> > >> > > > >
> >> > >> > > > > Hi Minna,
> >> > >> > > > >
> >> > >> > > > > Thanks for the update. I followed your suggestion
and there
> >> was
> >> > an
> >> > >> > > error
> >> > >> > > > > that says:
> >> > >> > > > >
> >> >
------------------------------------------------------------------
> >> > >> > > > > File
> >> > "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
> >> > >> > line
> >> > >> > > > 159,
> >> > >> > > > > in run_metplus
> >> > >> > > > > new_commands = process.run_all_times()
> >> > >> > > > > File
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> >> > >> > > > > line 261, in run_all_times
> >> > >> > > > > except produtil.run.ExitStatusException as ese:
> >> > >> > > > > NameError: name 'produtil' is not defined
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
>
---------------------------------------------------------------------------
> >> > >> > > > >
> >> > >> > > > > I looked up modules that related to the produtil,
but could
> >> not
> >> > >> find
> >> > >> > > any.
> >> > >> > > > > here is the Hera:
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> >> > >> > > > > my line command is:
> >> > >> > > > > master_metplus.py -c
> >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> >> > >> > > > > usecase_7.conf
> >> > >> > > > >
> >> > >> > > > > Thanks,
> >> > >> > > > > Guang Ping
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
> >> > >> met_help at ucar.edu>
> >> > >> > > > > wrote:
> >> > >> > > > >
> >> > >> > > > > > Hello Guang Ping,
> >> > >> > > > > >
> >> > >> > > > > > Julie has successfully installed the changes to
the
> >> > plot_tcmpr.R
> >> > >> > > script
> >> > >> > > > > on
> >> > >> > > > > > 'hera', with the following instructions:
> >> > >> > > > > >
> >> > >> > > > > > -------
> >> > >> > > > > > The changes to the plot_tcmpr.R script are now
installed
> on
> >> > >> hera.
> >> > >> > > > > >
> >> > >> > > > > > The user can run the following to access this new
version
> >> of
> >> > >> MET:
> >> > >> > > > > > module use -a /contrib/anaconda/modulefiles
> >> > >> > > > > > module load intel/18.0.5.274
> >> > >> > > > > > module load anaconda/latest
> >> > >> > > > > > module use /contrib/met/modulefiles
> >> > >> > > > > > module load met/10.0.0_test
> >> > >> > > > > >
> >> > >> > > > > > If they are using METplus, they will need to run:
> >> > >> > > > > > module use /contrib/METplus/modulefiles
> >> > >> > > > > > module load metplus/4.0.0
> >> > >> > > > > > module use /contrib/met/modulefiles/
> >> > >> > > > > > module load met/10.0.0_test
> >> > >> > > > > > And they will need to set MET_INSTALL_DIR to
> >> > >> > > /contrib/met/10.0.0_test
> >> > >> > > > in
> >> > >> > > > > > their user config file.
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > If using the METplus wrapper to generate the plots
with
> all
> >> > the
> >> > >> > model
> >> > >> > > > > > points, you will need to turn off event
equalization in
> >> your
> >> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by
setting
> the
> >> > >> > > following:
> >> > >> > > > > >
> >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> >> > >> > > > > >
> >> > >> > > > > > This will disable the event equalization. Your
sample
> data
> >> > >> didn't
> >> > >> > > have
> >> > >> > > > > > any overlapping tracks so no plots were generated
when
> >> event
> >> > >> > > > equalization
> >> > >> > > > > > was enabled. You can leave MODEL unassigned so
that all
> >> > models
> >> > >> > will
> >> > >> > > be
> >> > >> > > > > > used (as long as all your tc-pairs .tcst files are
in the
> >> same
> >> > >> > > > > directory).
> >> > >> > > > > > If you want a subset of models, you can set the
> following:
> >> > >> > > > > >
> >> > >> > > > > > MODEL = GFSO,CMC,EMX
> >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> >> > >> > > > > >
> >> > >> > > > > > to explicitly include only the GFSO, CMC and EMX
models
> (or
> >> > >> > whatever
> >> > >> > > > > > models you wish) on your plots.
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > > Regards,
> >> > >> > > > > > Minna
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > > >
> >> > >> > > > >
> >> > >> > > > >
> >> > >> > > >
> >> > >> > > > --
> >> > >> > > > George McCabe - Software Engineer III
> >> > >> > > > National Center for Atmospheric Research
> >> > >> > > > Research Applications Laboratory
> >> > >> > > > 303-497-2768
> >> > >> > > > ---
> >> > >> > > > My working day may not be your working day. Please do
not
> feel
> >> > >> obliged
> >> > >> > to
> >> > >> > > > reply to this email outside of your normal working
hours.
> >> > >> > > >
> >> > >> > > >
> >> > >> > >
> >> > >> > >
> >> > >> >
> >> > >> > --
> >> > >> > George McCabe - Software Engineer III
> >> > >> > National Center for Atmospheric Research
> >> > >> > Research Applications Laboratory
> >> > >> > 303-497-2768
> >> > >> > ---
> >> > >> > My working day may not be your working day. Please do not
feel
> >> obliged
> >> > >> to
> >> > >> > reply to this email outside of your normal working hours.
> >> > >> >
> >> > >> >
> >> > >>
> >> > >>
> >> > >
> >> > > --
> >> > > George McCabe - Software Engineer III
> >> > > National Center for Atmospheric Research
> >> > > Research Applications Laboratory
> >> > > 303-497-2768
> >> > > ---
> >> > > My working day may not be your working day. Please do not
feel
> >> obliged to
> >> > > reply to this email outside of your normal working hours.
> >> > >
> >> >
> >> >
> >> > --
> >> > George McCabe - Software Engineer III
> >> > National Center for Atmospheric Research
> >> > Research Applications Laboratory
> >> > 303-497-2768
> >> > ---
> >> > My working day may not be your working day. Please do not feel
obliged
> >> to
> >> > reply to this email outside of your normal working hours.
> >> >
> >> >
> >>
> >>
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
>
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Mon Jun 07 09:40:07 2021
Hi Guang Ping,
Could you send me the command you ran that produced errors?
Thanks,
George
On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi George,
>
> I was wondering if you could give me an example of the config files
running
> your new installation with your new label setup. I was getting error
> messages when I ran. I assume your new installation is still
met10.0.0 and
> Metplus-4.0.0.
>
> Thanks a lot!
> Guang Ping
>
> On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > I updated the version of METplus on Hera to include the latest
changes.
> > With this version, you can reference the dep/plot labels for each
run:
> >
> > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > TCMPR_PLOTTER_DEP_LABELS = Track Error
> >
> > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > TCMPR_PLOTTER_XLAB =
> > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> >
> > {dep_label} will be substituted with the value of the
> > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> TCMPR_PLOTTER_DEP_VARS
> > value. The 2 lists should be the same length.
> >
> > You can similarly use {plot_labels} if you set
TCMPR_PLOTTER_PLOT_LABELS.
> >
> > Let me know if you have any issues setting that up.
> >
> > Thanks,
> > George
> >
> > On Thu, May 27, 2021 at 12:56 PM George McCabe <mccabe at ucar.edu>
wrote:
> >
> > > Hi Guang Ping,
> > >
> > > 1.
> > > The image size is controlled by a variable in the TCMPR config
file.
> Here
> > > is the setting that was used in the original that sets it:
> > >
> > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > >
> > > img_res = 72;
> > >
> > > 2.
> > > This is the same issue that Yan ran into on another MET help
ticket. I
> > > provided a work around to change the plot info and filenames for
each
> > > variable. I am modifying TCMPRPlotter to loop over the variables
to run
> > > once for each and add a way to specify the label to use for
each. This
> > > would allow you to use that label in the YLAB value. I can send
you the
> > > updated version to test when that is ready.
> > >
> > > 3.
> > > Yes, if R is not available then the TCMPRPlotter will not work.
The
> > > eventual plan is to migrate the R scripts to Python, but this
may not
> > > happen for a while unless this is needed more urgently.
> > >
> > > Thanks,
> > > George
> > >
> > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA Affiliate via
RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >>
> > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >>
> > >> Hi George,
> > >>
> > >> Thank you so much for making it work!
> > >> I ran your temporary script
> > >>
> > >>
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > >>
> > >> and it was able to generate multiple lines in the same frame.
Please
> > see:
> > >> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > >>
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > >>
> > >>
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > >>
> > >> Now there are some finer points that I would like to ask you:
> > >> 1. The plots become huge if we click the picture to zoom in.
This is
> > true
> > >> when we use the "display" command on Hera or other machines.
> > >> I think the original plots that were generated by the
earlier
> > scripts
> > >> do not have this issue.
> > >> 2. The X-Y labels are all the same. How do we change the label
> according
> > >> to
> > >> the variables?
> > >> In the config file,
> > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > >> TCMPR_PLOTTER_XLAB =
> > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > >> All plots have the same labels assigned above. How can I
assign
> > >> different labels for different variable plots?
> > >> 3. Your new version works on Hera, I am assuming that it will
not work
> > on
> > >> WCOSS because WCOSS does not have the R-library, Am I correct?
> > >> John (Gotway) mentioned that MET is going to use METcalcpy and
> METplotpy
> > >> in
> > >> the future, would this include the cyclone plots?
> > >>
> > >> Sorry that I have so many questions. I deeply appreciate your
help.
> > >>
> > >> Thanks,
> > >> Guang Ping
> > >>
> > >>
> > >>
> > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT <
> > met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> > Hi Guang Ping,
> > >> >
> > >> > I put a version of METplus for you to test using
TCMPRPlotter. To
> use
> > >> this
> > >> > version, run the module commands to set up METplus, then
instead of
> > >> calling
> > >> > run_metplus.py from the path, call the version in my scratch
> > directory,
> > >> > passing in your config files normally.
> > >> >
> > >> >
> > >> >
> > >>
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > >> >
> > >> > I ran using your config file from your previous email and was
able
> to
> > >> view
> > >> > the log output from the R script in the METplus log file. The
first
> > >> attempt
> > >> > failed due to the bug that requires -bmodel to be set, so I
changed
> > the
> > >> > default configuration to use the testing version of MET that
Minna
> and
> > >> > Julie made available on Hera (/contrib/met/10.0.0_test).
Calling
> this
> > >> > version of run_metplus.py will automatically use the test
version of
> > MET
> > >> > unless you are overriding MET_INSTALL_DIR in your config
files.
> > >> >
> > >> > I generated images here:
> > >> > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-
test/tcmpr_plots
> > >> >
> > >> > Please take a look and verify that the output looks correct.
Let me
> > >> know if
> > >> > you have any other questions or issues.
> > >> >
> > >> > Thanks,
> > >> > George
> > >> >
> > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe
<mccabe at ucar.edu>
> > wrote:
> > >> >
> > >> > > Hi Guang Ping,
> > >> > >
> > >> > > I will make some modifications to the wrapper to make it
easier to
> > >> debug
> > >> > > the error, as it is difficult to see what is happening. I
can put
> > the
> > >> > > changes on Hera so you can use that version to test. I will
let
> you
> > >> know
> > >> > > when that is ready.
> > >> > >
> > >> > > Thanks,
> > >> > > George
> > >> > >
> > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA Affiliate
via RT
> <
> > >> > > met_help at ucar.edu> wrote:
> > >> > >
> > >> > >>
> > >> > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >> > >>
> > >> > >> Hi George,
> > >> > >>
> > >> > >> Thanks for your quick response.
> > >> > >> I modified the config file
> > >> > >>
> > >> > >>
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > >> > >> and still got the same error messages:
> > >> > >>
> > >> > >>
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > >> > >>
> > >> > >> In your plot, you plotted only 1 model. What I wanted is
all 3
> > >> models'
> > >> > >> stats be plotted on the same frame.
> > >> > >>
> > >> > >> Thanks again,
> > >> > >> Guang Ping
> > >> > >>
> > >> > >>
> > >> > >>
> > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT <
> > >> met_help at ucar.edu
> > >> > >
> > >> > >> wrote:
> > >> > >>
> > >> > >> > Hi Guang Ping,
> > >> > >> >
> > >> > >> > Sorry, I mistakenly thought the error in the plotter was
due to
> > >> > missing
> > >> > >> > data. It looks like it is failing because it is not
reading the
> > >> > -filter
> > >> > >> > options properly. Please try putting quotation marks
around the
> > >> value
> > >> > >> for
> > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > >> > >> >
> > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > >> > >> >
> > >> > >> > Let me know if that does not work. If not, the wrapper
will
> have
> > >> to be
> > >> > >> > updated to add quotation marks around it. It should
really do
> > this
> > >> > >> > automatically, so I can make that change when I update
the
> > >> wrapper. I
> > >> > >> will
> > >> > >> > also modify it to output the log output and make it
easier to
> > copy
> > >> the
> > >> > >> > Rscript command to rerun it on the command line for
testing
> > >> purposes.
> > >> > I
> > >> > >> was
> > >> > >> > able to get output by running the following command
(using
> only 1
> > >> > input
> > >> > >> > file):
> > >> > >> >
> > >> > >> > Rscript
> /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > >> > -config
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > >> > >> > -title "Extratropical Cyclone Track Error" -subtitle
"Forecast
> > >> Hours"
> > >> > >> -ylab
> > >> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS"
-plot
> > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> > >> > >> >
> > >> > >> > Thanks,
> > >> > >> > George
> > >> > >> >
> > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA
Affiliate via
> > RT <
> > >> > >> > met_help at ucar.edu> wrote:
> > >> > >> >
> > >> > >> > >
> > >> > >> > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > >
> > >> > >> > >
> > >> > >> > > Hi George,
> > >> > >> > >
> > >> > >> > > Thanks for the info. But the plotting is supposed to
follow
> the
> > >> > >> > conversion
> > >> > >> > > from regular pairs to .tcst pairs, which are generated
by the
> > >> > command
> > >> > >> > line.
> > >> > >> > > All the .tcst pairs are in
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > >> > >> > > after the command line:
> > >> > >> > > master_metplus.py -c
Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> -c
> > >> > >> > > usecase_7.conf
> > >> > >> > >
> > >> > >> > > If that is not the case , where should the path be
specified?
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > >> > >> > >
> > >> > >> > > Thanks,
> > >> > >> > > Guang Ping
> > >> > >> > >
> > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT <
> > >> > >> met_help at ucar.edu>
> > >> > >> > > wrote:
> > >> > >> > >
> > >> > >> > > > Hi Guang Ping,
> > >> > >> > > >
> > >> > >> > > > This error is due to a bug in the logic to report an
error
> in
> > >> the
> > >> > >> > > wrapper.
> > >> > >> > > > This error is most likely happening because the
input files
> > >> passed
> > >> > >> to
> > >> > >> > the
> > >> > >> > > > plotter are empty. You will need to change the
> configuration
> > of
> > >> > >> TCPairs
> > >> > >> > > to
> > >> > >> > > > get output lines. The error will go away if there is
data
> > >> > available
> > >> > >> to
> > >> > >> > > > process.
> > >> > >> > > >
> > >> > >> > > > - George
> > >> > >> > > >
> > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA
Affiliate
> > via
> > >> > RT <
> > >> > >> > > > met_help at ucar.edu> wrote:
> > >> > >> > > >
> > >> > >> > > > >
> > >> > >> > > > > <URL:
> > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >> > >> > > > >
> > >> > >> > > > > Hi Minna,
> > >> > >> > > > >
> > >> > >> > > > > Thanks for the update. I followed your suggestion
and
> there
> > >> was
> > >> > an
> > >> > >> > > error
> > >> > >> > > > > that says:
> > >> > >> > > > >
> > >> >
------------------------------------------------------------------
> > >> > >> > > > > File
> > >> > "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
> > >> > >> > line
> > >> > >> > > > 159,
> > >> > >> > > > > in run_metplus
> > >> > >> > > > > new_commands = process.run_all_times()
> > >> > >> > > > > File
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > >> > >> > > > > line 261, in run_all_times
> > >> > >> > > > > except produtil.run.ExitStatusException as
ese:
> > >> > >> > > > > NameError: name 'produtil' is not defined
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
>
---------------------------------------------------------------------------
> > >> > >> > > > >
> > >> > >> > > > > I looked up modules that related to the produtil,
but
> could
> > >> not
> > >> > >> find
> > >> > >> > > any.
> > >> > >> > > > > here is the Hera:
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> >
> > >> > >>
> > >> >
> > >>
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > >> > >> > > > > my line command is:
> > >> > >> > > > > master_metplus.py -c
> > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > >> > >> > > > > usecase_7.conf
> > >> > >> > > > >
> > >> > >> > > > > Thanks,
> > >> > >> > > > > Guang Ping
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT <
> > >> > >> met_help at ucar.edu>
> > >> > >> > > > > wrote:
> > >> > >> > > > >
> > >> > >> > > > > > Hello Guang Ping,
> > >> > >> > > > > >
> > >> > >> > > > > > Julie has successfully installed the changes to
the
> > >> > plot_tcmpr.R
> > >> > >> > > script
> > >> > >> > > > > on
> > >> > >> > > > > > 'hera', with the following instructions:
> > >> > >> > > > > >
> > >> > >> > > > > > -------
> > >> > >> > > > > > The changes to the plot_tcmpr.R script are now
> installed
> > on
> > >> > >> hera.
> > >> > >> > > > > >
> > >> > >> > > > > > The user can run the following to access this
new
> version
> > >> of
> > >> > >> MET:
> > >> > >> > > > > > module use -a /contrib/anaconda/modulefiles
> > >> > >> > > > > > module load intel/18.0.5.274
> > >> > >> > > > > > module load anaconda/latest
> > >> > >> > > > > > module use /contrib/met/modulefiles
> > >> > >> > > > > > module load met/10.0.0_test
> > >> > >> > > > > >
> > >> > >> > > > > > If they are using METplus, they will need to
run:
> > >> > >> > > > > > module use /contrib/METplus/modulefiles
> > >> > >> > > > > > module load metplus/4.0.0
> > >> > >> > > > > > module use /contrib/met/modulefiles/
> > >> > >> > > > > > module load met/10.0.0_test
> > >> > >> > > > > > And they will need to set MET_INSTALL_DIR to
> > >> > >> > > /contrib/met/10.0.0_test
> > >> > >> > > > in
> > >> > >> > > > > > their user config file.
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > If using the METplus wrapper to generate the
plots with
> > all
> > >> > the
> > >> > >> > model
> > >> > >> > > > > > points, you will need to turn off event
equalization in
> > >> your
> > >> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file by
setting
> > the
> > >> > >> > > following:
> > >> > >> > > > > >
> > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > >> > >> > > > > >
> > >> > >> > > > > > This will disable the event equalization. Your
sample
> > data
> > >> > >> didn't
> > >> > >> > > have
> > >> > >> > > > > > any overlapping tracks so no plots were
generated when
> > >> event
> > >> > >> > > > equalization
> > >> > >> > > > > > was enabled. You can leave MODEL unassigned so
that
> all
> > >> > models
> > >> > >> > will
> > >> > >> > > be
> > >> > >> > > > > > used (as long as all your tc-pairs .tcst files
are in
> the
> > >> same
> > >> > >> > > > > directory).
> > >> > >> > > > > > If you want a subset of models, you can set the
> > following:
> > >> > >> > > > > >
> > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > >> > >> > > > > >
> > >> > >> > > > > > to explicitly include only the GFSO, CMC and EMX
models
> > (or
> > >> > >> > whatever
> > >> > >> > > > > > models you wish) on your plots.
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > > Regards,
> > >> > >> > > > > > Minna
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > > >
> > >> > >> > > > >
> > >> > >> > > > >
> > >> > >> > > >
> > >> > >> > > > --
> > >> > >> > > > George McCabe - Software Engineer III
> > >> > >> > > > National Center for Atmospheric Research
> > >> > >> > > > Research Applications Laboratory
> > >> > >> > > > 303-497-2768
> > >> > >> > > > ---
> > >> > >> > > > My working day may not be your working day. Please
do not
> > feel
> > >> > >> obliged
> > >> > >> > to
> > >> > >> > > > reply to this email outside of your normal working
hours.
> > >> > >> > > >
> > >> > >> > > >
> > >> > >> > >
> > >> > >> > >
> > >> > >> >
> > >> > >> > --
> > >> > >> > George McCabe - Software Engineer III
> > >> > >> > National Center for Atmospheric Research
> > >> > >> > Research Applications Laboratory
> > >> > >> > 303-497-2768
> > >> > >> > ---
> > >> > >> > My working day may not be your working day. Please do
not feel
> > >> obliged
> > >> > >> to
> > >> > >> > reply to this email outside of your normal working
hours.
> > >> > >> >
> > >> > >> >
> > >> > >>
> > >> > >>
> > >> > >
> > >> > > --
> > >> > > George McCabe - Software Engineer III
> > >> > > National Center for Atmospheric Research
> > >> > > Research Applications Laboratory
> > >> > > 303-497-2768
> > >> > > ---
> > >> > > My working day may not be your working day. Please do not
feel
> > >> obliged to
> > >> > > reply to this email outside of your normal working hours.
> > >> > >
> > >> >
> > >> >
> > >> > --
> > >> > George McCabe - Software Engineer III
> > >> > National Center for Atmospheric Research
> > >> > Research Applications Laboratory
> > >> > 303-497-2768
> > >> > ---
> > >> > My working day may not be your working day. Please do not
feel
> obliged
> > >> to
> > >> > reply to this email outside of your normal working hours.
> > >> >
> > >> >
> > >>
> > >>
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Mon Jun 07 09:51:39 2021
Hi George,
The run directory is on Hera:
/scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test_george2
Line command:
run_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c
usecase_8.conf
Thanks,
Guang Ping
On Mon, Jun 7, 2021 at 11:40 AM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> Could you send me the command you ran that produced errors?
>
> Thanks,
> George
>
> On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi George,
> >
> > I was wondering if you could give me an example of the config
files
> running
> > your new installation with your new label setup. I was getting
error
> > messages when I ran. I assume your new installation is still
met10.0.0
> and
> > Metplus-4.0.0.
> >
> > Thanks a lot!
> > Guang Ping
> >
> > On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Guang Ping,
> > >
> > > I updated the version of METplus on Hera to include the latest
changes.
> > > With this version, you can reference the dep/plot labels for
each run:
> > >
> > > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > > TCMPR_PLOTTER_DEP_LABELS = Track Error
> > >
> > > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> > > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > TCMPR_PLOTTER_XLAB =
> > > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> > >
> > > {dep_label} will be substituted with the value of the
> > > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> > TCMPR_PLOTTER_DEP_VARS
> > > value. The 2 lists should be the same length.
> > >
> > > You can similarly use {plot_labels} if you set
> TCMPR_PLOTTER_PLOT_LABELS.
> > >
> > > Let me know if you have any issues setting that up.
> > >
> > > Thanks,
> > > George
> > >
> > > On Thu, May 27, 2021 at 12:56 PM George McCabe <mccabe at ucar.edu>
> wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > 1.
> > > > The image size is controlled by a variable in the TCMPR config
file.
> > Here
> > > > is the setting that was used in the original that sets it:
> > > >
> > > >
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > > >
> > > > img_res = 72;
> > > >
> > > > 2.
> > > > This is the same issue that Yan ran into on another MET help
ticket.
> I
> > > > provided a work around to change the plot info and filenames
for each
> > > > variable. I am modifying TCMPRPlotter to loop over the
variables to
> run
> > > > once for each and add a way to specify the label to use for
each.
> This
> > > > would allow you to use that label in the YLAB value. I can
send you
> the
> > > > updated version to test when that is ready.
> > > >
> > > > 3.
> > > > Yes, if R is not available then the TCMPRPlotter will not
work. The
> > > > eventual plan is to migrate the R scripts to Python, but this
may not
> > > > happen for a while unless this is needed more urgently.
> > > >
> > > > Thanks,
> > > > George
> > > >
> > > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA Affiliate
via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >>
> > > >> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> > > >>
> > > >> Hi George,
> > > >>
> > > >> Thank you so much for making it work!
> > > >> I ran your temporary script
> > > >>
> > > >>
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > >>
> > > >> and it was able to generate multiple lines in the same frame.
Please
> > > see:
> > > >>
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > > >>
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > > >>
> > > >>
> > >
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > > >>
> > > >> Now there are some finer points that I would like to ask you:
> > > >> 1. The plots become huge if we click the picture to zoom in.
This is
> > > true
> > > >> when we use the "display" command on Hera or other machines.
> > > >> I think the original plots that were generated by the
earlier
> > > scripts
> > > >> do not have this issue.
> > > >> 2. The X-Y labels are all the same. How do we change the
label
> > according
> > > >> to
> > > >> the variables?
> > > >> In the config file,
> > > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> > > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > >> TCMPR_PLOTTER_XLAB =
> > > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > > >> All plots have the same labels assigned above. How can I
assign
> > > >> different labels for different variable plots?
> > > >> 3. Your new version works on Hera, I am assuming that it will
not
> work
> > > on
> > > >> WCOSS because WCOSS does not have the R-library, Am I
correct?
> > > >> John (Gotway) mentioned that MET is going to use METcalcpy
and
> > METplotpy
> > > >> in
> > > >> the future, would this include the cyclone plots?
> > > >>
> > > >> Sorry that I have so many questions. I deeply appreciate
your help.
> > > >>
> > > >> Thanks,
> > > >> Guang Ping
> > > >>
> > > >>
> > > >>
> > > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT <
> > > met_help at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> > Hi Guang Ping,
> > > >> >
> > > >> > I put a version of METplus for you to test using
TCMPRPlotter. To
> > use
> > > >> this
> > > >> > version, run the module commands to set up METplus, then
instead
> of
> > > >> calling
> > > >> > run_metplus.py from the path, call the version in my
scratch
> > > directory,
> > > >> > passing in your config files normally.
> > > >> >
> > > >> >
> > > >> >
> > > >>
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > >> >
> > > >> > I ran using your config file from your previous email and
was able
> > to
> > > >> view
> > > >> > the log output from the R script in the METplus log file.
The
> first
> > > >> attempt
> > > >> > failed due to the bug that requires -bmodel to be set, so I
> changed
> > > the
> > > >> > default configuration to use the testing version of MET
that Minna
> > and
> > > >> > Julie made available on Hera (/contrib/met/10.0.0_test).
Calling
> > this
> > > >> > version of run_metplus.py will automatically use the test
version
> of
> > > MET
> > > >> > unless you are overriding MET_INSTALL_DIR in your config
files.
> > > >> >
> > > >> > I generated images here:
> > > >> > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-
test/tcmpr_plots
> > > >> >
> > > >> > Please take a look and verify that the output looks
correct. Let
> me
> > > >> know if
> > > >> > you have any other questions or issues.
> > > >> >
> > > >> > Thanks,
> > > >> > George
> > > >> >
> > > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe
<mccabe at ucar.edu>
> > > wrote:
> > > >> >
> > > >> > > Hi Guang Ping,
> > > >> > >
> > > >> > > I will make some modifications to the wrapper to make it
easier
> to
> > > >> debug
> > > >> > > the error, as it is difficult to see what is happening. I
can
> put
> > > the
> > > >> > > changes on Hera so you can use that version to test. I
will let
> > you
> > > >> know
> > > >> > > when that is ready.
> > > >> > >
> > > >> > > Thanks,
> > > >> > > George
> > > >> > >
> > > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA
Affiliate via
> RT
> > <
> > > >> > > met_help at ucar.edu> wrote:
> > > >> > >
> > > >> > >>
> > > >> > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> > > >> > >>
> > > >> > >> Hi George,
> > > >> > >>
> > > >> > >> Thanks for your quick response.
> > > >> > >> I modified the config file
> > > >> > >>
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > >> > >> and still got the same error messages:
> > > >> > >>
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > > >> > >>
> > > >> > >> In your plot, you plotted only 1 model. What I wanted is
all 3
> > > >> models'
> > > >> > >> stats be plotted on the same frame.
> > > >> > >>
> > > >> > >> Thanks again,
> > > >> > >> Guang Ping
> > > >> > >>
> > > >> > >>
> > > >> > >>
> > > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT <
> > > >> met_help at ucar.edu
> > > >> > >
> > > >> > >> wrote:
> > > >> > >>
> > > >> > >> > Hi Guang Ping,
> > > >> > >> >
> > > >> > >> > Sorry, I mistakenly thought the error in the plotter
was due
> to
> > > >> > missing
> > > >> > >> > data. It looks like it is failing because it is not
reading
> the
> > > >> > -filter
> > > >> > >> > options properly. Please try putting quotation marks
around
> the
> > > >> value
> > > >> > >> for
> > > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > > >> > >> >
> > > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > >> > >> >
> > > >> > >> > Let me know if that does not work. If not, the wrapper
will
> > have
> > > >> to be
> > > >> > >> > updated to add quotation marks around it. It should
really do
> > > this
> > > >> > >> > automatically, so I can make that change when I update
the
> > > >> wrapper. I
> > > >> > >> will
> > > >> > >> > also modify it to output the log output and make it
easier to
> > > copy
> > > >> the
> > > >> > >> > Rscript command to rerun it on the command line for
testing
> > > >> purposes.
> > > >> > I
> > > >> > >> was
> > > >> > >> > able to get output by running the following command
(using
> > only 1
> > > >> > input
> > > >> > >> > file):
> > > >> > >> >
> > > >> > >> > Rscript
> > /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > > >> > -config
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > > >> > >> > -title "Extratropical Cyclone Track Error" -subtitle
> "Forecast
> > > >> Hours"
> > > >> > >> -ylab
> > > >> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC" -dep
> > > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS"
-plot
> > > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> > > >> > >> >
> > > >> > >> > Thanks,
> > > >> > >> > George
> > > >> > >> >
> > > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA
Affiliate
> via
> > > RT <
> > > >> > >> > met_help at ucar.edu> wrote:
> > > >> > >> >
> > > >> > >> > >
> > > >> > >> > > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > >
> > > >> > >> > >
> > > >> > >> > > Hi George,
> > > >> > >> > >
> > > >> > >> > > Thanks for the info. But the plotting is supposed to
follow
> > the
> > > >> > >> > conversion
> > > >> > >> > > from regular pairs to .tcst pairs, which are
generated by
> the
> > > >> > command
> > > >> > >> > line.
> > > >> > >> > > All the .tcst pairs are in
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > >> > >> > > after the command line:
> > > >> > >> > > master_metplus.py -c
> Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > -c
> > > >> > >> > > usecase_7.conf
> > > >> > >> > >
> > > >> > >> > > If that is not the case , where should the path be
> specified?
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > > >> > >> > >
> > > >> > >> > > Thanks,
> > > >> > >> > > Guang Ping
> > > >> > >> > >
> > > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via RT
<
> > > >> > >> met_help at ucar.edu>
> > > >> > >> > > wrote:
> > > >> > >> > >
> > > >> > >> > > > Hi Guang Ping,
> > > >> > >> > > >
> > > >> > >> > > > This error is due to a bug in the logic to report
an
> error
> > in
> > > >> the
> > > >> > >> > > wrapper.
> > > >> > >> > > > This error is most likely happening because the
input
> files
> > > >> passed
> > > >> > >> to
> > > >> > >> > the
> > > >> > >> > > > plotter are empty. You will need to change the
> > configuration
> > > of
> > > >> > >> TCPairs
> > > >> > >> > > to
> > > >> > >> > > > get output lines. The error will go away if there
is data
> > > >> > available
> > > >> > >> to
> > > >> > >> > > > process.
> > > >> > >> > > >
> > > >> > >> > > > - George
> > > >> > >> > > >
> > > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou - NOAA
> Affiliate
> > > via
> > > >> > RT <
> > > >> > >> > > > met_help at ucar.edu> wrote:
> > > >> > >> > > >
> > > >> > >> > > > >
> > > >> > >> > > > > <URL:
> > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > >> > >> > > > >
> > > >> > >> > > > > Hi Minna,
> > > >> > >> > > > >
> > > >> > >> > > > > Thanks for the update. I followed your
suggestion and
> > there
> > > >> was
> > > >> > an
> > > >> > >> > > error
> > > >> > >> > > > > that says:
> > > >> > >> > > > >
> > > >> >
------------------------------------------------------------------
> > > >> > >> > > > > File
> > > >> > "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
> > > >> > >> > line
> > > >> > >> > > > 159,
> > > >> > >> > > > > in run_metplus
> > > >> > >> > > > > new_commands = process.run_all_times()
> > > >> > >> > > > > File
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > >> > >> > > > > line 261, in run_all_times
> > > >> > >> > > > > except produtil.run.ExitStatusException as
ese:
> > > >> > >> > > > > NameError: name 'produtil' is not defined
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
>
---------------------------------------------------------------------------
> > > >> > >> > > > >
> > > >> > >> > > > > I looked up modules that related to the
produtil, but
> > could
> > > >> not
> > > >> > >> find
> > > >> > >> > > any.
> > > >> > >> > > > > here is the Hera:
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >>
> > > >> >
> > > >>
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > >> > >> > > > > my line command is:
> > > >> > >> > > > > master_metplus.py -c
> > > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > >> > >> > > > > usecase_7.conf
> > > >> > >> > > > >
> > > >> > >> > > > > Thanks,
> > > >> > >> > > > > Guang Ping
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via RT
<
> > > >> > >> met_help at ucar.edu>
> > > >> > >> > > > > wrote:
> > > >> > >> > > > >
> > > >> > >> > > > > > Hello Guang Ping,
> > > >> > >> > > > > >
> > > >> > >> > > > > > Julie has successfully installed the changes
to the
> > > >> > plot_tcmpr.R
> > > >> > >> > > script
> > > >> > >> > > > > on
> > > >> > >> > > > > > 'hera', with the following instructions:
> > > >> > >> > > > > >
> > > >> > >> > > > > > -------
> > > >> > >> > > > > > The changes to the plot_tcmpr.R script are now
> > installed
> > > on
> > > >> > >> hera.
> > > >> > >> > > > > >
> > > >> > >> > > > > > The user can run the following to access this
new
> > version
> > > >> of
> > > >> > >> MET:
> > > >> > >> > > > > > module use -a /contrib/anaconda/modulefiles
> > > >> > >> > > > > > module load intel/18.0.5.274
> > > >> > >> > > > > > module load anaconda/latest
> > > >> > >> > > > > > module use /contrib/met/modulefiles
> > > >> > >> > > > > > module load met/10.0.0_test
> > > >> > >> > > > > >
> > > >> > >> > > > > > If they are using METplus, they will need to
run:
> > > >> > >> > > > > > module use /contrib/METplus/modulefiles
> > > >> > >> > > > > > module load metplus/4.0.0
> > > >> > >> > > > > > module use /contrib/met/modulefiles/
> > > >> > >> > > > > > module load met/10.0.0_test
> > > >> > >> > > > > > And they will need to set MET_INSTALL_DIR to
> > > >> > >> > > /contrib/met/10.0.0_test
> > > >> > >> > > > in
> > > >> > >> > > > > > their user config file.
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > If using the METplus wrapper to generate the
plots
> with
> > > all
> > > >> > the
> > > >> > >> > model
> > > >> > >> > > > > > points, you will need to turn off event
equalization
> in
> > > >> your
> > > >> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file
by
> setting
> > > the
> > > >> > >> > > following:
> > > >> > >> > > > > >
> > > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > >> > >> > > > > >
> > > >> > >> > > > > > This will disable the event equalization.
Your
> sample
> > > data
> > > >> > >> didn't
> > > >> > >> > > have
> > > >> > >> > > > > > any overlapping tracks so no plots were
generated
> when
> > > >> event
> > > >> > >> > > > equalization
> > > >> > >> > > > > > was enabled. You can leave MODEL unassigned
so that
> > all
> > > >> > models
> > > >> > >> > will
> > > >> > >> > > be
> > > >> > >> > > > > > used (as long as all your tc-pairs .tcst files
are in
> > the
> > > >> same
> > > >> > >> > > > > directory).
> > > >> > >> > > > > > If you want a subset of models, you can set
the
> > > following:
> > > >> > >> > > > > >
> > > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > > >> > >> > > > > >
> > > >> > >> > > > > > to explicitly include only the GFSO, CMC and
EMX
> models
> > > (or
> > > >> > >> > whatever
> > > >> > >> > > > > > models you wish) on your plots.
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > > Regards,
> > > >> > >> > > > > > Minna
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > > >
> > > >> > >> > > > >
> > > >> > >> > > > >
> > > >> > >> > > >
> > > >> > >> > > > --
> > > >> > >> > > > George McCabe - Software Engineer III
> > > >> > >> > > > National Center for Atmospheric Research
> > > >> > >> > > > Research Applications Laboratory
> > > >> > >> > > > 303-497-2768
> > > >> > >> > > > ---
> > > >> > >> > > > My working day may not be your working day. Please
do not
> > > feel
> > > >> > >> obliged
> > > >> > >> > to
> > > >> > >> > > > reply to this email outside of your normal working
hours.
> > > >> > >> > > >
> > > >> > >> > > >
> > > >> > >> > >
> > > >> > >> > >
> > > >> > >> >
> > > >> > >> > --
> > > >> > >> > George McCabe - Software Engineer III
> > > >> > >> > National Center for Atmospheric Research
> > > >> > >> > Research Applications Laboratory
> > > >> > >> > 303-497-2768
> > > >> > >> > ---
> > > >> > >> > My working day may not be your working day. Please do
not
> feel
> > > >> obliged
> > > >> > >> to
> > > >> > >> > reply to this email outside of your normal working
hours.
> > > >> > >> >
> > > >> > >> >
> > > >> > >>
> > > >> > >>
> > > >> > >
> > > >> > > --
> > > >> > > George McCabe - Software Engineer III
> > > >> > > National Center for Atmospheric Research
> > > >> > > Research Applications Laboratory
> > > >> > > 303-497-2768
> > > >> > > ---
> > > >> > > My working day may not be your working day. Please do not
feel
> > > >> obliged to
> > > >> > > reply to this email outside of your normal working hours.
> > > >> > >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > George McCabe - Software Engineer III
> > > >> > National Center for Atmospheric Research
> > > >> > Research Applications Laboratory
> > > >> > 303-497-2768
> > > >> > ---
> > > >> > My working day may not be your working day. Please do not
feel
> > obliged
> > > >> to
> > > >> > reply to this email outside of your normal working hours.
> > > >> >
> > > >> >
> > > >>
> > > >>
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Mon Jun 07 11:23:09 2021
Hi Guang Ping,
Looking at your log output, it looks like you are not using the
version of
METplus from my scratch directory that has the changes needed to run
with
the new settings. Instead of running run_metplus.py from the path, run
it
from:
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
- George
On Mon, Jun 7, 2021 at 9:52 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi George,
>
> The run directory is on Hera:
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> Line command:
> run_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c
> usecase_8.conf
>
> Thanks,
> Guang Ping
>
> On Mon, Jun 7, 2021 at 11:40 AM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > Could you send me the command you ran that produced errors?
> >
> > Thanks,
> > George
> >
> > On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi George,
> > >
> > > I was wondering if you could give me an example of the config
files
> > running
> > > your new installation with your new label setup. I was getting
error
> > > messages when I ran. I assume your new installation is still
met10.0.0
> > and
> > > Metplus-4.0.0.
> > >
> > > Thanks a lot!
> > > Guang Ping
> > >
> > > On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > I updated the version of METplus on Hera to include the latest
> changes.
> > > > With this version, you can reference the dep/plot labels for
each
> run:
> > > >
> > > > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > > > TCMPR_PLOTTER_DEP_LABELS = Track Error
> > > >
> > > > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> > > > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > TCMPR_PLOTTER_XLAB =
> > > > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> > > >
> > > > {dep_label} will be substituted with the value of the
> > > > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> > > TCMPR_PLOTTER_DEP_VARS
> > > > value. The 2 lists should be the same length.
> > > >
> > > > You can similarly use {plot_labels} if you set
> > TCMPR_PLOTTER_PLOT_LABELS.
> > > >
> > > > Let me know if you have any issues setting that up.
> > > >
> > > > Thanks,
> > > > George
> > > >
> > > > On Thu, May 27, 2021 at 12:56 PM George McCabe
<mccabe at ucar.edu>
> > wrote:
> > > >
> > > > > Hi Guang Ping,
> > > > >
> > > > > 1.
> > > > > The image size is controlled by a variable in the TCMPR
config
> file.
> > > Here
> > > > > is the setting that was used in the original that sets it:
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > > > >
> > > > > img_res = 72;
> > > > >
> > > > > 2.
> > > > > This is the same issue that Yan ran into on another MET help
> ticket.
> > I
> > > > > provided a work around to change the plot info and filenames
for
> each
> > > > > variable. I am modifying TCMPRPlotter to loop over the
variables to
> > run
> > > > > once for each and add a way to specify the label to use for
each.
> > This
> > > > > would allow you to use that label in the YLAB value. I can
send you
> > the
> > > > > updated version to test when that is ready.
> > > > >
> > > > > 3.
> > > > > Yes, if R is not available then the TCMPRPlotter will not
work. The
> > > > > eventual plan is to migrate the R scripts to Python, but
this may
> not
> > > > > happen for a while unless this is needed more urgently.
> > > > >
> > > > > Thanks,
> > > > > George
> > > > >
> > > > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA Affiliate
via RT
> <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >>
> > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > >>
> > > > >> Hi George,
> > > > >>
> > > > >> Thank you so much for making it work!
> > > > >> I ran your temporary script
> > > > >>
> > > > >>
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > >>
> > > > >> and it was able to generate multiple lines in the same
frame.
> Please
> > > > see:
> > > > >>
> > https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > > > >>
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > > > >>
> > > > >>
> > > >
> > >
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > > > >>
> > > > >> Now there are some finer points that I would like to ask
you:
> > > > >> 1. The plots become huge if we click the picture to zoom
in. This
> is
> > > > true
> > > > >> when we use the "display" command on Hera or other
machines.
> > > > >> I think the original plots that were generated by the
earlier
> > > > scripts
> > > > >> do not have this issue.
> > > > >> 2. The X-Y labels are all the same. How do we change the
label
> > > according
> > > > >> to
> > > > >> the variables?
> > > > >> In the config file,
> > > > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> > > > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > >> TCMPR_PLOTTER_XLAB =
> > > > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > > > >> All plots have the same labels assigned above. How can
I
> assign
> > > > >> different labels for different variable plots?
> > > > >> 3. Your new version works on Hera, I am assuming that it
will not
> > work
> > > > on
> > > > >> WCOSS because WCOSS does not have the R-library, Am I
correct?
> > > > >> John (Gotway) mentioned that MET is going to use METcalcpy
and
> > > METplotpy
> > > > >> in
> > > > >> the future, would this include the cyclone plots?
> > > > >>
> > > > >> Sorry that I have so many questions. I deeply appreciate
your
> help.
> > > > >>
> > > > >> Thanks,
> > > > >> Guang Ping
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT <
> > > > met_help at ucar.edu>
> > > > >> wrote:
> > > > >>
> > > > >> > Hi Guang Ping,
> > > > >> >
> > > > >> > I put a version of METplus for you to test using
TCMPRPlotter.
> To
> > > use
> > > > >> this
> > > > >> > version, run the module commands to set up METplus, then
instead
> > of
> > > > >> calling
> > > > >> > run_metplus.py from the path, call the version in my
scratch
> > > > directory,
> > > > >> > passing in your config files normally.
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > >> >
> > > > >> > I ran using your config file from your previous email and
was
> able
> > > to
> > > > >> view
> > > > >> > the log output from the R script in the METplus log file.
The
> > first
> > > > >> attempt
> > > > >> > failed due to the bug that requires -bmodel to be set, so
I
> > changed
> > > > the
> > > > >> > default configuration to use the testing version of MET
that
> Minna
> > > and
> > > > >> > Julie made available on Hera (/contrib/met/10.0.0_test).
Calling
> > > this
> > > > >> > version of run_metplus.py will automatically use the test
> version
> > of
> > > > MET
> > > > >> > unless you are overriding MET_INSTALL_DIR in your config
files.
> > > > >> >
> > > > >> > I generated images here:
> > > > >> >
> /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-test/tcmpr_plots
> > > > >> >
> > > > >> > Please take a look and verify that the output looks
correct. Let
> > me
> > > > >> know if
> > > > >> > you have any other questions or issues.
> > > > >> >
> > > > >> > Thanks,
> > > > >> > George
> > > > >> >
> > > > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe
<mccabe at ucar.edu>
> > > > wrote:
> > > > >> >
> > > > >> > > Hi Guang Ping,
> > > > >> > >
> > > > >> > > I will make some modifications to the wrapper to make
it
> easier
> > to
> > > > >> debug
> > > > >> > > the error, as it is difficult to see what is happening.
I can
> > put
> > > > the
> > > > >> > > changes on Hera so you can use that version to test. I
will
> let
> > > you
> > > > >> know
> > > > >> > > when that is ready.
> > > > >> > >
> > > > >> > > Thanks,
> > > > >> > > George
> > > > >> > >
> > > > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA
Affiliate via
> > RT
> > > <
> > > > >> > > met_help at ucar.edu> wrote:
> > > > >> > >
> > > > >> > >>
> > > > >> > >> <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > >
> > > > >> > >>
> > > > >> > >> Hi George,
> > > > >> > >>
> > > > >> > >> Thanks for your quick response.
> > > > >> > >> I modified the config file
> > > > >> > >>
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > >> > >> and still got the same error messages:
> > > > >> > >>
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > > > >> > >>
> > > > >> > >> In your plot, you plotted only 1 model. What I wanted
is all
> 3
> > > > >> models'
> > > > >> > >> stats be plotted on the same frame.
> > > > >> > >>
> > > > >> > >> Thanks again,
> > > > >> > >> Guang Ping
> > > > >> > >>
> > > > >> > >>
> > > > >> > >>
> > > > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT <
> > > > >> met_help at ucar.edu
> > > > >> > >
> > > > >> > >> wrote:
> > > > >> > >>
> > > > >> > >> > Hi Guang Ping,
> > > > >> > >> >
> > > > >> > >> > Sorry, I mistakenly thought the error in the plotter
was
> due
> > to
> > > > >> > missing
> > > > >> > >> > data. It looks like it is failing because it is not
reading
> > the
> > > > >> > -filter
> > > > >> > >> > options properly. Please try putting quotation marks
around
> > the
> > > > >> value
> > > > >> > >> for
> > > > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > > > >> > >> >
> > > > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > >> > >> >
> > > > >> > >> > Let me know if that does not work. If not, the
wrapper will
> > > have
> > > > >> to be
> > > > >> > >> > updated to add quotation marks around it. It should
really
> do
> > > > this
> > > > >> > >> > automatically, so I can make that change when I
update the
> > > > >> wrapper. I
> > > > >> > >> will
> > > > >> > >> > also modify it to output the log output and make it
easier
> to
> > > > copy
> > > > >> the
> > > > >> > >> > Rscript command to rerun it on the command line for
testing
> > > > >> purposes.
> > > > >> > I
> > > > >> > >> was
> > > > >> > >> > able to get output by running the following command
(using
> > > only 1
> > > > >> > input
> > > > >> > >> > file):
> > > > >> > >> >
> > > > >> > >> > Rscript
> > > /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > > > >> > -config
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > > > >> > >> > -title "Extratropical Cyclone Track Error" -subtitle
> > "Forecast
> > > > >> Hours"
> > > > >> > >> -ylab
> > > > >> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC"
-dep
> > > > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend "GFS"
-plot
> > > > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > > > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> > > > >> > >> >
> > > > >> > >> > Thanks,
> > > > >> > >> > George
> > > > >> > >> >
> > > > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA
Affiliate
> > via
> > > > RT <
> > > > >> > >> > met_help at ucar.edu> wrote:
> > > > >> > >> >
> > > > >> > >> > >
> > > > >> > >> > > <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > >
> > > > >> > >> > >
> > > > >> > >> > > Hi George,
> > > > >> > >> > >
> > > > >> > >> > > Thanks for the info. But the plotting is supposed
to
> follow
> > > the
> > > > >> > >> > conversion
> > > > >> > >> > > from regular pairs to .tcst pairs, which are
generated by
> > the
> > > > >> > command
> > > > >> > >> > line.
> > > > >> > >> > > All the .tcst pairs are in
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > > >> > >> > > after the command line:
> > > > >> > >> > > master_metplus.py -c
> > Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > -c
> > > > >> > >> > > usecase_7.conf
> > > > >> > >> > >
> > > > >> > >> > > If that is not the case , where should the path be
> > specified?
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > > > >> > >> > >
> > > > >> > >> > > Thanks,
> > > > >> > >> > > Guang Ping
> > > > >> > >> > >
> > > > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe via
RT <
> > > > >> > >> met_help at ucar.edu>
> > > > >> > >> > > wrote:
> > > > >> > >> > >
> > > > >> > >> > > > Hi Guang Ping,
> > > > >> > >> > > >
> > > > >> > >> > > > This error is due to a bug in the logic to
report an
> > error
> > > in
> > > > >> the
> > > > >> > >> > > wrapper.
> > > > >> > >> > > > This error is most likely happening because the
input
> > files
> > > > >> passed
> > > > >> > >> to
> > > > >> > >> > the
> > > > >> > >> > > > plotter are empty. You will need to change the
> > > configuration
> > > > of
> > > > >> > >> TCPairs
> > > > >> > >> > > to
> > > > >> > >> > > > get output lines. The error will go away if
there is
> data
> > > > >> > available
> > > > >> > >> to
> > > > >> > >> > > > process.
> > > > >> > >> > > >
> > > > >> > >> > > > - George
> > > > >> > >> > > >
> > > > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou -
NOAA
> > Affiliate
> > > > via
> > > > >> > RT <
> > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > > >> > >> > > >
> > > > >> > >> > > > >
> > > > >> > >> > > > > <URL:
> > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > >> > >> > > > >
> > > > >> > >> > > > > Hi Minna,
> > > > >> > >> > > > >
> > > > >> > >> > > > > Thanks for the update. I followed your
suggestion and
> > > there
> > > > >> was
> > > > >> > an
> > > > >> > >> > > error
> > > > >> > >> > > > > that says:
> > > > >> > >> > > > >
> > > > >> >
> ------------------------------------------------------------------
> > > > >> > >> > > > > File
> > > > >> > "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
> > > > >> > >> > line
> > > > >> > >> > > > 159,
> > > > >> > >> > > > > in run_metplus
> > > > >> > >> > > > > new_commands = process.run_all_times()
> > > > >> > >> > > > > File
> > > > >> > >> > > > >
> > > > >> > >> > > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > >> > >> > > > > line 261, in run_all_times
> > > > >> > >> > > > > except produtil.run.ExitStatusException as
ese:
> > > > >> > >> > > > > NameError: name 'produtil' is not defined
> > > > >> > >> > > > >
> > > > >> > >> > > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > > >> > >> > > > >
> > > > >> > >> > > > > I looked up modules that related to the
produtil, but
> > > could
> > > > >> not
> > > > >> > >> find
> > > > >> > >> > > any.
> > > > >> > >> > > > > here is the Hera:
> > > > >> > >> > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >>
> > > > >> >
> > > > >>
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > >> > >> > > > > my line command is:
> > > > >> > >> > > > > master_metplus.py -c
> > > > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > > >> > >> > > > > usecase_7.conf
> > > > >> > >> > > > >
> > > > >> > >> > > > > Thanks,
> > > > >> > >> > > > > Guang Ping
> > > > >> > >> > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win via
RT <
> > > > >> > >> met_help at ucar.edu>
> > > > >> > >> > > > > wrote:
> > > > >> > >> > > > >
> > > > >> > >> > > > > > Hello Guang Ping,
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > Julie has successfully installed the changes
to the
> > > > >> > plot_tcmpr.R
> > > > >> > >> > > script
> > > > >> > >> > > > > on
> > > > >> > >> > > > > > 'hera', with the following instructions:
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > -------
> > > > >> > >> > > > > > The changes to the plot_tcmpr.R script are
now
> > > installed
> > > > on
> > > > >> > >> hera.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > The user can run the following to access
this new
> > > version
> > > > >> of
> > > > >> > >> MET:
> > > > >> > >> > > > > > module use -a /contrib/anaconda/modulefiles
> > > > >> > >> > > > > > module load intel/18.0.5.274
> > > > >> > >> > > > > > module load anaconda/latest
> > > > >> > >> > > > > > module use /contrib/met/modulefiles
> > > > >> > >> > > > > > module load met/10.0.0_test
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > If they are using METplus, they will need to
run:
> > > > >> > >> > > > > > module use /contrib/METplus/modulefiles
> > > > >> > >> > > > > > module load metplus/4.0.0
> > > > >> > >> > > > > > module use /contrib/met/modulefiles/
> > > > >> > >> > > > > > module load met/10.0.0_test
> > > > >> > >> > > > > > And they will need to set MET_INSTALL_DIR
to
> > > > >> > >> > > /contrib/met/10.0.0_test
> > > > >> > >> > > > in
> > > > >> > >> > > > > > their user config file.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > If using the METplus wrapper to generate the
plots
> > with
> > > > all
> > > > >> > the
> > > > >> > >> > model
> > > > >> > >> > > > > > points, you will need to turn off event
> equalization
> > in
> > > > >> your
> > > > >> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf file
by
> > setting
> > > > the
> > > > >> > >> > > following:
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > This will disable the event equalization.
Your
> > sample
> > > > data
> > > > >> > >> didn't
> > > > >> > >> > > have
> > > > >> > >> > > > > > any overlapping tracks so no plots were
generated
> > when
> > > > >> event
> > > > >> > >> > > > equalization
> > > > >> > >> > > > > > was enabled. You can leave MODEL unassigned
so
> that
> > > all
> > > > >> > models
> > > > >> > >> > will
> > > > >> > >> > > be
> > > > >> > >> > > > > > used (as long as all your tc-pairs .tcst
files are
> in
> > > the
> > > > >> same
> > > > >> > >> > > > > directory).
> > > > >> > >> > > > > > If you want a subset of models, you can set
the
> > > > following:
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > > > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel GFSO,EMX,CMC
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > to explicitly include only the GFSO, CMC and
EMX
> > models
> > > > (or
> > > > >> > >> > whatever
> > > > >> > >> > > > > > models you wish) on your plots.
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > > Regards,
> > > > >> > >> > > > > > Minna
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > > >
> > > > >> > >> > > >
> > > > >> > >> > > > --
> > > > >> > >> > > > George McCabe - Software Engineer III
> > > > >> > >> > > > National Center for Atmospheric Research
> > > > >> > >> > > > Research Applications Laboratory
> > > > >> > >> > > > 303-497-2768
> > > > >> > >> > > > ---
> > > > >> > >> > > > My working day may not be your working day.
Please do
> not
> > > > feel
> > > > >> > >> obliged
> > > > >> > >> > to
> > > > >> > >> > > > reply to this email outside of your normal
working
> hours.
> > > > >> > >> > > >
> > > > >> > >> > > >
> > > > >> > >> > >
> > > > >> > >> > >
> > > > >> > >> >
> > > > >> > >> > --
> > > > >> > >> > George McCabe - Software Engineer III
> > > > >> > >> > National Center for Atmospheric Research
> > > > >> > >> > Research Applications Laboratory
> > > > >> > >> > 303-497-2768
> > > > >> > >> > ---
> > > > >> > >> > My working day may not be your working day. Please
do not
> > feel
> > > > >> obliged
> > > > >> > >> to
> > > > >> > >> > reply to this email outside of your normal working
hours.
> > > > >> > >> >
> > > > >> > >> >
> > > > >> > >>
> > > > >> > >>
> > > > >> > >
> > > > >> > > --
> > > > >> > > George McCabe - Software Engineer III
> > > > >> > > National Center for Atmospheric Research
> > > > >> > > Research Applications Laboratory
> > > > >> > > 303-497-2768
> > > > >> > > ---
> > > > >> > > My working day may not be your working day. Please do
not feel
> > > > >> obliged to
> > > > >> > > reply to this email outside of your normal working
hours.
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> > --
> > > > >> > George McCabe - Software Engineer III
> > > > >> > National Center for Atmospheric Research
> > > > >> > Research Applications Laboratory
> > > > >> > 303-497-2768
> > > > >> > ---
> > > > >> > My working day may not be your working day. Please do not
feel
> > > obliged
> > > > >> to
> > > > >> > reply to this email outside of your normal working hours.
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > > >
> > > > > --
> > > > > George McCabe - Software Engineer III
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > 303-497-2768
> > > > > ---
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Mon Jun 07 11:50:46 2021
Hi George,
Thanks for pointing that out. I thought the version had been
implemented.
Here is the command:
/scratch2/NCEPDEV/fv3-cam/noscrub/Guang.Ping.Lou/metplus_test_george2
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
-c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c Plotter_8.conf
The execution went through. But the labels are not changed.
Could you give me a version of Plotter_8.conf so that the labels would
change per variable?
Thanks,
Guang Ping
On Mon, Jun 7, 2021 at 1:23 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> Looking at your log output, it looks like you are not using the
version of
> METplus from my scratch directory that has the changes needed to run
with
> the new settings. Instead of running run_metplus.py from the path,
run it
> from:
>
>
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
>
> - George
>
> On Mon, Jun 7, 2021 at 9:52 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi George,
> >
> > The run directory is on Hera:
> > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> > Line command:
> > run_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c
> > usecase_8.conf
> >
> > Thanks,
> > Guang Ping
> >
> > On Mon, Jun 7, 2021 at 11:40 AM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Guang Ping,
> > >
> > > Could you send me the command you ran that produced errors?
> > >
> > > Thanks,
> > > George
> > >
> > > On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate via RT
<
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> > > >
> > > > Hi George,
> > > >
> > > > I was wondering if you could give me an example of the config
files
> > > running
> > > > your new installation with your new label setup. I was getting
error
> > > > messages when I ran. I assume your new installation is still
> met10.0.0
> > > and
> > > > Metplus-4.0.0.
> > > >
> > > > Thanks a lot!
> > > > Guang Ping
> > > >
> > > > On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT <
> met_help at ucar.edu
> > >
> > > > wrote:
> > > >
> > > > > Hi Guang Ping,
> > > > >
> > > > > I updated the version of METplus on Hera to include the
latest
> > changes.
> > > > > With this version, you can reference the dep/plot labels for
each
> > run:
> > > > >
> > > > > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > > > > TCMPR_PLOTTER_DEP_LABELS = Track Error
> > > > >
> > > > > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> > > > > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > TCMPR_PLOTTER_XLAB =
> > > > > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> > > > >
> > > > > {dep_label} will be substituted with the value of the
> > > > > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> > > > TCMPR_PLOTTER_DEP_VARS
> > > > > value. The 2 lists should be the same length.
> > > > >
> > > > > You can similarly use {plot_labels} if you set
> > > TCMPR_PLOTTER_PLOT_LABELS.
> > > > >
> > > > > Let me know if you have any issues setting that up.
> > > > >
> > > > > Thanks,
> > > > > George
> > > > >
> > > > > On Thu, May 27, 2021 at 12:56 PM George McCabe
<mccabe at ucar.edu>
> > > wrote:
> > > > >
> > > > > > Hi Guang Ping,
> > > > > >
> > > > > > 1.
> > > > > > The image size is controlled by a variable in the TCMPR
config
> > file.
> > > > Here
> > > > > > is the setting that was used in the original that sets it:
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > > > > >
> > > > > > img_res = 72;
> > > > > >
> > > > > > 2.
> > > > > > This is the same issue that Yan ran into on another MET
help
> > ticket.
> > > I
> > > > > > provided a work around to change the plot info and
filenames for
> > each
> > > > > > variable. I am modifying TCMPRPlotter to loop over the
variables
> to
> > > run
> > > > > > once for each and add a way to specify the label to use
for each.
> > > This
> > > > > > would allow you to use that label in the YLAB value. I can
send
> you
> > > the
> > > > > > updated version to test when that is ready.
> > > > > >
> > > > > > 3.
> > > > > > Yes, if R is not available then the TCMPRPlotter will not
work.
> The
> > > > > > eventual plan is to migrate the R scripts to Python, but
this may
> > not
> > > > > > happen for a while unless this is needed more urgently.
> > > > > >
> > > > > > Thanks,
> > > > > > George
> > > > > >
> > > > > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA
Affiliate via
> RT
> > <
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >>
> > > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > > >>
> > > > > >> Hi George,
> > > > > >>
> > > > > >> Thank you so much for making it work!
> > > > > >> I ran your temporary script
> > > > > >>
> > > > > >>
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > >>
> > > > > >> and it was able to generate multiple lines in the same
frame.
> > Please
> > > > > see:
> > > > > >>
> > > https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > > > > >>
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > > > > >>
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > > > > >>
> > > > > >> Now there are some finer points that I would like to ask
you:
> > > > > >> 1. The plots become huge if we click the picture to zoom
in.
> This
> > is
> > > > > true
> > > > > >> when we use the "display" command on Hera or other
machines.
> > > > > >> I think the original plots that were generated by
the
> earlier
> > > > > scripts
> > > > > >> do not have this issue.
> > > > > >> 2. The X-Y labels are all the same. How do we change the
label
> > > > according
> > > > > >> to
> > > > > >> the variables?
> > > > > >> In the config file,
> > > > > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> > > > > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > >> TCMPR_PLOTTER_XLAB =
> > > > > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > > > > >> All plots have the same labels assigned above. How
can I
> > assign
> > > > > >> different labels for different variable plots?
> > > > > >> 3. Your new version works on Hera, I am assuming that it
will
> not
> > > work
> > > > > on
> > > > > >> WCOSS because WCOSS does not have the R-library, Am I
correct?
> > > > > >> John (Gotway) mentioned that MET is going to use
METcalcpy and
> > > > METplotpy
> > > > > >> in
> > > > > >> the future, would this include the cyclone plots?
> > > > > >>
> > > > > >> Sorry that I have so many questions. I deeply appreciate
your
> > help.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> Guang Ping
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT <
> > > > > met_help at ucar.edu>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Hi Guang Ping,
> > > > > >> >
> > > > > >> > I put a version of METplus for you to test using
TCMPRPlotter.
> > To
> > > > use
> > > > > >> this
> > > > > >> > version, run the module commands to set up METplus,
then
> instead
> > > of
> > > > > >> calling
> > > > > >> > run_metplus.py from the path, call the version in my
scratch
> > > > > directory,
> > > > > >> > passing in your config files normally.
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > >> >
> > > > > >> > I ran using your config file from your previous email
and was
> > able
> > > > to
> > > > > >> view
> > > > > >> > the log output from the R script in the METplus log
file. The
> > > first
> > > > > >> attempt
> > > > > >> > failed due to the bug that requires -bmodel to be set,
so I
> > > changed
> > > > > the
> > > > > >> > default configuration to use the testing version of MET
that
> > Minna
> > > > and
> > > > > >> > Julie made available on Hera
(/contrib/met/10.0.0_test).
> Calling
> > > > this
> > > > > >> > version of run_metplus.py will automatically use the
test
> > version
> > > of
> > > > > MET
> > > > > >> > unless you are overriding MET_INSTALL_DIR in your
config
> files.
> > > > > >> >
> > > > > >> > I generated images here:
> > > > > >> >
> > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-test/tcmpr_plots
> > > > > >> >
> > > > > >> > Please take a look and verify that the output looks
correct.
> Let
> > > me
> > > > > >> know if
> > > > > >> > you have any other questions or issues.
> > > > > >> >
> > > > > >> > Thanks,
> > > > > >> > George
> > > > > >> >
> > > > > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe <
> mccabe at ucar.edu>
> > > > > wrote:
> > > > > >> >
> > > > > >> > > Hi Guang Ping,
> > > > > >> > >
> > > > > >> > > I will make some modifications to the wrapper to make
it
> > easier
> > > to
> > > > > >> debug
> > > > > >> > > the error, as it is difficult to see what is
happening. I
> can
> > > put
> > > > > the
> > > > > >> > > changes on Hera so you can use that version to test.
I will
> > let
> > > > you
> > > > > >> know
> > > > > >> > > when that is ready.
> > > > > >> > >
> > > > > >> > > Thanks,
> > > > > >> > > George
> > > > > >> > >
> > > > > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA
Affiliate
> via
> > > RT
> > > > <
> > > > > >> > > met_help at ucar.edu> wrote:
> > > > > >> > >
> > > > > >> > >>
> > > > > >> > >> <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > >
> > > > > >> > >>
> > > > > >> > >> Hi George,
> > > > > >> > >>
> > > > > >> > >> Thanks for your quick response.
> > > > > >> > >> I modified the config file
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > > >> > >> and still got the same error messages:
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > > > > >> > >>
> > > > > >> > >> In your plot, you plotted only 1 model. What I
wanted is
> all
> > 3
> > > > > >> models'
> > > > > >> > >> stats be plotted on the same frame.
> > > > > >> > >>
> > > > > >> > >> Thanks again,
> > > > > >> > >> Guang Ping
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via RT
<
> > > > > >> met_help at ucar.edu
> > > > > >> > >
> > > > > >> > >> wrote:
> > > > > >> > >>
> > > > > >> > >> > Hi Guang Ping,
> > > > > >> > >> >
> > > > > >> > >> > Sorry, I mistakenly thought the error in the
plotter was
> > due
> > > to
> > > > > >> > missing
> > > > > >> > >> > data. It looks like it is failing because it is
not
> reading
> > > the
> > > > > >> > -filter
> > > > > >> > >> > options properly. Please try putting quotation
marks
> around
> > > the
> > > > > >> value
> > > > > >> > >> for
> > > > > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > > > > >> > >> >
> > > > > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > > >> > >> >
> > > > > >> > >> > Let me know if that does not work. If not, the
wrapper
> will
> > > > have
> > > > > >> to be
> > > > > >> > >> > updated to add quotation marks around it. It
should
> really
> > do
> > > > > this
> > > > > >> > >> > automatically, so I can make that change when I
update
> the
> > > > > >> wrapper. I
> > > > > >> > >> will
> > > > > >> > >> > also modify it to output the log output and make
it
> easier
> > to
> > > > > copy
> > > > > >> the
> > > > > >> > >> > Rscript command to rerun it on the command line
for
> testing
> > > > > >> purposes.
> > > > > >> > I
> > > > > >> > >> was
> > > > > >> > >> > able to get output by running the following
command
> (using
> > > > only 1
> > > > > >> > input
> > > > > >> > >> > file):
> > > > > >> > >> >
> > > > > >> > >> > Rscript
> > > > /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > > > > >> > -config
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > > > > >> > >> > -title "Extratropical Cyclone Track Error"
-subtitle
> > > "Forecast
> > > > > >> Hours"
> > > > > >> > >> -ylab
> > > > > >> > >> > "Track error (NM)" -filter "-amodel GFSO,EMX,CMC"
-dep
> > > > > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend
"GFS"
> -plot
> > > > > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > > > > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-tcmpr
> > > > > >> > >> >
> > > > > >> > >> > Thanks,
> > > > > >> > >> > George
> > > > > >> > >> >
> > > > > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA
> Affiliate
> > > via
> > > > > RT <
> > > > > >> > >> > met_help at ucar.edu> wrote:
> > > > > >> > >> >
> > > > > >> > >> > >
> > > > > >> > >> > > <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > > >
> > > > > >> > >> > >
> > > > > >> > >> > > Hi George,
> > > > > >> > >> > >
> > > > > >> > >> > > Thanks for the info. But the plotting is
supposed to
> > follow
> > > > the
> > > > > >> > >> > conversion
> > > > > >> > >> > > from regular pairs to .tcst pairs, which are
generated
> by
> > > the
> > > > > >> > command
> > > > > >> > >> > line.
> > > > > >> > >> > > All the .tcst pairs are in
> > > > > >> > >> > >
> > > > > >> > >> > >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > > > >> > >> > > after the command line:
> > > > > >> > >> > > master_metplus.py -c
> > > Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > -c
> > > > > >> > >> > > usecase_7.conf
> > > > > >> > >> > >
> > > > > >> > >> > > If that is not the case , where should the path
be
> > > specified?
> > > > > >> > >> > >
> > > > > >> > >> > >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > > > > >> > >> > >
> > > > > >> > >> > > Thanks,
> > > > > >> > >> > > Guang Ping
> > > > > >> > >> > >
> > > > > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe
via RT <
> > > > > >> > >> met_help at ucar.edu>
> > > > > >> > >> > > wrote:
> > > > > >> > >> > >
> > > > > >> > >> > > > Hi Guang Ping,
> > > > > >> > >> > > >
> > > > > >> > >> > > > This error is due to a bug in the logic to
report an
> > > error
> > > > in
> > > > > >> the
> > > > > >> > >> > > wrapper.
> > > > > >> > >> > > > This error is most likely happening because
the input
> > > files
> > > > > >> passed
> > > > > >> > >> to
> > > > > >> > >> > the
> > > > > >> > >> > > > plotter are empty. You will need to change the
> > > > configuration
> > > > > of
> > > > > >> > >> TCPairs
> > > > > >> > >> > > to
> > > > > >> > >> > > > get output lines. The error will go away if
there is
> > data
> > > > > >> > available
> > > > > >> > >> to
> > > > > >> > >> > > > process.
> > > > > >> > >> > > >
> > > > > >> > >> > > > - George
> > > > > >> > >> > > >
> > > > > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou -
NOAA
> > > Affiliate
> > > > > via
> > > > > >> > RT <
> > > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > > > >> > >> > > >
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > <URL:
> > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > Hi Minna,
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > Thanks for the update. I followed your
suggestion
> and
> > > > there
> > > > > >> was
> > > > > >> > an
> > > > > >> > >> > > error
> > > > > >> > >> > > > > that says:
> > > > > >> > >> > > > >
> > > > > >> >
> > ------------------------------------------------------------------
> > > > > >> > >> > > > > File
> > > > > >> > "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
> > > > > >> > >> > line
> > > > > >> > >> > > > 159,
> > > > > >> > >> > > > > in run_metplus
> > > > > >> > >> > > > > new_commands = process.run_all_times()
> > > > > >> > >> > > > > File
> > > > > >> > >> > > > >
> > > > > >> > >> > > >
> > > > > >> > >> > >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > > >> > >> > > > > line 261, in run_all_times
> > > > > >> > >> > > > > except produtil.run.ExitStatusException
as ese:
> > > > > >> > >> > > > > NameError: name 'produtil' is not defined
> > > > > >> > >> > > > >
> > > > > >> > >> > > >
> > > > > >> > >> > >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > I looked up modules that related to the
produtil,
> but
> > > > could
> > > > > >> not
> > > > > >> > >> find
> > > > > >> > >> > > any.
> > > > > >> > >> > > > > here is the Hera:
> > > > > >> > >> > > > >
> > > > > >> > >> > > > >
> > > > > >> > >> > > >
> > > > > >> > >> > >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > > >> > >> > > > > my line command is:
> > > > > >> > >> > > > > master_metplus.py -c
> > > > > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > > > >> > >> > > > > usecase_7.conf
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > Thanks,
> > > > > >> > >> > > > > Guang Ping
> > > > > >> > >> > > > >
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win
via RT <
> > > > > >> > >> met_help at ucar.edu>
> > > > > >> > >> > > > > wrote:
> > > > > >> > >> > > > >
> > > > > >> > >> > > > > > Hello Guang Ping,
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > Julie has successfully installed the
changes to
> the
> > > > > >> > plot_tcmpr.R
> > > > > >> > >> > > script
> > > > > >> > >> > > > > on
> > > > > >> > >> > > > > > 'hera', with the following instructions:
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > -------
> > > > > >> > >> > > > > > The changes to the plot_tcmpr.R script are
now
> > > > installed
> > > > > on
> > > > > >> > >> hera.
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > The user can run the following to access
this new
> > > > version
> > > > > >> of
> > > > > >> > >> MET:
> > > > > >> > >> > > > > > module use -a
/contrib/anaconda/modulefiles
> > > > > >> > >> > > > > > module load intel/18.0.5.274
> > > > > >> > >> > > > > > module load anaconda/latest
> > > > > >> > >> > > > > > module use /contrib/met/modulefiles
> > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > If they are using METplus, they will need
to run:
> > > > > >> > >> > > > > > module use /contrib/METplus/modulefiles
> > > > > >> > >> > > > > > module load metplus/4.0.0
> > > > > >> > >> > > > > > module use /contrib/met/modulefiles/
> > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > >> > >> > > > > > And they will need to set MET_INSTALL_DIR
to
> > > > > >> > >> > > /contrib/met/10.0.0_test
> > > > > >> > >> > > > in
> > > > > >> > >> > > > > > their user config file.
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > If using the METplus wrapper to generate
the
> plots
> > > with
> > > > > all
> > > > > >> > the
> > > > > >> > >> > model
> > > > > >> > >> > > > > > points, you will need to turn off event
> > equalization
> > > in
> > > > > >> your
> > > > > >> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf
file by
> > > setting
> > > > > the
> > > > > >> > >> > > following:
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > This will disable the event equalization.
Your
> > > sample
> > > > > data
> > > > > >> > >> didn't
> > > > > >> > >> > > have
> > > > > >> > >> > > > > > any overlapping tracks so no plots were
generated
> > > when
> > > > > >> event
> > > > > >> > >> > > > equalization
> > > > > >> > >> > > > > > was enabled. You can leave MODEL
unassigned so
> > that
> > > > all
> > > > > >> > models
> > > > > >> > >> > will
> > > > > >> > >> > > be
> > > > > >> > >> > > > > > used (as long as all your tc-pairs .tcst
files
> are
> > in
> > > > the
> > > > > >> same
> > > > > >> > >> > > > > directory).
> > > > > >> > >> > > > > > If you want a subset of models, you can
set the
> > > > > following:
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > > > > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel
GFSO,EMX,CMC
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > to explicitly include only the GFSO, CMC
and EMX
> > > models
> > > > > (or
> > > > > >> > >> > whatever
> > > > > >> > >> > > > > > models you wish) on your plots.
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > > Regards,
> > > > > >> > >> > > > > > Minna
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > > >
> > > > > >> > >> > > > >
> > > > > >> > >> > > > >
> > > > > >> > >> > > >
> > > > > >> > >> > > > --
> > > > > >> > >> > > > George McCabe - Software Engineer III
> > > > > >> > >> > > > National Center for Atmospheric Research
> > > > > >> > >> > > > Research Applications Laboratory
> > > > > >> > >> > > > 303-497-2768
> > > > > >> > >> > > > ---
> > > > > >> > >> > > > My working day may not be your working day.
Please do
> > not
> > > > > feel
> > > > > >> > >> obliged
> > > > > >> > >> > to
> > > > > >> > >> > > > reply to this email outside of your normal
working
> > hours.
> > > > > >> > >> > > >
> > > > > >> > >> > > >
> > > > > >> > >> > >
> > > > > >> > >> > >
> > > > > >> > >> >
> > > > > >> > >> > --
> > > > > >> > >> > George McCabe - Software Engineer III
> > > > > >> > >> > National Center for Atmospheric Research
> > > > > >> > >> > Research Applications Laboratory
> > > > > >> > >> > 303-497-2768
> > > > > >> > >> > ---
> > > > > >> > >> > My working day may not be your working day. Please
do not
> > > feel
> > > > > >> obliged
> > > > > >> > >> to
> > > > > >> > >> > reply to this email outside of your normal working
hours.
> > > > > >> > >> >
> > > > > >> > >> >
> > > > > >> > >>
> > > > > >> > >>
> > > > > >> > >
> > > > > >> > > --
> > > > > >> > > George McCabe - Software Engineer III
> > > > > >> > > National Center for Atmospheric Research
> > > > > >> > > Research Applications Laboratory
> > > > > >> > > 303-497-2768
> > > > > >> > > ---
> > > > > >> > > My working day may not be your working day. Please do
not
> feel
> > > > > >> obliged to
> > > > > >> > > reply to this email outside of your normal working
hours.
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> > --
> > > > > >> > George McCabe - Software Engineer III
> > > > > >> > National Center for Atmospheric Research
> > > > > >> > Research Applications Laboratory
> > > > > >> > 303-497-2768
> > > > > >> > ---
> > > > > >> > My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > >> to
> > > > > >> > reply to this email outside of your normal working
hours.
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > > >
> > > > > > --
> > > > > > George McCabe - Software Engineer III
> > > > > > National Center for Atmospheric Research
> > > > > > Research Applications Laboratory
> > > > > > 303-497-2768
> > > > > > ---
> > > > > > My working day may not be your working day. Please do not
feel
> > > obliged
> > > > to
> > > > > > reply to this email outside of your normal working hours.
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > George McCabe - Software Engineer III
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > 303-497-2768
> > > > > ---
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > > >
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Mon Jun 07 13:02:31 2021
Hi Guang Ping,
I see you have set the dep labels with:
TCMPR_PLOTTER_DEP_LABELS = Mean Sea level pressure, MAX wind, Position
error
You will need to reference these values in the other variables that
you
want to change. For example, if you want to set the Y label (ylab) for
each, you can reference {dep_label} in that variable. Instead of
setting:
TCMPR_PLOTTER_YLAB = Track error (NM)
you would set:
TCMPR_PLOTTER_YLAB = {dep_label} (NM)
You can also reference this tag in the title, i.e.:
TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
You can also reference:
- {dep} to get the actual value for each item in
TCMPR_PLOTTER_DEP_VARS.
- {plot} to get the values for each item in TCMPR_PLOTTER_PLOT_TYPES
- {plot_label} to get the values for each item in
TCMPR_PLOTTER_PLOT_LABELS
You currently don't have TCMPR_PLOTTER_PLOT_LABELS set, so the value
substituted for {plot_label} would be the same as {plot}.
Let me know if that doesn't work or if you have other questions.
Thanks,
George
On Mon, Jun 7, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Hi George,
>
> Thanks for pointing that out. I thought the version had been
implemented.
> Here is the command:
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
>
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c Plotter_8.conf
>
> The execution went through. But the labels are not changed.
> Could you give me a version of Plotter_8.conf so that the labels
would
> change per variable?
>
> Thanks,
> Guang Ping
>
>
> On Mon, Jun 7, 2021 at 1:23 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > Looking at your log output, it looks like you are not using the
version
> of
> > METplus from my scratch directory that has the changes needed to
run with
> > the new settings. Instead of running run_metplus.py from the path,
run it
> > from:
> >
> >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> >
> > - George
> >
> > On Mon, Jun 7, 2021 at 9:52 AM Guang Lou - NOAA Affiliate via RT <
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi George,
> > >
> > > The run directory is on Hera:
> > > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> > > Line command:
> > > run_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c
> > > usecase_8.conf
> > >
> > > Thanks,
> > > Guang Ping
> > >
> > > On Mon, Jun 7, 2021 at 11:40 AM George McCabe via RT <
> met_help at ucar.edu>
> > > wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > Could you send me the command you ran that produced errors?
> > > >
> > > > Thanks,
> > > > George
> > > >
> > > > On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate via
RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > >
> > > > > Hi George,
> > > > >
> > > > > I was wondering if you could give me an example of the
config files
> > > > running
> > > > > your new installation with your new label setup. I was
getting
> error
> > > > > messages when I ran. I assume your new installation is still
> > met10.0.0
> > > > and
> > > > > Metplus-4.0.0.
> > > > >
> > > > > Thanks a lot!
> > > > > Guang Ping
> > > > >
> > > > > On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT <
> > met_help at ucar.edu
> > > >
> > > > > wrote:
> > > > >
> > > > > > Hi Guang Ping,
> > > > > >
> > > > > > I updated the version of METplus on Hera to include the
latest
> > > changes.
> > > > > > With this version, you can reference the dep/plot labels
for each
> > > run:
> > > > > >
> > > > > > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > > > > > TCMPR_PLOTTER_DEP_LABELS = Track Error
> > > > > >
> > > > > > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> > > > > > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > > TCMPR_PLOTTER_XLAB =
> > > > > > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> > > > > >
> > > > > > {dep_label} will be substituted with the value of the
> > > > > > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> > > > > TCMPR_PLOTTER_DEP_VARS
> > > > > > value. The 2 lists should be the same length.
> > > > > >
> > > > > > You can similarly use {plot_labels} if you set
> > > > TCMPR_PLOTTER_PLOT_LABELS.
> > > > > >
> > > > > > Let me know if you have any issues setting that up.
> > > > > >
> > > > > > Thanks,
> > > > > > George
> > > > > >
> > > > > > On Thu, May 27, 2021 at 12:56 PM George McCabe
<mccabe at ucar.edu>
> > > > wrote:
> > > > > >
> > > > > > > Hi Guang Ping,
> > > > > > >
> > > > > > > 1.
> > > > > > > The image size is controlled by a variable in the TCMPR
config
> > > file.
> > > > > Here
> > > > > > > is the setting that was used in the original that sets
it:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > > > > > >
> > > > > > > img_res = 72;
> > > > > > >
> > > > > > > 2.
> > > > > > > This is the same issue that Yan ran into on another MET
help
> > > ticket.
> > > > I
> > > > > > > provided a work around to change the plot info and
filenames
> for
> > > each
> > > > > > > variable. I am modifying TCMPRPlotter to loop over the
> variables
> > to
> > > > run
> > > > > > > once for each and add a way to specify the label to use
for
> each.
> > > > This
> > > > > > > would allow you to use that label in the YLAB value. I
can send
> > you
> > > > the
> > > > > > > updated version to test when that is ready.
> > > > > > >
> > > > > > > 3.
> > > > > > > Yes, if R is not available then the TCMPRPlotter will
not work.
> > The
> > > > > > > eventual plan is to migrate the R scripts to Python, but
this
> may
> > > not
> > > > > > > happen for a while unless this is needed more urgently.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > George
> > > > > > >
> > > > > > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA
Affiliate via
> > RT
> > > <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >>
> > > > > > >> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> > > > > > >>
> > > > > > >> Hi George,
> > > > > > >>
> > > > > > >> Thank you so much for making it work!
> > > > > > >> I ran your temporary script
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > > >>
> > > > > > >> and it was able to generate multiple lines in the same
frame.
> > > Please
> > > > > > see:
> > > > > > >>
> > > >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > > > > > >>
> > https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > > > > > >>
> > > > > > >> Now there are some finer points that I would like to
ask you:
> > > > > > >> 1. The plots become huge if we click the picture to
zoom in.
> > This
> > > is
> > > > > > true
> > > > > > >> when we use the "display" command on Hera or other
machines.
> > > > > > >> I think the original plots that were generated by
the
> > earlier
> > > > > > scripts
> > > > > > >> do not have this issue.
> > > > > > >> 2. The X-Y labels are all the same. How do we change
the label
> > > > > according
> > > > > > >> to
> > > > > > >> the variables?
> > > > > > >> In the config file,
> > > > > > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track Error
> > > > > > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > > >> TCMPR_PLOTTER_XLAB =
> > > > > > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > > > > > >> All plots have the same labels assigned above. How
can I
> > > assign
> > > > > > >> different labels for different variable plots?
> > > > > > >> 3. Your new version works on Hera, I am assuming that
it will
> > not
> > > > work
> > > > > > on
> > > > > > >> WCOSS because WCOSS does not have the R-library, Am I
correct?
> > > > > > >> John (Gotway) mentioned that MET is going to use
METcalcpy and
> > > > > METplotpy
> > > > > > >> in
> > > > > > >> the future, would this include the cyclone plots?
> > > > > > >>
> > > > > > >> Sorry that I have so many questions. I deeply
appreciate your
> > > help.
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> Guang Ping
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT <
> > > > > > met_help at ucar.edu>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > Hi Guang Ping,
> > > > > > >> >
> > > > > > >> > I put a version of METplus for you to test using
> TCMPRPlotter.
> > > To
> > > > > use
> > > > > > >> this
> > > > > > >> > version, run the module commands to set up METplus,
then
> > instead
> > > > of
> > > > > > >> calling
> > > > > > >> > run_metplus.py from the path, call the version in my
scratch
> > > > > > directory,
> > > > > > >> > passing in your config files normally.
> > > > > > >> >
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > > >> >
> > > > > > >> > I ran using your config file from your previous email
and
> was
> > > able
> > > > > to
> > > > > > >> view
> > > > > > >> > the log output from the R script in the METplus log
file.
> The
> > > > first
> > > > > > >> attempt
> > > > > > >> > failed due to the bug that requires -bmodel to be
set, so I
> > > > changed
> > > > > > the
> > > > > > >> > default configuration to use the testing version of
MET that
> > > Minna
> > > > > and
> > > > > > >> > Julie made available on Hera
(/contrib/met/10.0.0_test).
> > Calling
> > > > > this
> > > > > > >> > version of run_metplus.py will automatically use the
test
> > > version
> > > > of
> > > > > > MET
> > > > > > >> > unless you are overriding MET_INSTALL_DIR in your
config
> > files.
> > > > > > >> >
> > > > > > >> > I generated images here:
> > > > > > >> >
> > > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-
test/tcmpr_plots
> > > > > > >> >
> > > > > > >> > Please take a look and verify that the output looks
correct.
> > Let
> > > > me
> > > > > > >> know if
> > > > > > >> > you have any other questions or issues.
> > > > > > >> >
> > > > > > >> > Thanks,
> > > > > > >> > George
> > > > > > >> >
> > > > > > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe <
> > mccabe at ucar.edu>
> > > > > > wrote:
> > > > > > >> >
> > > > > > >> > > Hi Guang Ping,
> > > > > > >> > >
> > > > > > >> > > I will make some modifications to the wrapper to
make it
> > > easier
> > > > to
> > > > > > >> debug
> > > > > > >> > > the error, as it is difficult to see what is
happening. I
> > can
> > > > put
> > > > > > the
> > > > > > >> > > changes on Hera so you can use that version to
test. I
> will
> > > let
> > > > > you
> > > > > > >> know
> > > > > > >> > > when that is ready.
> > > > > > >> > >
> > > > > > >> > > Thanks,
> > > > > > >> > > George
> > > > > > >> > >
> > > > > > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA
Affiliate
> > via
> > > > RT
> > > > > <
> > > > > > >> > > met_help at ucar.edu> wrote:
> > > > > > >> > >
> > > > > > >> > >>
> > > > > > >> > >> <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > >
> > > > > > >> > >>
> > > > > > >> > >> Hi George,
> > > > > > >> > >>
> > > > > > >> > >> Thanks for your quick response.
> > > > > > >> > >> I modified the config file
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > > > >> > >> and still got the same error messages:
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > > > > > >> > >>
> > > > > > >> > >> In your plot, you plotted only 1 model. What I
wanted is
> > all
> > > 3
> > > > > > >> models'
> > > > > > >> > >> stats be plotted on the same frame.
> > > > > > >> > >>
> > > > > > >> > >> Thanks again,
> > > > > > >> > >> Guang Ping
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe via
RT <
> > > > > > >> met_help at ucar.edu
> > > > > > >> > >
> > > > > > >> > >> wrote:
> > > > > > >> > >>
> > > > > > >> > >> > Hi Guang Ping,
> > > > > > >> > >> >
> > > > > > >> > >> > Sorry, I mistakenly thought the error in the
plotter
> was
> > > due
> > > > to
> > > > > > >> > missing
> > > > > > >> > >> > data. It looks like it is failing because it is
not
> > reading
> > > > the
> > > > > > >> > -filter
> > > > > > >> > >> > options properly. Please try putting quotation
marks
> > around
> > > > the
> > > > > > >> value
> > > > > > >> > >> for
> > > > > > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > > > > > >> > >> >
> > > > > > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > > > >> > >> >
> > > > > > >> > >> > Let me know if that does not work. If not, the
wrapper
> > will
> > > > > have
> > > > > > >> to be
> > > > > > >> > >> > updated to add quotation marks around it. It
should
> > really
> > > do
> > > > > > this
> > > > > > >> > >> > automatically, so I can make that change when I
update
> > the
> > > > > > >> wrapper. I
> > > > > > >> > >> will
> > > > > > >> > >> > also modify it to output the log output and make
it
> > easier
> > > to
> > > > > > copy
> > > > > > >> the
> > > > > > >> > >> > Rscript command to rerun it on the command line
for
> > testing
> > > > > > >> purposes.
> > > > > > >> > I
> > > > > > >> > >> was
> > > > > > >> > >> > able to get output by running the following
command
> > (using
> > > > > only 1
> > > > > > >> > input
> > > > > > >> > >> > file):
> > > > > > >> > >> >
> > > > > > >> > >> > Rscript
> > > > > /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > > > > > >> > -config
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > > > > > >> > >> > -title "Extratropical Cyclone Track Error"
-subtitle
> > > > "Forecast
> > > > > > >> Hours"
> > > > > > >> > >> -ylab
> > > > > > >> > >> > "Track error (NM)" -filter "-amodel
GFSO,EMX,CMC" -dep
> > > > > > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend
"GFS"
> > -plot
> > > > > > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > > > > > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-
tcmpr
> > > > > > >> > >> >
> > > > > > >> > >> > Thanks,
> > > > > > >> > >> > George
> > > > > > >> > >> >
> > > > > > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou - NOAA
> > Affiliate
> > > > via
> > > > > > RT <
> > > > > > >> > >> > met_help at ucar.edu> wrote:
> > > > > > >> > >> >
> > > > > > >> > >> > >
> > > > > > >> > >> > > <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > > > >
> > > > > > >> > >> > >
> > > > > > >> > >> > > Hi George,
> > > > > > >> > >> > >
> > > > > > >> > >> > > Thanks for the info. But the plotting is
supposed to
> > > follow
> > > > > the
> > > > > > >> > >> > conversion
> > > > > > >> > >> > > from regular pairs to .tcst pairs, which are
> generated
> > by
> > > > the
> > > > > > >> > command
> > > > > > >> > >> > line.
> > > > > > >> > >> > > All the .tcst pairs are in
> > > > > > >> > >> > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > > > > >> > >> > > after the command line:
> > > > > > >> > >> > > master_metplus.py -c
> > > > Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > -c
> > > > > > >> > >> > > usecase_7.conf
> > > > > > >> > >> > >
> > > > > > >> > >> > > If that is not the case , where should the
path be
> > > > specified?
> > > > > > >> > >> > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > > > > > >> > >> > >
> > > > > > >> > >> > > Thanks,
> > > > > > >> > >> > > Guang Ping
> > > > > > >> > >> > >
> > > > > > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George McCabe
via RT
> <
> > > > > > >> > >> met_help at ucar.edu>
> > > > > > >> > >> > > wrote:
> > > > > > >> > >> > >
> > > > > > >> > >> > > > Hi Guang Ping,
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > This error is due to a bug in the logic to
report
> an
> > > > error
> > > > > in
> > > > > > >> the
> > > > > > >> > >> > > wrapper.
> > > > > > >> > >> > > > This error is most likely happening because
the
> input
> > > > files
> > > > > > >> passed
> > > > > > >> > >> to
> > > > > > >> > >> > the
> > > > > > >> > >> > > > plotter are empty. You will need to change
the
> > > > > configuration
> > > > > > of
> > > > > > >> > >> TCPairs
> > > > > > >> > >> > > to
> > > > > > >> > >> > > > get output lines. The error will go away if
there
> is
> > > data
> > > > > > >> > available
> > > > > > >> > >> to
> > > > > > >> > >> > > > process.
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > - George
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou -
NOAA
> > > > Affiliate
> > > > > > via
> > > > > > >> > RT <
> > > > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > <URL:
> > > > > > >> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > Hi Minna,
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > Thanks for the update. I followed your
suggestion
> > and
> > > > > there
> > > > > > >> was
> > > > > > >> > an
> > > > > > >> > >> > > error
> > > > > > >> > >> > > > > that says:
> > > > > > >> > >> > > > >
> > > > > > >> >
> > >
------------------------------------------------------------------
> > > > > > >> > >> > > > > File
> > > > > > >> > "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
> > > > > > >> > >> > line
> > > > > > >> > >> > > > 159,
> > > > > > >> > >> > > > > in run_metplus
> > > > > > >> > >> > > > > new_commands = process.run_all_times()
> > > > > > >> > >> > > > > File
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > > > >> > >> > > > > line 261, in run_all_times
> > > > > > >> > >> > > > > except
produtil.run.ExitStatusException as
> ese:
> > > > > > >> > >> > > > > NameError: name 'produtil' is not defined
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > I looked up modules that related to the
produtil,
> > but
> > > > > could
> > > > > > >> not
> > > > > > >> > >> find
> > > > > > >> > >> > > any.
> > > > > > >> > >> > > > > here is the Hera:
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> >
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > > > >> > >> > > > > my line command is:
> > > > > > >> > >> > > > > master_metplus.py -c
> > > > > > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > > > > >> > >> > > > > usecase_7.conf
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > Thanks,
> > > > > > >> > >> > > > > Guang Ping
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna Win
via RT
> <
> > > > > > >> > >> met_help at ucar.edu>
> > > > > > >> > >> > > > > wrote:
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > > > Hello Guang Ping,
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > Julie has successfully installed the
changes to
> > the
> > > > > > >> > plot_tcmpr.R
> > > > > > >> > >> > > script
> > > > > > >> > >> > > > > on
> > > > > > >> > >> > > > > > 'hera', with the following instructions:
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > -------
> > > > > > >> > >> > > > > > The changes to the plot_tcmpr.R script
are now
> > > > > installed
> > > > > > on
> > > > > > >> > >> hera.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > The user can run the following to access
this
> new
> > > > > version
> > > > > > >> of
> > > > > > >> > >> MET:
> > > > > > >> > >> > > > > > module use -a
/contrib/anaconda/modulefiles
> > > > > > >> > >> > > > > > module load intel/18.0.5.274
> > > > > > >> > >> > > > > > module load anaconda/latest
> > > > > > >> > >> > > > > > module use /contrib/met/modulefiles
> > > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > If they are using METplus, they will
need to
> run:
> > > > > > >> > >> > > > > > module use /contrib/METplus/modulefiles
> > > > > > >> > >> > > > > > module load metplus/4.0.0
> > > > > > >> > >> > > > > > module use /contrib/met/modulefiles/
> > > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > > >> > >> > > > > > And they will need to set
MET_INSTALL_DIR to
> > > > > > >> > >> > > /contrib/met/10.0.0_test
> > > > > > >> > >> > > > in
> > > > > > >> > >> > > > > > their user config file.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > If using the METplus wrapper to generate
the
> > plots
> > > > with
> > > > > > all
> > > > > > >> > the
> > > > > > >> > >> > model
> > > > > > >> > >> > > > > > points, you will need to turn off event
> > > equalization
> > > > in
> > > > > > >> your
> > > > > > >> > >> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_3.conf
file by
> > > > setting
> > > > > > the
> > > > > > >> > >> > > following:
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > This will disable the event
equalization. Your
> > > > sample
> > > > > > data
> > > > > > >> > >> didn't
> > > > > > >> > >> > > have
> > > > > > >> > >> > > > > > any overlapping tracks so no plots were
> generated
> > > > when
> > > > > > >> event
> > > > > > >> > >> > > > equalization
> > > > > > >> > >> > > > > > was enabled. You can leave MODEL
unassigned so
> > > that
> > > > > all
> > > > > > >> > models
> > > > > > >> > >> > will
> > > > > > >> > >> > > be
> > > > > > >> > >> > > > > > used (as long as all your tc-pairs .tcst
files
> > are
> > > in
> > > > > the
> > > > > > >> same
> > > > > > >> > >> > > > > directory).
> > > > > > >> > >> > > > > > If you want a subset of models, you can
set the
> > > > > > following:
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > > > > > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel
GFSO,EMX,CMC
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > to explicitly include only the GFSO, CMC
and
> EMX
> > > > models
> > > > > > (or
> > > > > > >> > >> > whatever
> > > > > > >> > >> > > > > > models you wish) on your plots.
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > > Regards,
> > > > > > >> > >> > > > > > Minna
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > > > --
> > > > > > >> > >> > > > George McCabe - Software Engineer III
> > > > > > >> > >> > > > National Center for Atmospheric Research
> > > > > > >> > >> > > > Research Applications Laboratory
> > > > > > >> > >> > > > 303-497-2768
> > > > > > >> > >> > > > ---
> > > > > > >> > >> > > > My working day may not be your working day.
Please
> do
> > > not
> > > > > > feel
> > > > > > >> > >> obliged
> > > > > > >> > >> > to
> > > > > > >> > >> > > > reply to this email outside of your normal
working
> > > hours.
> > > > > > >> > >> > > >
> > > > > > >> > >> > > >
> > > > > > >> > >> > >
> > > > > > >> > >> > >
> > > > > > >> > >> >
> > > > > > >> > >> > --
> > > > > > >> > >> > George McCabe - Software Engineer III
> > > > > > >> > >> > National Center for Atmospheric Research
> > > > > > >> > >> > Research Applications Laboratory
> > > > > > >> > >> > 303-497-2768
> > > > > > >> > >> > ---
> > > > > > >> > >> > My working day may not be your working day.
Please do
> not
> > > > feel
> > > > > > >> obliged
> > > > > > >> > >> to
> > > > > > >> > >> > reply to this email outside of your normal
working
> hours.
> > > > > > >> > >> >
> > > > > > >> > >> >
> > > > > > >> > >>
> > > > > > >> > >>
> > > > > > >> > >
> > > > > > >> > > --
> > > > > > >> > > George McCabe - Software Engineer III
> > > > > > >> > > National Center for Atmospheric Research
> > > > > > >> > > Research Applications Laboratory
> > > > > > >> > > 303-497-2768
> > > > > > >> > > ---
> > > > > > >> > > My working day may not be your working day. Please
do not
> > feel
> > > > > > >> obliged to
> > > > > > >> > > reply to this email outside of your normal working
hours.
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > --
> > > > > > >> > George McCabe - Software Engineer III
> > > > > > >> > National Center for Atmospheric Research
> > > > > > >> > Research Applications Laboratory
> > > > > > >> > 303-497-2768
> > > > > > >> > ---
> > > > > > >> > My working day may not be your working day. Please do
not
> feel
> > > > > obliged
> > > > > > >> to
> > > > > > >> > reply to this email outside of your normal working
hours.
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > > --
> > > > > > > George McCabe - Software Engineer III
> > > > > > > National Center for Atmospheric Research
> > > > > > > Research Applications Laboratory
> > > > > > > 303-497-2768
> > > > > > > ---
> > > > > > > My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > to
> > > > > > > reply to this email outside of your normal working
hours.
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > George McCabe - Software Engineer III
> > > > > > National Center for Atmospheric Research
> > > > > > Research Applications Laboratory
> > > > > > 303-497-2768
> > > > > > ---
> > > > > > My working day may not be your working day. Please do not
feel
> > > obliged
> > > > to
> > > > > > reply to this email outside of your normal working hours.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: Guang Lou - NOAA Affiliate
Time: Mon Jun 07 14:10:23 2021
Thanks, George!
But the title and labels are not taken one by one. It just puts all in
the
either title or label.
For example,
TCMPR_PLOTTER_DEP_VARS =AMSLP-BMSLP, AMAX_WIND-BMAX_WIND, TK_ERR
TCMPR_PLOTTER_DEP_LABELS = Pressure Error (MB), MAX wind Error, Track
error
(NM)
TCMPR_PLOTTER_PLOT_LABELS = Mean Sea level pressure, MAX wind, Track
error
What I wanted is AMSLP-BMSLP corresponds to Pressure Error (MB) and
Mean
Sea level pressure
MAX_WIND-BMAX_WIND corresponds to MAX
wind
Error and MAX wind
TK_ERR corresponds to Track error (NM)
and
Track error
Each line above is on one frame.
/scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2/tcmpr_plots8
Thanks,
Guang Ping
On Mon, Jun 7, 2021 at 3:02 PM George McCabe via RT
<met_help at ucar.edu>
wrote:
> Hi Guang Ping,
>
> I see you have set the dep labels with:
>
> TCMPR_PLOTTER_DEP_LABELS = Mean Sea level pressure, MAX wind,
Position
> error
>
> You will need to reference these values in the other variables that
you
> want to change. For example, if you want to set the Y label (ylab)
for
> each, you can reference {dep_label} in that variable. Instead of
setting:
>
> TCMPR_PLOTTER_YLAB = Track error (NM)
>
> you would set:
>
> TCMPR_PLOTTER_YLAB = {dep_label} (NM)
>
> You can also reference this tag in the title, i.e.:
>
> TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
>
> You can also reference:
> - {dep} to get the actual value for each item in
TCMPR_PLOTTER_DEP_VARS.
> - {plot} to get the values for each item in TCMPR_PLOTTER_PLOT_TYPES
> - {plot_label} to get the values for each item in
TCMPR_PLOTTER_PLOT_LABELS
>
> You currently don't have TCMPR_PLOTTER_PLOT_LABELS set, so the value
> substituted for {plot_label} would be the same as {plot}.
>
> Let me know if that doesn't work or if you have other questions.
>
> Thanks,
> George
>
> On Mon, Jun 7, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via RT <
> met_help at ucar.edu> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> >
> > Hi George,
> >
> > Thanks for pointing that out. I thought the version had been
implemented.
> > Here is the command:
> > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c Plotter_8.conf
> >
> > The execution went through. But the labels are not changed.
> > Could you give me a version of Plotter_8.conf so that the labels
would
> > change per variable?
> >
> > Thanks,
> > Guang Ping
> >
> >
> > On Mon, Jun 7, 2021 at 1:23 PM George McCabe via RT
<met_help at ucar.edu>
> > wrote:
> >
> > > Hi Guang Ping,
> > >
> > > Looking at your log output, it looks like you are not using the
version
> > of
> > > METplus from my scratch directory that has the changes needed to
run
> with
> > > the new settings. Instead of running run_metplus.py from the
path, run
> it
> > > from:
> > >
> > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > >
> > > - George
> > >
> > > On Mon, Jun 7, 2021 at 9:52 AM Guang Lou - NOAA Affiliate via RT
<
> > > met_help at ucar.edu> wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
>
> > > >
> > > > Hi George,
> > > >
> > > > The run directory is on Hera:
> > > > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> > > > Line command:
> > > > run_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c
> > > > usecase_8.conf
> > > >
> > > > Thanks,
> > > > Guang Ping
> > > >
> > > > On Mon, Jun 7, 2021 at 11:40 AM George McCabe via RT <
> > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > Hi Guang Ping,
> > > > >
> > > > > Could you send me the command you ran that produced errors?
> > > > >
> > > > > Thanks,
> > > > > George
> > > > >
> > > > > On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate
via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > > >
> > > > > > Hi George,
> > > > > >
> > > > > > I was wondering if you could give me an example of the
config
> files
> > > > > running
> > > > > > your new installation with your new label setup. I was
getting
> > error
> > > > > > messages when I ran. I assume your new installation is
still
> > > met10.0.0
> > > > > and
> > > > > > Metplus-4.0.0.
> > > > > >
> > > > > > Thanks a lot!
> > > > > > Guang Ping
> > > > > >
> > > > > > On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT <
> > > met_help at ucar.edu
> > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hi Guang Ping,
> > > > > > >
> > > > > > > I updated the version of METplus on Hera to include the
latest
> > > > changes.
> > > > > > > With this version, you can reference the dep/plot labels
for
> each
> > > > run:
> > > > > > >
> > > > > > > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > > > > > > TCMPR_PLOTTER_DEP_LABELS = Track Error
> > > > > > >
> > > > > > > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> > > > > > > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > > > TCMPR_PLOTTER_XLAB =
> > > > > > > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> > > > > > >
> > > > > > > {dep_label} will be substituted with the value of the
> > > > > > > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> > > > > > TCMPR_PLOTTER_DEP_VARS
> > > > > > > value. The 2 lists should be the same length.
> > > > > > >
> > > > > > > You can similarly use {plot_labels} if you set
> > > > > TCMPR_PLOTTER_PLOT_LABELS.
> > > > > > >
> > > > > > > Let me know if you have any issues setting that up.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > George
> > > > > > >
> > > > > > > On Thu, May 27, 2021 at 12:56 PM George McCabe <
> mccabe at ucar.edu>
> > > > > wrote:
> > > > > > >
> > > > > > > > Hi Guang Ping,
> > > > > > > >
> > > > > > > > 1.
> > > > > > > > The image size is controlled by a variable in the
TCMPR
> config
> > > > file.
> > > > > > Here
> > > > > > > > is the setting that was used in the original that sets
it:
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > > > > > > >
> > > > > > > > img_res = 72;
> > > > > > > >
> > > > > > > > 2.
> > > > > > > > This is the same issue that Yan ran into on another
MET help
> > > > ticket.
> > > > > I
> > > > > > > > provided a work around to change the plot info and
filenames
> > for
> > > > each
> > > > > > > > variable. I am modifying TCMPRPlotter to loop over the
> > variables
> > > to
> > > > > run
> > > > > > > > once for each and add a way to specify the label to
use for
> > each.
> > > > > This
> > > > > > > > would allow you to use that label in the YLAB value. I
can
> send
> > > you
> > > > > the
> > > > > > > > updated version to test when that is ready.
> > > > > > > >
> > > > > > > > 3.
> > > > > > > > Yes, if R is not available then the TCMPRPlotter will
not
> work.
> > > The
> > > > > > > > eventual plan is to migrate the R scripts to Python,
but this
> > may
> > > > not
> > > > > > > > happen for a while unless this is needed more
urgently.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > George
> > > > > > > >
> > > > > > > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA
Affiliate
> via
> > > RT
> > > > <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > >>
> > > > > > > >> <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > >
> > > > > > > >>
> > > > > > > >> Hi George,
> > > > > > > >>
> > > > > > > >> Thank you so much for making it work!
> > > > > > > >> I ran your temporary script
> > > > > > > >>
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > > > >>
> > > > > > > >> and it was able to generate multiple lines in the
same
> frame.
> > > > Please
> > > > > > > see:
> > > > > > > >>
> > > > >
> > https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > > > > > > >>
> > > https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > > > > > > >>
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > > > > > > >>
> > > > > > > >> Now there are some finer points that I would like to
ask
> you:
> > > > > > > >> 1. The plots become huge if we click the picture to
zoom in.
> > > This
> > > > is
> > > > > > > true
> > > > > > > >> when we use the "display" command on Hera or other
machines.
> > > > > > > >> I think the original plots that were generated
by the
> > > earlier
> > > > > > > scripts
> > > > > > > >> do not have this issue.
> > > > > > > >> 2. The X-Y labels are all the same. How do we change
the
> label
> > > > > > according
> > > > > > > >> to
> > > > > > > >> the variables?
> > > > > > > >> In the config file,
> > > > > > > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track
Error
> > > > > > > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > > > >> TCMPR_PLOTTER_XLAB =
> > > > > > > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > > > > > > >> All plots have the same labels assigned above.
How can I
> > > > assign
> > > > > > > >> different labels for different variable plots?
> > > > > > > >> 3. Your new version works on Hera, I am assuming that
it
> will
> > > not
> > > > > work
> > > > > > > on
> > > > > > > >> WCOSS because WCOSS does not have the R-library, Am I
> correct?
> > > > > > > >> John (Gotway) mentioned that MET is going to use
METcalcpy
> and
> > > > > > METplotpy
> > > > > > > >> in
> > > > > > > >> the future, would this include the cyclone plots?
> > > > > > > >>
> > > > > > > >> Sorry that I have so many questions. I deeply
appreciate
> your
> > > > help.
> > > > > > > >>
> > > > > > > >> Thanks,
> > > > > > > >> Guang Ping
> > > > > > > >>
> > > > > > > >>
> > > > > > > >>
> > > > > > > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via RT
<
> > > > > > > met_help at ucar.edu>
> > > > > > > >> wrote:
> > > > > > > >>
> > > > > > > >> > Hi Guang Ping,
> > > > > > > >> >
> > > > > > > >> > I put a version of METplus for you to test using
> > TCMPRPlotter.
> > > > To
> > > > > > use
> > > > > > > >> this
> > > > > > > >> > version, run the module commands to set up METplus,
then
> > > instead
> > > > > of
> > > > > > > >> calling
> > > > > > > >> > run_metplus.py from the path, call the version in
my
> scratch
> > > > > > > directory,
> > > > > > > >> > passing in your config files normally.
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > > > >> >
> > > > > > > >> > I ran using your config file from your previous
email and
> > was
> > > > able
> > > > > > to
> > > > > > > >> view
> > > > > > > >> > the log output from the R script in the METplus log
file.
> > The
> > > > > first
> > > > > > > >> attempt
> > > > > > > >> > failed due to the bug that requires -bmodel to be
set, so
> I
> > > > > changed
> > > > > > > the
> > > > > > > >> > default configuration to use the testing version of
MET
> that
> > > > Minna
> > > > > > and
> > > > > > > >> > Julie made available on Hera
(/contrib/met/10.0.0_test).
> > > Calling
> > > > > > this
> > > > > > > >> > version of run_metplus.py will automatically use
the test
> > > > version
> > > > > of
> > > > > > > MET
> > > > > > > >> > unless you are overriding MET_INSTALL_DIR in your
config
> > > files.
> > > > > > > >> >
> > > > > > > >> > I generated images here:
> > > > > > > >> >
> > > > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-
test/tcmpr_plots
> > > > > > > >> >
> > > > > > > >> > Please take a look and verify that the output looks
> correct.
> > > Let
> > > > > me
> > > > > > > >> know if
> > > > > > > >> > you have any other questions or issues.
> > > > > > > >> >
> > > > > > > >> > Thanks,
> > > > > > > >> > George
> > > > > > > >> >
> > > > > > > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe <
> > > mccabe at ucar.edu>
> > > > > > > wrote:
> > > > > > > >> >
> > > > > > > >> > > Hi Guang Ping,
> > > > > > > >> > >
> > > > > > > >> > > I will make some modifications to the wrapper to
make it
> > > > easier
> > > > > to
> > > > > > > >> debug
> > > > > > > >> > > the error, as it is difficult to see what is
happening.
> I
> > > can
> > > > > put
> > > > > > > the
> > > > > > > >> > > changes on Hera so you can use that version to
test. I
> > will
> > > > let
> > > > > > you
> > > > > > > >> know
> > > > > > > >> > > when that is ready.
> > > > > > > >> > >
> > > > > > > >> > > Thanks,
> > > > > > > >> > > George
> > > > > > > >> > >
> > > > > > > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou - NOAA
> Affiliate
> > > via
> > > > > RT
> > > > > > <
> > > > > > > >> > > met_help at ucar.edu> wrote:
> > > > > > > >> > >
> > > > > > > >> > >>
> > > > > > > >> > >> <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > > >
> > > > > > > >> > >>
> > > > > > > >> > >> Hi George,
> > > > > > > >> > >>
> > > > > > > >> > >> Thanks for your quick response.
> > > > > > > >> > >> I modified the config file
> > > > > > > >> > >>
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > > > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > > > > >> > >> and still got the same error messages:
> > > > > > > >> > >>
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > > > > > > >> > >>
> > > > > > > >> > >> In your plot, you plotted only 1 model. What I
wanted
> is
> > > all
> > > > 3
> > > > > > > >> models'
> > > > > > > >> > >> stats be plotted on the same frame.
> > > > > > > >> > >>
> > > > > > > >> > >> Thanks again,
> > > > > > > >> > >> Guang Ping
> > > > > > > >> > >>
> > > > > > > >> > >>
> > > > > > > >> > >>
> > > > > > > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe
via RT <
> > > > > > > >> met_help at ucar.edu
> > > > > > > >> > >
> > > > > > > >> > >> wrote:
> > > > > > > >> > >>
> > > > > > > >> > >> > Hi Guang Ping,
> > > > > > > >> > >> >
> > > > > > > >> > >> > Sorry, I mistakenly thought the error in the
plotter
> > was
> > > > due
> > > > > to
> > > > > > > >> > missing
> > > > > > > >> > >> > data. It looks like it is failing because it
is not
> > > reading
> > > > > the
> > > > > > > >> > -filter
> > > > > > > >> > >> > options properly. Please try putting quotation
marks
> > > around
> > > > > the
> > > > > > > >> value
> > > > > > > >> > >> for
> > > > > > > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > > > > > > >> > >> >
> > > > > > > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel GFSO,EMX,CMC"
> > > > > > > >> > >> >
> > > > > > > >> > >> > Let me know if that does not work. If not, the
> wrapper
> > > will
> > > > > > have
> > > > > > > >> to be
> > > > > > > >> > >> > updated to add quotation marks around it. It
should
> > > really
> > > > do
> > > > > > > this
> > > > > > > >> > >> > automatically, so I can make that change when
I
> update
> > > the
> > > > > > > >> wrapper. I
> > > > > > > >> > >> will
> > > > > > > >> > >> > also modify it to output the log output and
make it
> > > easier
> > > > to
> > > > > > > copy
> > > > > > > >> the
> > > > > > > >> > >> > Rscript command to rerun it on the command
line for
> > > testing
> > > > > > > >> purposes.
> > > > > > > >> > I
> > > > > > > >> > >> was
> > > > > > > >> > >> > able to get output by running the following
command
> > > (using
> > > > > > only 1
> > > > > > > >> > input
> > > > > > > >> > >> > file):
> > > > > > > >> > >> >
> > > > > > > >> > >> > Rscript
> > > > > > /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > > > > > > >> > -config
> > > > > > > >> > >> >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > > > > > > >> > >> > -title "Extratropical Cyclone Track Error"
-subtitle
> > > > > "Forecast
> > > > > > > >> Hours"
> > > > > > > >> > >> -ylab
> > > > > > > >> > >> > "Track error (NM)" -filter "-amodel
GFSO,EMX,CMC"
> -dep
> > > > > > > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR -legend
"GFS"
> > > -plot
> > > > > > > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > > > > > > >> > >> >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > > > > > > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-
tcmpr
> > > > > > > >> > >> >
> > > > > > > >> > >> > Thanks,
> > > > > > > >> > >> > George
> > > > > > > >> > >> >
> > > > > > > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou -
NOAA
> > > Affiliate
> > > > > via
> > > > > > > RT <
> > > > > > > >> > >> > met_help at ucar.edu> wrote:
> > > > > > > >> > >> >
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > <URL:
> > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > > > > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > Hi George,
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > Thanks for the info. But the plotting is
supposed
> to
> > > > follow
> > > > > > the
> > > > > > > >> > >> > conversion
> > > > > > > >> > >> > > from regular pairs to .tcst pairs, which are
> > generated
> > > by
> > > > > the
> > > > > > > >> > command
> > > > > > > >> > >> > line.
> > > > > > > >> > >> > > All the .tcst pairs are in
> > > > > > > >> > >> > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > > > > > >> > >> > > after the command line:
> > > > > > > >> > >> > > master_metplus.py -c
> > > > > Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > > -c
> > > > > > > >> > >> > > usecase_7.conf
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > If that is not the case , where should the
path be
> > > > > specified?
> > > > > > > >> > >> > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > Thanks,
> > > > > > > >> > >> > > Guang Ping
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George
McCabe via
> RT
> > <
> > > > > > > >> > >> met_help at ucar.edu>
> > > > > > > >> > >> > > wrote:
> > > > > > > >> > >> > >
> > > > > > > >> > >> > > > Hi Guang Ping,
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > > > This error is due to a bug in the logic to
report
> > an
> > > > > error
> > > > > > in
> > > > > > > >> the
> > > > > > > >> > >> > > wrapper.
> > > > > > > >> > >> > > > This error is most likely happening
because the
> > input
> > > > > files
> > > > > > > >> passed
> > > > > > > >> > >> to
> > > > > > > >> > >> > the
> > > > > > > >> > >> > > > plotter are empty. You will need to change
the
> > > > > > configuration
> > > > > > > of
> > > > > > > >> > >> TCPairs
> > > > > > > >> > >> > > to
> > > > > > > >> > >> > > > get output lines. The error will go away
if there
> > is
> > > > data
> > > > > > > >> > available
> > > > > > > >> > >> to
> > > > > > > >> > >> > > > process.
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > > > - George
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang Lou
- NOAA
> > > > > Affiliate
> > > > > > > via
> > > > > > > >> > RT <
> > > > > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > <URL:
> > > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > Hi Minna,
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > Thanks for the update. I followed your
> suggestion
> > > and
> > > > > > there
> > > > > > > >> was
> > > > > > > >> > an
> > > > > > > >> > >> > > error
> > > > > > > >> > >> > > > > that says:
> > > > > > > >> > >> > > > >
> > > > > > > >> >
> > > >
------------------------------------------------------------------
> > > > > > > >> > >> > > > > File
> > > > > > > >> > "/contrib/METplus/METplus-
4.0.0/metplus/util/met_util.py",
> > > > > > > >> > >> > line
> > > > > > > >> > >> > > > 159,
> > > > > > > >> > >> > > > > in run_metplus
> > > > > > > >> > >> > > > > new_commands =
process.run_all_times()
> > > > > > > >> > >> > > > > File
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > > > > >> > >> > > > > line 261, in run_all_times
> > > > > > > >> > >> > > > > except
produtil.run.ExitStatusException as
> > ese:
> > > > > > > >> > >> > > > > NameError: name 'produtil' is not
defined
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > I looked up modules that related to the
> produtil,
> > > but
> > > > > > could
> > > > > > > >> not
> > > > > > > >> > >> find
> > > > > > > >> > >> > > any.
> > > > > > > >> > >> > > > > here is the Hera:
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> >
> > > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > > > > >> > >> > > > > my line command is:
> > > > > > > >> > >> > > > > master_metplus.py -c
> > > > > > > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > > > > > >> > >> > > > > usecase_7.conf
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > Thanks,
> > > > > > > >> > >> > > > > Guang Ping
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna
Win via
> RT
> > <
> > > > > > > >> > >> met_help at ucar.edu>
> > > > > > > >> > >> > > > > wrote:
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > > > Hello Guang Ping,
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > Julie has successfully installed the
changes
> to
> > > the
> > > > > > > >> > plot_tcmpr.R
> > > > > > > >> > >> > > script
> > > > > > > >> > >> > > > > on
> > > > > > > >> > >> > > > > > 'hera', with the following
instructions:
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > -------
> > > > > > > >> > >> > > > > > The changes to the plot_tcmpr.R script
are
> now
> > > > > > installed
> > > > > > > on
> > > > > > > >> > >> hera.
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > The user can run the following to
access this
> > new
> > > > > > version
> > > > > > > >> of
> > > > > > > >> > >> MET:
> > > > > > > >> > >> > > > > > module use -a
/contrib/anaconda/modulefiles
> > > > > > > >> > >> > > > > > module load intel/18.0.5.274
> > > > > > > >> > >> > > > > > module load anaconda/latest
> > > > > > > >> > >> > > > > > module use /contrib/met/modulefiles
> > > > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > If they are using METplus, they will
need to
> > run:
> > > > > > > >> > >> > > > > > module use
/contrib/METplus/modulefiles
> > > > > > > >> > >> > > > > > module load metplus/4.0.0
> > > > > > > >> > >> > > > > > module use /contrib/met/modulefiles/
> > > > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > > > >> > >> > > > > > And they will need to set
MET_INSTALL_DIR to
> > > > > > > >> > >> > > /contrib/met/10.0.0_test
> > > > > > > >> > >> > > > in
> > > > > > > >> > >> > > > > > their user config file.
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > If using the METplus wrapper to
generate the
> > > plots
> > > > > with
> > > > > > > all
> > > > > > > >> > the
> > > > > > > >> > >> > model
> > > > > > > >> > >> > > > > > points, you will need to turn off
event
> > > > equalization
> > > > > in
> > > > > > > >> your
> > > > > > > >> > >> > > > > >
Plotter_fcstGFS_obsGFS_RPlotting_3.conf file
> by
> > > > > setting
> > > > > > > the
> > > > > > > >> > >> > > following:
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > This will disable the event
equalization.
> Your
> > > > > sample
> > > > > > > data
> > > > > > > >> > >> didn't
> > > > > > > >> > >> > > have
> > > > > > > >> > >> > > > > > any overlapping tracks so no plots
were
> > generated
> > > > > when
> > > > > > > >> event
> > > > > > > >> > >> > > > equalization
> > > > > > > >> > >> > > > > > was enabled. You can leave MODEL
unassigned
> so
> > > > that
> > > > > > all
> > > > > > > >> > models
> > > > > > > >> > >> > will
> > > > > > > >> > >> > > be
> > > > > > > >> > >> > > > > > used (as long as all your tc-pairs
.tcst
> files
> > > are
> > > > in
> > > > > > the
> > > > > > > >> same
> > > > > > > >> > >> > > > > directory).
> > > > > > > >> > >> > > > > > If you want a subset of models, you
can set
> the
> > > > > > > following:
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > > > > > > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel
GFSO,EMX,CMC
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > to explicitly include only the GFSO,
CMC and
> > EMX
> > > > > models
> > > > > > > (or
> > > > > > > >> > >> > whatever
> > > > > > > >> > >> > > > > > models you wish) on your plots.
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > > Regards,
> > > > > > > >> > >> > > > > > Minna
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > > >
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > > >
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > > > --
> > > > > > > >> > >> > > > George McCabe - Software Engineer III
> > > > > > > >> > >> > > > National Center for Atmospheric Research
> > > > > > > >> > >> > > > Research Applications Laboratory
> > > > > > > >> > >> > > > 303-497-2768
> > > > > > > >> > >> > > > ---
> > > > > > > >> > >> > > > My working day may not be your working
day.
> Please
> > do
> > > > not
> > > > > > > feel
> > > > > > > >> > >> obliged
> > > > > > > >> > >> > to
> > > > > > > >> > >> > > > reply to this email outside of your normal
> working
> > > > hours.
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> > >
> > > > > > > >> > >> >
> > > > > > > >> > >> > --
> > > > > > > >> > >> > George McCabe - Software Engineer III
> > > > > > > >> > >> > National Center for Atmospheric Research
> > > > > > > >> > >> > Research Applications Laboratory
> > > > > > > >> > >> > 303-497-2768
> > > > > > > >> > >> > ---
> > > > > > > >> > >> > My working day may not be your working day.
Please do
> > not
> > > > > feel
> > > > > > > >> obliged
> > > > > > > >> > >> to
> > > > > > > >> > >> > reply to this email outside of your normal
working
> > hours.
> > > > > > > >> > >> >
> > > > > > > >> > >> >
> > > > > > > >> > >>
> > > > > > > >> > >>
> > > > > > > >> > >
> > > > > > > >> > > --
> > > > > > > >> > > George McCabe - Software Engineer III
> > > > > > > >> > > National Center for Atmospheric Research
> > > > > > > >> > > Research Applications Laboratory
> > > > > > > >> > > 303-497-2768
> > > > > > > >> > > ---
> > > > > > > >> > > My working day may not be your working day.
Please do
> not
> > > feel
> > > > > > > >> obliged to
> > > > > > > >> > > reply to this email outside of your normal
working
> hours.
> > > > > > > >> > >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> > --
> > > > > > > >> > George McCabe - Software Engineer III
> > > > > > > >> > National Center for Atmospheric Research
> > > > > > > >> > Research Applications Laboratory
> > > > > > > >> > 303-497-2768
> > > > > > > >> > ---
> > > > > > > >> > My working day may not be your working day. Please
do not
> > feel
> > > > > > obliged
> > > > > > > >> to
> > > > > > > >> > reply to this email outside of your normal working
hours.
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >>
> > > > > > > >
> > > > > > > > --
> > > > > > > > George McCabe - Software Engineer III
> > > > > > > > National Center for Atmospheric Research
> > > > > > > > Research Applications Laboratory
> > > > > > > > 303-497-2768
> > > > > > > > ---
> > > > > > > > My working day may not be your working day. Please do
not
> feel
> > > > > obliged
> > > > > > to
> > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > George McCabe - Software Engineer III
> > > > > > > National Center for Atmospheric Research
> > > > > > > Research Applications Laboratory
> > > > > > > 303-497-2768
> > > > > > > ---
> > > > > > > My working day may not be your working day. Please do
not feel
> > > > obliged
> > > > > to
> > > > > > > reply to this email outside of your normal working
hours.
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > George McCabe - Software Engineer III
> > > > > National Center for Atmospheric Research
> > > > > Research Applications Laboratory
> > > > > 303-497-2768
> > > > > ---
> > > > > My working day may not be your working day. Please do not
feel
> > obliged
> > > to
> > > > > reply to this email outside of your normal working hours.
> > > > >
> > > > >
> > > >
> > > >
> > >
> > > --
> > > George McCabe - Software Engineer III
> > > National Center for Atmospheric Research
> > > Research Applications Laboratory
> > > 303-497-2768
> > > ---
> > > My working day may not be your working day. Please do not feel
obliged
> to
> > > reply to this email outside of your normal working hours.
> > >
> > >
> >
> >
>
> --
> George McCabe - Software Engineer III
> National Center for Atmospheric Research
> Research Applications Laboratory
> 303-497-2768
> ---
> My working day may not be your working day. Please do not feel
obliged to
> reply to this email outside of your normal working hours.
>
>
------------------------------------------------
Subject: Plotting multiple models's track errors for extratropcial cyclones
From: George McCabe
Time: Mon Jun 07 15:12:27 2021
Hi Guang Ping,
It looks like you are referencing the variable name
TCMPR_PLOTTER_PLOT_LABELS and TCMPR_PLOTTER_DEP_LABELS, which is why
you
are seeing the entire list substituted. You will want to use
{dep_label}
and {plot_label} which will substitute each value in the list as it
loops
over them.
TCMPR_PLOTTER_TITLE = Extratropical Cyclone {plot_label}
TCMPR_PLOTTER_SUBTITLE = Forecast Hours
TCMPR_PLOTTER_XLAB =
TCMPR_PLOTTER_YLAB = {dep_label}
TCMPR_PLOTTER_DEP_LABELS corresponds to the values of
TCMPR_PLOTTER_DEP_VARS and
TCMPR_PLOTTER_PLOT_LABELS corresponds to the values of
TCMPR_PLOTTER_PLOT_TYPES, so the values you set for
TCMPR_PLOTTER_PLOT_LABELS are actually labels for MEAN,MEDIAN,BOXPLOT.
I
was envisioning the configuration to look something like this:
TCMPR_PLOTTER_DEP_VARS = AMSLP-BMSLP, AMAX_WIND-BMAX_WIND, TK_ERR
TCMPR_PLOTTER_DEP_LABELS = Pressure Error (MB), MAX wind Error, Track
error
(NM)
TCMPR_PLOTTER_PLOT_TYPES = MEAN,MEDIAN,BOXPLOT
TCMPR_PLOTTER_PLOT_LABELS = Mean, Median, Boxplot
TCMPR_PLOTTER_TITLE = Extratropical Cyclone {plot_label} {dep_label}
Which would produce the following titles:
Extratropical Cyclone Mean Pressure Error (MB)
Extratropical Cyclone Median Pressure Error (MB)
Extratropical Cyclone Boxplot Pressure Error (MB)
Extratropical Cyclone Mean MAX wind Error
Extratropical Cyclone Median MAX wind Error
Extratropical Cyclone Boxplot MAX wind Error
Extratropical Cyclone Mean Track error (NM)
Extratropical Cyclone Median Track error (NM)
Extratropical Cyclone Boxplot Track error (NM)
It sounds like you want to be able to have more than 1 string label
for
each dep or plot value in the list. Is that correct? If so, I could
modify
the logic to either:
* Support TCMPR_PLOTTER_DEP_LABELS_<n> and
TCMPR_PLOTTER_PLOT_LABELS_<n>
which could be referenced by {dep_label_1}, {dep_label_2},
{plot_label_1},
{plot_label_2}, etc.
OR
* Support TCMPR_PLOTTER_DEP_*TITLES*, TCMPR_PLOTTER_DEP*_LABELS*,
TCMPR_PLOTTER_PLOT_*TITLES*, and TCMPR_PLOTTER_PLOT*_LABELS* that
could be
referenced with {dep_title}, {dep_label}, {plot_title}, and
{plot_label}.
The latter would be quicker to implement and named clearly. The former
would be more flexible as you could create any number of labels to
reference in different places (filenames, ylab, title, etc.) but less
clear
what each set of labels is used for. Ultimately, we just want to
implement
a solution that will allow you to configure the tool the way you need
to
use it in the most intuitive way. I am open to other suggestions as
well.
Please let me know what you think and I can make the necessary
adjustments.
Thanks,
George
On Mon, Jun 7, 2021 at 2:10 PM Guang Lou - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
>
> Thanks, George!
> But the title and labels are not taken one by one. It just puts all
in the
> either title or label.
> For example,
> TCMPR_PLOTTER_DEP_VARS =AMSLP-BMSLP, AMAX_WIND-BMAX_WIND, TK_ERR
> TCMPR_PLOTTER_DEP_LABELS = Pressure Error (MB), MAX wind Error,
Track error
> (NM)
> TCMPR_PLOTTER_PLOT_LABELS = Mean Sea level pressure, MAX wind, Track
error
>
> What I wanted is AMSLP-BMSLP corresponds to Pressure Error (MB)
and Mean
> Sea level pressure
> MAX_WIND-BMAX_WIND corresponds to MAX
wind
> Error and MAX wind
> TK_ERR corresponds to Track error
(NM) and
> Track error
>
> Each line above is on one frame.
>
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2/tcmpr_plots8
> Thanks,
> Guang Ping
>
>
> On Mon, Jun 7, 2021 at 3:02 PM George McCabe via RT
<met_help at ucar.edu>
> wrote:
>
> > Hi Guang Ping,
> >
> > I see you have set the dep labels with:
> >
> > TCMPR_PLOTTER_DEP_LABELS = Mean Sea level pressure, MAX wind,
Position
> > error
> >
> > You will need to reference these values in the other variables
that you
> > want to change. For example, if you want to set the Y label (ylab)
for
> > each, you can reference {dep_label} in that variable. Instead of
setting:
> >
> > TCMPR_PLOTTER_YLAB = Track error (NM)
> >
> > you would set:
> >
> > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> >
> > You can also reference this tag in the title, i.e.:
> >
> > TCMPR_PLOTTER_TITLE = Extratropical Cyclone {dep_label}
> >
> > You can also reference:
> > - {dep} to get the actual value for each item in
TCMPR_PLOTTER_DEP_VARS.
> > - {plot} to get the values for each item in
TCMPR_PLOTTER_PLOT_TYPES
> > - {plot_label} to get the values for each item in
> TCMPR_PLOTTER_PLOT_LABELS
> >
> > You currently don't have TCMPR_PLOTTER_PLOT_LABELS set, so the
value
> > substituted for {plot_label} would be the same as {plot}.
> >
> > Let me know if that doesn't work or if you have other questions.
> >
> > Thanks,
> > George
> >
> > On Mon, Jun 7, 2021 at 11:51 AM Guang Lou - NOAA Affiliate via RT
<
> > met_help at ucar.edu> wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > >
> > > Hi George,
> > >
> > > Thanks for pointing that out. I thought the version had been
> implemented.
> > > Here is the command:
> > > /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf -c Plotter_8.conf
> > >
> > > The execution went through. But the labels are not changed.
> > > Could you give me a version of Plotter_8.conf so that the labels
would
> > > change per variable?
> > >
> > > Thanks,
> > > Guang Ping
> > >
> > >
> > > On Mon, Jun 7, 2021 at 1:23 PM George McCabe via RT
<met_help at ucar.edu
> >
> > > wrote:
> > >
> > > > Hi Guang Ping,
> > > >
> > > > Looking at your log output, it looks like you are not using
the
> version
> > > of
> > > > METplus from my scratch directory that has the changes needed
to run
> > with
> > > > the new settings. Instead of running run_metplus.py from the
path,
> run
> > it
> > > > from:
> > > >
> > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > >
> > > > - George
> > > >
> > > > On Mon, Jun 7, 2021 at 9:52 AM Guang Lou - NOAA Affiliate via
RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > >
> > > > > Hi George,
> > > > >
> > > > > The run directory is on Hera:
> > > > >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test_george2
> > > > > Line command:
> > > > > run_metplus.py -c Plotter_fcstGFS_obsGFS_RPlotting_8.conf
-c
> > > > > usecase_8.conf
> > > > >
> > > > > Thanks,
> > > > > Guang Ping
> > > > >
> > > > > On Mon, Jun 7, 2021 at 11:40 AM George McCabe via RT <
> > > met_help at ucar.edu>
> > > > > wrote:
> > > > >
> > > > > > Hi Guang Ping,
> > > > > >
> > > > > > Could you send me the command you ran that produced
errors?
> > > > > >
> > > > > > Thanks,
> > > > > > George
> > > > > >
> > > > > > On Fri, Jun 4, 2021 at 9:26 AM Guang Lou - NOAA Affiliate
via RT
> <
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> >
> > > > > > >
> > > > > > > Hi George,
> > > > > > >
> > > > > > > I was wondering if you could give me an example of the
config
> > files
> > > > > > running
> > > > > > > your new installation with your new label setup. I was
getting
> > > error
> > > > > > > messages when I ran. I assume your new installation is
still
> > > > met10.0.0
> > > > > > and
> > > > > > > Metplus-4.0.0.
> > > > > > >
> > > > > > > Thanks a lot!
> > > > > > > Guang Ping
> > > > > > >
> > > > > > > On Tue, Jun 1, 2021 at 6:28 PM George McCabe via RT <
> > > > met_help at ucar.edu
> > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi Guang Ping,
> > > > > > > >
> > > > > > > > I updated the version of METplus on Hera to include
the
> latest
> > > > > changes.
> > > > > > > > With this version, you can reference the dep/plot
labels for
> > each
> > > > > run:
> > > > > > > >
> > > > > > > > TCMPR_PLOTTER_DEP_VARS = TK_ERR
> > > > > > > > TCMPR_PLOTTER_DEP_LABELS = Track Error
> > > > > > > >
> > > > > > > > TCMPR_PLOTTER_TITLE = Extratropical Cyclone
{dep_label}
> > > > > > > > TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > > > > TCMPR_PLOTTER_XLAB =
> > > > > > > > TCMPR_PLOTTER_YLAB = {dep_label} (NM)
> > > > > > > >
> > > > > > > > {dep_label} will be substituted with the value of the
> > > > > > > > TCMPR_PLOTTER_DEP_LABELS list for the corresponding
> > > > > > > TCMPR_PLOTTER_DEP_VARS
> > > > > > > > value. The 2 lists should be the same length.
> > > > > > > >
> > > > > > > > You can similarly use {plot_labels} if you set
> > > > > > TCMPR_PLOTTER_PLOT_LABELS.
> > > > > > > >
> > > > > > > > Let me know if you have any issues setting that up.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > George
> > > > > > > >
> > > > > > > > On Thu, May 27, 2021 at 12:56 PM George McCabe <
> > mccabe at ucar.edu>
> > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi Guang Ping,
> > > > > > > > >
> > > > > > > > > 1.
> > > > > > > > > The image size is controlled by a variable in the
TCMPR
> > config
> > > > > file.
> > > > > > > Here
> > > > > > > > > is the setting that was used in the original that
sets it:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://github.com/dtcenter/METplus/blob/main_v4.0/parm/use_cases/met_tool_wrapper/TCMPRPlotter/TCMPRPlotterConfig_Customize
> > > > > > > > >
> > > > > > > > > img_res = 72;
> > > > > > > > >
> > > > > > > > > 2.
> > > > > > > > > This is the same issue that Yan ran into on another
MET
> help
> > > > > ticket.
> > > > > > I
> > > > > > > > > provided a work around to change the plot info and
> filenames
> > > for
> > > > > each
> > > > > > > > > variable. I am modifying TCMPRPlotter to loop over
the
> > > variables
> > > > to
> > > > > > run
> > > > > > > > > once for each and add a way to specify the label to
use for
> > > each.
> > > > > > This
> > > > > > > > > would allow you to use that label in the YLAB value.
I can
> > send
> > > > you
> > > > > > the
> > > > > > > > > updated version to test when that is ready.
> > > > > > > > >
> > > > > > > > > 3.
> > > > > > > > > Yes, if R is not available then the TCMPRPlotter
will not
> > work.
> > > > The
> > > > > > > > > eventual plan is to migrate the R scripts to Python,
but
> this
> > > may
> > > > > not
> > > > > > > > > happen for a while unless this is needed more
urgently.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > George
> > > > > > > > >
> > > > > > > > > On Thu, May 27, 2021 at 12:32 PM Guang Lou - NOAA
Affiliate
> > via
> > > > RT
> > > > > <
> > > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > > >
> > > > > > > > >>
> > > > > > > > >> <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > >
> > > > > > > > >>
> > > > > > > > >> Hi George,
> > > > > > > > >>
> > > > > > > > >> Thank you so much for making it work!
> > > > > > > > >> I ran your temporary script
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > > > > >>
> > > > > > > > >> and it was able to generate multiple lines in the
same
> > frame.
> > > > > Please
> > > > > > > > see:
> > > > > > > > >>
> > > > > >
> > > https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMSLP-
BMSLP_mean.png
> > > > > > > > >>
> > > >
https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/TK_ERR_mean.png
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://www.emc.ncep.noaa.gov/mmb/gplou/metplots/AMAX_WIND-
BMAX_WIND_mean.png
> > > > > > > > >>
> > > > > > > > >> Now there are some finer points that I would like
to ask
> > you:
> > > > > > > > >> 1. The plots become huge if we click the picture to
zoom
> in.
> > > > This
> > > > > is
> > > > > > > > true
> > > > > > > > >> when we use the "display" command on Hera or other
> machines.
> > > > > > > > >> I think the original plots that were generated
by the
> > > > earlier
> > > > > > > > scripts
> > > > > > > > >> do not have this issue.
> > > > > > > > >> 2. The X-Y labels are all the same. How do we
change the
> > label
> > > > > > > according
> > > > > > > > >> to
> > > > > > > > >> the variables?
> > > > > > > > >> In the config file,
> > > > > > > > >> TCMPR_PLOTTER_TITLE = Extratropical Cyclone Track
Error
> > > > > > > > >> TCMPR_PLOTTER_SUBTITLE = Forecast Hours
> > > > > > > > >> TCMPR_PLOTTER_XLAB =
> > > > > > > > >> TCMPR_PLOTTER_YLAB = Track error (NM)
> > > > > > > > >> All plots have the same labels assigned above.
How
> can I
> > > > > assign
> > > > > > > > >> different labels for different variable plots?
> > > > > > > > >> 3. Your new version works on Hera, I am assuming
that it
> > will
> > > > not
> > > > > > work
> > > > > > > > on
> > > > > > > > >> WCOSS because WCOSS does not have the R-library, Am
I
> > correct?
> > > > > > > > >> John (Gotway) mentioned that MET is going to use
METcalcpy
> > and
> > > > > > > METplotpy
> > > > > > > > >> in
> > > > > > > > >> the future, would this include the cyclone plots?
> > > > > > > > >>
> > > > > > > > >> Sorry that I have so many questions. I deeply
appreciate
> > your
> > > > > help.
> > > > > > > > >>
> > > > > > > > >> Thanks,
> > > > > > > > >> Guang Ping
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >> On Thu, May 27, 2021 at 10:46 AM George McCabe via
RT <
> > > > > > > > met_help at ucar.edu>
> > > > > > > > >> wrote:
> > > > > > > > >>
> > > > > > > > >> > Hi Guang Ping,
> > > > > > > > >> >
> > > > > > > > >> > I put a version of METplus for you to test using
> > > TCMPRPlotter.
> > > > > To
> > > > > > > use
> > > > > > > > >> this
> > > > > > > > >> > version, run the module commands to set up
METplus, then
> > > > instead
> > > > > > of
> > > > > > > > >> calling
> > > > > > > > >> > run_metplus.py from the path, call the version in
my
> > scratch
> > > > > > > > directory,
> > > > > > > > >> > passing in your config files normally.
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
/home/George.Mccabe/scratch1_George.Mccabe/METplus.feature_926/ush/run_metplus.py
> > > > > > > > >> >
> > > > > > > > >> > I ran using your config file from your previous
email
> and
> > > was
> > > > > able
> > > > > > > to
> > > > > > > > >> view
> > > > > > > > >> > the log output from the R script in the METplus
log
> file.
> > > The
> > > > > > first
> > > > > > > > >> attempt
> > > > > > > > >> > failed due to the bug that requires -bmodel to be
set,
> so
> > I
> > > > > > changed
> > > > > > > > the
> > > > > > > > >> > default configuration to use the testing version
of MET
> > that
> > > > > Minna
> > > > > > > and
> > > > > > > > >> > Julie made available on Hera
(/contrib/met/10.0.0_test).
> > > > Calling
> > > > > > > this
> > > > > > > > >> > version of run_metplus.py will automatically use
the
> test
> > > > > version
> > > > > > of
> > > > > > > > MET
> > > > > > > > >> > unless you are overriding MET_INSTALL_DIR in your
config
> > > > files.
> > > > > > > > >> >
> > > > > > > > >> > I generated images here:
> > > > > > > > >> >
> > > > > /home/George.Mccabe/scratch1_George.Mccabe/tcmpr-
test/tcmpr_plots
> > > > > > > > >> >
> > > > > > > > >> > Please take a look and verify that the output
looks
> > correct.
> > > > Let
> > > > > > me
> > > > > > > > >> know if
> > > > > > > > >> > you have any other questions or issues.
> > > > > > > > >> >
> > > > > > > > >> > Thanks,
> > > > > > > > >> > George
> > > > > > > > >> >
> > > > > > > > >> > On Wed, May 26, 2021 at 2:59 PM George McCabe <
> > > > mccabe at ucar.edu>
> > > > > > > > wrote:
> > > > > > > > >> >
> > > > > > > > >> > > Hi Guang Ping,
> > > > > > > > >> > >
> > > > > > > > >> > > I will make some modifications to the wrapper
to make
> it
> > > > > easier
> > > > > > to
> > > > > > > > >> debug
> > > > > > > > >> > > the error, as it is difficult to see what is
> happening.
> > I
> > > > can
> > > > > > put
> > > > > > > > the
> > > > > > > > >> > > changes on Hera so you can use that version to
test. I
> > > will
> > > > > let
> > > > > > > you
> > > > > > > > >> know
> > > > > > > > >> > > when that is ready.
> > > > > > > > >> > >
> > > > > > > > >> > > Thanks,
> > > > > > > > >> > > George
> > > > > > > > >> > >
> > > > > > > > >> > > On Wed, May 26, 2021 at 2:20 PM Guang Lou -
NOAA
> > Affiliate
> > > > via
> > > > > > RT
> > > > > > > <
> > > > > > > > >> > > met_help at ucar.edu> wrote:
> > > > > > > > >> > >
> > > > > > > > >> > >>
> > > > > > > > >> > >> <URL:
> > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > > > >
> > > > > > > > >> > >>
> > > > > > > > >> > >> Hi George,
> > > > > > > > >> > >>
> > > > > > > > >> > >> Thanks for your quick response.
> > > > > > > > >> > >> I modified the config file
> > > > > > > > >> > >>
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > > > > >> > >> to TCMPR_PLOTTER_FILTER = "-amodel
GFSO,EMX,CMC"
> > > > > > > > >> > >> and still got the same error messages:
> > > > > > > > >> > >>
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526200601
> > > > > > > > >> > >>
> > > > > > > > >> > >> In your plot, you plotted only 1 model. What I
wanted
> > is
> > > > all
> > > > > 3
> > > > > > > > >> models'
> > > > > > > > >> > >> stats be plotted on the same frame.
> > > > > > > > >> > >>
> > > > > > > > >> > >> Thanks again,
> > > > > > > > >> > >> Guang Ping
> > > > > > > > >> > >>
> > > > > > > > >> > >>
> > > > > > > > >> > >>
> > > > > > > > >> > >> On Wed, May 26, 2021 at 3:54 PM George McCabe
via RT
> <
> > > > > > > > >> met_help at ucar.edu
> > > > > > > > >> > >
> > > > > > > > >> > >> wrote:
> > > > > > > > >> > >>
> > > > > > > > >> > >> > Hi Guang Ping,
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > Sorry, I mistakenly thought the error in the
> plotter
> > > was
> > > > > due
> > > > > > to
> > > > > > > > >> > missing
> > > > > > > > >> > >> > data. It looks like it is failing because it
is not
> > > > reading
> > > > > > the
> > > > > > > > >> > -filter
> > > > > > > > >> > >> > options properly. Please try putting
quotation
> marks
> > > > around
> > > > > > the
> > > > > > > > >> value
> > > > > > > > >> > >> for
> > > > > > > > >> > >> > TCMPR_PLOTTER_FILTER to see if that helps.
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > TCMPR_PLOTTER_FILTER = "-amodel
GFSO,EMX,CMC"
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > Let me know if that does not work. If not,
the
> > wrapper
> > > > will
> > > > > > > have
> > > > > > > > >> to be
> > > > > > > > >> > >> > updated to add quotation marks around it. It
should
> > > > really
> > > > > do
> > > > > > > > this
> > > > > > > > >> > >> > automatically, so I can make that change
when I
> > update
> > > > the
> > > > > > > > >> wrapper. I
> > > > > > > > >> > >> will
> > > > > > > > >> > >> > also modify it to output the log output and
make it
> > > > easier
> > > > > to
> > > > > > > > copy
> > > > > > > > >> the
> > > > > > > > >> > >> > Rscript command to rerun it on the command
line for
> > > > testing
> > > > > > > > >> purposes.
> > > > > > > > >> > I
> > > > > > > > >> > >> was
> > > > > > > > >> > >> > able to get output by running the following
command
> > > > (using
> > > > > > > only 1
> > > > > > > > >> > input
> > > > > > > > >> > >> > file):
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > Rscript
> > > > > > > /contrib/met/10.0.0_test/share/met/Rscripts/plot_tcmpr.R
> > > > > > > > >> > -config
> > > > > > > > >> > >> >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /contrib/METplus/METplus-
4.0.0/parm/use_cases/model_applications/tc_and_extra_tc/Plotter_fcstGFS_obsGFS_RPlotting/TCMPRPlotterConfig_customize
> > > > > > > > >> > >> > -title "Extratropical Cyclone Track Error"
> -subtitle
> > > > > > "Forecast
> > > > > > > > >> Hours"
> > > > > > > > >> > >> -ylab
> > > > > > > > >> > >> > "Track error (NM)" -filter "-amodel
GFSO,EMX,CMC"
> > -dep
> > > > > > > > >> > >> > AMSLP-BMSLP,AMAX_WIND-BMAX_WIND,TK_ERR
-legend
> "GFS"
> > > > -plot
> > > > > > > > >> > >> > MEAN,MEDIAN,BOXPLOT -no_ee -lookin
> > > > > > > > >> > >> >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020010100.gfso.0217.tcst
> > > > > > > > >> > >> > -outdir /scratch1/BMC/dtc/George.Mccabe/out-
tcmpr
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > Thanks,
> > > > > > > > >> > >> > George
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > On Wed, May 26, 2021 at 1:19 PM Guang Lou -
NOAA
> > > > Affiliate
> > > > > > via
> > > > > > > > RT <
> > > > > > > > >> > >> > met_help at ucar.edu> wrote:
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > <URL:
> > > > > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800
> > > > > > > > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > Hi George,
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > Thanks for the info. But the plotting is
supposed
> > to
> > > > > follow
> > > > > > > the
> > > > > > > > >> > >> > conversion
> > > > > > > > >> > >> > > from regular pairs to .tcst pairs, which
are
> > > generated
> > > > by
> > > > > > the
> > > > > > > > >> > command
> > > > > > > > >> > >> > line.
> > > > > > > > >> > >> > > All the .tcst pairs are in
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/tc_pairs/202001/mlq2020*.tcst
> > > > > > > > >> > >> > > after the command line:
> > > > > > > > >> > >> > > master_metplus.py -c
> > > > > > Plotter_fcstGFS_obsGFS_RPlotting_7.conf
> > > > > > > -c
> > > > > > > > >> > >> > > usecase_7.conf
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > If that is not the case , where should the
path
> be
> > > > > > specified?
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs/metplus.log.20210526153320
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > Thanks,
> > > > > > > > >> > >> > > Guang Ping
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > On Wed, May 26, 2021 at 2:13 PM George
McCabe via
> > RT
> > > <
> > > > > > > > >> > >> met_help at ucar.edu>
> > > > > > > > >> > >> > > wrote:
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > > > Hi Guang Ping,
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > > > This error is due to a bug in the logic
to
> report
> > > an
> > > > > > error
> > > > > > > in
> > > > > > > > >> the
> > > > > > > > >> > >> > > wrapper.
> > > > > > > > >> > >> > > > This error is most likely happening
because the
> > > input
> > > > > > files
> > > > > > > > >> passed
> > > > > > > > >> > >> to
> > > > > > > > >> > >> > the
> > > > > > > > >> > >> > > > plotter are empty. You will need to
change the
> > > > > > > configuration
> > > > > > > > of
> > > > > > > > >> > >> TCPairs
> > > > > > > > >> > >> > > to
> > > > > > > > >> > >> > > > get output lines. The error will go away
if
> there
> > > is
> > > > > data
> > > > > > > > >> > available
> > > > > > > > >> > >> to
> > > > > > > > >> > >> > > > process.
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > > > - George
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > > > On Wed, May 26, 2021 at 11:51 AM Guang
Lou -
> NOAA
> > > > > > Affiliate
> > > > > > > > via
> > > > > > > > >> > RT <
> > > > > > > > >> > >> > > > met_help at ucar.edu> wrote:
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > <URL:
> > > > > > > > >>
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=99800 >
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > Hi Minna,
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > Thanks for the update. I followed your
> > suggestion
> > > > and
> > > > > > > there
> > > > > > > > >> was
> > > > > > > > >> > an
> > > > > > > > >> > >> > > error
> > > > > > > > >> > >> > > > > that says:
> > > > > > > > >> > >> > > > >
> > > > > > > > >> >
> > > > >
------------------------------------------------------------------
> > > > > > > > >> > >> > > > > File
> > > > > > > > >> >
> "/contrib/METplus/METplus-4.0.0/metplus/util/met_util.py",
> > > > > > > > >> > >> > line
> > > > > > > > >> > >> > > > 159,
> > > > > > > > >> > >> > > > > in run_metplus
> > > > > > > > >> > >> > > > > new_commands =
process.run_all_times()
> > > > > > > > >> > >> > > > > File
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> "/contrib/METplus/METplus-
4.0.0/metplus/wrappers/tcmpr_plotter_wrapper.py",
> > > > > > > > >> > >> > > > > line 261, in run_all_times
> > > > > > > > >> > >> > > > > except
produtil.run.ExitStatusException
> as
> > > ese:
> > > > > > > > >> > >> > > > > NameError: name 'produtil' is not
defined
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
---------------------------------------------------------------------------
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > I looked up modules that related to
the
> > produtil,
> > > > but
> > > > > > > could
> > > > > > > > >> not
> > > > > > > > >> > >> find
> > > > > > > > >> > >> > > any.
> > > > > > > > >> > >> > > > > here is the Hera:
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> /scratch2/NCEPDEV/fv3-
cam/noscrub/Guang.Ping.Lou/metplus_test2/met_out7/logs
> > > > > > > > >> > >> > > > > my line command is:
> > > > > > > > >> > >> > > > > master_metplus.py -c
> > > > > > > > >> Plotter_fcstGFS_obsGFS_RPlotting_7.conf -c
> > > > > > > > >> > >> > > > > usecase_7.conf
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > Thanks,
> > > > > > > > >> > >> > > > > Guang Ping
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > On Fri, May 21, 2021 at 4:22 PM Minna
Win via
> > RT
> > > <
> > > > > > > > >> > >> met_help at ucar.edu>
> > > > > > > > >> > >> > > > > wrote:
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > > > Hello Guang Ping,
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > Julie has successfully installed the
> changes
> > to
> > > > the
> > > > > > > > >> > plot_tcmpr.R
> > > > > > > > >> > >> > > script
> > > > > > > > >> > >> > > > > on
> > > > > > > > >> > >> > > > > > 'hera', with the following
instructions:
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > -------
> > > > > > > > >> > >> > > > > > The changes to the plot_tcmpr.R
script are
> > now
> > > > > > > installed
> > > > > > > > on
> > > > > > > > >> > >> hera.
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > The user can run the following to
access
> this
> > > new
> > > > > > > version
> > > > > > > > >> of
> > > > > > > > >> > >> MET:
> > > > > > > > >> > >> > > > > > module use -a
/contrib/anaconda/modulefiles
> > > > > > > > >> > >> > > > > > module load intel/18.0.5.274
> > > > > > > > >> > >> > > > > > module load anaconda/latest
> > > > > > > > >> > >> > > > > > module use /contrib/met/modulefiles
> > > > > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > If they are using METplus, they will
need
> to
> > > run:
> > > > > > > > >> > >> > > > > > module use
/contrib/METplus/modulefiles
> > > > > > > > >> > >> > > > > > module load metplus/4.0.0
> > > > > > > > >> > >> > > > > > module use /contrib/met/modulefiles/
> > > > > > > > >> > >> > > > > > module load met/10.0.0_test
> > > > > > > > >> > >> > > > > > And they will need to set
MET_INSTALL_DIR
> to
> > > > > > > > >> > >> > > /contrib/met/10.0.0_test
> > > > > > > > >> > >> > > > in
> > > > > > > > >> > >> > > > > > their user config file.
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > If using the METplus wrapper to
generate
> the
> > > > plots
> > > > > > with
> > > > > > > > all
> > > > > > > > >> > the
> > > > > > > > >> > >> > model
> > > > > > > > >> > >> > > > > > points, you will need to turn off
event
> > > > > equalization
> > > > > > in
> > > > > > > > >> your
> > > > > > > > >> > >> > > > > >
Plotter_fcstGFS_obsGFS_RPlotting_3.conf
> file
> > by
> > > > > > setting
> > > > > > > > the
> > > > > > > > >> > >> > > following:
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > TCMPR_PLOTTER_NO_EE = yes
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > This will disable the event
equalization.
> > Your
> > > > > > sample
> > > > > > > > data
> > > > > > > > >> > >> didn't
> > > > > > > > >> > >> > > have
> > > > > > > > >> > >> > > > > > any overlapping tracks so no plots
were
> > > generated
> > > > > > when
> > > > > > > > >> event
> > > > > > > > >> > >> > > > equalization
> > > > > > > > >> > >> > > > > > was enabled. You can leave MODEL
> unassigned
> > so
> > > > > that
> > > > > > > all
> > > > > > > > >> > models
> > > > > > > > >> > >> > will
> > > > > > > > >> > >> > > be
> > > > > > > > >> > >> > > > > > used (as long as all your tc-pairs
.tcst
> > files
> > > > are
> > > > > in
> > > > > > > the
> > > > > > > > >> same
> > > > > > > > >> > >> > > > > directory).
> > > > > > > > >> > >> > > > > > If you want a subset of models, you
can set
> > the
> > > > > > > > following:
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > MODEL = GFSO,CMC,EMX
> > > > > > > > >> > >> > > > > > TCMPR_PLOTTER_FILTER = -amodel
GFSO,EMX,CMC
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > to explicitly include only the GFSO,
CMC
> and
> > > EMX
> > > > > > models
> > > > > > > > (or
> > > > > > > > >> > >> > whatever
> > > > > > > > >> > >> > > > > > models you wish) on your plots.
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > > Regards,
> > > > > > > > >> > >> > > > > > Minna
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > > >
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > > >
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > > > --
> > > > > > > > >> > >> > > > George McCabe - Software Engineer III
> > > > > > > > >> > >> > > > National Center for Atmospheric Research
> > > > > > > > >> > >> > > > Research Applications Laboratory
> > > > > > > > >> > >> > > > 303-497-2768
> > > > > > > > >> > >> > > > ---
> > > > > > > > >> > >> > > > My working day may not be your working
day.
> > Please
> > > do
> > > > > not
> > > > > > > > feel
> > > > > > > > >> > >> obliged
> > > > > > > > >> > >> > to
> > > > > > > > >> > >> > > > reply to this email outside of your
normal
> > working
> > > > > hours.
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> > >
> > > > > > > > >> > >> >
> > > > > > > > >> > >> > --
> > > > > > > > >> > >> > George McCabe - Software Engineer III
> > > > > > > > >> > >> > National Center for Atmospheric Research
> > > > > > > > >> > >> > Research Applications Laboratory
> > > > > > > > >> > >> > 303-497-2768
> > > > > > > > >> > >> > ---
> > > > > > > > >> > >> > My working day may not be your working day.
Please
> do
> > > not
> > > > > > feel
> > > > > > > > >> obliged
> > > > > > > > >> > >> to
> > > > > > > > >> > >> > reply to this email outside of your normal
working
> > > hours.
> > > > > > > > >> > >> >
> > > > > > > > >> > >> >
> > > > > > > > >> > >>
> > > > > > > > >> > >>
> > > > > > > > >> > >
> > > > > > > > >> > > --
> > > > > > > > >> > > George McCabe - Software Engineer III
> > > > > > > > >> > > National Center for Atmospheric Research
> > > > > > > > >> > > Research Applications Laboratory
> > > > > > > > >> > > 303-497-2768
> > > > > > > > >> > > ---
> > > > > > > > >> > > My working day may not be your working day.
Please do
> > not
> > > > feel
> > > > > > > > >> obliged to
> > > > > > > > >> > > reply to this email outside of your normal
working
> > hours.
> > > > > > > > >> > >
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >> > --
> > > > > > > > >> > George McCabe - Software Engineer III
> > > > > > > > >> > National Center for Atmospheric Research
> > > > > > > > >> > Research Applications Laboratory
> > > > > > > > >> > 303-497-2768
> > > > > > > > >> > ---
> > > > > > > > >> > My working day may not be your working day.
Please do
> not
> > > feel
> > > > > > > obliged
> > > > > > > > >> to
> > > > > > > > >> > reply to this email outside of your normal
working
> hours.
> > > > > > > > >> >
> > > > > > > > >> >
> > > > > > > > >>
> > > > > > > > >>
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > George McCabe - Software Engineer III
> > > > > > > > > National Center for Atmospheric Research
> > > > > > > > > Research Applications Laboratory
> > > > > > > > > 303-497-2768
> > > > > > > > > ---
> > > > > > > > > My working day may not be your working day. Please
do not
> > feel
> > > > > > obliged
> > > > > > > to
> > > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > George McCabe - Software Engineer III
> > > > > > > > National Center for Atmospheric Research
> > > > > > > > Research Applications Laboratory
> > > > > > > > 303-497-2768
> > > > > > > > ---
> > > > > > > > My working day may not be your working day. Please do
not
> feel
> > > > > obliged
> > > > > > to
> > > > > > > > reply to this email outside of your normal working
hours.
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > George McCabe - Software Engineer III
> > > > > > National Center for Atmospheric Research
> > > > > > Research Applications Laboratory
> > > > > > 303-497-2768
> > > > > > ---
> > > > > > My working day may not be your working day. Please do not
feel
> > > obliged
> > > > to
> > > > > > reply to this email outside of your normal working hours.
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > > --
> > > > George McCabe - Software Engineer III
> > > > National Center for Atmospheric Research
> > > > Research Applications Laboratory
> > > > 303-497-2768
> > > > ---
> > > > My working day may not be your working day. Please do not feel
> obliged
> > to
> > > > reply to this email outside of your normal working hours.
> > > >
> > > >
> > >
> > >
> >
> > --
> > George McCabe - Software Engineer III
> > National Center for Atmospheric Research
> > Research Applications Laboratory
> > 303-497-2768
> > ---
> > My working day may not be your working day. Please do not feel
obliged to
> > reply to this email outside of your normal working hours.
> >
> >
>
>
--
George McCabe - Software Engineer III
National Center for Atmospheric Research
Research Applications Laboratory
303-497-2768
---
My working day may not be your working day. Please do not feel obliged
to
reply to this email outside of your normal working hours.
------------------------------------------------
More information about the Met_help
mailing list