[Met_help] [rt.rap.ucar.edu #86735] History for Re: MET point stat using Hurricane Hunter Dropsonde data

Tue Jul 9 12:07:26 MDT 2019

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Hi John,

Did you had time to look into this?

Thanks,

Keren

On Thu, Aug 16, 2018 at 11:42 AM, Keren Rosado - NOAA Affiliate <
keren.rosado at noaa.gov> wrote:

> Hi John,
>
> It was nice meeting you yesterday and thanks for your help.
>
> As we discussed yesterday, I will write you the steps I did to get the
> temperature profiles I showed you using point_stat with model output and
> observations from Hurricane Hunter dropsondes.
>
> In the /scratch4/BMC/fim/Keren.Rosado/MET/data/sample_obs/dropsonde
> directory I have nine subdirectories starting in 2016*
>
> I went into each text file looking for the observation time (added into
> the text name "_##.txt") and created a netcdf file for their corresponding
> forecast hour using ascii2nc.
> For example  in the directory 20160929N1 I created a netcdf file
> 0929_24.nc using all the text files ending in 19,20,21,22,23.
>
> The model output location is: /scratch4/BMC/fim/Keren.
> Rosado/MET/data/sample_fcst/2016092900
> The Configure file location is: /scratch4/BMC/fim/Keren.
> Rosado/MET/tutorial_Matthew_GF/config/SAS_PointStatConfig
>
> Then I typed the following point_stat command for each observation time
> matching model output time.
>
>
> point_stat /scratch4/BMC/fim/Keren.Rosado/MET/data/sample_fcst/2016092900
> /gfs.t00z.pgrb2.0p25.f024 /scratch4/BMC/fim/Keren.
> Rosado/MET/data/sample_obs/dropsonde/20160929N1/0929_24.nc
> /scratch4/BMC/fim/Keren.Rosado/MET/tutorial_Matthew_
> GF/config/SAS_PointStatConfig
>
> -outdir /scratch4/BMC/fim/Keren.Rosado/MET/tutorial_Matthew_
> GF/out/point_stat
>
> -v 3
>
> -log /scratch4/BMC/fim/Keren.Rosado/MET/tutorial_Matthew_
> GF/out/point_stat/24.log
>
>
> The point_stat output is located at: /scratch4/BMC/fim/Keren.
> Rosado/MET/tutorial_Matthew_GF/out/point_stat/sas_Matthew_
> 13km_drop_m_all/2016092900/point_stat
>
>
>
> Let me know if you need me to clarify you something.
>
>
>
> Thanks,
>
>
> Keren
>

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: Re: MET point stat using Hurricane Hunter Dropsonde data
From: John Halley Gotway
Time: Mon Aug 27 17:25:51 2018

Keren,

My apologies for the long delay in getting back to you.  I've been
pretty
focused on development work for the next release.

Thanks for sending all of these details.  I see how you're processing
the
data and the logical flow makes sense to me.  I'd just recommend a few
changes to the configuration file you're using when you run Point-
Stat.
Based on your config file, it looks like you're concerned with TMP and
RH.
And using wgrib2 to look at the model data, I see output for the
following
pressure levels:

0.4 mb, 1 mb, 2 mb, 3 mb, 5 mb, 7 mb, 10 mb, 15 mb, 20 mb, 30 mb, 40
mb, 50
mb, 70 mb, 100 mb, 150 mb, 200 mb, 250 mb, 300 mb, 350 mb, 400 mb, 450
mb,
500 mb, 550 mb, 600 mb, 650 mb, 700 mb, 750 mb, 800 mb, 850 mb, 900
mb, 925
mb, 950 mb, 975 mb, 1000 mb

You've configured Point-Stat to verify many small ranges of pressure
levels:
"P1010-1000","P1000-990","P990-980" ... and so on.

Looking carefully at the Point-Stat log messages, you get many warning
about finding no forecast data, like this:
WARNING: MetGrib2DataFile::data_plane_array() - No matching records
found
for 'TMP/P990-980'
WARNING: MetGrib2DataFile::data_plane_array() - No matching records
found
for 'TMP/P970-960'
...

So I suggest we refine what levels you actually verify.  There's
several
ways you could set up the logic, but one option would be this...
Verify
each forecast pressure level using point observations that fall within
+/-
10mb of it.   For example, verify a forecast of 500mb with obs that
are
from 490 to 510.  I stopped at 100mb, because that's where you stopped
in
your original config.  That's what I've done in the attached config
file.

I also got rid of 'cat_thresh = [ >0 ];' since >0 is not really a
meaningful threshold for temperature.  As you go up in the atmosphere,
meaning thresholds change a lot.  So instead, I configured it to only
write
continuous statistics and partial sums (CNT and SL1L2 line types).

Lastly, the "obs_window" is set to be +/- 86400 seconds!  That's a
full
24-hours.  I'd suggest making that a much tighter window.  Perhaps +/-
30
minutes of 1 hour.

Thanks,
John

On Thu, Aug 23, 2018 at 9:26 AM Keren Rosado - NOAA Affiliate via RT <
met_help at ucar.edu> wrote:

>
> Thu Aug 23 09:25:57 2018: Request 86735 was acted upon.
> Transaction: Ticket created by keren.rosado at noaa.gov
>        Queue: met_help
>      Subject: Re: MET point stat using Hurricane Hunter Dropsonde
data
>        Owner: Nobody
>   Requestors: keren.rosado at noaa.gov
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=86735 >
>
>
> Hi John,
>
>
> Did you had time to look into this?
>
>
> Thanks,
>
> Keren
>
>
>
> On Thu, Aug 16, 2018 at 11:42 AM, Keren Rosado - NOAA Affiliate <
> keren.rosado at noaa.gov> wrote:
>
> > Hi John,
> >
> > It was nice meeting you yesterday and thanks for your help.
> >
> > As we discussed yesterday, I will write you the steps I did to get
the
> > temperature profiles I showed you using point_stat with model
output and
> > observations from Hurricane Hunter dropsondes.
> >
> > In the
/scratch4/BMC/fim/Keren.Rosado/MET/data/sample_obs/dropsonde
> > directory I have nine subdirectories starting in 2016*
> >
> > I went into each text file looking for the observation time (added
into
> > the text name "_##.txt") and created a netcdf file for their
> corresponding
> > forecast hour using ascii2nc.
> > For example  in the directory 20160929N1 I created a netcdf file
> > 0929_24.nc using all the text files ending in 19,20,21,22,23.
> >
> > The model output location is: /scratch4/BMC/fim/Keren.
> > Rosado/MET/data/sample_fcst/2016092900
> > The Configure file location is: /scratch4/BMC/fim/Keren.
> > Rosado/MET/tutorial_Matthew_GF/config/SAS_PointStatConfig
> >
> > Then I typed the following point_stat command for each observation
time
> > matching model output time.
> >
> >
> > point_stat
/scratch4/BMC/fim/Keren.Rosado/MET/data/sample_fcst/2016092900
> > /gfs.t00z.pgrb2.0p25.f024 /scratch4/BMC/fim/Keren.
> > Rosado/MET/data/sample_obs/dropsonde/20160929N1/0929_24.nc
> > /scratch4/BMC/fim/Keren.Rosado/MET/tutorial_Matthew_
> > GF/config/SAS_PointStatConfig
> >
> > -outdir /scratch4/BMC/fim/Keren.Rosado/MET/tutorial_Matthew_
> > GF/out/point_stat
> >
> > -v 3
> >
> > -log /scratch4/BMC/fim/Keren.Rosado/MET/tutorial_Matthew_
> > GF/out/point_stat/24.log
> >
> >
> > The point_stat output is located at: /scratch4/BMC/fim/Keren.
> > Rosado/MET/tutorial_Matthew_GF/out/point_stat/sas_Matthew_
> > 13km_drop_m_all/2016092900/point_stat
> >
> >
> >
> > Let me know if you need me to clarify you something.
> >
> >
> >
> > Thanks,
> >
> >
> > Keren
> >
>
>

------------------------------------------------