[Met_help] [rt.rap.ucar.edu #84526] History for error with Stat_analysis_pstd

Mon Mar 26 09:49:29 MDT 2018

----------------------------------------------------------------
  Initial Request
----------------------------------------------------------------

Zhang, Mandy has shared OneDrive for Business files with you. To view them, click the links below.

<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EX50E7zux3xIsLqRfo34njMBgGBP7X0vlKTNTjiAelx8aA>
[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EX50E7zux3xIsLqRfo34njMBgGBP7X0vlKTNTjiAelx8aA>

run_mpr.log<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EX50E7zux3xIsLqRfo34njMBgGBP7X0vlKTNTjiAelx8aA>

<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EabEcFZQDp9NvrZwK0UEJLcB943QJQAcPb-edx5YRzeVPA>
[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EabEcFZQDp9NvrZwK0UEJLcB943QJQAcPb-edx5YRzeVPA>

run_pct.log<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EabEcFZQDp9NvrZwK0UEJLcB943QJQAcPb-edx5YRzeVPA>

<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EcSXPNv3qAxPtvsM3wjabjoB8X3cbK_ernwM7XAvYzYSgg>
[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EcSXPNv3qAxPtvsM3wjabjoB8X3cbK_ernwM7XAvYzYSgg>

test_stat_analysis_month.sh<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/EcSXPNv3qAxPtvsM3wjabjoB8X3cbK_ernwM7XAvYzYSgg>

<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/ESwgvVzl_GZBgLlzQXp08Z0BnxLAYIzsuxoT_kdGLw7HZQ>
[https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/ESwgvVzl_GZBgLlzQXp08Z0BnxLAYIzsuxoT_kdGLw7HZQ>

point_stat_sfcuvt_000000L_20180126_160000V.stat<https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/ESwgvVzl_GZBgLlzQXp08Z0BnxLAYIzsuxoT_kdGLw7HZQ>

Hi All,

     I want to aggregate stat data through multiple times and calculate the analysis, when I use job aggregate_stat, the input line of CTC and CTS works, but the input line of PCT/MPR and output line of PSTD doesn't work.   the error messages show:

******

WARNING: do_job_aggr_stat() -> no matching STAT lines found for job: -job aggregate_stat -fcst_var TMP -interp_mthd NEAREST -line_type PCT -dump_row ./job_aggregate_stat_pct_pstd.stat -out_line_type PSTD -out_fcst_thresh ==0.1 -out_obs_thresh >=271&&<275 -out_alpha 0.05000
******
I attached my stat data and run_log, could anyone help me to figure out the problem?
Thank you very much!
Mandy

----------------------------------------------------------------
  Complete Ticket History
----------------------------------------------------------------

Subject: error with Stat_analysis_pstd
From: John Halley Gotway
Time: Fri Mar 23 10:21:26 2018

Hi Mandy,

I see you have some questions about running STAT-Analysis on your
output
from Point-Stat.  Thanks for sending the sample data files, that
helps.

I think the source of the confusion is figuring out which line types
go
with which variables.

(1) The categorical CTC and CTS line types are used when verifying
deterministic forecasts.  In the sample data file you sent me, you
have CTC
and CTS output line for TMP and WIND:

egrep "CTC|CTS" point_stat_sfcuvt_000000L_20180126_160000V.stat | awk
'{print $10}' | sort -u
TMP
WIND

(2) The probabilistic PCT and PSTD line types are used when verifying
probability forecast.  In your data those are present for the ensemble
frequency variables:

egrep "PCT|PSTD" point_stat_sfcuvt_000000L_20180126_160000V.stat | awk
'{print $10}' | sort -u
TMP_ENS_FREQ_ge271.and.lt275
... and so on ...

You asked STAT-Analysis to process PCT data when FCST_VAR = TMP... but
that
doesn't happen in your data.  Instead, you can either specify a
specific
FCST_VAR value or, conveniently, specify "-by FCST_VAR", like this:

met-6.1/bin/stat_analysis -lookin
point_stat_sfcuvt_000000L_20180126_160000V.stat -job aggregate_stat
-line_type PCT -out_line_type PSTD -by FCST_VAR

Make sense?

Thanks,
John

On Thu, Mar 22, 2018 at 3:04 PM, Zhang, Mandy via RT
<met_help at ucar.edu>
wrote:

>
> Thu Mar 22 15:04:11 2018: Request 84526 was acted upon.
> Transaction: Ticket created by Man.Zhang-1 at ou.edu
>        Queue: met_help
>      Subject: error with Stat_analysis_pstd
>        Owner: Nobody
>   Requestors: Man.Zhang-1 at ou.edu
>       Status: new
>  Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=84526 >
>
>
> Zhang, Mandy has shared OneDrive for Business files with you. To
view
> them, click the links below.
>
>
> <https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-
1_ou_edu/
> EX50E7zux3xIsLqRfo34njMBgGBP7X0vlKTNTjiAelx8aA>
> [https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<
> https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/
> EX50E7zux3xIsLqRfo34njMBgGBP7X0vlKTNTjiAelx8aA>
>
> run_mpr.log<https://sooners-my.sharepoint.com/:u:/g/
> personal/man_zhang-
1_ou_edu/EX50E7zux3xIsLqRfo34njMBgGBP7X0vlKTNTjiAelx8aA
> >
>
> <https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-
1_ou_edu/
> EabEcFZQDp9NvrZwK0UEJLcB943QJQAcPb-edx5YRzeVPA>
> [https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<
> https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/
> EabEcFZQDp9NvrZwK0UEJLcB943QJQAcPb-edx5YRzeVPA>
>
> run_pct.log<https://sooners-my.sharepoint.com/:u:/g/
> personal/man_zhang-1_ou_edu/EabEcFZQDp9NvrZwK0UEJLcB943QJQAcPb-
edx5YRzeVPA
> >
>
> <https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-
1_ou_edu/
> EcSXPNv3qAxPtvsM3wjabjoB8X3cbK_ernwM7XAvYzYSgg>
> [https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<
> https://sooners-my.sharepoint.com/:u:/g/personal/man_zhang-1_ou_edu/
> EcSXPNv3qAxPtvsM3wjabjoB8X3cbK_ernwM7XAvYzYSgg>
>
> test_stat_analysis_month.sh<https://sooners-my.sharepoint.
> com/:u:/g/personal/man_zhang-1_ou_edu/EcSXPNv3qAxPtvsM3wjabjoB8X3cbK
> _ernwM7XAvYzYSgg>
>
> <https://sooners-my.sharepoint.com/:u:/g/personal/
> man_zhang-1_ou_edu/ESwgvVzl_GZBgLlzQXp08Z0BnxLAYIzsuxoT_kdGLw7HZQ>
> [https://r1.res.office365.com/owa/prem/images/dc-generic_20.png]<
> https://sooners-my.sharepoint.com/:u:/g/personal/
> man_zhang-1_ou_edu/ESwgvVzl_GZBgLlzQXp08Z0BnxLAYIzsuxoT_kdGLw7HZQ>
>
> point_stat_sfcuvt_000000L_20180126_160000V.stat<https://
> sooners-my.sharepoint.com/:u:/g/personal/man_zhang-
1_ou_edu/ESwgvVzl_
> GZBgLlzQXp08Z0BnxLAYIzsuxoT_kdGLw7HZQ>
>
>
>
>
> Hi All,
>
>      I want to aggregate stat data through multiple times and
calculate
> the analysis, when I use job aggregate_stat, the input line of CTC
and CTS
> works, but the input line of PCT/MPR and output line of PSTD doesn't
work.
>  the error messages show:
>
> ******
>
> WARNING: do_job_aggr_stat() -> no matching STAT lines found for job:
-job
> aggregate_stat -fcst_var TMP -interp_mthd NEAREST -line_type PCT
-dump_row
> ./job_aggregate_stat_pct_pstd.stat -out_line_type PSTD
-out_fcst_thresh
> ==0.1 -out_obs_thresh >=271&&<275 -out_alpha 0.05000
> ******
> I attached my stat data and run_log, could anyone help me to figure
out
> the problem?
> Thank you very much!
> Mandy
>
>

------------------------------------------------
Subject: error with Stat_analysis_pstd
From: Zhang, Mandy
Time: Mon Mar 26 08:43:54 2018

Hi John,

     It's very helpful,  works well.

Thank you very much!

Mandy

________________________________
From: John Halley Gotway via RT <met_help at ucar.edu>
Sent: Friday, March 23, 2018 11:21:27 AM
To: Zhang, Mandy
Subject: Re: [rt.rap.ucar.edu #84526] error with Stat_analysis_pstd