[Met_help] [rt.rap.ucar.edu #47447] History for ensemble stat problem
RAL HelpDesk {for Paul Oldenburg}
met_help at ucar.edu
Fri Jun 10 11:16:23 MDT 2011
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hello,
I am trying to run ensemble stats tool using same obs data and ensemble wrf forecasts.
I am getting an error that looks like this.
*** Running Ensemble-Stat on APCP using GRIB forecasts, point observations, and gridded observations ***
config() -> syntax error in file "/lfs0/projects/chem-var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
line = 1
econfig_column = 7
text = "so"
CDF
____
Also, I can ncview obs netcdf files obtained from prepbufr with pb2nc but ncdump -h has problem reading the header. That might be related to the error above.
I put bundle2_pagowski.tar.gz on your ftp.
Can you help?
Thanks,
Mariusz
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Paul Oldenburg
Time: Thu Jun 09 12:35:51 2011
Mariusz,
Compare how you are calling ensemble_stat with the usage statement
below:
../bin/ensemble_stat \
6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
${OBSDIR}/2010081112.nc \
./config/EnsembleStatConfig_enkf \
-outdir $OUTDIR -v 2
Usage: ensemble_stat
n_ens ens_file_1 ... ens_file_n | ens_file_list
config_file
[-grid_obs file]
...
I think if you re-order your arguments in this way, it will work:
../bin/ensemble_stat \
6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
./config/EnsembleStatConfig_enkf \
-grid_obs ${OBSDIR}/2010081112.nc \
-outdir $OUTDIR -v 2
Please let me know if you have any questions.
Paul
On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
> Queue: met_help
> Subject: ensemble stat problem
> Owner: Nobody
> Requestors: Mariusz.Pagowski at noaa.gov
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
>
> Hello,
> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
> I am getting an error that looks like this.
>
> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>
>
> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>
> line = 1
>
> econfig_column = 7
>
> text = "so"
>
>
>
> CDF
> ____
>
> Also, I can ncview obs netcdf files obtained from prepbufr with
pb2nc but ncdump -h has problem reading the header. That might be
related to the error above.
>
> I put bundle2_pagowski.tar.gz on your ftp.
> Can you help?
>
> Thanks,
> Mariusz
>
>
>
>
------------------------------------------------
Subject: ensemble stat problem
From: Mariusz Pagowski
Time: Thu Jun 09 13:19:16 2011
Paul,
Thanks for spotting that.
I now run the program with
echo
echo "*** Running Ensemble-Stat on APCP using GRIB forecasts, point
observ\
ations, and gridded observations ***"
../bin/ensemble_stat \
6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
./config/EnsembleStatConfig_enkf \
-grid_obs ${OBSDIR}/2010081112.nc \
-outdir $OUTDIR -v 2
and it gives me this error
*** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
, and gridded observations ***
Configuration File:
./config/EnsembleStatConfig_enkf
Ensemble Files[6]:
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
_2010-08-11_12:00:00_PLEV.mem001
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
_2010-08-11_12:00:00_PLEV.mem002
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
_2010-08-11_12:00:00_PLEV.mem003
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
_2010-08-11_12:00:00_PLEV.mem004
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
_2010-08-11_12:00:00_PLEV.mem005
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
_2010-08-11_12:00:00_PLEV.mem006
Gridded Observation Files[1]:
/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
--------------------------------------------------------------------------\
------
Processing ensemble field: TT(0,2,*,*)
--------------------------------------------------------------------------\
------
NetCDF: Attribute not found
Following files are produced
rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
-rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
-rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
-rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
------------------------------------------------
Subject: ensemble stat problem
From: Mariusz Pagowski
Time: Thu Jun 09 13:19:16 2011
Thanks for helping
Mariusz
On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> Compare how you are calling ensemble_stat with the usage statement
below:
>
> ../bin/ensemble_stat \
> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
> ${OBSDIR}/2010081112.nc \
> ./config/EnsembleStatConfig_enkf \
> -outdir $OUTDIR -v 2
>
> Usage: ensemble_stat
> n_ens ens_file_1 ... ens_file_n | ens_file_list
> config_file
> [-grid_obs file]
> ...
>
> I think if you re-order your arguments in this way, it will work:
>
> ../bin/ensemble_stat \
> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
> ./config/EnsembleStatConfig_enkf \
> -grid_obs ${OBSDIR}/2010081112.nc \
> -outdir $OUTDIR -v 2
>
> Please let me know if you have any questions.
>
> Paul
>
>
> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>> Queue: met_help
>> Subject: ensemble stat problem
>> Owner: Nobody
>> Requestors: Mariusz.Pagowski at noaa.gov
>> Status: new
>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>>
>> Hello,
>> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
>> I am getting an error that looks like this.
>>
>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>
>>
>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>
>> line = 1
>>
>> econfig_column = 7
>>
>> text = "so"
>>
>>
>>
>> CDF
>> ____
>>
>> Also, I can ncview obs netcdf files obtained from prepbufr with
pb2nc but ncdump -h has problem reading the header. That might be
related to the error above.
>>
>> I put bundle2_pagowski.tar.gz on your ftp.
>> Can you help?
>>
>> Thanks,
>> Mariusz
>>
>>
>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Paul Oldenburg
Time: Thu Jun 09 14:40:35 2011
Mariusz,
I see the following lines your ensemble_stat output below:
> Gridded Observation Files[1]:
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
I think that this means you are using point observations and not
gridded observations. Thus, you should try
ensemble_stat using the -point_obs parameter instead of the -grid_obs
parameter as I suggested. Sorry for misleading you.
Paul
On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
> Paul,
> Thanks for spotting that.
> I now run the program with
>
> echo
> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts, point
observ\
> ations, and gridded observations ***"
> ../bin/ensemble_stat \
> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
> ./config/EnsembleStatConfig_enkf \
> -grid_obs ${OBSDIR}/2010081112.nc \
> -outdir $OUTDIR -v 2
>
>
> and it gives me this error
>
> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
> , and gridded observations ***
> Configuration File:
> ./config/EnsembleStatConfig_enkf
> Ensemble Files[6]:
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
> _2010-08-11_12:00:00_PLEV.mem001
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
> _2010-08-11_12:00:00_PLEV.mem002
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
> _2010-08-11_12:00:00_PLEV.mem003
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
> _2010-08-11_12:00:00_PLEV.mem004
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
> _2010-08-11_12:00:00_PLEV.mem005
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
> _2010-08-11_12:00:00_PLEV.mem006
> Gridded Observation Files[1]:
> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>
>
--------------------------------------------------------------------------\
> ------
>
> Processing ensemble field: TT(0,2,*,*)
>
>
--------------------------------------------------------------------------\
> ------
>
> NetCDF: Attribute not found
>
>
>
> Following files are produced
>
> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>
>
>
>
>
>
>
> Thanks for helping
> Mariusz
>
>
>
> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>
>> Mariusz,
>>
>> Compare how you are calling ensemble_stat with the usage statement
below:
>>
>> ../bin/ensemble_stat \
>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>> ${OBSDIR}/2010081112.nc \
>> ./config/EnsembleStatConfig_enkf \
>> -outdir $OUTDIR -v 2
>>
>> Usage: ensemble_stat
>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>> config_file
>> [-grid_obs file]
>> ...
>>
>> I think if you re-order your arguments in this way, it will work:
>>
>> ../bin/ensemble_stat \
>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>> ./config/EnsembleStatConfig_enkf \
>> -grid_obs ${OBSDIR}/2010081112.nc \
>> -outdir $OUTDIR -v 2
>>
>> Please let me know if you have any questions.
>>
>> Paul
>>
>>
>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>
>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>> Queue: met_help
>>> Subject: ensemble stat problem
>>> Owner: Nobody
>>> Requestors: Mariusz.Pagowski at noaa.gov
>>> Status: new
>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>
>>>
>>> Hello,
>>> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
>>> I am getting an error that looks like this.
>>>
>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>
>>>
>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>
>>> line = 1
>>>
>>> econfig_column = 7
>>>
>>> text = "so"
>>>
>>>
>>>
>>> CDF
>>> ____
>>>
>>> Also, I can ncview obs netcdf files obtained from prepbufr with
pb2nc but ncdump -h has problem reading the header. That might be
related to the error above.
>>>
>>> I put bundle2_pagowski.tar.gz on your ftp.
>>> Can you help?
>>>
>>> Thanks,
>>> Mariusz
>>>
>>>
>>>
>>>
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Mariusz Pagowski
Time: Thu Jun 09 14:50:26 2011
Paul,
I changed obs to -point_obs
After an error message about range I changed
fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
Still getting an error:
Processing ensemble field: TT(0-0,2,*,*)
PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
Nelements = 4
Nalloc = 10
AllocInc = 10
Element # 0 = -9999
Element # 1 = 2
Element # 2 = -12345
Element # 3 = -12345
Thanks,
Mariusz
On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> I see the following lines your ensemble_stat output below:
>
>> Gridded Observation Files[1]:
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>
> I think that this means you are using point observations and not
gridded observations. Thus, you should try
> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>
> Paul
>
>
> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>> Paul,
>> Thanks for spotting that.
>> I now run the program with
>>
>> echo
>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts, point
observ\
>> ations, and gridded observations ***"
>> ../bin/ensemble_stat \
>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>> ./config/EnsembleStatConfig_enkf \
>> -grid_obs ${OBSDIR}/2010081112.nc \
>> -outdir $OUTDIR -v 2
>>
>>
>> and it gives me this error
>>
>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>> , and gridded observations ***
>> Configuration File:
>> ./config/EnsembleStatConfig_enkf
>> Ensemble Files[6]:
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>> _2010-08-11_12:00:00_PLEV.mem001
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>> _2010-08-11_12:00:00_PLEV.mem002
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>> _2010-08-11_12:00:00_PLEV.mem003
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>> _2010-08-11_12:00:00_PLEV.mem004
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>> _2010-08-11_12:00:00_PLEV.mem005
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>> _2010-08-11_12:00:00_PLEV.mem006
>> Gridded Observation Files[1]:
>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>
>>
--------------------------------------------------------------------------\
>> ------
>>
>> Processing ensemble field: TT(0,2,*,*)
>>
>>
--------------------------------------------------------------------------\
>> ------
>>
>> NetCDF: Attribute not found
>>
>>
>>
>> Following files are produced
>>
>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>
>>
>>
>>
>>
>>
>>
>> Thanks for helping
>> Mariusz
>>
>>
>>
>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>
>>> Mariusz,
>>>
>>> Compare how you are calling ensemble_stat with the usage statement
below:
>>>
>>> ../bin/ensemble_stat \
>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>> ${OBSDIR}/2010081112.nc \
>>> ./config/EnsembleStatConfig_enkf \
>>> -outdir $OUTDIR -v 2
>>>
>>> Usage: ensemble_stat
>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>> config_file
>>> [-grid_obs file]
>>> ...
>>>
>>> I think if you re-order your arguments in this way, it will work:
>>>
>>> ../bin/ensemble_stat \
>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>> ./config/EnsembleStatConfig_enkf \
>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>> -outdir $OUTDIR -v 2
>>>
>>> Please let me know if you have any questions.
>>>
>>> Paul
>>>
>>>
>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>>
>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>> Queue: met_help
>>>> Subject: ensemble stat problem
>>>> Owner: Nobody
>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>> Status: new
>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>
>>>>
>>>> Hello,
>>>> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
>>>> I am getting an error that looks like this.
>>>>
>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>>
>>>>
>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>
>>>> line = 1
>>>>
>>>> econfig_column = 7
>>>>
>>>> text = "so"
>>>>
>>>>
>>>>
>>>> CDF
>>>> ____
>>>>
>>>> Also, I can ncview obs netcdf files obtained from prepbufr with
pb2nc but ncdump -h has problem reading the header. That might be
related to the error above.
>>>>
>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>> Can you help?
>>>>
>>>> Thanks,
>>>> Mariusz
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Paul Oldenburg
Time: Thu Jun 09 15:15:44 2011
Mariusz,
Please perform the following test:
1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
3. run ensemble_stat using the following command line (with correct
paths):
ensemble_stat \
6 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
EnsembleStatConfig_enkf \
-point_obs 2010081112.nc \
-outdir . -v 2
Please let us know if this operation reproduces the error you
reported.
Thanks,
Paul
On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
> Paul,
> I changed obs to -point_obs
> After an error message about range I changed
> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>
> Still getting an error:
>
> Processing ensemble field: TT(0-0,2,*,*)
>
>
> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
> Nelements = 4
> Nalloc = 10
> AllocInc = 10
> Element # 0 = -9999
> Element # 1 = 2
> Element # 2 = -12345
> Element # 3 = -12345
>
> Thanks,
> Mariusz
>
>
>
> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg} wrote:
>
>> Mariusz,
>>
>> I see the following lines your ensemble_stat output below:
>>
>>> Gridded Observation Files[1]:
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>
>> I think that this means you are using point observations and not
gridded observations. Thus, you should try
>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>
>> Paul
>>
>>
>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>
>>> Paul,
>>> Thanks for spotting that.
>>> I now run the program with
>>>
>>> echo
>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>> ations, and gridded observations ***"
>>> ../bin/ensemble_stat \
>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>> ./config/EnsembleStatConfig_enkf \
>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>> -outdir $OUTDIR -v 2
>>>
>>>
>>> and it gives me this error
>>>
>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>> , and gridded observations ***
>>> Configuration File:
>>> ./config/EnsembleStatConfig_enkf
>>> Ensemble Files[6]:
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>> _2010-08-11_12:00:00_PLEV.mem001
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>> _2010-08-11_12:00:00_PLEV.mem002
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>> _2010-08-11_12:00:00_PLEV.mem003
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>> _2010-08-11_12:00:00_PLEV.mem004
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>> _2010-08-11_12:00:00_PLEV.mem005
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>> _2010-08-11_12:00:00_PLEV.mem006
>>> Gridded Observation Files[1]:
>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>
>>>
--------------------------------------------------------------------------\
>>> ------
>>>
>>> Processing ensemble field: TT(0,2,*,*)
>>>
>>>
--------------------------------------------------------------------------\
>>> ------
>>>
>>> NetCDF: Attribute not found
>>>
>>>
>>>
>>> Following files are produced
>>>
>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Thanks for helping
>>> Mariusz
>>>
>>>
>>>
>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>
>>>> Mariusz,
>>>>
>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>
>>>> ../bin/ensemble_stat \
>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>> ${OBSDIR}/2010081112.nc \
>>>> ./config/EnsembleStatConfig_enkf \
>>>> -outdir $OUTDIR -v 2
>>>>
>>>> Usage: ensemble_stat
>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>> config_file
>>>> [-grid_obs file]
>>>> ...
>>>>
>>>> I think if you re-order your arguments in this way, it will work:
>>>>
>>>> ../bin/ensemble_stat \
>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>> ./config/EnsembleStatConfig_enkf \
>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>> -outdir $OUTDIR -v 2
>>>>
>>>> Please let me know if you have any questions.
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>
>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>> Queue: met_help
>>>>> Subject: ensemble stat problem
>>>>> Owner: Nobody
>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>> Status: new
>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>
>>>>>
>>>>> Hello,
>>>>> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
>>>>> I am getting an error that looks like this.
>>>>>
>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>>>
>>>>>
>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>
>>>>> line = 1
>>>>>
>>>>> econfig_column = 7
>>>>>
>>>>> text = "so"
>>>>>
>>>>>
>>>>>
>>>>> CDF
>>>>> ____
>>>>>
>>>>> Also, I can ncview obs netcdf files obtained from prepbufr with
pb2nc but ncdump -h has problem reading the header. That might be
related to the error above.
>>>>>
>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>> Can you help?
>>>>>
>>>>> Thanks,
>>>>> Mariusz
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Mariusz Pagowski
Time: Thu Jun 09 21:48:02 2011
Paul,
I list the files separately as you suggested.
After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I get
Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
LongArray::operator[](int) -> range check error ... 4
When I reset to "TT(0-0,2,*,*)" ]
I get the same error
PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
Nelements = 4
Nalloc = 10
AllocInc = 10
Element # 0 = -9999
Element # 1 = 2
Element # 2 = -12345
Element # 3 = -12345
Mariusz
On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> Please perform the following test:
>
> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
> 3. run ensemble_stat using the following command line (with correct
paths):
>
> ensemble_stat \
> 6 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
> EnsembleStatConfig_enkf \
> -point_obs 2010081112.nc \
> -outdir . -v 2
>
> Please let us know if this operation reproduces the error you
reported.
>
> Thanks,
>
> Paul
>
>
> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>> Paul,
>> I changed obs to -point_obs
>> After an error message about range I changed
>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>
>> Still getting an error:
>>
>> Processing ensemble field: TT(0-0,2,*,*)
>>
>>
>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
>> Nelements = 4
>> Nalloc = 10
>> AllocInc = 10
>> Element # 0 = -9999
>> Element # 1 = 2
>> Element # 2 = -12345
>> Element # 3 = -12345
>>
>> Thanks,
>> Mariusz
>>
>>
>>
>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>
>>> Mariusz,
>>>
>>> I see the following lines your ensemble_stat output below:
>>>
>>>> Gridded Observation Files[1]:
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>
>>> I think that this means you are using point observations and not
gridded observations. Thus, you should try
>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>
>>> Paul
>>>
>>>
>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>
>>>> Paul,
>>>> Thanks for spotting that.
>>>> I now run the program with
>>>>
>>>> echo
>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>> ations, and gridded observations ***"
>>>> ../bin/ensemble_stat \
>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>> ./config/EnsembleStatConfig_enkf \
>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>> -outdir $OUTDIR -v 2
>>>>
>>>>
>>>> and it gives me this error
>>>>
>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>> , and gridded observations ***
>>>> Configuration File:
>>>> ./config/EnsembleStatConfig_enkf
>>>> Ensemble Files[6]:
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>> Gridded Observation Files[1]:
>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>
>>>>
--------------------------------------------------------------------------\
>>>> ------
>>>>
>>>> Processing ensemble field: TT(0,2,*,*)
>>>>
>>>>
--------------------------------------------------------------------------\
>>>> ------
>>>>
>>>> NetCDF: Attribute not found
>>>>
>>>>
>>>>
>>>> Following files are produced
>>>>
>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Thanks for helping
>>>> Mariusz
>>>>
>>>>
>>>>
>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>
>>>>> Mariusz,
>>>>>
>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>
>>>>> ../bin/ensemble_stat \
>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>> ${OBSDIR}/2010081112.nc \
>>>>> ./config/EnsembleStatConfig_enkf \
>>>>> -outdir $OUTDIR -v 2
>>>>>
>>>>> Usage: ensemble_stat
>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>> config_file
>>>>> [-grid_obs file]
>>>>> ...
>>>>>
>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>
>>>>> ../bin/ensemble_stat \
>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>> ./config/EnsembleStatConfig_enkf \
>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>> -outdir $OUTDIR -v 2
>>>>>
>>>>> Please let me know if you have any questions.
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>
>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>> Queue: met_help
>>>>>> Subject: ensemble stat problem
>>>>>> Owner: Nobody
>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>> Status: new
>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>
>>>>>>
>>>>>> Hello,
>>>>>> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
>>>>>> I am getting an error that looks like this.
>>>>>>
>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>>>>
>>>>>>
>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>
>>>>>> line = 1
>>>>>>
>>>>>> econfig_column = 7
>>>>>>
>>>>>> text = "so"
>>>>>>
>>>>>>
>>>>>>
>>>>>> CDF
>>>>>> ____
>>>>>>
>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr with
pb2nc but ncdump -h has problem reading the header. That might be
related to the error above.
>>>>>>
>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>> Can you help?
>>>>>>
>>>>>> Thanks,
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>
>
------------------------------------------------
Subject: ensemble stat problem
From: Paul Oldenburg
Time: Fri Jun 10 09:39:49 2011
Mariusz,
I included the ensemble_stat config file that we are using to try to
reproduce the error that you reported using
(presumably) the following setting:
ens_field[] = [ "TT(0,2,*,*)" ] ;
We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
again, can you please send us the following information:
1. NetCDF version and compiler that was used to build it
2. Compiler family (GNU, PGI, etc.) used to build MET
3. OS name and version that you are using
Unfortunately, if we are not able to reproduce the error that you have
reported on our system, it will be very difficult
for us to fix your problem. Sorry for the trouble.
Paul
$ensemble_stat \
6 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
EnsembleStatConfig_enkf \
-point_obs 2010081112.nc \
-outdir . -v 2
GSL_RNG_TYPE=mt19937
GSL_RNG_SEED=1513747021
Configuration File:
EnsembleStatConfig_enkf
Ensemble Files[6]:
wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
Point Observation Files[1]:
2010081112.nc
--------------------------------------------------------------------------------
Processing ensemble field: TT(0,2,*,*)
--------------------------------------------------------------------------------
Processing point observation file: 2010081112.nc
Searching 95087 observations from 19199 header messages.
--------------------------------------------------------------------------------
Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
For TT(0,2,*,*) found 1 forecast levels.
--------------------------------------------------------------------------------
Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
For TT(0,2,*,*) found 1 forecast levels.
--------------------------------------------------------------------------------
Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
For TT(0,2,*,*) found 1 forecast levels.
--------------------------------------------------------------------------------
Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
For TT(0,2,*,*) found 1 forecast levels.
--------------------------------------------------------------------------------
Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
For TT(0,2,*,*) found 1 forecast levels.
--------------------------------------------------------------------------------
Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
For TT(0,2,*,*) found 1 forecast levels.
--------------------------------------------------------------------------------
Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
interpolation method DW_MEAN(4), using 66 pairs.
--------------------------------------------------------------------------------
Output file: ./ensemble_stat_20100811_120000V.stat
Output file: ./ensemble_stat_20100811_120000V_rhist.txt
Output file: ./ensemble_stat_20100811_120000V_orank.txt
Output file: ./ensemble_stat_20100811_120000V_ens.nc
On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
> Paul,
> I list the files separately as you suggested.
> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I get
>
>
> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>
>
> LongArray::operator[](int) -> range check error ... 4
>
> When I reset to "TT(0-0,2,*,*)" ]
> I get the same error
>
> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
> Nelements = 4
> Nalloc = 10
> AllocInc = 10
> Element # 0 = -9999
> Element # 1 = 2
> Element # 2 = -12345
> Element # 3 = -12345
>
> Mariusz
>
> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg} wrote:
>
>> Mariusz,
>>
>> Please perform the following test:
>>
>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>> 3. run ensemble_stat using the following command line (with
correct paths):
>>
>> ensemble_stat \
>> 6 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>> EnsembleStatConfig_enkf \
>> -point_obs 2010081112.nc \
>> -outdir . -v 2
>>
>> Please let us know if this operation reproduces the error you
reported.
>>
>> Thanks,
>>
>> Paul
>>
>>
>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>
>>> Paul,
>>> I changed obs to -point_obs
>>> After an error message about range I changed
>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>
>>> Still getting an error:
>>>
>>> Processing ensemble field: TT(0-0,2,*,*)
>>>
>>>
>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>> Nelements = 4
>>> Nalloc = 10
>>> AllocInc = 10
>>> Element # 0 = -9999
>>> Element # 1 = 2
>>> Element # 2 = -12345
>>> Element # 3 = -12345
>>>
>>> Thanks,
>>> Mariusz
>>>
>>>
>>>
>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>
>>>> Mariusz,
>>>>
>>>> I see the following lines your ensemble_stat output below:
>>>>
>>>>> Gridded Observation Files[1]:
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>
>>>> I think that this means you are using point observations and not
gridded observations. Thus, you should try
>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>
>>>>> Paul,
>>>>> Thanks for spotting that.
>>>>> I now run the program with
>>>>>
>>>>> echo
>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>> ations, and gridded observations ***"
>>>>> ../bin/ensemble_stat \
>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>> ./config/EnsembleStatConfig_enkf \
>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>> -outdir $OUTDIR -v 2
>>>>>
>>>>>
>>>>> and it gives me this error
>>>>>
>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>> , and gridded observations ***
>>>>> Configuration File:
>>>>> ./config/EnsembleStatConfig_enkf
>>>>> Ensemble Files[6]:
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>> Gridded Observation Files[1]:
>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>
>>>>>
--------------------------------------------------------------------------\
>>>>> ------
>>>>>
>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>
>>>>>
--------------------------------------------------------------------------\
>>>>> ------
>>>>>
>>>>> NetCDF: Attribute not found
>>>>>
>>>>>
>>>>>
>>>>> Following files are produced
>>>>>
>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> Thanks for helping
>>>>> Mariusz
>>>>>
>>>>>
>>>>>
>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>
>>>>>> Mariusz,
>>>>>>
>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>
>>>>>> ../bin/ensemble_stat \
>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>> -outdir $OUTDIR -v 2
>>>>>>
>>>>>> Usage: ensemble_stat
>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>> config_file
>>>>>> [-grid_obs file]
>>>>>> ...
>>>>>>
>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>
>>>>>> ../bin/ensemble_stat \
>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>> -outdir $OUTDIR -v 2
>>>>>>
>>>>>> Please let me know if you have any questions.
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>>
>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>
>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>> Queue: met_help
>>>>>>> Subject: ensemble stat problem
>>>>>>> Owner: Nobody
>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>> Status: new
>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>
>>>>>>>
>>>>>>> Hello,
>>>>>>> I am trying to run ensemble stats tool using same obs data and
ensemble wrf forecasts.
>>>>>>> I am getting an error that looks like this.
>>>>>>>
>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>>>>>
>>>>>>>
>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>
>>>>>>> line = 1
>>>>>>>
>>>>>>> econfig_column = 7
>>>>>>>
>>>>>>> text = "so"
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> CDF
>>>>>>> ____
>>>>>>>
>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>
>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>> Can you help?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Mariusz
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>
------------------------------------------------
Subject: ensemble stat problem
From: Paul Oldenburg
Time: Fri Jun 10 09:39:49 2011
////////////////////////////////////////////////////////////////////////////////
//
// Default ensemble_stat configuration file
//
////////////////////////////////////////////////////////////////////////////////
//
// Specify a name to designate the model being verified. This name
will be
// written to the second column of the ASCII output generated.
//
model = "WRF";
//
// Section 1: Ensemble Processing
//
//
// Specify a comma-separated list of ensemble fields to be computed.
Each field
// is specified as a GRIB code or abbreviation followed by an
accumulation or
// vertical level indicator for GRIB files or as a variable name
followed by a
// list of dimensions for NetCDF files output from p_interp or MET.
//
// Specifying ensemble fields for GRIB files:
// GC/ANNN for accumulation interval NNN
// GC/ZNNN for vertical level NNN
// GC/PNNN for pressure level NNN in hPa
// GC/PNNN-NNN for a range of pressure levels in hPa
// GC/LNNN for a generic level type
// GC/RNNN for a specific GRIB record number
// Where GC is the number of or abbreviation for the grib code
// to be verified.
// http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
//
// Specifying ensemble fields for NetCDF files:
// var_name(i,...,j,*,*) for a single field
// Where var_name is the name of the NetCDF variable,
// and i,...,j specifies fixed dimension values,
// and *,* specifies the two dimensions for the gridded field.
//
// e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
// e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
//
ens_field[] = [ "TT(0,2,*,*)" ] ;
//
// Specify a comma-separated list of groups of thresholds to be
applied to the
// fields listed above. Ensemble thresholds are used to compute the
ensemble
// relative frequency output.
//
// The length of the "ens_field" and "ens_thresh" arrays must match.
To apply
// multiple thresholds to a field, separate the threshold values with
a space.
//
// Each threshold must be preceded by a two letter indicator for the
type of
// thresholding to be performed:
// 'lt' for less than 'le' for less than or equal to
// 'eq' for equal to 'ne' for not equal to
// 'gt' for greater than 'ge' for greater than or equal to
//
// e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0" ];
//
ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
//
// When summarizing the ensemble, compute a ratio of the number of
valid
// ensemble fields to the total number of ensemble members. If that
ratio is
// less than this threshold, error out. This threshold must be
between 0 and 1.
// Setting this threshold to 1 will require that each all ensemble
members be
// present to be processed.
//
// e.g. vld_ens_thresh = 1.0;
//
vld_ens_thresh = 1.0;
//
// When summarizing the ensemble, for each grid point compute a ratio
of the
// number of valid data values to the number of ensemble members. If
that
// ratio is less than this threshold, write out bad data. This
threshold must
// be between 0 and 1. Setting this threshold to 1 will require each
grid
// point to contain valid data for all ensemble members.
//
// e.g. vld_data_thresh = 1.0;
//
vld_data_thresh = 1.0;
//
// Section 2: Rank Histograms
//
//
// Specify a comma-separated list of ensemble fields to be verified.
The
// forecast and observation fields may be specified separately. If
the
// obs_field parameter is left blank, it will default to the contents
of
// fcst_field.
//
// Each field is specified as a GRIB code or abbreviation followed by
an
// accumulation or vertical level indicator for GRIB files or as a
variable name
// followed by a list of dimensions for NetCDF files output from
p_interp or MET.
//
// Specifying verification fields for GRIB files:
// GC/ANNN for accumulation interval NNN
// GC/ZNNN for vertical level NNN
// GC/PNNN for pressure level NNN in hPa
// GC/PNNN-NNN for a range of pressure levels in hPa
// GC/LNNN for a generic level type
// GC/RNNN for a specific GRIB record number
// Where GC is the number of or abbreviation for the grib code
// to be verified.
// http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
//
// Specifying verification fields for NetCDF files:
// var_name(i,...,j,*,*) for a single field
// Where var_name is the name of the NetCDF variable,
// and i,...,j specifies fixed dimension values,
// and *,* specifies the two dimensions for the gridded field.
//
// e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
// e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
//
fcst_field[] = [ "TT(0,2,*,*)" ];
obs_field[] = [ "TMP/P850" ];
//
// Beginning and ending time offset values in seconds for point
observations
// to be used. These time offsets are defined in reference to the
// ensemble valid time, v. Observations with a valid time falling in
the
// window [v+beg_ds, v+end_ds] will be used.
// These selections are overridden by the command line arguments
// -obs_valid_beg and -obs_valid_end.
//
beg_ds = -900;
end_ds = 900;
//
// Specify a comma-separated list of PrepBufr message types with which
// to perform the point verification. Statistics will be computed
separately
// for each message type specified. At least one PrepBufr message
type
// must be provided when verifying with point observations.
// List of valid message types:
// ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
// MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
// SFCSHP SPSSMI SYNDAT VADWND
// ANYAIR (= AIRCAR, AIRCFT)
// ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
// ONLYSF (= ADPSFC, SFCSHP)
//
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
//
// e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
//
message_type[] = [ "ANYSFC" ];
//
// Specify a comma-separated list of grids to be used in masking the
data over
// which to perform scoring. An empty list indicates that no masking
grid
// should be performed. The standard NCEP grids are named "GNNN"
where NNN
// indicates the three digit grid number. Enter "FULL" to score over
the
// entire domain.
// http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
//
// e.g. mask_grid[] = [ "FULL" ];
//
mask_grid[] = [ "FULL" ];
//
// Specify a comma-separated list of masking regions to be applied.
// An empty list indicates that no additional masks should be used.
// The masking regions may be defined in one of 4 ways:
//
// (1) An ASCII file containing a lat/lon polygon.
// Latitude in degrees north and longitude in degrees east.
// By default, the first and last polygon points are connected.
// e.g. "MET_BASE/data/poly/EAST.poly" which consists of n points:
// "poly_name lat1 lon1 lat2 lon2... latn lonn"
//
// (2) The NetCDF output of the gen_poly_mask tool.
//
// (3) A NetCDF data file, followed by the name of the NetCDF variable
// to be used, and optionally, a threshold to be applied to the
field.
// e.g. "sample.nc var_name gt0.00"
//
// (4) A GRIB data file, followed by a description of the field
// to be used, and optionally, a threshold to be applied to the
field.
// e.g. "sample.grb APCP/A3 gt0.00"
//
// Any NetCDF or GRIB file used must have the same grid dimensions as
the
// data being verified.
//
// MET_BASE may be used in the path for the files above.
//
// e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
// "poly_mask.ncf",
// "sample.nc APCP",
// "sample.grb HGT/Z0 gt100.0" ];
//
mask_poly[] = [ ] ;
//
// Specify the name of an ASCII file containing a space-separated list
of
// station ID's at which to perform verification. Each station ID
specified
// is treated as an individual masking region.
//
// An empty list file name indicates that no station ID masks should
be used.
//
// MET_BASE may be used in the path for the station ID mask file name.
//
// e.g. mask_sid = "CONUS.stations";
//
mask_sid = "";
//
// Specify a comma-separated list of interpolation method(s) to be
used for
// point observations. For gridded observations, this serves to
smooth
// the data fields prior to verifying them. The value at each grid
point is
// replaced by the measure computed over the neighborhood defined
around the
// grid point. String values are interpreted as follows:
// MIN = Minimum in the neighborhood
// MAX = Maximum in the neighborhood
// MEDIAN = Median in the neighborhood
// UW_MEAN = Unweighted mean in the neighborhood
// DW_MEAN = Distance-weighted mean in the neighborhood
// LS_FIT = Least-squares fit in the neighborhood
// BILIN = Bilinear interpolation using the 4 closest points
//
// e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
//
interp_method[] = [ "DW_MEAN" ];
//
// Specify a comma-separated list of box widths to be used by the
interpolation
// techniques listed above. A value of 1 indicates that no smoothing
should be
// performed.
//
// e.g. interp_width = [ 1, 3, 5 ];
//
interp_width[] = [ 2 ];
//
// The interp_flag controls how the smoothing defined above should be
applied:
// (1) Smooth only the forecast field
// (2) Smooth only the observation field
// (3) Smooth both the forecast and observation fields
//
interp_flag = 1;
//
// When smoothing, compute a ratio of the number of valid data points
to
// the total number of points in the neighborhood. If that ratio is
less
// than this threshold, do not compute a smoothed forecast value.
This
// threshold must be between 0 and 1. Setting this threshold to 1
will
// require that each observation be surrounded by n*n valid forecast
// points.
//
// e.g. interp_thresh = 1.0;
//
interp_thresh = 1.0;
//
// Specify flags to indicate the type of data to be output:
//
// (1) STAT and RHIST Text Files, Ranked Histograms:
// Total (TOTAL),
// Continuous Ranked Probability Score (CRPS),
// Ignorance Score (IGN),
// Number of ranks used (N_RANK),
// Count of observations with current rank (RANK_i)
// NOTE: Previous column is repeated for each rank used
(N_RANK)
//
// (2) STAT and ORANK Text Files, Observation Rank Matched Pairs:
// Total (TOTAL),
// Index (INDEX),
// Observation Station ID (OBS_SID),
// Observation Latitude (OBS_LAT),
// Observation Longitude (OBS_LON),
// Observation Level (OBS_LVL),
// Observation Elevation (OBS_ELV),
// Observation Value (OBS),
// Probability Integral Transform (PIT),
// Observation Rank (RANK),
// Number of valid Ensemble Values (N_ENS_VLD),
// Total Number of Ensemble Values (N_ENS),
// Current Ensemble Value (ENS_i)
// NOTE: Previous column is repeated for each ensemble
member (N_ENS)
//
// (3) Write the Ensemble Mean fields.
//
// (4) Write the Ensemble Standard Deviation fields.
//
// (5) Write the Ensemble Mean - 1 Standard Deviation fields.
//
// (6) Write the Ensemble Mean + 1 Standard Deviation fields.
//
// (7) Write the Ensemble Minimum fields.
//
// (8) Write the Ensemble Maximum fields.
//
// (9) Write the Ensemble Range fields.
//
// (10) Write the Ensemble Valid Data Count fields.
//
// (11) Write the Ensemble Relative Frequency by threshold fields.
//
// (12) Write the gridded field of Observation Ranks to a NetCDF
file.
//
// Values for flags (1) and (2) are interpreted as follows:
// (0) Do not generate output of this type
// (1) Write output to a STAT file
// (2) Write output to a STAT file and a text file
//
// Values for flags (3) though (12) are interpreted as follows:
// (0) Do not write this field to the NetCDF file.
// (1) Write this field to the NetCDF file.
//
output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
// output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
//
// When computing observation ranks, in the case of ties, randomly
choose
// the rank from all possible values. Specify the name of the random
// number generator to be used. See the MET Users Guide for a list of
// possible random number generators.
//
rng_type = "mt19937";
//
// If left unspecified, the random number generator seed will change
for
// each run and the assignment of ranks will not be reproducable.
//
rng_seed = "";
//
// Specify the GRIB Table 2 parameter table version number to be used
// for interpreting GRIB codes.
// http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
//
grib_ptv = 129;
//
// Prefix to be used for the output file names.
//
output_prefix = "";
//
// Indicate a version number for the contents of this configuration
file.
// The value should generally not be modified.
//
version = "V3.0.1";
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Mariusz Pagowski
Time: Fri Jun 10 09:48:52 2011
Paul,
The config included in my Mac mail plays all the character tricks with
your text included in the mail. Can you attach it as a text, maybe
gzipped,
separately.
Thakns,
Mariusz
On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> I included the ensemble_stat config file that we are using to try to
reproduce the error that you reported using
> (presumably) the following setting:
>
> ens_field[] = [ "TT(0,2,*,*)" ] ;
>
> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
> again, can you please send us the following information:
>
> 1. NetCDF version and compiler that was used to build it
> 2. Compiler family (GNU, PGI, etc.) used to build MET
> 3. OS name and version that you are using
>
> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
> for us to fix your problem. Sorry for the trouble.
>
> Paul
>
>
> $ensemble_stat \
> 6 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
> EnsembleStatConfig_enkf \
> -point_obs 2010081112.nc \
> -outdir . -v 2
>
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1513747021
> Configuration File:
> EnsembleStatConfig_enkf
> Ensemble Files[6]:
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
> Point Observation Files[1]:
> 2010081112.nc
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble field: TT(0,2,*,*)
>
>
--------------------------------------------------------------------------------
>
> Processing point observation file: 2010081112.nc
> Searching 95087 observations from 19199 header messages.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
> interpolation method DW_MEAN(4), using 66 pairs.
>
>
--------------------------------------------------------------------------------
>
> Output file: ./ensemble_stat_20100811_120000V.stat
> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
> Output file: ./ensemble_stat_20100811_120000V_orank.txt
> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>
>
>
>
> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>> Paul,
>> I list the files separately as you suggested.
>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>
>>
>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>
>>
>> LongArray::operator[](int) -> range check error ... 4
>>
>> When I reset to "TT(0-0,2,*,*)" ]
>> I get the same error
>>
>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
>> Nelements = 4
>> Nalloc = 10
>> AllocInc = 10
>> Element # 0 = -9999
>> Element # 1 = 2
>> Element # 2 = -12345
>> Element # 3 = -12345
>>
>> Mariusz
>>
>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>
>>> Mariusz,
>>>
>>> Please perform the following test:
>>>
>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>
>>> ensemble_stat \
>>> 6 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>> EnsembleStatConfig_enkf \
>>> -point_obs 2010081112.nc \
>>> -outdir . -v 2
>>>
>>> Please let us know if this operation reproduces the error you
reported.
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>
>>>> Paul,
>>>> I changed obs to -point_obs
>>>> After an error message about range I changed
>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>
>>>> Still getting an error:
>>>>
>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>
>>>>
>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>> Nelements = 4
>>>> Nalloc = 10
>>>> AllocInc = 10
>>>> Element # 0 = -9999
>>>> Element # 1 = 2
>>>> Element # 2 = -12345
>>>> Element # 3 = -12345
>>>>
>>>> Thanks,
>>>> Mariusz
>>>>
>>>>
>>>>
>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>
>>>>> Mariusz,
>>>>>
>>>>> I see the following lines your ensemble_stat output below:
>>>>>
>>>>>> Gridded Observation Files[1]:
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>
>>>>> I think that this means you are using point observations and not
gridded observations. Thus, you should try
>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>
>>>>>> Paul,
>>>>>> Thanks for spotting that.
>>>>>> I now run the program with
>>>>>>
>>>>>> echo
>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>>> ations, and gridded observations ***"
>>>>>> ../bin/ensemble_stat \
>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>> -outdir $OUTDIR -v 2
>>>>>>
>>>>>>
>>>>>> and it gives me this error
>>>>>>
>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>>> , and gridded observations ***
>>>>>> Configuration File:
>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>> Ensemble Files[6]:
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>> Gridded Observation Files[1]:
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>
>>>>>>
--------------------------------------------------------------------------\
>>>>>> ------
>>>>>>
>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>
>>>>>>
--------------------------------------------------------------------------\
>>>>>> ------
>>>>>>
>>>>>> NetCDF: Attribute not found
>>>>>>
>>>>>>
>>>>>>
>>>>>> Following files are produced
>>>>>>
>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks for helping
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>
>>>>>>> Mariusz,
>>>>>>>
>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>
>>>>>>> ../bin/ensemble_stat \
>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>
>>>>>>> Usage: ensemble_stat
>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>> config_file
>>>>>>> [-grid_obs file]
>>>>>>> ...
>>>>>>>
>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>
>>>>>>> ../bin/ensemble_stat \
>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>
>>>>>>> Please let me know if you have any questions.
>>>>>>>
>>>>>>> Paul
>>>>>>>
>>>>>>>
>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>
>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>> Queue: met_help
>>>>>>>> Subject: ensemble stat problem
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>
>>>>>>>>
>>>>>>>> Hello,
>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>> I am getting an error that looks like this.
>>>>>>>>
>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>>>>>>
>>>>>>>>
>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>
>>>>>>>> line = 1
>>>>>>>>
>>>>>>>> econfig_column = 7
>>>>>>>>
>>>>>>>> text = "so"
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> CDF
>>>>>>>> ____
>>>>>>>>
>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>
>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>> Can you help?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Mariusz
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>
>
>
////////////////////////////////////////////////////////////////////////////////
> //
> // Default ensemble_stat configuration file
> //
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Specify a name to designate the model being verified. This name
will be
> // written to the second column of the ASCII output generated.
> //
> model = "WRF";
>
> //
> // Section 1: Ensemble Processing
> //
>
> //
> // Specify a comma-separated list of ensemble fields to be computed.
Each field
> // is specified as a GRIB code or abbreviation followed by an
accumulation or
> // vertical level indicator for GRIB files or as a variable name
followed by a
> // list of dimensions for NetCDF files output from p_interp or MET.
> //
> // Specifying ensemble fields for GRIB files:
> // GC/ANNN for accumulation interval NNN
> // GC/ZNNN for vertical level NNN
> // GC/PNNN for pressure level NNN in hPa
> // GC/PNNN-NNN for a range of pressure levels in hPa
> // GC/LNNN for a generic level type
> // GC/RNNN for a specific GRIB record number
> // Where GC is the number of or abbreviation for the grib code
> // to be verified.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> // Specifying ensemble fields for NetCDF files:
> // var_name(i,...,j,*,*) for a single field
> // Where var_name is the name of the NetCDF variable,
> // and i,...,j specifies fixed dimension values,
> // and *,* specifies the two dimensions for the gridded field.
> //
> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
> //
> ens_field[] = [ "TT(0,2,*,*)" ] ;
>
> //
> // Specify a comma-separated list of groups of thresholds to be
applied to the
> // fields listed above. Ensemble thresholds are used to compute the
ensemble
> // relative frequency output.
> //
> // The length of the "ens_field" and "ens_thresh" arrays must match.
To apply
> // multiple thresholds to a field, separate the threshold values
with a space.
> //
> // Each threshold must be preceded by a two letter indicator for the
type of
> // thresholding to be performed:
> // 'lt' for less than 'le' for less than or equal to
> // 'eq' for equal to 'ne' for not equal to
> // 'gt' for greater than 'ge' for greater than or equal to
> //
> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0" ];
> //
> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>
> //
> // When summarizing the ensemble, compute a ratio of the number of
valid
> // ensemble fields to the total number of ensemble members. If that
ratio is
> // less than this threshold, error out. This threshold must be
between 0 and 1.
> // Setting this threshold to 1 will require that each all ensemble
members be
> // present to be processed.
> //
> // e.g. vld_ens_thresh = 1.0;
> //
> vld_ens_thresh = 1.0;
>
> //
> // When summarizing the ensemble, for each grid point compute a
ratio of the
> // number of valid data values to the number of ensemble members.
If that
> // ratio is less than this threshold, write out bad data. This
threshold must
> // be between 0 and 1. Setting this threshold to 1 will require
each grid
> // point to contain valid data for all ensemble members.
> //
> // e.g. vld_data_thresh = 1.0;
> //
> vld_data_thresh = 1.0;
>
> //
> // Section 2: Rank Histograms
> //
>
> //
> // Specify a comma-separated list of ensemble fields to be verified.
The
> // forecast and observation fields may be specified separately. If
the
> // obs_field parameter is left blank, it will default to the
contents of
> // fcst_field.
> //
> // Each field is specified as a GRIB code or abbreviation followed
by an
> // accumulation or vertical level indicator for GRIB files or as a
variable name
> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
> //
> // Specifying verification fields for GRIB files:
> // GC/ANNN for accumulation interval NNN
> // GC/ZNNN for vertical level NNN
> // GC/PNNN for pressure level NNN in hPa
> // GC/PNNN-NNN for a range of pressure levels in hPa
> // GC/LNNN for a generic level type
> // GC/RNNN for a specific GRIB record number
> // Where GC is the number of or abbreviation for the grib code
> // to be verified.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> // Specifying verification fields for NetCDF files:
> // var_name(i,...,j,*,*) for a single field
> // Where var_name is the name of the NetCDF variable,
> // and i,...,j specifies fixed dimension values,
> // and *,* specifies the two dimensions for the gridded field.
> //
> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
> //
> fcst_field[] = [ "TT(0,2,*,*)" ];
> obs_field[] = [ "TMP/P850" ];
>
> //
> // Beginning and ending time offset values in seconds for point
observations
> // to be used. These time offsets are defined in reference to the
> // ensemble valid time, v. Observations with a valid time falling
in the
> // window [v+beg_ds, v+end_ds] will be used.
> // These selections are overridden by the command line arguments
> // -obs_valid_beg and -obs_valid_end.
> //
> beg_ds = -900;
> end_ds = 900;
>
> //
> // Specify a comma-separated list of PrepBufr message types with
which
> // to perform the point verification. Statistics will be computed
separately
> // for each message type specified. At least one PrepBufr message
type
> // must be provided when verifying with point observations.
> // List of valid message types:
> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
> // SFCSHP SPSSMI SYNDAT VADWND
> // ANYAIR (= AIRCAR, AIRCFT)
> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
> // ONLYSF (= ADPSFC, SFCSHP)
> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
> //
> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
> //
> message_type[] = [ "ANYSFC" ];
>
> //
> // Specify a comma-separated list of grids to be used in masking the
data over
> // which to perform scoring. An empty list indicates that no
masking grid
> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
> // indicates the three digit grid number. Enter "FULL" to score
over the
> // entire domain.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
> //
> // e.g. mask_grid[] = [ "FULL" ];
> //
> mask_grid[] = [ "FULL" ];
>
> //
> // Specify a comma-separated list of masking regions to be applied.
> // An empty list indicates that no additional masks should be used.
> // The masking regions may be defined in one of 4 ways:
> //
> // (1) An ASCII file containing a lat/lon polygon.
> // Latitude in degrees north and longitude in degrees east.
> // By default, the first and last polygon points are connected.
> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
> //
> // (2) The NetCDF output of the gen_poly_mask tool.
> //
> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
> // to be used, and optionally, a threshold to be applied to the
field.
> // e.g. "sample.nc var_name gt0.00"
> //
> // (4) A GRIB data file, followed by a description of the field
> // to be used, and optionally, a threshold to be applied to the
field.
> // e.g. "sample.grb APCP/A3 gt0.00"
> //
> // Any NetCDF or GRIB file used must have the same grid dimensions
as the
> // data being verified.
> //
> // MET_BASE may be used in the path for the files above.
> //
> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
> // "poly_mask.ncf",
> // "sample.nc APCP",
> // "sample.grb HGT/Z0 gt100.0" ];
> //
> mask_poly[] = [ ] ;
>
> //
> // Specify the name of an ASCII file containing a space-separated
list of
> // station ID's at which to perform verification. Each station ID
specified
> // is treated as an individual masking region.
> //
> // An empty list file name indicates that no station ID masks should
be used.
> //
> // MET_BASE may be used in the path for the station ID mask file
name.
> //
> // e.g. mask_sid = "CONUS.stations";
> //
> mask_sid = "";
>
> //
> // Specify a comma-separated list of interpolation method(s) to be
used for
> // point observations. For gridded observations, this serves to
smooth
> // the data fields prior to verifying them. The value at each grid
point is
> // replaced by the measure computed over the neighborhood defined
around the
> // grid point. String values are interpreted as follows:
> // MIN = Minimum in the neighborhood
> // MAX = Maximum in the neighborhood
> // MEDIAN = Median in the neighborhood
> // UW_MEAN = Unweighted mean in the neighborhood
> // DW_MEAN = Distance-weighted mean in the neighborhood
> // LS_FIT = Least-squares fit in the neighborhood
> // BILIN = Bilinear interpolation using the 4 closest points
> //
> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
> //
> interp_method[] = [ "DW_MEAN" ];
>
> //
> // Specify a comma-separated list of box widths to be used by the
interpolation
> // techniques listed above. A value of 1 indicates that no
smoothing should be
> // performed.
> //
> // e.g. interp_width = [ 1, 3, 5 ];
> //
> interp_width[] = [ 2 ];
>
> //
> // The interp_flag controls how the smoothing defined above should
be applied:
> // (1) Smooth only the forecast field
> // (2) Smooth only the observation field
> // (3) Smooth both the forecast and observation fields
> //
> interp_flag = 1;
>
> //
> // When smoothing, compute a ratio of the number of valid data
points to
> // the total number of points in the neighborhood. If that ratio is
less
> // than this threshold, do not compute a smoothed forecast value.
This
> // threshold must be between 0 and 1. Setting this threshold to 1
will
> // require that each observation be surrounded by n*n valid forecast
> // points.
> //
> // e.g. interp_thresh = 1.0;
> //
> interp_thresh = 1.0;
>
> //
> // Specify flags to indicate the type of data to be output:
> //
> // (1) STAT and RHIST Text Files, Ranked Histograms:
> // Total (TOTAL),
> // Continuous Ranked Probability Score (CRPS),
> // Ignorance Score (IGN),
> // Number of ranks used (N_RANK),
> // Count of observations with current rank (RANK_i)
> // NOTE: Previous column is repeated for each rank used
(N_RANK)
> //
> // (2) STAT and ORANK Text Files, Observation Rank Matched Pairs:
> // Total (TOTAL),
> // Index (INDEX),
> // Observation Station ID (OBS_SID),
> // Observation Latitude (OBS_LAT),
> // Observation Longitude (OBS_LON),
> // Observation Level (OBS_LVL),
> // Observation Elevation (OBS_ELV),
> // Observation Value (OBS),
> // Probability Integral Transform (PIT),
> // Observation Rank (RANK),
> // Number of valid Ensemble Values (N_ENS_VLD),
> // Total Number of Ensemble Values (N_ENS),
> // Current Ensemble Value (ENS_i)
> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
> //
> // (3) Write the Ensemble Mean fields.
> //
> // (4) Write the Ensemble Standard Deviation fields.
> //
> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
> //
> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
> //
> // (7) Write the Ensemble Minimum fields.
> //
> // (8) Write the Ensemble Maximum fields.
> //
> // (9) Write the Ensemble Range fields.
> //
> // (10) Write the Ensemble Valid Data Count fields.
> //
> // (11) Write the Ensemble Relative Frequency by threshold fields.
> //
> // (12) Write the gridded field of Observation Ranks to a NetCDF
file.
> //
> // Values for flags (1) and (2) are interpreted as follows:
> // (0) Do not generate output of this type
> // (1) Write output to a STAT file
> // (2) Write output to a STAT file and a text file
> //
> // Values for flags (3) though (12) are interpreted as follows:
> // (0) Do not write this field to the NetCDF file.
> // (1) Write this field to the NetCDF file.
> //
> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>
> //
> // When computing observation ranks, in the case of ties, randomly
choose
> // the rank from all possible values. Specify the name of the
random
> // number generator to be used. See the MET Users Guide for a list
of
> // possible random number generators.
> //
> rng_type = "mt19937";
>
> //
> // If left unspecified, the random number generator seed will change
for
> // each run and the assignment of ranks will not be reproducable.
> //
> rng_seed = "";
>
> //
> // Specify the GRIB Table 2 parameter table version number to be
used
> // for interpreting GRIB codes.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> grib_ptv = 129;
>
> //
> // Prefix to be used for the output file names.
> //
> output_prefix = "";
>
> //
> // Indicate a version number for the contents of this configuration
file.
> // The value should generally not be modified.
> //
> version = "V3.0.1";
------------------------------------------------
Subject: ensemble stat problem
From: Paul Oldenburg
Time: Fri Jun 10 09:54:40 2011
Mariusz,
As you requested.
Paul
On 06/10/2011 09:48 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
> Paul,
> The config included in my Mac mail plays all the character tricks
with your text included in the mail. Can you attach it as a text,
maybe gzipped,
> separately.
> Thakns,
> Mariusz
>
> On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>
>> Mariusz,
>>
>> I included the ensemble_stat config file that we are using to try
to reproduce the error that you reported using
>> (presumably) the following setting:
>>
>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>
>> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
>> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
>> again, can you please send us the following information:
>>
>> 1. NetCDF version and compiler that was used to build it
>> 2. Compiler family (GNU, PGI, etc.) used to build MET
>> 3. OS name and version that you are using
>>
>> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
>> for us to fix your problem. Sorry for the trouble.
>>
>> Paul
>>
>>
>> $ensemble_stat \
>> 6 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>> EnsembleStatConfig_enkf \
>> -point_obs 2010081112.nc \
>> -outdir . -v 2
>>
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=1513747021
>> Configuration File:
>> EnsembleStatConfig_enkf
>> Ensemble Files[6]:
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
>> Point Observation Files[1]:
>> 2010081112.nc
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble field: TT(0,2,*,*)
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing point observation file: 2010081112.nc
>> Searching 95087 observations from 19199 header messages.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem002
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem003
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem004
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem005
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem006
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
>> interpolation method DW_MEAN(4), using 66 pairs.
>>
>>
--------------------------------------------------------------------------------
>>
>> Output file: ./ensemble_stat_20100811_120000V.stat
>> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
>> Output file: ./ensemble_stat_20100811_120000V_orank.txt
>> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>>
>>
>>
>>
>> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>
>>> Paul,
>>> I list the files separately as you suggested.
>>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>>
>>>
>>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>>
>>>
>>> LongArray::operator[](int) -> range check error ... 4
>>>
>>> When I reset to "TT(0-0,2,*,*)" ]
>>> I get the same error
>>>
>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>> Nelements = 4
>>> Nalloc = 10
>>> AllocInc = 10
>>> Element # 0 = -9999
>>> Element # 1 = 2
>>> Element # 2 = -12345
>>> Element # 3 = -12345
>>>
>>> Mariusz
>>>
>>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>
>>>> Mariusz,
>>>>
>>>> Please perform the following test:
>>>>
>>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>>
>>>> ensemble_stat \
>>>> 6 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>>> EnsembleStatConfig_enkf \
>>>> -point_obs 2010081112.nc \
>>>> -outdir . -v 2
>>>>
>>>> Please let us know if this operation reproduces the error you
reported.
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>
>>>>> Paul,
>>>>> I changed obs to -point_obs
>>>>> After an error message about range I changed
>>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>>
>>>>> Still getting an error:
>>>>>
>>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>>
>>>>>
>>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>>> Nelements = 4
>>>>> Nalloc = 10
>>>>> AllocInc = 10
>>>>> Element # 0 = -9999
>>>>> Element # 1 = 2
>>>>> Element # 2 = -12345
>>>>> Element # 3 = -12345
>>>>>
>>>>> Thanks,
>>>>> Mariusz
>>>>>
>>>>>
>>>>>
>>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>
>>>>>> Mariusz,
>>>>>>
>>>>>> I see the following lines your ensemble_stat output below:
>>>>>>
>>>>>>> Gridded Observation Files[1]:
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>
>>>>>> I think that this means you are using point observations and
not gridded observations. Thus, you should try
>>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>>
>>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447
>
>>>>>>>
>>>>>>> Paul,
>>>>>>> Thanks for spotting that.
>>>>>>> I now run the program with
>>>>>>>
>>>>>>> echo
>>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>>>> ations, and gridded observations ***"
>>>>>>> ../bin/ensemble_stat \
>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>
>>>>>>>
>>>>>>> and it gives me this error
>>>>>>>
>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>>>> , and gridded observations ***
>>>>>>> Configuration File:
>>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>>> Ensemble Files[6]:
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>>> Gridded Observation Files[1]:
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>
>>>>>>>
--------------------------------------------------------------------------\
>>>>>>> ------
>>>>>>>
>>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>>
>>>>>>>
--------------------------------------------------------------------------\
>>>>>>> ------
>>>>>>>
>>>>>>> NetCDF: Attribute not found
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Following files are produced
>>>>>>>
>>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Thanks for helping
>>>>>>> Mariusz
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>>
>>>>>>>> Mariusz,
>>>>>>>>
>>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>>
>>>>>>>> ../bin/ensemble_stat \
>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>
>>>>>>>> Usage: ensemble_stat
>>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>>> config_file
>>>>>>>> [-grid_obs file]
>>>>>>>> ...
>>>>>>>>
>>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>>
>>>>>>>> ../bin/ensemble_stat \
>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>
>>>>>>>> Please let me know if you have any questions.
>>>>>>>>
>>>>>>>> Paul
>>>>>>>>
>>>>>>>>
>>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>>
>>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>>> Queue: met_help
>>>>>>>>> Subject: ensemble stat problem
>>>>>>>>> Owner: Nobody
>>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>>> Status: new
>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>>> I am getting an error that looks like this.
>>>>>>>>>
>>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts,
point observations, and gridded observations ***
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>>
>>>>>>>>> line = 1
>>>>>>>>>
>>>>>>>>> econfig_column = 7
>>>>>>>>>
>>>>>>>>> text = "so"
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CDF
>>>>>>>>> ____
>>>>>>>>>
>>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>>
>>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>>> Can you help?
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Mariusz
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>>
////////////////////////////////////////////////////////////////////////////////
>> //
>> // Default ensemble_stat configuration file
>> //
>>
////////////////////////////////////////////////////////////////////////////////
>>
>> //
>> // Specify a name to designate the model being verified. This name
will be
>> // written to the second column of the ASCII output generated.
>> //
>> model = "WRF";
>>
>> //
>> // Section 1: Ensemble Processing
>> //
>>
>> //
>> // Specify a comma-separated list of ensemble fields to be
computed. Each field
>> // is specified as a GRIB code or abbreviation followed by an
accumulation or
>> // vertical level indicator for GRIB files or as a variable name
followed by a
>> // list of dimensions for NetCDF files output from p_interp or MET.
>> //
>> // Specifying ensemble fields for GRIB files:
>> // GC/ANNN for accumulation interval NNN
>> // GC/ZNNN for vertical level NNN
>> // GC/PNNN for pressure level NNN in hPa
>> // GC/PNNN-NNN for a range of pressure levels in hPa
>> // GC/LNNN for a generic level type
>> // GC/RNNN for a specific GRIB record number
>> // Where GC is the number of or abbreviation for the grib code
>> // to be verified.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> // Specifying ensemble fields for NetCDF files:
>> // var_name(i,...,j,*,*) for a single field
>> // Where var_name is the name of the NetCDF variable,
>> // and i,...,j specifies fixed dimension values,
>> // and *,* specifies the two dimensions for the gridded field.
>> //
>> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>> //
>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>
>> //
>> // Specify a comma-separated list of groups of thresholds to be
applied to the
>> // fields listed above. Ensemble thresholds are used to compute
the ensemble
>> // relative frequency output.
>> //
>> // The length of the "ens_field" and "ens_thresh" arrays must
match. To apply
>> // multiple thresholds to a field, separate the threshold values
with a space.
>> //
>> // Each threshold must be preceded by a two letter indicator for
the type of
>> // thresholding to be performed:
>> // 'lt' for less than 'le' for less than or equal to
>> // 'eq' for equal to 'ne' for not equal to
>> // 'gt' for greater than 'ge' for greater than or equal to
>> //
>> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0" ];
>> //
>> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>>
>> //
>> // When summarizing the ensemble, compute a ratio of the number of
valid
>> // ensemble fields to the total number of ensemble members. If
that ratio is
>> // less than this threshold, error out. This threshold must be
between 0 and 1.
>> // Setting this threshold to 1 will require that each all ensemble
members be
>> // present to be processed.
>> //
>> // e.g. vld_ens_thresh = 1.0;
>> //
>> vld_ens_thresh = 1.0;
>>
>> //
>> // When summarizing the ensemble, for each grid point compute a
ratio of the
>> // number of valid data values to the number of ensemble members.
If that
>> // ratio is less than this threshold, write out bad data. This
threshold must
>> // be between 0 and 1. Setting this threshold to 1 will require
each grid
>> // point to contain valid data for all ensemble members.
>> //
>> // e.g. vld_data_thresh = 1.0;
>> //
>> vld_data_thresh = 1.0;
>>
>> //
>> // Section 2: Rank Histograms
>> //
>>
>> //
>> // Specify a comma-separated list of ensemble fields to be
verified. The
>> // forecast and observation fields may be specified separately. If
the
>> // obs_field parameter is left blank, it will default to the
contents of
>> // fcst_field.
>> //
>> // Each field is specified as a GRIB code or abbreviation followed
by an
>> // accumulation or vertical level indicator for GRIB files or as a
variable name
>> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
>> //
>> // Specifying verification fields for GRIB files:
>> // GC/ANNN for accumulation interval NNN
>> // GC/ZNNN for vertical level NNN
>> // GC/PNNN for pressure level NNN in hPa
>> // GC/PNNN-NNN for a range of pressure levels in hPa
>> // GC/LNNN for a generic level type
>> // GC/RNNN for a specific GRIB record number
>> // Where GC is the number of or abbreviation for the grib code
>> // to be verified.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> // Specifying verification fields for NetCDF files:
>> // var_name(i,...,j,*,*) for a single field
>> // Where var_name is the name of the NetCDF variable,
>> // and i,...,j specifies fixed dimension values,
>> // and *,* specifies the two dimensions for the gridded field.
>> //
>> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>> //
>> fcst_field[] = [ "TT(0,2,*,*)" ];
>> obs_field[] = [ "TMP/P850" ];
>>
>> //
>> // Beginning and ending time offset values in seconds for point
observations
>> // to be used. These time offsets are defined in reference to the
>> // ensemble valid time, v. Observations with a valid time falling
in the
>> // window [v+beg_ds, v+end_ds] will be used.
>> // These selections are overridden by the command line arguments
>> // -obs_valid_beg and -obs_valid_end.
>> //
>> beg_ds = -900;
>> end_ds = 900;
>>
>> //
>> // Specify a comma-separated list of PrepBufr message types with
which
>> // to perform the point verification. Statistics will be computed
separately
>> // for each message type specified. At least one PrepBufr message
type
>> // must be provided when verifying with point observations.
>> // List of valid message types:
>> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
>> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
>> // SFCSHP SPSSMI SYNDAT VADWND
>> // ANYAIR (= AIRCAR, AIRCFT)
>> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
>> // ONLYSF (= ADPSFC, SFCSHP)
>> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
>> //
>> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
>> //
>> message_type[] = [ "ANYSFC" ];
>>
>> //
>> // Specify a comma-separated list of grids to be used in masking
the data over
>> // which to perform scoring. An empty list indicates that no
masking grid
>> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
>> // indicates the three digit grid number. Enter "FULL" to score
over the
>> // entire domain.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
>> //
>> // e.g. mask_grid[] = [ "FULL" ];
>> //
>> mask_grid[] = [ "FULL" ];
>>
>> //
>> // Specify a comma-separated list of masking regions to be applied.
>> // An empty list indicates that no additional masks should be used.
>> // The masking regions may be defined in one of 4 ways:
>> //
>> // (1) An ASCII file containing a lat/lon polygon.
>> // Latitude in degrees north and longitude in degrees east.
>> // By default, the first and last polygon points are connected.
>> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
>> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
>> //
>> // (2) The NetCDF output of the gen_poly_mask tool.
>> //
>> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
>> // to be used, and optionally, a threshold to be applied to the
field.
>> // e.g. "sample.nc var_name gt0.00"
>> //
>> // (4) A GRIB data file, followed by a description of the field
>> // to be used, and optionally, a threshold to be applied to the
field.
>> // e.g. "sample.grb APCP/A3 gt0.00"
>> //
>> // Any NetCDF or GRIB file used must have the same grid dimensions
as the
>> // data being verified.
>> //
>> // MET_BASE may be used in the path for the files above.
>> //
>> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
>> // "poly_mask.ncf",
>> // "sample.nc APCP",
>> // "sample.grb HGT/Z0 gt100.0" ];
>> //
>> mask_poly[] = [ ] ;
>>
>> //
>> // Specify the name of an ASCII file containing a space-separated
list of
>> // station ID's at which to perform verification. Each station ID
specified
>> // is treated as an individual masking region.
>> //
>> // An empty list file name indicates that no station ID masks
should be used.
>> //
>> // MET_BASE may be used in the path for the station ID mask file
name.
>> //
>> // e.g. mask_sid = "CONUS.stations";
>> //
>> mask_sid = "";
>>
>> //
>> // Specify a comma-separated list of interpolation method(s) to be
used for
>> // point observations. For gridded observations, this serves to
smooth
>> // the data fields prior to verifying them. The value at each grid
point is
>> // replaced by the measure computed over the neighborhood defined
around the
>> // grid point. String values are interpreted as follows:
>> // MIN = Minimum in the neighborhood
>> // MAX = Maximum in the neighborhood
>> // MEDIAN = Median in the neighborhood
>> // UW_MEAN = Unweighted mean in the neighborhood
>> // DW_MEAN = Distance-weighted mean in the neighborhood
>> // LS_FIT = Least-squares fit in the neighborhood
>> // BILIN = Bilinear interpolation using the 4 closest points
>> //
>> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
>> //
>> interp_method[] = [ "DW_MEAN" ];
>>
>> //
>> // Specify a comma-separated list of box widths to be used by the
interpolation
>> // techniques listed above. A value of 1 indicates that no
smoothing should be
>> // performed.
>> //
>> // e.g. interp_width = [ 1, 3, 5 ];
>> //
>> interp_width[] = [ 2 ];
>>
>> //
>> // The interp_flag controls how the smoothing defined above should
be applied:
>> // (1) Smooth only the forecast field
>> // (2) Smooth only the observation field
>> // (3) Smooth both the forecast and observation fields
>> //
>> interp_flag = 1;
>>
>> //
>> // When smoothing, compute a ratio of the number of valid data
points to
>> // the total number of points in the neighborhood. If that ratio
is less
>> // than this threshold, do not compute a smoothed forecast value.
This
>> // threshold must be between 0 and 1. Setting this threshold to 1
will
>> // require that each observation be surrounded by n*n valid
forecast
>> // points.
>> //
>> // e.g. interp_thresh = 1.0;
>> //
>> interp_thresh = 1.0;
>>
>> //
>> // Specify flags to indicate the type of data to be output:
>> //
>> // (1) STAT and RHIST Text Files, Ranked Histograms:
>> // Total (TOTAL),
>> // Continuous Ranked Probability Score (CRPS),
>> // Ignorance Score (IGN),
>> // Number of ranks used (N_RANK),
>> // Count of observations with current rank (RANK_i)
>> // NOTE: Previous column is repeated for each rank used
(N_RANK)
>> //
>> // (2) STAT and ORANK Text Files, Observation Rank Matched
Pairs:
>> // Total (TOTAL),
>> // Index (INDEX),
>> // Observation Station ID (OBS_SID),
>> // Observation Latitude (OBS_LAT),
>> // Observation Longitude (OBS_LON),
>> // Observation Level (OBS_LVL),
>> // Observation Elevation (OBS_ELV),
>> // Observation Value (OBS),
>> // Probability Integral Transform (PIT),
>> // Observation Rank (RANK),
>> // Number of valid Ensemble Values (N_ENS_VLD),
>> // Total Number of Ensemble Values (N_ENS),
>> // Current Ensemble Value (ENS_i)
>> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
>> //
>> // (3) Write the Ensemble Mean fields.
>> //
>> // (4) Write the Ensemble Standard Deviation fields.
>> //
>> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
>> //
>> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
>> //
>> // (7) Write the Ensemble Minimum fields.
>> //
>> // (8) Write the Ensemble Maximum fields.
>> //
>> // (9) Write the Ensemble Range fields.
>> //
>> // (10) Write the Ensemble Valid Data Count fields.
>> //
>> // (11) Write the Ensemble Relative Frequency by threshold
fields.
>> //
>> // (12) Write the gridded field of Observation Ranks to a NetCDF
file.
>> //
>> // Values for flags (1) and (2) are interpreted as follows:
>> // (0) Do not generate output of this type
>> // (1) Write output to a STAT file
>> // (2) Write output to a STAT file and a text file
>> //
>> // Values for flags (3) though (12) are interpreted as follows:
>> // (0) Do not write this field to the NetCDF file.
>> // (1) Write this field to the NetCDF file.
>> //
>> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
>> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>>
>> //
>> // When computing observation ranks, in the case of ties, randomly
choose
>> // the rank from all possible values. Specify the name of the
random
>> // number generator to be used. See the MET Users Guide for a list
of
>> // possible random number generators.
>> //
>> rng_type = "mt19937";
>>
>> //
>> // If left unspecified, the random number generator seed will
change for
>> // each run and the assignment of ranks will not be reproducable.
>> //
>> rng_seed = "";
>>
>> //
>> // Specify the GRIB Table 2 parameter table version number to be
used
>> // for interpreting GRIB codes.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> grib_ptv = 129;
>>
>> //
>> // Prefix to be used for the output file names.
>> //
>> output_prefix = "";
>>
>> //
>> // Indicate a version number for the contents of this configuration
file.
>> // The value should generally not be modified.
>> //
>> version = "V3.0.1";
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Mariusz Pagowski
Time: Fri Jun 10 09:59:46 2011
Paul,
this file is a log of your run not the config file.
MAriusz
On Jun 10, 2011, at 9:54 AM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> As you requested.
>
> Paul
>
>
> On 06/10/2011 09:48 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>> Paul,
>> The config included in my Mac mail plays all the character tricks
with your text included in the mail. Can you attach it as a text,
maybe gzipped,
>> separately.
>> Thakns,
>> Mariusz
>>
>> On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>
>>> Mariusz,
>>>
>>> I included the ensemble_stat config file that we are using to try
to reproduce the error that you reported using
>>> (presumably) the following setting:
>>>
>>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>
>>> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
>>> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
>>> again, can you please send us the following information:
>>>
>>> 1. NetCDF version and compiler that was used to build it
>>> 2. Compiler family (GNU, PGI, etc.) used to build MET
>>> 3. OS name and version that you are using
>>>
>>> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
>>> for us to fix your problem. Sorry for the trouble.
>>>
>>> Paul
>>>
>>>
>>> $ensemble_stat \
>>> 6 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>> EnsembleStatConfig_enkf \
>>> -point_obs 2010081112.nc \
>>> -outdir . -v 2
>>>
>>> GSL_RNG_TYPE=mt19937
>>> GSL_RNG_SEED=1513747021
>>> Configuration File:
>>> EnsembleStatConfig_enkf
>>> Ensemble Files[6]:
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
>>> Point Observation Files[1]:
>>> 2010081112.nc
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble field: TT(0,2,*,*)
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing point observation file: 2010081112.nc
>>> Searching 95087 observations from 19199 header messages.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem002
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem003
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem004
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem005
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem006
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
>>> interpolation method DW_MEAN(4), using 66 pairs.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Output file: ./ensemble_stat_20100811_120000V.stat
>>> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
>>> Output file: ./ensemble_stat_20100811_120000V_orank.txt
>>> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>>>
>>>
>>>
>>>
>>> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>
>>>> Paul,
>>>> I list the files separately as you suggested.
>>>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>>>
>>>>
>>>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>>>
>>>>
>>>> LongArray::operator[](int) -> range check error ... 4
>>>>
>>>> When I reset to "TT(0-0,2,*,*)" ]
>>>> I get the same error
>>>>
>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>> Nelements = 4
>>>> Nalloc = 10
>>>> AllocInc = 10
>>>> Element # 0 = -9999
>>>> Element # 1 = 2
>>>> Element # 2 = -12345
>>>> Element # 3 = -12345
>>>>
>>>> Mariusz
>>>>
>>>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>
>>>>> Mariusz,
>>>>>
>>>>> Please perform the following test:
>>>>>
>>>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>>>
>>>>> ensemble_stat \
>>>>> 6 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>>>> EnsembleStatConfig_enkf \
>>>>> -point_obs 2010081112.nc \
>>>>> -outdir . -v 2
>>>>>
>>>>> Please let us know if this operation reproduces the error you
reported.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>
>>>>>> Paul,
>>>>>> I changed obs to -point_obs
>>>>>> After an error message about range I changed
>>>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>>>
>>>>>> Still getting an error:
>>>>>>
>>>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>>>
>>>>>>
>>>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>>>> Nelements = 4
>>>>>> Nalloc = 10
>>>>>> AllocInc = 10
>>>>>> Element # 0 = -9999
>>>>>> Element # 1 = 2
>>>>>> Element # 2 = -12345
>>>>>> Element # 3 = -12345
>>>>>>
>>>>>> Thanks,
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>
>>>>>>> Mariusz,
>>>>>>>
>>>>>>> I see the following lines your ensemble_stat output below:
>>>>>>>
>>>>>>>> Gridded Observation Files[1]:
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>
>>>>>>> I think that this means you are using point observations and
not gridded observations. Thus, you should try
>>>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>>>
>>>>>>> Paul
>>>>>>>
>>>>>>>
>>>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>
>>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447
>
>>>>>>>>
>>>>>>>> Paul,
>>>>>>>> Thanks for spotting that.
>>>>>>>> I now run the program with
>>>>>>>>
>>>>>>>> echo
>>>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>>>>> ations, and gridded observations ***"
>>>>>>>> ../bin/ensemble_stat \
>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>
>>>>>>>>
>>>>>>>> and it gives me this error
>>>>>>>>
>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>>>>> , and gridded observations ***
>>>>>>>> Configuration File:
>>>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>>>> Ensemble Files[6]:
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>>>> Gridded Observation Files[1]:
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>>
>>>>>>>>
--------------------------------------------------------------------------\
>>>>>>>> ------
>>>>>>>>
>>>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>>>
>>>>>>>>
--------------------------------------------------------------------------\
>>>>>>>> ------
>>>>>>>>
>>>>>>>> NetCDF: Attribute not found
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Following files are produced
>>>>>>>>
>>>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks for helping
>>>>>>>> Mariusz
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul
Oldenburg} wrote:
>>>>>>>>
>>>>>>>>> Mariusz,
>>>>>>>>>
>>>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>>>
>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>
>>>>>>>>> Usage: ensemble_stat
>>>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>>>> config_file
>>>>>>>>> [-grid_obs file]
>>>>>>>>> ...
>>>>>>>>>
>>>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>>>
>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>
>>>>>>>>> Please let me know if you have any questions.
>>>>>>>>>
>>>>>>>>> Paul
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>>>
>>>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>>>> Queue: met_help
>>>>>>>>>> Subject: ensemble stat problem
>>>>>>>>>> Owner: Nobody
>>>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>>>> Status: new
>>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hello,
>>>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>>>> I am getting an error that looks like this.
>>>>>>>>>>
>>>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts,
point observations, and gridded observations ***
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>>>
>>>>>>>>>> line = 1
>>>>>>>>>>
>>>>>>>>>> econfig_column = 7
>>>>>>>>>>
>>>>>>>>>> text = "so"
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CDF
>>>>>>>>>> ____
>>>>>>>>>>
>>>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>>>
>>>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>>>> Can you help?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Mariusz
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>>
////////////////////////////////////////////////////////////////////////////////
>>> //
>>> // Default ensemble_stat configuration file
>>> //
>>>
////////////////////////////////////////////////////////////////////////////////
>>>
>>> //
>>> // Specify a name to designate the model being verified. This
name will be
>>> // written to the second column of the ASCII output generated.
>>> //
>>> model = "WRF";
>>>
>>> //
>>> // Section 1: Ensemble Processing
>>> //
>>>
>>> //
>>> // Specify a comma-separated list of ensemble fields to be
computed. Each field
>>> // is specified as a GRIB code or abbreviation followed by an
accumulation or
>>> // vertical level indicator for GRIB files or as a variable name
followed by a
>>> // list of dimensions for NetCDF files output from p_interp or
MET.
>>> //
>>> // Specifying ensemble fields for GRIB files:
>>> // GC/ANNN for accumulation interval NNN
>>> // GC/ZNNN for vertical level NNN
>>> // GC/PNNN for pressure level NNN in hPa
>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>> // GC/LNNN for a generic level type
>>> // GC/RNNN for a specific GRIB record number
>>> // Where GC is the number of or abbreviation for the grib code
>>> // to be verified.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> // Specifying ensemble fields for NetCDF files:
>>> // var_name(i,...,j,*,*) for a single field
>>> // Where var_name is the name of the NetCDF variable,
>>> // and i,...,j specifies fixed dimension values,
>>> // and *,* specifies the two dimensions for the gridded field.
>>> //
>>> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>>> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>>> //
>>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>
>>> //
>>> // Specify a comma-separated list of groups of thresholds to be
applied to the
>>> // fields listed above. Ensemble thresholds are used to compute
the ensemble
>>> // relative frequency output.
>>> //
>>> // The length of the "ens_field" and "ens_thresh" arrays must
match. To apply
>>> // multiple thresholds to a field, separate the threshold values
with a space.
>>> //
>>> // Each threshold must be preceded by a two letter indicator for
the type of
>>> // thresholding to be performed:
>>> // 'lt' for less than 'le' for less than or equal to
>>> // 'eq' for equal to 'ne' for not equal to
>>> // 'gt' for greater than 'ge' for greater than or equal to
>>> //
>>> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0"
];
>>> //
>>> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>>>
>>> //
>>> // When summarizing the ensemble, compute a ratio of the number of
valid
>>> // ensemble fields to the total number of ensemble members. If
that ratio is
>>> // less than this threshold, error out. This threshold must be
between 0 and 1.
>>> // Setting this threshold to 1 will require that each all ensemble
members be
>>> // present to be processed.
>>> //
>>> // e.g. vld_ens_thresh = 1.0;
>>> //
>>> vld_ens_thresh = 1.0;
>>>
>>> //
>>> // When summarizing the ensemble, for each grid point compute a
ratio of the
>>> // number of valid data values to the number of ensemble members.
If that
>>> // ratio is less than this threshold, write out bad data. This
threshold must
>>> // be between 0 and 1. Setting this threshold to 1 will require
each grid
>>> // point to contain valid data for all ensemble members.
>>> //
>>> // e.g. vld_data_thresh = 1.0;
>>> //
>>> vld_data_thresh = 1.0;
>>>
>>> //
>>> // Section 2: Rank Histograms
>>> //
>>>
>>> //
>>> // Specify a comma-separated list of ensemble fields to be
verified. The
>>> // forecast and observation fields may be specified separately.
If the
>>> // obs_field parameter is left blank, it will default to the
contents of
>>> // fcst_field.
>>> //
>>> // Each field is specified as a GRIB code or abbreviation followed
by an
>>> // accumulation or vertical level indicator for GRIB files or as a
variable name
>>> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
>>> //
>>> // Specifying verification fields for GRIB files:
>>> // GC/ANNN for accumulation interval NNN
>>> // GC/ZNNN for vertical level NNN
>>> // GC/PNNN for pressure level NNN in hPa
>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>> // GC/LNNN for a generic level type
>>> // GC/RNNN for a specific GRIB record number
>>> // Where GC is the number of or abbreviation for the grib code
>>> // to be verified.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> // Specifying verification fields for NetCDF files:
>>> // var_name(i,...,j,*,*) for a single field
>>> // Where var_name is the name of the NetCDF variable,
>>> // and i,...,j specifies fixed dimension values,
>>> // and *,* specifies the two dimensions for the gridded field.
>>> //
>>> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>>> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>>> //
>>> fcst_field[] = [ "TT(0,2,*,*)" ];
>>> obs_field[] = [ "TMP/P850" ];
>>>
>>> //
>>> // Beginning and ending time offset values in seconds for point
observations
>>> // to be used. These time offsets are defined in reference to the
>>> // ensemble valid time, v. Observations with a valid time falling
in the
>>> // window [v+beg_ds, v+end_ds] will be used.
>>> // These selections are overridden by the command line arguments
>>> // -obs_valid_beg and -obs_valid_end.
>>> //
>>> beg_ds = -900;
>>> end_ds = 900;
>>>
>>> //
>>> // Specify a comma-separated list of PrepBufr message types with
which
>>> // to perform the point verification. Statistics will be computed
separately
>>> // for each message type specified. At least one PrepBufr message
type
>>> // must be provided when verifying with point observations.
>>> // List of valid message types:
>>> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
>>> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
>>> // SFCSHP SPSSMI SYNDAT VADWND
>>> // ANYAIR (= AIRCAR, AIRCFT)
>>> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
>>> // ONLYSF (= ADPSFC, SFCSHP)
>>> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
>>> //
>>> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
>>> //
>>> message_type[] = [ "ANYSFC" ];
>>>
>>> //
>>> // Specify a comma-separated list of grids to be used in masking
the data over
>>> // which to perform scoring. An empty list indicates that no
masking grid
>>> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
>>> // indicates the three digit grid number. Enter "FULL" to score
over the
>>> // entire domain.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
>>> //
>>> // e.g. mask_grid[] = [ "FULL" ];
>>> //
>>> mask_grid[] = [ "FULL" ];
>>>
>>> //
>>> // Specify a comma-separated list of masking regions to be
applied.
>>> // An empty list indicates that no additional masks should be
used.
>>> // The masking regions may be defined in one of 4 ways:
>>> //
>>> // (1) An ASCII file containing a lat/lon polygon.
>>> // Latitude in degrees north and longitude in degrees east.
>>> // By default, the first and last polygon points are
connected.
>>> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
>>> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
>>> //
>>> // (2) The NetCDF output of the gen_poly_mask tool.
>>> //
>>> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
>>> // to be used, and optionally, a threshold to be applied to
the field.
>>> // e.g. "sample.nc var_name gt0.00"
>>> //
>>> // (4) A GRIB data file, followed by a description of the field
>>> // to be used, and optionally, a threshold to be applied to
the field.
>>> // e.g. "sample.grb APCP/A3 gt0.00"
>>> //
>>> // Any NetCDF or GRIB file used must have the same grid dimensions
as the
>>> // data being verified.
>>> //
>>> // MET_BASE may be used in the path for the files above.
>>> //
>>> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
>>> // "poly_mask.ncf",
>>> // "sample.nc APCP",
>>> // "sample.grb HGT/Z0 gt100.0" ];
>>> //
>>> mask_poly[] = [ ] ;
>>>
>>> //
>>> // Specify the name of an ASCII file containing a space-separated
list of
>>> // station ID's at which to perform verification. Each station ID
specified
>>> // is treated as an individual masking region.
>>> //
>>> // An empty list file name indicates that no station ID masks
should be used.
>>> //
>>> // MET_BASE may be used in the path for the station ID mask file
name.
>>> //
>>> // e.g. mask_sid = "CONUS.stations";
>>> //
>>> mask_sid = "";
>>>
>>> //
>>> // Specify a comma-separated list of interpolation method(s) to be
used for
>>> // point observations. For gridded observations, this serves to
smooth
>>> // the data fields prior to verifying them. The value at each
grid point is
>>> // replaced by the measure computed over the neighborhood defined
around the
>>> // grid point. String values are interpreted as follows:
>>> // MIN = Minimum in the neighborhood
>>> // MAX = Maximum in the neighborhood
>>> // MEDIAN = Median in the neighborhood
>>> // UW_MEAN = Unweighted mean in the neighborhood
>>> // DW_MEAN = Distance-weighted mean in the neighborhood
>>> // LS_FIT = Least-squares fit in the neighborhood
>>> // BILIN = Bilinear interpolation using the 4 closest points
>>> //
>>> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
>>> //
>>> interp_method[] = [ "DW_MEAN" ];
>>>
>>> //
>>> // Specify a comma-separated list of box widths to be used by the
interpolation
>>> // techniques listed above. A value of 1 indicates that no
smoothing should be
>>> // performed.
>>> //
>>> // e.g. interp_width = [ 1, 3, 5 ];
>>> //
>>> interp_width[] = [ 2 ];
>>>
>>> //
>>> // The interp_flag controls how the smoothing defined above should
be applied:
>>> // (1) Smooth only the forecast field
>>> // (2) Smooth only the observation field
>>> // (3) Smooth both the forecast and observation fields
>>> //
>>> interp_flag = 1;
>>>
>>> //
>>> // When smoothing, compute a ratio of the number of valid data
points to
>>> // the total number of points in the neighborhood. If that ratio
is less
>>> // than this threshold, do not compute a smoothed forecast value.
This
>>> // threshold must be between 0 and 1. Setting this threshold to 1
will
>>> // require that each observation be surrounded by n*n valid
forecast
>>> // points.
>>> //
>>> // e.g. interp_thresh = 1.0;
>>> //
>>> interp_thresh = 1.0;
>>>
>>> //
>>> // Specify flags to indicate the type of data to be output:
>>> //
>>> // (1) STAT and RHIST Text Files, Ranked Histograms:
>>> // Total (TOTAL),
>>> // Continuous Ranked Probability Score (CRPS),
>>> // Ignorance Score (IGN),
>>> // Number of ranks used (N_RANK),
>>> // Count of observations with current rank (RANK_i)
>>> // NOTE: Previous column is repeated for each rank used
(N_RANK)
>>> //
>>> // (2) STAT and ORANK Text Files, Observation Rank Matched
Pairs:
>>> // Total (TOTAL),
>>> // Index (INDEX),
>>> // Observation Station ID (OBS_SID),
>>> // Observation Latitude (OBS_LAT),
>>> // Observation Longitude (OBS_LON),
>>> // Observation Level (OBS_LVL),
>>> // Observation Elevation (OBS_ELV),
>>> // Observation Value (OBS),
>>> // Probability Integral Transform (PIT),
>>> // Observation Rank (RANK),
>>> // Number of valid Ensemble Values (N_ENS_VLD),
>>> // Total Number of Ensemble Values (N_ENS),
>>> // Current Ensemble Value (ENS_i)
>>> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
>>> //
>>> // (3) Write the Ensemble Mean fields.
>>> //
>>> // (4) Write the Ensemble Standard Deviation fields.
>>> //
>>> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
>>> //
>>> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
>>> //
>>> // (7) Write the Ensemble Minimum fields.
>>> //
>>> // (8) Write the Ensemble Maximum fields.
>>> //
>>> // (9) Write the Ensemble Range fields.
>>> //
>>> // (10) Write the Ensemble Valid Data Count fields.
>>> //
>>> // (11) Write the Ensemble Relative Frequency by threshold
fields.
>>> //
>>> // (12) Write the gridded field of Observation Ranks to a NetCDF
file.
>>> //
>>> // Values for flags (1) and (2) are interpreted as follows:
>>> // (0) Do not generate output of this type
>>> // (1) Write output to a STAT file
>>> // (2) Write output to a STAT file and a text file
>>> //
>>> // Values for flags (3) though (12) are interpreted as follows:
>>> // (0) Do not write this field to the NetCDF file.
>>> // (1) Write this field to the NetCDF file.
>>> //
>>> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
>>> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>>>
>>> //
>>> // When computing observation ranks, in the case of ties, randomly
choose
>>> // the rank from all possible values. Specify the name of the
random
>>> // number generator to be used. See the MET Users Guide for a
list of
>>> // possible random number generators.
>>> //
>>> rng_type = "mt19937";
>>>
>>> //
>>> // If left unspecified, the random number generator seed will
change for
>>> // each run and the assignment of ranks will not be reproducable.
>>> //
>>> rng_seed = "";
>>>
>>> //
>>> // Specify the GRIB Table 2 parameter table version number to be
used
>>> // for interpreting GRIB codes.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> grib_ptv = 129;
>>>
>>> //
>>> // Prefix to be used for the output file names.
>>> //
>>> output_prefix = "";
>>>
>>> //
>>> // Indicate a version number for the contents of this
configuration file.
>>> // The value should generally not be modified.
>>> //
>>> version = "V3.0.1";
>>
>
>
> <ens_out.txt.tar.gz>
------------------------------------------------
Subject: ensemble stat problem
From: Paul Oldenburg
Time: Fri Jun 10 10:00:53 2011
On 06/10/2011 09:59 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
> Paul,
> this file is a log of your run not the config file.
> MAriusz
>
> On Jun 10, 2011, at 9:54 AM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>
>> Mariusz,
>>
>> As you requested.
>>
>> Paul
>>
>>
>> On 06/10/2011 09:48 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>
>>> Paul,
>>> The config included in my Mac mail plays all the character tricks
with your text included in the mail. Can you attach it as a text,
maybe gzipped,
>>> separately.
>>> Thakns,
>>> Mariusz
>>>
>>> On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>
>>>> Mariusz,
>>>>
>>>> I included the ensemble_stat config file that we are using to try
to reproduce the error that you reported using
>>>> (presumably) the following setting:
>>>>
>>>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>>
>>>> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
>>>> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
>>>> again, can you please send us the following information:
>>>>
>>>> 1. NetCDF version and compiler that was used to build it
>>>> 2. Compiler family (GNU, PGI, etc.) used to build MET
>>>> 3. OS name and version that you are using
>>>>
>>>> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
>>>> for us to fix your problem. Sorry for the trouble.
>>>>
>>>> Paul
>>>>
>>>>
>>>> $ensemble_stat \
>>>> 6 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>>> EnsembleStatConfig_enkf \
>>>> -point_obs 2010081112.nc \
>>>> -outdir . -v 2
>>>>
>>>> GSL_RNG_TYPE=mt19937
>>>> GSL_RNG_SEED=1513747021
>>>> Configuration File:
>>>> EnsembleStatConfig_enkf
>>>> Ensemble Files[6]:
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
>>>> Point Observation Files[1]:
>>>> 2010081112.nc
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble field: TT(0,2,*,*)
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing point observation file: 2010081112.nc
>>>> Searching 95087 observations from 19199 header messages.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>>> For TT(0,2,*,*) found 1 forecast levels.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem002
>>>> For TT(0,2,*,*) found 1 forecast levels.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem003
>>>> For TT(0,2,*,*) found 1 forecast levels.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem004
>>>> For TT(0,2,*,*) found 1 forecast levels.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem005
>>>> For TT(0,2,*,*) found 1 forecast levels.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem006
>>>> For TT(0,2,*,*) found 1 forecast levels.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
>>>> interpolation method DW_MEAN(4), using 66 pairs.
>>>>
>>>>
--------------------------------------------------------------------------------
>>>>
>>>> Output file: ./ensemble_stat_20100811_120000V.stat
>>>> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
>>>> Output file: ./ensemble_stat_20100811_120000V_orank.txt
>>>> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>>>>
>>>>
>>>>
>>>>
>>>> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>
>>>>> Paul,
>>>>> I list the files separately as you suggested.
>>>>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>>>>
>>>>>
>>>>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>>>>
>>>>>
>>>>> LongArray::operator[](int) -> range check error ... 4
>>>>>
>>>>> When I reset to "TT(0-0,2,*,*)" ]
>>>>> I get the same error
>>>>>
>>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>>> Nelements = 4
>>>>> Nalloc = 10
>>>>> AllocInc = 10
>>>>> Element # 0 = -9999
>>>>> Element # 1 = 2
>>>>> Element # 2 = -12345
>>>>> Element # 3 = -12345
>>>>>
>>>>> Mariusz
>>>>>
>>>>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>
>>>>>> Mariusz,
>>>>>>
>>>>>> Please perform the following test:
>>>>>>
>>>>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>>>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>>>>
>>>>>> ensemble_stat \
>>>>>> 6 \
>>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>>>>> EnsembleStatConfig_enkf \
>>>>>> -point_obs 2010081112.nc \
>>>>>> -outdir . -v 2
>>>>>>
>>>>>> Please let us know if this operation reproduces the error you
reported.
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>>
>>>>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447
>
>>>>>>>
>>>>>>> Paul,
>>>>>>> I changed obs to -point_obs
>>>>>>> After an error message about range I changed
>>>>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>>>>
>>>>>>> Still getting an error:
>>>>>>>
>>>>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>>>>
>>>>>>>
>>>>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &,
double &) const -> bad arguments:
>>>>>>> Nelements = 4
>>>>>>> Nalloc = 10
>>>>>>> AllocInc = 10
>>>>>>> Element # 0 = -9999
>>>>>>> Element # 1 = 2
>>>>>>> Element # 2 = -12345
>>>>>>> Element # 3 = -12345
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Mariusz
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>>
>>>>>>>> Mariusz,
>>>>>>>>
>>>>>>>> I see the following lines your ensemble_stat output below:
>>>>>>>>
>>>>>>>>> Gridded Observation Files[1]:
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>>
>>>>>>>> I think that this means you are using point observations and
not gridded observations. Thus, you should try
>>>>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>>>>
>>>>>>>> Paul
>>>>>>>>
>>>>>>>>
>>>>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>>
>>>>>>>>> <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>>
>>>>>>>>> Paul,
>>>>>>>>> Thanks for spotting that.
>>>>>>>>> I now run the program with
>>>>>>>>>
>>>>>>>>> echo
>>>>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB
forecasts, point observ\
>>>>>>>>> ations, and gridded observations ***"
>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> and it gives me this error
>>>>>>>>>
>>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts,
point observations\
>>>>>>>>> , and gridded observations ***
>>>>>>>>> Configuration File:
>>>>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>>>>> Ensemble Files[6]:
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>>>>> Gridded Observation Files[1]:
>>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>>>
>>>>>>>>>
--------------------------------------------------------------------------\
>>>>>>>>> ------
>>>>>>>>>
>>>>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>>>>
>>>>>>>>>
--------------------------------------------------------------------------\
>>>>>>>>> ------
>>>>>>>>>
>>>>>>>>> NetCDF: Attribute not found
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Following files are produced
>>>>>>>>>
>>>>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks for helping
>>>>>>>>> Mariusz
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul
Oldenburg} wrote:
>>>>>>>>>
>>>>>>>>>> Mariusz,
>>>>>>>>>>
>>>>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>>>>
>>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>>
>>>>>>>>>> Usage: ensemble_stat
>>>>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>>>>> config_file
>>>>>>>>>> [-grid_obs file]
>>>>>>>>>> ...
>>>>>>>>>>
>>>>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>>>>
>>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>>
>>>>>>>>>> Please let me know if you have any questions.
>>>>>>>>>>
>>>>>>>>>> Paul
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>>>>
>>>>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>>>>> Queue: met_help
>>>>>>>>>>> Subject: ensemble stat problem
>>>>>>>>>>> Owner: Nobody
>>>>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>>>>> Status: new
>>>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hello,
>>>>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>>>>> I am getting an error that looks like this.
>>>>>>>>>>>
>>>>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts,
point observations, and gridded observations ***
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>>>>
>>>>>>>>>>> line = 1
>>>>>>>>>>>
>>>>>>>>>>> econfig_column = 7
>>>>>>>>>>>
>>>>>>>>>>> text = "so"
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> CDF
>>>>>>>>>>> ____
>>>>>>>>>>>
>>>>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>>>>
>>>>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>>>>> Can you help?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Mariusz
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>>
////////////////////////////////////////////////////////////////////////////////
>>>> //
>>>> // Default ensemble_stat configuration file
>>>> //
>>>>
////////////////////////////////////////////////////////////////////////////////
>>>>
>>>> //
>>>> // Specify a name to designate the model being verified. This
name will be
>>>> // written to the second column of the ASCII output generated.
>>>> //
>>>> model = "WRF";
>>>>
>>>> //
>>>> // Section 1: Ensemble Processing
>>>> //
>>>>
>>>> //
>>>> // Specify a comma-separated list of ensemble fields to be
computed. Each field
>>>> // is specified as a GRIB code or abbreviation followed by an
accumulation or
>>>> // vertical level indicator for GRIB files or as a variable name
followed by a
>>>> // list of dimensions for NetCDF files output from p_interp or
MET.
>>>> //
>>>> // Specifying ensemble fields for GRIB files:
>>>> // GC/ANNN for accumulation interval NNN
>>>> // GC/ZNNN for vertical level NNN
>>>> // GC/PNNN for pressure level NNN in hPa
>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>> // GC/LNNN for a generic level type
>>>> // GC/RNNN for a specific GRIB record number
>>>> // Where GC is the number of or abbreviation for the grib code
>>>> // to be verified.
>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>> //
>>>> // Specifying ensemble fields for NetCDF files:
>>>> // var_name(i,...,j,*,*) for a single field
>>>> // Where var_name is the name of the NetCDF variable,
>>>> // and i,...,j specifies fixed dimension values,
>>>> // and *,* specifies the two dimensions for the gridded field.
>>>> //
>>>> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>>>> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>>>> //
>>>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>>
>>>> //
>>>> // Specify a comma-separated list of groups of thresholds to be
applied to the
>>>> // fields listed above. Ensemble thresholds are used to compute
the ensemble
>>>> // relative frequency output.
>>>> //
>>>> // The length of the "ens_field" and "ens_thresh" arrays must
match. To apply
>>>> // multiple thresholds to a field, separate the threshold values
with a space.
>>>> //
>>>> // Each threshold must be preceded by a two letter indicator for
the type of
>>>> // thresholding to be performed:
>>>> // 'lt' for less than 'le' for less than or equal to
>>>> // 'eq' for equal to 'ne' for not equal to
>>>> // 'gt' for greater than 'ge' for greater than or equal to
>>>> //
>>>> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0"
];
>>>> //
>>>> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>>>>
>>>> //
>>>> // When summarizing the ensemble, compute a ratio of the number
of valid
>>>> // ensemble fields to the total number of ensemble members. If
that ratio is
>>>> // less than this threshold, error out. This threshold must be
between 0 and 1.
>>>> // Setting this threshold to 1 will require that each all
ensemble members be
>>>> // present to be processed.
>>>> //
>>>> // e.g. vld_ens_thresh = 1.0;
>>>> //
>>>> vld_ens_thresh = 1.0;
>>>>
>>>> //
>>>> // When summarizing the ensemble, for each grid point compute a
ratio of the
>>>> // number of valid data values to the number of ensemble members.
If that
>>>> // ratio is less than this threshold, write out bad data. This
threshold must
>>>> // be between 0 and 1. Setting this threshold to 1 will require
each grid
>>>> // point to contain valid data for all ensemble members.
>>>> //
>>>> // e.g. vld_data_thresh = 1.0;
>>>> //
>>>> vld_data_thresh = 1.0;
>>>>
>>>> //
>>>> // Section 2: Rank Histograms
>>>> //
>>>>
>>>> //
>>>> // Specify a comma-separated list of ensemble fields to be
verified. The
>>>> // forecast and observation fields may be specified separately.
If the
>>>> // obs_field parameter is left blank, it will default to the
contents of
>>>> // fcst_field.
>>>> //
>>>> // Each field is specified as a GRIB code or abbreviation
followed by an
>>>> // accumulation or vertical level indicator for GRIB files or as
a variable name
>>>> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
>>>> //
>>>> // Specifying verification fields for GRIB files:
>>>> // GC/ANNN for accumulation interval NNN
>>>> // GC/ZNNN for vertical level NNN
>>>> // GC/PNNN for pressure level NNN in hPa
>>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>>> // GC/LNNN for a generic level type
>>>> // GC/RNNN for a specific GRIB record number
>>>> // Where GC is the number of or abbreviation for the grib code
>>>> // to be verified.
>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>> //
>>>> // Specifying verification fields for NetCDF files:
>>>> // var_name(i,...,j,*,*) for a single field
>>>> // Where var_name is the name of the NetCDF variable,
>>>> // and i,...,j specifies fixed dimension values,
>>>> // and *,* specifies the two dimensions for the gridded field.
>>>> //
>>>> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>>>> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>>>> //
>>>> fcst_field[] = [ "TT(0,2,*,*)" ];
>>>> obs_field[] = [ "TMP/P850" ];
>>>>
>>>> //
>>>> // Beginning and ending time offset values in seconds for point
observations
>>>> // to be used. These time offsets are defined in reference to
the
>>>> // ensemble valid time, v. Observations with a valid time
falling in the
>>>> // window [v+beg_ds, v+end_ds] will be used.
>>>> // These selections are overridden by the command line arguments
>>>> // -obs_valid_beg and -obs_valid_end.
>>>> //
>>>> beg_ds = -900;
>>>> end_ds = 900;
>>>>
>>>> //
>>>> // Specify a comma-separated list of PrepBufr message types with
which
>>>> // to perform the point verification. Statistics will be
computed separately
>>>> // for each message type specified. At least one PrepBufr
message type
>>>> // must be provided when verifying with point observations.
>>>> // List of valid message types:
>>>> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
>>>> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
>>>> // SFCSHP SPSSMI SYNDAT VADWND
>>>> // ANYAIR (= AIRCAR, AIRCFT)
>>>> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
>>>> // ONLYSF (= ADPSFC, SFCSHP)
>>>> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
>>>> //
>>>> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
>>>> //
>>>> message_type[] = [ "ANYSFC" ];
>>>>
>>>> //
>>>> // Specify a comma-separated list of grids to be used in masking
the data over
>>>> // which to perform scoring. An empty list indicates that no
masking grid
>>>> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
>>>> // indicates the three digit grid number. Enter "FULL" to score
over the
>>>> // entire domain.
>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
>>>> //
>>>> // e.g. mask_grid[] = [ "FULL" ];
>>>> //
>>>> mask_grid[] = [ "FULL" ];
>>>>
>>>> //
>>>> // Specify a comma-separated list of masking regions to be
applied.
>>>> // An empty list indicates that no additional masks should be
used.
>>>> // The masking regions may be defined in one of 4 ways:
>>>> //
>>>> // (1) An ASCII file containing a lat/lon polygon.
>>>> // Latitude in degrees north and longitude in degrees east.
>>>> // By default, the first and last polygon points are
connected.
>>>> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
>>>> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
>>>> //
>>>> // (2) The NetCDF output of the gen_poly_mask tool.
>>>> //
>>>> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
>>>> // to be used, and optionally, a threshold to be applied to
the field.
>>>> // e.g. "sample.nc var_name gt0.00"
>>>> //
>>>> // (4) A GRIB data file, followed by a description of the field
>>>> // to be used, and optionally, a threshold to be applied to
the field.
>>>> // e.g. "sample.grb APCP/A3 gt0.00"
>>>> //
>>>> // Any NetCDF or GRIB file used must have the same grid
dimensions as the
>>>> // data being verified.
>>>> //
>>>> // MET_BASE may be used in the path for the files above.
>>>> //
>>>> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
>>>> // "poly_mask.ncf",
>>>> // "sample.nc APCP",
>>>> // "sample.grb HGT/Z0 gt100.0" ];
>>>> //
>>>> mask_poly[] = [ ] ;
>>>>
>>>> //
>>>> // Specify the name of an ASCII file containing a space-separated
list of
>>>> // station ID's at which to perform verification. Each station
ID specified
>>>> // is treated as an individual masking region.
>>>> //
>>>> // An empty list file name indicates that no station ID masks
should be used.
>>>> //
>>>> // MET_BASE may be used in the path for the station ID mask file
name.
>>>> //
>>>> // e.g. mask_sid = "CONUS.stations";
>>>> //
>>>> mask_sid = "";
>>>>
>>>> //
>>>> // Specify a comma-separated list of interpolation method(s) to
be used for
>>>> // point observations. For gridded observations, this serves to
smooth
>>>> // the data fields prior to verifying them. The value at each
grid point is
>>>> // replaced by the measure computed over the neighborhood defined
around the
>>>> // grid point. String values are interpreted as follows:
>>>> // MIN = Minimum in the neighborhood
>>>> // MAX = Maximum in the neighborhood
>>>> // MEDIAN = Median in the neighborhood
>>>> // UW_MEAN = Unweighted mean in the neighborhood
>>>> // DW_MEAN = Distance-weighted mean in the neighborhood
>>>> // LS_FIT = Least-squares fit in the neighborhood
>>>> // BILIN = Bilinear interpolation using the 4 closest points
>>>> //
>>>> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
>>>> //
>>>> interp_method[] = [ "DW_MEAN" ];
>>>>
>>>> //
>>>> // Specify a comma-separated list of box widths to be used by the
interpolation
>>>> // techniques listed above. A value of 1 indicates that no
smoothing should be
>>>> // performed.
>>>> //
>>>> // e.g. interp_width = [ 1, 3, 5 ];
>>>> //
>>>> interp_width[] = [ 2 ];
>>>>
>>>> //
>>>> // The interp_flag controls how the smoothing defined above
should be applied:
>>>> // (1) Smooth only the forecast field
>>>> // (2) Smooth only the observation field
>>>> // (3) Smooth both the forecast and observation fields
>>>> //
>>>> interp_flag = 1;
>>>>
>>>> //
>>>> // When smoothing, compute a ratio of the number of valid data
points to
>>>> // the total number of points in the neighborhood. If that ratio
is less
>>>> // than this threshold, do not compute a smoothed forecast value.
This
>>>> // threshold must be between 0 and 1. Setting this threshold to
1 will
>>>> // require that each observation be surrounded by n*n valid
forecast
>>>> // points.
>>>> //
>>>> // e.g. interp_thresh = 1.0;
>>>> //
>>>> interp_thresh = 1.0;
>>>>
>>>> //
>>>> // Specify flags to indicate the type of data to be output:
>>>> //
>>>> // (1) STAT and RHIST Text Files, Ranked Histograms:
>>>> // Total (TOTAL),
>>>> // Continuous Ranked Probability Score (CRPS),
>>>> // Ignorance Score (IGN),
>>>> // Number of ranks used (N_RANK),
>>>> // Count of observations with current rank (RANK_i)
>>>> // NOTE: Previous column is repeated for each rank used
(N_RANK)
>>>> //
>>>> // (2) STAT and ORANK Text Files, Observation Rank Matched
Pairs:
>>>> // Total (TOTAL),
>>>> // Index (INDEX),
>>>> // Observation Station ID (OBS_SID),
>>>> // Observation Latitude (OBS_LAT),
>>>> // Observation Longitude (OBS_LON),
>>>> // Observation Level (OBS_LVL),
>>>> // Observation Elevation (OBS_ELV),
>>>> // Observation Value (OBS),
>>>> // Probability Integral Transform (PIT),
>>>> // Observation Rank (RANK),
>>>> // Number of valid Ensemble Values (N_ENS_VLD),
>>>> // Total Number of Ensemble Values (N_ENS),
>>>> // Current Ensemble Value (ENS_i)
>>>> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
>>>> //
>>>> // (3) Write the Ensemble Mean fields.
>>>> //
>>>> // (4) Write the Ensemble Standard Deviation fields.
>>>> //
>>>> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
>>>> //
>>>> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
>>>> //
>>>> // (7) Write the Ensemble Minimum fields.
>>>> //
>>>> // (8) Write the Ensemble Maximum fields.
>>>> //
>>>> // (9) Write the Ensemble Range fields.
>>>> //
>>>> // (10) Write the Ensemble Valid Data Count fields.
>>>> //
>>>> // (11) Write the Ensemble Relative Frequency by threshold
fields.
>>>> //
>>>> // (12) Write the gridded field of Observation Ranks to a
NetCDF file.
>>>> //
>>>> // Values for flags (1) and (2) are interpreted as follows:
>>>> // (0) Do not generate output of this type
>>>> // (1) Write output to a STAT file
>>>> // (2) Write output to a STAT file and a text file
>>>> //
>>>> // Values for flags (3) though (12) are interpreted as follows:
>>>> // (0) Do not write this field to the NetCDF file.
>>>> // (1) Write this field to the NetCDF file.
>>>> //
>>>> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
>>>> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>>>>
>>>> //
>>>> // When computing observation ranks, in the case of ties,
randomly choose
>>>> // the rank from all possible values. Specify the name of the
random
>>>> // number generator to be used. See the MET Users Guide for a
list of
>>>> // possible random number generators.
>>>> //
>>>> rng_type = "mt19937";
>>>>
>>>> //
>>>> // If left unspecified, the random number generator seed will
change for
>>>> // each run and the assignment of ranks will not be reproducable.
>>>> //
>>>> rng_seed = "";
>>>>
>>>> //
>>>> // Specify the GRIB Table 2 parameter table version number to be
used
>>>> // for interpreting GRIB codes.
>>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>>> //
>>>> grib_ptv = 129;
>>>>
>>>> //
>>>> // Prefix to be used for the output file names.
>>>> //
>>>> output_prefix = "";
>>>>
>>>> //
>>>> // Indicate a version number for the contents of this
configuration file.
>>>> // The value should generally not be modified.
>>>> //
>>>> version = "V3.0.1";
>>>
>>
>>
>> <ens_out.txt.tar.gz>
>
------------------------------------------------
Subject: ensemble stat problem
From: Mariusz Pagowski
Time: Fri Jun 10 10:12:44 2011
Paul,
I ran the code with your config and got
Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
LongArray::operator[](int) -> range check error ... 4
Attached is Makefile used to build MET. My compilers are as follows
Mariusz
------------------------------------------------
Subject: ensemble stat problem
From: Mariusz Pagowski
Time: Fri Jun 10 10:12:44 2011
1) icc/11.1.072 9) nco/4.0.1
2) mvapich2/1.4.1-intel-11.1 10) udunits/2.1.15
3) netcdf/3.6.3 11) mathlibs/fftw
4) hdf4/4.2r3-intel 12) gempak/5.11.4
5) hdf5/1.8.3 13) jet-tools
6) ncl/5.2.0 14) sge
7) intel/11.1.072 15) totalview/8.8.0-1
8) papi/4.1.0 16) wjet
On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> I included the ensemble_stat config file that we are using to try to
reproduce the error that you reported using
> (presumably) the following setting:
>
> ens_field[] = [ "TT(0,2,*,*)" ] ;
>
> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
> again, can you please send us the following information:
>
> 1. NetCDF version and compiler that was used to build it
> 2. Compiler family (GNU, PGI, etc.) used to build MET
> 3. OS name and version that you are using
>
> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
> for us to fix your problem. Sorry for the trouble.
>
> Paul
>
>
> $ensemble_stat \
> 6 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
> EnsembleStatConfig_enkf \
> -point_obs 2010081112.nc \
> -outdir . -v 2
>
> GSL_RNG_TYPE=mt19937
> GSL_RNG_SEED=1513747021
> Configuration File:
> EnsembleStatConfig_enkf
> Ensemble Files[6]:
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
> Point Observation Files[1]:
> 2010081112.nc
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble field: TT(0,2,*,*)
>
>
--------------------------------------------------------------------------------
>
> Processing point observation file: 2010081112.nc
> Searching 95087 observations from 19199 header messages.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing ensemble file: wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
> For TT(0,2,*,*) found 1 forecast levels.
>
>
--------------------------------------------------------------------------------
>
> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
> interpolation method DW_MEAN(4), using 66 pairs.
>
>
--------------------------------------------------------------------------------
>
> Output file: ./ensemble_stat_20100811_120000V.stat
> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
> Output file: ./ensemble_stat_20100811_120000V_orank.txt
> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>
>
>
>
> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>> Paul,
>> I list the files separately as you suggested.
>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>
>>
>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>
>>
>> LongArray::operator[](int) -> range check error ... 4
>>
>> When I reset to "TT(0-0,2,*,*)" ]
>> I get the same error
>>
>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double &)
const -> bad arguments:
>> Nelements = 4
>> Nalloc = 10
>> AllocInc = 10
>> Element # 0 = -9999
>> Element # 1 = 2
>> Element # 2 = -12345
>> Element # 3 = -12345
>>
>> Mariusz
>>
>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>
>>> Mariusz,
>>>
>>> Please perform the following test:
>>>
>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>
>>> ensemble_stat \
>>> 6 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>> EnsembleStatConfig_enkf \
>>> -point_obs 2010081112.nc \
>>> -outdir . -v 2
>>>
>>> Please let us know if this operation reproduces the error you
reported.
>>>
>>> Thanks,
>>>
>>> Paul
>>>
>>>
>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>
>>>> Paul,
>>>> I changed obs to -point_obs
>>>> After an error message about range I changed
>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>
>>>> Still getting an error:
>>>>
>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>
>>>>
>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>> Nelements = 4
>>>> Nalloc = 10
>>>> AllocInc = 10
>>>> Element # 0 = -9999
>>>> Element # 1 = 2
>>>> Element # 2 = -12345
>>>> Element # 3 = -12345
>>>>
>>>> Thanks,
>>>> Mariusz
>>>>
>>>>
>>>>
>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>
>>>>> Mariusz,
>>>>>
>>>>> I see the following lines your ensemble_stat output below:
>>>>>
>>>>>> Gridded Observation Files[1]:
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>
>>>>> I think that this means you are using point observations and not
gridded observations. Thus, you should try
>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>
>>>>>> Paul,
>>>>>> Thanks for spotting that.
>>>>>> I now run the program with
>>>>>>
>>>>>> echo
>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>>> ations, and gridded observations ***"
>>>>>> ../bin/ensemble_stat \
>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>> -outdir $OUTDIR -v 2
>>>>>>
>>>>>>
>>>>>> and it gives me this error
>>>>>>
>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>>> , and gridded observations ***
>>>>>> Configuration File:
>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>> Ensemble Files[6]:
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>> Gridded Observation Files[1]:
>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>
>>>>>>
--------------------------------------------------------------------------\
>>>>>> ------
>>>>>>
>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>
>>>>>>
--------------------------------------------------------------------------\
>>>>>> ------
>>>>>>
>>>>>> NetCDF: Attribute not found
>>>>>>
>>>>>>
>>>>>>
>>>>>> Following files are produced
>>>>>>
>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> Thanks for helping
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>
>>>>>>> Mariusz,
>>>>>>>
>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>
>>>>>>> ../bin/ensemble_stat \
>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>
>>>>>>> Usage: ensemble_stat
>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>> config_file
>>>>>>> [-grid_obs file]
>>>>>>> ...
>>>>>>>
>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>
>>>>>>> ../bin/ensemble_stat \
>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>
>>>>>>> Please let me know if you have any questions.
>>>>>>>
>>>>>>> Paul
>>>>>>>
>>>>>>>
>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>
>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>> Queue: met_help
>>>>>>>> Subject: ensemble stat problem
>>>>>>>> Owner: Nobody
>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>> Status: new
>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>
>>>>>>>>
>>>>>>>> Hello,
>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>> I am getting an error that looks like this.
>>>>>>>>
>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations, and gridded observations ***
>>>>>>>>
>>>>>>>>
>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>
>>>>>>>> line = 1
>>>>>>>>
>>>>>>>> econfig_column = 7
>>>>>>>>
>>>>>>>> text = "so"
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> CDF
>>>>>>>> ____
>>>>>>>>
>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>
>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>> Can you help?
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Mariusz
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>
>
>
////////////////////////////////////////////////////////////////////////////////
> //
> // Default ensemble_stat configuration file
> //
>
////////////////////////////////////////////////////////////////////////////////
>
> //
> // Specify a name to designate the model being verified. This name
will be
> // written to the second column of the ASCII output generated.
> //
> model = "WRF";
>
> //
> // Section 1: Ensemble Processing
> //
>
> //
> // Specify a comma-separated list of ensemble fields to be computed.
Each field
> // is specified as a GRIB code or abbreviation followed by an
accumulation or
> // vertical level indicator for GRIB files or as a variable name
followed by a
> // list of dimensions for NetCDF files output from p_interp or MET.
> //
> // Specifying ensemble fields for GRIB files:
> // GC/ANNN for accumulation interval NNN
> // GC/ZNNN for vertical level NNN
> // GC/PNNN for pressure level NNN in hPa
> // GC/PNNN-NNN for a range of pressure levels in hPa
> // GC/LNNN for a generic level type
> // GC/RNNN for a specific GRIB record number
> // Where GC is the number of or abbreviation for the grib code
> // to be verified.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> // Specifying ensemble fields for NetCDF files:
> // var_name(i,...,j,*,*) for a single field
> // Where var_name is the name of the NetCDF variable,
> // and i,...,j specifies fixed dimension values,
> // and *,* specifies the two dimensions for the gridded field.
> //
> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
> //
> ens_field[] = [ "TT(0,2,*,*)" ] ;
>
> //
> // Specify a comma-separated list of groups of thresholds to be
applied to the
> // fields listed above. Ensemble thresholds are used to compute the
ensemble
> // relative frequency output.
> //
> // The length of the "ens_field" and "ens_thresh" arrays must match.
To apply
> // multiple thresholds to a field, separate the threshold values
with a space.
> //
> // Each threshold must be preceded by a two letter indicator for the
type of
> // thresholding to be performed:
> // 'lt' for less than 'le' for less than or equal to
> // 'eq' for equal to 'ne' for not equal to
> // 'gt' for greater than 'ge' for greater than or equal to
> //
> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0" ];
> //
> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>
> //
> // When summarizing the ensemble, compute a ratio of the number of
valid
> // ensemble fields to the total number of ensemble members. If that
ratio is
> // less than this threshold, error out. This threshold must be
between 0 and 1.
> // Setting this threshold to 1 will require that each all ensemble
members be
> // present to be processed.
> //
> // e.g. vld_ens_thresh = 1.0;
> //
> vld_ens_thresh = 1.0;
>
> //
> // When summarizing the ensemble, for each grid point compute a
ratio of the
> // number of valid data values to the number of ensemble members.
If that
> // ratio is less than this threshold, write out bad data. This
threshold must
> // be between 0 and 1. Setting this threshold to 1 will require
each grid
> // point to contain valid data for all ensemble members.
> //
> // e.g. vld_data_thresh = 1.0;
> //
> vld_data_thresh = 1.0;
>
> //
> // Section 2: Rank Histograms
> //
>
> //
> // Specify a comma-separated list of ensemble fields to be verified.
The
> // forecast and observation fields may be specified separately. If
the
> // obs_field parameter is left blank, it will default to the
contents of
> // fcst_field.
> //
> // Each field is specified as a GRIB code or abbreviation followed
by an
> // accumulation or vertical level indicator for GRIB files or as a
variable name
> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
> //
> // Specifying verification fields for GRIB files:
> // GC/ANNN for accumulation interval NNN
> // GC/ZNNN for vertical level NNN
> // GC/PNNN for pressure level NNN in hPa
> // GC/PNNN-NNN for a range of pressure levels in hPa
> // GC/LNNN for a generic level type
> // GC/RNNN for a specific GRIB record number
> // Where GC is the number of or abbreviation for the grib code
> // to be verified.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> // Specifying verification fields for NetCDF files:
> // var_name(i,...,j,*,*) for a single field
> // Where var_name is the name of the NetCDF variable,
> // and i,...,j specifies fixed dimension values,
> // and *,* specifies the two dimensions for the gridded field.
> //
> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
> //
> fcst_field[] = [ "TT(0,2,*,*)" ];
> obs_field[] = [ "TMP/P850" ];
>
> //
> // Beginning and ending time offset values in seconds for point
observations
> // to be used. These time offsets are defined in reference to the
> // ensemble valid time, v. Observations with a valid time falling
in the
> // window [v+beg_ds, v+end_ds] will be used.
> // These selections are overridden by the command line arguments
> // -obs_valid_beg and -obs_valid_end.
> //
> beg_ds = -900;
> end_ds = 900;
>
> //
> // Specify a comma-separated list of PrepBufr message types with
which
> // to perform the point verification. Statistics will be computed
separately
> // for each message type specified. At least one PrepBufr message
type
> // must be provided when verifying with point observations.
> // List of valid message types:
> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
> // SFCSHP SPSSMI SYNDAT VADWND
> // ANYAIR (= AIRCAR, AIRCFT)
> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
> // ONLYSF (= ADPSFC, SFCSHP)
> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
> //
> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
> //
> message_type[] = [ "ANYSFC" ];
>
> //
> // Specify a comma-separated list of grids to be used in masking the
data over
> // which to perform scoring. An empty list indicates that no
masking grid
> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
> // indicates the three digit grid number. Enter "FULL" to score
over the
> // entire domain.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
> //
> // e.g. mask_grid[] = [ "FULL" ];
> //
> mask_grid[] = [ "FULL" ];
>
> //
> // Specify a comma-separated list of masking regions to be applied.
> // An empty list indicates that no additional masks should be used.
> // The masking regions may be defined in one of 4 ways:
> //
> // (1) An ASCII file containing a lat/lon polygon.
> // Latitude in degrees north and longitude in degrees east.
> // By default, the first and last polygon points are connected.
> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
> //
> // (2) The NetCDF output of the gen_poly_mask tool.
> //
> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
> // to be used, and optionally, a threshold to be applied to the
field.
> // e.g. "sample.nc var_name gt0.00"
> //
> // (4) A GRIB data file, followed by a description of the field
> // to be used, and optionally, a threshold to be applied to the
field.
> // e.g. "sample.grb APCP/A3 gt0.00"
> //
> // Any NetCDF or GRIB file used must have the same grid dimensions
as the
> // data being verified.
> //
> // MET_BASE may be used in the path for the files above.
> //
> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
> // "poly_mask.ncf",
> // "sample.nc APCP",
> // "sample.grb HGT/Z0 gt100.0" ];
> //
> mask_poly[] = [ ] ;
>
> //
> // Specify the name of an ASCII file containing a space-separated
list of
> // station ID's at which to perform verification. Each station ID
specified
> // is treated as an individual masking region.
> //
> // An empty list file name indicates that no station ID masks should
be used.
> //
> // MET_BASE may be used in the path for the station ID mask file
name.
> //
> // e.g. mask_sid = "CONUS.stations";
> //
> mask_sid = "";
>
> //
> // Specify a comma-separated list of interpolation method(s) to be
used for
> // point observations. For gridded observations, this serves to
smooth
> // the data fields prior to verifying them. The value at each grid
point is
> // replaced by the measure computed over the neighborhood defined
around the
> // grid point. String values are interpreted as follows:
> // MIN = Minimum in the neighborhood
> // MAX = Maximum in the neighborhood
> // MEDIAN = Median in the neighborhood
> // UW_MEAN = Unweighted mean in the neighborhood
> // DW_MEAN = Distance-weighted mean in the neighborhood
> // LS_FIT = Least-squares fit in the neighborhood
> // BILIN = Bilinear interpolation using the 4 closest points
> //
> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
> //
> interp_method[] = [ "DW_MEAN" ];
>
> //
> // Specify a comma-separated list of box widths to be used by the
interpolation
> // techniques listed above. A value of 1 indicates that no
smoothing should be
> // performed.
> //
> // e.g. interp_width = [ 1, 3, 5 ];
> //
> interp_width[] = [ 2 ];
>
> //
> // The interp_flag controls how the smoothing defined above should
be applied:
> // (1) Smooth only the forecast field
> // (2) Smooth only the observation field
> // (3) Smooth both the forecast and observation fields
> //
> interp_flag = 1;
>
> //
> // When smoothing, compute a ratio of the number of valid data
points to
> // the total number of points in the neighborhood. If that ratio is
less
> // than this threshold, do not compute a smoothed forecast value.
This
> // threshold must be between 0 and 1. Setting this threshold to 1
will
> // require that each observation be surrounded by n*n valid forecast
> // points.
> //
> // e.g. interp_thresh = 1.0;
> //
> interp_thresh = 1.0;
>
> //
> // Specify flags to indicate the type of data to be output:
> //
> // (1) STAT and RHIST Text Files, Ranked Histograms:
> // Total (TOTAL),
> // Continuous Ranked Probability Score (CRPS),
> // Ignorance Score (IGN),
> // Number of ranks used (N_RANK),
> // Count of observations with current rank (RANK_i)
> // NOTE: Previous column is repeated for each rank used
(N_RANK)
> //
> // (2) STAT and ORANK Text Files, Observation Rank Matched Pairs:
> // Total (TOTAL),
> // Index (INDEX),
> // Observation Station ID (OBS_SID),
> // Observation Latitude (OBS_LAT),
> // Observation Longitude (OBS_LON),
> // Observation Level (OBS_LVL),
> // Observation Elevation (OBS_ELV),
> // Observation Value (OBS),
> // Probability Integral Transform (PIT),
> // Observation Rank (RANK),
> // Number of valid Ensemble Values (N_ENS_VLD),
> // Total Number of Ensemble Values (N_ENS),
> // Current Ensemble Value (ENS_i)
> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
> //
> // (3) Write the Ensemble Mean fields.
> //
> // (4) Write the Ensemble Standard Deviation fields.
> //
> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
> //
> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
> //
> // (7) Write the Ensemble Minimum fields.
> //
> // (8) Write the Ensemble Maximum fields.
> //
> // (9) Write the Ensemble Range fields.
> //
> // (10) Write the Ensemble Valid Data Count fields.
> //
> // (11) Write the Ensemble Relative Frequency by threshold fields.
> //
> // (12) Write the gridded field of Observation Ranks to a NetCDF
file.
> //
> // Values for flags (1) and (2) are interpreted as follows:
> // (0) Do not generate output of this type
> // (1) Write output to a STAT file
> // (2) Write output to a STAT file and a text file
> //
> // Values for flags (3) though (12) are interpreted as follows:
> // (0) Do not write this field to the NetCDF file.
> // (1) Write this field to the NetCDF file.
> //
> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>
> //
> // When computing observation ranks, in the case of ties, randomly
choose
> // the rank from all possible values. Specify the name of the
random
> // number generator to be used. See the MET Users Guide for a list
of
> // possible random number generators.
> //
> rng_type = "mt19937";
>
> //
> // If left unspecified, the random number generator seed will change
for
> // each run and the assignment of ranks will not be reproducable.
> //
> rng_seed = "";
>
> //
> // Specify the GRIB Table 2 parameter table version number to be
used
> // for interpreting GRIB codes.
> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
> //
> grib_ptv = 129;
>
> //
> // Prefix to be used for the output file names.
> //
> output_prefix = "";
>
> //
> // Indicate a version number for the contents of this configuration
file.
> // The value should generally not be modified.
> //
> version = "V3.0.1";
------------------------------------------------
Subject: ensemble stat problem
From: Paul Oldenburg
Time: Fri Jun 10 10:40:38 2011
Mariusz,
We realized after seeing the path and compiler information that you
are trying to run MET on jet at NOAA. I do
verification work on jet as well, and we have built and run MET there.
I attached the Makefile that we used to build
MET. Using this Makefile, we are able to run your test case without
errors. Please rebuild your instance of MET with
the attached Makefile and we think it will fix your problem. Since we
don't have access to your environment and you did
not list the paths explicitly, we do not know which instance of the
intel compilers you are using or the location of
NetCDF that is referenced in your Makefile. If you have questions,
please let me know.
Paul
On 06/10/2011 10:12 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>
> Paul,
> I ran the code with your config and got
>
> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>
>
> LongArray::operator[](int) -> range check error ... 4
>
> Attached is Makefile used to build MET. My compilers are as follows
>
> Mariusz
>
>
>
>
>
> 1) icc/11.1.072 9) nco/4.0.1
> 2) mvapich2/1.4.1-intel-11.1 10) udunits/2.1.15
> 3) netcdf/3.6.3 11) mathlibs/fftw
> 4) hdf4/4.2r3-intel 12) gempak/5.11.4
> 5) hdf5/1.8.3 13) jet-tools
> 6) ncl/5.2.0 14) sge
> 7) intel/11.1.072 15) totalview/8.8.0-1
> 8) papi/4.1.0 16) wjet
>
>
>
> On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>
>> Mariusz,
>>
>> I included the ensemble_stat config file that we are using to try
to reproduce the error that you reported using
>> (presumably) the following setting:
>>
>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>
>> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
>> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
>> again, can you please send us the following information:
>>
>> 1. NetCDF version and compiler that was used to build it
>> 2. Compiler family (GNU, PGI, etc.) used to build MET
>> 3. OS name and version that you are using
>>
>> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
>> for us to fix your problem. Sorry for the trouble.
>>
>> Paul
>>
>>
>> $ensemble_stat \
>> 6 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>> EnsembleStatConfig_enkf \
>> -point_obs 2010081112.nc \
>> -outdir . -v 2
>>
>> GSL_RNG_TYPE=mt19937
>> GSL_RNG_SEED=1513747021
>> Configuration File:
>> EnsembleStatConfig_enkf
>> Ensemble Files[6]:
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
>> Point Observation Files[1]:
>> 2010081112.nc
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble field: TT(0,2,*,*)
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing point observation file: 2010081112.nc
>> Searching 95087 observations from 19199 header messages.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem002
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem003
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem004
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem005
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem006
>> For TT(0,2,*,*) found 1 forecast levels.
>>
>>
--------------------------------------------------------------------------------
>>
>> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
>> interpolation method DW_MEAN(4), using 66 pairs.
>>
>>
--------------------------------------------------------------------------------
>>
>> Output file: ./ensemble_stat_20100811_120000V.stat
>> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
>> Output file: ./ensemble_stat_20100811_120000V_orank.txt
>> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>>
>>
>>
>>
>> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>
>>> Paul,
>>> I list the files separately as you suggested.
>>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>>
>>>
>>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>>
>>>
>>> LongArray::operator[](int) -> range check error ... 4
>>>
>>> When I reset to "TT(0-0,2,*,*)" ]
>>> I get the same error
>>>
>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>> Nelements = 4
>>> Nalloc = 10
>>> AllocInc = 10
>>> Element # 0 = -9999
>>> Element # 1 = 2
>>> Element # 2 = -12345
>>> Element # 3 = -12345
>>>
>>> Mariusz
>>>
>>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>
>>>> Mariusz,
>>>>
>>>> Please perform the following test:
>>>>
>>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>>
>>>> ensemble_stat \
>>>> 6 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>>> EnsembleStatConfig_enkf \
>>>> -point_obs 2010081112.nc \
>>>> -outdir . -v 2
>>>>
>>>> Please let us know if this operation reproduces the error you
reported.
>>>>
>>>> Thanks,
>>>>
>>>> Paul
>>>>
>>>>
>>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>
>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>
>>>>> Paul,
>>>>> I changed obs to -point_obs
>>>>> After an error message about range I changed
>>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>>
>>>>> Still getting an error:
>>>>>
>>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>>
>>>>>
>>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>>> Nelements = 4
>>>>> Nalloc = 10
>>>>> AllocInc = 10
>>>>> Element # 0 = -9999
>>>>> Element # 1 = 2
>>>>> Element # 2 = -12345
>>>>> Element # 3 = -12345
>>>>>
>>>>> Thanks,
>>>>> Mariusz
>>>>>
>>>>>
>>>>>
>>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>
>>>>>> Mariusz,
>>>>>>
>>>>>> I see the following lines your ensemble_stat output below:
>>>>>>
>>>>>>> Gridded Observation Files[1]:
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>
>>>>>> I think that this means you are using point observations and
not gridded observations. Thus, you should try
>>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>>
>>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>
>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447
>
>>>>>>>
>>>>>>> Paul,
>>>>>>> Thanks for spotting that.
>>>>>>> I now run the program with
>>>>>>>
>>>>>>> echo
>>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>>>> ations, and gridded observations ***"
>>>>>>> ../bin/ensemble_stat \
>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>
>>>>>>>
>>>>>>> and it gives me this error
>>>>>>>
>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>>>> , and gridded observations ***
>>>>>>> Configuration File:
>>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>>> Ensemble Files[6]:
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>>> Gridded Observation Files[1]:
>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>
>>>>>>>
--------------------------------------------------------------------------\
>>>>>>> ------
>>>>>>>
>>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>>
>>>>>>>
--------------------------------------------------------------------------\
>>>>>>> ------
>>>>>>>
>>>>>>> NetCDF: Attribute not found
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Following files are produced
>>>>>>>
>>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Thanks for helping
>>>>>>> Mariusz
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>>
>>>>>>>> Mariusz,
>>>>>>>>
>>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>>
>>>>>>>> ../bin/ensemble_stat \
>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>
>>>>>>>> Usage: ensemble_stat
>>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>>> config_file
>>>>>>>> [-grid_obs file]
>>>>>>>> ...
>>>>>>>>
>>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>>
>>>>>>>> ../bin/ensemble_stat \
>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>
>>>>>>>> Please let me know if you have any questions.
>>>>>>>>
>>>>>>>> Paul
>>>>>>>>
>>>>>>>>
>>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>>
>>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>>> Queue: met_help
>>>>>>>>> Subject: ensemble stat problem
>>>>>>>>> Owner: Nobody
>>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>>> Status: new
>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hello,
>>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>>> I am getting an error that looks like this.
>>>>>>>>>
>>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts,
point observations, and gridded observations ***
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>>
>>>>>>>>> line = 1
>>>>>>>>>
>>>>>>>>> econfig_column = 7
>>>>>>>>>
>>>>>>>>> text = "so"
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CDF
>>>>>>>>> ____
>>>>>>>>>
>>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>>
>>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>>> Can you help?
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Mariusz
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>>
////////////////////////////////////////////////////////////////////////////////
>> //
>> // Default ensemble_stat configuration file
>> //
>>
////////////////////////////////////////////////////////////////////////////////
>>
>> //
>> // Specify a name to designate the model being verified. This name
will be
>> // written to the second column of the ASCII output generated.
>> //
>> model = "WRF";
>>
>> //
>> // Section 1: Ensemble Processing
>> //
>>
>> //
>> // Specify a comma-separated list of ensemble fields to be
computed. Each field
>> // is specified as a GRIB code or abbreviation followed by an
accumulation or
>> // vertical level indicator for GRIB files or as a variable name
followed by a
>> // list of dimensions for NetCDF files output from p_interp or MET.
>> //
>> // Specifying ensemble fields for GRIB files:
>> // GC/ANNN for accumulation interval NNN
>> // GC/ZNNN for vertical level NNN
>> // GC/PNNN for pressure level NNN in hPa
>> // GC/PNNN-NNN for a range of pressure levels in hPa
>> // GC/LNNN for a generic level type
>> // GC/RNNN for a specific GRIB record number
>> // Where GC is the number of or abbreviation for the grib code
>> // to be verified.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> // Specifying ensemble fields for NetCDF files:
>> // var_name(i,...,j,*,*) for a single field
>> // Where var_name is the name of the NetCDF variable,
>> // and i,...,j specifies fixed dimension values,
>> // and *,* specifies the two dimensions for the gridded field.
>> //
>> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>> //
>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>
>> //
>> // Specify a comma-separated list of groups of thresholds to be
applied to the
>> // fields listed above. Ensemble thresholds are used to compute
the ensemble
>> // relative frequency output.
>> //
>> // The length of the "ens_field" and "ens_thresh" arrays must
match. To apply
>> // multiple thresholds to a field, separate the threshold values
with a space.
>> //
>> // Each threshold must be preceded by a two letter indicator for
the type of
>> // thresholding to be performed:
>> // 'lt' for less than 'le' for less than or equal to
>> // 'eq' for equal to 'ne' for not equal to
>> // 'gt' for greater than 'ge' for greater than or equal to
>> //
>> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0" ];
>> //
>> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>>
>> //
>> // When summarizing the ensemble, compute a ratio of the number of
valid
>> // ensemble fields to the total number of ensemble members. If
that ratio is
>> // less than this threshold, error out. This threshold must be
between 0 and 1.
>> // Setting this threshold to 1 will require that each all ensemble
members be
>> // present to be processed.
>> //
>> // e.g. vld_ens_thresh = 1.0;
>> //
>> vld_ens_thresh = 1.0;
>>
>> //
>> // When summarizing the ensemble, for each grid point compute a
ratio of the
>> // number of valid data values to the number of ensemble members.
If that
>> // ratio is less than this threshold, write out bad data. This
threshold must
>> // be between 0 and 1. Setting this threshold to 1 will require
each grid
>> // point to contain valid data for all ensemble members.
>> //
>> // e.g. vld_data_thresh = 1.0;
>> //
>> vld_data_thresh = 1.0;
>>
>> //
>> // Section 2: Rank Histograms
>> //
>>
>> //
>> // Specify a comma-separated list of ensemble fields to be
verified. The
>> // forecast and observation fields may be specified separately. If
the
>> // obs_field parameter is left blank, it will default to the
contents of
>> // fcst_field.
>> //
>> // Each field is specified as a GRIB code or abbreviation followed
by an
>> // accumulation or vertical level indicator for GRIB files or as a
variable name
>> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
>> //
>> // Specifying verification fields for GRIB files:
>> // GC/ANNN for accumulation interval NNN
>> // GC/ZNNN for vertical level NNN
>> // GC/PNNN for pressure level NNN in hPa
>> // GC/PNNN-NNN for a range of pressure levels in hPa
>> // GC/LNNN for a generic level type
>> // GC/RNNN for a specific GRIB record number
>> // Where GC is the number of or abbreviation for the grib code
>> // to be verified.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> // Specifying verification fields for NetCDF files:
>> // var_name(i,...,j,*,*) for a single field
>> // Where var_name is the name of the NetCDF variable,
>> // and i,...,j specifies fixed dimension values,
>> // and *,* specifies the two dimensions for the gridded field.
>> //
>> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>> //
>> fcst_field[] = [ "TT(0,2,*,*)" ];
>> obs_field[] = [ "TMP/P850" ];
>>
>> //
>> // Beginning and ending time offset values in seconds for point
observations
>> // to be used. These time offsets are defined in reference to the
>> // ensemble valid time, v. Observations with a valid time falling
in the
>> // window [v+beg_ds, v+end_ds] will be used.
>> // These selections are overridden by the command line arguments
>> // -obs_valid_beg and -obs_valid_end.
>> //
>> beg_ds = -900;
>> end_ds = 900;
>>
>> //
>> // Specify a comma-separated list of PrepBufr message types with
which
>> // to perform the point verification. Statistics will be computed
separately
>> // for each message type specified. At least one PrepBufr message
type
>> // must be provided when verifying with point observations.
>> // List of valid message types:
>> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
>> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
>> // SFCSHP SPSSMI SYNDAT VADWND
>> // ANYAIR (= AIRCAR, AIRCFT)
>> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
>> // ONLYSF (= ADPSFC, SFCSHP)
>> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
>> //
>> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
>> //
>> message_type[] = [ "ANYSFC" ];
>>
>> //
>> // Specify a comma-separated list of grids to be used in masking
the data over
>> // which to perform scoring. An empty list indicates that no
masking grid
>> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
>> // indicates the three digit grid number. Enter "FULL" to score
over the
>> // entire domain.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
>> //
>> // e.g. mask_grid[] = [ "FULL" ];
>> //
>> mask_grid[] = [ "FULL" ];
>>
>> //
>> // Specify a comma-separated list of masking regions to be applied.
>> // An empty list indicates that no additional masks should be used.
>> // The masking regions may be defined in one of 4 ways:
>> //
>> // (1) An ASCII file containing a lat/lon polygon.
>> // Latitude in degrees north and longitude in degrees east.
>> // By default, the first and last polygon points are connected.
>> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
>> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
>> //
>> // (2) The NetCDF output of the gen_poly_mask tool.
>> //
>> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
>> // to be used, and optionally, a threshold to be applied to the
field.
>> // e.g. "sample.nc var_name gt0.00"
>> //
>> // (4) A GRIB data file, followed by a description of the field
>> // to be used, and optionally, a threshold to be applied to the
field.
>> // e.g. "sample.grb APCP/A3 gt0.00"
>> //
>> // Any NetCDF or GRIB file used must have the same grid dimensions
as the
>> // data being verified.
>> //
>> // MET_BASE may be used in the path for the files above.
>> //
>> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
>> // "poly_mask.ncf",
>> // "sample.nc APCP",
>> // "sample.grb HGT/Z0 gt100.0" ];
>> //
>> mask_poly[] = [ ] ;
>>
>> //
>> // Specify the name of an ASCII file containing a space-separated
list of
>> // station ID's at which to perform verification. Each station ID
specified
>> // is treated as an individual masking region.
>> //
>> // An empty list file name indicates that no station ID masks
should be used.
>> //
>> // MET_BASE may be used in the path for the station ID mask file
name.
>> //
>> // e.g. mask_sid = "CONUS.stations";
>> //
>> mask_sid = "";
>>
>> //
>> // Specify a comma-separated list of interpolation method(s) to be
used for
>> // point observations. For gridded observations, this serves to
smooth
>> // the data fields prior to verifying them. The value at each grid
point is
>> // replaced by the measure computed over the neighborhood defined
around the
>> // grid point. String values are interpreted as follows:
>> // MIN = Minimum in the neighborhood
>> // MAX = Maximum in the neighborhood
>> // MEDIAN = Median in the neighborhood
>> // UW_MEAN = Unweighted mean in the neighborhood
>> // DW_MEAN = Distance-weighted mean in the neighborhood
>> // LS_FIT = Least-squares fit in the neighborhood
>> // BILIN = Bilinear interpolation using the 4 closest points
>> //
>> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
>> //
>> interp_method[] = [ "DW_MEAN" ];
>>
>> //
>> // Specify a comma-separated list of box widths to be used by the
interpolation
>> // techniques listed above. A value of 1 indicates that no
smoothing should be
>> // performed.
>> //
>> // e.g. interp_width = [ 1, 3, 5 ];
>> //
>> interp_width[] = [ 2 ];
>>
>> //
>> // The interp_flag controls how the smoothing defined above should
be applied:
>> // (1) Smooth only the forecast field
>> // (2) Smooth only the observation field
>> // (3) Smooth both the forecast and observation fields
>> //
>> interp_flag = 1;
>>
>> //
>> // When smoothing, compute a ratio of the number of valid data
points to
>> // the total number of points in the neighborhood. If that ratio
is less
>> // than this threshold, do not compute a smoothed forecast value.
This
>> // threshold must be between 0 and 1. Setting this threshold to 1
will
>> // require that each observation be surrounded by n*n valid
forecast
>> // points.
>> //
>> // e.g. interp_thresh = 1.0;
>> //
>> interp_thresh = 1.0;
>>
>> //
>> // Specify flags to indicate the type of data to be output:
>> //
>> // (1) STAT and RHIST Text Files, Ranked Histograms:
>> // Total (TOTAL),
>> // Continuous Ranked Probability Score (CRPS),
>> // Ignorance Score (IGN),
>> // Number of ranks used (N_RANK),
>> // Count of observations with current rank (RANK_i)
>> // NOTE: Previous column is repeated for each rank used
(N_RANK)
>> //
>> // (2) STAT and ORANK Text Files, Observation Rank Matched
Pairs:
>> // Total (TOTAL),
>> // Index (INDEX),
>> // Observation Station ID (OBS_SID),
>> // Observation Latitude (OBS_LAT),
>> // Observation Longitude (OBS_LON),
>> // Observation Level (OBS_LVL),
>> // Observation Elevation (OBS_ELV),
>> // Observation Value (OBS),
>> // Probability Integral Transform (PIT),
>> // Observation Rank (RANK),
>> // Number of valid Ensemble Values (N_ENS_VLD),
>> // Total Number of Ensemble Values (N_ENS),
>> // Current Ensemble Value (ENS_i)
>> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
>> //
>> // (3) Write the Ensemble Mean fields.
>> //
>> // (4) Write the Ensemble Standard Deviation fields.
>> //
>> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
>> //
>> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
>> //
>> // (7) Write the Ensemble Minimum fields.
>> //
>> // (8) Write the Ensemble Maximum fields.
>> //
>> // (9) Write the Ensemble Range fields.
>> //
>> // (10) Write the Ensemble Valid Data Count fields.
>> //
>> // (11) Write the Ensemble Relative Frequency by threshold
fields.
>> //
>> // (12) Write the gridded field of Observation Ranks to a NetCDF
file.
>> //
>> // Values for flags (1) and (2) are interpreted as follows:
>> // (0) Do not generate output of this type
>> // (1) Write output to a STAT file
>> // (2) Write output to a STAT file and a text file
>> //
>> // Values for flags (3) though (12) are interpreted as follows:
>> // (0) Do not write this field to the NetCDF file.
>> // (1) Write this field to the NetCDF file.
>> //
>> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
>> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>>
>> //
>> // When computing observation ranks, in the case of ties, randomly
choose
>> // the rank from all possible values. Specify the name of the
random
>> // number generator to be used. See the MET Users Guide for a list
of
>> // possible random number generators.
>> //
>> rng_type = "mt19937";
>>
>> //
>> // If left unspecified, the random number generator seed will
change for
>> // each run and the assignment of ranks will not be reproducable.
>> //
>> rng_seed = "";
>>
>> //
>> // Specify the GRIB Table 2 parameter table version number to be
used
>> // for interpreting GRIB codes.
>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>> //
>> grib_ptv = 129;
>>
>> //
>> // Prefix to be used for the output file names.
>> //
>> output_prefix = "";
>>
>> //
>> // Indicate a version number for the contents of this configuration
file.
>> // The value should generally not be modified.
>> //
>> version = "V3.0.1";
>
------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #47447] ensemble stat problem
From: Mariusz Pagowski
Time: Fri Jun 10 10:51:33 2011
Thanks Paul,
the new executable works fine,
Mariusz
On Jun 10, 2011, at 10:40 AM, RAL HelpDesk {for Paul Oldenburg} wrote:
> Mariusz,
>
> We realized after seeing the path and compiler information that you
are trying to run MET on jet at NOAA. I do
> verification work on jet as well, and we have built and run MET
there. I attached the Makefile that we used to build
> MET. Using this Makefile, we are able to run your test case without
errors. Please rebuild your instance of MET with
> the attached Makefile and we think it will fix your problem. Since
we don't have access to your environment and you did
> not list the paths explicitly, we do not know which instance of the
intel compilers you are using or the location of
> NetCDF that is referenced in your Makefile. If you have questions,
please let me know.
>
> Paul
>
>
> On 06/10/2011 10:12 AM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>
>> Paul,
>> I ran the code with your config and got
>>
>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>
>>
>> LongArray::operator[](int) -> range check error ... 4
>>
>> Attached is Makefile used to build MET. My compilers are as follows
>>
>> Mariusz
>>
>>
>>
>>
>>
>> 1) icc/11.1.072 9) nco/4.0.1
>> 2) mvapich2/1.4.1-intel-11.1 10) udunits/2.1.15
>> 3) netcdf/3.6.3 11) mathlibs/fftw
>> 4) hdf4/4.2r3-intel 12) gempak/5.11.4
>> 5) hdf5/1.8.3 13) jet-tools
>> 6) ncl/5.2.0 14) sge
>> 7) intel/11.1.072 15) totalview/8.8.0-1
>> 8) papi/4.1.0 16) wjet
>>
>>
>>
>> On Jun 10, 2011, at 9:39 AM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>
>>> Mariusz,
>>>
>>> I included the ensemble_stat config file that we are using to try
to reproduce the error that you reported using
>>> (presumably) the following setting:
>>>
>>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>
>>> We are not able to reproduce your error. Instead the call to
ensemble_stat and resulting output that we get is copied
>>> below. Please try to run ensemble_stat using the identical call
syntax and config file. If the LongArray error appears
>>> again, can you please send us the following information:
>>>
>>> 1. NetCDF version and compiler that was used to build it
>>> 2. Compiler family (GNU, PGI, etc.) used to build MET
>>> 3. OS name and version that you are using
>>>
>>> Unfortunately, if we are not able to reproduce the error that you
have reported on our system, it will be very difficult
>>> for us to fix your problem. Sorry for the trouble.
>>>
>>> Paul
>>>
>>>
>>> $ensemble_stat \
>>> 6 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>> EnsembleStatConfig_enkf \
>>> -point_obs 2010081112.nc \
>>> -outdir . -v 2
>>>
>>> GSL_RNG_TYPE=mt19937
>>> GSL_RNG_SEED=1513747021
>>> Configuration File:
>>> EnsembleStatConfig_enkf
>>> Ensemble Files[6]:
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005
>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006
>>> Point Observation Files[1]:
>>> 2010081112.nc
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble field: TT(0,2,*,*)
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing point observation file: 2010081112.nc
>>> Searching 95087 observations from 19199 header messages.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem002
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem003
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem004
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem005
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing ensemble file: wrfout_d01_2010-08-
11_12:00:00_PLEV.mem006
>>> For TT(0,2,*,*) found 1 forecast levels.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Processing point verification TT(0,2,*,*) versus TMP/P850, for
observation type ANYSFC, over region FULL, for
>>> interpolation method DW_MEAN(4), using 66 pairs.
>>>
>>>
--------------------------------------------------------------------------------
>>>
>>> Output file: ./ensemble_stat_20100811_120000V.stat
>>> Output file: ./ensemble_stat_20100811_120000V_rhist.txt
>>> Output file: ./ensemble_stat_20100811_120000V_orank.txt
>>> Output file: ./ensemble_stat_20100811_120000V_ens.nc
>>>
>>>
>>>
>>>
>>> On 06/09/2011 09:48 PM, RAL HelpDesk {for Mariusz Pagowski} wrote:
>>>>
>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>
>>>> Paul,
>>>> I list the files separately as you suggested.
>>>> After I replace [ "TT(0-0,2,*,*)" ] ; with [ "TT(0,2,*,*)" ] ; I
get
>>>>
>>>>
>>>> Processing ensemble file: /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01_2010-08-
11_12:00:00_PLEV.mem001
>>>>
>>>>
>>>> LongArray::operator[](int) -> range check error ... 4
>>>>
>>>> When I reset to "TT(0-0,2,*,*)" ]
>>>> I get the same error
>>>>
>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>> Nelements = 4
>>>> Nalloc = 10
>>>> AllocInc = 10
>>>> Element # 0 = -9999
>>>> Element # 1 = 2
>>>> Element # 2 = -12345
>>>> Element # 3 = -12345
>>>>
>>>> Mariusz
>>>>
>>>> On Jun 9, 2011, at 3:15 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>
>>>>> Mariusz,
>>>>>
>>>>> Please perform the following test:
>>>>>
>>>>> 1. in your config file, set ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>>> 2. in your config file, set fcst_field[] = [ "TT(0,2,*,*)" ];
>>>>> 3. run ensemble_stat using the following command line (with
correct paths):
>>>>>
>>>>> ensemble_stat \
>>>>> 6 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem001 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem002 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem003 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem004 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem005 \
>>>>> wrfout_d01_2010-08-11_12:00:00_PLEV.mem006 \
>>>>> EnsembleStatConfig_enkf \
>>>>> -point_obs 2010081112.nc \
>>>>> -outdir . -v 2
>>>>>
>>>>> Please let us know if this operation reproduces the error you
reported.
>>>>>
>>>>> Thanks,
>>>>>
>>>>> Paul
>>>>>
>>>>>
>>>>> On 06/09/2011 02:50 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>
>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>
>>>>>> Paul,
>>>>>> I changed obs to -point_obs
>>>>>> After an error message about range I changed
>>>>>> fcst_field[] = [ "TT(0,2,*,*)" ]; to [ "TT(0-0,2,*,*)" ];
>>>>>>
>>>>>> Still getting an error:
>>>>>>
>>>>>> Processing ensemble field: TT(0-0,2,*,*)
>>>>>>
>>>>>>
>>>>>> PinterpFile::data(NcVar *, const LongArray &, WrfData &, double
&) const -> bad arguments:
>>>>>> Nelements = 4
>>>>>> Nalloc = 10
>>>>>> AllocInc = 10
>>>>>> Element # 0 = -9999
>>>>>> Element # 1 = 2
>>>>>> Element # 2 = -12345
>>>>>> Element # 3 = -12345
>>>>>>
>>>>>> Thanks,
>>>>>> Mariusz
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Jun 9, 2011, at 2:40 PM, RAL HelpDesk {for Paul Oldenburg}
wrote:
>>>>>>
>>>>>>> Mariusz,
>>>>>>>
>>>>>>> I see the following lines your ensemble_stat output below:
>>>>>>>
>>>>>>>> Gridded Observation Files[1]:
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>
>>>>>>> I think that this means you are using point observations and
not gridded observations. Thus, you should try
>>>>>>> ensemble_stat using the -point_obs parameter instead of the
-grid_obs parameter as I suggested. Sorry for misleading you.
>>>>>>>
>>>>>>> Paul
>>>>>>>
>>>>>>>
>>>>>>> On 06/09/2011 01:19 PM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>
>>>>>>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447
>
>>>>>>>>
>>>>>>>> Paul,
>>>>>>>> Thanks for spotting that.
>>>>>>>> I now run the program with
>>>>>>>>
>>>>>>>> echo
>>>>>>>> echo "*** Running Ensemble-Stat on APCP using GRIB forecasts,
point observ\
>>>>>>>> ations, and gridded observations ***"
>>>>>>>> ../bin/ensemble_stat \
>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>
>>>>>>>>
>>>>>>>> and it gives me this error
>>>>>>>>
>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts, point
observations\
>>>>>>>> , and gridded observations ***
>>>>>>>> Configuration File:
>>>>>>>> ./config/EnsembleStatConfig_enkf
>>>>>>>> Ensemble Files[6]:
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem001
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem002
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem003
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem004
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem005
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/test_3/met_wrf/wrfout_d01\
>>>>>>>> _2010-08-11_12:00:00_PLEV.mem006
>>>>>>>> Gridded Observation Files[1]:
>>>>>>>> /lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc
>>>>>>>>
>>>>>>>>
--------------------------------------------------------------------------\
>>>>>>>> ------
>>>>>>>>
>>>>>>>> Processing ensemble field: TT(0,2,*,*)
>>>>>>>>
>>>>>>>>
--------------------------------------------------------------------------\
>>>>>>>> ------
>>>>>>>>
>>>>>>>> NetCDF: Attribute not found
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Following files are produced
>>>>>>>>
>>>>>>>> rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V.stat
>>>>>>>> -rw-r--r-- 1 pagowski 147324 Jun 9 19:10
ensemble_stat_20100811_120000V_ens.nc
>>>>>>>> -rw-r--r-- 1 pagowski 33004 Jun 9 19:10
ensemble_stat_20100811_120000V_orank.nc
>>>>>>>> -rw-r--r-- 1 pagowski 0 Jun 9 19:10
ensemble_stat_20100811_120000V_rhist.txt
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks for helping
>>>>>>>> Mariusz
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Jun 9, 2011, at 12:35 PM, RAL HelpDesk {for Paul
Oldenburg} wrote:
>>>>>>>>
>>>>>>>>> Mariusz,
>>>>>>>>>
>>>>>>>>> Compare how you are calling ensemble_stat with the usage
statement below:
>>>>>>>>>
>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>> ${OBSDIR}/2010081112.nc \
>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>
>>>>>>>>> Usage: ensemble_stat
>>>>>>>>> n_ens ens_file_1 ... ens_file_n | ens_file_list
>>>>>>>>> config_file
>>>>>>>>> [-grid_obs file]
>>>>>>>>> ...
>>>>>>>>>
>>>>>>>>> I think if you re-order your arguments in this way, it will
work:
>>>>>>>>>
>>>>>>>>> ../bin/ensemble_stat \
>>>>>>>>> 6 ${INDIR}/wrfout_d01_2010-08-11_12:00:00*.mem00[1-6] \
>>>>>>>>> ./config/EnsembleStatConfig_enkf \
>>>>>>>>> -grid_obs ${OBSDIR}/2010081112.nc \
>>>>>>>>> -outdir $OUTDIR -v 2
>>>>>>>>>
>>>>>>>>> Please let me know if you have any questions.
>>>>>>>>>
>>>>>>>>> Paul
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On 06/09/2011 11:58 AM, RAL HelpDesk {for Mariusz Pagowski}
wrote:
>>>>>>>>>>
>>>>>>>>>> Thu Jun 09 11:58:16 2011: Request 47447 was acted upon.
>>>>>>>>>> Transaction: Ticket created by Mariusz.Pagowski at noaa.gov
>>>>>>>>>> Queue: met_help
>>>>>>>>>> Subject: ensemble stat problem
>>>>>>>>>> Owner: Nobody
>>>>>>>>>> Requestors: Mariusz.Pagowski at noaa.gov
>>>>>>>>>> Status: new
>>>>>>>>>> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=47447 >
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hello,
>>>>>>>>>> I am trying to run ensemble stats tool using same obs data
and ensemble wrf forecasts.
>>>>>>>>>> I am getting an error that looks like this.
>>>>>>>>>>
>>>>>>>>>> *** Running Ensemble-Stat on APCP using GRIB forecasts,
point observations, and gridded observations ***
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> config() -> syntax error in file "/lfs0/projects/chem-
var/wrfvar/enkf_runs/eval/obs_pbufr/2010081112.nc"
>>>>>>>>>>
>>>>>>>>>> line = 1
>>>>>>>>>>
>>>>>>>>>> econfig_column = 7
>>>>>>>>>>
>>>>>>>>>> text = "so"
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CDF
>>>>>>>>>> ____
>>>>>>>>>>
>>>>>>>>>> Also, I can ncview obs netcdf files obtained from prepbufr
with pb2nc but ncdump -h has problem reading the header. That might
be related to the error above.
>>>>>>>>>>
>>>>>>>>>> I put bundle2_pagowski.tar.gz on your ftp.
>>>>>>>>>> Can you help?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Mariusz
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>>
////////////////////////////////////////////////////////////////////////////////
>>> //
>>> // Default ensemble_stat configuration file
>>> //
>>>
////////////////////////////////////////////////////////////////////////////////
>>>
>>> //
>>> // Specify a name to designate the model being verified. This
name will be
>>> // written to the second column of the ASCII output generated.
>>> //
>>> model = "WRF";
>>>
>>> //
>>> // Section 1: Ensemble Processing
>>> //
>>>
>>> //
>>> // Specify a comma-separated list of ensemble fields to be
computed. Each field
>>> // is specified as a GRIB code or abbreviation followed by an
accumulation or
>>> // vertical level indicator for GRIB files or as a variable name
followed by a
>>> // list of dimensions for NetCDF files output from p_interp or
MET.
>>> //
>>> // Specifying ensemble fields for GRIB files:
>>> // GC/ANNN for accumulation interval NNN
>>> // GC/ZNNN for vertical level NNN
>>> // GC/PNNN for pressure level NNN in hPa
>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>> // GC/LNNN for a generic level type
>>> // GC/RNNN for a specific GRIB record number
>>> // Where GC is the number of or abbreviation for the grib code
>>> // to be verified.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> // Specifying ensemble fields for NetCDF files:
>>> // var_name(i,...,j,*,*) for a single field
>>> // Where var_name is the name of the NetCDF variable,
>>> // and i,...,j specifies fixed dimension values,
>>> // and *,* specifies the two dimensions for the gridded field.
>>> //
>>> // e.g. ens_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>>> // e.g. ens_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>>> //
>>> ens_field[] = [ "TT(0,2,*,*)" ] ;
>>>
>>> //
>>> // Specify a comma-separated list of groups of thresholds to be
applied to the
>>> // fields listed above. Ensemble thresholds are used to compute
the ensemble
>>> // relative frequency output.
>>> //
>>> // The length of the "ens_field" and "ens_thresh" arrays must
match. To apply
>>> // multiple thresholds to a field, separate the threshold values
with a space.
>>> //
>>> // Each threshold must be preceded by a two letter indicator for
the type of
>>> // thresholding to be performed:
>>> // 'lt' for less than 'le' for less than or equal to
>>> // 'eq' for equal to 'ne' for not equal to
>>> // 'gt' for greater than 'ge' for greater than or equal to
>>> //
>>> // e.g. ens_thresh[] = [ "gt0.0 ge5.0", "gt0.0", "lt80.0 ge80.0"
];
>>> //
>>> ens_thresh[] = [ "lt1000.0", "lt1000.0" ] ;
>>>
>>> //
>>> // When summarizing the ensemble, compute a ratio of the number of
valid
>>> // ensemble fields to the total number of ensemble members. If
that ratio is
>>> // less than this threshold, error out. This threshold must be
between 0 and 1.
>>> // Setting this threshold to 1 will require that each all ensemble
members be
>>> // present to be processed.
>>> //
>>> // e.g. vld_ens_thresh = 1.0;
>>> //
>>> vld_ens_thresh = 1.0;
>>>
>>> //
>>> // When summarizing the ensemble, for each grid point compute a
ratio of the
>>> // number of valid data values to the number of ensemble members.
If that
>>> // ratio is less than this threshold, write out bad data. This
threshold must
>>> // be between 0 and 1. Setting this threshold to 1 will require
each grid
>>> // point to contain valid data for all ensemble members.
>>> //
>>> // e.g. vld_data_thresh = 1.0;
>>> //
>>> vld_data_thresh = 1.0;
>>>
>>> //
>>> // Section 2: Rank Histograms
>>> //
>>>
>>> //
>>> // Specify a comma-separated list of ensemble fields to be
verified. The
>>> // forecast and observation fields may be specified separately.
If the
>>> // obs_field parameter is left blank, it will default to the
contents of
>>> // fcst_field.
>>> //
>>> // Each field is specified as a GRIB code or abbreviation followed
by an
>>> // accumulation or vertical level indicator for GRIB files or as a
variable name
>>> // followed by a list of dimensions for NetCDF files output from
p_interp or MET.
>>> //
>>> // Specifying verification fields for GRIB files:
>>> // GC/ANNN for accumulation interval NNN
>>> // GC/ZNNN for vertical level NNN
>>> // GC/PNNN for pressure level NNN in hPa
>>> // GC/PNNN-NNN for a range of pressure levels in hPa
>>> // GC/LNNN for a generic level type
>>> // GC/RNNN for a specific GRIB record number
>>> // Where GC is the number of or abbreviation for the grib code
>>> // to be verified.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> // Specifying verification fields for NetCDF files:
>>> // var_name(i,...,j,*,*) for a single field
>>> // Where var_name is the name of the NetCDF variable,
>>> // and i,...,j specifies fixed dimension values,
>>> // and *,* specifies the two dimensions for the gridded field.
>>> //
>>> // e.g. fcst_field[] = [ "61/A3", "RH/L10" ]; for GRIB input
>>> // e.g. fcst_field[] = [ "RAINC(0,*,*)", "QVAPOR(0,5,*,*)" ]; for
NetCDF input
>>> //
>>> fcst_field[] = [ "TT(0,2,*,*)" ];
>>> obs_field[] = [ "TMP/P850" ];
>>>
>>> //
>>> // Beginning and ending time offset values in seconds for point
observations
>>> // to be used. These time offsets are defined in reference to the
>>> // ensemble valid time, v. Observations with a valid time falling
in the
>>> // window [v+beg_ds, v+end_ds] will be used.
>>> // These selections are overridden by the command line arguments
>>> // -obs_valid_beg and -obs_valid_end.
>>> //
>>> beg_ds = -900;
>>> end_ds = 900;
>>>
>>> //
>>> // Specify a comma-separated list of PrepBufr message types with
which
>>> // to perform the point verification. Statistics will be computed
separately
>>> // for each message type specified. At least one PrepBufr message
type
>>> // must be provided when verifying with point observations.
>>> // List of valid message types:
>>> // ADPUPA AIRCAR AIRCFT ADPSFC ERS1DA GOESND GPSIPW
>>> // MSONET PROFLR QKSWND RASSDA SATEMP SATWND SFCBOG
>>> // SFCSHP SPSSMI SYNDAT VADWND
>>> // ANYAIR (= AIRCAR, AIRCFT)
>>> // ANYSFC (= ADPSFC, SFCSHP, ADPUPA, PROFLR)
>>> // ONLYSF (= ADPSFC, SFCSHP)
>>> //
http://www.emc.ncep.noaa.gov/mmb/data_processing/prepbufr.doc/table_1.htm
>>> //
>>> // e.g. message_type[] = [ "ADPUPA", "AIRCAR" ];
>>> //
>>> message_type[] = [ "ANYSFC" ];
>>>
>>> //
>>> // Specify a comma-separated list of grids to be used in masking
the data over
>>> // which to perform scoring. An empty list indicates that no
masking grid
>>> // should be performed. The standard NCEP grids are named "GNNN"
where NNN
>>> // indicates the three digit grid number. Enter "FULL" to score
over the
>>> // entire domain.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/tableb.html
>>> //
>>> // e.g. mask_grid[] = [ "FULL" ];
>>> //
>>> mask_grid[] = [ "FULL" ];
>>>
>>> //
>>> // Specify a comma-separated list of masking regions to be
applied.
>>> // An empty list indicates that no additional masks should be
used.
>>> // The masking regions may be defined in one of 4 ways:
>>> //
>>> // (1) An ASCII file containing a lat/lon polygon.
>>> // Latitude in degrees north and longitude in degrees east.
>>> // By default, the first and last polygon points are
connected.
>>> // e.g. "MET_BASE/data/poly/EAST.poly" which consists of n
points:
>>> // "poly_name lat1 lon1 lat2 lon2... latn lonn"
>>> //
>>> // (2) The NetCDF output of the gen_poly_mask tool.
>>> //
>>> // (3) A NetCDF data file, followed by the name of the NetCDF
variable
>>> // to be used, and optionally, a threshold to be applied to
the field.
>>> // e.g. "sample.nc var_name gt0.00"
>>> //
>>> // (4) A GRIB data file, followed by a description of the field
>>> // to be used, and optionally, a threshold to be applied to
the field.
>>> // e.g. "sample.grb APCP/A3 gt0.00"
>>> //
>>> // Any NetCDF or GRIB file used must have the same grid dimensions
as the
>>> // data being verified.
>>> //
>>> // MET_BASE may be used in the path for the files above.
>>> //
>>> // e.g. mask_poly[] = [ "MET_BASE/data/poly/EAST.poly",
>>> // "poly_mask.ncf",
>>> // "sample.nc APCP",
>>> // "sample.grb HGT/Z0 gt100.0" ];
>>> //
>>> mask_poly[] = [ ] ;
>>>
>>> //
>>> // Specify the name of an ASCII file containing a space-separated
list of
>>> // station ID's at which to perform verification. Each station ID
specified
>>> // is treated as an individual masking region.
>>> //
>>> // An empty list file name indicates that no station ID masks
should be used.
>>> //
>>> // MET_BASE may be used in the path for the station ID mask file
name.
>>> //
>>> // e.g. mask_sid = "CONUS.stations";
>>> //
>>> mask_sid = "";
>>>
>>> //
>>> // Specify a comma-separated list of interpolation method(s) to be
used for
>>> // point observations. For gridded observations, this serves to
smooth
>>> // the data fields prior to verifying them. The value at each
grid point is
>>> // replaced by the measure computed over the neighborhood defined
around the
>>> // grid point. String values are interpreted as follows:
>>> // MIN = Minimum in the neighborhood
>>> // MAX = Maximum in the neighborhood
>>> // MEDIAN = Median in the neighborhood
>>> // UW_MEAN = Unweighted mean in the neighborhood
>>> // DW_MEAN = Distance-weighted mean in the neighborhood
>>> // LS_FIT = Least-squares fit in the neighborhood
>>> // BILIN = Bilinear interpolation using the 4 closest points
>>> //
>>> // e.g. interp_method[] = [ "UW_MEAN", "MEDIAN" ];
>>> //
>>> interp_method[] = [ "DW_MEAN" ];
>>>
>>> //
>>> // Specify a comma-separated list of box widths to be used by the
interpolation
>>> // techniques listed above. A value of 1 indicates that no
smoothing should be
>>> // performed.
>>> //
>>> // e.g. interp_width = [ 1, 3, 5 ];
>>> //
>>> interp_width[] = [ 2 ];
>>>
>>> //
>>> // The interp_flag controls how the smoothing defined above should
be applied:
>>> // (1) Smooth only the forecast field
>>> // (2) Smooth only the observation field
>>> // (3) Smooth both the forecast and observation fields
>>> //
>>> interp_flag = 1;
>>>
>>> //
>>> // When smoothing, compute a ratio of the number of valid data
points to
>>> // the total number of points in the neighborhood. If that ratio
is less
>>> // than this threshold, do not compute a smoothed forecast value.
This
>>> // threshold must be between 0 and 1. Setting this threshold to 1
will
>>> // require that each observation be surrounded by n*n valid
forecast
>>> // points.
>>> //
>>> // e.g. interp_thresh = 1.0;
>>> //
>>> interp_thresh = 1.0;
>>>
>>> //
>>> // Specify flags to indicate the type of data to be output:
>>> //
>>> // (1) STAT and RHIST Text Files, Ranked Histograms:
>>> // Total (TOTAL),
>>> // Continuous Ranked Probability Score (CRPS),
>>> // Ignorance Score (IGN),
>>> // Number of ranks used (N_RANK),
>>> // Count of observations with current rank (RANK_i)
>>> // NOTE: Previous column is repeated for each rank used
(N_RANK)
>>> //
>>> // (2) STAT and ORANK Text Files, Observation Rank Matched
Pairs:
>>> // Total (TOTAL),
>>> // Index (INDEX),
>>> // Observation Station ID (OBS_SID),
>>> // Observation Latitude (OBS_LAT),
>>> // Observation Longitude (OBS_LON),
>>> // Observation Level (OBS_LVL),
>>> // Observation Elevation (OBS_ELV),
>>> // Observation Value (OBS),
>>> // Probability Integral Transform (PIT),
>>> // Observation Rank (RANK),
>>> // Number of valid Ensemble Values (N_ENS_VLD),
>>> // Total Number of Ensemble Values (N_ENS),
>>> // Current Ensemble Value (ENS_i)
>>> // NOTE: Previous column is repeated for each ensemble
member (N_ENS)
>>> //
>>> // (3) Write the Ensemble Mean fields.
>>> //
>>> // (4) Write the Ensemble Standard Deviation fields.
>>> //
>>> // (5) Write the Ensemble Mean - 1 Standard Deviation fields.
>>> //
>>> // (6) Write the Ensemble Mean + 1 Standard Deviation fields.
>>> //
>>> // (7) Write the Ensemble Minimum fields.
>>> //
>>> // (8) Write the Ensemble Maximum fields.
>>> //
>>> // (9) Write the Ensemble Range fields.
>>> //
>>> // (10) Write the Ensemble Valid Data Count fields.
>>> //
>>> // (11) Write the Ensemble Relative Frequency by threshold
fields.
>>> //
>>> // (12) Write the gridded field of Observation Ranks to a NetCDF
file.
>>> //
>>> // Values for flags (1) and (2) are interpreted as follows:
>>> // (0) Do not generate output of this type
>>> // (1) Write output to a STAT file
>>> // (2) Write output to a STAT file and a text file
>>> //
>>> // Values for flags (3) though (12) are interpreted as follows:
>>> // (0) Do not write this field to the NetCDF file.
>>> // (1) Write this field to the NetCDF file.
>>> //
>>> output_flag[] = [ 2, 2, 0, 1, 1, 1, 1, 1, 1, 1, 0, 1 ];
>>> // output_flag[] = [ 1, 2, 3, 4, 5, 6, 7, 8, 9,10,11,12 ];
>>>
>>> //
>>> // When computing observation ranks, in the case of ties, randomly
choose
>>> // the rank from all possible values. Specify the name of the
random
>>> // number generator to be used. See the MET Users Guide for a
list of
>>> // possible random number generators.
>>> //
>>> rng_type = "mt19937";
>>>
>>> //
>>> // If left unspecified, the random number generator seed will
change for
>>> // each run and the assignment of ranks will not be reproducable.
>>> //
>>> rng_seed = "";
>>>
>>> //
>>> // Specify the GRIB Table 2 parameter table version number to be
used
>>> // for interpreting GRIB codes.
>>> // http://www.nco.ncep.noaa.gov/pmb/docs/on388/table2.html
>>> //
>>> grib_ptv = 129;
>>>
>>> //
>>> // Prefix to be used for the output file names.
>>> //
>>> output_prefix = "";
>>>
>>> //
>>> // Indicate a version number for the contents of this
configuration file.
>>> // The value should generally not be modified.
>>> //
>>> version = "V3.0.1";
>>
>
>
> <Makefile.tar.gz>
------------------------------------------------
More information about the Met_help
mailing list