[Met_help] [rt.rap.ucar.edu #87481] History for
John Halley Gotway via RT
met_help at ucar.edu
Wed Nov 28 10:38:10 MST 2018
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Sir,
I am able to run mode of MET-8.0 with the assistance of met_help team.
Now I am getting sum warnings while running mode as follows.
mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
3B42RT.2018082100.7.nc4 MODEConfig_default -outdir ./output/mode_analysis/
-v 2
DEBUG 1: Default Config File: /MET_V8/share/met//config/MODEConfig_default
DEBUG 1: Match Config File: MODEConfig_default
DEBUG 1: Merge Config File: MODEConfig_default
WARNING:
WARNING: NcCfFile::open() -> could not determine the valid time, using 0.
WARNING:
DEBUG 1: Forecast File: ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
DEBUG 1: Regridding observation precipitation(*,*) to the verification grid.
WARNING:
WARNING: setup_fcst_obs_data() -> Forecast and observation valid times do
not match 20180821_000000 != 19700101_000000 for APCP_03(*,*) versus
precipitation(*,*).
WARNING:
DEBUG 1: Forecast Field: APCP_03 at A3
DEBUG 1: Observation Field: precipitation at *,*
DEBUG 2: Processing masking regions.
DEBUG 2: Identifying objects in the forecast and observation fields...
DEBUG 2: Computing contingency table statistics...
DEBUG 2: Identified: 0 forecast objects and 0 observation objects.
DEBUG 2: Performing merging (THRESH) in the forecast field.
DEBUG 2: Performing merging (THRESH) in the observation field.
DEBUG 2: Remaining: 0 forecast objects and 0 observation objects.
DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
observation fields.
DEBUG 1: Creating Fcst-Obs Object Statistics file:
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
DEBUG 1: Creating Contingency Table Statistics file:
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
DEBUG 1: Creating Object NetCDF file:
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
DEBUG 1: Loading forecast raw color table:
/MET_V8/share/met//colortables/met_default.ctable
DEBUG 1: Loading observation raw color table:
/MET_V8/share/met//colortables/met_default.ctable
DEBUG 1: Creating postscript file:
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
Am I doing some mistakes or the above warnings are general due to
observation and fcst time mismatch.
Kindly find the attachments for reference.
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject:
From: John Halley Gotway
Time: Tue Oct 23 16:07:14 2018
So we worked together through the details of writing a python script
for
reading the daily 3B42RT datasets.
Now, you need to adapt that script for handling the 3-hourly 3B42RT
data...
let's say that you've done that and called it "read_3B42RT_3hours.py".
You
should use that Python script when running MODE, like this:
mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
PYTHON_NUMPY MODEConfig_default -outdir ./output/mode_analysis \
-v 2
And then in the MODE config file:
fcst = {
field = { name = "APCP_03"; level = "(*,*)"; }
censor_thresh = [];
censor_val = [];
conv_radius = 60.0/grid_res; // in grid squares
conv_thresh = >=5.0;
vld_thresh = 0.5;
filter_attr_name = [];
filter_attr_thresh = [];
merge_thresh = >=1.25;
merge_flag = THRESH;
}
obs = fcst;
obs = {
field = { name="read_3B42RT_3hours.py read_3B42RT.2018082100.7.nc4
precipitation"; }
}
Does that make sense?
Thanks,
John
On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> Transaction: Ticket created by biranchimahala at gmail.com
> Queue: met_help
> Subject: (No subject given)
> Owner: Nobody
> Requestors: biranchimahala at gmail.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
>
> Sir,
> I am able to run mode of MET-8.0 with the assistance of met_help
team.
> Now I am getting sum warnings while running mode as follows.
>
> mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
./output/mode_analysis/
> -v 2
>
> DEBUG 1: Default Config File:
/MET_V8/share/met//config/MODEConfig_default
> DEBUG 1: Match Config File: MODEConfig_default
> DEBUG 1: Merge Config File: MODEConfig_default
> WARNING:
> WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
> WARNING:
> DEBUG 1: Forecast File:
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> DEBUG 1: Regridding observation precipitation(*,*) to the
verification
> grid.
> WARNING:
> WARNING: setup_fcst_obs_data() -> Forecast and observation valid
times do
> not match 20180821_000000 != 19700101_000000 for APCP_03(*,*) versus
> precipitation(*,*).
> WARNING:
> DEBUG 1: Forecast Field: APCP_03 at A3
> DEBUG 1: Observation Field: precipitation at *,*
> DEBUG 2: Processing masking regions.
> DEBUG 2: Identifying objects in the forecast and observation
fields...
> DEBUG 2: Computing contingency table statistics...
> DEBUG 2: Identified: 0 forecast objects and 0 observation objects.
> DEBUG 2: Performing merging (THRESH) in the forecast field.
> DEBUG 2: Performing merging (THRESH) in the observation field.
> DEBUG 2: Remaining: 0 forecast objects and 0 observation objects.
> DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
> observation fields.
> DEBUG 1: Creating Fcst-Obs Object Statistics file:
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> DEBUG 1: Creating Contingency Table Statistics file:
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> DEBUG 1: Creating Object NetCDF file:
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> DEBUG 1: Loading forecast raw color table:
> /MET_V8/share/met//colortables/met_default.ctable
> DEBUG 1: Loading observation raw color table:
> /MET_V8/share/met//colortables/met_default.ctable
> DEBUG 1: Creating postscript file:
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
>
> Am I doing some mistakes or the above warnings are general due to
> observation and fcst time mismatch.
> Kindly find the attachments for reference.
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Wed Oct 24 09:56:00 2018
Sir,
The command:
python read_3B42RT_3hours.py
./input/sample_obs/3B42RT.2018082100.7.nc4
precipitation
shows the following message:
Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
Variable Name : 'precipitation'
Data Shape: (1440, 480)
Data Type: dtype('float64')
Traceback (most recent call last):
File "read_3B42RT_3hours.py", line 49, in <module>
beg_time = dt.datetime.strptime(beg_time_str, "%Y-%m-%d
%H:%M:%S.%fZ")
File "/usr/lib64/python2.7/_strptime.py", line 332, in _strptime
(data_string, format))
ValueError: time data '2018-08-20 22:30:00Z' does not match format
'%Y-%m-%d %H:%M:%S.%fZ'
So I could not run mode ...
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> So we worked together through the details of writing a python script
for
> reading the daily 3B42RT datasets.
>
> Now, you need to adapt that script for handling the 3-hourly 3B42RT
data...
> let's say that you've done that and called it
"read_3B42RT_3hours.py". You
> should use that Python script when running MODE, like this:
>
> mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> PYTHON_NUMPY MODEConfig_default -outdir ./output/mode_analysis \
> -v 2
>
> And then in the MODE config file:
>
> fcst = {
> field = { name = "APCP_03"; level = "(*,*)"; }
> censor_thresh = [];
> censor_val = [];
> conv_radius = 60.0/grid_res; // in grid squares
> conv_thresh = >=5.0;
> vld_thresh = 0.5;
> filter_attr_name = [];
> filter_attr_thresh = [];
> merge_thresh = >=1.25;
> merge_flag = THRESH;
> }
> obs = fcst;
> obs = {
> field = { name="read_3B42RT_3hours.py read_3B42RT.2018082100.7.nc4
> precipitation"; }
> }
>
> Does that make sense?
>
> Thanks,
> John
>
> On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> > Transaction: Ticket created by biranchimahala at gmail.com
> > Queue: met_help
> > Subject: (No subject given)
> > Owner: Nobody
> > Requestors: biranchimahala at gmail.com
> > Status: new
> > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >
> >
> > Sir,
> > I am able to run mode of MET-8.0 with the assistance of met_help
team.
> > Now I am getting sum warnings while running mode as follows.
> >
> > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> ./output/mode_analysis/
> > -v 2
> >
> > DEBUG 1: Default Config File:
> /MET_V8/share/met//config/MODEConfig_default
> > DEBUG 1: Match Config File: MODEConfig_default
> > DEBUG 1: Merge Config File: MODEConfig_default
> > WARNING:
> > WARNING: NcCfFile::open() -> could not determine the valid time,
using 0.
> > WARNING:
> > DEBUG 1: Forecast File:
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > DEBUG 1: Regridding observation precipitation(*,*) to the
verification
> > grid.
> > WARNING:
> > WARNING: setup_fcst_obs_data() -> Forecast and observation valid
times do
> > not match 20180821_000000 != 19700101_000000 for APCP_03(*,*)
versus
> > precipitation(*,*).
> > WARNING:
> > DEBUG 1: Forecast Field: APCP_03 at A3
> > DEBUG 1: Observation Field: precipitation at *,*
> > DEBUG 2: Processing masking regions.
> > DEBUG 2: Identifying objects in the forecast and observation
fields...
> > DEBUG 2: Computing contingency table statistics...
> > DEBUG 2: Identified: 0 forecast objects and 0 observation objects.
> > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > DEBUG 2: Performing merging (THRESH) in the observation field.
> > DEBUG 2: Remaining: 0 forecast objects and 0 observation objects.
> > DEBUG 2: Performing matching (MERGE_BOTH) between the forecast and
> > observation fields.
> > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > DEBUG 1: Creating Contingency Table Statistics file:
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > DEBUG 1: Creating Object NetCDF file:
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > DEBUG 1: Loading forecast raw color table:
> > /MET_V8/share/met//colortables/met_default.ctable
> > DEBUG 1: Loading observation raw color table:
> > /MET_V8/share/met//colortables/met_default.ctable
> > DEBUG 1: Creating postscript file:
> > ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> >
> > Am I doing some mistakes or the above warnings are general due to
> > observation and fcst time mismatch.
> > Kindly find the attachments for reference.
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
>
>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Wed Oct 24 10:34:51 2018
Biranchi,
Looking very closely at the 3B42RT NetCDF files and the error message
from
that python script, it looks like the time formats are very slightly
different.
The Daily files include microseconds:
:BeginTime = "01:30:00.000Z" ;
:EndTime = "01:29:59.999Z" ;
The 3-hourly files do not:
:BeginTime = "22:30:00Z" ;
:EndTime = "01:30:00Z" ;
Other than that, they're the same. So I created a new script named
"read_3B42RT.py" (see attached) which should handle both the daily and
3-hourly files. I parses the times with or without the microseconds
included:
python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4 precipitation
Hopefully that does the trick.
Thanks,
John
On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
> Sir,
> The command:
> python read_3B42RT_3hours.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> precipitation
> shows the following message:
> Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> Variable Name : 'precipitation'
> Data Shape: (1440, 480)
> Data Type: dtype('float64')
> Traceback (most recent call last):
> File "read_3B42RT_3hours.py", line 49, in <module>
> beg_time = dt.datetime.strptime(beg_time_str, "%Y-%m-%d
> %H:%M:%S.%fZ")
> File "/usr/lib64/python2.7/_strptime.py", line 332, in _strptime
> (data_string, format))
> ValueError: time data '2018-08-20 22:30:00Z' does not match format
> '%Y-%m-%d %H:%M:%S.%fZ'
>
> So I could not run mode ...
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > So we worked together through the details of writing a python
script for
> > reading the daily 3B42RT datasets.
> >
> > Now, you need to adapt that script for handling the 3-hourly
3B42RT
> data...
> > let's say that you've done that and called it
"read_3B42RT_3hours.py".
> You
> > should use that Python script when running MODE, like this:
> >
> > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > PYTHON_NUMPY MODEConfig_default -outdir ./output/mode_analysis \
> > -v 2
> >
> > And then in the MODE config file:
> >
> > fcst = {
> > field = { name = "APCP_03"; level = "(*,*)"; }
> > censor_thresh = [];
> > censor_val = [];
> > conv_radius = 60.0/grid_res; // in grid squares
> > conv_thresh = >=5.0;
> > vld_thresh = 0.5;
> > filter_attr_name = [];
> > filter_attr_thresh = [];
> > merge_thresh = >=1.25;
> > merge_flag = THRESH;
> > }
> > obs = fcst;
> > obs = {
> > field = { name="read_3B42RT_3hours.py
read_3B42RT.2018082100.7.nc4
> > precipitation"; }
> > }
> >
> > Does that make sense?
> >
> > Thanks,
> > John
> >
> > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> > > Transaction: Ticket created by biranchimahala at gmail.com
> > > Queue: met_help
> > > Subject: (No subject given)
> > > Owner: Nobody
> > > Requestors: biranchimahala at gmail.com
> > > Status: new
> > > Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> >
> > >
> > >
> > > Sir,
> > > I am able to run mode of MET-8.0 with the assistance of met_help
team.
> > > Now I am getting sum warnings while running mode as follows.
> > >
> > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> > ./output/mode_analysis/
> > > -v 2
> > >
> > > DEBUG 1: Default Config File:
> > /MET_V8/share/met//config/MODEConfig_default
> > > DEBUG 1: Match Config File: MODEConfig_default
> > > DEBUG 1: Merge Config File: MODEConfig_default
> > > WARNING:
> > > WARNING: NcCfFile::open() -> could not determine the valid time,
using
> 0.
> > > WARNING:
> > > DEBUG 1: Forecast File:
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > > DEBUG 1: Regridding observation precipitation(*,*) to the
verification
> > > grid.
> > > WARNING:
> > > WARNING: setup_fcst_obs_data() -> Forecast and observation valid
times
> do
> > > not match 20180821_000000 != 19700101_000000 for APCP_03(*,*)
versus
> > > precipitation(*,*).
> > > WARNING:
> > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > DEBUG 1: Observation Field: precipitation at *,*
> > > DEBUG 2: Processing masking regions.
> > > DEBUG 2: Identifying objects in the forecast and observation
fields...
> > > DEBUG 2: Computing contingency table statistics...
> > > DEBUG 2: Identified: 0 forecast objects and 0 observation
objects.
> > > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > > DEBUG 2: Performing merging (THRESH) in the observation field.
> > > DEBUG 2: Remaining: 0 forecast objects and 0 observation
objects.
> > > DEBUG 2: Performing matching (MERGE_BOTH) between the forecast
and
> > > observation fields.
> > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > DEBUG 1: Creating Contingency Table Statistics file:
> > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > DEBUG 1: Creating Object NetCDF file:
> > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > DEBUG 1: Loading forecast raw color table:
> > > /MET_V8/share/met//colortables/met_default.ctable
> > > DEBUG 1: Loading observation raw color table:
> > > /MET_V8/share/met//colortables/met_default.ctable
> > > DEBUG 1: Creating postscript file:
> > > ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > >
> > > Am I doing some mistakes or the above warnings are general due
to
> > > observation and fcst time mismatch.
> > > Kindly find the attachments for reference.
> > > Thanking You
> > > With Best Regards
> > > ________________________
> > > Dr. BIRANCHI KUMAR MAHALA
> > > Asst. Prof., Mathematics
> > > *Kalinga Institute of Industrial Technology,*
> > > *Deemed to be University, Bhubaneswar*
> > > *Mobile- 09861182688*
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Wed Oct 24 11:12:28 2018
Sir,
The script works fine for
python read_3B42RT.py ./input/sample_obs/3B42RT.2018082100.7.nc4
precipitation
But the output of the command;
plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
'name="./read_3B42RT.py
./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
shows the following;
DEBUG 1: Opening data file: PYTHON_NUMPY
Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
Variable Name : 'precipitation'
Data Shape: (1440, 480)
Data Type: dtype('float64')
Begin Time = 2018-08-20 22:30:00
End Time = 2018-08-21 01:30:00
Accum Time = 030000
Attributes: {'long_name': 'precipitation', 'init': '20180821_013000',
'valid': '20180821_013000', 'grid': {'delta_lat': 0.25, 'lon_ll':
-179.875,
'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875, 'delta_lon':
0.25,
'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation', 'lead':
'00',
'level': 'Surface', 'units': 'mm', 'accum': '030000'}
DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
ERROR :
ERROR : DataPlane::two_to_one() -> range check error: (Nx, Ny) =
(480,
1440), (x, y) = (480, 0)
ERROR :
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Biranchi,
>
> Looking very closely at the 3B42RT NetCDF files and the error
message from
> that python script, it looks like the time formats are very slightly
> different.
>
> The Daily files include microseconds:
> :BeginTime = "01:30:00.000Z" ;
> :EndTime = "01:29:59.999Z" ;
>
> The 3-hourly files do not:
> :BeginTime = "22:30:00Z" ;
> :EndTime = "01:30:00Z" ;
>
> Other than that, they're the same. So I created a new script named
> "read_3B42RT.py" (see attached) which should handle both the daily
and
> 3-hourly files. I parses the times with or without the microseconds
> included:
>
> python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
> python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4 precipitation
>
> Hopefully that does the trick.
>
> Thanks,
> John
>
> On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >
> > Sir,
> > The command:
> > python read_3B42RT_3hours.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> > precipitation
> > shows the following message:
> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > Variable Name : 'precipitation'
> > Data Shape: (1440, 480)
> > Data Type: dtype('float64')
> > Traceback (most recent call last):
> > File "read_3B42RT_3hours.py", line 49, in <module>
> > beg_time = dt.datetime.strptime(beg_time_str, "%Y-%m-%d
> > %H:%M:%S.%fZ")
> > File "/usr/lib64/python2.7/_strptime.py", line 332, in _strptime
> > (data_string, format))
> > ValueError: time data '2018-08-20 22:30:00Z' does not match format
> > '%Y-%m-%d %H:%M:%S.%fZ'
> >
> > So I could not run mode ...
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
> >
> > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > So we worked together through the details of writing a python
script
> for
> > > reading the daily 3B42RT datasets.
> > >
> > > Now, you need to adapt that script for handling the 3-hourly
3B42RT
> > data...
> > > let's say that you've done that and called it
"read_3B42RT_3hours.py".
> > You
> > > should use that Python script when running MODE, like this:
> > >
> > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > PYTHON_NUMPY MODEConfig_default -outdir ./output/mode_analysis \
> > > -v 2
> > >
> > > And then in the MODE config file:
> > >
> > > fcst = {
> > > field = { name = "APCP_03"; level = "(*,*)"; }
> > > censor_thresh = [];
> > > censor_val = [];
> > > conv_radius = 60.0/grid_res; // in grid squares
> > > conv_thresh = >=5.0;
> > > vld_thresh = 0.5;
> > > filter_attr_name = [];
> > > filter_attr_thresh = [];
> > > merge_thresh = >=1.25;
> > > merge_flag = THRESH;
> > > }
> > > obs = fcst;
> > > obs = {
> > > field = { name="read_3B42RT_3hours.py
read_3B42RT.2018082100.7.nc4
> > > precipitation"; }
> > > }
> > >
> > > Does that make sense?
> > >
> > > Thanks,
> > > John
> > >
> > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > >
> > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> > > > Transaction: Ticket created by biranchimahala at gmail.com
> > > > Queue: met_help
> > > > Subject: (No subject given)
> > > > Owner: Nobody
> > > > Requestors: biranchimahala at gmail.com
> > > > Status: new
> > > > Ticket <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > >
> > > >
> > > >
> > > > Sir,
> > > > I am able to run mode of MET-8.0 with the assistance of
met_help
> team.
> > > > Now I am getting sum warnings while running mode as follows.
> > > >
> > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> > > ./output/mode_analysis/
> > > > -v 2
> > > >
> > > > DEBUG 1: Default Config File:
> > > /MET_V8/share/met//config/MODEConfig_default
> > > > DEBUG 1: Match Config File: MODEConfig_default
> > > > DEBUG 1: Merge Config File: MODEConfig_default
> > > > WARNING:
> > > > WARNING: NcCfFile::open() -> could not determine the valid
time,
> using
> > 0.
> > > > WARNING:
> > > > DEBUG 1: Forecast File:
> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > > > DEBUG 1: Regridding observation precipitation(*,*) to the
> verification
> > > > grid.
> > > > WARNING:
> > > > WARNING: setup_fcst_obs_data() -> Forecast and observation
valid
> times
> > do
> > > > not match 20180821_000000 != 19700101_000000 for APCP_03(*,*)
versus
> > > > precipitation(*,*).
> > > > WARNING:
> > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > DEBUG 1: Observation Field: precipitation at *,*
> > > > DEBUG 2: Processing masking regions.
> > > > DEBUG 2: Identifying objects in the forecast and observation
> fields...
> > > > DEBUG 2: Computing contingency table statistics...
> > > > DEBUG 2: Identified: 0 forecast objects and 0 observation
objects.
> > > > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > > > DEBUG 2: Performing merging (THRESH) in the observation field.
> > > > DEBUG 2: Remaining: 0 forecast objects and 0 observation
objects.
> > > > DEBUG 2: Performing matching (MERGE_BOTH) between the forecast
and
> > > > observation fields.
> > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > DEBUG 1: Creating Contingency Table Statistics file:
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > DEBUG 1: Creating Object NetCDF file:
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > DEBUG 1: Loading forecast raw color table:
> > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > DEBUG 1: Loading observation raw color table:
> > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > DEBUG 1: Creating postscript file:
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > >
> > > > Am I doing some mistakes or the above warnings are general due
to
> > > > observation and fcst time mismatch.
> > > > Kindly find the attachments for reference.
> > > > Thanking You
> > > > With Best Regards
> > > > ________________________
> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > Asst. Prof., Mathematics
> > > > *Kalinga Institute of Industrial Technology,*
> > > > *Deemed to be University, Bhubaneswar*
> > > > *Mobile- 09861182688*
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Wed Oct 24 11:32:25 2018
Ah yes, there are more differences in these files.
For some reason the Daily files store data in lon, lat order:
float precipitation(lon, lat) ;
While the 3-hourly files store data in lat, lon order:
float precipitation(lat, lon) ;
That's pretty frustrating! OK, I updated the script to check for
(lat,
lon) versus (lon, lat) ordering... and take the transpose in the
latter
case. I tested using these commands:
met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT_Daily.20180821.7.ps \
'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4 precipitation";'
met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps \
'name="read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation";'
I have attached the updated script and these 2 test images.
However, it would be wise to independently verify that the precip is
in the
right spot. Can you compare these images to NASA plots for the same
times?
Thanks,
John
On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
> Sir,
> The script works fine for
> python read_3B42RT.py ./input/sample_obs/3B42RT.2018082100.7.nc4
> precipitation
> But the output of the command;
> plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> 'name="./read_3B42RT.py
> ./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
> shows the following;
> DEBUG 1: Opening data file: PYTHON_NUMPY
> Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> Variable Name : 'precipitation'
> Data Shape: (1440, 480)
> Data Type: dtype('float64')
> Begin Time = 2018-08-20 22:30:00
> End Time = 2018-08-21 01:30:00
> Accum Time = 030000
> Attributes: {'long_name': 'precipitation', 'init':
'20180821_013000',
> 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25, 'lon_ll':
-179.875,
> 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875, 'delta_lon':
0.25,
> 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation', 'lead':
'00',
> 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
> ERROR :
> ERROR : DataPlane::two_to_one() -> range check error: (Nx, Ny) =
(480,
> 1440), (x, y) = (480, 0)
> ERROR :
>
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Biranchi,
> >
> > Looking very closely at the 3B42RT NetCDF files and the error
message
> from
> > that python script, it looks like the time formats are very
slightly
> > different.
> >
> > The Daily files include microseconds:
> > :BeginTime = "01:30:00.000Z" ;
> > :EndTime = "01:29:59.999Z" ;
> >
> > The 3-hourly files do not:
> > :BeginTime = "22:30:00Z" ;
> > :EndTime = "01:30:00Z" ;
> >
> > Other than that, they're the same. So I created a new script
named
> > "read_3B42RT.py" (see attached) which should handle both the daily
and
> > 3-hourly files. I parses the times with or without the
microseconds
> > included:
> >
> > python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
> > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4 precipitation
> >
> > Hopefully that does the trick.
> >
> > Thanks,
> > John
> >
> > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT <
> met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > >
> > > Sir,
> > > The command:
> > > python read_3B42RT_3hours.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> > > precipitation
> > > shows the following message:
> > > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > > Variable Name : 'precipitation'
> > > Data Shape: (1440, 480)
> > > Data Type: dtype('float64')
> > > Traceback (most recent call last):
> > > File "read_3B42RT_3hours.py", line 49, in <module>
> > > beg_time = dt.datetime.strptime(beg_time_str, "%Y-%m-%d
> > > %H:%M:%S.%fZ")
> > > File "/usr/lib64/python2.7/_strptime.py", line 332, in
_strptime
> > > (data_string, format))
> > > ValueError: time data '2018-08-20 22:30:00Z' does not match
format
> > > '%Y-%m-%d %H:%M:%S.%fZ'
> > >
> > > So I could not run mode ...
> > > Thanking You
> > > With Best Regards
> > > ________________________
> > > Dr. BIRANCHI KUMAR MAHALA
> > > Asst. Prof., Mathematics
> > > *Kalinga Institute of Industrial Technology,*
> > > *Deemed to be University, Bhubaneswar*
> > > *Mobile- 09861182688*
> > >
> > >
> > >
> > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > So we worked together through the details of writing a python
script
> > for
> > > > reading the daily 3B42RT datasets.
> > > >
> > > > Now, you need to adapt that script for handling the 3-hourly
3B42RT
> > > data...
> > > > let's say that you've done that and called it
> "read_3B42RT_3hours.py".
> > > You
> > > > should use that Python script when running MODE, like this:
> > > >
> > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > > PYTHON_NUMPY MODEConfig_default -outdir ./output/mode_analysis
\
> > > > -v 2
> > > >
> > > > And then in the MODE config file:
> > > >
> > > > fcst = {
> > > > field = { name = "APCP_03"; level = "(*,*)"; }
> > > > censor_thresh = [];
> > > > censor_val = [];
> > > > conv_radius = 60.0/grid_res; // in grid squares
> > > > conv_thresh = >=5.0;
> > > > vld_thresh = 0.5;
> > > > filter_attr_name = [];
> > > > filter_attr_thresh = [];
> > > > merge_thresh = >=1.25;
> > > > merge_flag = THRESH;
> > > > }
> > > > obs = fcst;
> > > > obs = {
> > > > field = { name="read_3B42RT_3hours.py
read_3B42RT.2018082100.7.nc4
> > > > precipitation"; }
> > > > }
> > > >
> > > > Does that make sense?
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT <
> > > met_help at ucar.edu
> > > > >
> > > > wrote:
> > > >
> > > > >
> > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> > > > > Transaction: Ticket created by biranchimahala at gmail.com
> > > > > Queue: met_help
> > > > > Subject: (No subject given)
> > > > > Owner: Nobody
> > > > > Requestors: biranchimahala at gmail.com
> > > > > Status: new
> > > > > Ticket <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > >
> > > > >
> > > > >
> > > > > Sir,
> > > > > I am able to run mode of MET-8.0 with the assistance of
met_help
> > team.
> > > > > Now I am getting sum warnings while running mode as follows.
> > > > >
> > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> > > > ./output/mode_analysis/
> > > > > -v 2
> > > > >
> > > > > DEBUG 1: Default Config File:
> > > > /MET_V8/share/met//config/MODEConfig_default
> > > > > DEBUG 1: Match Config File: MODEConfig_default
> > > > > DEBUG 1: Merge Config File: MODEConfig_default
> > > > > WARNING:
> > > > > WARNING: NcCfFile::open() -> could not determine the valid
time,
> > using
> > > 0.
> > > > > WARNING:
> > > > > DEBUG 1: Forecast File:
> > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > > > > DEBUG 1: Regridding observation precipitation(*,*) to the
> > verification
> > > > > grid.
> > > > > WARNING:
> > > > > WARNING: setup_fcst_obs_data() -> Forecast and observation
valid
> > times
> > > do
> > > > > not match 20180821_000000 != 19700101_000000 for
APCP_03(*,*)
> versus
> > > > > precipitation(*,*).
> > > > > WARNING:
> > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > > DEBUG 1: Observation Field: precipitation at *,*
> > > > > DEBUG 2: Processing masking regions.
> > > > > DEBUG 2: Identifying objects in the forecast and observation
> > fields...
> > > > > DEBUG 2: Computing contingency table statistics...
> > > > > DEBUG 2: Identified: 0 forecast objects and 0 observation
objects.
> > > > > DEBUG 2: Performing merging (THRESH) in the forecast field.
> > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
> > > > > DEBUG 2: Remaining: 0 forecast objects and 0 observation
objects.
> > > > > DEBUG 2: Performing matching (MERGE_BOTH) between the
forecast and
> > > > > observation fields.
> > > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> > > > >
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > > DEBUG 1: Creating Contingency Table Statistics file:
> > > > >
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > > DEBUG 1: Creating Object NetCDF file:
> > > > >
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > > DEBUG 1: Loading forecast raw color table:
> > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > > DEBUG 1: Loading observation raw color table:
> > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > > DEBUG 1: Creating postscript file:
> > > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > > >
> > > > > Am I doing some mistakes or the above warnings are general
due to
> > > > > observation and fcst time mismatch.
> > > > > Kindly find the attachments for reference.
> > > > > Thanking You
> > > > > With Best Regards
> > > > > ________________________
> > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > Asst. Prof., Mathematics
> > > > > *Kalinga Institute of Industrial Technology,*
> > > > > *Deemed to be University, Bhubaneswar*
> > > > > *Mobile- 09861182688*
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Wed Oct 24 11:47:07 2018
Sir,
Can you please brief how to compare the precipitation images with NASA
plots.
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Ah yes, there are more differences in these files.
>
> For some reason the Daily files store data in lon, lat order:
> float precipitation(lon, lat) ;
> While the 3-hourly files store data in lat, lon order:
> float precipitation(lat, lon) ;
>
> That's pretty frustrating! OK, I updated the script to check for
(lat,
> lon) versus (lon, lat) ordering... and take the transpose in the
latter
> case. I tested using these commands:
>
> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT_Daily.20180821.7.ps
\
> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation";'
>
> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps \
> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation";'
>
> I have attached the updated script and these 2 test images.
>
> However, it would be wise to independently verify that the precip is
in the
> right spot. Can you compare these images to NASA plots for the same
times?
>
> Thanks,
> John
>
> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >
> > Sir,
> > The script works fine for
> > python read_3B42RT.py ./input/sample_obs/3B42RT.2018082100.7.nc4
> > precipitation
> > But the output of the command;
> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > 'name="./read_3B42RT.py
> > ./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
> > shows the following;
> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > Variable Name : 'precipitation'
> > Data Shape: (1440, 480)
> > Data Type: dtype('float64')
> > Begin Time = 2018-08-20 22:30:00
> > End Time = 2018-08-21 01:30:00
> > Accum Time = 030000
> > Attributes: {'long_name': 'precipitation', 'init':
'20180821_013000',
> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25, 'lon_ll':
> -179.875,
> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875, 'delta_lon':
0.25,
> > 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation', 'lead':
'00',
> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> > DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
> > ERROR :
> > ERROR : DataPlane::two_to_one() -> range check error: (Nx, Ny) =
(480,
> > 1440), (x, y) = (480, 0)
> > ERROR :
> >
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
> >
> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Biranchi,
> > >
> > > Looking very closely at the 3B42RT NetCDF files and the error
message
> > from
> > > that python script, it looks like the time formats are very
slightly
> > > different.
> > >
> > > The Daily files include microseconds:
> > > :BeginTime = "01:30:00.000Z" ;
> > > :EndTime = "01:29:59.999Z" ;
> > >
> > > The 3-hourly files do not:
> > > :BeginTime = "22:30:00Z" ;
> > > :EndTime = "01:30:00Z" ;
> > >
> > > Other than that, they're the same. So I created a new script
named
> > > "read_3B42RT.py" (see attached) which should handle both the
daily and
> > > 3-hourly files. I parses the times with or without the
microseconds
> > > included:
> > >
> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4 precipitation
> > >
> > > Hopefully that does the trick.
> > >
> > > Thanks,
> > > John
> > >
> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>
> > > >
> > > > Sir,
> > > > The command:
> > > > python read_3B42RT_3hours.py
> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > precipitation
> > > > shows the following message:
> > > > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > Variable Name : 'precipitation'
> > > > Data Shape: (1440, 480)
> > > > Data Type: dtype('float64')
> > > > Traceback (most recent call last):
> > > > File "read_3B42RT_3hours.py", line 49, in <module>
> > > > beg_time = dt.datetime.strptime(beg_time_str, "%Y-%m-
%d
> > > > %H:%M:%S.%fZ")
> > > > File "/usr/lib64/python2.7/_strptime.py", line 332, in
_strptime
> > > > (data_string, format))
> > > > ValueError: time data '2018-08-20 22:30:00Z' does not match
format
> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > > >
> > > > So I could not run mode ...
> > > > Thanking You
> > > > With Best Regards
> > > > ________________________
> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > Asst. Prof., Mathematics
> > > > *Kalinga Institute of Industrial Technology,*
> > > > *Deemed to be University, Bhubaneswar*
> > > > *Mobile- 09861182688*
> > > >
> > > >
> > > >
> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT <
> > > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > > So we worked together through the details of writing a
python
> script
> > > for
> > > > > reading the daily 3B42RT datasets.
> > > > >
> > > > > Now, you need to adapt that script for handling the 3-hourly
3B42RT
> > > > data...
> > > > > let's say that you've done that and called it
> > "read_3B42RT_3hours.py".
> > > > You
> > > > > should use that Python script when running MODE, like this:
> > > > >
> > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > > > PYTHON_NUMPY MODEConfig_default -outdir
./output/mode_analysis \
> > > > > -v 2
> > > > >
> > > > > And then in the MODE config file:
> > > > >
> > > > > fcst = {
> > > > > field = { name = "APCP_03"; level = "(*,*)"; }
> > > > > censor_thresh = [];
> > > > > censor_val = [];
> > > > > conv_radius = 60.0/grid_res; // in grid squares
> > > > > conv_thresh = >=5.0;
> > > > > vld_thresh = 0.5;
> > > > > filter_attr_name = [];
> > > > > filter_attr_thresh = [];
> > > > > merge_thresh = >=1.25;
> > > > > merge_flag = THRESH;
> > > > > }
> > > > > obs = fcst;
> > > > > obs = {
> > > > > field = { name="read_3B42RT_3hours.py
> read_3B42RT.2018082100.7.nc4
> > > > > precipitation"; }
> > > > > }
> > > > >
> > > > > Does that make sense?
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT <
> > > > met_help at ucar.edu
> > > > > >
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> > > > > > Transaction: Ticket created by biranchimahala at gmail.com
> > > > > > Queue: met_help
> > > > > > Subject: (No subject given)
> > > > > > Owner: Nobody
> > > > > > Requestors: biranchimahala at gmail.com
> > > > > > Status: new
> > > > > > Ticket <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > >
> > > > > >
> > > > > >
> > > > > > Sir,
> > > > > > I am able to run mode of MET-8.0 with the assistance of
met_help
> > > team.
> > > > > > Now I am getting sum warnings while running mode as
follows.
> > > > > >
> > > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> > > > > ./output/mode_analysis/
> > > > > > -v 2
> > > > > >
> > > > > > DEBUG 1: Default Config File:
> > > > > /MET_V8/share/met//config/MODEConfig_default
> > > > > > DEBUG 1: Match Config File: MODEConfig_default
> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
> > > > > > WARNING:
> > > > > > WARNING: NcCfFile::open() -> could not determine the valid
time,
> > > using
> > > > 0.
> > > > > > WARNING:
> > > > > > DEBUG 1: Forecast File:
> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > > > > > DEBUG 1: Regridding observation precipitation(*,*) to the
> > > verification
> > > > > > grid.
> > > > > > WARNING:
> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and observation
valid
> > > times
> > > > do
> > > > > > not match 20180821_000000 != 19700101_000000 for
APCP_03(*,*)
> > versus
> > > > > > precipitation(*,*).
> > > > > > WARNING:
> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > > > DEBUG 1: Observation Field: precipitation at *,*
> > > > > > DEBUG 2: Processing masking regions.
> > > > > > DEBUG 2: Identifying objects in the forecast and
observation
> > > fields...
> > > > > > DEBUG 2: Computing contingency table statistics...
> > > > > > DEBUG 2: Identified: 0 forecast objects and 0 observation
> objects.
> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
> > > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0 observation
objects.
> > > > > > DEBUG 2: Performing matching (MERGE_BOTH) between the
forecast
> and
> > > > > > observation fields.
> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> > > > > >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > > > DEBUG 1: Creating Contingency Table Statistics file:
> > > > > >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > > > DEBUG 1: Creating Object NetCDF file:
> > > > > >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > > > DEBUG 1: Loading forecast raw color table:
> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > > > DEBUG 1: Loading observation raw color table:
> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > > > DEBUG 1: Creating postscript file:
> > > > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > > > >
> > > > > > Am I doing some mistakes or the above warnings are general
due to
> > > > > > observation and fcst time mismatch.
> > > > > > Kindly find the attachments for reference.
> > > > > > Thanking You
> > > > > > With Best Regards
> > > > > > ________________________
> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > Asst. Prof., Mathematics
> > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > *Mobile- 09861182688*
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Wed Oct 24 11:47:59 2018
Sir,
The new script works fine for both.
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala
<biranchimahala at gmail.com>
wrote:
> Sir,
> Can you please brief how to compare the precipitation images with
NASA
> plots.
>
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
>> Ah yes, there are more differences in these files.
>>
>> For some reason the Daily files store data in lon, lat order:
>> float precipitation(lon, lat) ;
>> While the 3-hourly files store data in lat, lon order:
>> float precipitation(lat, lon) ;
>>
>> That's pretty frustrating! OK, I updated the script to check for
(lat,
>> lon) versus (lon, lat) ordering... and take the transpose in the
latter
>> case. I tested using these commands:
>>
>> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT_Daily.20180821.7.ps
\
>> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation";'
>>
>> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps \
>> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation";'
>>
>> I have attached the updated script and these 2 test images.
>>
>> However, it would be wise to independently verify that the precip
is in
>> the
>> right spot. Can you compare these images to NASA plots for the
same
>> times?
>>
>> Thanks,
>> John
>>
>> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT <
>> met_help at ucar.edu>
>> wrote:
>>
>> >
>> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>> >
>> > Sir,
>> > The script works fine for
>> > python read_3B42RT.py ./input/sample_obs/3B42RT.2018082100.7.nc4
>> > precipitation
>> > But the output of the command;
>> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
>> > 'name="./read_3B42RT.py
>> > ./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
>> > shows the following;
>> > DEBUG 1: Opening data file: PYTHON_NUMPY
>> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
>> > Variable Name : 'precipitation'
>> > Data Shape: (1440, 480)
>> > Data Type: dtype('float64')
>> > Begin Time = 2018-08-20 22:30:00
>> > End Time = 2018-08-21 01:30:00
>> > Accum Time = 030000
>> > Attributes: {'long_name': 'precipitation', 'init':
'20180821_013000',
>> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25, 'lon_ll':
>> -179.875,
>> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875, 'delta_lon':
0.25,
>> > 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation', 'lead':
'00',
>> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
>> > DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
>> > ERROR :
>> > ERROR : DataPlane::two_to_one() -> range check error: (Nx, Ny) =
(480,
>> > 1440), (x, y) = (480, 0)
>> > ERROR :
>> >
>> > Thanking You
>> > With Best Regards
>> > ________________________
>> > Dr. BIRANCHI KUMAR MAHALA
>> > Asst. Prof., Mathematics
>> > *Kalinga Institute of Industrial Technology,*
>> > *Deemed to be University, Bhubaneswar*
>> > *Mobile- 09861182688*
>> >
>> >
>> >
>> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT <
>> > met_help at ucar.edu> wrote:
>> >
>> > > Biranchi,
>> > >
>> > > Looking very closely at the 3B42RT NetCDF files and the error
message
>> > from
>> > > that python script, it looks like the time formats are very
slightly
>> > > different.
>> > >
>> > > The Daily files include microseconds:
>> > > :BeginTime = "01:30:00.000Z" ;
>> > > :EndTime = "01:29:59.999Z" ;
>> > >
>> > > The 3-hourly files do not:
>> > > :BeginTime = "22:30:00Z" ;
>> > > :EndTime = "01:30:00Z" ;
>> > >
>> > > Other than that, they're the same. So I created a new script
named
>> > > "read_3B42RT.py" (see attached) which should handle both the
daily and
>> > > 3-hourly files. I parses the times with or without the
microseconds
>> > > included:
>> > >
>> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
>> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4 precipitation
>> > >
>> > > Hopefully that does the trick.
>> > >
>> > > Thanks,
>> > > John
>> > >
>> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT <
>> > met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > >
>> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>
>> > > >
>> > > > Sir,
>> > > > The command:
>> > > > python read_3B42RT_3hours.py
>> ./input/sample_obs/3B42RT.2018082100.7.nc4
>> > > > precipitation
>> > > > shows the following message:
>> > > > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
>> > > > Variable Name : 'precipitation'
>> > > > Data Shape: (1440, 480)
>> > > > Data Type: dtype('float64')
>> > > > Traceback (most recent call last):
>> > > > File "read_3B42RT_3hours.py", line 49, in <module>
>> > > > beg_time = dt.datetime.strptime(beg_time_str, "%Y-%m-
%d
>> > > > %H:%M:%S.%fZ")
>> > > > File "/usr/lib64/python2.7/_strptime.py", line 332, in
_strptime
>> > > > (data_string, format))
>> > > > ValueError: time data '2018-08-20 22:30:00Z' does not match
format
>> > > > '%Y-%m-%d %H:%M:%S.%fZ'
>> > > >
>> > > > So I could not run mode ...
>> > > > Thanking You
>> > > > With Best Regards
>> > > > ________________________
>> > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > Asst. Prof., Mathematics
>> > > > *Kalinga Institute of Industrial Technology,*
>> > > > *Deemed to be University, Bhubaneswar*
>> > > > *Mobile- 09861182688*
>> > > >
>> > > >
>> > > >
>> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT <
>> > > > met_help at ucar.edu>
>> > > > wrote:
>> > > >
>> > > > > So we worked together through the details of writing a
python
>> script
>> > > for
>> > > > > reading the daily 3B42RT datasets.
>> > > > >
>> > > > > Now, you need to adapt that script for handling the 3-
hourly
>> 3B42RT
>> > > > data...
>> > > > > let's say that you've done that and called it
>> > "read_3B42RT_3hours.py".
>> > > > You
>> > > > > should use that Python script when running MODE, like this:
>> > > > >
>> > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
>> > > > > PYTHON_NUMPY MODEConfig_default -outdir
./output/mode_analysis \
>> > > > > -v 2
>> > > > >
>> > > > > And then in the MODE config file:
>> > > > >
>> > > > > fcst = {
>> > > > > field = { name = "APCP_03"; level = "(*,*)"; }
>> > > > > censor_thresh = [];
>> > > > > censor_val = [];
>> > > > > conv_radius = 60.0/grid_res; // in grid squares
>> > > > > conv_thresh = >=5.0;
>> > > > > vld_thresh = 0.5;
>> > > > > filter_attr_name = [];
>> > > > > filter_attr_thresh = [];
>> > > > > merge_thresh = >=1.25;
>> > > > > merge_flag = THRESH;
>> > > > > }
>> > > > > obs = fcst;
>> > > > > obs = {
>> > > > > field = { name="read_3B42RT_3hours.py
>> read_3B42RT.2018082100.7.nc4
>> > > > > precipitation"; }
>> > > > > }
>> > > > >
>> > > > > Does that make sense?
>> > > > >
>> > > > > Thanks,
>> > > > > John
>> > > > >
>> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT <
>> > > > met_help at ucar.edu
>> > > > > >
>> > > > > wrote:
>> > > > >
>> > > > > >
>> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
>> > > > > > Transaction: Ticket created by biranchimahala at gmail.com
>> > > > > > Queue: met_help
>> > > > > > Subject: (No subject given)
>> > > > > > Owner: Nobody
>> > > > > > Requestors: biranchimahala at gmail.com
>> > > > > > Status: new
>> > > > > > Ticket <URL:
>> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>> > > > >
>> > > > > >
>> > > > > >
>> > > > > > Sir,
>> > > > > > I am able to run mode of MET-8.0 with the assistance of
met_help
>> > > team.
>> > > > > > Now I am getting sum warnings while running mode as
follows.
>> > > > > >
>> > > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
>> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
>> > > > > ./output/mode_analysis/
>> > > > > > -v 2
>> > > > > >
>> > > > > > DEBUG 1: Default Config File:
>> > > > > /MET_V8/share/met//config/MODEConfig_default
>> > > > > > DEBUG 1: Match Config File: MODEConfig_default
>> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
>> > > > > > WARNING:
>> > > > > > WARNING: NcCfFile::open() -> could not determine the
valid time,
>> > > using
>> > > > 0.
>> > > > > > WARNING:
>> > > > > > DEBUG 1: Forecast File:
>> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
>> > > > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
>> > > > > > DEBUG 1: Regridding observation precipitation(*,*) to the
>> > > verification
>> > > > > > grid.
>> > > > > > WARNING:
>> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and
observation valid
>> > > times
>> > > > do
>> > > > > > not match 20180821_000000 != 19700101_000000 for
APCP_03(*,*)
>> > versus
>> > > > > > precipitation(*,*).
>> > > > > > WARNING:
>> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
>> > > > > > DEBUG 1: Observation Field: precipitation at *,*
>> > > > > > DEBUG 2: Processing masking regions.
>> > > > > > DEBUG 2: Identifying objects in the forecast and
observation
>> > > fields...
>> > > > > > DEBUG 2: Computing contingency table statistics...
>> > > > > > DEBUG 2: Identified: 0 forecast objects and 0 observation
>> objects.
>> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
>> > > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
>> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0 observation
>> objects.
>> > > > > > DEBUG 2: Performing matching (MERGE_BOTH) between the
forecast
>> and
>> > > > > > observation fields.
>> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
>> > > > > >
>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
>> > > > > > DEBUG 1: Creating Contingency Table Statistics file:
>> > > > > >
>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
>> > > > > > DEBUG 1: Creating Object NetCDF file:
>> > > > > >
>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
>> > > > > > DEBUG 1: Loading forecast raw color table:
>> > > > > > /MET_V8/share/met//colortables/met_default.ctable
>> > > > > > DEBUG 1: Loading observation raw color table:
>> > > > > > /MET_V8/share/met//colortables/met_default.ctable
>> > > > > > DEBUG 1: Creating postscript file:
>> > > > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
>> > > > > >
>> > > > > > Am I doing some mistakes or the above warnings are
general due
>> to
>> > > > > > observation and fcst time mismatch.
>> > > > > > Kindly find the attachments for reference.
>> > > > > > Thanking You
>> > > > > > With Best Regards
>> > > > > > ________________________
>> > > > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > > > Asst. Prof., Mathematics
>> > > > > > *Kalinga Institute of Industrial Technology,*
>> > > > > > *Deemed to be University, Bhubaneswar*
>> > > > > > *Mobile- 09861182688*
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Wed Oct 24 12:26:45 2018
Biranchi,
I found this image showing 3B42 data for 20160229:
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
I grabbed the NetCDF file for that day and tried to plot it in MET.
But
the number of latitude values changed... 480 in recent data but 400 in
older data. So I updated the script to parse the lat/lon info on the
fly.
Also, I noticed that the picture in MET is upside down... compared to
the
NASA image. So I flipped it.
The updated script is attached as well as the image generated by this
command:
met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42_Daily.20160229.7.ps \
'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4 precipitation";' \
-plot_range 0 100
That should now match this image:
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
Thanks,
John
On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
> Sir,
> The new script works fine for both.
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala
<biranchimahala at gmail.com
> >
> wrote:
>
> > Sir,
> > Can you please brief how to compare the precipitation images with
NASA
> > plots.
> >
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
> >
> > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> >> Ah yes, there are more differences in these files.
> >>
> >> For some reason the Daily files store data in lon, lat order:
> >> float precipitation(lon, lat) ;
> >> While the 3-hourly files store data in lat, lon order:
> >> float precipitation(lat, lon) ;
> >>
> >> That's pretty frustrating! OK, I updated the script to check for
(lat,
> >> lon) versus (lon, lat) ordering... and take the transpose in the
latter
> >> case. I tested using these commands:
> >>
> >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42RT_Daily.20180821.7.ps \
> >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation";'
> >>
> >> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps \
> >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation";'
> >>
> >> I have attached the updated script and these 2 test images.
> >>
> >> However, it would be wise to independently verify that the precip
is in
> >> the
> >> right spot. Can you compare these images to NASA plots for the
same
> >> times?
> >>
> >> Thanks,
> >> John
> >>
> >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT <
> >> met_help at ucar.edu>
> >> wrote:
> >>
> >> >
> >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >> >
> >> > Sir,
> >> > The script works fine for
> >> > python read_3B42RT.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> >> > precipitation
> >> > But the output of the command;
> >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> >> > 'name="./read_3B42RT.py
> >> > ./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
> >> > shows the following;
> >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> >> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> >> > Variable Name : 'precipitation'
> >> > Data Shape: (1440, 480)
> >> > Data Type: dtype('float64')
> >> > Begin Time = 2018-08-20 22:30:00
> >> > End Time = 2018-08-21 01:30:00
> >> > Accum Time = 030000
> >> > Attributes: {'long_name': 'precipitation', 'init':
'20180821_013000',
> >> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25,
'lon_ll':
> >> -179.875,
> >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875,
'delta_lon':
> 0.25,
> >> > 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation',
'lead':
> '00',
> >> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> >> > DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
> >> > ERROR :
> >> > ERROR : DataPlane::two_to_one() -> range check error: (Nx, Ny)
=
> (480,
> >> > 1440), (x, y) = (480, 0)
> >> > ERROR :
> >> >
> >> > Thanking You
> >> > With Best Regards
> >> > ________________________
> >> > Dr. BIRANCHI KUMAR MAHALA
> >> > Asst. Prof., Mathematics
> >> > *Kalinga Institute of Industrial Technology,*
> >> > *Deemed to be University, Bhubaneswar*
> >> > *Mobile- 09861182688*
> >> >
> >> >
> >> >
> >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT <
> >> > met_help at ucar.edu> wrote:
> >> >
> >> > > Biranchi,
> >> > >
> >> > > Looking very closely at the 3B42RT NetCDF files and the error
> message
> >> > from
> >> > > that python script, it looks like the time formats are very
slightly
> >> > > different.
> >> > >
> >> > > The Daily files include microseconds:
> >> > > :BeginTime = "01:30:00.000Z" ;
> >> > > :EndTime = "01:29:59.999Z" ;
> >> > >
> >> > > The 3-hourly files do not:
> >> > > :BeginTime = "22:30:00Z" ;
> >> > > :EndTime = "01:30:00Z" ;
> >> > >
> >> > > Other than that, they're the same. So I created a new script
named
> >> > > "read_3B42RT.py" (see attached) which should handle both the
daily
> and
> >> > > 3-hourly files. I parses the times with or without the
microseconds
> >> > > included:
> >> > >
> >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
> >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation
> >> > >
> >> > > Hopefully that does the trick.
> >> > >
> >> > > Thanks,
> >> > > John
> >> > >
> >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT <
> >> > met_help at ucar.edu>
> >> > > wrote:
> >> > >
> >> > > >
> >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >> > > >
> >> > > > Sir,
> >> > > > The command:
> >> > > > python read_3B42RT_3hours.py
> >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> >> > > > precipitation
> >> > > > shows the following message:
> >> > > > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> >> > > > Variable Name : 'precipitation'
> >> > > > Data Shape: (1440, 480)
> >> > > > Data Type: dtype('float64')
> >> > > > Traceback (most recent call last):
> >> > > > File "read_3B42RT_3hours.py", line 49, in <module>
> >> > > > beg_time = dt.datetime.strptime(beg_time_str, "%Y-
%m-%d
> >> > > > %H:%M:%S.%fZ")
> >> > > > File "/usr/lib64/python2.7/_strptime.py", line 332, in
_strptime
> >> > > > (data_string, format))
> >> > > > ValueError: time data '2018-08-20 22:30:00Z' does not match
format
> >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> >> > > >
> >> > > > So I could not run mode ...
> >> > > > Thanking You
> >> > > > With Best Regards
> >> > > > ________________________
> >> > > > Dr. BIRANCHI KUMAR MAHALA
> >> > > > Asst. Prof., Mathematics
> >> > > > *Kalinga Institute of Industrial Technology,*
> >> > > > *Deemed to be University, Bhubaneswar*
> >> > > > *Mobile- 09861182688*
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT <
> >> > > > met_help at ucar.edu>
> >> > > > wrote:
> >> > > >
> >> > > > > So we worked together through the details of writing a
python
> >> script
> >> > > for
> >> > > > > reading the daily 3B42RT datasets.
> >> > > > >
> >> > > > > Now, you need to adapt that script for handling the 3-
hourly
> >> 3B42RT
> >> > > > data...
> >> > > > > let's say that you've done that and called it
> >> > "read_3B42RT_3hours.py".
> >> > > > You
> >> > > > > should use that Python script when running MODE, like
this:
> >> > > > >
> >> > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
./output/mode_analysis \
> >> > > > > -v 2
> >> > > > >
> >> > > > > And then in the MODE config file:
> >> > > > >
> >> > > > > fcst = {
> >> > > > > field = { name = "APCP_03"; level = "(*,*)"; }
> >> > > > > censor_thresh = [];
> >> > > > > censor_val = [];
> >> > > > > conv_radius = 60.0/grid_res; // in grid squares
> >> > > > > conv_thresh = >=5.0;
> >> > > > > vld_thresh = 0.5;
> >> > > > > filter_attr_name = [];
> >> > > > > filter_attr_thresh = [];
> >> > > > > merge_thresh = >=1.25;
> >> > > > > merge_flag = THRESH;
> >> > > > > }
> >> > > > > obs = fcst;
> >> > > > > obs = {
> >> > > > > field = { name="read_3B42RT_3hours.py
> >> read_3B42RT.2018082100.7.nc4
> >> > > > > precipitation"; }
> >> > > > > }
> >> > > > >
> >> > > > > Does that make sense?
> >> > > > >
> >> > > > > Thanks,
> >> > > > > John
> >> > > > >
> >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT <
> >> > > > met_help at ucar.edu
> >> > > > > >
> >> > > > > wrote:
> >> > > > >
> >> > > > > >
> >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted upon.
> >> > > > > > Transaction: Ticket created by biranchimahala at gmail.com
> >> > > > > > Queue: met_help
> >> > > > > > Subject: (No subject given)
> >> > > > > > Owner: Nobody
> >> > > > > > Requestors: biranchimahala at gmail.com
> >> > > > > > Status: new
> >> > > > > > Ticket <URL:
> >> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> >> > > > >
> >> > > > > >
> >> > > > > >
> >> > > > > > Sir,
> >> > > > > > I am able to run mode of MET-8.0 with the assistance of
> met_help
> >> > > team.
> >> > > > > > Now I am getting sum warnings while running mode as
follows.
> >> > > > > >
> >> > > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> >> > > > > ./output/mode_analysis/
> >> > > > > > -v 2
> >> > > > > >
> >> > > > > > DEBUG 1: Default Config File:
> >> > > > > /MET_V8/share/met//config/MODEConfig_default
> >> > > > > > DEBUG 1: Match Config File: MODEConfig_default
> >> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
> >> > > > > > WARNING:
> >> > > > > > WARNING: NcCfFile::open() -> could not determine the
valid
> time,
> >> > > using
> >> > > > 0.
> >> > > > > > WARNING:
> >> > > > > > DEBUG 1: Forecast File:
> >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> >> > > > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> >> > > > > > DEBUG 1: Regridding observation precipitation(*,*) to
the
> >> > > verification
> >> > > > > > grid.
> >> > > > > > WARNING:
> >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and
observation
> valid
> >> > > times
> >> > > > do
> >> > > > > > not match 20180821_000000 != 19700101_000000 for
APCP_03(*,*)
> >> > versus
> >> > > > > > precipitation(*,*).
> >> > > > > > WARNING:
> >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> >> > > > > > DEBUG 1: Observation Field: precipitation at *,*
> >> > > > > > DEBUG 2: Processing masking regions.
> >> > > > > > DEBUG 2: Identifying objects in the forecast and
observation
> >> > > fields...
> >> > > > > > DEBUG 2: Computing contingency table statistics...
> >> > > > > > DEBUG 2: Identified: 0 forecast objects and 0
observation
> >> objects.
> >> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
> >> > > > > > DEBUG 2: Performing merging (THRESH) in the observation
field.
> >> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0
observation
> >> objects.
> >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH) between the
forecast
> >> and
> >> > > > > > observation fields.
> >> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> >> > > > > >
> >> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> >> > > > > > DEBUG 1: Creating Contingency Table Statistics file:
> >> > > > > >
> >> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> >> > > > > > DEBUG 1: Creating Object NetCDF file:
> >> > > > > >
> >> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> >> > > > > > DEBUG 1: Loading forecast raw color table:
> >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> >> > > > > > DEBUG 1: Loading observation raw color table:
> >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> >> > > > > > DEBUG 1: Creating postscript file:
> >> > > > > >
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> >> > > > > >
> >> > > > > > Am I doing some mistakes or the above warnings are
general due
> >> to
> >> > > > > > observation and fcst time mismatch.
> >> > > > > > Kindly find the attachments for reference.
> >> > > > > > Thanking You
> >> > > > > > With Best Regards
> >> > > > > > ________________________
> >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> >> > > > > > Asst. Prof., Mathematics
> >> > > > > > *Kalinga Institute of Industrial Technology,*
> >> > > > > > *Deemed to be University, Bhubaneswar*
> >> > > > > > *Mobile- 09861182688*
> >> > > > > >
> >> > > > > >
> >> > > > >
> >> > > > >
> >> > > >
> >> > > >
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Sat Oct 27 03:12:51 2018
Sir,
Now it works.
I have another query as below.
I am trying to run pcp_combine tool to find the APCP by running the
command;
pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
APCP_24h_00utc15Aug2018.nc -pcpdir ./
The output of the above command shows the following ;
DEBUG 1: Reading input file: wrfprs_d02.120
WARNING:
WARNING: MetGrib1DataFile::data_plane() -> No exact match found for
VarInfo
"APCP/A120" in GRIB file "wrfprs_d02.120".
WARNING:
ERROR :
ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
ERROR :
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Biranchi,
>
> I found this image showing 3B42 data for 20160229:
>
>
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
>
> I grabbed the NetCDF file for that day and tried to plot it in MET.
But
> the number of latitude values changed... 480 in recent data but 400
in
> older data. So I updated the script to parse the lat/lon info on
the fly.
> Also, I noticed that the picture in MET is upside down... compared
to the
> NASA image. So I flipped it.
>
> The updated script is attached as well as the image generated by
this
> command:
>
> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42_Daily.20160229.7.ps \
> 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4 precipitation";' \
> -plot_range 0 100
>
> That should now match this image:
>
>
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
>
> Thanks,
> John
>
> On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >
> > Sir,
> > The new script works fine for both.
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
> >
> > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
> biranchimahala at gmail.com
> > >
> > wrote:
> >
> > > Sir,
> > > Can you please brief how to compare the precipitation images
with NASA
> > > plots.
> > >
> > > Thanking You
> > > With Best Regards
> > > ________________________
> > > Dr. BIRANCHI KUMAR MAHALA
> > > Asst. Prof., Mathematics
> > > *Kalinga Institute of Industrial Technology,*
> > > *Deemed to be University, Bhubaneswar*
> > > *Mobile- 09861182688*
> > >
> > >
> > >
> > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > >> Ah yes, there are more differences in these files.
> > >>
> > >> For some reason the Daily files store data in lon, lat order:
> > >> float precipitation(lon, lat) ;
> > >> While the 3-hourly files store data in lat, lon order:
> > >> float precipitation(lat, lon) ;
> > >>
> > >> That's pretty frustrating! OK, I updated the script to check
for
> (lat,
> > >> lon) versus (lon, lat) ordering... and take the transpose in
the
> latter
> > >> case. I tested using these commands:
> > >>
> > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42RT_Daily.20180821.7.ps \
> > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation";'
> > >>
> > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
\
> > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
precipitation";'
> > >>
> > >> I have attached the updated script and these 2 test images.
> > >>
> > >> However, it would be wise to independently verify that the
precip is
> in
> > >> the
> > >> right spot. Can you compare these images to NASA plots for the
same
> > >> times?
> > >>
> > >> Thanks,
> > >> John
> > >>
> > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT <
> > >> met_help at ucar.edu>
> > >> wrote:
> > >>
> > >> >
> > >> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>
> > >> >
> > >> > Sir,
> > >> > The script works fine for
> > >> > python read_3B42RT.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> > >> > precipitation
> > >> > But the output of the command;
> > >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > >> > 'name="./read_3B42RT.py
> > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
> > >> > shows the following;
> > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > >> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > >> > Variable Name : 'precipitation'
> > >> > Data Shape: (1440, 480)
> > >> > Data Type: dtype('float64')
> > >> > Begin Time = 2018-08-20 22:30:00
> > >> > End Time = 2018-08-21 01:30:00
> > >> > Accum Time = 030000
> > >> > Attributes: {'long_name': 'precipitation', 'init':
> '20180821_013000',
> > >> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25,
'lon_ll':
> > >> -179.875,
> > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875,
'delta_lon':
> > 0.25,
> > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation',
'lead':
> > '00',
> > >> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> > >> > DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
> > >> > ERROR :
> > >> > ERROR : DataPlane::two_to_one() -> range check error: (Nx,
Ny) =
> > (480,
> > >> > 1440), (x, y) = (480, 0)
> > >> > ERROR :
> > >> >
> > >> > Thanking You
> > >> > With Best Regards
> > >> > ________________________
> > >> > Dr. BIRANCHI KUMAR MAHALA
> > >> > Asst. Prof., Mathematics
> > >> > *Kalinga Institute of Industrial Technology,*
> > >> > *Deemed to be University, Bhubaneswar*
> > >> > *Mobile- 09861182688*
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT <
> > >> > met_help at ucar.edu> wrote:
> > >> >
> > >> > > Biranchi,
> > >> > >
> > >> > > Looking very closely at the 3B42RT NetCDF files and the
error
> > message
> > >> > from
> > >> > > that python script, it looks like the time formats are very
> slightly
> > >> > > different.
> > >> > >
> > >> > > The Daily files include microseconds:
> > >> > > :BeginTime = "01:30:00.000Z" ;
> > >> > > :EndTime = "01:29:59.999Z" ;
> > >> > >
> > >> > > The 3-hourly files do not:
> > >> > > :BeginTime = "22:30:00Z" ;
> > >> > > :EndTime = "01:30:00Z" ;
> > >> > >
> > >> > > Other than that, they're the same. So I created a new
script
> named
> > >> > > "read_3B42RT.py" (see attached) which should handle both
the daily
> > and
> > >> > > 3-hourly files. I parses the times with or without the
> microseconds
> > >> > > included:
> > >> > >
> > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4 precipitation
> > >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation
> > >> > >
> > >> > > Hopefully that does the trick.
> > >> > >
> > >> > > Thanks,
> > >> > > John
> > >> > >
> > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT <
> > >> > met_help at ucar.edu>
> > >> > > wrote:
> > >> > >
> > >> > > >
> > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > >> > > >
> > >> > > > Sir,
> > >> > > > The command:
> > >> > > > python read_3B42RT_3hours.py
> > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > >> > > > precipitation
> > >> > > > shows the following message:
> > >> > > > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > >> > > > Variable Name : 'precipitation'
> > >> > > > Data Shape: (1440, 480)
> > >> > > > Data Type: dtype('float64')
> > >> > > > Traceback (most recent call last):
> > >> > > > File "read_3B42RT_3hours.py", line 49, in <module>
> > >> > > > beg_time = dt.datetime.strptime(beg_time_str,
"%Y-%m-%d
> > >> > > > %H:%M:%S.%fZ")
> > >> > > > File "/usr/lib64/python2.7/_strptime.py", line 332, in
> _strptime
> > >> > > > (data_string, format))
> > >> > > > ValueError: time data '2018-08-20 22:30:00Z' does not
match
> format
> > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > >> > > >
> > >> > > > So I could not run mode ...
> > >> > > > Thanking You
> > >> > > > With Best Regards
> > >> > > > ________________________
> > >> > > > Dr. BIRANCHI KUMAR MAHALA
> > >> > > > Asst. Prof., Mathematics
> > >> > > > *Kalinga Institute of Industrial Technology,*
> > >> > > > *Deemed to be University, Bhubaneswar*
> > >> > > > *Mobile- 09861182688*
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via RT
<
> > >> > > > met_help at ucar.edu>
> > >> > > > wrote:
> > >> > > >
> > >> > > > > So we worked together through the details of writing a
python
> > >> script
> > >> > > for
> > >> > > > > reading the daily 3B42RT datasets.
> > >> > > > >
> > >> > > > > Now, you need to adapt that script for handling the 3-
hourly
> > >> 3B42RT
> > >> > > > data...
> > >> > > > > let's say that you've done that and called it
> > >> > "read_3B42RT_3hours.py".
> > >> > > > You
> > >> > > > > should use that Python script when running MODE, like
this:
> > >> > > > >
> > >> > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
> ./output/mode_analysis \
> > >> > > > > -v 2
> > >> > > > >
> > >> > > > > And then in the MODE config file:
> > >> > > > >
> > >> > > > > fcst = {
> > >> > > > > field = { name = "APCP_03"; level = "(*,*)"; }
> > >> > > > > censor_thresh = [];
> > >> > > > > censor_val = [];
> > >> > > > > conv_radius = 60.0/grid_res; // in grid
squares
> > >> > > > > conv_thresh = >=5.0;
> > >> > > > > vld_thresh = 0.5;
> > >> > > > > filter_attr_name = [];
> > >> > > > > filter_attr_thresh = [];
> > >> > > > > merge_thresh = >=1.25;
> > >> > > > > merge_flag = THRESH;
> > >> > > > > }
> > >> > > > > obs = fcst;
> > >> > > > > obs = {
> > >> > > > > field = { name="read_3B42RT_3hours.py
> > >> read_3B42RT.2018082100.7.nc4
> > >> > > > > precipitation"; }
> > >> > > > > }
> > >> > > > >
> > >> > > > > Does that make sense?
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > John
> > >> > > > >
> > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via RT
<
> > >> > > > met_help at ucar.edu
> > >> > > > > >
> > >> > > > > wrote:
> > >> > > > >
> > >> > > > > >
> > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted
upon.
> > >> > > > > > Transaction: Ticket created by
biranchimahala at gmail.com
> > >> > > > > > Queue: met_help
> > >> > > > > > Subject: (No subject given)
> > >> > > > > > Owner: Nobody
> > >> > > > > > Requestors: biranchimahala at gmail.com
> > >> > > > > > Status: new
> > >> > > > > > Ticket <URL:
> > >> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > >> > > > >
> > >> > > > > >
> > >> > > > > >
> > >> > > > > > Sir,
> > >> > > > > > I am able to run mode of MET-8.0 with the assistance
of
> > met_help
> > >> > > team.
> > >> > > > > > Now I am getting sum warnings while running mode as
follows.
> > >> > > > > >
> > >> > > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> > >> > > > > ./output/mode_analysis/
> > >> > > > > > -v 2
> > >> > > > > >
> > >> > > > > > DEBUG 1: Default Config File:
> > >> > > > > /MET_V8/share/met//config/MODEConfig_default
> > >> > > > > > DEBUG 1: Match Config File: MODEConfig_default
> > >> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
> > >> > > > > > WARNING:
> > >> > > > > > WARNING: NcCfFile::open() -> could not determine the
valid
> > time,
> > >> > > using
> > >> > > > 0.
> > >> > > > > > WARNING:
> > >> > > > > > DEBUG 1: Forecast File:
> > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > >> > > > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > >> > > > > > DEBUG 1: Regridding observation precipitation(*,*) to
the
> > >> > > verification
> > >> > > > > > grid.
> > >> > > > > > WARNING:
> > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and
observation
> > valid
> > >> > > times
> > >> > > > do
> > >> > > > > > not match 20180821_000000 != 19700101_000000 for
> APCP_03(*,*)
> > >> > versus
> > >> > > > > > precipitation(*,*).
> > >> > > > > > WARNING:
> > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > >> > > > > > DEBUG 1: Observation Field: precipitation at *,*
> > >> > > > > > DEBUG 2: Processing masking regions.
> > >> > > > > > DEBUG 2: Identifying objects in the forecast and
observation
> > >> > > fields...
> > >> > > > > > DEBUG 2: Computing contingency table statistics...
> > >> > > > > > DEBUG 2: Identified: 0 forecast objects and 0
observation
> > >> objects.
> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the forecast
field.
> > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
> field.
> > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0
observation
> > >> objects.
> > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH) between the
> forecast
> > >> and
> > >> > > > > > observation fields.
> > >> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> > >> > > > > >
> > >> >
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > >> > > > > > DEBUG 1: Creating Contingency Table Statistics file:
> > >> > > > > >
> > >> >
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > >> > > > > > DEBUG 1: Creating Object NetCDF file:
> > >> > > > > >
> > >> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > >> > > > > > DEBUG 1: Loading forecast raw color table:
> > >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > >> > > > > > DEBUG 1: Loading observation raw color table:
> > >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > >> > > > > > DEBUG 1: Creating postscript file:
> > >> > > > > >
> > ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > >> > > > > >
> > >> > > > > > Am I doing some mistakes or the above warnings are
general
> due
> > >> to
> > >> > > > > > observation and fcst time mismatch.
> > >> > > > > > Kindly find the attachments for reference.
> > >> > > > > > Thanking You
> > >> > > > > > With Best Regards
> > >> > > > > > ________________________
> > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > >> > > > > > Asst. Prof., Mathematics
> > >> > > > > > *Kalinga Institute of Industrial Technology,*
> > >> > > > > > *Deemed to be University, Bhubaneswar*
> > >> > > > > > *Mobile- 09861182688*
> > >> > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> > >
> > >> >
> > >> >
> > >>
> > >>
> >
> >
>
>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Mon Oct 29 10:01:07 2018
Dr. Biranchi,
So you've seen the following error from pcp_combine:
ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
The most likely explanation is that the input file (wrfprs_d02.120)
really
does not contain a record for 120-hour accumulated precipitation.
If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2) tools
available,
please use them to inventory this file and check what precip
accumulation
actually is available:
* wgrib **wrfprs_d02.120 | grep APCP*
Thanks,
John
On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
> Sir,
> Now it works.
> I have another query as below.
> I am trying to run pcp_combine tool to find the APCP by running the
> command;
> pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
> APCP_24h_00utc15Aug2018.nc -pcpdir ./
> The output of the above command shows the following ;
> DEBUG 1: Reading input file: wrfprs_d02.120
> WARNING:
> WARNING: MetGrib1DataFile::data_plane() -> No exact match found for
VarInfo
> "APCP/A120" in GRIB file "wrfprs_d02.120".
> WARNING:
> ERROR :
> ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
> ERROR :
>
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Biranchi,
> >
> > I found this image showing 3B42 data for 20160229:
> >
> >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> >
> > I grabbed the NetCDF file for that day and tried to plot it in
MET. But
> > the number of latitude values changed... 480 in recent data but
400 in
> > older data. So I updated the script to parse the lat/lon info on
the
> fly.
> > Also, I noticed that the picture in MET is upside down... compared
to the
> > NASA image. So I flipped it.
> >
> > The updated script is attached as well as the image generated by
this
> > command:
> >
> > met-8.0/bin/plot_data_plane PYTHON_NUMPY 3B42_Daily.20160229.7.ps
\
> > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4 precipitation";'
\
> > -plot_range 0 100
> >
> > That should now match this image:
> >
> >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> >
> > Thanks,
> > John
> >
> > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > >
> > > Sir,
> > > The new script works fine for both.
> > > Thanking You
> > > With Best Regards
> > > ________________________
> > > Dr. BIRANCHI KUMAR MAHALA
> > > Asst. Prof., Mathematics
> > > *Kalinga Institute of Industrial Technology,*
> > > *Deemed to be University, Bhubaneswar*
> > > *Mobile- 09861182688*
> > >
> > >
> > >
> > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
> > biranchimahala at gmail.com
> > > >
> > > wrote:
> > >
> > > > Sir,
> > > > Can you please brief how to compare the precipitation images
with
> NASA
> > > > plots.
> > > >
> > > > Thanking You
> > > > With Best Regards
> > > > ________________________
> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > Asst. Prof., Mathematics
> > > > *Kalinga Institute of Industrial Technology,*
> > > > *Deemed to be University, Bhubaneswar*
> > > > *Mobile- 09861182688*
> > > >
> > > >
> > > >
> > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > >> Ah yes, there are more differences in these files.
> > > >>
> > > >> For some reason the Daily files store data in lon, lat order:
> > > >> float precipitation(lon, lat) ;
> > > >> While the 3-hourly files store data in lat, lon order:
> > > >> float precipitation(lat, lon) ;
> > > >>
> > > >> That's pretty frustrating! OK, I updated the script to check
for
> > (lat,
> > > >> lon) versus (lon, lat) ordering... and take the transpose in
the
> > latter
> > > >> case. I tested using these commands:
> > > >>
> > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42RT_Daily.20180821.7.ps
> \
> > > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> precipitation";'
> > > >>
> > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42RT.2018082100.7.ps \
> > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
precipitation";'
> > > >>
> > > >> I have attached the updated script and these 2 test images.
> > > >>
> > > >> However, it would be wise to independently verify that the
precip is
> > in
> > > >> the
> > > >> right spot. Can you compare these images to NASA plots for
the same
> > > >> times?
> > > >>
> > > >> Thanks,
> > > >> John
> > > >>
> > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT <
> > > >> met_help at ucar.edu>
> > > >> wrote:
> > > >>
> > > >> >
> > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > > >> >
> > > >> > Sir,
> > > >> > The script works fine for
> > > >> > python read_3B42RT.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> > > >> > precipitation
> > > >> > But the output of the command;
> > > >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > > >> > 'name="./read_3B42RT.py
> > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4 precipitation";'
> > > >> > shows the following;
> > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > >> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > > >> > Variable Name : 'precipitation'
> > > >> > Data Shape: (1440, 480)
> > > >> > Data Type: dtype('float64')
> > > >> > Begin Time = 2018-08-20 22:30:00
> > > >> > End Time = 2018-08-21 01:30:00
> > > >> > Accum Time = 030000
> > > >> > Attributes: {'long_name': 'precipitation', 'init':
> > '20180821_013000',
> > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25,
'lon_ll':
> > > >> -179.875,
> > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875,
'delta_lon':
> > > 0.25,
> > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation',
'lead':
> > > '00',
> > > >> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> > > >> > DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
> > > >> > ERROR :
> > > >> > ERROR : DataPlane::two_to_one() -> range check error: (Nx,
Ny) =
> > > (480,
> > > >> > 1440), (x, y) = (480, 0)
> > > >> > ERROR :
> > > >> >
> > > >> > Thanking You
> > > >> > With Best Regards
> > > >> > ________________________
> > > >> > Dr. BIRANCHI KUMAR MAHALA
> > > >> > Asst. Prof., Mathematics
> > > >> > *Kalinga Institute of Industrial Technology,*
> > > >> > *Deemed to be University, Bhubaneswar*
> > > >> > *Mobile- 09861182688*
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via RT
<
> > > >> > met_help at ucar.edu> wrote:
> > > >> >
> > > >> > > Biranchi,
> > > >> > >
> > > >> > > Looking very closely at the 3B42RT NetCDF files and the
error
> > > message
> > > >> > from
> > > >> > > that python script, it looks like the time formats are
very
> > slightly
> > > >> > > different.
> > > >> > >
> > > >> > > The Daily files include microseconds:
> > > >> > > :BeginTime = "01:30:00.000Z" ;
> > > >> > > :EndTime = "01:29:59.999Z" ;
> > > >> > >
> > > >> > > The 3-hourly files do not:
> > > >> > > :BeginTime = "22:30:00Z" ;
> > > >> > > :EndTime = "01:30:00Z" ;
> > > >> > >
> > > >> > > Other than that, they're the same. So I created a new
script
> > named
> > > >> > > "read_3B42RT.py" (see attached) which should handle both
the
> daily
> > > and
> > > >> > > 3-hourly files. I parses the times with or without the
> > microseconds
> > > >> > > included:
> > > >> > >
> > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
precipitation
> > > >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
precipitation
> > > >> > >
> > > >> > > Hopefully that does the trick.
> > > >> > >
> > > >> > > Thanks,
> > > >> > > John
> > > >> > >
> > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT <
> > > >> > met_help at ucar.edu>
> > > >> > > wrote:
> > > >> > >
> > > >> > > >
> > > >> > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> >
> > > >> > > >
> > > >> > > > Sir,
> > > >> > > > The command:
> > > >> > > > python read_3B42RT_3hours.py
> > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > >> > > > precipitation
> > > >> > > > shows the following message:
> > > >> > > > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > >> > > > Variable Name : 'precipitation'
> > > >> > > > Data Shape: (1440, 480)
> > > >> > > > Data Type: dtype('float64')
> > > >> > > > Traceback (most recent call last):
> > > >> > > > File "read_3B42RT_3hours.py", line 49, in <module>
> > > >> > > > beg_time = dt.datetime.strptime(beg_time_str,
> "%Y-%m-%d
> > > >> > > > %H:%M:%S.%fZ")
> > > >> > > > File "/usr/lib64/python2.7/_strptime.py", line 332,
in
> > _strptime
> > > >> > > > (data_string, format))
> > > >> > > > ValueError: time data '2018-08-20 22:30:00Z' does not
match
> > format
> > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > > >> > > >
> > > >> > > > So I could not run mode ...
> > > >> > > > Thanking You
> > > >> > > > With Best Regards
> > > >> > > > ________________________
> > > >> > > > Dr. BIRANCHI KUMAR MAHALA
> > > >> > > > Asst. Prof., Mathematics
> > > >> > > > *Kalinga Institute of Industrial Technology,*
> > > >> > > > *Deemed to be University, Bhubaneswar*
> > > >> > > > *Mobile- 09861182688*
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway via
RT <
> > > >> > > > met_help at ucar.edu>
> > > >> > > > wrote:
> > > >> > > >
> > > >> > > > > So we worked together through the details of writing
a
> python
> > > >> script
> > > >> > > for
> > > >> > > > > reading the daily 3B42RT datasets.
> > > >> > > > >
> > > >> > > > > Now, you need to adapt that script for handling the
3-hourly
> > > >> 3B42RT
> > > >> > > > data...
> > > >> > > > > let's say that you've done that and called it
> > > >> > "read_3B42RT_3hours.py".
> > > >> > > > You
> > > >> > > > > should use that Python script when running MODE, like
this:
> > > >> > > > >
> > > >> > > > > mode ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
\
> > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
> > ./output/mode_analysis \
> > > >> > > > > -v 2
> > > >> > > > >
> > > >> > > > > And then in the MODE config file:
> > > >> > > > >
> > > >> > > > > fcst = {
> > > >> > > > > field = { name = "APCP_03"; level = "(*,*)"; }
> > > >> > > > > censor_thresh = [];
> > > >> > > > > censor_val = [];
> > > >> > > > > conv_radius = 60.0/grid_res; // in grid
squares
> > > >> > > > > conv_thresh = >=5.0;
> > > >> > > > > vld_thresh = 0.5;
> > > >> > > > > filter_attr_name = [];
> > > >> > > > > filter_attr_thresh = [];
> > > >> > > > > merge_thresh = >=1.25;
> > > >> > > > > merge_flag = THRESH;
> > > >> > > > > }
> > > >> > > > > obs = fcst;
> > > >> > > > > obs = {
> > > >> > > > > field = { name="read_3B42RT_3hours.py
> > > >> read_3B42RT.2018082100.7.nc4
> > > >> > > > > precipitation"; }
> > > >> > > > > }
> > > >> > > > >
> > > >> > > > > Does that make sense?
> > > >> > > > >
> > > >> > > > > Thanks,
> > > >> > > > > John
> > > >> > > > >
> > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala via
RT <
> > > >> > > > met_help at ucar.edu
> > > >> > > > > >
> > > >> > > > > wrote:
> > > >> > > > >
> > > >> > > > > >
> > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted
upon.
> > > >> > > > > > Transaction: Ticket created by
biranchimahala at gmail.com
> > > >> > > > > > Queue: met_help
> > > >> > > > > > Subject: (No subject given)
> > > >> > > > > > Owner: Nobody
> > > >> > > > > > Requestors: biranchimahala at gmail.com
> > > >> > > > > > Status: new
> > > >> > > > > > Ticket <URL:
> > > >> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > >> > > > >
> > > >> > > > > >
> > > >> > > > > >
> > > >> > > > > > Sir,
> > > >> > > > > > I am able to run mode of MET-8.0 with the
assistance of
> > > met_help
> > > >> > > team.
> > > >> > > > > > Now I am getting sum warnings while running mode as
> follows.
> > > >> > > > > >
> > > >> > > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default -outdir
> > > >> > > > > ./output/mode_analysis/
> > > >> > > > > > -v 2
> > > >> > > > > >
> > > >> > > > > > DEBUG 1: Default Config File:
> > > >> > > > > /MET_V8/share/met//config/MODEConfig_default
> > > >> > > > > > DEBUG 1: Match Config File: MODEConfig_default
> > > >> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
> > > >> > > > > > WARNING:
> > > >> > > > > > WARNING: NcCfFile::open() -> could not determine
the valid
> > > time,
> > > >> > > using
> > > >> > > > 0.
> > > >> > > > > > WARNING:
> > > >> > > > > > DEBUG 1: Forecast File:
> > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > >> > > > > > DEBUG 1: Observation File: 3B42RT.2018082100.7.nc4
> > > >> > > > > > DEBUG 1: Regridding observation precipitation(*,*)
to the
> > > >> > > verification
> > > >> > > > > > grid.
> > > >> > > > > > WARNING:
> > > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and
observation
> > > valid
> > > >> > > times
> > > >> > > > do
> > > >> > > > > > not match 20180821_000000 != 19700101_000000 for
> > APCP_03(*,*)
> > > >> > versus
> > > >> > > > > > precipitation(*,*).
> > > >> > > > > > WARNING:
> > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > >> > > > > > DEBUG 1: Observation Field: precipitation at *,*
> > > >> > > > > > DEBUG 2: Processing masking regions.
> > > >> > > > > > DEBUG 2: Identifying objects in the forecast and
> observation
> > > >> > > fields...
> > > >> > > > > > DEBUG 2: Computing contingency table statistics...
> > > >> > > > > > DEBUG 2: Identified: 0 forecast objects and 0
observation
> > > >> objects.
> > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> field.
> > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
> > field.
> > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0
observation
> > > >> objects.
> > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH) between
the
> > forecast
> > > >> and
> > > >> > > > > > observation fields.
> > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics file:
> > > >> > > > > >
> > > >> >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > >> > > > > > DEBUG 1: Creating Contingency Table Statistics
file:
> > > >> > > > > >
> > > >> >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
> > > >> > > > > >
> > > >> >
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > >> > > > > > DEBUG 1: Loading forecast raw color table:
> > > >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > >> > > > > > DEBUG 1: Loading observation raw color table:
> > > >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > >> > > > > > DEBUG 1: Creating postscript file:
> > > >> > > > > >
> > > ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > >> > > > > >
> > > >> > > > > > Am I doing some mistakes or the above warnings are
general
> > due
> > > >> to
> > > >> > > > > > observation and fcst time mismatch.
> > > >> > > > > > Kindly find the attachments for reference.
> > > >> > > > > > Thanking You
> > > >> > > > > > With Best Regards
> > > >> > > > > > ________________________
> > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > >> > > > > > Asst. Prof., Mathematics
> > > >> > > > > > *Kalinga Institute of Industrial Technology,*
> > > >> > > > > > *Deemed to be University, Bhubaneswar*
> > > >> > > > > > *Mobile- 09861182688*
> > > >> > > > > >
> > > >> > > > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> > >
> > > >> >
> > > >> >
> > > >>
> > > >>
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Mon Oct 29 11:28:04 2018
Sir,
* wgrib **wrfprs_d02.120 | grep APCP* command shows the following;
bash: AerosolCoeff.bin: command not found...
whreas the command
wgrib wrfprs_d02.120 | grep APCP
shows the following;
310:20113176:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=120:TimeU=1:sfc:0-
120hr
acc:NAve=0
Also
wgrib wrfprs_d02.96 | grep APCP
shows the following;
310:19992520:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=96:TimeU=1:sfc:0-
96hr
acc:NAve=0
For information.
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Mon, Oct 29, 2018 at 9:31 PM John Halley Gotway via RT
<met_help at ucar.edu>
wrote:
> Dr. Biranchi,
>
> So you've seen the following error from pcp_combine:
> ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
>
> The most likely explanation is that the input file (wrfprs_d02.120)
really
> does not contain a record for 120-hour accumulated precipitation.
>
> If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2) tools
available,
> please use them to inventory this file and check what precip
accumulation
> actually is available:
> * wgrib **wrfprs_d02.120 | grep APCP*
>
> Thanks,
> John
>
> On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT
<met_help at ucar.edu>
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >
> > Sir,
> > Now it works.
> > I have another query as below.
> > I am trying to run pcp_combine tool to find the APCP by running
the
> > command;
> > pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
> > APCP_24h_00utc15Aug2018.nc -pcpdir ./
> > The output of the above command shows the following ;
> > DEBUG 1: Reading input file: wrfprs_d02.120
> > WARNING:
> > WARNING: MetGrib1DataFile::data_plane() -> No exact match found
for
> VarInfo
> > "APCP/A120" in GRIB file "wrfprs_d02.120".
> > WARNING:
> > ERROR :
> > ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
> > ERROR :
> >
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
> >
> > On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT <
> > met_help at ucar.edu> wrote:
> >
> > > Biranchi,
> > >
> > > I found this image showing 3B42 data for 20160229:
> > >
> > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > >
> > > I grabbed the NetCDF file for that day and tried to plot it in
MET.
> But
> > > the number of latitude values changed... 480 in recent data but
400 in
> > > older data. So I updated the script to parse the lat/lon info
on the
> > fly.
> > > Also, I noticed that the picture in MET is upside down...
compared to
> the
> > > NASA image. So I flipped it.
> > >
> > > The updated script is attached as well as the image generated by
this
> > > command:
> > >
> > > met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42_Daily.20160229.7.ps \
> > > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4
precipitation";' \
> > > -plot_range 0 100
> > >
> > > That should now match this image:
> > >
> > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > >
> > > Thanks,
> > > John
> > >
> > > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT <
> > met_help at ucar.edu
> > > >
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>
> > > >
> > > > Sir,
> > > > The new script works fine for both.
> > > > Thanking You
> > > > With Best Regards
> > > > ________________________
> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > Asst. Prof., Mathematics
> > > > *Kalinga Institute of Industrial Technology,*
> > > > *Deemed to be University, Bhubaneswar*
> > > > *Mobile- 09861182688*
> > > >
> > > >
> > > >
> > > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
> > > biranchimahala at gmail.com
> > > > >
> > > > wrote:
> > > >
> > > > > Sir,
> > > > > Can you please brief how to compare the precipitation images
with
> > NASA
> > > > > plots.
> > > > >
> > > > > Thanking You
> > > > > With Best Regards
> > > > > ________________________
> > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > Asst. Prof., Mathematics
> > > > > *Kalinga Institute of Industrial Technology,*
> > > > > *Deemed to be University, Bhubaneswar*
> > > > > *Mobile- 09861182688*
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > >> Ah yes, there are more differences in these files.
> > > > >>
> > > > >> For some reason the Daily files store data in lon, lat
order:
> > > > >> float precipitation(lon, lat) ;
> > > > >> While the 3-hourly files store data in lat, lon order:
> > > > >> float precipitation(lat, lon) ;
> > > > >>
> > > > >> That's pretty frustrating! OK, I updated the script to
check for
> > > (lat,
> > > > >> lon) versus (lon, lat) ordering... and take the transpose
in the
> > > latter
> > > > >> case. I tested using these commands:
> > > > >>
> > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
> 3B42RT_Daily.20180821.7.ps
> > \
> > > > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > precipitation";'
> > > > >>
> > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42RT.2018082100.7.ps \
> > > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
precipitation";'
> > > > >>
> > > > >> I have attached the updated script and these 2 test images.
> > > > >>
> > > > >> However, it would be wise to independently verify that the
precip
> is
> > > in
> > > > >> the
> > > > >> right spot. Can you compare these images to NASA plots for
the
> same
> > > > >> times?
> > > > >>
> > > > >> Thanks,
> > > > >> John
> > > > >>
> > > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT <
> > > > >> met_help at ucar.edu>
> > > > >> wrote:
> > > > >>
> > > > >> >
> > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > > > >> >
> > > > >> > Sir,
> > > > >> > The script works fine for
> > > > >> > python read_3B42RT.py
./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > >> > precipitation
> > > > >> > But the output of the command;
> > > > >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > > > >> > 'name="./read_3B42RT.py
> > > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4
precipitation";'
> > > > >> > shows the following;
> > > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > > >> > Input File: './input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > >> > Variable Name : 'precipitation'
> > > > >> > Data Shape: (1440, 480)
> > > > >> > Data Type: dtype('float64')
> > > > >> > Begin Time = 2018-08-20 22:30:00
> > > > >> > End Time = 2018-08-21 01:30:00
> > > > >> > Accum Time = 030000
> > > > >> > Attributes: {'long_name': 'precipitation', 'init':
> > > '20180821_013000',
> > > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25,
> 'lon_ll':
> > > > >> -179.875,
> > > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875,
> 'delta_lon':
> > > > 0.25,
> > > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name': 'precipitation',
> 'lead':
> > > > '00',
> > > > >> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> > > > >> > DEBUG 1: Creating postscript file: 3B42RT.2018082100.7.ps
> > > > >> > ERROR :
> > > > >> > ERROR : DataPlane::two_to_one() -> range check error:
(Nx, Ny)
> =
> > > > (480,
> > > > >> > 1440), (x, y) = (480, 0)
> > > > >> > ERROR :
> > > > >> >
> > > > >> > Thanking You
> > > > >> > With Best Regards
> > > > >> > ________________________
> > > > >> > Dr. BIRANCHI KUMAR MAHALA
> > > > >> > Asst. Prof., Mathematics
> > > > >> > *Kalinga Institute of Industrial Technology,*
> > > > >> > *Deemed to be University, Bhubaneswar*
> > > > >> > *Mobile- 09861182688*
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via
RT <
> > > > >> > met_help at ucar.edu> wrote:
> > > > >> >
> > > > >> > > Biranchi,
> > > > >> > >
> > > > >> > > Looking very closely at the 3B42RT NetCDF files and the
error
> > > > message
> > > > >> > from
> > > > >> > > that python script, it looks like the time formats are
very
> > > slightly
> > > > >> > > different.
> > > > >> > >
> > > > >> > > The Daily files include microseconds:
> > > > >> > > :BeginTime = "01:30:00.000Z" ;
> > > > >> > > :EndTime = "01:29:59.999Z" ;
> > > > >> > >
> > > > >> > > The 3-hourly files do not:
> > > > >> > > :BeginTime = "22:30:00Z" ;
> > > > >> > > :EndTime = "01:30:00Z" ;
> > > > >> > >
> > > > >> > > Other than that, they're the same. So I created a new
script
> > > named
> > > > >> > > "read_3B42RT.py" (see attached) which should handle
both the
> > daily
> > > > and
> > > > >> > > 3-hourly files. I parses the times with or without the
> > > microseconds
> > > > >> > > included:
> > > > >> > >
> > > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
precipitation
> > > > >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> precipitation
> > > > >> > >
> > > > >> > > Hopefully that does the trick.
> > > > >> > >
> > > > >> > > Thanks,
> > > > >> > > John
> > > > >> > >
> > > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via RT
<
> > > > >> > met_help at ucar.edu>
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > >
> > > > >> > > > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > >
> > > > >> > > >
> > > > >> > > > Sir,
> > > > >> > > > The command:
> > > > >> > > > python read_3B42RT_3hours.py
> > > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > >> > > > precipitation
> > > > >> > > > shows the following message:
> > > > >> > > > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > >> > > > Variable Name : 'precipitation'
> > > > >> > > > Data Shape: (1440, 480)
> > > > >> > > > Data Type: dtype('float64')
> > > > >> > > > Traceback (most recent call last):
> > > > >> > > > File "read_3B42RT_3hours.py", line 49, in <module>
> > > > >> > > > beg_time = dt.datetime.strptime(beg_time_str,
> > "%Y-%m-%d
> > > > >> > > > %H:%M:%S.%fZ")
> > > > >> > > > File "/usr/lib64/python2.7/_strptime.py", line 332,
in
> > > _strptime
> > > > >> > > > (data_string, format))
> > > > >> > > > ValueError: time data '2018-08-20 22:30:00Z' does not
match
> > > format
> > > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > > > >> > > >
> > > > >> > > > So I could not run mode ...
> > > > >> > > > Thanking You
> > > > >> > > > With Best Regards
> > > > >> > > > ________________________
> > > > >> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > >> > > > Asst. Prof., Mathematics
> > > > >> > > > *Kalinga Institute of Industrial Technology,*
> > > > >> > > > *Deemed to be University, Bhubaneswar*
> > > > >> > > > *Mobile- 09861182688*
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway
via RT <
> > > > >> > > > met_help at ucar.edu>
> > > > >> > > > wrote:
> > > > >> > > >
> > > > >> > > > > So we worked together through the details of
writing a
> > python
> > > > >> script
> > > > >> > > for
> > > > >> > > > > reading the daily 3B42RT datasets.
> > > > >> > > > >
> > > > >> > > > > Now, you need to adapt that script for handling the
> 3-hourly
> > > > >> 3B42RT
> > > > >> > > > data...
> > > > >> > > > > let's say that you've done that and called it
> > > > >> > "read_3B42RT_3hours.py".
> > > > >> > > > You
> > > > >> > > > > should use that Python script when running MODE,
like
> this:
> > > > >> > > > >
> > > > >> > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
> > > ./output/mode_analysis \
> > > > >> > > > > -v 2
> > > > >> > > > >
> > > > >> > > > > And then in the MODE config file:
> > > > >> > > > >
> > > > >> > > > > fcst = {
> > > > >> > > > > field = { name = "APCP_03"; level = "(*,*)"; }
> > > > >> > > > > censor_thresh = [];
> > > > >> > > > > censor_val = [];
> > > > >> > > > > conv_radius = 60.0/grid_res; // in grid
squares
> > > > >> > > > > conv_thresh = >=5.0;
> > > > >> > > > > vld_thresh = 0.5;
> > > > >> > > > > filter_attr_name = [];
> > > > >> > > > > filter_attr_thresh = [];
> > > > >> > > > > merge_thresh = >=1.25;
> > > > >> > > > > merge_flag = THRESH;
> > > > >> > > > > }
> > > > >> > > > > obs = fcst;
> > > > >> > > > > obs = {
> > > > >> > > > > field = { name="read_3B42RT_3hours.py
> > > > >> read_3B42RT.2018082100.7.nc4
> > > > >> > > > > precipitation"; }
> > > > >> > > > > }
> > > > >> > > > >
> > > > >> > > > > Does that make sense?
> > > > >> > > > >
> > > > >> > > > > Thanks,
> > > > >> > > > > John
> > > > >> > > > >
> > > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala
via RT <
> > > > >> > > > met_help at ucar.edu
> > > > >> > > > > >
> > > > >> > > > > wrote:
> > > > >> > > > >
> > > > >> > > > > >
> > > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was acted
upon.
> > > > >> > > > > > Transaction: Ticket created by
biranchimahala at gmail.com
> > > > >> > > > > > Queue: met_help
> > > > >> > > > > > Subject: (No subject given)
> > > > >> > > > > > Owner: Nobody
> > > > >> > > > > > Requestors: biranchimahala at gmail.com
> > > > >> > > > > > Status: new
> > > > >> > > > > > Ticket <URL:
> > > > >> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > >> > > > >
> > > > >> > > > > >
> > > > >> > > > > >
> > > > >> > > > > > Sir,
> > > > >> > > > > > I am able to run mode of MET-8.0 with the
assistance of
> > > > met_help
> > > > >> > > team.
> > > > >> > > > > > Now I am getting sum warnings while running mode
as
> > follows.
> > > > >> > > > > >
> > > > >> > > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default
-outdir
> > > > >> > > > > ./output/mode_analysis/
> > > > >> > > > > > -v 2
> > > > >> > > > > >
> > > > >> > > > > > DEBUG 1: Default Config File:
> > > > >> > > > > /MET_V8/share/met//config/MODEConfig_default
> > > > >> > > > > > DEBUG 1: Match Config File: MODEConfig_default
> > > > >> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
> > > > >> > > > > > WARNING:
> > > > >> > > > > > WARNING: NcCfFile::open() -> could not determine
the
> valid
> > > > time,
> > > > >> > > using
> > > > >> > > > 0.
> > > > >> > > > > > WARNING:
> > > > >> > > > > > DEBUG 1: Forecast File:
> > > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > >> > > > > > DEBUG 1: Observation File:
3B42RT.2018082100.7.nc4
> > > > >> > > > > > DEBUG 1: Regridding observation
precipitation(*,*) to
> the
> > > > >> > > verification
> > > > >> > > > > > grid.
> > > > >> > > > > > WARNING:
> > > > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and
> observation
> > > > valid
> > > > >> > > times
> > > > >> > > > do
> > > > >> > > > > > not match 20180821_000000 != 19700101_000000 for
> > > APCP_03(*,*)
> > > > >> > versus
> > > > >> > > > > > precipitation(*,*).
> > > > >> > > > > > WARNING:
> > > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > >> > > > > > DEBUG 1: Observation Field: precipitation at *,*
> > > > >> > > > > > DEBUG 2: Processing masking regions.
> > > > >> > > > > > DEBUG 2: Identifying objects in the forecast and
> > observation
> > > > >> > > fields...
> > > > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > > > >> > > > > > DEBUG 2: Identified: 0 forecast objects and 0
> observation
> > > > >> objects.
> > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> > field.
> > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
observation
> > > field.
> > > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0
observation
> > > > >> objects.
> > > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH) between
the
> > > forecast
> > > > >> and
> > > > >> > > > > > observation fields.
> > > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics
file:
> > > > >> > > > > >
> > > > >> >
> > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > >> > > > > > DEBUG 1: Creating Contingency Table Statistics
file:
> > > > >> > > > > >
> > > > >> >
> > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
> > > > >> > > > > >
> > > > >> >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > >> > > > > > DEBUG 1: Loading forecast raw color table:
> > > > >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > >> > > > > > DEBUG 1: Loading observation raw color table:
> > > > >> > > > > > /MET_V8/share/met//colortables/met_default.ctable
> > > > >> > > > > > DEBUG 1: Creating postscript file:
> > > > >> > > > > >
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > > >> > > > > >
> > > > >> > > > > > Am I doing some mistakes or the above warnings
are
> general
> > > due
> > > > >> to
> > > > >> > > > > > observation and fcst time mismatch.
> > > > >> > > > > > Kindly find the attachments for reference.
> > > > >> > > > > > Thanking You
> > > > >> > > > > > With Best Regards
> > > > >> > > > > > ________________________
> > > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > >> > > > > > Asst. Prof., Mathematics
> > > > >> > > > > > *Kalinga Institute of Industrial Technology,*
> > > > >> > > > > > *Deemed to be University, Bhubaneswar*
> > > > >> > > > > > *Mobile- 09861182688*
> > > > >> > > > > >
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >>
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Mon Oct 29 11:38:13 2018
Sure enough! I clearly see the 120 hour accumulation in that file and
would expect that pcp_combine command to work exactly how you have
written
it.
I'd like to try to replicate this behavior here and debug. Can you
please
post the 96 and 120 forecast files "wrfprs_d02.120" to our anonymous
FTP
site following these instructions?
https://dtcenter.org/met/users/support/met_help.php#ftp
Please write once they're there so I know to go grab them.
Thanks,
John
On Mon, Oct 29, 2018 at 11:28 AM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
> Sir,
> * wgrib **wrfprs_d02.120 | grep APCP* command shows the following;
> bash: AerosolCoeff.bin: command not found...
> whreas the command
> wgrib wrfprs_d02.120 | grep APCP
> shows the following;
>
>
310:20113176:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=120:TimeU=1:sfc:0-
120hr
> acc:NAve=0
> Also
> wgrib wrfprs_d02.96 | grep APCP
> shows the following;
>
>
310:19992520:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=96:TimeU=1:sfc:0-
96hr
> acc:NAve=0
>
>
> For information.
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Mon, Oct 29, 2018 at 9:31 PM John Halley Gotway via RT <
> met_help at ucar.edu>
> wrote:
>
> > Dr. Biranchi,
> >
> > So you've seen the following error from pcp_combine:
> > ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
> >
> > The most likely explanation is that the input file
(wrfprs_d02.120)
> really
> > does not contain a record for 120-hour accumulated precipitation.
> >
> > If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2) tools
available,
> > please use them to inventory this file and check what precip
accumulation
> > actually is available:
> > * wgrib **wrfprs_d02.120 | grep APCP*
> >
> > Thanks,
> > John
> >
> > On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT <
> met_help at ucar.edu>
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > >
> > > Sir,
> > > Now it works.
> > > I have another query as below.
> > > I am trying to run pcp_combine tool to find the APCP by running
the
> > > command;
> > > pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
> > > APCP_24h_00utc15Aug2018.nc -pcpdir ./
> > > The output of the above command shows the following ;
> > > DEBUG 1: Reading input file: wrfprs_d02.120
> > > WARNING:
> > > WARNING: MetGrib1DataFile::data_plane() -> No exact match found
for
> > VarInfo
> > > "APCP/A120" in GRIB file "wrfprs_d02.120".
> > > WARNING:
> > > ERROR :
> > > ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
> > > ERROR :
> > >
> > > Thanking You
> > > With Best Regards
> > > ________________________
> > > Dr. BIRANCHI KUMAR MAHALA
> > > Asst. Prof., Mathematics
> > > *Kalinga Institute of Industrial Technology,*
> > > *Deemed to be University, Bhubaneswar*
> > > *Mobile- 09861182688*
> > >
> > >
> > >
> > > On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT <
> > > met_help at ucar.edu> wrote:
> > >
> > > > Biranchi,
> > > >
> > > > I found this image showing 3B42 data for 20160229:
> > > >
> > > >
> > > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > > >
> > > > I grabbed the NetCDF file for that day and tried to plot it in
MET.
> > But
> > > > the number of latitude values changed... 480 in recent data
but 400
> in
> > > > older data. So I updated the script to parse the lat/lon info
on the
> > > fly.
> > > > Also, I noticed that the picture in MET is upside down...
compared to
> > the
> > > > NASA image. So I flipped it.
> > > >
> > > > The updated script is attached as well as the image generated
by this
> > > > command:
> > > >
> > > > met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42_Daily.20160229.7.ps \
> > > > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4
precipitation";' \
> > > > -plot_range 0 100
> > > >
> > > > That should now match this image:
> > > >
> > > >
> > > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT <
> > > met_help at ucar.edu
> > > > >
> > > > wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > > > >
> > > > > Sir,
> > > > > The new script works fine for both.
> > > > > Thanking You
> > > > > With Best Regards
> > > > > ________________________
> > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > Asst. Prof., Mathematics
> > > > > *Kalinga Institute of Industrial Technology,*
> > > > > *Deemed to be University, Bhubaneswar*
> > > > > *Mobile- 09861182688*
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
> > > > biranchimahala at gmail.com
> > > > > >
> > > > > wrote:
> > > > >
> > > > > > Sir,
> > > > > > Can you please brief how to compare the precipitation
images with
> > > NASA
> > > > > > plots.
> > > > > >
> > > > > > Thanking You
> > > > > > With Best Regards
> > > > > > ________________________
> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > Asst. Prof., Mathematics
> > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > *Mobile- 09861182688*
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via RT
<
> > > > > > met_help at ucar.edu> wrote:
> > > > > >
> > > > > >> Ah yes, there are more differences in these files.
> > > > > >>
> > > > > >> For some reason the Daily files store data in lon, lat
order:
> > > > > >> float precipitation(lon, lat) ;
> > > > > >> While the 3-hourly files store data in lat, lon order:
> > > > > >> float precipitation(lat, lon) ;
> > > > > >>
> > > > > >> That's pretty frustrating! OK, I updated the script to
check
> for
> > > > (lat,
> > > > > >> lon) versus (lon, lat) ordering... and take the transpose
in the
> > > > latter
> > > > > >> case. I tested using these commands:
> > > > > >>
> > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
> > 3B42RT_Daily.20180821.7.ps
> > > \
> > > > > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > > precipitation";'
> > > > > >>
> > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42RT.2018082100.7.ps
> \
> > > > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
> precipitation";'
> > > > > >>
> > > > > >> I have attached the updated script and these 2 test
images.
> > > > > >>
> > > > > >> However, it would be wise to independently verify that
the
> precip
> > is
> > > > in
> > > > > >> the
> > > > > >> right spot. Can you compare these images to NASA plots
for the
> > same
> > > > > >> times?
> > > > > >>
> > > > > >> Thanks,
> > > > > >> John
> > > > > >>
> > > > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT <
> > > > > >> met_help at ucar.edu>
> > > > > >> wrote:
> > > > > >>
> > > > > >> >
> > > > > >> > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> >
> > > > > >> >
> > > > > >> > Sir,
> > > > > >> > The script works fine for
> > > > > >> > python read_3B42RT.py
> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > > >> > precipitation
> > > > > >> > But the output of the command;
> > > > > >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > > > > >> > 'name="./read_3B42RT.py
> > > > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4
precipitation";'
> > > > > >> > shows the following;
> > > > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > > > >> > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > > >> > Variable Name : 'precipitation'
> > > > > >> > Data Shape: (1440, 480)
> > > > > >> > Data Type: dtype('float64')
> > > > > >> > Begin Time = 2018-08-20 22:30:00
> > > > > >> > End Time = 2018-08-21 01:30:00
> > > > > >> > Accum Time = 030000
> > > > > >> > Attributes: {'long_name': 'precipitation', 'init':
> > > > '20180821_013000',
> > > > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat': 0.25,
> > 'lon_ll':
> > > > > >> -179.875,
> > > > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875,
> > 'delta_lon':
> > > > > 0.25,
> > > > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name':
'precipitation',
> > 'lead':
> > > > > '00',
> > > > > >> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> > > > > >> > DEBUG 1: Creating postscript file:
3B42RT.2018082100.7.ps
> > > > > >> > ERROR :
> > > > > >> > ERROR : DataPlane::two_to_one() -> range check error:
(Nx,
> Ny)
> > =
> > > > > (480,
> > > > > >> > 1440), (x, y) = (480, 0)
> > > > > >> > ERROR :
> > > > > >> >
> > > > > >> > Thanking You
> > > > > >> > With Best Regards
> > > > > >> > ________________________
> > > > > >> > Dr. BIRANCHI KUMAR MAHALA
> > > > > >> > Asst. Prof., Mathematics
> > > > > >> > *Kalinga Institute of Industrial Technology,*
> > > > > >> > *Deemed to be University, Bhubaneswar*
> > > > > >> > *Mobile- 09861182688*
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway via
RT <
> > > > > >> > met_help at ucar.edu> wrote:
> > > > > >> >
> > > > > >> > > Biranchi,
> > > > > >> > >
> > > > > >> > > Looking very closely at the 3B42RT NetCDF files and
the
> error
> > > > > message
> > > > > >> > from
> > > > > >> > > that python script, it looks like the time formats
are very
> > > > slightly
> > > > > >> > > different.
> > > > > >> > >
> > > > > >> > > The Daily files include microseconds:
> > > > > >> > > :BeginTime = "01:30:00.000Z" ;
> > > > > >> > > :EndTime = "01:29:59.999Z" ;
> > > > > >> > >
> > > > > >> > > The 3-hourly files do not:
> > > > > >> > > :BeginTime = "22:30:00Z" ;
> > > > > >> > > :EndTime = "01:30:00Z" ;
> > > > > >> > >
> > > > > >> > > Other than that, they're the same. So I created a
new
> script
> > > > named
> > > > > >> > > "read_3B42RT.py" (see attached) which should handle
both the
> > > daily
> > > > > and
> > > > > >> > > 3-hourly files. I parses the times with or without
the
> > > > microseconds
> > > > > >> > > included:
> > > > > >> > >
> > > > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
precipitation
> > > > > >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > precipitation
> > > > > >> > >
> > > > > >> > > Hopefully that does the trick.
> > > > > >> > >
> > > > > >> > > Thanks,
> > > > > >> > > John
> > > > > >> > >
> > > > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via
RT <
> > > > > >> > met_help at ucar.edu>
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > >
> > > > > >> > > > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > >
> > > > > >> > > >
> > > > > >> > > > Sir,
> > > > > >> > > > The command:
> > > > > >> > > > python read_3B42RT_3hours.py
> > > > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > > >> > > > precipitation
> > > > > >> > > > shows the following message:
> > > > > >> > > > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > > >> > > > Variable Name : 'precipitation'
> > > > > >> > > > Data Shape: (1440, 480)
> > > > > >> > > > Data Type: dtype('float64')
> > > > > >> > > > Traceback (most recent call last):
> > > > > >> > > > File "read_3B42RT_3hours.py", line 49, in
<module>
> > > > > >> > > > beg_time =
dt.datetime.strptime(beg_time_str,
> > > "%Y-%m-%d
> > > > > >> > > > %H:%M:%S.%fZ")
> > > > > >> > > > File "/usr/lib64/python2.7/_strptime.py", line
332, in
> > > > _strptime
> > > > > >> > > > (data_string, format))
> > > > > >> > > > ValueError: time data '2018-08-20 22:30:00Z' does
not
> match
> > > > format
> > > > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > > > > >> > > >
> > > > > >> > > > So I could not run mode ...
> > > > > >> > > > Thanking You
> > > > > >> > > > With Best Regards
> > > > > >> > > > ________________________
> > > > > >> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > >> > > > Asst. Prof., Mathematics
> > > > > >> > > > *Kalinga Institute of Industrial Technology,*
> > > > > >> > > > *Deemed to be University, Bhubaneswar*
> > > > > >> > > > *Mobile- 09861182688*
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley Gotway
via RT
> <
> > > > > >> > > > met_help at ucar.edu>
> > > > > >> > > > wrote:
> > > > > >> > > >
> > > > > >> > > > > So we worked together through the details of
writing a
> > > python
> > > > > >> script
> > > > > >> > > for
> > > > > >> > > > > reading the daily 3B42RT datasets.
> > > > > >> > > > >
> > > > > >> > > > > Now, you need to adapt that script for handling
the
> > 3-hourly
> > > > > >> 3B42RT
> > > > > >> > > > data...
> > > > > >> > > > > let's say that you've done that and called it
> > > > > >> > "read_3B42RT_3hours.py".
> > > > > >> > > > You
> > > > > >> > > > > should use that Python script when running MODE,
like
> > this:
> > > > > >> > > > >
> > > > > >> > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
> > > > ./output/mode_analysis \
> > > > > >> > > > > -v 2
> > > > > >> > > > >
> > > > > >> > > > > And then in the MODE config file:
> > > > > >> > > > >
> > > > > >> > > > > fcst = {
> > > > > >> > > > > field = { name = "APCP_03"; level = "(*,*)";
}
> > > > > >> > > > > censor_thresh = [];
> > > > > >> > > > > censor_val = [];
> > > > > >> > > > > conv_radius = 60.0/grid_res; // in grid
> squares
> > > > > >> > > > > conv_thresh = >=5.0;
> > > > > >> > > > > vld_thresh = 0.5;
> > > > > >> > > > > filter_attr_name = [];
> > > > > >> > > > > filter_attr_thresh = [];
> > > > > >> > > > > merge_thresh = >=1.25;
> > > > > >> > > > > merge_flag = THRESH;
> > > > > >> > > > > }
> > > > > >> > > > > obs = fcst;
> > > > > >> > > > > obs = {
> > > > > >> > > > > field = { name="read_3B42RT_3hours.py
> > > > > >> read_3B42RT.2018082100.7.nc4
> > > > > >> > > > > precipitation"; }
> > > > > >> > > > > }
> > > > > >> > > > >
> > > > > >> > > > > Does that make sense?
> > > > > >> > > > >
> > > > > >> > > > > Thanks,
> > > > > >> > > > > John
> > > > > >> > > > >
> > > > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi Mahala
via RT
> <
> > > > > >> > > > met_help at ucar.edu
> > > > > >> > > > > >
> > > > > >> > > > > wrote:
> > > > > >> > > > >
> > > > > >> > > > > >
> > > > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was
acted
> upon.
> > > > > >> > > > > > Transaction: Ticket created by
> biranchimahala at gmail.com
> > > > > >> > > > > > Queue: met_help
> > > > > >> > > > > > Subject: (No subject given)
> > > > > >> > > > > > Owner: Nobody
> > > > > >> > > > > > Requestors: biranchimahala at gmail.com
> > > > > >> > > > > > Status: new
> > > > > >> > > > > > Ticket <URL:
> > > > > >> > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > > >> > > > >
> > > > > >> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > > > Sir,
> > > > > >> > > > > > I am able to run mode of MET-8.0 with the
assistance
> of
> > > > > met_help
> > > > > >> > > team.
> > > > > >> > > > > > Now I am getting sum warnings while running
mode as
> > > follows.
> > > > > >> > > > > >
> > > > > >> > > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default
-outdir
> > > > > >> > > > > ./output/mode_analysis/
> > > > > >> > > > > > -v 2
> > > > > >> > > > > >
> > > > > >> > > > > > DEBUG 1: Default Config File:
> > > > > >> > > > > /MET_V8/share/met//config/MODEConfig_default
> > > > > >> > > > > > DEBUG 1: Match Config File: MODEConfig_default
> > > > > >> > > > > > DEBUG 1: Merge Config File: MODEConfig_default
> > > > > >> > > > > > WARNING:
> > > > > >> > > > > > WARNING: NcCfFile::open() -> could not
determine the
> > valid
> > > > > time,
> > > > > >> > > using
> > > > > >> > > > 0.
> > > > > >> > > > > > WARNING:
> > > > > >> > > > > > DEBUG 1: Forecast File:
> > > > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > >> > > > > > DEBUG 1: Observation File:
3B42RT.2018082100.7.nc4
> > > > > >> > > > > > DEBUG 1: Regridding observation
precipitation(*,*) to
> > the
> > > > > >> > > verification
> > > > > >> > > > > > grid.
> > > > > >> > > > > > WARNING:
> > > > > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast and
> > observation
> > > > > valid
> > > > > >> > > times
> > > > > >> > > > do
> > > > > >> > > > > > not match 20180821_000000 != 19700101_000000
for
> > > > APCP_03(*,*)
> > > > > >> > versus
> > > > > >> > > > > > precipitation(*,*).
> > > > > >> > > > > > WARNING:
> > > > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > > >> > > > > > DEBUG 1: Observation Field: precipitation at
*,*
> > > > > >> > > > > > DEBUG 2: Processing masking regions.
> > > > > >> > > > > > DEBUG 2: Identifying objects in the forecast
and
> > > observation
> > > > > >> > > fields...
> > > > > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > > > > >> > > > > > DEBUG 2: Identified: 0 forecast objects and 0
> > observation
> > > > > >> objects.
> > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> > > field.
> > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> observation
> > > > field.
> > > > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0
> observation
> > > > > >> objects.
> > > > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH)
between the
> > > > forecast
> > > > > >> and
> > > > > >> > > > > > observation fields.
> > > > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics
file:
> > > > > >> > > > > >
> > > > > >> >
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > > >> > > > > > DEBUG 1: Creating Contingency Table Statistics
file:
> > > > > >> > > > > >
> > > > > >> >
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
> > > > > >> > > > > >
> > > > > >> >
> > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > > >> > > > > > DEBUG 1: Loading forecast raw color table:
> > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
> > > > > >> > > > > > DEBUG 1: Loading observation raw color table:
> > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
> > > > > >> > > > > > DEBUG 1: Creating postscript file:
> > > > > >> > > > > >
> > > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > > > >> > > > > >
> > > > > >> > > > > > Am I doing some mistakes or the above warnings
are
> > general
> > > > due
> > > > > >> to
> > > > > >> > > > > > observation and fcst time mismatch.
> > > > > >> > > > > > Kindly find the attachments for reference.
> > > > > >> > > > > > Thanking You
> > > > > >> > > > > > With Best Regards
> > > > > >> > > > > > ________________________
> > > > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > >> > > > > > Asst. Prof., Mathematics
> > > > > >> > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > >> > > > > > *Deemed to be University, Bhubaneswar*
> > > > > >> > > > > > *Mobile- 09861182688*
> > > > > >> > > > > >
> > > > > >> > > > > >
> > > > > >> > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >>
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: Biranchi Mahala
Time: Mon Oct 29 12:04:21 2018
Sir,
It is sent to your site under the directory mahala_data
for information.
Thanking You
With Best Regards
________________________
Dr. BIRANCHI KUMAR MAHALA
Asst. Prof., Mathematics
*Kalinga Institute of Industrial Technology,*
*Deemed to be University, Bhubaneswar*
*Mobile- 09861182688*
On Mon, Oct 29, 2018 at 11:17 PM John Halley Gotway via RT <
met_help at ucar.edu> wrote:
> Sure enough! I clearly see the 120 hour accumulation in that file
and
> would expect that pcp_combine command to work exactly how you have
written
> it.
>
> I'd like to try to replicate this behavior here and debug. Can you
please
> post the 96 and 120 forecast files "wrfprs_d02.120" to our anonymous
FTP
> site following these instructions?
> https://dtcenter.org/met/users/support/met_help.php#ftp
>
> Please write once they're there so I know to go grab them.
>
> Thanks,
> John
>
> On Mon, Oct 29, 2018 at 11:28 AM Biranchi Mahala via RT
<met_help at ucar.edu
> >
> wrote:
>
> >
> > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> >
> > Sir,
> > * wgrib **wrfprs_d02.120 | grep APCP* command shows the following;
> > bash: AerosolCoeff.bin: command not found...
> > whreas the command
> > wgrib wrfprs_d02.120 | grep APCP
> > shows the following;
> >
> >
>
310:20113176:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=120:TimeU=1:sfc:0-
120hr
> > acc:NAve=0
> > Also
> > wgrib wrfprs_d02.96 | grep APCP
> > shows the following;
> >
> >
>
310:19992520:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=96:TimeU=1:sfc:0-
96hr
> > acc:NAve=0
> >
> >
> > For information.
> > Thanking You
> > With Best Regards
> > ________________________
> > Dr. BIRANCHI KUMAR MAHALA
> > Asst. Prof., Mathematics
> > *Kalinga Institute of Industrial Technology,*
> > *Deemed to be University, Bhubaneswar*
> > *Mobile- 09861182688*
> >
> >
> >
> > On Mon, Oct 29, 2018 at 9:31 PM John Halley Gotway via RT <
> > met_help at ucar.edu>
> > wrote:
> >
> > > Dr. Biranchi,
> > >
> > > So you've seen the following error from pcp_combine:
> > > ERROR : get_field() -> can't get data plane from file
"wrfprs_d02.120"
> > >
> > > The most likely explanation is that the input file
(wrfprs_d02.120)
> > really
> > > does not contain a record for 120-hour accumulated
precipitation.
> > >
> > > If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2) tools
> available,
> > > please use them to inventory this file and check what precip
> accumulation
> > > actually is available:
> > > * wgrib **wrfprs_d02.120 | grep APCP*
> > >
> > > Thanks,
> > > John
> > >
> > > On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT <
> > met_help at ucar.edu>
> > > wrote:
> > >
> > > >
> > > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>
> > > >
> > > > Sir,
> > > > Now it works.
> > > > I have another query as below.
> > > > I am trying to run pcp_combine tool to find the APCP by
running the
> > > > command;
> > > > pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
> > > > APCP_24h_00utc15Aug2018.nc -pcpdir ./
> > > > The output of the above command shows the following ;
> > > > DEBUG 1: Reading input file: wrfprs_d02.120
> > > > WARNING:
> > > > WARNING: MetGrib1DataFile::data_plane() -> No exact match
found for
> > > VarInfo
> > > > "APCP/A120" in GRIB file "wrfprs_d02.120".
> > > > WARNING:
> > > > ERROR :
> > > > ERROR : get_field() -> can't get data plane from file
> "wrfprs_d02.120"
> > > > ERROR :
> > > >
> > > > Thanking You
> > > > With Best Regards
> > > > ________________________
> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > Asst. Prof., Mathematics
> > > > *Kalinga Institute of Industrial Technology,*
> > > > *Deemed to be University, Bhubaneswar*
> > > > *Mobile- 09861182688*
> > > >
> > > >
> > > >
> > > > On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT <
> > > > met_help at ucar.edu> wrote:
> > > >
> > > > > Biranchi,
> > > > >
> > > > > I found this image showing 3B42 data for 20160229:
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > > > >
> > > > > I grabbed the NetCDF file for that day and tried to plot it
in MET.
> > > But
> > > > > the number of latitude values changed... 480 in recent data
but 400
> > in
> > > > > older data. So I updated the script to parse the lat/lon
info on
> the
> > > > fly.
> > > > > Also, I noticed that the picture in MET is upside down...
compared
> to
> > > the
> > > > > NASA image. So I flipped it.
> > > > >
> > > > > The updated script is attached as well as the image
generated by
> this
> > > > > command:
> > > > >
> > > > > met-8.0/bin/plot_data_plane PYTHON_NUMPY
3B42_Daily.20160229.7.ps
> \
> > > > > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4
precipitation";'
> \
> > > > > -plot_range 0 100
> > > > >
> > > > > That should now match this image:
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > > > >
> > > > > Thanks,
> > > > > John
> > > > >
> > > > > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT <
> > > > met_help at ucar.edu
> > > > > >
> > > > > wrote:
> > > > >
> > > > > >
> > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > > > > >
> > > > > > Sir,
> > > > > > The new script works fine for both.
> > > > > > Thanking You
> > > > > > With Best Regards
> > > > > > ________________________
> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > Asst. Prof., Mathematics
> > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > *Mobile- 09861182688*
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
> > > > > biranchimahala at gmail.com
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Sir,
> > > > > > > Can you please brief how to compare the precipitation
images
> with
> > > > NASA
> > > > > > > plots.
> > > > > > >
> > > > > > > Thanking You
> > > > > > > With Best Regards
> > > > > > > ________________________
> > > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > > Asst. Prof., Mathematics
> > > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > > *Mobile- 09861182688*
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway via
RT <
> > > > > > > met_help at ucar.edu> wrote:
> > > > > > >
> > > > > > >> Ah yes, there are more differences in these files.
> > > > > > >>
> > > > > > >> For some reason the Daily files store data in lon, lat
order:
> > > > > > >> float precipitation(lon, lat) ;
> > > > > > >> While the 3-hourly files store data in lat, lon order:
> > > > > > >> float precipitation(lat, lon) ;
> > > > > > >>
> > > > > > >> That's pretty frustrating! OK, I updated the script to
check
> > for
> > > > > (lat,
> > > > > > >> lon) versus (lon, lat) ordering... and take the
transpose in
> the
> > > > > latter
> > > > > > >> case. I tested using these commands:
> > > > > > >>
> > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
> > > 3B42RT_Daily.20180821.7.ps
> > > > \
> > > > > > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > > > precipitation";'
> > > > > > >>
> > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
> 3B42RT.2018082100.7.ps
> > \
> > > > > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
> > precipitation";'
> > > > > > >>
> > > > > > >> I have attached the updated script and these 2 test
images.
> > > > > > >>
> > > > > > >> However, it would be wise to independently verify that
the
> > precip
> > > is
> > > > > in
> > > > > > >> the
> > > > > > >> right spot. Can you compare these images to NASA plots
for
> the
> > > same
> > > > > > >> times?
> > > > > > >>
> > > > > > >> Thanks,
> > > > > > >> John
> > > > > > >>
> > > > > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via RT
<
> > > > > > >> met_help at ucar.edu>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> >
> > > > > > >> > <URL:
> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > >
> > > > > > >> >
> > > > > > >> > Sir,
> > > > > > >> > The script works fine for
> > > > > > >> > python read_3B42RT.py
> > ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > > > >> > precipitation
> > > > > > >> > But the output of the command;
> > > > > > >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > > > > > >> > 'name="./read_3B42RT.py
> > > > > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4
precipitation";'
> > > > > > >> > shows the following;
> > > > > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > > > > >> > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > > > >> > Variable Name : 'precipitation'
> > > > > > >> > Data Shape: (1440, 480)
> > > > > > >> > Data Type: dtype('float64')
> > > > > > >> > Begin Time = 2018-08-20 22:30:00
> > > > > > >> > End Time = 2018-08-21 01:30:00
> > > > > > >> > Accum Time = 030000
> > > > > > >> > Attributes: {'long_name': 'precipitation', 'init':
> > > > > '20180821_013000',
> > > > > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat':
0.25,
> > > 'lon_ll':
> > > > > > >> -179.875,
> > > > > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll': -59.875,
> > > 'delta_lon':
> > > > > > 0.25,
> > > > > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name':
'precipitation',
> > > 'lead':
> > > > > > '00',
> > > > > > >> > 'level': 'Surface', 'units': 'mm', 'accum': '030000'}
> > > > > > >> > DEBUG 1: Creating postscript file:
3B42RT.2018082100.7.ps
> > > > > > >> > ERROR :
> > > > > > >> > ERROR : DataPlane::two_to_one() -> range check
error: (Nx,
> > Ny)
> > > =
> > > > > > (480,
> > > > > > >> > 1440), (x, y) = (480, 0)
> > > > > > >> > ERROR :
> > > > > > >> >
> > > > > > >> > Thanking You
> > > > > > >> > With Best Regards
> > > > > > >> > ________________________
> > > > > > >> > Dr. BIRANCHI KUMAR MAHALA
> > > > > > >> > Asst. Prof., Mathematics
> > > > > > >> > *Kalinga Institute of Industrial Technology,*
> > > > > > >> > *Deemed to be University, Bhubaneswar*
> > > > > > >> > *Mobile- 09861182688*
> > > > > > >> >
> > > > > > >> >
> > > > > > >> >
> > > > > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway
via RT <
> > > > > > >> > met_help at ucar.edu> wrote:
> > > > > > >> >
> > > > > > >> > > Biranchi,
> > > > > > >> > >
> > > > > > >> > > Looking very closely at the 3B42RT NetCDF files and
the
> > error
> > > > > > message
> > > > > > >> > from
> > > > > > >> > > that python script, it looks like the time formats
are
> very
> > > > > slightly
> > > > > > >> > > different.
> > > > > > >> > >
> > > > > > >> > > The Daily files include microseconds:
> > > > > > >> > > :BeginTime = "01:30:00.000Z" ;
> > > > > > >> > > :EndTime = "01:29:59.999Z" ;
> > > > > > >> > >
> > > > > > >> > > The 3-hourly files do not:
> > > > > > >> > > :BeginTime = "22:30:00Z" ;
> > > > > > >> > > :EndTime = "01:30:00Z" ;
> > > > > > >> > >
> > > > > > >> > > Other than that, they're the same. So I created a
new
> > script
> > > > > named
> > > > > > >> > > "read_3B42RT.py" (see attached) which should handle
both
> the
> > > > daily
> > > > > > and
> > > > > > >> > > 3-hourly files. I parses the times with or without
the
> > > > > microseconds
> > > > > > >> > > included:
> > > > > > >> > >
> > > > > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
> precipitation
> > > > > > >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > > precipitation
> > > > > > >> > >
> > > > > > >> > > Hopefully that does the trick.
> > > > > > >> > >
> > > > > > >> > > Thanks,
> > > > > > >> > > John
> > > > > > >> > >
> > > > > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala via
RT <
> > > > > > >> > met_help at ucar.edu>
> > > > > > >> > > wrote:
> > > > > > >> > >
> > > > > > >> > > >
> > > > > > >> > > > <URL:
> > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > >
> > > > > > >> > > >
> > > > > > >> > > > Sir,
> > > > > > >> > > > The command:
> > > > > > >> > > > python read_3B42RT_3hours.py
> > > > > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > > > >> > > > precipitation
> > > > > > >> > > > shows the following message:
> > > > > > >> > > > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > > > >> > > > Variable Name : 'precipitation'
> > > > > > >> > > > Data Shape: (1440, 480)
> > > > > > >> > > > Data Type: dtype('float64')
> > > > > > >> > > > Traceback (most recent call last):
> > > > > > >> > > > File "read_3B42RT_3hours.py", line 49, in
<module>
> > > > > > >> > > > beg_time =
dt.datetime.strptime(beg_time_str,
> > > > "%Y-%m-%d
> > > > > > >> > > > %H:%M:%S.%fZ")
> > > > > > >> > > > File "/usr/lib64/python2.7/_strptime.py", line
332, in
> > > > > _strptime
> > > > > > >> > > > (data_string, format))
> > > > > > >> > > > ValueError: time data '2018-08-20 22:30:00Z' does
not
> > match
> > > > > format
> > > > > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > > > > > >> > > >
> > > > > > >> > > > So I could not run mode ...
> > > > > > >> > > > Thanking You
> > > > > > >> > > > With Best Regards
> > > > > > >> > > > ________________________
> > > > > > >> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > >> > > > Asst. Prof., Mathematics
> > > > > > >> > > > *Kalinga Institute of Industrial Technology,*
> > > > > > >> > > > *Deemed to be University, Bhubaneswar*
> > > > > > >> > > > *Mobile- 09861182688*
> > > > > > >> > > >
> > > > > > >> > > >
> > > > > > >> > > >
> > > > > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley
Gotway via
> RT
> > <
> > > > > > >> > > > met_help at ucar.edu>
> > > > > > >> > > > wrote:
> > > > > > >> > > >
> > > > > > >> > > > > So we worked together through the details of
writing a
> > > > python
> > > > > > >> script
> > > > > > >> > > for
> > > > > > >> > > > > reading the daily 3B42RT datasets.
> > > > > > >> > > > >
> > > > > > >> > > > > Now, you need to adapt that script for handling
the
> > > 3-hourly
> > > > > > >> 3B42RT
> > > > > > >> > > > data...
> > > > > > >> > > > > let's say that you've done that and called it
> > > > > > >> > "read_3B42RT_3hours.py".
> > > > > > >> > > > You
> > > > > > >> > > > > should use that Python script when running
MODE, like
> > > this:
> > > > > > >> > > > >
> > > > > > >> > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > > > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
> > > > > ./output/mode_analysis \
> > > > > > >> > > > > -v 2
> > > > > > >> > > > >
> > > > > > >> > > > > And then in the MODE config file:
> > > > > > >> > > > >
> > > > > > >> > > > > fcst = {
> > > > > > >> > > > > field = { name = "APCP_03"; level =
"(*,*)"; }
> > > > > > >> > > > > censor_thresh = [];
> > > > > > >> > > > > censor_val = [];
> > > > > > >> > > > > conv_radius = 60.0/grid_res; // in
grid
> > squares
> > > > > > >> > > > > conv_thresh = >=5.0;
> > > > > > >> > > > > vld_thresh = 0.5;
> > > > > > >> > > > > filter_attr_name = [];
> > > > > > >> > > > > filter_attr_thresh = [];
> > > > > > >> > > > > merge_thresh = >=1.25;
> > > > > > >> > > > > merge_flag = THRESH;
> > > > > > >> > > > > }
> > > > > > >> > > > > obs = fcst;
> > > > > > >> > > > > obs = {
> > > > > > >> > > > > field = { name="read_3B42RT_3hours.py
> > > > > > >> read_3B42RT.2018082100.7.nc4
> > > > > > >> > > > > precipitation"; }
> > > > > > >> > > > > }
> > > > > > >> > > > >
> > > > > > >> > > > > Does that make sense?
> > > > > > >> > > > >
> > > > > > >> > > > > Thanks,
> > > > > > >> > > > > John
> > > > > > >> > > > >
> > > > > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi
Mahala via
> RT
> > <
> > > > > > >> > > > met_help at ucar.edu
> > > > > > >> > > > > >
> > > > > > >> > > > > wrote:
> > > > > > >> > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was
acted
> > upon.
> > > > > > >> > > > > > Transaction: Ticket created by
> > biranchimahala at gmail.com
> > > > > > >> > > > > > Queue: met_help
> > > > > > >> > > > > > Subject: (No subject given)
> > > > > > >> > > > > > Owner: Nobody
> > > > > > >> > > > > > Requestors: biranchimahala at gmail.com
> > > > > > >> > > > > > Status: new
> > > > > > >> > > > > > Ticket <URL:
> > > > > > >> > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > > > >> > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > > > Sir,
> > > > > > >> > > > > > I am able to run mode of MET-8.0 with the
assistance
> > of
> > > > > > met_help
> > > > > > >> > > team.
> > > > > > >> > > > > > Now I am getting sum warnings while running
mode as
> > > > follows.
> > > > > > >> > > > > >
> > > > > > >> > > > > > mode
./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default
-outdir
> > > > > > >> > > > > ./output/mode_analysis/
> > > > > > >> > > > > > -v 2
> > > > > > >> > > > > >
> > > > > > >> > > > > > DEBUG 1: Default Config File:
> > > > > > >> > > > > /MET_V8/share/met//config/MODEConfig_default
> > > > > > >> > > > > > DEBUG 1: Match Config File:
MODEConfig_default
> > > > > > >> > > > > > DEBUG 1: Merge Config File:
MODEConfig_default
> > > > > > >> > > > > > WARNING:
> > > > > > >> > > > > > WARNING: NcCfFile::open() -> could not
determine the
> > > valid
> > > > > > time,
> > > > > > >> > > using
> > > > > > >> > > > 0.
> > > > > > >> > > > > > WARNING:
> > > > > > >> > > > > > DEBUG 1: Forecast File:
> > > > > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > > >> > > > > > DEBUG 1: Observation File:
3B42RT.2018082100.7.nc4
> > > > > > >> > > > > > DEBUG 1: Regridding observation
precipitation(*,*)
> to
> > > the
> > > > > > >> > > verification
> > > > > > >> > > > > > grid.
> > > > > > >> > > > > > WARNING:
> > > > > > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast
and
> > > observation
> > > > > > valid
> > > > > > >> > > times
> > > > > > >> > > > do
> > > > > > >> > > > > > not match 20180821_000000 != 19700101_000000
for
> > > > > APCP_03(*,*)
> > > > > > >> > versus
> > > > > > >> > > > > > precipitation(*,*).
> > > > > > >> > > > > > WARNING:
> > > > > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > > > >> > > > > > DEBUG 1: Observation Field: precipitation at
*,*
> > > > > > >> > > > > > DEBUG 2: Processing masking regions.
> > > > > > >> > > > > > DEBUG 2: Identifying objects in the forecast
and
> > > > observation
> > > > > > >> > > fields...
> > > > > > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > > > > > >> > > > > > DEBUG 2: Identified: 0 forecast objects and 0
> > > observation
> > > > > > >> objects.
> > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
forecast
> > > > field.
> > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> > observation
> > > > > field.
> > > > > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and 0
> > observation
> > > > > > >> objects.
> > > > > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH)
between
> the
> > > > > forecast
> > > > > > >> and
> > > > > > >> > > > > > observation fields.
> > > > > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object Statistics
file:
> > > > > > >> > > > > >
> > > > > > >> >
> > > > >
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > > > >> > > > > > DEBUG 1: Creating Contingency Table
Statistics file:
> > > > > > >> > > > > >
> > > > > > >> >
> > > > >
>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
> > > > > > >> > > > > >
> > > > > > >> >
> > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > > > >> > > > > > DEBUG 1: Loading forecast raw color table:
> > > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
> > > > > > >> > > > > > DEBUG 1: Loading observation raw color table:
> > > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
> > > > > > >> > > > > > DEBUG 1: Creating postscript file:
> > > > > > >> > > > > >
> > > > > >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > > > > >> > > > > >
> > > > > > >> > > > > > Am I doing some mistakes or the above
warnings are
> > > general
> > > > > due
> > > > > > >> to
> > > > > > >> > > > > > observation and fcst time mismatch.
> > > > > > >> > > > > > Kindly find the attachments for reference.
> > > > > > >> > > > > > Thanking You
> > > > > > >> > > > > > With Best Regards
> > > > > > >> > > > > > ________________________
> > > > > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > >> > > > > > Asst. Prof., Mathematics
> > > > > > >> > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > >> > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > >> > > > > > *Mobile- 09861182688*
> > > > > > >> > > > > >
> > > > > > >> > > > > >
> > > > > > >> > > > >
> > > > > > >> > > > >
> > > > > > >> > > >
> > > > > > >> > > >
> > > > > > >> > >
> > > > > > >> > >
> > > > > > >> >
> > > > > > >> >
> > > > > > >>
> > > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Wed Oct 31 11:41:06 2018
Thank you for posting your sample data. I retrieved them and was able
to
replicate the exact behavior you described. Running through the
debugger I
was able to identify a slight bug in the GRIB1 library code we're
using.
The fix is a simple one-line change, but unfortunately, this will
require a
bugfix. I'll get that done and posted as soon as possible and will
write
to let you know when it's available.
My apologies but thanks for helping us debug the code.
John
On Mon, Oct 29, 2018 at 12:04 PM Biranchi Mahala via RT
<met_help at ucar.edu>
wrote:
>
> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>
> Sir,
> It is sent to your site under the directory mahala_data
>
> for information.
> Thanking You
> With Best Regards
> ________________________
> Dr. BIRANCHI KUMAR MAHALA
> Asst. Prof., Mathematics
> *Kalinga Institute of Industrial Technology,*
> *Deemed to be University, Bhubaneswar*
> *Mobile- 09861182688*
>
>
>
> On Mon, Oct 29, 2018 at 11:17 PM John Halley Gotway via RT <
> met_help at ucar.edu> wrote:
>
> > Sure enough! I clearly see the 120 hour accumulation in that file
and
> > would expect that pcp_combine command to work exactly how you have
> written
> > it.
> >
> > I'd like to try to replicate this behavior here and debug. Can
you
> please
> > post the 96 and 120 forecast files "wrfprs_d02.120" to our
anonymous FTP
> > site following these instructions?
> > https://dtcenter.org/met/users/support/met_help.php#ftp
> >
> > Please write once they're there so I know to go grab them.
> >
> > Thanks,
> > John
> >
> > On Mon, Oct 29, 2018 at 11:28 AM Biranchi Mahala via RT <
> met_help at ucar.edu
> > >
> > wrote:
> >
> > >
> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > >
> > > Sir,
> > > * wgrib **wrfprs_d02.120 | grep APCP* command shows the
following;
> > > bash: AerosolCoeff.bin: command not found...
> > > whreas the command
> > > wgrib wrfprs_d02.120 | grep APCP
> > > shows the following;
> > >
> > >
> >
>
310:20113176:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=120:TimeU=1:sfc:0-
120hr
> > > acc:NAve=0
> > > Also
> > > wgrib wrfprs_d02.96 | grep APCP
> > > shows the following;
> > >
> > >
> >
>
310:19992520:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=96:TimeU=1:sfc:0-
96hr
> > > acc:NAve=0
> > >
> > >
> > > For information.
> > > Thanking You
> > > With Best Regards
> > > ________________________
> > > Dr. BIRANCHI KUMAR MAHALA
> > > Asst. Prof., Mathematics
> > > *Kalinga Institute of Industrial Technology,*
> > > *Deemed to be University, Bhubaneswar*
> > > *Mobile- 09861182688*
> > >
> > >
> > >
> > > On Mon, Oct 29, 2018 at 9:31 PM John Halley Gotway via RT <
> > > met_help at ucar.edu>
> > > wrote:
> > >
> > > > Dr. Biranchi,
> > > >
> > > > So you've seen the following error from pcp_combine:
> > > > ERROR : get_field() -> can't get data plane from file
> "wrfprs_d02.120"
> > > >
> > > > The most likely explanation is that the input file
(wrfprs_d02.120)
> > > really
> > > > does not contain a record for 120-hour accumulated
precipitation.
> > > >
> > > > If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2) tools
> > available,
> > > > please use them to inventory this file and check what precip
> > accumulation
> > > > actually is available:
> > > > * wgrib **wrfprs_d02.120 | grep APCP*
> > > >
> > > > Thanks,
> > > > John
> > > >
> > > > On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT <
> > > met_help at ucar.edu>
> > > > wrote:
> > > >
> > > > >
> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
> > > > >
> > > > > Sir,
> > > > > Now it works.
> > > > > I have another query as below.
> > > > > I am trying to run pcp_combine tool to find the APCP by
running the
> > > > > command;
> > > > > pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
> > > > > APCP_24h_00utc15Aug2018.nc -pcpdir ./
> > > > > The output of the above command shows the following ;
> > > > > DEBUG 1: Reading input file: wrfprs_d02.120
> > > > > WARNING:
> > > > > WARNING: MetGrib1DataFile::data_plane() -> No exact match
found for
> > > > VarInfo
> > > > > "APCP/A120" in GRIB file "wrfprs_d02.120".
> > > > > WARNING:
> > > > > ERROR :
> > > > > ERROR : get_field() -> can't get data plane from file
> > "wrfprs_d02.120"
> > > > > ERROR :
> > > > >
> > > > > Thanking You
> > > > > With Best Regards
> > > > > ________________________
> > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > Asst. Prof., Mathematics
> > > > > *Kalinga Institute of Industrial Technology,*
> > > > > *Deemed to be University, Bhubaneswar*
> > > > > *Mobile- 09861182688*
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT <
> > > > > met_help at ucar.edu> wrote:
> > > > >
> > > > > > Biranchi,
> > > > > >
> > > > > > I found this image showing 3B42 data for 20160229:
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > > > > >
> > > > > > I grabbed the NetCDF file for that day and tried to plot
it in
> MET.
> > > > But
> > > > > > the number of latitude values changed... 480 in recent
data but
> 400
> > > in
> > > > > > older data. So I updated the script to parse the lat/lon
info on
> > the
> > > > > fly.
> > > > > > Also, I noticed that the picture in MET is upside down...
> compared
> > to
> > > > the
> > > > > > NASA image. So I flipped it.
> > > > > >
> > > > > > The updated script is attached as well as the image
generated by
> > this
> > > > > > command:
> > > > > >
> > > > > > met-8.0/bin/plot_data_plane PYTHON_NUMPY
> 3B42_Daily.20160229.7.ps
> > \
> > > > > > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4
> precipitation";'
> > \
> > > > > > -plot_range 0 100
> > > > > >
> > > > > > That should now match this image:
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
> > > > > >
> > > > > > Thanks,
> > > > > > John
> > > > > >
> > > > > > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT <
> > > > > met_help at ucar.edu
> > > > > > >
> > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> >
> > > > > > >
> > > > > > > Sir,
> > > > > > > The new script works fine for both.
> > > > > > > Thanking You
> > > > > > > With Best Regards
> > > > > > > ________________________
> > > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > > Asst. Prof., Mathematics
> > > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > > *Mobile- 09861182688*
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
> > > > > > biranchimahala at gmail.com
> > > > > > > >
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Sir,
> > > > > > > > Can you please brief how to compare the precipitation
images
> > with
> > > > > NASA
> > > > > > > > plots.
> > > > > > > >
> > > > > > > > Thanking You
> > > > > > > > With Best Regards
> > > > > > > > ________________________
> > > > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > > > Asst. Prof., Mathematics
> > > > > > > > *Kalinga Institute of Industrial Technology,*
> > > > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > > > *Mobile- 09861182688*
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway
via RT <
> > > > > > > > met_help at ucar.edu> wrote:
> > > > > > > >
> > > > > > > >> Ah yes, there are more differences in these files.
> > > > > > > >>
> > > > > > > >> For some reason the Daily files store data in lon,
lat
> order:
> > > > > > > >> float precipitation(lon, lat) ;
> > > > > > > >> While the 3-hourly files store data in lat, lon
order:
> > > > > > > >> float precipitation(lat, lon) ;
> > > > > > > >>
> > > > > > > >> That's pretty frustrating! OK, I updated the script
to
> check
> > > for
> > > > > > (lat,
> > > > > > > >> lon) versus (lon, lat) ordering... and take the
transpose in
> > the
> > > > > > latter
> > > > > > > >> case. I tested using these commands:
> > > > > > > >>
> > > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
> > > > 3B42RT_Daily.20180821.7.ps
> > > > > \
> > > > > > > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > > > > precipitation";'
> > > > > > > >>
> > > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
> > 3B42RT.2018082100.7.ps
> > > \
> > > > > > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
> > > precipitation";'
> > > > > > > >>
> > > > > > > >> I have attached the updated script and these 2 test
images.
> > > > > > > >>
> > > > > > > >> However, it would be wise to independently verify
that the
> > > precip
> > > > is
> > > > > > in
> > > > > > > >> the
> > > > > > > >> right spot. Can you compare these images to NASA
plots for
> > the
> > > > same
> > > > > > > >> times?
> > > > > > > >>
> > > > > > > >> Thanks,
> > > > > > > >> John
> > > > > > > >>
> > > > > > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via
RT <
> > > > > > > >> met_help at ucar.edu>
> > > > > > > >> wrote:
> > > > > > > >>
> > > > > > > >> >
> > > > > > > >> > <URL:
> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > >
> > > > > > > >> >
> > > > > > > >> > Sir,
> > > > > > > >> > The script works fine for
> > > > > > > >> > python read_3B42RT.py
> > > ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > > > > >> > precipitation
> > > > > > > >> > But the output of the command;
> > > > > > > >> > plot_data_plane PYTHON_NUMPY 3B42RT.2018082100.7.ps
> > > > > > > >> > 'name="./read_3B42RT.py
> > > > > > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4
> precipitation";'
> > > > > > > >> > shows the following;
> > > > > > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
> > > > > > > >> > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > > > > >> > Variable Name : 'precipitation'
> > > > > > > >> > Data Shape: (1440, 480)
> > > > > > > >> > Data Type: dtype('float64')
> > > > > > > >> > Begin Time = 2018-08-20 22:30:00
> > > > > > > >> > End Time = 2018-08-21 01:30:00
> > > > > > > >> > Accum Time = 030000
> > > > > > > >> > Attributes: {'long_name': 'precipitation', 'init':
> > > > > > '20180821_013000',
> > > > > > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat':
0.25,
> > > > 'lon_ll':
> > > > > > > >> -179.875,
> > > > > > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll':
-59.875,
> > > > 'delta_lon':
> > > > > > > 0.25,
> > > > > > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name':
'precipitation',
> > > > 'lead':
> > > > > > > '00',
> > > > > > > >> > 'level': 'Surface', 'units': 'mm', 'accum':
'030000'}
> > > > > > > >> > DEBUG 1: Creating postscript file:
3B42RT.2018082100.7.ps
> > > > > > > >> > ERROR :
> > > > > > > >> > ERROR : DataPlane::two_to_one() -> range check
error:
> (Nx,
> > > Ny)
> > > > =
> > > > > > > (480,
> > > > > > > >> > 1440), (x, y) = (480, 0)
> > > > > > > >> > ERROR :
> > > > > > > >> >
> > > > > > > >> > Thanking You
> > > > > > > >> > With Best Regards
> > > > > > > >> > ________________________
> > > > > > > >> > Dr. BIRANCHI KUMAR MAHALA
> > > > > > > >> > Asst. Prof., Mathematics
> > > > > > > >> > *Kalinga Institute of Industrial Technology,*
> > > > > > > >> > *Deemed to be University, Bhubaneswar*
> > > > > > > >> > *Mobile- 09861182688*
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley Gotway
via
> RT <
> > > > > > > >> > met_help at ucar.edu> wrote:
> > > > > > > >> >
> > > > > > > >> > > Biranchi,
> > > > > > > >> > >
> > > > > > > >> > > Looking very closely at the 3B42RT NetCDF files
and the
> > > error
> > > > > > > message
> > > > > > > >> > from
> > > > > > > >> > > that python script, it looks like the time
formats are
> > very
> > > > > > slightly
> > > > > > > >> > > different.
> > > > > > > >> > >
> > > > > > > >> > > The Daily files include microseconds:
> > > > > > > >> > > :BeginTime = "01:30:00.000Z" ;
> > > > > > > >> > > :EndTime = "01:29:59.999Z" ;
> > > > > > > >> > >
> > > > > > > >> > > The 3-hourly files do not:
> > > > > > > >> > > :BeginTime = "22:30:00Z" ;
> > > > > > > >> > > :EndTime = "01:30:00Z" ;
> > > > > > > >> > >
> > > > > > > >> > > Other than that, they're the same. So I created
a new
> > > script
> > > > > > named
> > > > > > > >> > > "read_3B42RT.py" (see attached) which should
handle both
> > the
> > > > > daily
> > > > > > > and
> > > > > > > >> > > 3-hourly files. I parses the times with or
without the
> > > > > > microseconds
> > > > > > > >> > > included:
> > > > > > > >> > >
> > > > > > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
> > precipitation
> > > > > > > >> > > python read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
> > > > precipitation
> > > > > > > >> > >
> > > > > > > >> > > Hopefully that does the trick.
> > > > > > > >> > >
> > > > > > > >> > > Thanks,
> > > > > > > >> > > John
> > > > > > > >> > >
> > > > > > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala
via RT <
> > > > > > > >> > met_help at ucar.edu>
> > > > > > > >> > > wrote:
> > > > > > > >> > >
> > > > > > > >> > > >
> > > > > > > >> > > > <URL:
> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > > >
> > > > > > > >> > > >
> > > > > > > >> > > > Sir,
> > > > > > > >> > > > The command:
> > > > > > > >> > > > python read_3B42RT_3hours.py
> > > > > > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
> > > > > > > >> > > > precipitation
> > > > > > > >> > > > shows the following message:
> > > > > > > >> > > > Input File:
> './input/sample_obs/3B42RT.2018082100.7.nc4'
> > > > > > > >> > > > Variable Name : 'precipitation'
> > > > > > > >> > > > Data Shape: (1440, 480)
> > > > > > > >> > > > Data Type: dtype('float64')
> > > > > > > >> > > > Traceback (most recent call last):
> > > > > > > >> > > > File "read_3B42RT_3hours.py", line 49, in
<module>
> > > > > > > >> > > > beg_time =
dt.datetime.strptime(beg_time_str,
> > > > > "%Y-%m-%d
> > > > > > > >> > > > %H:%M:%S.%fZ")
> > > > > > > >> > > > File "/usr/lib64/python2.7/_strptime.py",
line 332,
> in
> > > > > > _strptime
> > > > > > > >> > > > (data_string, format))
> > > > > > > >> > > > ValueError: time data '2018-08-20 22:30:00Z'
does not
> > > match
> > > > > > format
> > > > > > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
> > > > > > > >> > > >
> > > > > > > >> > > > So I could not run mode ...
> > > > > > > >> > > > Thanking You
> > > > > > > >> > > > With Best Regards
> > > > > > > >> > > > ________________________
> > > > > > > >> > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > > >> > > > Asst. Prof., Mathematics
> > > > > > > >> > > > *Kalinga Institute of Industrial Technology,*
> > > > > > > >> > > > *Deemed to be University, Bhubaneswar*
> > > > > > > >> > > > *Mobile- 09861182688*
> > > > > > > >> > > >
> > > > > > > >> > > >
> > > > > > > >> > > >
> > > > > > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley
Gotway via
> > RT
> > > <
> > > > > > > >> > > > met_help at ucar.edu>
> > > > > > > >> > > > wrote:
> > > > > > > >> > > >
> > > > > > > >> > > > > So we worked together through the details of
> writing a
> > > > > python
> > > > > > > >> script
> > > > > > > >> > > for
> > > > > > > >> > > > > reading the daily 3B42RT datasets.
> > > > > > > >> > > > >
> > > > > > > >> > > > > Now, you need to adapt that script for
handling the
> > > > 3-hourly
> > > > > > > >> 3B42RT
> > > > > > > >> > > > data...
> > > > > > > >> > > > > let's say that you've done that and called it
> > > > > > > >> > "read_3B42RT_3hours.py".
> > > > > > > >> > > > You
> > > > > > > >> > > > > should use that Python script when running
MODE,
> like
> > > > this:
> > > > > > > >> > > > >
> > > > > > > >> > > > > mode
> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
> > > > > > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
> > > > > > ./output/mode_analysis \
> > > > > > > >> > > > > -v 2
> > > > > > > >> > > > >
> > > > > > > >> > > > > And then in the MODE config file:
> > > > > > > >> > > > >
> > > > > > > >> > > > > fcst = {
> > > > > > > >> > > > > field = { name = "APCP_03"; level =
"(*,*)"; }
> > > > > > > >> > > > > censor_thresh = [];
> > > > > > > >> > > > > censor_val = [];
> > > > > > > >> > > > > conv_radius = 60.0/grid_res; // in
grid
> > > squares
> > > > > > > >> > > > > conv_thresh = >=5.0;
> > > > > > > >> > > > > vld_thresh = 0.5;
> > > > > > > >> > > > > filter_attr_name = [];
> > > > > > > >> > > > > filter_attr_thresh = [];
> > > > > > > >> > > > > merge_thresh = >=1.25;
> > > > > > > >> > > > > merge_flag = THRESH;
> > > > > > > >> > > > > }
> > > > > > > >> > > > > obs = fcst;
> > > > > > > >> > > > > obs = {
> > > > > > > >> > > > > field = { name="read_3B42RT_3hours.py
> > > > > > > >> read_3B42RT.2018082100.7.nc4
> > > > > > > >> > > > > precipitation"; }
> > > > > > > >> > > > > }
> > > > > > > >> > > > >
> > > > > > > >> > > > > Does that make sense?
> > > > > > > >> > > > >
> > > > > > > >> > > > > Thanks,
> > > > > > > >> > > > > John
> > > > > > > >> > > > >
> > > > > > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi
Mahala via
> > RT
> > > <
> > > > > > > >> > > > met_help at ucar.edu
> > > > > > > >> > > > > >
> > > > > > > >> > > > > wrote:
> > > > > > > >> > > > >
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481 was
acted
> > > upon.
> > > > > > > >> > > > > > Transaction: Ticket created by
> > > biranchimahala at gmail.com
> > > > > > > >> > > > > > Queue: met_help
> > > > > > > >> > > > > > Subject: (No subject given)
> > > > > > > >> > > > > > Owner: Nobody
> > > > > > > >> > > > > > Requestors: biranchimahala at gmail.com
> > > > > > > >> > > > > > Status: new
> > > > > > > >> > > > > > Ticket <URL:
> > > > > > > >> > >
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
> > > > > > > >> > > > >
> > > > > > > >> > > > > >
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > Sir,
> > > > > > > >> > > > > > I am able to run mode of MET-8.0 with the
> assistance
> > > of
> > > > > > > met_help
> > > > > > > >> > > team.
> > > > > > > >> > > > > > Now I am getting sum warnings while running
mode
> as
> > > > > follows.
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > mode
> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > > > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default
-outdir
> > > > > > > >> > > > > ./output/mode_analysis/
> > > > > > > >> > > > > > -v 2
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > DEBUG 1: Default Config File:
> > > > > > > >> > > > > /MET_V8/share/met//config/MODEConfig_default
> > > > > > > >> > > > > > DEBUG 1: Match Config File:
MODEConfig_default
> > > > > > > >> > > > > > DEBUG 1: Merge Config File:
MODEConfig_default
> > > > > > > >> > > > > > WARNING:
> > > > > > > >> > > > > > WARNING: NcCfFile::open() -> could not
determine
> the
> > > > valid
> > > > > > > time,
> > > > > > > >> > > using
> > > > > > > >> > > > 0.
> > > > > > > >> > > > > > WARNING:
> > > > > > > >> > > > > > DEBUG 1: Forecast File:
> > > > > > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
> > > > > > > >> > > > > > DEBUG 1: Observation File:
3B42RT.2018082100.7.nc4
> > > > > > > >> > > > > > DEBUG 1: Regridding observation
precipitation(*,*)
> > to
> > > > the
> > > > > > > >> > > verification
> > > > > > > >> > > > > > grid.
> > > > > > > >> > > > > > WARNING:
> > > > > > > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast
and
> > > > observation
> > > > > > > valid
> > > > > > > >> > > times
> > > > > > > >> > > > do
> > > > > > > >> > > > > > not match 20180821_000000 !=
19700101_000000 for
> > > > > > APCP_03(*,*)
> > > > > > > >> > versus
> > > > > > > >> > > > > > precipitation(*,*).
> > > > > > > >> > > > > > WARNING:
> > > > > > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
> > > > > > > >> > > > > > DEBUG 1: Observation Field: precipitation
at *,*
> > > > > > > >> > > > > > DEBUG 2: Processing masking regions.
> > > > > > > >> > > > > > DEBUG 2: Identifying objects in the
forecast and
> > > > > observation
> > > > > > > >> > > fields...
> > > > > > > >> > > > > > DEBUG 2: Computing contingency table
statistics...
> > > > > > > >> > > > > > DEBUG 2: Identified: 0 forecast objects and
0
> > > > observation
> > > > > > > >> objects.
> > > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> forecast
> > > > > field.
> > > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in the
> > > observation
> > > > > > field.
> > > > > > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and
0
> > > observation
> > > > > > > >> objects.
> > > > > > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH)
between
> > the
> > > > > > forecast
> > > > > > > >> and
> > > > > > > >> > > > > > observation fields.
> > > > > > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object
Statistics file:
> > > > > > > >> > > > > >
> > > > > > > >> >
> > > > > >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
> > > > > > > >> > > > > > DEBUG 1: Creating Contingency Table
Statistics
> file:
> > > > > > > >> > > > > >
> > > > > > > >> >
> > > > > >
> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
> > > > > > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
> > > > > > > >> > > > > >
> > > > > > > >> >
> > > > >
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
> > > > > > > >> > > > > > DEBUG 1: Loading forecast raw color table:
> > > > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
> > > > > > > >> > > > > > DEBUG 1: Loading observation raw color
table:
> > > > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
> > > > > > > >> > > > > > DEBUG 1: Creating postscript file:
> > > > > > > >> > > > > >
> > > > > > >
> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
> > > > > > > >> > > > > >
> > > > > > > >> > > > > > Am I doing some mistakes or the above
warnings are
> > > > general
> > > > > > due
> > > > > > > >> to
> > > > > > > >> > > > > > observation and fcst time mismatch.
> > > > > > > >> > > > > > Kindly find the attachments for reference.
> > > > > > > >> > > > > > Thanking You
> > > > > > > >> > > > > > With Best Regards
> > > > > > > >> > > > > > ________________________
> > > > > > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
> > > > > > > >> > > > > > Asst. Prof., Mathematics
> > > > > > > >> > > > > > *Kalinga Institute of Industrial
Technology,*
> > > > > > > >> > > > > > *Deemed to be University, Bhubaneswar*
> > > > > > > >> > > > > > *Mobile- 09861182688*
> > > > > > > >> > > > > >
> > > > > > > >> > > > > >
> > > > > > > >> > > > >
> > > > > > > >> > > > >
> > > > > > > >> > > >
> > > > > > > >> > > >
> > > > > > > >> > >
> > > > > > > >> > >
> > > > > > > >> >
> > > > > > > >> >
> > > > > > > >>
> > > > > > > >>
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
> >
> >
>
>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Wed Oct 31 13:38:36 2018
OK, I just finished posting the bugfix for this here:
https://dtcenter.org/met/users/support/known_issues/METv8.0/index.php
Thanks,
John
On Wed, Oct 31, 2018 at 11:40 AM John Halley Gotway <johnhg at ucar.edu>
wrote:
> Thank you for posting your sample data. I retrieved them and was
able to
> replicate the exact behavior you described. Running through the
debugger I
> was able to identify a slight bug in the GRIB1 library code we're
using.
> The fix is a simple one-line change, but unfortunately, this will
require a
> bugfix. I'll get that done and posted as soon as possible and will
write
> to let you know when it's available.
>
> My apologies but thanks for helping us debug the code.
>
> John
>
> On Mon, Oct 29, 2018 at 12:04 PM Biranchi Mahala via RT
<met_help at ucar.edu>
> wrote:
>
>>
>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>>
>> Sir,
>> It is sent to your site under the directory mahala_data
>>
>> for information.
>> Thanking You
>> With Best Regards
>> ________________________
>> Dr. BIRANCHI KUMAR MAHALA
>> Asst. Prof., Mathematics
>> *Kalinga Institute of Industrial Technology,*
>> *Deemed to be University, Bhubaneswar*
>> *Mobile- 09861182688*
>>
>>
>>
>> On Mon, Oct 29, 2018 at 11:17 PM John Halley Gotway via RT <
>> met_help at ucar.edu> wrote:
>>
>> > Sure enough! I clearly see the 120 hour accumulation in that
file and
>> > would expect that pcp_combine command to work exactly how you
have
>> written
>> > it.
>> >
>> > I'd like to try to replicate this behavior here and debug. Can
you
>> please
>> > post the 96 and 120 forecast files "wrfprs_d02.120" to our
anonymous FTP
>> > site following these instructions?
>> > https://dtcenter.org/met/users/support/met_help.php#ftp
>> >
>> > Please write once they're there so I know to go grab them.
>> >
>> > Thanks,
>> > John
>> >
>> > On Mon, Oct 29, 2018 at 11:28 AM Biranchi Mahala via RT <
>> met_help at ucar.edu
>> > >
>> > wrote:
>> >
>> > >
>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>> > >
>> > > Sir,
>> > > * wgrib **wrfprs_d02.120 | grep APCP* command shows the
following;
>> > > bash: AerosolCoeff.bin: command not found...
>> > > whreas the command
>> > > wgrib wrfprs_d02.120 | grep APCP
>> > > shows the following;
>> > >
>> > >
>> >
>>
310:20113176:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=120:TimeU=1:sfc:0-
120hr
>> > > acc:NAve=0
>> > > Also
>> > > wgrib wrfprs_d02.96 | grep APCP
>> > > shows the following;
>> > >
>> > >
>> >
>>
310:19992520:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=96:TimeU=1:sfc:0-
96hr
>> > > acc:NAve=0
>> > >
>> > >
>> > > For information.
>> > > Thanking You
>> > > With Best Regards
>> > > ________________________
>> > > Dr. BIRANCHI KUMAR MAHALA
>> > > Asst. Prof., Mathematics
>> > > *Kalinga Institute of Industrial Technology,*
>> > > *Deemed to be University, Bhubaneswar*
>> > > *Mobile- 09861182688*
>> > >
>> > >
>> > >
>> > > On Mon, Oct 29, 2018 at 9:31 PM John Halley Gotway via RT <
>> > > met_help at ucar.edu>
>> > > wrote:
>> > >
>> > > > Dr. Biranchi,
>> > > >
>> > > > So you've seen the following error from pcp_combine:
>> > > > ERROR : get_field() -> can't get data plane from file
>> "wrfprs_d02.120"
>> > > >
>> > > > The most likely explanation is that the input file
(wrfprs_d02.120)
>> > > really
>> > > > does not contain a record for 120-hour accumulated
precipitation.
>> > > >
>> > > > If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2) tools
>> > available,
>> > > > please use them to inventory this file and check what precip
>> > accumulation
>> > > > actually is available:
>> > > > * wgrib **wrfprs_d02.120 | grep APCP*
>> > > >
>> > > > Thanks,
>> > > > John
>> > > >
>> > > > On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT <
>> > > met_help at ucar.edu>
>> > > > wrote:
>> > > >
>> > > > >
>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>> > > > >
>> > > > > Sir,
>> > > > > Now it works.
>> > > > > I have another query as below.
>> > > > > I am trying to run pcp_combine tool to find the APCP by
running
>> the
>> > > > > command;
>> > > > > pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
>> > > > > APCP_24h_00utc15Aug2018.nc -pcpdir ./
>> > > > > The output of the above command shows the following ;
>> > > > > DEBUG 1: Reading input file: wrfprs_d02.120
>> > > > > WARNING:
>> > > > > WARNING: MetGrib1DataFile::data_plane() -> No exact match
found
>> for
>> > > > VarInfo
>> > > > > "APCP/A120" in GRIB file "wrfprs_d02.120".
>> > > > > WARNING:
>> > > > > ERROR :
>> > > > > ERROR : get_field() -> can't get data plane from file
>> > "wrfprs_d02.120"
>> > > > > ERROR :
>> > > > >
>> > > > > Thanking You
>> > > > > With Best Regards
>> > > > > ________________________
>> > > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > > Asst. Prof., Mathematics
>> > > > > *Kalinga Institute of Industrial Technology,*
>> > > > > *Deemed to be University, Bhubaneswar*
>> > > > > *Mobile- 09861182688*
>> > > > >
>> > > > >
>> > > > >
>> > > > > On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT
<
>> > > > > met_help at ucar.edu> wrote:
>> > > > >
>> > > > > > Biranchi,
>> > > > > >
>> > > > > > I found this image showing 3B42 data for 20160229:
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
>> > > > > >
>> > > > > > I grabbed the NetCDF file for that day and tried to plot
it in
>> MET.
>> > > > But
>> > > > > > the number of latitude values changed... 480 in recent
data but
>> 400
>> > > in
>> > > > > > older data. So I updated the script to parse the lat/lon
info
>> on
>> > the
>> > > > > fly.
>> > > > > > Also, I noticed that the picture in MET is upside down...
>> compared
>> > to
>> > > > the
>> > > > > > NASA image. So I flipped it.
>> > > > > >
>> > > > > > The updated script is attached as well as the image
generated by
>> > this
>> > > > > > command:
>> > > > > >
>> > > > > > met-8.0/bin/plot_data_plane PYTHON_NUMPY
>> 3B42_Daily.20160229.7.ps
>> > \
>> > > > > > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4
>> precipitation";'
>> > \
>> > > > > > -plot_range 0 100
>> > > > > >
>> > > > > > That should now match this image:
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
>> > > > > >
>> > > > > > Thanks,
>> > > > > > John
>> > > > > >
>> > > > > > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT <
>> > > > > met_help at ucar.edu
>> > > > > > >
>> > > > > > wrote:
>> > > > > >
>> > > > > > >
>> > > > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>> >
>> > > > > > >
>> > > > > > > Sir,
>> > > > > > > The new script works fine for both.
>> > > > > > > Thanking You
>> > > > > > > With Best Regards
>> > > > > > > ________________________
>> > > > > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > > > > Asst. Prof., Mathematics
>> > > > > > > *Kalinga Institute of Industrial Technology,*
>> > > > > > > *Deemed to be University, Bhubaneswar*
>> > > > > > > *Mobile- 09861182688*
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
>> > > > > > biranchimahala at gmail.com
>> > > > > > > >
>> > > > > > > wrote:
>> > > > > > >
>> > > > > > > > Sir,
>> > > > > > > > Can you please brief how to compare the precipitation
images
>> > with
>> > > > > NASA
>> > > > > > > > plots.
>> > > > > > > >
>> > > > > > > > Thanking You
>> > > > > > > > With Best Regards
>> > > > > > > > ________________________
>> > > > > > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > > > > > Asst. Prof., Mathematics
>> > > > > > > > *Kalinga Institute of Industrial Technology,*
>> > > > > > > > *Deemed to be University, Bhubaneswar*
>> > > > > > > > *Mobile- 09861182688*
>> > > > > > > >
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway
via RT <
>> > > > > > > > met_help at ucar.edu> wrote:
>> > > > > > > >
>> > > > > > > >> Ah yes, there are more differences in these files.
>> > > > > > > >>
>> > > > > > > >> For some reason the Daily files store data in lon,
lat
>> order:
>> > > > > > > >> float precipitation(lon, lat) ;
>> > > > > > > >> While the 3-hourly files store data in lat, lon
order:
>> > > > > > > >> float precipitation(lat, lon) ;
>> > > > > > > >>
>> > > > > > > >> That's pretty frustrating! OK, I updated the script
to
>> check
>> > > for
>> > > > > > (lat,
>> > > > > > > >> lon) versus (lon, lat) ordering... and take the
transpose
>> in
>> > the
>> > > > > > latter
>> > > > > > > >> case. I tested using these commands:
>> > > > > > > >>
>> > > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
>> > > > 3B42RT_Daily.20180821.7.ps
>> > > > > \
>> > > > > > > >> 'name="read_3B42RT.py 3B42RT_Daily.20180821.7.nc4
>> > > > > precipitation";'
>> > > > > > > >>
>> > > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
>> > 3B42RT.2018082100.7.ps
>> > > \
>> > > > > > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
>> > > precipitation";'
>> > > > > > > >>
>> > > > > > > >> I have attached the updated script and these 2 test
images.
>> > > > > > > >>
>> > > > > > > >> However, it would be wise to independently verify
that the
>> > > precip
>> > > > is
>> > > > > > in
>> > > > > > > >> the
>> > > > > > > >> right spot. Can you compare these images to NASA
plots for
>> > the
>> > > > same
>> > > > > > > >> times?
>> > > > > > > >>
>> > > > > > > >> Thanks,
>> > > > > > > >> John
>> > > > > > > >>
>> > > > > > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala via
RT <
>> > > > > > > >> met_help at ucar.edu>
>> > > > > > > >> wrote:
>> > > > > > > >>
>> > > > > > > >> >
>> > > > > > > >> > <URL:
>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>> > > >
>> > > > > > > >> >
>> > > > > > > >> > Sir,
>> > > > > > > >> > The script works fine for
>> > > > > > > >> > python read_3B42RT.py
>> > > ./input/sample_obs/3B42RT.2018082100.7.nc4
>> > > > > > > >> > precipitation
>> > > > > > > >> > But the output of the command;
>> > > > > > > >> > plot_data_plane PYTHON_NUMPY
3B42RT.2018082100.7.ps
>> > > > > > > >> > 'name="./read_3B42RT.py
>> > > > > > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4
>> precipitation";'
>> > > > > > > >> > shows the following;
>> > > > > > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
>> > > > > > > >> > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
>> > > > > > > >> > Variable Name : 'precipitation'
>> > > > > > > >> > Data Shape: (1440, 480)
>> > > > > > > >> > Data Type: dtype('float64')
>> > > > > > > >> > Begin Time = 2018-08-20 22:30:00
>> > > > > > > >> > End Time = 2018-08-21 01:30:00
>> > > > > > > >> > Accum Time = 030000
>> > > > > > > >> > Attributes: {'long_name': 'precipitation', 'init':
>> > > > > > '20180821_013000',
>> > > > > > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat':
0.25,
>> > > > 'lon_ll':
>> > > > > > > >> -179.875,
>> > > > > > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll':
-59.875,
>> > > > 'delta_lon':
>> > > > > > > 0.25,
>> > > > > > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name':
'precipitation',
>> > > > 'lead':
>> > > > > > > '00',
>> > > > > > > >> > 'level': 'Surface', 'units': 'mm', 'accum':
'030000'}
>> > > > > > > >> > DEBUG 1: Creating postscript file:
>> 3B42RT.2018082100.7.ps
>> > > > > > > >> > ERROR :
>> > > > > > > >> > ERROR : DataPlane::two_to_one() -> range check
error:
>> (Nx,
>> > > Ny)
>> > > > =
>> > > > > > > (480,
>> > > > > > > >> > 1440), (x, y) = (480, 0)
>> > > > > > > >> > ERROR :
>> > > > > > > >> >
>> > > > > > > >> > Thanking You
>> > > > > > > >> > With Best Regards
>> > > > > > > >> > ________________________
>> > > > > > > >> > Dr. BIRANCHI KUMAR MAHALA
>> > > > > > > >> > Asst. Prof., Mathematics
>> > > > > > > >> > *Kalinga Institute of Industrial Technology,*
>> > > > > > > >> > *Deemed to be University, Bhubaneswar*
>> > > > > > > >> > *Mobile- 09861182688*
>> > > > > > > >> >
>> > > > > > > >> >
>> > > > > > > >> >
>> > > > > > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley
Gotway via
>> RT <
>> > > > > > > >> > met_help at ucar.edu> wrote:
>> > > > > > > >> >
>> > > > > > > >> > > Biranchi,
>> > > > > > > >> > >
>> > > > > > > >> > > Looking very closely at the 3B42RT NetCDF files
and the
>> > > error
>> > > > > > > message
>> > > > > > > >> > from
>> > > > > > > >> > > that python script, it looks like the time
formats are
>> > very
>> > > > > > slightly
>> > > > > > > >> > > different.
>> > > > > > > >> > >
>> > > > > > > >> > > The Daily files include microseconds:
>> > > > > > > >> > > :BeginTime = "01:30:00.000Z" ;
>> > > > > > > >> > > :EndTime = "01:29:59.999Z" ;
>> > > > > > > >> > >
>> > > > > > > >> > > The 3-hourly files do not:
>> > > > > > > >> > > :BeginTime = "22:30:00Z" ;
>> > > > > > > >> > > :EndTime = "01:30:00Z" ;
>> > > > > > > >> > >
>> > > > > > > >> > > Other than that, they're the same. So I created
a new
>> > > script
>> > > > > > named
>> > > > > > > >> > > "read_3B42RT.py" (see attached) which should
handle
>> both
>> > the
>> > > > > daily
>> > > > > > > and
>> > > > > > > >> > > 3-hourly files. I parses the times with or
without the
>> > > > > > microseconds
>> > > > > > > >> > > included:
>> > > > > > > >> > >
>> > > > > > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
>> > precipitation
>> > > > > > > >> > > python read_3B42RT.py
3B42RT_Daily.20180821.7.nc4
>> > > > precipitation
>> > > > > > > >> > >
>> > > > > > > >> > > Hopefully that does the trick.
>> > > > > > > >> > >
>> > > > > > > >> > > Thanks,
>> > > > > > > >> > > John
>> > > > > > > >> > >
>> > > > > > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala
via RT
>> <
>> > > > > > > >> > met_help at ucar.edu>
>> > > > > > > >> > > wrote:
>> > > > > > > >> > >
>> > > > > > > >> > > >
>> > > > > > > >> > > > <URL:
>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>> > > > > >
>> > > > > > > >> > > >
>> > > > > > > >> > > > Sir,
>> > > > > > > >> > > > The command:
>> > > > > > > >> > > > python read_3B42RT_3hours.py
>> > > > > > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
>> > > > > > > >> > > > precipitation
>> > > > > > > >> > > > shows the following message:
>> > > > > > > >> > > > Input File:
>> './input/sample_obs/3B42RT.2018082100.7.nc4'
>> > > > > > > >> > > > Variable Name : 'precipitation'
>> > > > > > > >> > > > Data Shape: (1440, 480)
>> > > > > > > >> > > > Data Type: dtype('float64')
>> > > > > > > >> > > > Traceback (most recent call last):
>> > > > > > > >> > > > File "read_3B42RT_3hours.py", line 49, in
<module>
>> > > > > > > >> > > > beg_time =
dt.datetime.strptime(beg_time_str,
>> > > > > "%Y-%m-%d
>> > > > > > > >> > > > %H:%M:%S.%fZ")
>> > > > > > > >> > > > File "/usr/lib64/python2.7/_strptime.py",
line
>> 332, in
>> > > > > > _strptime
>> > > > > > > >> > > > (data_string, format))
>> > > > > > > >> > > > ValueError: time data '2018-08-20 22:30:00Z'
does not
>> > > match
>> > > > > > format
>> > > > > > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
>> > > > > > > >> > > >
>> > > > > > > >> > > > So I could not run mode ...
>> > > > > > > >> > > > Thanking You
>> > > > > > > >> > > > With Best Regards
>> > > > > > > >> > > > ________________________
>> > > > > > > >> > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > > > > >> > > > Asst. Prof., Mathematics
>> > > > > > > >> > > > *Kalinga Institute of Industrial Technology,*
>> > > > > > > >> > > > *Deemed to be University, Bhubaneswar*
>> > > > > > > >> > > > *Mobile- 09861182688*
>> > > > > > > >> > > >
>> > > > > > > >> > > >
>> > > > > > > >> > > >
>> > > > > > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley
Gotway
>> via
>> > RT
>> > > <
>> > > > > > > >> > > > met_help at ucar.edu>
>> > > > > > > >> > > > wrote:
>> > > > > > > >> > > >
>> > > > > > > >> > > > > So we worked together through the details of
>> writing a
>> > > > > python
>> > > > > > > >> script
>> > > > > > > >> > > for
>> > > > > > > >> > > > > reading the daily 3B42RT datasets.
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > Now, you need to adapt that script for
handling the
>> > > > 3-hourly
>> > > > > > > >> 3B42RT
>> > > > > > > >> > > > data...
>> > > > > > > >> > > > > let's say that you've done that and called
it
>> > > > > > > >> > "read_3B42RT_3hours.py".
>> > > > > > > >> > > > You
>> > > > > > > >> > > > > should use that Python script when running
MODE,
>> like
>> > > > this:
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > mode
>> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
>> > > > > > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
>> > > > > > ./output/mode_analysis \
>> > > > > > > >> > > > > -v 2
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > And then in the MODE config file:
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > fcst = {
>> > > > > > > >> > > > > field = { name = "APCP_03"; level =
"(*,*)"; }
>> > > > > > > >> > > > > censor_thresh = [];
>> > > > > > > >> > > > > censor_val = [];
>> > > > > > > >> > > > > conv_radius = 60.0/grid_res; // in
grid
>> > > squares
>> > > > > > > >> > > > > conv_thresh = >=5.0;
>> > > > > > > >> > > > > vld_thresh = 0.5;
>> > > > > > > >> > > > > filter_attr_name = [];
>> > > > > > > >> > > > > filter_attr_thresh = [];
>> > > > > > > >> > > > > merge_thresh = >=1.25;
>> > > > > > > >> > > > > merge_flag = THRESH;
>> > > > > > > >> > > > > }
>> > > > > > > >> > > > > obs = fcst;
>> > > > > > > >> > > > > obs = {
>> > > > > > > >> > > > > field = { name="read_3B42RT_3hours.py
>> > > > > > > >> read_3B42RT.2018082100.7.nc4
>> > > > > > > >> > > > > precipitation"; }
>> > > > > > > >> > > > > }
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > Does that make sense?
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > Thanks,
>> > > > > > > >> > > > > John
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi
Mahala
>> via
>> > RT
>> > > <
>> > > > > > > >> > > > met_help at ucar.edu
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > wrote:
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481
was acted
>> > > upon.
>> > > > > > > >> > > > > > Transaction: Ticket created by
>> > > biranchimahala at gmail.com
>> > > > > > > >> > > > > > Queue: met_help
>> > > > > > > >> > > > > > Subject: (No subject given)
>> > > > > > > >> > > > > > Owner: Nobody
>> > > > > > > >> > > > > > Requestors: biranchimahala at gmail.com
>> > > > > > > >> > > > > > Status: new
>> > > > > > > >> > > > > > Ticket <URL:
>> > > > > > > >> > >
>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>> > > > > > > >> > > > >
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > > Sir,
>> > > > > > > >> > > > > > I am able to run mode of MET-8.0 with the
>> assistance
>> > > of
>> > > > > > > met_help
>> > > > > > > >> > > team.
>> > > > > > > >> > > > > > Now I am getting sum warnings while
running mode
>> as
>> > > > > follows.
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > > mode
>> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
>> > > > > > > >> > > > > > 3B42RT.2018082100.7.nc4 MODEConfig_default
>> -outdir
>> > > > > > > >> > > > > ./output/mode_analysis/
>> > > > > > > >> > > > > > -v 2
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > > DEBUG 1: Default Config File:
>> > > > > > > >> > > > > /MET_V8/share/met//config/MODEConfig_default
>> > > > > > > >> > > > > > DEBUG 1: Match Config File:
MODEConfig_default
>> > > > > > > >> > > > > > DEBUG 1: Merge Config File:
MODEConfig_default
>> > > > > > > >> > > > > > WARNING:
>> > > > > > > >> > > > > > WARNING: NcCfFile::open() -> could not
determine
>> the
>> > > > valid
>> > > > > > > time,
>> > > > > > > >> > > using
>> > > > > > > >> > > > 0.
>> > > > > > > >> > > > > > WARNING:
>> > > > > > > >> > > > > > DEBUG 1: Forecast File:
>> > > > > > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
>> > > > > > > >> > > > > > DEBUG 1: Observation File:
>> 3B42RT.2018082100.7.nc4
>> > > > > > > >> > > > > > DEBUG 1: Regridding observation
>> precipitation(*,*)
>> > to
>> > > > the
>> > > > > > > >> > > verification
>> > > > > > > >> > > > > > grid.
>> > > > > > > >> > > > > > WARNING:
>> > > > > > > >> > > > > > WARNING: setup_fcst_obs_data() -> Forecast
and
>> > > > observation
>> > > > > > > valid
>> > > > > > > >> > > times
>> > > > > > > >> > > > do
>> > > > > > > >> > > > > > not match 20180821_000000 !=
19700101_000000 for
>> > > > > > APCP_03(*,*)
>> > > > > > > >> > versus
>> > > > > > > >> > > > > > precipitation(*,*).
>> > > > > > > >> > > > > > WARNING:
>> > > > > > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
>> > > > > > > >> > > > > > DEBUG 1: Observation Field: precipitation
at *,*
>> > > > > > > >> > > > > > DEBUG 2: Processing masking regions.
>> > > > > > > >> > > > > > DEBUG 2: Identifying objects in the
forecast and
>> > > > > observation
>> > > > > > > >> > > fields...
>> > > > > > > >> > > > > > DEBUG 2: Computing contingency table
>> statistics...
>> > > > > > > >> > > > > > DEBUG 2: Identified: 0 forecast objects
and 0
>> > > > observation
>> > > > > > > >> objects.
>> > > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
>> forecast
>> > > > > field.
>> > > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
>> > > observation
>> > > > > > field.
>> > > > > > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects and
0
>> > > observation
>> > > > > > > >> objects.
>> > > > > > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH)
between
>> > the
>> > > > > > forecast
>> > > > > > > >> and
>> > > > > > > >> > > > > > observation fields.
>> > > > > > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object
Statistics
>> file:
>> > > > > > > >> > > > > >
>> > > > > > > >> >
>> > > > > >
>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
>> > > > > > > >> > > > > > DEBUG 1: Creating Contingency Table
Statistics
>> file:
>> > > > > > > >> > > > > >
>> > > > > > > >> >
>> > > > > >
>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
>> > > > > > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
>> > > > > > > >> > > > > >
>> > > > > > > >> >
>> > > > >
>>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
>> > > > > > > >> > > > > > DEBUG 1: Loading forecast raw color table:
>> > > > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
>> > > > > > > >> > > > > > DEBUG 1: Loading observation raw color
table:
>> > > > > > > >> > > > > >
/MET_V8/share/met//colortables/met_default.ctable
>> > > > > > > >> > > > > > DEBUG 1: Creating postscript file:
>> > > > > > > >> > > > > >
>> > > > > > >
>> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > > Am I doing some mistakes or the above
warnings
>> are
>> > > > general
>> > > > > > due
>> > > > > > > >> to
>> > > > > > > >> > > > > > observation and fcst time mismatch.
>> > > > > > > >> > > > > > Kindly find the attachments for reference.
>> > > > > > > >> > > > > > Thanking You
>> > > > > > > >> > > > > > With Best Regards
>> > > > > > > >> > > > > > ________________________
>> > > > > > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
>> > > > > > > >> > > > > > Asst. Prof., Mathematics
>> > > > > > > >> > > > > > *Kalinga Institute of Industrial
Technology,*
>> > > > > > > >> > > > > > *Deemed to be University, Bhubaneswar*
>> > > > > > > >> > > > > > *Mobile- 09861182688*
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > > >
>> > > > > > > >> > > > >
>> > > > > > > >> > > > >
>> > > > > > > >> > > >
>> > > > > > > >> > > >
>> > > > > > > >> > >
>> > > > > > > >> > >
>> > > > > > > >> >
>> > > > > > > >> >
>> > > > > > > >>
>> > > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > >
>> > > > >
>> > > >
>> > > >
>> > >
>> > >
>> >
>> >
>>
>>
------------------------------------------------
Subject:
From: John Halley Gotway
Time: Thu Nov 01 14:26:51 2018
Sorry for the trouble. Our nightly build for the MET software pointed
out
that the bugfix I posted yesterday was insufficient. I reposted today
after rerunning our regression test to make sure it works well, and it
does.
Please use the patch posted today (11/01/2018):
https://dtcenter.org/met/users/support/known_issues/METv8.0/index.php
Thanks,
John
On Wed, Oct 31, 2018 at 1:38 PM John Halley Gotway <johnhg at ucar.edu>
wrote:
> OK, I just finished posting the bugfix for this here:
>
https://dtcenter.org/met/users/support/known_issues/METv8.0/index.php
>
> Thanks,
> John
>
> On Wed, Oct 31, 2018 at 11:40 AM John Halley Gotway
<johnhg at ucar.edu>
> wrote:
>
>> Thank you for posting your sample data. I retrieved them and was
able to
>> replicate the exact behavior you described. Running through the
debugger I
>> was able to identify a slight bug in the GRIB1 library code we're
using.
>> The fix is a simple one-line change, but unfortunately, this will
require a
>> bugfix. I'll get that done and posted as soon as possible and will
write
>> to let you know when it's available.
>>
>> My apologies but thanks for helping us debug the code.
>>
>> John
>>
>> On Mon, Oct 29, 2018 at 12:04 PM Biranchi Mahala via RT <
>> met_help at ucar.edu> wrote:
>>
>>>
>>> <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>>>
>>> Sir,
>>> It is sent to your site under the directory mahala_data
>>>
>>> for information.
>>> Thanking You
>>> With Best Regards
>>> ________________________
>>> Dr. BIRANCHI KUMAR MAHALA
>>> Asst. Prof., Mathematics
>>> *Kalinga Institute of Industrial Technology,*
>>> *Deemed to be University, Bhubaneswar*
>>> *Mobile- 09861182688*
>>>
>>>
>>>
>>> On Mon, Oct 29, 2018 at 11:17 PM John Halley Gotway via RT <
>>> met_help at ucar.edu> wrote:
>>>
>>> > Sure enough! I clearly see the 120 hour accumulation in that
file and
>>> > would expect that pcp_combine command to work exactly how you
have
>>> written
>>> > it.
>>> >
>>> > I'd like to try to replicate this behavior here and debug. Can
you
>>> please
>>> > post the 96 and 120 forecast files "wrfprs_d02.120" to our
anonymous
>>> FTP
>>> > site following these instructions?
>>> > https://dtcenter.org/met/users/support/met_help.php#ftp
>>> >
>>> > Please write once they're there so I know to go grab them.
>>> >
>>> > Thanks,
>>> > John
>>> >
>>> > On Mon, Oct 29, 2018 at 11:28 AM Biranchi Mahala via RT <
>>> met_help at ucar.edu
>>> > >
>>> > wrote:
>>> >
>>> > >
>>> > > <URL: https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>
>>> > >
>>> > > Sir,
>>> > > * wgrib **wrfprs_d02.120 | grep APCP* command shows the
following;
>>> > > bash: AerosolCoeff.bin: command not found...
>>> > > whreas the command
>>> > > wgrib wrfprs_d02.120 | grep APCP
>>> > > shows the following;
>>> > >
>>> > >
>>> >
>>>
310:20113176:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=120:TimeU=1:sfc:0-
120hr
>>> > > acc:NAve=0
>>> > > Also
>>> > > wgrib wrfprs_d02.96 | grep APCP
>>> > > shows the following;
>>> > >
>>> > >
>>> >
>>>
310:19992520:d=18081000:APCP:kpds5=61:kpds6=1:kpds7=0:TR=4:P1=0:P2=96:TimeU=1:sfc:0-
96hr
>>> > > acc:NAve=0
>>> > >
>>> > >
>>> > > For information.
>>> > > Thanking You
>>> > > With Best Regards
>>> > > ________________________
>>> > > Dr. BIRANCHI KUMAR MAHALA
>>> > > Asst. Prof., Mathematics
>>> > > *Kalinga Institute of Industrial Technology,*
>>> > > *Deemed to be University, Bhubaneswar*
>>> > > *Mobile- 09861182688*
>>> > >
>>> > >
>>> > >
>>> > > On Mon, Oct 29, 2018 at 9:31 PM John Halley Gotway via RT <
>>> > > met_help at ucar.edu>
>>> > > wrote:
>>> > >
>>> > > > Dr. Biranchi,
>>> > > >
>>> > > > So you've seen the following error from pcp_combine:
>>> > > > ERROR : get_field() -> can't get data plane from file
>>> "wrfprs_d02.120"
>>> > > >
>>> > > > The most likely explanation is that the input file
(wrfprs_d02.120)
>>> > > really
>>> > > > does not contain a record for 120-hour accumulated
precipitation.
>>> > > >
>>> > > > If you have the wgrib (for GRIB1) or wgrib2 (for GRIB2)
tools
>>> > available,
>>> > > > please use them to inventory this file and check what precip
>>> > accumulation
>>> > > > actually is available:
>>> > > > * wgrib **wrfprs_d02.120 | grep APCP*
>>> > > >
>>> > > > Thanks,
>>> > > > John
>>> > > >
>>> > > > On Sat, Oct 27, 2018 at 3:13 AM Biranchi Mahala via RT <
>>> > > met_help at ucar.edu>
>>> > > > wrote:
>>> > > >
>>> > > > >
>>> > > > > <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>>> > > > >
>>> > > > > Sir,
>>> > > > > Now it works.
>>> > > > > I have another query as below.
>>> > > > > I am trying to run pcp_combine tool to find the APCP by
running
>>> the
>>> > > > > command;
>>> > > > > pcp_combine -subtract wrfprs_d02.120 120 wrfprs_d02.96 96
>>> > > > > APCP_24h_00utc15Aug2018.nc -pcpdir ./
>>> > > > > The output of the above command shows the following ;
>>> > > > > DEBUG 1: Reading input file: wrfprs_d02.120
>>> > > > > WARNING:
>>> > > > > WARNING: MetGrib1DataFile::data_plane() -> No exact match
found
>>> for
>>> > > > VarInfo
>>> > > > > "APCP/A120" in GRIB file "wrfprs_d02.120".
>>> > > > > WARNING:
>>> > > > > ERROR :
>>> > > > > ERROR : get_field() -> can't get data plane from file
>>> > "wrfprs_d02.120"
>>> > > > > ERROR :
>>> > > > >
>>> > > > > Thanking You
>>> > > > > With Best Regards
>>> > > > > ________________________
>>> > > > > Dr. BIRANCHI KUMAR MAHALA
>>> > > > > Asst. Prof., Mathematics
>>> > > > > *Kalinga Institute of Industrial Technology,*
>>> > > > > *Deemed to be University, Bhubaneswar*
>>> > > > > *Mobile- 09861182688*
>>> > > > >
>>> > > > >
>>> > > > >
>>> > > > > On Wed, Oct 24, 2018 at 11:56 PM John Halley Gotway via RT
<
>>> > > > > met_help at ucar.edu> wrote:
>>> > > > >
>>> > > > > > Biranchi,
>>> > > > > >
>>> > > > > > I found this image showing 3B42 data for 20160229:
>>> > > > > >
>>> > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
>>> > > > > >
>>> > > > > > I grabbed the NetCDF file for that day and tried to plot
it in
>>> MET.
>>> > > > But
>>> > > > > > the number of latitude values changed... 480 in recent
data
>>> but 400
>>> > > in
>>> > > > > > older data. So I updated the script to parse the
lat/lon info
>>> on
>>> > the
>>> > > > > fly.
>>> > > > > > Also, I noticed that the picture in MET is upside
down...
>>> compared
>>> > to
>>> > > > the
>>> > > > > > NASA image. So I flipped it.
>>> > > > > >
>>> > > > > > The updated script is attached as well as the image
generated
>>> by
>>> > this
>>> > > > > > command:
>>> > > > > >
>>> > > > > > met-8.0/bin/plot_data_plane PYTHON_NUMPY
>>> 3B42_Daily.20160229.7.ps
>>> > \
>>> > > > > > 'name="read_3B42RT.py 3B42_Daily.20160229.7.nc4
>>> precipitation";'
>>> > \
>>> > > > > > -plot_range 0 100
>>> > > > > >
>>> > > > > > That should now match this image:
>>> > > > > >
>>> > > > > >
>>> > > > > >
>>> > > > >
>>> > > >
>>> > >
>>> >
>>>
https://docserver.gesdisc.eosdis.nasa.gov/public/project/Images/TRMM_3B42_Daily_7.png
>>> > > > > >
>>> > > > > > Thanks,
>>> > > > > > John
>>> > > > > >
>>> > > > > > On Wed, Oct 24, 2018 at 11:48 AM Biranchi Mahala via RT
<
>>> > > > > met_help at ucar.edu
>>> > > > > > >
>>> > > > > > wrote:
>>> > > > > >
>>> > > > > > >
>>> > > > > > > <URL:
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481 >
>>> > > > > > >
>>> > > > > > > Sir,
>>> > > > > > > The new script works fine for both.
>>> > > > > > > Thanking You
>>> > > > > > > With Best Regards
>>> > > > > > > ________________________
>>> > > > > > > Dr. BIRANCHI KUMAR MAHALA
>>> > > > > > > Asst. Prof., Mathematics
>>> > > > > > > *Kalinga Institute of Industrial Technology,*
>>> > > > > > > *Deemed to be University, Bhubaneswar*
>>> > > > > > > *Mobile- 09861182688*
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > On Wed, Oct 24, 2018 at 11:16 PM Biranchi Mahala <
>>> > > > > > biranchimahala at gmail.com
>>> > > > > > > >
>>> > > > > > > wrote:
>>> > > > > > >
>>> > > > > > > > Sir,
>>> > > > > > > > Can you please brief how to compare the
precipitation
>>> images
>>> > with
>>> > > > > NASA
>>> > > > > > > > plots.
>>> > > > > > > >
>>> > > > > > > > Thanking You
>>> > > > > > > > With Best Regards
>>> > > > > > > > ________________________
>>> > > > > > > > Dr. BIRANCHI KUMAR MAHALA
>>> > > > > > > > Asst. Prof., Mathematics
>>> > > > > > > > *Kalinga Institute of Industrial Technology,*
>>> > > > > > > > *Deemed to be University, Bhubaneswar*
>>> > > > > > > > *Mobile- 09861182688*
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > >
>>> > > > > > > > On Wed, Oct 24, 2018 at 11:02 PM John Halley Gotway
via RT
>>> <
>>> > > > > > > > met_help at ucar.edu> wrote:
>>> > > > > > > >
>>> > > > > > > >> Ah yes, there are more differences in these files.
>>> > > > > > > >>
>>> > > > > > > >> For some reason the Daily files store data in lon,
lat
>>> order:
>>> > > > > > > >> float precipitation(lon, lat) ;
>>> > > > > > > >> While the 3-hourly files store data in lat, lon
order:
>>> > > > > > > >> float precipitation(lat, lon) ;
>>> > > > > > > >>
>>> > > > > > > >> That's pretty frustrating! OK, I updated the
script to
>>> check
>>> > > for
>>> > > > > > (lat,
>>> > > > > > > >> lon) versus (lon, lat) ordering... and take the
transpose
>>> in
>>> > the
>>> > > > > > latter
>>> > > > > > > >> case. I tested using these commands:
>>> > > > > > > >>
>>> > > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
>>> > > > 3B42RT_Daily.20180821.7.ps
>>> > > > > \
>>> > > > > > > >> 'name="read_3B42RT.py
3B42RT_Daily.20180821.7.nc4
>>> > > > > precipitation";'
>>> > > > > > > >>
>>> > > > > > > >> met-8.0/bin/plot_data_plane PYTHON_NUMPY
>>> > 3B42RT.2018082100.7.ps
>>> > > \
>>> > > > > > > >> 'name="read_3B42RT.py 3B42RT.2018082100.7.nc4
>>> > > precipitation";'
>>> > > > > > > >>
>>> > > > > > > >> I have attached the updated script and these 2 test
>>> images.
>>> > > > > > > >>
>>> > > > > > > >> However, it would be wise to independently verify
that the
>>> > > precip
>>> > > > is
>>> > > > > > in
>>> > > > > > > >> the
>>> > > > > > > >> right spot. Can you compare these images to NASA
plots
>>> for
>>> > the
>>> > > > same
>>> > > > > > > >> times?
>>> > > > > > > >>
>>> > > > > > > >> Thanks,
>>> > > > > > > >> John
>>> > > > > > > >>
>>> > > > > > > >> On Wed, Oct 24, 2018 at 11:12 AM Biranchi Mahala
via RT <
>>> > > > > > > >> met_help at ucar.edu>
>>> > > > > > > >> wrote:
>>> > > > > > > >>
>>> > > > > > > >> >
>>> > > > > > > >> > <URL:
>>> > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>>> > > >
>>> > > > > > > >> >
>>> > > > > > > >> > Sir,
>>> > > > > > > >> > The script works fine for
>>> > > > > > > >> > python read_3B42RT.py
>>> > > ./input/sample_obs/3B42RT.2018082100.7.nc4
>>> > > > > > > >> > precipitation
>>> > > > > > > >> > But the output of the command;
>>> > > > > > > >> > plot_data_plane PYTHON_NUMPY
3B42RT.2018082100.7.ps
>>> > > > > > > >> > 'name="./read_3B42RT.py
>>> > > > > > > >> > ./input/sample_obs/3B42RT.2018082100.7.nc4
>>> precipitation";'
>>> > > > > > > >> > shows the following;
>>> > > > > > > >> > DEBUG 1: Opening data file: PYTHON_NUMPY
>>> > > > > > > >> > Input File:
'./input/sample_obs/3B42RT.2018082100.7.nc4'
>>> > > > > > > >> > Variable Name : 'precipitation'
>>> > > > > > > >> > Data Shape: (1440, 480)
>>> > > > > > > >> > Data Type: dtype('float64')
>>> > > > > > > >> > Begin Time = 2018-08-20 22:30:00
>>> > > > > > > >> > End Time = 2018-08-21 01:30:00
>>> > > > > > > >> > Accum Time = 030000
>>> > > > > > > >> > Attributes: {'long_name': 'precipitation',
'init':
>>> > > > > > '20180821_013000',
>>> > > > > > > >> > 'valid': '20180821_013000', 'grid': {'delta_lat':
0.25,
>>> > > > 'lon_ll':
>>> > > > > > > >> -179.875,
>>> > > > > > > >> > 'name': '3B42-Grid', 'Nlat': 480, 'lat_ll':
-59.875,
>>> > > > 'delta_lon':
>>> > > > > > > 0.25,
>>> > > > > > > >> > 'type': 'LatLon', 'Nlon': 1440}, 'name':
>>> 'precipitation',
>>> > > > 'lead':
>>> > > > > > > '00',
>>> > > > > > > >> > 'level': 'Surface', 'units': 'mm', 'accum':
'030000'}
>>> > > > > > > >> > DEBUG 1: Creating postscript file:
>>> 3B42RT.2018082100.7.ps
>>> > > > > > > >> > ERROR :
>>> > > > > > > >> > ERROR : DataPlane::two_to_one() -> range check
error:
>>> (Nx,
>>> > > Ny)
>>> > > > =
>>> > > > > > > (480,
>>> > > > > > > >> > 1440), (x, y) = (480, 0)
>>> > > > > > > >> > ERROR :
>>> > > > > > > >> >
>>> > > > > > > >> > Thanking You
>>> > > > > > > >> > With Best Regards
>>> > > > > > > >> > ________________________
>>> > > > > > > >> > Dr. BIRANCHI KUMAR MAHALA
>>> > > > > > > >> > Asst. Prof., Mathematics
>>> > > > > > > >> > *Kalinga Institute of Industrial Technology,*
>>> > > > > > > >> > *Deemed to be University, Bhubaneswar*
>>> > > > > > > >> > *Mobile- 09861182688*
>>> > > > > > > >> >
>>> > > > > > > >> >
>>> > > > > > > >> >
>>> > > > > > > >> > On Wed, Oct 24, 2018 at 10:04 PM John Halley
Gotway via
>>> RT <
>>> > > > > > > >> > met_help at ucar.edu> wrote:
>>> > > > > > > >> >
>>> > > > > > > >> > > Biranchi,
>>> > > > > > > >> > >
>>> > > > > > > >> > > Looking very closely at the 3B42RT NetCDF files
and
>>> the
>>> > > error
>>> > > > > > > message
>>> > > > > > > >> > from
>>> > > > > > > >> > > that python script, it looks like the time
formats are
>>> > very
>>> > > > > > slightly
>>> > > > > > > >> > > different.
>>> > > > > > > >> > >
>>> > > > > > > >> > > The Daily files include microseconds:
>>> > > > > > > >> > > :BeginTime = "01:30:00.000Z" ;
>>> > > > > > > >> > > :EndTime = "01:29:59.999Z" ;
>>> > > > > > > >> > >
>>> > > > > > > >> > > The 3-hourly files do not:
>>> > > > > > > >> > > :BeginTime = "22:30:00Z" ;
>>> > > > > > > >> > > :EndTime = "01:30:00Z" ;
>>> > > > > > > >> > >
>>> > > > > > > >> > > Other than that, they're the same. So I
created a new
>>> > > script
>>> > > > > > named
>>> > > > > > > >> > > "read_3B42RT.py" (see attached) which should
handle
>>> both
>>> > the
>>> > > > > daily
>>> > > > > > > and
>>> > > > > > > >> > > 3-hourly files. I parses the times with or
without
>>> the
>>> > > > > > microseconds
>>> > > > > > > >> > > included:
>>> > > > > > > >> > >
>>> > > > > > > >> > > python read_3B42RT.py 3B42RT.2018082100.7.nc4
>>> > precipitation
>>> > > > > > > >> > > python read_3B42RT.py
3B42RT_Daily.20180821.7.nc4
>>> > > > precipitation
>>> > > > > > > >> > >
>>> > > > > > > >> > > Hopefully that does the trick.
>>> > > > > > > >> > >
>>> > > > > > > >> > > Thanks,
>>> > > > > > > >> > > John
>>> > > > > > > >> > >
>>> > > > > > > >> > > On Wed, Oct 24, 2018 at 9:56 AM Biranchi Mahala
via
>>> RT <
>>> > > > > > > >> > met_help at ucar.edu>
>>> > > > > > > >> > > wrote:
>>> > > > > > > >> > >
>>> > > > > > > >> > > >
>>> > > > > > > >> > > > <URL:
>>> > > > https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>>> > > > > >
>>> > > > > > > >> > > >
>>> > > > > > > >> > > > Sir,
>>> > > > > > > >> > > > The command:
>>> > > > > > > >> > > > python read_3B42RT_3hours.py
>>> > > > > > > >> ./input/sample_obs/3B42RT.2018082100.7.nc4
>>> > > > > > > >> > > > precipitation
>>> > > > > > > >> > > > shows the following message:
>>> > > > > > > >> > > > Input File:
>>> './input/sample_obs/3B42RT.2018082100.7.nc4'
>>> > > > > > > >> > > > Variable Name : 'precipitation'
>>> > > > > > > >> > > > Data Shape: (1440, 480)
>>> > > > > > > >> > > > Data Type: dtype('float64')
>>> > > > > > > >> > > > Traceback (most recent call last):
>>> > > > > > > >> > > > File "read_3B42RT_3hours.py", line 49, in
<module>
>>> > > > > > > >> > > > beg_time =
>>> dt.datetime.strptime(beg_time_str,
>>> > > > > "%Y-%m-%d
>>> > > > > > > >> > > > %H:%M:%S.%fZ")
>>> > > > > > > >> > > > File "/usr/lib64/python2.7/_strptime.py",
line
>>> 332, in
>>> > > > > > _strptime
>>> > > > > > > >> > > > (data_string, format))
>>> > > > > > > >> > > > ValueError: time data '2018-08-20 22:30:00Z'
does
>>> not
>>> > > match
>>> > > > > > format
>>> > > > > > > >> > > > '%Y-%m-%d %H:%M:%S.%fZ'
>>> > > > > > > >> > > >
>>> > > > > > > >> > > > So I could not run mode ...
>>> > > > > > > >> > > > Thanking You
>>> > > > > > > >> > > > With Best Regards
>>> > > > > > > >> > > > ________________________
>>> > > > > > > >> > > > Dr. BIRANCHI KUMAR MAHALA
>>> > > > > > > >> > > > Asst. Prof., Mathematics
>>> > > > > > > >> > > > *Kalinga Institute of Industrial Technology,*
>>> > > > > > > >> > > > *Deemed to be University, Bhubaneswar*
>>> > > > > > > >> > > > *Mobile- 09861182688*
>>> > > > > > > >> > > >
>>> > > > > > > >> > > >
>>> > > > > > > >> > > >
>>> > > > > > > >> > > > On Wed, Oct 24, 2018 at 3:37 AM John Halley
Gotway
>>> via
>>> > RT
>>> > > <
>>> > > > > > > >> > > > met_help at ucar.edu>
>>> > > > > > > >> > > > wrote:
>>> > > > > > > >> > > >
>>> > > > > > > >> > > > > So we worked together through the details
of
>>> writing a
>>> > > > > python
>>> > > > > > > >> script
>>> > > > > > > >> > > for
>>> > > > > > > >> > > > > reading the daily 3B42RT datasets.
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > Now, you need to adapt that script for
handling
>>> the
>>> > > > 3-hourly
>>> > > > > > > >> 3B42RT
>>> > > > > > > >> > > > data...
>>> > > > > > > >> > > > > let's say that you've done that and called
it
>>> > > > > > > >> > "read_3B42RT_3hours.py".
>>> > > > > > > >> > > > You
>>> > > > > > > >> > > > > should use that Python script when running
MODE,
>>> like
>>> > > > this:
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > mode
>>> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc \
>>> > > > > > > >> > > > > PYTHON_NUMPY MODEConfig_default -outdir
>>> > > > > > ./output/mode_analysis \
>>> > > > > > > >> > > > > -v 2
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > And then in the MODE config file:
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > fcst = {
>>> > > > > > > >> > > > > field = { name = "APCP_03"; level =
"(*,*)"; }
>>> > > > > > > >> > > > > censor_thresh = [];
>>> > > > > > > >> > > > > censor_val = [];
>>> > > > > > > >> > > > > conv_radius = 60.0/grid_res; //
in grid
>>> > > squares
>>> > > > > > > >> > > > > conv_thresh = >=5.0;
>>> > > > > > > >> > > > > vld_thresh = 0.5;
>>> > > > > > > >> > > > > filter_attr_name = [];
>>> > > > > > > >> > > > > filter_attr_thresh = [];
>>> > > > > > > >> > > > > merge_thresh = >=1.25;
>>> > > > > > > >> > > > > merge_flag = THRESH;
>>> > > > > > > >> > > > > }
>>> > > > > > > >> > > > > obs = fcst;
>>> > > > > > > >> > > > > obs = {
>>> > > > > > > >> > > > > field = { name="read_3B42RT_3hours.py
>>> > > > > > > >> read_3B42RT.2018082100.7.nc4
>>> > > > > > > >> > > > > precipitation"; }
>>> > > > > > > >> > > > > }
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > Does that make sense?
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > Thanks,
>>> > > > > > > >> > > > > John
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > On Mon, Oct 22, 2018 at 11:08 PM Biranchi
Mahala
>>> via
>>> > RT
>>> > > <
>>> > > > > > > >> > > > met_help at ucar.edu
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > wrote:
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > > Mon Oct 22 23:08:10 2018: Request 87481
was
>>> acted
>>> > > upon.
>>> > > > > > > >> > > > > > Transaction: Ticket created by
>>> > > biranchimahala at gmail.com
>>> > > > > > > >> > > > > > Queue: met_help
>>> > > > > > > >> > > > > > Subject: (No subject given)
>>> > > > > > > >> > > > > > Owner: Nobody
>>> > > > > > > >> > > > > > Requestors: biranchimahala at gmail.com
>>> > > > > > > >> > > > > > Status: new
>>> > > > > > > >> > > > > > Ticket <URL:
>>> > > > > > > >> > >
>>> https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=87481
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > > Sir,
>>> > > > > > > >> > > > > > I am able to run mode of MET-8.0 with the
>>> assistance
>>> > > of
>>> > > > > > > met_help
>>> > > > > > > >> > > team.
>>> > > > > > > >> > > > > > Now I am getting sum warnings while
running
>>> mode as
>>> > > > > follows.
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > > mode
>>> ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
>>> > > > > > > >> > > > > > 3B42RT.2018082100.7.nc4
MODEConfig_default
>>> -outdir
>>> > > > > > > >> > > > > ./output/mode_analysis/
>>> > > > > > > >> > > > > > -v 2
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > > DEBUG 1: Default Config File:
>>> > > > > > > >> > > > >
/MET_V8/share/met//config/MODEConfig_default
>>> > > > > > > >> > > > > > DEBUG 1: Match Config File:
MODEConfig_default
>>> > > > > > > >> > > > > > DEBUG 1: Merge Config File:
MODEConfig_default
>>> > > > > > > >> > > > > > WARNING:
>>> > > > > > > >> > > > > > WARNING: NcCfFile::open() -> could not
>>> determine the
>>> > > > valid
>>> > > > > > > time,
>>> > > > > > > >> > > using
>>> > > > > > > >> > > > 0.
>>> > > > > > > >> > > > > > WARNING:
>>> > > > > > > >> > > > > > DEBUG 1: Forecast File:
>>> > > > > > > >> > > ./input/sample_fcst/APCP_03h_val00utc21Aug18.nc
>>> > > > > > > >> > > > > > DEBUG 1: Observation File:
>>> 3B42RT.2018082100.7.nc4
>>> > > > > > > >> > > > > > DEBUG 1: Regridding observation
>>> precipitation(*,*)
>>> > to
>>> > > > the
>>> > > > > > > >> > > verification
>>> > > > > > > >> > > > > > grid.
>>> > > > > > > >> > > > > > WARNING:
>>> > > > > > > >> > > > > > WARNING: setup_fcst_obs_data() ->
Forecast and
>>> > > > observation
>>> > > > > > > valid
>>> > > > > > > >> > > times
>>> > > > > > > >> > > > do
>>> > > > > > > >> > > > > > not match 20180821_000000 !=
19700101_000000 for
>>> > > > > > APCP_03(*,*)
>>> > > > > > > >> > versus
>>> > > > > > > >> > > > > > precipitation(*,*).
>>> > > > > > > >> > > > > > WARNING:
>>> > > > > > > >> > > > > > DEBUG 1: Forecast Field: APCP_03 at A3
>>> > > > > > > >> > > > > > DEBUG 1: Observation Field: precipitation
at *,*
>>> > > > > > > >> > > > > > DEBUG 2: Processing masking regions.
>>> > > > > > > >> > > > > > DEBUG 2: Identifying objects in the
forecast and
>>> > > > > observation
>>> > > > > > > >> > > fields...
>>> > > > > > > >> > > > > > DEBUG 2: Computing contingency table
>>> statistics...
>>> > > > > > > >> > > > > > DEBUG 2: Identified: 0 forecast objects
and 0
>>> > > > observation
>>> > > > > > > >> objects.
>>> > > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
>>> forecast
>>> > > > > field.
>>> > > > > > > >> > > > > > DEBUG 2: Performing merging (THRESH) in
the
>>> > > observation
>>> > > > > > field.
>>> > > > > > > >> > > > > > DEBUG 2: Remaining: 0 forecast objects
and 0
>>> > > observation
>>> > > > > > > >> objects.
>>> > > > > > > >> > > > > > DEBUG 2: Performing matching (MERGE_BOTH)
>>> between
>>> > the
>>> > > > > > forecast
>>> > > > > > > >> and
>>> > > > > > > >> > > > > > observation fields.
>>> > > > > > > >> > > > > > DEBUG 1: Creating Fcst-Obs Object
Statistics
>>> file:
>>> > > > > > > >> > > > > >
>>> > > > > > > >> >
>>> > > > > >
>>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.txt
>>> > > > > > > >> > > > > > DEBUG 1: Creating Contingency Table
Statistics
>>> file:
>>> > > > > > > >> > > > > >
>>> > > > > > > >> >
>>> > > > > >
>>> >
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_cts.txt
>>> > > > > > > >> > > > > > DEBUG 1: Creating Object NetCDF file:
>>> > > > > > > >> > > > > >
>>> > > > > > > >> >
>>> > > > >
>>>
./output/mode_analysis//mode_960000L_20180821_000000V_030000A_obj.nc
>>> > > > > > > >> > > > > > DEBUG 1: Loading forecast raw color
table:
>>> > > > > > > >> > > > > >
>>> /MET_V8/share/met//colortables/met_default.ctable
>>> > > > > > > >> > > > > > DEBUG 1: Loading observation raw color
table:
>>> > > > > > > >> > > > > >
>>> /MET_V8/share/met//colortables/met_default.ctable
>>> > > > > > > >> > > > > > DEBUG 1: Creating postscript file:
>>> > > > > > > >> > > > > >
>>> > > > > > >
>>> ./output/mode_analysis//mode_960000L_20180821_000000V_030000A.ps
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > > Am I doing some mistakes or the above
warnings
>>> are
>>> > > > general
>>> > > > > > due
>>> > > > > > > >> to
>>> > > > > > > >> > > > > > observation and fcst time mismatch.
>>> > > > > > > >> > > > > > Kindly find the attachments for
reference.
>>> > > > > > > >> > > > > > Thanking You
>>> > > > > > > >> > > > > > With Best Regards
>>> > > > > > > >> > > > > > ________________________
>>> > > > > > > >> > > > > > Dr. BIRANCHI KUMAR MAHALA
>>> > > > > > > >> > > > > > Asst. Prof., Mathematics
>>> > > > > > > >> > > > > > *Kalinga Institute of Industrial
Technology,*
>>> > > > > > > >> > > > > > *Deemed to be University, Bhubaneswar*
>>> > > > > > > >> > > > > > *Mobile- 09861182688*
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > > >
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > > >
>>> > > > > > > >> > > >
>>> > > > > > > >> > > >
>>> > > > > > > >> > >
>>> > > > > > > >> > >
>>> > > > > > > >> >
>>> > > > > > > >> >
>>> > > > > > > >>
>>> > > > > > > >>
>>> > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > > >
>>> > > > >
>>> > > > >
>>> > > >
>>> > > >
>>> > >
>>> > >
>>> >
>>> >
>>>
>>>
------------------------------------------------
More information about the Met_help
mailing list