[Met_help] [rt.rap.ucar.edu #63242] History for Little_R input
John Halley Gotway via RT
met_help at ucar.edu
Mon Oct 14 14:24:24 MDT 2013
----------------------------------------------------------------
Initial Request
----------------------------------------------------------------
Hi,
I would just like to ask something about our little_r support.
I have used ascii2nc before in converting little_r files into netcdf
format and it went well.
When we modified the little_r files (now contatining 3 hours instead of
3-day data), I have encountered an error:
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while parsing
line 861.
WARNING:
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while parsing
line 861.
WARNING:
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while parsing
line 861.
WARNING:
ERROR :
ERROR : LittleRHandler::_readObservations() -> the fifth entry of the
little_r report on line 861 does not match "FM-[0-9]":
ERROR : "-888888.00000 0-888888.00000 0"
ERROR :
DEBUG 2: Processing observations for 215 headers.
DEBUG 1: Creating NetCDF Observation file: SURFACE_OBS_2013040200.nc
NetCDF: Start+count exceeds dimension bound
Would you know how can I resolve this?
THanks!
PS:
I am attaching the little_r file in this email.
Vladimir A. Malabanan
3F IBM Bldg J, UP Ayala Technohub
Applications Programmer
Advanced Analytics - Data Specialist
Diliman, Quezon City
IBM Solutions Delivery, Inc.
Philippines
Global Delivery Center
Phone:
+632-995-2IBM local 8639
e-mail:
malabava at ph.ibm.com
----------------------------------------------------------------
Complete Ticket History
----------------------------------------------------------------
Subject: Re: [rt.rap.ucar.edu #63242] Little_R input
From: John Halley Gotway
Time: Tue Oct 01 15:49:28 2013
Vladimir,
Thanks for sending the data file. That makes it easier to debug. The
problem is caused by the station name used on line 860 of the file you
sent:
ZAMBOANGADELNORTE_CITYAGRICULTUREOFFICE_
ascii2nc is expecting a maximum station name length of 30 characters,
but this one is 40. That's causing this NetCDF error:
NetCDF: Start+count exceeds dimension bound
Also, the little_r data on lines 857 to 859 is missing the closing
line:
17.32819 122.29619ISABELA_DIVILACAN_V
II,Isabela,DIVILACAN FM-12 SYNOP
Project NOAH
0.00000 1 0 0 0
0 T F F1364829306 91
20130401151506-888888.00000 0-888888.00000 0-888888.00000
0-888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000 0
101108.05000 0-888888.00000 0 297.05000 0-
888888.00000 0 0.00000 0 0.00000 0-
888888.00000 0-888888.00000 0 90.80000 0-
888888.00000 0
-777777.00000 0-777777.00000 0-888888.00000 0-
888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000 0
**************** 1 0 0 *********************
For some reason, it was missing that 1, 0, 0 line at the end (that
I've surrounded with stars) which is supposed to come at the end of
little_R messages.
After adding in that missing line and modifying the code to allow for
longer station names, here's what I see from ascii2nc:
/d1/johnhg/MET/MET_development/svn-met-
dev.cgd.ucar.edu/branches/met/METv4.1_bugfix/bin/ascii2nc
SURFACE_OBS_2013040200_test SURFACE_OBS_2013040200_test.nc
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing line 875.
WARNING:
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing line 877.
WARNING:
WARNING:
WARNING: process_little_r_obs() -> the number of data lines specified
in the header (1) does not match the number found in the data (4) on
line number 878.
WARNING:
DEBUG 2: Processing observations for 676 headers.
DEBUG 1: Creating NetCDF Observation file:
SURFACE_OBS_2013040200_test.nc
DEBUG 2: Finished processing 3407 observations for 676 headers.
Still a few warnings, but it's running to completion.
I just posted a bugfix for METv4.1 that fixes this problem:
http://www.dtcenter.org/met/users/support/known_issues/METv4.1/index.php
The fix does the following:
- Extend the maximum string length from 30 characters to 40 (which
is the max for little_r).
- When writing the NetCDF file, check the station name string
length. If it's over 40 characters, print a warning message, but just
write the first 40 characters to the output file.
Please try updating your build of MET and rerunning. Thanks for
letting us know about this problem.
John Halley Gotway
met_help at ucar.edu
On 10/01/2013 03:52 AM, Vladimir A Malabanan via RT wrote:
>
> Tue Oct 01 03:52:08 2013: Request 63242 was acted upon.
> Transaction: Ticket created by vlad.malabanan at ph.ibm.com
> Queue: met_help
> Subject: Little_R input
> Owner: Nobody
> Requestors: vlad.malabanan at ph.ibm.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=63242 >
>
>
> Hi,
>
> I would just like to ask something about our little_r support.
> I have used ascii2nc before in converting little_r files into netcdf
> format and it went well.
>
> When we modified the little_r files (now contatining 3 hours instead
of
> 3-day data), I have encountered an error:
>
> WARNING:
> WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
> line 861.
> WARNING:
> WARNING:
> WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
> line 861.
> WARNING:
> WARNING:
> WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
> line 861.
> WARNING:
> ERROR :
> ERROR : LittleRHandler::_readObservations() -> the fifth entry of
the
> little_r report on line 861 does not match "FM-[0-9]":
> ERROR : "-888888.00000 0-888888.00000 0"
> ERROR :
> DEBUG 2: Processing observations for 215 headers.
> DEBUG 1: Creating NetCDF Observation file: SURFACE_OBS_2013040200.nc
> NetCDF: Start+count exceeds dimension bound
>
> Would you know how can I resolve this?
>
> THanks!
>
> PS:
> I am attaching the little_r file in this email.
>
>
>
> Vladimir A. Malabanan
> 3F IBM Bldg J, UP Ayala Technohub
>
> Applications Programmer
> Advanced Analytics - Data Specialist
> Diliman, Quezon City
> IBM Solutions Delivery, Inc.
> Philippines
> Global Delivery Center
>
>
> Phone:
> +632-995-2IBM local 8639
>
>
> e-mail:
> malabava at ph.ibm.com
>
>
>
>
>
>
------------------------------------------------
Subject: Little_R input
From: Vladimir A Malabanan
Time: Tue Oct 01 18:24:52 2013
Wow! That was a quick response from you John!
Thank you!
I'll try it out now. I will inform you of any updates.
Vladimir A. Malabanan
3F IBM Bldg J, UP Ayala Technohub
Applications Programmer
Advanced Analytics - Data Specialist
Diliman, Quezon City
IBM Solutions Delivery, Inc.
Philippines
Global Delivery Center
Phone:
+632-995-2IBM local 8639
e-mail:
malabava at ph.ibm.com
From: "John Halley Gotway via RT" <met_help at ucar.edu>
To: Vladimir A Malabanan/Philippines/IBM at IBMPH,
Date: 10/02/2013 06:05 AM
Subject: Re: [rt.rap.ucar.edu #63242] Little_R input
Vladimir,
Thanks for sending the data file. That makes it easier to debug. The
problem is caused by the station name used on line 860 of the file you
sent:
ZAMBOANGADELNORTE_CITYAGRICULTUREOFFICE_
ascii2nc is expecting a maximum station name length of 30 characters,
but
this one is 40. That's causing this NetCDF error:
NetCDF: Start+count exceeds dimension bound
Also, the little_r data on lines 857 to 859 is missing the closing
line:
17.32819 122.29619ISABELA_DIVILACAN_V
II,Isabela,DIVILACAN FM-12 SYNOP Project NOAH
0.00000 1 0 0 0
0
T F F1364829306 91 20130401151506-
888888.00000
0-888888.00000 0-888888.00000
0-888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000
0-888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000
0-888888.00000 0-888888.00000 0
101108.05000 0-888888.00000 0 297.05000 0-
888888.00000
0 0.00000 0 0.00000 0-888888.00000 0-
888888.00000
0 90.80000 0-888888.00000 0
-777777.00000 0-777777.00000 0-888888.00000 0-
888888.00000
0-888888.00000 0-888888.00000 0-888888.00000 0-
888888.00000
0-888888.00000 0-888888.00000 0
**************** 1 0 0 *********************
For some reason, it was missing that 1, 0, 0 line at the end (that
I've
surrounded with stars) which is supposed to come at the end of
little_R
messages.
After adding in that missing line and modifying the code to allow for
longer station names, here's what I see from ascii2nc:
/d1/johnhg/MET/MET_development/svn-met-
dev.cgd.ucar.edu/branches/met/METv4.1_bugfix/bin/ascii2nc
SURFACE_OBS_2013040200_test SURFACE_OBS_2013040200_test.nc
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
line 875.
WARNING:
WARNING:
WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
line 877.
WARNING:
WARNING:
WARNING: process_little_r_obs() -> the number of data lines specified
in
the header (1) does not match the number found in the data (4) on line
number 878.
WARNING:
DEBUG 2: Processing observations for 676 headers.
DEBUG 1: Creating NetCDF Observation file:
SURFACE_OBS_2013040200_test.nc
DEBUG 2: Finished processing 3407 observations for 676 headers.
Still a few warnings, but it's running to completion.
I just posted a bugfix for METv4.1 that fixes this problem:
http://www.dtcenter.org/met/users/support/known_issues/METv4.1/index.php
The fix does the following:
- Extend the maximum string length from 30 characters to 40 (which
is
the max for little_r).
- When writing the NetCDF file, check the station name string
length. If
it's over 40 characters, print a warning message, but just write the
first
40 characters to the output file.
Please try updating your build of MET and rerunning. Thanks for
letting
us know about this problem.
John Halley Gotway
met_help at ucar.edu
On 10/01/2013 03:52 AM, Vladimir A Malabanan via RT wrote:
>
> Tue Oct 01 03:52:08 2013: Request 63242 was acted upon.
> Transaction: Ticket created by vlad.malabanan at ph.ibm.com
> Queue: met_help
> Subject: Little_R input
> Owner: Nobody
> Requestors: vlad.malabanan at ph.ibm.com
> Status: new
> Ticket <URL:
https://rt.rap.ucar.edu/rt/Ticket/Display.html?id=63242 >
>
>
> Hi,
>
> I would just like to ask something about our little_r support.
> I have used ascii2nc before in converting little_r files into netcdf
> format and it went well.
>
> When we modified the little_r files (now contatining 3 hours instead
of
> 3-day data), I have encountered an error:
>
> WARNING:
> WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
> line 861.
> WARNING:
> WARNING:
> WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
> line 861.
> WARNING:
> WARNING:
> WARNING: DataLine::read_fwf_line() -> Encountered newline while
parsing
> line 861.
> WARNING:
> ERROR :
> ERROR : LittleRHandler::_readObservations() -> the fifth entry of
the
> little_r report on line 861 does not match "FM-[0-9]":
> ERROR : "-888888.00000 0-888888.00000 0"
> ERROR :
> DEBUG 2: Processing observations for 215 headers.
> DEBUG 1: Creating NetCDF Observation file: SURFACE_OBS_2013040200.nc
> NetCDF: Start+count exceeds dimension bound
>
> Would you know how can I resolve this?
>
> THanks!
>
> PS:
> I am attaching the little_r file in this email.
>
>
>
> Vladimir A. Malabanan
> 3F IBM Bldg J, UP Ayala Technohub
>
> Applications Programmer
> Advanced Analytics - Data Specialist
> Diliman, Quezon City
> IBM Solutions Delivery, Inc.
> Philippines
> Global Delivery Center
>
>
> Phone:
> +632-995-2IBM local 8639
>
>
> e-mail:
> malabava at ph.ibm.com
>
>
>
>
>
>
------------------------------------------------
More information about the Met_help
mailing list