[Go-essp-tech] questions about data node THREDDS problems

Serguei Nikonov serguei.nikonov at noaa.gov
Wed Feb 29 10:04:27 MST 2012 

Hi All,

can somebody explain me the meaning of messages in THREDDS log file 
(threddsServlet.log). We have here in GFDL a LOT of messages like

2012-02-29T11:00:26.752 -0500 [   7201683][    5663] INFO  - 
thredds.servlet.FileServerServlet - Remote host: 134.157.176.252 - Request: "GET 
/thredds/fileServer/gfdl_dataroot/NOAA-GFDL/GFDL-ESM2M/rcp26/mon/atmos/Amon/r1i1p1/v20110601/rlds/rlds_Amon_GFDL-
SM2M_rcp26_r1i1p1_206101-206512.nc HTTP/1.0"

2012-02-29T11:00:26.752 -0500 [   7201683][    5663] INFO  - 
thredds.servlet.FileServerServlet - Request Completed - -1 - 0 - 0

What does it mean  "-1 - 0  - 0"? Does it mean that this request was not 
actually done?

Actually, most of time we have these kind of messages on GFDL data node, and not 
too much happy ones like
2012-02-29T11:46:03.995 -0500 [   9938926][    9347] INFO  - 
thredds.servlet.ServletUtil - returnFile(): Request Completed - 206 - 0 - 27

For example, for last 50 mins:
bad one - 3876
good one - 43.

It means that there are only 1% of successful requests. Not too much...
Is this rate common for other data nodes?

Also, we have a lot java errors (see at the bottom). What the cause of them and 
how serious they are?

Another issue, I tried to put this question on CMIP5 help desk 
(https://footprints.badc.rl.ac.uk) but was rejected with my credentials I am 
using for publishing data. Will I need to get another account for that? Also, I 
was rejected by the recipient domain when sent this email directly to CMIP5 help 
desk (cmip5-helpdesk at stfc.ac.uk)


Thanks,
Sergey Nikonov


2012-02-29T11:00:27.095 -0500 [   7202026][    5654] WARN  - 
esg.orp.app.SAMLAuthorizationServiceFilterCollaborator - 
org.apache.commons.httpclient.ProtocolException: The server pcmdi3.llnl.gov 
failed to respond with a valid HTTP response
java.lang.RuntimeException: org.apache.commons.httpclient.ProtocolException: The 
server pcmdi3.llnl.gov failed to respond with a valid HTTP response
         at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:77)
         at 
esg.orp.app.SAMLAuthorizationServiceFilterCollaborator.authorize(SAMLAuthorizationServiceFilterCollaborator.java:78)
         at 
esg.orp.app.AuthorizationFilter.attemptValidation(AuthorizationFilter.java:60)
         at 
esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:62)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:66)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
eske.web.filters.security.AuthorizationTokenValidationFilter.doFilter(AuthorizationTokenValidationFilter.java:84)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
         at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
         at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
         at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
         at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
         at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
         at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
         at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
         at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
         at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
         at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.commons.httpclient.ProtocolException: The server 
pcmdi3.llnl.gov failed to respond with a valid HTTP response
         at 
org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1987)
         at 
org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
         at 
org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
         at 
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
         at 
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
         at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
         at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
         at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:56)
         ... 22 more
2012-02-29T11:00:27.096 -0500 [   7202027][    5655] WARN  - 
esg.orp.app.SAMLAuthorizationServiceFilterCollaborator - java.io.IOException: 
Stream closed
java.lang.RuntimeException: java.io.IOException: Stream closed
         at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:81)
         at 
esg.orp.app.SAMLAuthorizationServiceFilterCollaborator.authorize(SAMLAuthorizationServiceFilterCollaborator.java:78)
         at 
esg.orp.app.AuthorizationFilter.attemptValidation(AuthorizationFilter.java:60)
         at 
esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:62)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:66)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
eske.web.filters.security.AuthorizationTokenValidationFilter.doFilter(AuthorizationTokenValidationFilter.java:84)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
         at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
         at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
         at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
         at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
         at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
         at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
         at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
         at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
         at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
         at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Stream closed
         at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:145)
         at java.io.BufferedInputStream.fill(BufferedInputStream.java:189)
         at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
         at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
         at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
         at 
org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
         at 
org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
         at 
org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
         at 
org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
         at 
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
         at 
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
         at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
         at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
         at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:56)
         ... 22 more

More information about the GO-ESSP-TECH mailing list