[Go-essp-tech] questions about data node THREDDS problems

Wed Feb 29 10:31:00 MST 2012

Hi Serguei,

just to confirm that we have very bad time trying to access GFDL data.

Our averaged success rate is 2 success for 3 tries (over 11 months). 
With GFDL it's less than 10%.

By period the success rate can drop down to 100% of failure during days 
(this week end for example).

==> It could be good to periodically reboot pcmdi3 attribute service 
(once a day ?).

On our node we have
- 33% of "Request Completed - -1 - 0 - 0" during the last full hour. 
(220 requests total)
- 20% of "Request Completed - -1 - 0 - 0" during the last 2 days. (21 
000 requests total)

But I don't know what 1 - 0 - 0 means :-)

Furthermore I can not find any single error like yours in our log during 
February. So I guess the pcmdi3 attribute service bottleneck is not the 
only answer in your case.

regards.
Sébastien

Le 29/02/2012 18:04, Serguei Nikonov a écrit :
> Hi All,
>
> can somebody explain me the meaning of messages in THREDDS log file
> (threddsServlet.log). We have here in GFDL a LOT of messages like
>
> 2012-02-29T11:00:26.752 -0500 [   7201683][    5663] INFO  -
> thredds.servlet.FileServerServlet - Remote host: 134.157.176.252 - Request: "GET
> /thredds/fileServer/gfdl_dataroot/NOAA-GFDL/GFDL-ESM2M/rcp26/mon/atmos/Amon/r1i1p1/v20110601/rlds/rlds_Amon_GFDL-
> SM2M_rcp26_r1i1p1_206101-206512.nc HTTP/1.0"
>
> 2012-02-29T11:00:26.752 -0500 [   7201683][    5663] INFO  -
> thredds.servlet.FileServerServlet - Request Completed - -1 - 0 - 0
>
> What does it mean  "-1 - 0  - 0"? Does it mean that this request was not
> actually done?
>
> Actually, most of time we have these kind of messages on GFDL data node, and not
> too much happy ones like
> 2012-02-29T11:46:03.995 -0500 [   9938926][    9347] INFO  -
> thredds.servlet.ServletUtil - returnFile(): Request Completed - 206 - 0 - 27
>
> For example, for last 50 mins:
> bad one - 3876
> good one - 43.
>
> It means that there are only 1% of successful requests. Not too much...
> Is this rate common for other data nodes?
>
> Also, we have a lot java errors (see at the bottom). What the cause of them and
> how serious they are?
>
> Another issue, I tried to put this question on CMIP5 help desk
> (https://footprints.badc.rl.ac.uk) but was rejected with my credentials I am
> using for publishing data. Will I need to get another account for that? Also, I
> was rejected by the recipient domain when sent this email directly to CMIP5 help
> desk (cmip5-helpdesk at stfc.ac.uk)
>
>
> Thanks,
> Sergey Nikonov
>
>
> 2012-02-29T11:00:27.095 -0500 [   7202026][    5654] WARN  -
> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator -
> org.apache.commons.httpclient.ProtocolException: The server pcmdi3.llnl.gov
> failed to respond with a valid HTTP response
> java.lang.RuntimeException: org.apache.commons.httpclient.ProtocolException: The
> server pcmdi3.llnl.gov failed to respond with a valid HTTP response
>           at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:77)
>           at
> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator.authorize(SAMLAuthorizationServiceFilterCollaborator.java:78)
>           at
> esg.orp.app.AuthorizationFilter.attemptValidation(AuthorizationFilter.java:60)
>           at
> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:62)
>           at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>           at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>           at
> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:66)
>           at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>           at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>           at
> eske.web.filters.security.AuthorizationTokenValidationFilter.doFilter(AuthorizationTokenValidationFilter.java:84)
>           at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>           at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>           at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>           at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>           at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
>           at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>           at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>           at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>           at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>           at
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>           at
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
>           at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>           at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.commons.httpclient.ProtocolException: The server
> pcmdi3.llnl.gov failed to respond with a valid HTTP response
>           at
> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1987)
>           at
> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
>           at
> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
>           at
> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
>           at
> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>           at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>           at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>           at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:56)
>           ... 22 more
> 2012-02-29T11:00:27.096 -0500 [   7202027][    5655] WARN  -
> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator - java.io.IOException:
> Stream closed
> java.lang.RuntimeException: java.io.IOException: Stream closed
>           at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:81)
>           at
> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator.authorize(SAMLAuthorizationServiceFilterCollaborator.java:78)
>           at
> esg.orp.app.AuthorizationFilter.attemptValidation(AuthorizationFilter.java:60)
>           at
> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:62)
>           at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>           at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>           at
> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:66)
>           at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>           at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>           at
> eske.web.filters.security.AuthorizationTokenValidationFilter.doFilter(AuthorizationTokenValidationFilter.java:84)
>           at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>           at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>           at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>           at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>           at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
>           at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>           at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>           at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>           at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>           at
> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>           at
> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
>           at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>           at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Stream closed
>           at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:145)
>           at java.io.BufferedInputStream.fill(BufferedInputStream.java:189)
>           at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
>           at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
>           at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
>           at
> org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
>           at
> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
>           at
> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
>           at
> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
>           at
> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
>           at
> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>           at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>           at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>           at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:56)
>           ... 22 more
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech

-- 
Sébastien Denvil
IPSL, Pôle de modélisation du climat
UPMC, Case 101, 4 place Jussieu,
75252 Paris Cedex 5

Tour 45-55 2ème étage Bureau 209
Tel: 33 1 44 27 21 10
Fax: 33 1 44 27 39 02

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2945 bytes
Desc: Signature cryptographique S/MIME
Url : http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120229/a5253981/attachment-0001.bin 