[Go-essp-tech] questions about data node THREDDS problems
Jeffrey F. Painter
painter1 at llnl.gov
Wed Feb 29 13:26:04 MST 2012
I have had similar success rates recently. I've nevertheless downloaded
several terabytes to PCMDI (LLNL), some of which is in good enough shape
to publish here soon. Download rates are not much better at MIROC, the
other http site which I have used heavily.
I just wrote Kyle Olivo about finding quicker means of replicating GFDL
data.
- Jeff
On 2/29/12 9:31 AM, Sébastien Denvil wrote:
> Hi Serguei,
>
> just to confirm that we have very bad time trying to access GFDL data.
>
> Our averaged success rate is 2 success for 3 tries (over 11 months).
> With GFDL it's less than 10%.
>
> By period the success rate can drop down to 100% of failure during days
> (this week end for example).
>
> ==> It could be good to periodically reboot pcmdi3 attribute service
> (once a day ?).
>
> On our node we have
> - 33% of "Request Completed - -1 - 0 - 0" during the last full hour.
> (220 requests total)
> - 20% of "Request Completed - -1 - 0 - 0" during the last 2 days. (21
> 000 requests total)
>
> But I don't know what 1 - 0 - 0 means :-)
>
> Furthermore I can not find any single error like yours in our log during
> February. So I guess the pcmdi3 attribute service bottleneck is not the
> only answer in your case.
>
> regards.
> Sébastien
>
> Le 29/02/2012 18:04, Serguei Nikonov a écrit :
>> Hi All,
>>
>> can somebody explain me the meaning of messages in THREDDS log file
>> (threddsServlet.log). We have here in GFDL a LOT of messages like
>>
>> 2012-02-29T11:00:26.752 -0500 [ 7201683][ 5663] INFO -
>> thredds.servlet.FileServerServlet - Remote host: 134.157.176.252 - Request: "GET
>> /thredds/fileServer/gfdl_dataroot/NOAA-GFDL/GFDL-ESM2M/rcp26/mon/atmos/Amon/r1i1p1/v20110601/rlds/rlds_Amon_GFDL-
>> SM2M_rcp26_r1i1p1_206101-206512.nc HTTP/1.0"
>>
>> 2012-02-29T11:00:26.752 -0500 [ 7201683][ 5663] INFO -
>> thredds.servlet.FileServerServlet - Request Completed - -1 - 0 - 0
>>
>> What does it mean "-1 - 0 - 0"? Does it mean that this request was not
>> actually done?
>>
>> Actually, most of time we have these kind of messages on GFDL data node, and not
>> too much happy ones like
>> 2012-02-29T11:46:03.995 -0500 [ 9938926][ 9347] INFO -
>> thredds.servlet.ServletUtil - returnFile(): Request Completed - 206 - 0 - 27
>>
>> For example, for last 50 mins:
>> bad one - 3876
>> good one - 43.
>>
>> It means that there are only 1% of successful requests. Not too much...
>> Is this rate common for other data nodes?
>>
>> Also, we have a lot java errors (see at the bottom). What the cause of them and
>> how serious they are?
>>
>> Another issue, I tried to put this question on CMIP5 help desk
>> (https://footprints.badc.rl.ac.uk) but was rejected with my credentials I am
>> using for publishing data. Will I need to get another account for that? Also, I
>> was rejected by the recipient domain when sent this email directly to CMIP5 help
>> desk (cmip5-helpdesk at stfc.ac.uk)
>>
>>
>> Thanks,
>> Sergey Nikonov
>>
>>
>> 2012-02-29T11:00:27.095 -0500 [ 7202026][ 5654] WARN -
>> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator -
>> org.apache.commons.httpclient.ProtocolException: The server pcmdi3.llnl.gov
>> failed to respond with a valid HTTP response
>> java.lang.RuntimeException: org.apache.commons.httpclient.ProtocolException: The
>> server pcmdi3.llnl.gov failed to respond with a valid HTTP response
>> at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:77)
>> at
>> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator.authorize(SAMLAuthorizationServiceFilterCollaborator.java:78)
>> at
>> esg.orp.app.AuthorizationFilter.attemptValidation(AuthorizationFilter.java:60)
>> at
>> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:62)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:66)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>> eske.web.filters.security.AuthorizationTokenValidationFilter.doFilter(AuthorizationTokenValidationFilter.java:84)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>> at
>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>> at
>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
>> at
>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>> at
>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>> at
>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>> at
>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>> at
>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>> at
>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
>> at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: org.apache.commons.httpclient.ProtocolException: The server
>> pcmdi3.llnl.gov failed to respond with a valid HTTP response
>> at
>> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1987)
>> at
>> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
>> at
>> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
>> at
>> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
>> at
>> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>> at
>> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>> at
>> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>> at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:56)
>> ... 22 more
>> 2012-02-29T11:00:27.096 -0500 [ 7202027][ 5655] WARN -
>> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator - java.io.IOException:
>> Stream closed
>> java.lang.RuntimeException: java.io.IOException: Stream closed
>> at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:81)
>> at
>> esg.orp.app.SAMLAuthorizationServiceFilterCollaborator.authorize(SAMLAuthorizationServiceFilterCollaborator.java:78)
>> at
>> esg.orp.app.AuthorizationFilter.attemptValidation(AuthorizationFilter.java:60)
>> at
>> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:62)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>> esg.orp.app.AccessControlFilterTemplate.doFilter(AccessControlFilterTemplate.java:66)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>> eske.web.filters.security.AuthorizationTokenValidationFilter.doFilter(AuthorizationTokenValidationFilter.java:84)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>> at
>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> at
>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>> at
>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>> at
>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:470)
>> at
>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>> at
>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>> at
>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>> at
>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
>> at
>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>> at
>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
>> at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.io.IOException: Stream closed
>> at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:145)
>> at java.io.BufferedInputStream.fill(BufferedInputStream.java:189)
>> at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
>> at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
>> at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
>> at
>> org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
>> at
>> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
>> at
>> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
>> at
>> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
>> at
>> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
>> at
>> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>> at
>> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>> at
>> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>> at esg.security.common.SOAPServiceClient.doSoap(SOAPServiceClient.java:56)
>> ... 22 more
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>
> --
> Sébastien Denvil
> IPSL, Pôle de modélisation du climat
> UPMC, Case 101, 4 place Jussieu,
> 75252 Paris Cedex 5
>
> Tour 45-55 2ème étage Bureau 209
> Tel: 33 1 44 27 21 10
> Fax: 33 1 44 27 39 02
>
More information about the GO-ESSP-TECH
mailing list