[Go-essp-tech] Error reinitializing THREDDS

Estanislao Gonzalez gonzalez at dkrz.de
Fri Feb 24 08:33:50 MST 2012


Hi,

yes I recall seeing them... but it's hard to reproduce, so I'm not sure 
under which circumstances this happens... perhaps aborting the 
publication leaves those empty files behind?

Thanks,
Estani


Am 24.02.2012 16:28, schrieb Serguei Nikonov:
> Hi Estani,
>
> have to admit that we regularly experience problem with too many open 
> files error and lack of memory. We even increased yesterday memory 
> allocation to 20G (from 16G) and open files limit to 8000. But this 
> was another case, some datasets xmls happened to be empty (?!).
>
> Thanks,
> Sergey
>
> On 02/24/2012 08:25 AM, Estanislao Gonzalez wrote:
>> Hi Sergei, Hans,
>>
>> This also happens if your TDS crashed because of the already 
>> mentioned problems
>> of memory or open files.
>>
>> Try restarting the node again. If it doesn't work immediately 
>> thereafter, then
>> is indeed something different. But I've seen this happening and it's 
>> kind of
>> frustrating to recheck everything for the n-th time, just to find out 
>> that the
>> node was under a lot of stress...
>>
>> Thanks,
>> Estani
>>
>> Am 23.02.2012 20:10, schrieb Drach, Bob:
>>> Hi Sergey,
>>>
>>> Look in the TDS catalogInit.log. On our system it's in
>>> /esg/content/thredds/logs. Check for errors in the most recent
>>> initialization. If you can spot the dataset(s) that caused the
>>> initialization error, just move those catalogs aside then rerun the
>>> esgunpublish. If that succeeds, then fix the 'broken' catalogs/datasets
>>> and regenerate them.
>>>
>>> --Bob
>>>
>>> On 2/23/12 9:48 AM, "Serguei Nikonov"<serguei.nikonov at noaa.gov> wrote:
>>>
>>>> Hi Bob,
>>>>
>>>> I have constantly this error when try to publish/unpublish any data:
>>>>
>>>> ERROR 2012-02-23 12:36:21,046 Error reading url
>>>> https://localhost:443/thredds/admin/debug?catalogs/reinit: HTTPError()
>>>> Traceback (most recent call last):
>>>> File "/usr/local/cdat/bin/esgunpublish", line 5, in<module>
>>>> pkg_resources.run_script('esgcet==2.9.0', 'esgunpublish')
>>>> File "build/bdist.linux-x86_64/egg/pkg_resources.py", line 489, in
>>>> run_script
>>>> File "build/bdist.linux-x86_64/egg/pkg_resources.py", line 1207, in
>>>> run_script
>>>> File
>>>> "/usr/local/cdat/lib/python2.6/site-packages/esgcet-2.9.0-py2.6.egg/EGG-IN 
>>>>
>>>> FO/scripts/esgunpublish",
>>>> line 221, in<module>
>>>> main(sys.argv[1:])
>>>> File
>>>> "/usr/local/cdat/lib/python2.6/site-packages/esgcet-2.9.0-py2.6.egg/EGG-IN 
>>>>
>>>> FO/scripts/esgunpublish",
>>>> line 184, in main
>>>> result = deleteDatasetList(datasetNames, Session, gatewayOp,
>>>> thredds, las,
>>>> deleteDset, deleteAll=deleteAll, republish=republish)
>>>> File
>>>> "/usr/local/cdat/lib/python2.6/site-packages/esgcet-2.9.0-py2.6.egg/esgcet 
>>>>
>>>> /publish/unpublish.py",
>>>> line 272, in deleteDatasetList
>>>> result = reinitializeThredds()
>>>> File
>>>> "/usr/local/cdat/lib/python2.6/site-packages/esgcet-2.9.0-py2.6.egg/esgcet 
>>>>
>>>> /publish/thredds.py",
>>>> line 1030, in reinitializeThredds
>>>> raise ESGPublishError("Error reinitializing the THREDDS Data Server:
>>>> %s"%msg)
>>>> esgcet.exceptions.ESGPublishError: Error reinitializing the THREDDS 
>>>> Data
>>>> Server:
>>>> HTTPError()
>>>>
>>>> Do you have any idea what is it?
>>>>
>>>> Thanks,
>>>> Sergey
>>>>
>>>>
>>>>
>>>> On 02/23/2012 12:35 AM, Hans Vahlenkamp wrote:
>>>>> Recall the discussion about how to determine the version number of 
>>>>> the
>>>>> installed ESGF software. I just realized that it is listed at the
>>>>> bottom
>>>>> of the home page:
>>>>>
>>>>> http://esgdata.gfdl.noaa.gov/esgf-node-manager/
>>>>>
>>>>> We have "v0.5.6 - bay_ridge release".
>>>>>
>>>>> Hans
>>>>>
>>>> _______________________________________________
>>>> GO-ESSP-TECH mailing list
>>>> GO-ESSP-TECH at ucar.edu
>>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>> _______________________________________________
>>> GO-ESSP-TECH mailing list
>>> GO-ESSP-TECH at ucar.edu
>>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>>
>>
>


-- 
Estanislao Gonzalez

Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  gonzalez at dkrz.de



More information about the GO-ESSP-TECH mailing list