[Go-essp-tech] Progress and Problems with P2P

[Kettleborough, Jamie]

Hello Stephen,
 
I don't think, to start off with, I'd fork too many pages.  'Though that said I think keeping 'data issues' (new versions, netcdf attributes etc) seperate from 'system issues'  (authentication, download problems) is a good idea.  Will you have a clickable table of contents - I think this is fairly common for FAQs isn't it.  What does anyone else think?
 
Do you think its a good idea to include a section on 'optimising wgets'?  Or am I suggesting something daft.
 
Jamie
 
(ps you'll be glad to hear I'll be off air this afternoon - so less noise from me)
 
 


________________________________

	From: stephen.pascoe at stfc.ac.uk [mailto:stephen.pascoe at stfc.ac.uk] 
	Sent: 02 February 2012 10:56
	To: Kettleborough, Jamie; martin.juckes at stfc.ac.uk; jma at cola.iges.org; go-essp-tech at ucar.edu; sebastien.denvil at ipsl.jussieu.fr
	Subject: RE: [Go-essp-tech] Progress and Problems with P2P
	
	

	Hi Jamie,

	 

	I've just fired-off an email to Gavin Bell asking him to loosen the restrictions on the esgf.org wiki so I can reorganise the FAQ content.  At the moment we have several disorganised FAQs.  Mark Elkington suggested a CMIP5 Provider FAQ for provider-specific data issues.

	 

	Take a look at http://esgf.org/wiki/CMIP5HelpDeskFAQ.  I hope to migrate the top section to it's own page soon and open-up write access.  What would be your suggestion of how to organise the FAQs into sub-pages?

	 

	Thanks,

	Stephen.

	 

	---

	Stephen Pascoe  +44 (0)1235 445980

	Centre of Environmental Data Archival

	STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK

	 

	From: go-essp-tech-bounces at ucar.edu [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of Kettleborough, Jamie
	Sent: 02 February 2012 10:52
	To: Juckes, Martin (STFC,RAL,RALSP); jma at cola.iges.org; go-essp-tech at ucar.edu; Sébastien Denvil
	Subject: Re: [Go-essp-tech] Progress and Problems with P2P

	 

	Hello Martin, Sebastien, Stephen,

	 

	is there a wiki page some where that could gather these 'hints and tips on optimising your wget downloads'?  Maybe it's a section in the CMIP5 helpdesk FAQ?

	 

	Should it be made clear that the 'vanilla' wget scripts from either the Gateway or P2P are general and not 'optimal' for any one location - and users should tweek them depending on their own experiences?

	 

	Jamie

		 

		I also found I was getting frequent file corruptions on data transfers from Australia - and have got far better success rate since adding a "--limit-rate=800k" flag to transfers from China, Japan and Australia (but you may have better network links to these nodes than us).  

		 

		I notice that those node seems to be far away from your home location.
		May I suggest you to give those options to wget ; from our experiences with synchro-data they appear to improve substantially the success rate :
		wget --timeout=20 --tries=10

		 


	-- 
	Scanned by iCritical. 


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120202/a54bd972/attachment.html