[Go-essp-tech] Progress and Problems with P2P

Kettleborough, Jamie jamie.kettleborough at metoffice.gov.uk
Thu Feb 2 03:51:35 MST 2012


Hello Martin, Sebastien, Stephen,
 
is there a wiki page some where that could gather these 'hints and tips on optimising your wget downloads'?  Maybe it's a section in the CMIP5 helpdesk FAQ?
 
Should it be made clear that the 'vanilla' wget scripts from either the Gateway or P2P are general and not 'optimal' for any one location - and users should tweek them depending on their own experiences?
 
Jamie


	I also found I was getting frequent file corruptions on data transfers from Australia - and have got far better success rate since adding a "--limit-rate=800k" flag to transfers from China, Japan and Australia (but you may have better network links to these nodes than us).  

	 

	I notice that those node seems to be far away from your home location.
	May I suggest you to give those options to wget ; from our experiences with synchro-data they appear to improve substantially the success rate :
	wget --timeout=20 --tries=10

	 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120202/4d9f03d4/attachment.html 


More information about the GO-ESSP-TECH mailing list