[Go-essp-tech] Progress and Problems with P2P

[stephen.pascoe at stfc.ac.uk]

Hi Jamie,

I've just fired-off an email to Gavin Bell asking him to loosen the restrictions on the esgf.org wiki so I can reorganise the FAQ content.  At the moment we have several disorganised FAQs.  Mark Elkington suggested a CMIP5 Provider FAQ for provider-specific data issues.

Take a look at http://esgf.org/wiki/CMIP5HelpDeskFAQ.  I hope to migrate the top section to it's own page soon and open-up write access.  What would be your suggestion of how to organise the FAQs into sub-pages?

Thanks,
Stephen.

---
Stephen Pascoe  +44 (0)1235 445980
Centre of Environmental Data Archival
STFC Rutherford Appleton Laboratory, Harwell Oxford, Didcot OX11 0QX, UK

From: go-essp-tech-bounces at ucar.edu [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of Kettleborough, Jamie
Sent: 02 February 2012 10:52
To: Juckes, Martin (STFC,RAL,RALSP); jma at cola.iges.org; go-essp-tech at ucar.edu; Sébastien Denvil
Subject: Re: [Go-essp-tech] Progress and Problems with P2P

Hello Martin, Sebastien, Stephen,

is there a wiki page some where that could gather these 'hints and tips on optimising your wget downloads'?  Maybe it's a section in the CMIP5 helpdesk FAQ?

Should it be made clear that the 'vanilla' wget scripts from either the Gateway or P2P are general and not 'optimal' for any one location - and users should tweek them depending on their own experiences?

Jamie

I also found I was getting frequent file corruptions on data transfers from Australia - and have got far better success rate since adding a "--limit-rate=800k" flag to transfers from China, Japan and Australia (but you may have better network links to these nodes than us).

I notice that those node seems to be far away from your home location.
May I suggest you to give those options to wget ; from our experiences with synchro-data they appear to improve substantially the success rate :
wget --timeout=20 --tries=10


-- 
Scanned by iCritical.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120202/16b437ef/attachment.html