[Go-essp-tech] Fwd: FW: CMIP5 download issue from BADC

Tue Jul 19 11:00:38 MDT 2011

 Hi,

A user called me up and wanted some help with this issue.
He indicated that he could not login at badc?

-------- Original Message --------
Subject: 	FW: CMIP5 download issue from BADC
Date: 	Tue, 19 Jul 2011 09:38:45 -0700
From: 	Thomas Reichler <thomas.reichler at utah.edu>
To: 	gavin at llnl.gov <gavin at llnl.gov>

-----Original Message-----
From: Thomas Reichler 
Sent: Tuesday, July 19, 2011 10:24 AM
To: 'cmip5-helpdesk at stfc.ac.uk'
Cc: 'esg-support at earthsystemgrid.org'
Subject: CMIP5 download issue from BADC

Hello,

I am having difficulties downloading CMIP5 data from the BADC Gateway.

I use the wget option to perform this, but when invoking the script a get many times errors like this:

...
--2011-07-19 01:30:50--  http://cmip-dn.badc.rl.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/piControl/mon/atmos/Amon/r1i1p1/v20110329/ta/ta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc
Resolving cmip-dn.badc.rl.ac.uk... 130.246.191.29
Connecting to cmip-dn.badc.rl.ac.uk|130.246.191.29|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://cmip-dn.badc.rl.ac.uk/OpenidRelyingParty/home.htm?redirect=http%3A%2F%2Fcmip-dn.badc.rl.ac.uk%2Fthredds%2FfileServer%2Fesg_dataroot%2Fcmip5%2Foutput1%2FMOHC%2FHadGEM2-ES%2FpiControl%2Fmon%2Fatmos%2FAmon%2Fr1i1p1%2Fv20110329%2Fta%2Fta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc [following]
--2011-07-19 01:30:51--  https://cmip-dn.badc.rl.ac.uk/OpenidRelyingParty/home.htm?redirect=http%3A%2F%2Fcmip-dn.badc.rl.ac.uk%2Fthredds%2FfileServer%2Fesg_dataroot%2Fcmip5%2Foutput1%2FMOHC%2FHadGEM2-ES%2FpiControl%2Fmon%2Fatmos%2FAmon%2Fr1i1p1%2Fv20110329%2Fta%2Fta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc
Connecting to cmip-dn.badc.rl.ac.uk|130.246.191.29|:443... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: http://cmip-dn.badc.rl.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/piControl/mon/atmos/Amon/r1i1p1/v20110329/ta/ta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc [following]
--2011-07-19 01:30:52--  http://cmip-dn.badc.rl.ac.uk/thredds/fileServer/esg_dataroot/cmip5/output1/MOHC/HadGEM2-ES/piControl/mon/atmos/Amon/r1i1p1/v20110329/ta/ta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc
Connecting to cmip-dn.badc.rl.ac.uk|130.246.191.29|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 564043684 (538M) [application/x-netcdf]
Saving to: `ta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc'

100%[==================================================================>] 564,043,684  394K/s   in 23m 26s 

2011-07-19 01:54:20 (392 KB/s) - `ta_Amon_HadGEM2-ES_piControl_r1i1p1_190912-193411.nc' saved [564043684/564043684]

--2011-07-19 01:54:20--  http://vesg.ipsl.fr/thredds/fileServer/esg_dataroot/CMIP5/output1/IPSL/IPSL-CM5A-LR/piControl/mon/atmos/cfMon/r1i1p1/v20110324/ta/ta_cfMon_IPSL-CM5A-LR_piControl_r1i1p1_260001-269912.nc
Resolving vesg.ipsl.fr... 134.157.176.104
Connecting to vesg.ipsl.fr|134.157.176.104|:80... connected.
HTTP request sent, awaiting response... 302 Moved Temporarily
Location: https://vesg.ipsl.fr/OpenidRelyingParty/home.htm?redirect=http%3A%2F%2Fvesg.ipsl.fr%2Fthredds%2FfileServer%2Fesg_dataroot%2FCMIP5%2Foutput1%2FIPSL%2FIPSL-CM5A-LR%2FpiControl%2Fmon%2Fatmos%2FcfMon%2Fr1i1p1%2Fv20110324%2Fta%2Fta_cfMon_IPSL-CM5A-LR_piControl_r1i1p1_260001-269912.nc [following]
--2011-07-19 01:54:21--  https://vesg.ipsl.fr/OpenidRelyingParty/home.htm?redirect=http%3A%2F%2Fvesg.ipsl.fr%2Fthredds%2FfileServer%2Fesg_dataroot%2FCMIP5%2Foutput1%2FIPSL%2FIPSL-CM5A-LR%2FpiControl%2Fmon%2Fatmos%2FcfMon%2Fr1i1p1%2Fv20110324%2Fta%2Fta_cfMon_IPSL-CM5A-LR_piControl_r1i1p1_260001-269912.nc
Connecting to vesg.ipsl.fr|134.157.176.104|:443... connected.
OpenSSL: error:14094416:SSL routines:SSL3_READ_BYTES:sslv3 alert certificate unknown
Unable to establish SSL connection.
...

As you can see, the transfer works for a while, but then I get these alert certificate errors. This issue is quite inconvenient because - given the amount of files to download - it is very difficult to keep track of what has been properly downloaded, what not, and then to reselect the files for download again.

Is there anything I do wrong or I can do differently?

With kind regards,

Thomas Reichler
Department of Atmospheric Sciences, University of Utah
135 S 1460 E, Rm 819 (WBB)
Salt Lake City, UT 84112-0110
801-585-0040 Fax: 801-581-4362
thomas.reichler at utah.edu, www.inscc.utah.edu/~reichler/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20110719/b1991c36/attachment.html 