[Go-essp-tech] wget script reports 302 Moved Temporarily ... for days! [SEC=UNCLASSIFIED]

Fri Feb 17 05:17:42 MST 2012

Hi,

to get back at the wget-script.sh question, that's the way the system 
works and has nothing to do with the files being moved.

I guess that a detailed description would certainly make most people 
dizzy... but the process is:
1) user want to get a file (http no security and fast)
2) user is not known to be logged in so redirect (302) to a service that 
will check this (check url has completely changed and now is http*s* 
secured and slow)
3) client sends certificate (certificate is sent only to http*s*) and if 
everything is ok, wget gets the cookie (state is stored) and goes back 
to the original http (with a cookie!) (again 302)
4) now the download proceeds (or not, 403 if the certificate is not 
"enough", e.g. if CMIP5 Research group membership is required, and the 
certificate doesn't show this)

I'm not sure which wget are you talking about (some Gateways have a 
different one), but the default one first version was more quiet, though 
people didn't like that, so that's why all what's happening is being shown.

My advice is to copy & paste the URL that is suspiciously breaking into 
a browser and see what happens. You should be derived to a page where 
you must put your OpenID. If you get a 403 then you just can't access 
that file. There might be quite a few issues causing this, in 99% of the 
cases it's just because the user don't have the required membership, and 
~ 50% of those cases is because the user has multiple OpenIDs...

I tried to explain what happens and be as brief as possible...

If anyone has problems downloading files, or any other problem regarding 
the usage of the ESG Federation, please send your questions to: 
cmip5-helpdesk at stfc.ac.uk
Describing the problem as described in the contact us page: 
http://ipcc-ar5.dkrz.de/contactus/contact-us.htm

Regards,
Estani

PS: tds.ucar.edu is not responding at the time of this writing.

Am 16.02.2012 22:01, schrieb Sébastien Denvil:
> Hi,
>
> I would say we have to check with NCAR people. They produced a version 
> v20120203 just after the v20120202.
>
> We have been able to download the v20120202, but never the v20120203 ; 
> just like you. It seems to me like a mistake. The v20120202 is still 
> available.
>
> Anyone on the list could check directly with them this version story?
>
> Regards.
> Sébastien
>
> Le 16/02/2012 21:44, Lawson Hanson a écrit :
>> Hi,
>>
>> Can anyone explain why an "wget-download.sh" script
>>      obtained from the ESG should produce the following
>>      errors, one like this for each file listed in the script?
>>
>>    --2012-02-17 06:35:35--  
>> http://tds.ucar.edu/thredds/fileServer/datazone/cmip5_data/cmip5/output1/NCAR/CCSM4/rcp85/mon/atmos/Amon/r1i1p1/v20120203/hfss/hfss_Amon_CCSM4_rcp85_r1i1p1_200601-210012.nc
>>    Resolving tds.ucar.edu... 128.117.12.72
>>    Connecting to tds.ucar.edu|128.117.12.72|:80... connected.
>>    HTTP request sent, awaiting response... 302 Moved Temporarily
>>    Location: 
>> https://tds.ucar.edu/OpenidRelyingParty/home.htm?redirect=http%3A%2F%2Ftds.ucar.edu%2Fthredds%2FfileServer%2Fdatazone%2Fcmip5_data%2Fcmip5%2Foutput1%2FNCAR%2FCCSM4%2Frcp85%2Fmon%2Fatmos%2FAmon%2Fr1i1p1%2Fv20120203%2Fhfss%2Fhfss_Amon_CCSM4_rcp85_r1i1p1_200601-210012.nc 
>> [following]
>>    --2012-02-17 06:35:36--  
>> https://tds.ucar.edu/OpenidRelyingParty/home.htm?redirect=http%3A%2F%2Ftds.ucar.edu%2Fthredds%2FfileServer%2Fdatazone%2Fcmip5_data%2Fcmip5%2Foutput1%2FNCAR%2FCCSM4%2Frcp85%2Fmon%2Fatmos%2FAmon%2Fr1i1p1%2Fv20120203%2Fhfss%2Fhfss_Amon_CCSM4_rcp85_r1i1p1_200601-210012.nc
>>    Connecting to tds.ucar.edu|128.117.12.72|:443... connected.
>>    HTTP request sent, awaiting response... 302 Moved Temporarily
>> Location: 
>> http://tds.ucar.edu/thredds/fileServer/datazone/cmip5_data/cmip5/output1/NCAR/CCSM4/rcp85/mon/atmos/Amon/r1i1p1/v20120203/hfss/hfss_Amon_CCSM4_rcp85_r1i1p1_200601-210012.nc 
>> [following]
>>    --2012-02-17 06:35:38--  
>> http://tds.ucar.edu/thredds/fileServer/datazone/cmip5_data/cmip5/output1/NCAR/CCSM4/rcp85/mon/atmos/Amon/r1i1p1/v20120203/hfss/hfss_Amon_CCSM4_rcp85_r1i1p1_200601-210012.nc
>>    Connecting to tds.ucar.edu|128.117.12.72|:80... connected.
>>    HTTP request sent, awaiting response... 403 Forbidden
>>    2012-02-17 06:35:45 ERROR 403: Forbidden.
>>
>> What does the "302 Moved Temporarily" imply?
>>      And if the file has been moved, then why isn't there
>>      a link to it so that the "wget-download.sh" script
>>      just works?
>>
>> I have tried several times over the past couple of days
>>      (thinking that perhaps there was a server fault, etc.)
>>      to run this "wget-download.sh" script, but each time
>>      with the same result.
>>
>> Your resolution for this problem will be most appreciated by
>>      a number of CAWCR/BoM/CSIRO scientists in Australia,
>>      because they all want to include the "CCSM4" model
>>      in their analyses.
>>
>> Best regards,
>>
>> Lawson Hanson
>> -------------
>>      CAWCR, Climate Variability and Change group,
>>      Climate Change Science team,
>>      Bureau of Meteorology, 700 Collins Street,
>>      Melbourne Docklands, VIC 3008
>>      Telephone: +61 3 9669 4763
>>
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
>
>
>
>
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech

-- 
Estanislao Gonzalez

Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany

Phone:   +49 (40) 46 00 94-126
E-Mail:  gonzalez at dkrz.de

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120217/fc4f1dfb/attachment.html 