[Go-essp-tech] GFDL data via pcmdi9

Thu Mar 8 08:38:04 MST 2012

Hi Luca,

We just made some configuration changes at GFDL that will hopefully prevent
> this problem - i.e. old users won't have to enroll in CMIP5 again.

We tried the standard workflow with another open id (one that has been
registered in CMIP5 Research on pcmdi3, but not pcmdi9).

   - Navigate and login to pcmdi3.
   - Select dataset to download.
   - Use myproxy java application to generate a certificate.
   - Download wget script (temporarily adding --no-check-certificate to
   avoid our certificate issue).
   - Launch wget script and receive a 403 forbidden error.

So it still seems that membership in CMIP5 Research is still not linked
between pcmdi3 and pcmdi9.
Thanks,
Kyle

On Thu, Mar 8, 2012 at 9:45 AM, Cinquini, Luca (3880) <
Luca.Cinquini at jpl.nasa.gov> wrote:

> Hi Kyle,
> thanks for your thoughts...
>
> On Mar 8, 2012, at 7:27 AM, Kyle Olivo wrote:
>
> Hi Luca et al,
>
> Michael's question is a good one. At the moment, users can access GFDL
> data easily via pcmdi9. However, most users will probably first attempt to
> use pcmdi3. Assuming we correct the certificate issue that is preventing
> all downloads from pcmdi3, how do we inform users that they need to enroll
> in the CMIP5 Research group on pcmdi9 to access GFDL data? It seems like
> this will lead to lots of confusion.
>
>
> We just made some configuration changes at GFDL that will hopefully
> prevent this problem - i.e. old users won't have to enroll in CMIP5 again.
>
>
> Given that the p2p stack is in beta, I don't think we want to point users
> directly to pcmdi9, correct?
>
>
> We are trying to proceed carefully here... so yes, you are right, we
> should not have all users use the new system yet.
>
>
> As an additional note, after I logged in to pcmdi9, added data to my data
> cart, and then used the 'generate wget' script button, I was immediately
> given the script but never prompted to enroll in CMIP5 Research. Should the
> user be prompted if they don't already belong to the research role?
>
>
> This is a good suggestion - not completely sure how easy it is to
> implement though....
>
> thanks again,
> Luca
>
>
> Thanks,
> Kyle
>
> On Wed, Mar 7, 2012 at 8:22 PM, Ganzberger, Michael <Ganzberger1 at llnl.gov>wrote:
>
>> ** **
>>
>> Hi all, ****
>>
>> ** **
>>
>> should we be directing users to get their GFDL data from pcmdi9 if they
>> are having trouble getting it from pcmdi3?****
>>
>> ** **
>>
>> Thanks, Mike****
>>
>> ** **
>>
>> ** **
>>
>> *From:* go-essp-tech-bounces at ucar.edu [mailto:
>> go-essp-tech-bounces at ucar.edu] *On Behalf Of *Cinquini, Luca (3880)
>> *Sent:* Wednesday, March 07, 2012 4:48 PM
>> *To:* Kyle Olivo
>> *Cc:* go-essp-tech at ucar.edu
>> *Subject:* Re: [Go-essp-tech] GFDL data via pcmdi9****
>>
>> ** **
>>
>> Ah, beautiful.... Thanks Kyle, I hope you find the new system useful,
>> please let us know what can be improved. As a warning, we are indeed in
>> beta testing now - we want to gather feedback from a few friendly users
>> before going into production.****
>>
>> thanks, Luca****
>>
>> ** **
>>
>> On Mar 7, 2012, at 3:15 PM, Kyle Olivo wrote:****
>>
>>
>>
>> ****
>>
>> Luca,
>>
>> Very sorry. It was confusion on my part.
>>
>> I guess I needed to apply for CMIP5 Research on pcmdi9 (it was only in
>> CMIP5 Research on pcmdi3 I guess).
>>
>> Sorry for the false alarm. It is working now.
>>
>> Thanks,
>> Kyle****
>>
>> On Wed, Mar 7, 2012 at 5:10 PM, Kyle Olivo <kyle.olivo at noaa.gov> wrote:**
>> **
>>
>> Hi Luca,****
>>
>>    - Portal: http://pcmdi9.llnl.gov/****
>>    - OpenID: https://pcmdi3.llnl.gov/esgcet/myopenid/kyle.olivo (in
>>    CMIP5 Research)****
>>
>> I've attached the script. Another user from GFDL (Aparna) tried her
>> OpenID (also in CMIP5 Research) and had the same issue. I believe her
>> OpenID is:****
>>
>> https://pcmdi3.llnl.gov/esgcet/myopenid/a1r<https://pcmdi3.llnl.gov/esgcet/myopenid/kyle.olivo>
>> ****
>>
>> Thanks,****
>>
>> Kyle****
>>
>> On Wed, Mar 7, 2012 at 4:51 PM, Cinquini, Luca (3880) <
>> Luca.Cinquini at jpl.nasa.gov> wrote:****
>>
>> Hi Kyle:****
>>
>> let's see if I can reproduce your problem...****
>>
>> ** **
>>
>> o which portal did you start with to generate the wget script ?****
>>
>> o which openid did you use to run the script ? The openid needs to be
>> enabled for CMIP5 Research - or Commercial to work****
>>
>> ** **
>>
>> Finally, could you please include the script so I can try to run it ?****
>>
>> ** **
>>
>> thanks, Luca****
>>
>> ** **
>>
>> On Mar 7, 2012, at 2:43 PM, Kyle Olivo wrote:****
>>
>> ** **
>>
>> Hi all,
>>
>> I heard the good news regarding retrieving data from GFDL's data node
>> using the pcmdi9 wget scripts, so I tried it out. Sadly, luck was not on my
>> side:****
>>
>>   ****
>>
>> tasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc ...Downloading
>> --2012-03-07 16:35:24--
>> http://esgdata.gfdl.noaa.gov/thredds/fileServer/gfdl_dataroot/NOAA-GFDL/GFDL-CM3/historical/day/atmos/day/r3i1p1/v20110601/tasmax/tasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc
>> Resolving esgdata.gfdl.noaa.gov... 140.208.31.117
>> Connecting to esgdata.gfdl.noaa.gov|140.208.31.117|:80... connected.
>> HTTP request sent, awaiting response... 302 Moved Temporarily
>> Location:
>> https://esgdata.gfdl.noaa.gov/esg-orp/home.htm?redirect=http%3A%2F%2Fesgdata.gfdl.noaa.gov%2Fthredds%2FfileServer%2Fgfdl_dataroot%2FNOAA-GFDL%2FGFDL-CM3%2Fhistorical%2Fday%2Fatmos%2Fday%2Fr3i1p1%2Fv20110601%2Ftasmax%2Ftasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc[following]
>> --2012-03-07 16:35:24--
>> https://esgdata.gfdl.noaa.gov/esg-orp/home.htm?redirect=http%3A%2F%2Fesgdata.gfdl.noaa.gov%2Fthredds%2FfileServer%2Fgfdl_dataroot%2FNOAA-GFDL%2FGFDL-CM3%2Fhistorical%2Fday%2Fatmos%2Fday%2Fr3i1p1%2Fv20110601%2Ftasmax%2Ftasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc
>> Connecting to esgdata.gfdl.noaa.gov|140.208.31.117|:443... connected.
>> WARNING: cannot verify esgdata.gfdl.noaa.gov's certificate, issued by
>> `/O=Grid/OU=GlobusTest/OU=
>> simpleCA-pcmdi3.llnl.gov/CN=esgdata.gfdl.noaa.gov':
>>   Self-signed certificate encountered.
>> HTTP request sent, awaiting response... 302 Moved Temporarily
>> Location:
>> http://esgdata.gfdl.noaa.gov/thredds/fileServer/gfdl_dataroot/NOAA-GFDL/GFDL-CM3/historical/day/atmos/day/r3i1p1/v20110601/tasmax/tasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc[following]
>> --2012-03-07 16:35:24--
>> http://esgdata.gfdl.noaa.gov/thredds/fileServer/gfdl_dataroot/NOAA-GFDL/GFDL-CM3/historical/day/atmos/day/r3i1p1/v20110601/tasmax/tasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc
>> Connecting to esgdata.gfdl.noaa.gov|140.208.31.117|:80... connected.
>> HTTP request sent, awaiting response... 302 Moved Temporarily
>> Location:
>> https://esgdata.gfdl.noaa.gov/esg-orp/registration-request.htm?resource=http%3A%2F%2Fesgdata.gfdl.noaa.gov%2Fthredds%2FfileServer%2Fgfdl_dataroot%2FNOAA-GFDL%2FGFDL-CM3%2Fhistorical%2Fday%2Fatmos%2Fday%2Fr3i1p1%2Fv20110601%2Ftasmax%2Ftasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc[following]
>> --2012-03-07 16:35:24--
>> https://esgdata.gfdl.noaa.gov/esg-orp/registration-request.htm?resource=http%3A%2F%2Fesgdata.gfdl.noaa.gov%2Fthredds%2FfileServer%2Fgfdl_dataroot%2FNOAA-GFDL%2FGFDL-CM3%2Fhistorical%2Fday%2Fatmos%2Fday%2Fr3i1p1%2Fv20110601%2Ftasmax%2Ftasmax_day_GFDL-CM3_historical_r3i1p1_19050101-19091231.nc
>> Connecting to esgdata.gfdl.noaa.gov|140.208.31.117|:443... connected.
>> WARNING: cannot verify esgdata.gfdl.noaa.gov's certificate, issued by
>> `/O=Grid/OU=GlobusTest/OU=
>> simpleCA-pcmdi3.llnl.gov/CN=esgdata.gfdl.noaa.gov':
>>   Self-signed certificate encountered.
>> HTTP request sent, awaiting response... 403 Forbidden
>> 2012-03-07 16:35:24 ERROR 403: Forbidden.
>>
>> download failed****
>>
>>
>> I tried the same with a colleagues openid, and we saw the same message. I
>> know there are still lingering issues with the self-signed certificate and
>> pcmdi3, but are others able to obtain GFDL data using the wget scripts from
>> pcmdi9? I ran the script with "-i" to avoid the certificate issue:****
>>
>> wget-20120307133412.sh -i****
>>
>>
>> Thanks,
>> Kyle****
>>
>>
>> --
>> Kyle Olivo
>> Modeling Services Group
>> Geophysical Fluid Dynamics Lab
>> o: 609-452-5316 | c: 541-450-9010****
>>
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech****
>>
>> ** **
>>
>>
>>
>>
>> --
>> Kyle Olivo
>> Modeling Services Group
>> Geophysical Fluid Dynamics Lab
>> o: 609-452-5316 | c: 541-450-9010****
>>
>>
>>
>>
>> --
>> Kyle Olivo
>> Modeling Services Group
>> Geophysical Fluid Dynamics Lab
>> o: 609-452-5316 | c: 541-450-9010****
>>
>> ** **
>>
>
>
>
> --
> Kyle Olivo
> Modeling Services Group
> Geophysical Fluid Dynamics Lab
> o: 609-452-5316 | c: 541-450-9010
>
>
>

-- 
Kyle Olivo
Modeling Services Group
Geophysical Fluid Dynamics Lab
o: 609-452-5316 | c: 541-450-9010
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120308/93a89b00/attachment-0001.html 