[Go-essp-tech] [ESG-CET] CMIP5 Federation Testing Outline

Thu Nov 18 09:00:59 MST 2010

Hi Eric:

On Nov 18, 2010, at 8:52 AM, Eric Nienhouse wrote:

> Hi Luca, All,
> 
> Thanks for this input.  What I would propose are two "documents" to 
> support this testing work:
> 
> 1)  An outline of the tests with some detail about how to perform them, 
> and what constitutes and acceptable outcome.
> 2)  A tracking document to capture the tests themselves with comments, 
> dates and test related details as you note below.
> 
> I think a wiki is ideal for the outline (1) above.  I agree emailing a 
> document around is too cumbersome.
> 
> I think an issue tracker is ideal for (2) above.  I propose we use the 
> existing NCAR Jira system for this.  Once we have a good outline 
> organized we can then create the necessary Jira tasks to track progress 
> and issues.
> 
If it was my, I'd rather have a single summary table of (A,B) tests as opposed to a multitude of tickets, but maybe the two approaches can co-exist. In any case, I'll go with what the majority of people think is best.
thanks, Luca

> Does this sound reasonable?
> 
> Thanks,
> 
> -Eric
> 
> Cinquini, Luca (3880) wrote:
>> Hi Eric,
>> 	thanks for starting this document, the list of tests to perform looks like a good start - we might want expand it in a little more detail, like for example distinguishing between:
>> 
>> 1) http file download via browser started at the gateway
>> 2) http file download via browser started at the TDS page
>> 3) http multi-files download via wget script (directly to the TDS)
>> 
>> for both home data node and federated data node.
>> 
>> We might also want to have a matrix table where we list the result of conducting each test between institutions (A,B), with an attached date when the test was last performed.
>> 
>> As for where the document should live, I personally favor the esgf wiki option, although I could also go with 3) and 4). Exchanging the document by email is kind of cumbersome IMO.
>> 
>> thanks, Luca
>> 
>> On Nov 18, 2010, at 7:25 AM, Eric Nienhouse wrote:
>> 
>> 
>>> Dear ESG Gateway Collaborators,
>>> 
>>> We discussed the need for federation testing in our recent GO-ESSP 
>>> call.  I would like to continue our test planning discussion and 
>>> collaboratively develop a document to support this effort.
>>> 
>>> I welcome your input and insights, in particular for testing scenarios 
>>> related to security and access control of CMIP5 datasets.  I plan to 
>>> serve to coordinate our testing efforts, however, I need help from 
>>> others to develop and document them.
>>> 
>>> I have an draft outline of these key federation tests at the link below 
>>> and I would like your input:
>>> 
>>> https://wiki.ucar.edu/display/esgcet/CMIP5+Federation+Testing+Task+Matrix
>>> 
>>> Several options exist to enable collaborative access to this document.  
>>> I'd like suggestions from others on the best approach.  Some options follow:
>>> 
>>> 1)  Exchange this document by email and merge edits (we've done this in 
>>> the past)
>>> 2)  Move the document to the ESGF wiki (Stephen and Estani have 
>>> suggested this already.)
>>> 3)  Keep it on wiki.ucar.edu and provide logins to all collaborators.
>>> 4)  Move it to Google Docs.
>>> 
>>> There is momentum to use the ESGF wiki as at least one supporting 
>>> document may already be there (CMIP5 Status of Gateways and Datanodes.)
>>> 
>>> What do others think would be best?
>>> 
>>> Thanks for your input on this.
>>> 
>>> Kind regards,
>>> 
>>> -Eric
>>> 
>>> Eric Nienhouse wrote:
>>> 
>>>> Dear ESG Gateway Collaborators,
>>>> 
>>>> We're quickly approaching the 1.2.0 ESG Gateway software release. This 
>>>> version will provide the basis for the upcoming CMIP5 activity data 
>>>> management effort.
>>>> 
>>>> The Gateway 1.2.0 Release Candidate 1 (RC1) is now available for 
>>>> inter-gateway federation testing.  We encourage all who can to upgrade 
>>>> to this version as soon as is reasonably possible. (In particular, if 
>>>> your gateway is on the list of "Key Participating Gateways" below.) 
>>>> For installation and update details, see the included email below.
>>>> 
>>>> Please note that the Gateway 1.2.0 RC1 requires a corresponding Data 
>>>> Node version 1.0.4.0 or greater.  This Gateway upgrade may require an 
>>>> update to your Data Node components as well.
>>>> 
>>>> We're in need of significant inter-gateway (eg: federation) testing. 
>>>> In order to begin this process, it is important that all participating 
>>>> gateways are running a consistent pre-release 1.2.0 version.  The 
>>>> 1.2.0 RC1 is the recommended version for federation related testing.
>>>> 
>>>> Following are the Key Participating Gateways.  Several have already 
>>>> upgraded to the 1.2.0 RC1 version.  If you have not yet upgraded to 
>>>> the 1.2.0 RC1 version, please advise as to when this may be reasonably 
>>>> possible.  (Please send any details or questions to: 
>>>> esg-gateway-dev at earthsystemgrid.org)
>>>> 
>>>> ANU
>>>> BADC
>>>> DKRZ
>>>> JPL
>>>> LBNL
>>>> NCAR
>>>> ORNL
>>>> PCMDI
>>>> 
>>>> Please note the NCAR testing site (http://esg.prototype.ucar.edu) is 
>>>> currently running the 1.2.0 RC1 version for federation testing purposes.
>>>> 
>>>> I would like to begin discussing the top priority federation tests and 
>>>> would like to hear your input.  In particular, testing scenarios 
>>>> related to security and access control of CMIP5 datasets are of key 
>>>> importance.  I will send a follow up email regarding this testing effort.
>>>> 
>>>> Thank you for your involvement in this effort!
>>>> 
>>>> Kind Regards,
>>>> 
>>>> -Eric
>>>> 
>>>> On Sun, 14 Nov 2010 20:15:48 -0700
>>>> Nathan Wilhelmi <wilhelmi at ucar.edu> wrote:
>>>> 
>>>>> Hello,
>>>>> 
>>>>> We have made a new release of the gateway available, 1.2.0-RC1. The
>>>>> release resolves a number of issues that were identified in the BETA3
>>>>> release.
>>>>> 
>>>>> The new BETA release can be downloaded directly from here:
>>>>> https://vets.development.ucar.edu/nexus/content/repositories/releases/sgf/gateway/1.2.0-RC1/ 
>>>>> 
>>>>> 
>>>>> For this release the the new installation and upgrade from 1.1.0 guides
>>>>> remain the same.
>>>>> 
>>>>> If you already have 1.2.0-BETAx installed upgrade instructions can be
>>>>> found here:
>>>>> https://wiki.ucar.edu/display/esgcet/Gateway+Upgrade+Instructions+%28version+1.2.0-BETA-1.2.0-BETA2+to+version+1.2.0-BETA3%29 
>>>>> 
>>>>> 
>>>>> 
>>>>> Please provide feedback (good or bad!) to: 
>>>>> esg-gateway-dev at earthsystemgrid.org
>>>>> 
>>>>> -or-
>>>>> 
>>>>> If you have Jira Issue Tracking access, please enter a trouble ticket
>>>>> against version "1.2.0-RC1" under the "Affects Version/s" drop-down.
>>>>> 
>>>>> Thanks!!!
>>>>> 
>>>>> -Nate
>>>>> 
>>> _______________________________________________
>>> ESG-CET mailing list
>>> ESG-CET at earthsystemgrid.org
>>> http://mailman.ucar.edu/mailman/listinfo/esg-cet
>>> 
>> 
>> 
> 
> _______________________________________________
> GO-ESSP-TECH mailing list
> GO-ESSP-TECH at ucar.edu
> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech