<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Hi Phil:<div><br><div><div>On Nov 20, 2009, at 9:29 AM, <<a href="mailto:philip.kershaw@stfc.ac.uk">philip.kershaw@stfc.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"> <div style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"> <div><span class="169341516-20112009"><font face="Tahoma" color="#0000ff" size="2">I suppose my next question then is - probably to Luca :) - is the security policy in the Gateway determined by the DRS based URLs? </font></span><span class="169341516-20112009"></span></div></div></blockquote><div>The security policy on the Gateway is totally independent on any physical path, it is established on logical identifiers. But, any URL can be resolved to its logical object, and thehrefore the access control attributes retrieved.</div><blockquote type="cite"><div style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"><div><span class="169341516-20112009"><font face="Tahoma" color="#0000ff" size="2">For the ESG software stack have you looked at how the DRS structure will map to the services exposed by the data node or the underlying file system(s)?</font></span></div></div></blockquote>Not yet... there is a general requirement of resolving a DRS URL to a page that lists all services for the corresponding dataset, or perhaps directly to a data stream, but we haven't talked about implementation yet. We touched briefly on this at the last telecon.</div><div>thanks, Luca<br><blockquote type="cite"><div style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"> <div><span class="169341516-20112009"><font face="Tahoma" color="#0000ff" size="2"></font></span> </div> <div><span class="169341516-20112009"><font face="Tahoma" color="#0000ff" size="2">Cheers,</font></span></div> <div><span class="169341516-20112009"><font face="Tahoma" color="#0000ff" size="2">Phil</font></span></div> <blockquote dir="ltr" style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px"> <div></div> <div class="OutlookMessageHeader" lang="en-us" dir="ltr" align="left"><font face="Tahoma" size="2">-----Original Message-----<br><b>From:</b> Don Middleton [<a href="mailto:don@ucar.edu">mailto:don@ucar.edu</a>] <br><b>Sent:</b> 20 November 2009 16:12<br><b>To:</b> Dean N. Williams<br><b>Cc:</b> Don Middleton; Kershaw, Philip (STFC,RAL,SSTD); <a href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br><b>Subject:</b> Re: [Go-essp-tech] DRS hierarchy on disk<br><br></font></div>We discussed this topic (GridFTP on vfs) a fair bit several years ago. We didn't end up pursuing it, however, and at this point I don't recall all the reasons. <div><br></div> <div>don</div> <div><br></div> <div><br> <div> <div>On Nov 20, 2009, at 8:43 AM, Dean N. Williams wrote:</div><br class="Apple-interchange-newline"> <blockquote type="cite"> <div style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space">Hi Phil, <div><br></div> <div><span class="Apple-tab-span" style="WHITE-SPACE: pre"></span>This is a good question. Perhaps Rachana or Frank can look into this and return a proper answer. My first thought is no, but I am not an expert on GridFTP.</div> <div><br></div> <div>Best regards,</div> <div><span class="Apple-tab-span" style="WHITE-SPACE: pre"></span>Dean</div> <div><br> <div> <div>On Nov 20, 2009, at 2:28 AM, <<a href="mailto:philip.kershaw@stfc.ac.uk">philip.kershaw@stfc.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"> <blockquote type="cite"> <div style="WORD-WRAP: break-word; webkit-nbsp-mode: space; webkit-line-break: after-white-space"> <div><font face="Tahoma" color="#0000ff" size="2"><span class="522001910-20112009">This is a problem for something like GridFTP where you 'see' the file system on the server not the DRS hierarchy. <span class="522001910-20112009">It's a headache for applying security policy as presumably this is based on the DRS structure. Some kind of mapping would need to be maintained. </span></span></font></div> <div><font face="Tahoma" color="#0000ff" size="2"><span class="522001910-20112009"><span class="522001910-20112009"></span></span></font> </div> <div><font face="Tahoma" color="#0000ff" size="2"><span class="522001910-20112009"><span class="522001910-20112009"></span>Is there a way of altering the GridFTP server side interface so that it could see a virtual file system structure based on the DRS?</span></font></div> <div><font face="Tahoma" color="#0000ff" size="2"><span class="522001910-20112009"></span></font> </div> <div><font face="Tahoma" color="#0000ff" size="2"><span class="522001910-20112009">Cheers,</span></font></div> <div><font face="Tahoma" color="#0000ff" size="2"><span class="522001910-20112009">Phil</span></font></div> <blockquote dir="ltr" style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px"> <div></div> <div class="OutlookMessageHeader" lang="en-us" dir="ltr" align="left"><font face="Tahoma" size="2">-----Original Message-----<br><b>From:</b> <a href="mailto:go-essp-tech-bounces@ucar.edu">go-essp-tech-bounces@ucar.edu</a> [<a href="mailto:go-essp-tech-bounces@ucar.edu">mailto:go-essp-tech-bounces@ucar.edu</a>] <b>On Behalf Of </b>Dean N. Williams<br><b>Sent:</b> 19 November 2009 12:14<br><b>To:</b> Lawrence, Bryan (STFC,RAL,SSTD)<br><b>Cc:</b> <a href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br><b>Subject:</b> Re: [Go-essp-tech] DRS hierarchy on disk<br><br></font></div>This is a correct statement. <div><br></div> <div>-Dean</div> <div><br> <div> <div>On Nov 19, 2009, at 4:04 AM, <<a href="mailto:bryan.lawrence@stfc.ac.uk">bryan.lawrence@stfc.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"> <blockquote type="cite"><span class="Apple-style-span" style="WORD-SPACING: 0px; FONT: medium Helvetica; TEXT-TRANSFORM: none; COLOR: rgb(0,0,0); TEXT-INDENT: 0px; WHITE-SPACE: normal; LETTER-SPACING: normal; BORDER-COLLAPSE: separate; orphans: 2; widows: 2; webkit-border-horizontal-spacing: 0px; webkit-border-vertical-spacing: 0px; webkit-text-decorations-in-effect: none; webkit-text-size-adjust: auto; webkit-text-stroke-width: 0px"> <div lang="EN-GB" link="blue" vlink="navy"><o:smarttagtype namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="City"><o:smarttagtype namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="place"> <div class="Section1"> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Hi Stephen<o:p></o:p></span></font></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p></o:p></span></font></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Bob or someone else can confirm, but I think the issue is that ESG in general is aiming at supporting more than just the DRS, so while conforming to DRS is a given for CMIP5, it’s not a given for all the datasets that ESG may work with.<o:p></o:p></span></font></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p></o:p></span></font></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><st1:city w:st="on"><st1:place w:st="on"><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Bryan</span></font></st1:place></st1:city><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p></o:p></span></font></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" color="navy" size="2"><span style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p></o:p></span></font></div> <div> <div class="MsoNormal" style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'; TEXT-ALIGN: center" align="center"><font face="Times New Roman" size="3"><span lang="EN-US" style="FONT-SIZE: 12pt"> <hr tabindex="-1" align="center" width="100%" size="2"> </span></font></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><b><font face="Tahoma" size="2"><span lang="EN-US" style="FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">From:</span></font></b><font face="Tahoma" size="2"><span lang="EN-US" style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"><span class="Apple-converted-space"> </span><a href="mailto:go-essp-tech-bounces@ucar.edu">go-essp-tech-bounces@ucar.edu</a> [<a style="COLOR: blue; TEXT-DECORATION: underline" href="mailto:go-essp-tech-bounces@ucar.edu">mailto:go-essp-tech-bounces@ucar.edu</a>]<span class="Apple-converted-space"> </span><b><span style="FONT-WEIGHT: bold">On Behalf Of<span class="Apple-converted-space"> </span></span></b><a style="COLOR: blue; TEXT-DECORATION: underline" href="mailto:stephen.pascoe@stfc.ac.uk">stephen.pascoe@stfc.ac.uk</a><br><b><span style="FONT-WEIGHT: bold">Sent:</span></b><span class="Apple-converted-space"> </span>19 November 2009 11:49<br><b><span style="FONT-WEIGHT: bold">To:</span></b><span class="Apple-converted-space"> </span><a style="COLOR: blue; TEXT-DECORATION: underline" href="mailto:drach@llnl.gov">drach@llnl.gov</a><br><b><span style="FONT-WEIGHT: bold">Cc:</span></b><span class="Apple-converted-space"> </span><a style="COLOR: blue; TEXT-DECORATION: underline" href="mailto:go-essp-tech@ucar.edu">go-essp-tech@ucar.edu</a><br><b><span style="FONT-WEIGHT: bold">Subject:</span></b><span class="Apple-converted-space"> </span>[Go-essp-tech] DRS hierarchy on disk</span></font><span lang="EN-US"><o:p></o:p></span></div></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">At the telco this Tuesday I was slightly surprised when someone (I think Bob) asserted data is not likely to follow the DRS hierarchy on disk. Although we know the disk layout can be mapped to DRS URLs in the web server I thought our default position was that we would lay out the data in the DRS hierarchy because it is the simplest solution.</span></font><o:p></o:p></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">This issue came up in a meeting with UKMO yesterday where they thought there was a strong reason for using the DRS on disk so that fallback positions like ftp follow a consistent structure. I also learnt that CMOR2 will output to the DRS hierarchy automatically.</span></font><o:p></o:p></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Given this, why wouldn't we want to insist all datasets are stored on disk in the DRS hierarchy?</span></font><o:p></o:p></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Thanks,</span></font><o:p></o:p></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Stephen.</span></font><o:p></o:p></div></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">---</span></font><o:p></o:p></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Stephen Pascoe +44 (0)1235 445980</span></font><o:p></o:p></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">British Atmospheric Data Centre</span></font><o:p></o:p></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Arial" size="2"><span style="FONT-SIZE: 10pt; FONT-FAMILY: Arial">Rutherford Appleton Laboratory</span></font><o:p></o:p></div> <div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div></div> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div><p style="FONT-SIZE: 12pt; MARGIN-LEFT: 0cm; MARGIN-RIGHT: 0cm; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt">--<span class="Apple-converted-space"> </span><br>Scanned by iCritical.<o:p></o:p></span></font></p> <div style="FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: 'Times New Roman'"><font face="Times New Roman" size="3"><span style="FONT-SIZE: 12pt"><o:p></o:p></span></font></div></div><br><p style="FONT-SIZE: 12pt; MARGIN-LEFT: 0cm; MARGIN-RIGHT: 0cm; FONT-FAMILY: 'Times New Roman'">--<span class="Apple-converted-space"> </span><br>Scanned by iCritical.</p><br>_______________________________________________<br>GO-ESSP-TECH mailing list<br><a style="COLOR: blue; TEXT-DECORATION: underline" href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>http://**mailman.ucar.edu/mailman/listinfo/go-essp-tech<br></o:smarttagtype></o:smarttagtype></div></span></blockquote></div><br></div></blockquote></div><br><p>-- <br>Scanned by iCritical. </p><br>_______________________________________________<br>GO-ESSP-TECH mailing list<br><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br>http://*mailman.ucar.edu/mailman/listinfo/go-essp-tech<br></blockquote></div><br></div></div>_______________________________________________<br>GO-ESSP-TECH mailing list<br><a href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a><br><a href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a><br></blockquote></div><br></div></blockquote> <br><p>-- <br>Scanned by iCritical. </p> <br></div> </blockquote></div><br></div></body></html>