[Go-essp-tech] DRS hierarchy on disk

Fri Nov 20 09:29:05 MST 2009

I suppose my next question then is - probably to Luca :) -  is the security policy in the Gateway determined by the DRS based URLs?  For the ESG software stack have you looked at how the DRS structure will map to the services exposed by the data node or the underlying file system(s)?

Cheers,
Phil

	-----Original Message-----
	From: Don Middleton [mailto:don at ucar.edu] 
	Sent: 20 November 2009 16:12
	To: Dean N. Williams
	Cc: Don Middleton; Kershaw, Philip (STFC,RAL,SSTD); go-essp-tech at ucar.edu
	Subject: Re: [Go-essp-tech] DRS hierarchy on disk

	We discussed this topic (GridFTP on vfs) a fair bit several years ago. We didn't end up pursuing it, however, and at this point I don't recall all the reasons. 

	don

	On Nov 20, 2009, at 8:43 AM, Dean N. Williams wrote:

		Hi Phil, 

		This is a good question. Perhaps Rachana or Frank can look into this and return a proper answer. My first thought is no, but I am not an expert on GridFTP.

		Best regards,
		Dean

		On Nov 20, 2009, at 2:28 AM, <philip.kershaw at stfc.ac.uk> wrote:

			This is a problem for something like GridFTP where you 'see' the file system on the server not the DRS hierarchy.  It's a headache for applying security policy as presumably this is based on the DRS structure.  Some kind of mapping would need to be maintained.   

			Is there a way of altering the GridFTP server side interface so that it could see a virtual file system structure based on the DRS?

			Cheers,
			Phil

				-----Original Message-----
				From: go-essp-tech-bounces at ucar.edu [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of Dean N. Williams
				Sent: 19 November 2009 12:14
				To: Lawrence, Bryan (STFC,RAL,SSTD)
				Cc: go-essp-tech at ucar.edu
				Subject: Re: [Go-essp-tech] DRS hierarchy on disk

				This is a correct statement. 

				-Dean

				On Nov 19, 2009, at 4:04 AM, <bryan.lawrence at stfc.ac.uk> wrote:

					Hi Stephen

					Bob or someone else can confirm, but  I think the issue is that ESG in general is aiming at supporting more than just the DRS, so while conforming to DRS is a given for CMIP5, it’s not a given for all the datasets that ESG may work with.

					Bryan

________________________________

					From: go-essp-tech-bounces at ucar.edu [mailto:go-essp-tech-bounces at ucar.edu] On Behalf Of stephen.pascoe at stfc.ac.uk
					Sent: 19 November 2009 11:49
					To: drach at llnl.gov
					Cc: go-essp-tech at ucar.edu
					Subject: [Go-essp-tech] DRS hierarchy on disk

					At the telco this Tuesday I was slightly surprised when someone (I think Bob) asserted data is not likely to follow the DRS hierarchy on disk.  Although we know the disk layout can be mapped to DRS URLs in the web server I thought our default position was that we would lay out the data in the DRS hierarchy because it is the simplest solution.

					This issue came up in a meeting with UKMO yesterday where they thought there was a strong reason for using the DRS on disk so that fallback positions like ftp follow a consistent structure.  I also learnt that CMOR2 will output to the DRS hierarchy automatically.

					Given this, why wouldn't we want to insist all datasets are stored on disk in the DRS hierarchy?

					Thanks,
					Stephen.

					---
					Stephen Pascoe  +44 (0)1235 445980
					British Atmospheric Data Centre
					Rutherford Appleton Laboratory

					-- 
					Scanned by iCritical.

					-- 
					Scanned by iCritical.

					_______________________________________________
					GO-ESSP-TECH mailing list
					GO-ESSP-TECH at ucar.edu
					http://**mailman.ucar.edu/mailman/listinfo/go-essp-tech

			-- 
			Scanned by iCritical. 

			_______________________________________________
			GO-ESSP-TECH mailing list
			GO-ESSP-TECH at ucar.edu
			http://*mailman.ucar.edu/mailman/listinfo/go-essp-tech

		_______________________________________________
		GO-ESSP-TECH mailing list
		GO-ESSP-TECH at ucar.edu
		http://mailman.ucar.edu/mailman/listinfo/go-essp-tech

-- 
Scanned by iCritical.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20091120/04f708ee/attachment.html 