[Go-essp-tech] checksum calculation on the dataset

Alex Sim asim at lbl.gov
Tue Feb 8 14:23:30 MST 2011


I'd like to bring up one additional item on checksum value calculation.

On this Luca's URL: http://oodt.jpl.nasa.gov/wiki/display/CLIMATE/Data+and+Metadata+Requirements+for+CMIP5+Observational+Datasets,

it describes that observational datasets should be converted to CF convention.

Can checksum values be calculated at the time of conversion, and stored in the publishing catalog along with other meta information?

Same for other simulation datasets. It needs to be calculated at the first publishing time, and stored in the catalog for comparison during the replication time.  Checksum calculation for the source datasets at the transfer time will cause CPU time and delay the transfers as well as possible duplicate calculations.  


best regards,

--
-- Alex



More information about the GO-ESSP-TECH mailing list