[Go-essp-tech] Data file gaps

Jennifer Adams jma at cola.iges.org
Tue Mar 27 15:39:02 MDT 2012 

On Mar 27, 2012, at 4:27 PM, Serguei Nikonov wrote:

> Hi Jennifer,
> 
> I wonder why dataset cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1 is in this list. We have not published it yet.
Well, it must have been published at one time, because I have some files that were grabbed on or before January 28. The version number is "v1". Here are the files I have:
-rw-r--r-- 1 root root 94718020 Jan  6 20:04 pr_day_GFDL-CM3_piControl_r1i1p1_00010101-00051231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:07 pr_day_GFDL-CM3_piControl_r1i1p1_00060101-00101231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 19:54 pr_day_GFDL-CM3_piControl_r1i1p1_00210101-00251231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:10 pr_day_GFDL-CM3_piControl_r1i1p1_00260101-00301231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 19:50 pr_day_GFDL-CM3_piControl_r1i1p1_00310101-00351231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 19:59 pr_day_GFDL-CM3_piControl_r1i1p1_00360101-00401231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 19:55 pr_day_GFDL-CM3_piControl_r1i1p1_00460101-00501231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:13 pr_day_GFDL-CM3_piControl_r1i1p1_00510101-00551231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:08 pr_day_GFDL-CM3_piControl_r1i1p1_00560101-00601231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 19:58 pr_day_GFDL-CM3_piControl_r1i1p1_00610101-00651231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:04 pr_day_GFDL-CM3_piControl_r1i1p1_00660101-00701231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:12 pr_day_GFDL-CM3_piControl_r1i1p1_00710101-00751231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 20:09 pr_day_GFDL-CM3_piControl_r1i1p1_00960101-01001231.nc
-rw-r--r-- 1 root root 94718020 Jan  6 19:55 pr_day_GFDL-CM3_piControl_r1i1p1_04910101-04951231.nc

> Regarding cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1 now it contains all files covering time range 1-500 yrs.
Great! Thank you very much for following up on this. 
--Jennifer

> 
> regards,
> Sergey 
> 
> On 03/20/2012 02:50 PM, Jennifer Adams wrote:
>> 
>> Dear All,
>> I have a GrADS script that creates descriptor files for CMIP5 data, and it has uncovered some gaps in the date strings of files that belong to an atomic data set. I have checked the ESGF gateways for all the datasets listed below and I can confirm that these files are missing for some variables. I haven't given the variable names, because I have only checked the subset of variables that are of interest to me and that may not be a complete list. If the specific var names that I checked would be useful, I can provide them. While checking on these gaps, I noticed that not all variables in an atomic dataset span the same time range … an inconsistency that doesn't quite make sense to me. I also noticed that in some cases, data files that I had grabbed are no longer listed on the gateway, even though the version number is the same. An example is cmip5.output1.NCC.NorESM1-M.piControl.day.land.day.r1i1p1.v20110901, mrsos, date range 11000101-12001231. What does that mean? 
>> 
>> The gaps put these data into the "not quite usable" category. I wasn't sure whether to send this to the helpdesk or the forum or both; in the end I am just posting here.
>> --Jennifer
>> 
>>  11880 times missing in cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.atmos.Amon.r1i1p1 between 141912 and 241001
>>  11880 times missing in cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.land.Lmon.r1i1p1  between 141912 and 241001
>>   4200 times missing in cmip5.output1.NASA-GISS.GISS-E2-R.piControl.mon.land.Lmon.r1i1p1  between 363012 and 398101 
>>  11880 times missing in cmip5.output1.NASA-GISS.GISS-E2-H.piControl.mon.ocean.Omon.r1i1p1 between 141912 and 241001
>>   4200 times missing in cmip5.output1.NASA-GISS.GISS-E2-R.piControl.mon.ocean.Omon.r1i1p1 between 363012 and 398101 
>>      1 times missing in cmip5.output1.MOHC.HadGEM2-CC.historical.mon.ocean.Omon.r3i1p1    between 200110 and 200112
>>     60 times missing in cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1 between 017012 and 017601
>>     60 times missing in cmip5.output1.NOAA-GFDL.GFDL-ESM2M.piControl.mon.land.Lmon.r1i1p1 between 003012 and 003601
>>   3650 times missing in cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1   between 00101231 and 00210101
>>   1825 times missing in cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1   between 00401231 and 00460101
>>   7300 times missing in cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1   between 00751231 and 00960101
>> 142350 times missing in cmip5.output1.NOAA-GFDL.GFDL-CM3.piControl.day.atmos.day.r1i1p1   between 01001231 and 04910101
>>  73000 times missing in cmip5.output1.NCC.NorESM1-M.piControl.day.land.day.r1i1p1         between 08991231 and 11000101
>>  29220 times missing in cmip5.output1.MPI-M.MPI-ESM-LR.rcp85.day.atmos.day.r1i1p1         between 22001231 and 22810101 
>> 
>> --
>> Jennifer M. Adams
>> IGES/COLA
>> 4041 Powder Mill Road, Suite 302
>> Calverton, MD 20705
>> jma at cola.iges.org
>> 
>> 
>> 
>> 
>> 
>> 
>> _______________________________________________
>> GO-ESSP-TECH mailing list
>> GO-ESSP-TECH at ucar.edu
>> http://mailman.ucar.edu/mailman/listinfo/go-essp-tech
> 

--
Jennifer M. Adams
IGES/COLA
4041 Powder Mill Road, Suite 302
Calverton, MD 20705
jma at cola.iges.org



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ucar.edu/pipermail/go-essp-tech/attachments/20120327/0924f7a4/attachment-0001.html

More information about the GO-ESSP-TECH mailing list