<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Karl,<br>
<br>
I think some institutions allow different publishers (probably
modelers) to publish data. I assume this happens in small batches so
I guess you might see a small number of datasets missing from time
to time.<br>
Sadly this will hide true problems, so I guess it's just better to
report them.<br>
<br>
What about synchronizing daily updates to UTC midnight? Would that
help/make sense? It's not possible with the current Gateway
though...<br>
<br>
Thanks,<br>
Estani<br>
Am 01.08.2011 18:24, schrieb Karl Taylor:
<blockquote cite="mid:4E36D350.3090506@llnl.gov" type="cite">
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
<font face="Times New Roman">Hi Estani,<br>
<br>
I understand that discrepancies can arise because things are
only synced once a day. I was a little surprised that you were
missing only 8 datasets, as I assumed that folks would usually
publish in larger chunks.<br>
<br>
Anyway, thanks for looking into it, and I agree that once a day
is fine.<br>
<br>
Best regards,<br>
Karl<br>
</font><br>
On 7/29/11 7:49 AM, Estanislao Gonzalez wrote:
<blockquote
cite="mid:ab7da87708179a254901e41338c28668@mailbox.dkrz.de"
type="cite">
<pre wrap="">Hi Karl,
I'm checking this, but there will always be discrepancies as the
harvesting gets triggered once every while and not immediately after
changes are performed.
Harvesting is not a cheap operation as AFAIK everything is sent and
then compared to what was already present. This will grow considerably
(harvesting PCMDI already takes more than a minute).
After re-triggering the harvesting operations we have exactly the same
values as PCMDI and BADC (which are at this time 8193).
The harvesting operations are triggered once per day in our case. I
don't think there's a real benefit for increasing this frequency, but we
could do it if it's required.
Thanks,
Estani
On Wed, 27 Jul 2011 15:53:53 -0700, Karl Taylor wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Dear all,
Currently (as of a few minutes ago) the ESG sites are showing the
following number of CMIP5 datasets:
PCMDI 8040
BADC 8040
NCAR 8040
NCI 8041
DKRZ 8032
ORNL 8031
NERSC 7525
JPL 7524
I think we know about the NCI single extra dataset, which they're
presumably working on removing. Also we know NERSC and JPL are not
seeing data at the NCI gateway (CSIRO model). Can anyone explain
1) the missing 8 datasets at DKRZ and the 9 missing datasets at
ORNL?
2) the difference of 1 between NERSC and JPL?
Best regards,
Karl
</pre>
</blockquote>
</blockquote>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
GO-ESSP-TECH mailing list
<a class="moz-txt-link-abbreviated" href="mailto:GO-ESSP-TECH@ucar.edu">GO-ESSP-TECH@ucar.edu</a>
<a class="moz-txt-link-freetext" href="http://mailman.ucar.edu/mailman/listinfo/go-essp-tech">http://mailman.ucar.edu/mailman/listinfo/go-essp-tech</a>
</pre>
</blockquote>
<br>
<br>
<pre class="moz-signature" cols="72">--
Estanislao Gonzalez
Max-Planck-Institut für Meteorologie (MPI-M)
Deutsches Klimarechenzentrum (DKRZ) - German Climate Computing Centre
Room 108 - Bundesstrasse 45a, D-20146 Hamburg, Germany
Phone: +49 (40) 46 00 94-126
E-Mail: <a class="moz-txt-link-abbreviated" href="mailto:gonzalez@dkrz.de">gonzalez@dkrz.de</a> </pre>
</body>
</html>