[Go-essp-tech] esgpublisher_gui memory consuming
Drach, Bob
drach1 at llnl.gov
Wed Nov 16 17:17:26 MST 2011
Hi Sergey,
I don't have information on memory requirements for esgpublish_gui, but have
some general comments:
- the currently released GUI is somewhat dated. Mike Ganzberger has a newer
version he has improved significantly. I can send you a copy if you wish to
try it.
- ... Or you could try running the publication scripts (esgpublish,
esgscan_directory) directly. This might be more efficient for a large
publication job. See
http://esg-pcmdi.llnl.gov/internal/esg-data-node-documentation/CMIP5_publica
tion_tutorial.ppt/view
for the gory details.
Best regards,
--Bob
On 11/16/11 9:58 AM, "Serguei Nikonov" <Serguei.Nikonov at noaa.gov> wrote:
> Hi Bob,
>
> I noticed that esgpublisher_gui takes a lot of memory. This is growing
> practically linear with size of dataset it processes. Just yesterday I have
> experienced huge memory swapping when published Omon dataset of control
> experiment. It had about 6000 files and publisher took about 4 GB memory, plus
> tomcat allocated 3 GB. As a result publishing was running more then 24 hours
> and
> eventually was killed by OS as consumed too much resources. Having this
> trouble
> we decided to change server machine for more powerful and the question is what
> are the requirements for memory and CPU?
>
>
> Thanks,
> Sergey
>
>
>
More information about the GO-ESSP-TECH
mailing list