[Go-essp-tech] esgpublisher_gui memory consuming

[Drach, Bob]

Hi Sergey,

I don't have information on memory requirements for esgpublish_gui, but have
some general comments:

- the currently released GUI is somewhat dated. Mike Ganzberger has a newer
version he has improved significantly. I can send you a copy if you wish to
try it.

- ... Or you could try running the publication scripts (esgpublish,
esgscan_directory) directly. This might be more efficient for a large
publication job. See

http://esg-pcmdi.llnl.gov/internal/esg-data-node-documentation/CMIP5_publica
tion_tutorial.ppt/view

 for the gory details.

Best regards,

--Bob


On 11/16/11 9:58 AM, "Serguei Nikonov" <Serguei.Nikonov at noaa.gov> wrote:

> Hi Bob,
> 
> I noticed that esgpublisher_gui takes a lot of memory. This is growing
> practically linear with size of dataset it processes. Just yesterday I have
> experienced huge memory swapping when published Omon dataset of control
> experiment. It had about 6000 files and publisher took about 4 GB memory, plus
> tomcat allocated 3 GB. As a result publishing was running more then 24 hours
> and 
> eventually was killed by OS as consumed too much resources. Having this
> trouble 
> we decided to change server machine for more powerful and the question is what
> are the requirements for memory and CPU?
> 
> 
> Thanks,
> Sergey
> 
> 
>