Skip to content

HOW TO allocate more memory to topologies

Why do that

If you encounter out of memory errors, it is likely you do not allocate enough memory to your topologies. In particular archiving topologies can require one or several Gb or ram in order to efficiently create compressed archive batches.

What to do

First of all, retrieve the latest topology configuration file. Do not forget to synchronize your platform configuration

$ git pull

Then, locate the following lines in your topology file:

"storm_settings" : {
    "topology.worker.childopts" : "-server -Xms128m -Xmx128m",

Update the topology.worker.childopts configuration, by adding some memory.

!!! warning "Check the memory available on storm cluster before increasing allocated memory."

Finally, restart the channel (or reload for processing channels) :

channelctl stop <channel_name>
channelctl start <channel_name>