[英]How to increase memory on Accumulo Proxy server?
Currently running a big data job that is doing lots of small inserts into an accumulo table, however after running for about an hour will always get an OOM exception当前正在运行一个大数据作业,该作业正在对累积表进行大量小插入,但是在运行大约一个小时后总是会出现 OOM 异常
2018-10-09 12:19:17,345 [rpc.CustomNonBlockingServer$CustomFrameBuffer] WARN : Got an IOException in internalRead!
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:197)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at org.apache.thrift.transport.TNonblockingSocket.read(TNonblockingSocket.java:142)
at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.internalRead(AbstractNonblockingServer.java:539)
at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.read(AbstractNonblockingServer.java:338)
at org.apache.thrift.server.AbstractNonblockingServer$AbstractSelectThread.handleRead(AbstractNonblockingServer.java:203)
at org.apache.thrift.server.TNonblockingServer$SelectAcceptThread.select(TNonblockingServer.java:203)
at org.apache.thrift.server.TNonblockingServer$SelectAcceptThread.run(TNonblockingServer.java:154)
#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
# Executing /bin/sh -c "kill -9 71952"...
Killed
Is there a way to increase the memory when you start off the proxy server either through the command line or the config file?当您通过命令行或配置文件启动代理服务器时,有没有办法增加内存? their documentation is spare and doesnt off much insight.
他们的文档是多余的,并没有太多洞察力。
./bin/accumulo proxy -p proxy/proxy.properties #option to increase memory
The bin/accumulo
command you're executing is a bash
shell script that sources conf/accumulo-env.sh
where you'd normally set some Java command-line options.您正在执行的
bin/accumulo
命令是一个bash
shell 脚本,它提供conf/accumulo-env.sh
,您通常会在其中设置一些 Java 命令行选项。
The provided launch scripts are a bit confusing in versions prior to Accumulo 2.x, but is anticipated to be much simpler and more direct/intuitive in 2.0.0 and later.提供的启动脚本在 Accumulo 2.x 之前的版本中有点混乱,但预计在 2.0.0 及更高版本中会更简单、更直接/直观。 In 1.9.x (and maybe some earlier versions), you can add appropriate Java flags to increase memory to the
ACCUMULO_OTHER_OPTS
environment in the conf/accumulo-env.sh
file.在 1.9.x(可能还有一些早期版本)中,您可以添加适当的 Java 标志以增加
conf/accumulo-env.sh
文件中ACCUMULO_OTHER_OPTS
环境的内存。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.