I have unloaded more than 100 CSV files in a folder. When I try to load those files to cassandra using DSBULK load and specifying the the folder location of all these files, I get the below error
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "unVocity-parsers input reading thread"
I wanted to see if anyone else has faced it and how it has been resolved.
Here are a few things you can try:
DSBULK_JAVA_OPTS
env var. See this page for more. Set the allocated memory to a higher value if possible.-maxConcurrentQueries
option. Start with -maxConcurrentQueries 1
; then raise the value to get the best throughput possible without hitting the OOM error. More on this here .
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.