I know that state stores are cleared on user exceptions and gets restored from the changelog topic when EOS is enabled. Does this also apply on other ...
I'm finding that using the merge operator for a large number of keys with rocksdb is very slow. My program uses a simple associative merge operator ( ...
I was checking this Confluent article and decided to change RocksDB’s default memory allocator. Yum can't find the formula jemalloc, though. Is there ...
I'm trying to learn how rocksdb works under the hood. I understand that each SST file has a bloom filter, to indicate whether a key belongs to the fil ...
In an earlier blog written by members of CockroachDB: https://www.cockroachlabs.com/blog/sql-in-cockroachdb-mapping-table-data-to-key-value-storage/, ...
By default, RocksDB sets target_file_size_base to 64 MB and target_file_size_multiplier to 1. The comments in the code mention that: Target file s ...
A sample rocksdb consumes ~75M of disk space out of this the WAL files (*.log) takes ~71M disk space. But the ls command shows the WAL file has actual ...
I am building rocksdb seem rocksdb's makefile will detect my system's compression library(snappy, libz), if installed rocksdb will link to it. I am ...
For a particular use case we are using spark structured streaming, but the process is not efficient and stable. Aggregation stateful operation is the ...
I am currently exploring on enabling async checkpointing in Spark Structured streaming , but not able to find any way for the same. DataBricks is offe ...
We've been using RocksDb for years. There's a (.NET) process using RocksDbSharp to generate RocskDb data. There's a C++ library that reads them. Both ...
Question about State Stores and Rebalancing Let say : We have 2 input topics and we are aggregating records and pushing into a table. We have of ...
I want to save a struct as a value in RocksDB and to do that, I want to codificate the Struct as a sequence of characters. I know that is possible to ...
I would like to show some experimental results about Rocksdb Put performance. The fact that single-threaded put throughput is slower than two-threaded ...
I am trying to leftJoin events from 2 streams. Initially, I joined 2 KStreams and everything was working fine. However, when I try to convert the seco ...
Is it possible to use RocksDB efficiently for range queries on numbers? For example if I have billions of tuples (price, product_id) can I use RocksD ...
I'm learning LevelDB and RocksDB and are confused by how they keep WAL data integrity without truncate. What I found: Log files are always seeked ...
Rocks Db: Hi, I am working on rocks db use case. Below are some questions i am trying to understand , any help would be appreciated: How does prim ...
I'm trying to configure the rocksdb I'm using as a backend for my flink job. The state rocksdb needs to hold is not too big (around 5G) but it needs t ...
The documentation is not clear about how to use the merge operation while using rocksdb-jni, and I am not familiar with C++ API, how could I define an ...