I have a problem inserting big list into Cassandra using python. I have a list of 3200 string that I want to save in Cassandra:
CREATE TABLE IF NOT EXISTS my_test (
id bigint PRIMARY KEY,
list_strings list<text>
);
When I'm reducing my list I have no problem. It works.
prepared_statement = session.prepare("INSERT INTO my_test (id, list_strings) VALUES (?, ?)")
session.execute(prepared_statement, [id, strings[:5]])
But if I keep the totality of my list I have an error:
Error from server: code=1500 [Replica(s) failed to execute write] message="Operation failed - received 0 responses and 1 failures" info={'required_responses': 1, 'consistency': 'LOCAL_ONE', 'received_responses': 0, 'failures': 1}
How can I insert big list into Cassandra?
A DB array type is not supossed to hold that ammount of data. Using different rows of the table to store each string would be better:
id | time | strings
-----------+------------+---------
bigint | timestamp | string
partition | clustering |
Using id as the clustering key would be a bad solution as when requesting all the tweets from a user id, it will require to do a read in multiple nodes while when used as a partition key it will only require to read in one node per user.
The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.