How can I write data from a pickle file to sqlite3 database?

Question

I have webscraped data into a pickle file and want to write that data into a sqlite3 database. Can anybody help me out with what needs to be done?

Answer 1

You need to create a column of type BLOB (which is a supported datatype in Sqlite3).

Then, you can just INSERT INTO data (id, content) VALUES (?, ?) with the binary dump of your pickle object.

Here's a walk through on Sqlite3 inserts .

pickle.dumps will convert the object into a byte-string you can store in the database. pickle.loads will turn it back after being SELECT 'd from the database.

You can also consider using dill for more complex objects.