存储/重用sql查询结果的最佳方法

Question

I had a request to come up with a way to store and reuse results of SQL queries, and I'm seriously in need of suggestions.
The situation in detail:
They want to use a scheduler to execute long running queries, then store the results in a way that these can later be used to create tables, charts and reports. The reports need to be able to filter the result set further (based on user input) so making the scheduler do the reports is out of the question. The results need to be stored in some sort of a uniform way: we don't know the exact number of long running queries, there might be hundreds of them. I've considered making database tables which describe and store result sets but don't really like the idea of "tables that store tables" (and the thought that it might not turn out strongly typed). I've also thought about serialising those results into files. I don't know how long we want to hold on to these query results, which would be important of course. We're using .net 4.0 and firebird technologies. If I'm not posting this question to the right place, please give me some directions.

Answer 1

We're looking at doing some very similar things. For our implementation we're looking to store the result sets as a

List<T> 

of a some Object, so if it were books, we'd have a book class. The RunQuery function would return in that case

List<Book> RunQuery(MyQuery query);

For the actual storage of the sets, a Memcache server seems to be a good simple choice for our needs. There are a number of memcache clients freely available that are really easy to use. You'll need to make your objects binary serializable but that's pretty easy - check out protobuf for .net

We can use web api endpoints called from Angular or jQuery to "Query" or filter the result sets that are retrieved from the Memcache server. We usually structure our GetData style methods to automatically look to the cache first, and then to hit the database. You could probably do something similar, perhaps work some notification into them mix - ie We'll run the query and ping you when its finished.

Hope this helps

Scott