简体繁体 English

处理大量数据

[英]Working with large amount of Data

原文 2013-10-24 15:03:44 4 1 c#/ asp.net/ session

I am creating web portal in asp.net 4.0 where i have to send http web request to 3rd party server and getting large volume of resultset which is to be a user specific. 我正在asp.net 4.0中创建Web门户，在该门户中我必须将http Web请求发送到第三方服务器，并获得大量的结果集，这将是用户特定的。 My problem is,where do i store these data temporally? 我的问题是，我该在哪里临时存储这些数据？

Is there a better way to store large results set temporarily? 有没有更好的方法来临时存储较大的结果集？

Response which we are getting from http webrequest is specific to different users (request basis) and we must keep the data until user complete shopping or booking so do not know how long we keep the data. 我们从http webrequest得到的响应是针对不同用户的（基于请求），并且我们必须保留数据，直到用户完成购物或预订为止，因此不知道我们将数据保留多长时间。

adding more : 增加更多：

We were thhinking to use session object , but due to large volume of data, we can not use it as it will consume server memory. 我们一直想使用会话对象，但是由于大量数据，我们无法使用它，因为它将消耗服务器内存。

Second option, we can use sql relational database, but website is consuming data from httpweb response so we do not have control the 3rd party service. 第二种选择是，我们可以使用sql关系数据库，但是网站正在使用httpweb响应中的数据，因此我们无法控制第三者服务。

1 个解决方案

Session is typically stored in server memory and thus not a great place to store large amounts of data. Session通常存储在服务器内存中，因此不是存储大量数据的好地方。 I would suggest a SQL table but all things are relative... How large is this data? 我建议使用SQL表，但所有内容都是相对的...该数据有多大？ If you have more than a single web server, session state has likely been moved to SQL so better to go there directly. 如果您有多个Web服务器，则会话状态可能已移至SQL，因此最好直接转到那里。