如何在将web.response流保存到文本文件之前对其进行格式化

Question

I am collecting info using web.response method as a web crawler. I collect it to a string and then save it to a text file .Then I search that text file using regular expression. Now the problem is when I search that text file using regular expression I am not able to do it properly because there are many random newlines in the text file.

My question is "Is there a way that the XML (HTML) document I get by web.response method can be formatted properly before saving it to text file , so that there are no random spaces and newlines in the text. I can not even post an unformatted HTML here otherwise I would have done it.

Answer 1

Internet可能会讨厌您这样做，但是如果您有预定义的条件，则可以转换字符串，例如：

var formattedHtml = html.Replace(Environment.NewLine, "");

Answer 2

This could solve your problem. But from performance point of view it is a bad solution .

Perform following actions on the response

1. Extract the content between > and < symbols and perform a Trim white space operation
2. Remove all the remaining new lines if present

Another better solution will be using a better RegEx for searching the string