构建简单的http代理的方式

Question

我正在尝试构建一个简单的http代理 ，它执行四个非常基本的事情：

接受来自Web浏览器的连接（使用TcpClient / TcpListener）。
从其流中读取请求。
读取主机名并启动与主机的连接。
从网页加载内容并将其转发回客户端。

我遇到的麻烦：

有时页面根本不会加载。
有时浏览器给我一个错误'内容有错误的加密'（在Firefox中）。
我很少能看到内容损坏（纯文本而不是HTML）。

我做了什么：

HttpListener类，包含侦听传入请求和调用事件OnNewRequestReceived的方法：

        public void Listen()
        {
            Listener.Start();

            while (true)
            {
                var client = Listener.AcceptTcpClient();

                Task.Run(() => StartReceivingData(client));      
            }

        }

        public void StartReceivingData(TcpClient client)
        {
            NetworkStream clientStream = client.GetStream();

            var buffer = new byte[16000];

            while (true)
            {
                try
                {
                    if (!clientStream.CanRead)
                        return;

                    //connection is closed
                    if (clientStream.Read(buffer).Equals(0))
                        return;

                    OnNewRequestReceived?.Invoke(this, new RequestReceivedEventArgs() { User = client, Request = buffer });
                } // when clientStream is disposed, exception is thrown.
                catch { return; }
            }
        }

HttpClient类基本上包含一个订阅上述事件的方法：

 private void Listener_OnNewConnectionReceived(object sender, RequestReceivedEventArgs e)
        {
            string hostname = HttpQueryParser.GetHostName(e.Request);
            NetworkStream proxyClientStream = e.User.GetStream();

            try
            {
                if (firewall.CheckIfBlocked(hostname))
                {
                    //send error page
                    e.User.GetStream().Write(Encoding.ASCII.GetBytes("<html><body style=\"padding:0; margin:0;\"><img style=\"padding:0; margin:0; width:100%; height:100%;\" src=\"https://www.hostinger.co.id/tutorial/wp-content/uploads/sites/11/2017/08/what-is-403-forbidden-error-and-how-to-fix-it.jpg\"</body></html>"));
                    return;
                }

                var targetServer = new TcpClient(hostname, 80);

                NetworkStream targetServerStream = targetServer.GetStream();

                targetServerStream.Write(e.Request);

                var responseBuffer = new byte[32];

                for (int offsetCounter = 0; true; ++offsetCounter)
                {
                    var bytesRead = targetServerStream.Read(responseBuffer, 0, responseBuffer.Length);

                  //  Console.WriteLine($"Read {bytesRead} from {hostname}.");

                    if (bytesRead.Equals(0))
                        return;


                    proxyClientStream.Write(responseBuffer, 0, responseBuffer.Length);

                    if (offsetCounter.Equals(0))
                    {
                        var headers = Encoding.UTF8.GetString(responseBuffer).Split("\r\n");

                        logger.Log(new HttpRequestEntry()
                        {
                            ResponseCode = headers[0].Substring(headers[0].IndexOf(" ") + 1),
                            Hostname = hostname
                        });
                    }
                }

            }
            catch { return; }
            finally { proxyClientStream.Dispose(); }


        }

所以，我猜我的缓冲区大小有问题，但将其更改为更高的值实际上并没有改变任何东西。

Answer 1

好的，所以我不知道我的字节数组是什么问题，但是我使用Stream.CopyTo使它工作，我很惊讶 - 它适用于两个NetworkStreams。 如果你好奇，这是工作方法：

 private void Listener_OnNewConnectionReceived(object sender, RequestReceivedEventArgs e)
 {
            string hostname = HttpQueryParser.GetHostName(e.Request);
            NetworkStream proxyClientStream = e.User.GetStream();

            try
            {
                if (firewall.CheckIfBlocked(hostname))
                {
                    //send error page
                    e.User.GetStream().Write(Encoding.ASCII.GetBytes("<html><body style=\"padding:0; margin:0;\"><img style=\"padding:0; margin:0; width:100%; height:100%;\" src=\"https://www.hostinger.co.id/tutorial/wp-content/uploads/sites/11/2017/08/what-is-403-forbidden-error-and-how-to-fix-it.jpg\"</body></html>"));
                    return;
                }

                var targetServer = new TcpClient(hostname, 80);

                NetworkStream targetServerStream = targetServer.GetStream();

                targetServerStream.Write(e.Request);

                var responseBuffer = new byte[32];

                //this is to capture status of http request and log it.

                targetServerStream.Read(responseBuffer, 0, responseBuffer.Length);

                proxyClientStream.Write(responseBuffer, 0, responseBuffer.Length);

                var headers = Encoding.UTF8.GetString(responseBuffer).Split("\r\n");

                logger.Log(new HttpRequestEntry()
                {
                    ResponseCode = headers[0].Substring(headers[0].IndexOf(" ") + 1),
                    Hostname = hostname
                });

                targetServerStream.CopyTo(proxyClientStream);

            }
            catch { return; }
            finally { proxyClientStream.Dispose(); }


}

构建简单的http代理的方式

问题描述

1 个解决方案

解决方案1
0 2019-03-28 20:44:36

构建简单的http代理的方式

问题描述

1 个解决方案

解决方案1 0 2019-03-28 20:44:36

解决方案1
0 2019-03-28 20:44:36