有没有一种方法可以用Python脚本通过Apache日志请求对网站进行压力测试？

Question

Have been fiddling with a Python script that would take POST, GET requests from apache log and stress test a website upon the requests found from apache log for quite some time by now.

Pretty much I could get the requests from the log file and parse them and convert them to CSV file with some help from here - https://lincolnloop.com/blog/load-testing-jmeter-part-3-replaying-apache-logs/

But now I am stuck - I haven't quite found a good stress tester that would take such requests in and stress test upon them. Jmeter doesn't cut it because still the GUI would needed to be used and that's no good as the purpose is to have simple and portable Python script. Of course any modules would be OK.

If anybody has any good ideas or a bit of code to share then would be immensely grateful!

Thanks and have a beautiful day! :)

Johannes

Answer 1

Is Python a must for your use case? If not, you could try Apache JMeter free and open-source Java-based load and performance testing solution.

It provides Access Log Sampler which seems to be exactly what you're looking for. See How to use Access Log Sampler to Generate Traffic with JMeter for detailed walkthrough.

Alternative option is using Grinder and Apache Log Playback script . In this case you'll be able to integrate it with your existing Python code but Java will still be required.

Answer 2

The Locust python framework allows load and stress testing.

An example from their website:

from locust import HttpLocust, TaskSet, task

class WebsiteTasks(TaskSet):
    def on_start(self):
        self.client.post("/login", {
            "username": "test_user",
            "password": ""
        })

    @task
    def index(self):
        self.client.get("/")

    @task
    def about(self):
        self.client.get("/about/")

class WebsiteUser(HttpLocust):
    task_set = WebsiteTasks
    min_wait = 5000
    max_wait = 15000

Read more here: http://locust.io/