用数据填充数据库的最有效方法？

Question

Hi I need to run some performance tests of my spring boot batch jobs. I am looking for the most effective way to set the data into the mongo database. The data is encrypted in the service, so I cant directly load the data via mongo. I want to load up 1million plus records. Should I be looking to use a load testing tool such as K6, or would it make more sense to set up a threadpool executor and write some java to get the data in??

Answer 1

If you want to measure the time required to insert 1M of records into the database you can consider the following options:

1. If it is possible to use Java code consider wrapping it into a microbenchmark test harness like JMH , this way you will get some performance metrics which are not provided by future tasks per se.

2. Assuming you're considering using k6 and it doesn't support anything but HTTP it seems your application exposes a HTTP interface, and assuming the system under test is a Spring Boot application it makes more sense to go for a Java-based load testing tool, this way you will be able to use the same infrastructure for the load tests as for the system under test. Moreover k6 can be executed only on one machine and I believe distributed clustered mode is a must have for a good load testing tool just in case if you will need to scale your load test. The most advanced free and open source load testing tools which are Java/JVM based are:

   • The Grinder
   • Apache JMeter
   • Gatling

Check out Open Source Load Testing Tools: Which One Should You Use? article to learn more about main features of the above solutions.