使用 docker 代理在 k8s 和管道上的 Jenkins

Question

I want to run my Jenkins behind k8s. We can achieve that with any standard helm chart or our own manifest files. In this case, Jenkins (master only) will run inside a container (Pod).

Now I also want to have a pipeline job that uses docker agent as described here

I am getting confused, about

• how and where this docker container will be run (on the same node where Jenkins is running? and suppose the node capacity is over then it needs to run docker agent on a different node)
• how does Jenkins will authenticate to run containers on k8s nodes?
• I saw the Kubernetes plugin/docker plugin. But those plugins create containers beforehand ( or at least we need to set up a template, which decides how containers will start, which image will be used and many more ) and connects Jenkins with help of JNLP / ssh. I lose the flexibility to have an image as an agent in that case.
• going further, I also like to build custom images on the fly with help of Dockerfile shipped along with code. An example is available in the same link .

Answer 1

I believe this documentation is answering all of your questions: https://devopscube.com/jenkins-build-agents-kubernetes/

With this method, you are not loosing your flexibility because your Jenkins master going to create K8s pod on the fly. Yes, additionally you need JNLP authentication but you can think that as sidecar container.

About your first question: If you use exactly that way, your Jenkins jobs going to run under Jenkins master with the same Docker that your Jenkins Master is using.