[英]Kubernetes NGINX Ingress TLS issue
我在云(VMVare vSphere)中部署了k8s集群-3个主节点和1个工作节点。 然后在安装了舵手nginx-ingress的情况下:
helm install stable/nginx-ingress
部署了一些简单的http-svc容器
将nginx-controller服务类型从LoadBalancer更改为NodePort并添加了externalIP (我的主节点的IP地址),所以看起来像:
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
ing-nginx-ingress-controller NodePort 10.233.15.202 172.16.40.21,172.16.40.22,172.16.40.23 80:31045/TCP,443:31427/TCP 1d
http-svc ClusterIP 10.233.13.55 80/TCP 1d
创建的证书和机密
openssl req -x509 -nodes -days 365 -newkey rsa:2048 -keyout /tmp/tls.key -out /tmp/tls.crt -subj "/CN=<FQDN_HERE>"
kubectl create secret tls secret --key /tmp/tls.key --cert /tmp/tls.crt
并创建入口:
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
name: some-ingress
namespace: default
spec:
tls:
- hosts:
- <FQDN_HERE>
secretName: secret
rules:
- host: <FQDN_HERE>
http:
paths:
- backend:
serviceName: http-svc
servicePort: 80
path: /
如果我使用云DNAT
external_ip:8443 -> master01_ip:443 (e.g. 172.16.40.21:443)
然后我有一个回应:
curl --resolve <FQDN>:8443:<external_ip> https://<FQDN>:8443 -v -k
* Added <FQDN>:8443:<external_ip> to DNS cache
* Rebuilt URL to: https://<FQDN>:8443/
* Hostname <FQDN> was found in DNS cache
* Trying <external_ip>...
* TCP_NODELAY set
* Connected to <FQDN> (<external_ip>) port 8443 (#0)
* ALPN, offering http/1.1
* Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
* TLSv1.2 (OUT), TLS header, Certificate Status (22):
* TLSv1.2 (OUT), TLS handshake, Client hello (1):
* TLSv1.2 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Client hello (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS change cipher, Client hello (1):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384
* ALPN, server accepted to use http/1.1
* Server certificate:
* subject: CN=<FQDN>
* start date: Feb 22 10:37:00 2018 GMT
* expire date: Feb 22 10:37:00 2019 GMT
* issuer: CN=<FQDN>
* SSL certificate verify result: self signed certificate (18), continuing anyway.
> GET / HTTP/1.1
> Host: <FQDN>:8443
> User-Agent: curl/7.58.0
但是,如果我使用负载平衡功能(vEdge Gateway):
-> 172.16.40.21:443
external_ip:443 -> 172.16.40.22:443
-> 172.16.40.23:443
有一个问题:
curl --resolve <FQDN>:443:<external_ip> https://<FQDN> -vvvv -k
* Added <FQDN>:443:<external_ip> to DNS cache
* Rebuilt URL to: https://<FQDN>/
* Hostname <FQDN> was found in DNS cache
* Trying <external_ip>...
* TCP_NODELAY set
* Connected to <FQDN> (<external_ip>) port 443 (#0)
* ALPN, offering http/1.1
* Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH
* TLSv1.2 (OUT), TLS header, Certificate Status (22):
* TLSv1.2 (OUT), TLS handshake, Client hello (1):
* OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to <FQDN>:443
* Closing connection 0
curl: (35) OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to <FQDN>:443
尝试使用nginx和自签名证书对两个独立VM进行了测试-正常工作。 云提供商表示LB是功能性的,并且是k8s入口中的问题。
谢谢!
正如@Nickolay所说,我应该已经在TCP模式下配置了HTTPS模式vEdge网关负载均衡器。 但是vEdge Gateway不允许这样做,因为端口443严格绑定到HTTPS。 我已解决了将运行状况检查(!)配置为TCP而不是SSL的问题,并且现在所有工作都可以进行。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.