為什么 Elasticsearch 集群只發現 1 個節點？

Question

我在 Kubernete 中部署了 Elasticsearch 7.10.1 集群。 k8s 規范的配置如下所示。

我配置了replicas: 3有 3 個 pod 作為 3 個節點來組成 Elasticsearch 集群。 我可以看到所有三個節點都在運行。

$ kubectl get pods
NAME                      READY   STATUS    RESTARTS   AGE
es-0                      1/1     Running   0          2m58s
es-1                      1/1     Running   0          5m43s
es-2                      1/1     Running   0          8m23s

但是 Elasticsearch 只能識別一個節點。 以下是來自_cluster/health的響應：

{
  "cluster_name" : "elk-cluster",
  "status" : "green",
  "timed_out" : false,
  "number_of_nodes" : 1,
  "number_of_data_nodes" : 1,
  "active_primary_shards" : 0,
  "active_shards" : 0,
  "relocating_shards" : 0,
  "initializing_shards" : 0,
  "unassigned_shards" : 0,
  "delayed_unassigned_shards" : 0,
  "number_of_pending_tasks" : 0,
  "number_of_in_flight_fetch" : 0,
  "task_max_waiting_in_queue_millis" : 0,
  "active_shards_percent_as_number" : 100.0
}

當我運行_cat/nodes ，它只顯示 1 個節點。 但它每次顯示不同的節點名稱。 所以輸出在以下之間切換：

10.0.2.185 38 32 3 0.05 0.48 0.38 cdhilmrstw * es-2

or

10.0.2.220 33 31 2 0.27 0.60 0.31 cdhilmrstw * es-0

or

10.0.1.240 14 96 1 0.04 0.68 0.49 cdhilmrstw * es-1

似乎集群一次只找到一個節點，並且不斷在不同節點之間切換。

如何在 Elasticsearch 上形成 3 個節點？

k8s規格：

apiVersion: v1
kind: ConfigMap
metadata:
  name: es-config
data:
  elasticsearch.yml: |
    cluster.name: elk-cluster
    network.host: "0.0.0.0"
    bootstrap.memory_lock: false
    discovery.zen.ping.unicast.hosts: elasticsearch-cluster
    discovery.zen.minimum_master_nodes: 2
    node.max_local_storage_nodes: 9
  ES_JAVA_OPTS: -Xms2g -Xmx4g
---
apiVersion: apps/v1
kind: StatefulSet
metadata:
  name: es
  namespace: default
spec:
  serviceName: es-entrypoint
  replicas: 3
  selector:
    matchLabels:
      name: es
  template:
    metadata:
      labels:
        name: es
    spec:
      volumes:
        - name: es-config
          configMap:
            name: es-config
            items:
              - key: elasticsearch.yml
                path: elasticsearch.yml
        - name: persistent-storage
          persistentVolumeClaim:
            claimName: es-claim
      initContainers:
        - name: permissions-fix
          image: busybox
          volumeMounts:
            - name: persistent-storage
              mountPath: /usr/share/elasticsearch/data
          command: [ 'chown' ]
          args: [ '1000:1000', '/usr/share/elasticsearch/data' ]
      containers:
        - name: es
          image: elasticsearch:7.10.1
          resources:
            requests:
              cpu: 2
              memory: 8
          ports:
            - name: http
              containerPort: 9200
            - containerPort: 9300
              name: inter-node
          volumeMounts:
            - name: es-config
              mountPath: /usr/share/elasticsearch/config/elasticsearch.yml
              subPath: elasticsearch.yml
            - name: persistent-storage
              mountPath: /usr/share/elasticsearch/data
---
apiVersion: v1
kind: Service
metadata:
  name: es-entrypoint
spec:
  selector:
    name: es
  ports:
    - port: 9200
      targetPort: 9200
      protocol: TCP
  clusterIP: None

Answer 1

這些是 Elasticsearch 6.x 版的發現設置：

 discovery.zen.ping.unicast.hosts: elasticsearch-cluster
 discovery.zen.minimum_master_nodes: 2

在 7.x 中已棄用。 您需要更新您的發現設置：

discovery.seed_hosts:
  - es-entrypoint.default.svc # headless service dns
cluster.initial_master_nodes:
  - es-0
  - es-1
  - es-2