簡體   English   中英

ElasticSearch:館長並發快照

[英]ElasticSearch: Curator concurrent snapshots

我們收到此消息:

[2017-08-11T04:00:02,908] [WARN] [r.suppressed]路徑:/ _ snapshot / s3_currently / curator-20170811040002,參數:{repository = s3_currently,wait_for_completion = true,snapshot = curator-20170811040002} org.elasticsearch .snapshots.ConcurrentSnapshotExecutionException:[s3_currently:curator-20170811040002]快照已在運行

我們使用兩種動作配置了x-pack策展人:

/home/curator/actions/currently.yml
---
actions:
  1:
    action: snapshot
    description: Create snapshot every 30 minutes.
    options:
      repository: s3_currently
      wait_for_completion: true
    filters:
    - filtertype: alias
      aliases: living
  2:
    action: delete_snapshots
    description: Remove recently snapshots
    options:
      repository: s3_currently
      retry_interval: 120
      retry_count: 3
    filters:
    - filtertype: count
      count: 48

/home/curator/actions/currently-dev.yml

---
actions:
  1:
    action: snapshot
    description: Create snapshot every hour for development.
    options:
      repository: s3_currently_dev
      wait_for_completion: true
    filters:
    - filtertype: alias
      aliases: living
  2:
    action: delete_snapshots
    description: Remove recently snapshots
    options:
      repository: s3_currently_dev
      retry_interval: 120
      retry_count: 3
    filters:
    - filtertype: count
      count: 24

我們添加了兩個cron作業:

0 * * * * -> currently_dev
0,30 * * * * -> currently

有任何想法嗎? 似乎elasticsearch不允許執行兩個並發快照,對嗎?

Elasticsearch不允許一次運行多個快照。 這樣做的原因是,它必須在快照持續時間內凍結所選索引的Lucene段。 對於群集的多個並發快照執行此操作將非常麻煩,而不是在處理方面,而是在其始終必須跟蹤所有段的方面。 它必須允許將新數據索引到新段中,同時將其他數據鎖定/凍結以進行快照。 這可能會導致開放段過多的情況,從而可能剝奪一個或多個節點所需的內存資源。 因此,Elasticsearch一次只允許單個快照更為安全。

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM