![](/img/trans.png)
[英]Processing a Warc File using Logstash, ElasticSearch, and Kibana
[英]Loading JSON data into Elasticsearch and Kibana using logstash configuration [ConfigurationError: translation missing]
我正在嘗試使用logstash及其配置將一些JSON數據導入到我的Elasticsearch和Kibana集群中。 我正在使用具有三個字段的JSON文件。
elasticsearch version used: 6.5.3
logstash version used: 6.5.3
使用的Logstash版本:6.5.3
樣本JSON文件:test.json
{"name":"Jonathan","score":"9.9","address":"New Delhi"}
{"name":"Sam","score":"8.9","address":"New York"}
{"name":"Michelle","score":"9.0","address":"California"}
我的配置文件:test.config
input{
file{
path => "/Users/amit/elasticsearch/data/test.json"
codec => json
sincedb_path => "/dev/null"
start_position => "beginning"
}
}
filter{
json{
source => "message"
}
mutate{
convert => {
"name" => "text"
"score" => "float"
"address" => "text"
}
}
}
output{
elasticsearch{
hosts => "localhost:9200"
index => "test"
}
stdout { codec => rubydebug }
}
我正在嘗試使用以下命令使用logstash將此數據導入Elasticsearch:
bin/logstash -f ../../data/test.config
但是我收到以下錯誤消息:
[2018-12-27T20:18:41,439] [錯誤] [logstash.pipeline]錯誤注冊插件{:pipeline_id =>“ main”,:plugin =>“#,@filter = {\\” name \\“ => \\ “ text \\”,\\“ score \\” => \\“ float \\”,\\“ address \\” => \\“ text \\”},id => \\“ 4a292b8b637c63de89c36b730212b3c706307f5fd385080369ac0cbeac3c2d53 \\”,enable_metric => true,period_flush => false >>“,:error =>”缺少翻譯:en.logstash.agent.configuration.invalid_plugin_register“,:thread =>”#“}
[2018-12-27T20:18:41,452] [錯誤] [logstash.pipeline]由於錯誤{:pipeline_id =>“ main”,:exception =># ,: backtrace => [“ / Users / amit / elasticsearch / logstash / logstash-6.5.3 / vendor / bundle / jruby / 2.3.0 / gems / logstash-filter-mutate-3.3.4 / lib / logstash / filters / mutate.rb:219:
block in register'", "org/jruby/RubyHash.java:1343:in
each'”,“block in register'", "org/jruby/RubyHash.java:1343:in
filter-mutate -3.3.4 / lib / logstash / filters / mutate.rb:217:inregister'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:242:in
register_plugin'“,” /Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:253:in register_plugins中的block in register_plugins'", "org/jruby/RubyArray.java:1734:in
每個register_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
elasticsearchregister_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
logstashregister_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
logstash-6.5.3register_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
logstash-coreregister_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
libregister_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
logstashregister_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
pipeline.rb:253block in register_plugins'", "org/jruby/RubyArray.java:1734:in
register_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
register_plugins'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:595:in
maybe_setup_out_plugins中start_workers'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:200:in
pipeline.rb:start_workers'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:200:in
instart_workers'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:200:in
運行中“”,“start_workers'", "/Users/amit/elasticsearch/logstash/logstash-6.5.3/logstash-core/lib/logstash/pipeline.rb:200:in
.rb:160:in`block in start'“],:thread =>”#“}[2018-12-27T20:18:41,474] [錯誤] [logstash.agent]無法執行操作{:id =>:main,:action_type => LogStash :: ConvergeResult :: FailedAction,:message =>“執行動作:PipelineAction :: Create,action_result:false“,:backtrace => nil}
[2018-12-27T20:18:41,705] [INFO] [logstash.agent]成功啟動Logstash API端點{:port => 9600}
另外,如果我從文件test.config中刪除了mutate過濾器,它也可以正常工作。 但是,我想將score變量的類型更改為float。 嘗試在解析過程中更改字段是否存在問題,或者我缺少其他內容? 謝謝 :)
似乎您不能使用“文本”,請使用“名稱” =>“字符串”
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.