啟動水槽時出錯

Question

我正在嘗試使用dynatrace作為flume和hadoop的源作為接收器，其中dynatrace和flume在同一服務器上，而hadoop在另一台服務器上。

但是，當啟動水槽時，我得到以下錯誤：

---

錯誤[conf-file-poller-0]（org.apache.flume.conf.file.AbstractFileConfigurationProvider $ FileWatcherRunnable.run：211）-未處理的錯誤java.lang.NoSuchMethodError：org.slf4j.spi.LocationAwareLogger.log（Lorg / slf4j / Marker; Ljava / lang / String; ILjava / lang / String; Ljava / lang / Throwable;）V在org.apache的org.apache.commons.logging.impl.SLF4JLocationAwareLog.debug（SLF4JLocationAwareLog.java:120）處。 org.apache.hadoop.metrics2.MetricsSystem.register（MetricsSystem.java:54）上的hadoop.metrics2.impl.MetricsSystemImpl.register（MetricsSystemImpl.java:220）在org.apache.hadoop.security.UserGroupInformation $ UgiMetrics.create（位於org.apache.hadoop.security的UserGroupInformation.java:106）。位於org.apache.flume.sink.hdfs.HDFSEventSink.authenticate（HDFSEventSink.java:529）的org.apache.flume.sink.hdfs.HDFSEventSink.authenticate（HDFSEventSink.java:529）的UserGroupInformation。（UserGroupInformation.java:208）。在org.apache.flume.conf.Configurables.configure（Configurables.java:41）處的flume.sink.hdfs.HDFSEventSink.configure（HDFSEventSink.java:247）在org.apache.flume.conf.properties.Propert org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.load（PropertiesFileConfigurationProvider.java:223）上的iesFileConfigurationProvider.loadSinks（PropertiesFileConfigurationProvider.java:373）在org.apache.flume.conf.file.AbstractFileConfigurationProvider.doLoad（AbstractFileConfigurationProvider.java： 123），位於org.apache.flume.conf.file.AbstractFileConfigurationProvider $ FileWatcherRunnable.run（AbstractFileConfigurationProvider.java:202），位於org.apache.flume.conf.file.AbstractFileConfigurationProvider.java:38。 util.concurrent.Executors $ RunnableAdapter.call（Executors.java:471）在java.util.concurrent.FutureTask.runAndReset（FutureTask.java:304）在java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.access $ 301（ScheduledThreadPoolExecutor.java ：178）在java.util.concurrent.ScheduledThreadPoolExecutor $ ScheduledFutureTask.run（ScheduledThreadPoolExecutor.java:293）在java.util.concurrent.ThreadPoolExecutor.runWor java.util.concurrent.ThreadPoolExecutor $ Worker.run（ThreadPoolExecutor.java:615）的ker（ThreadPoolExecutor.java:1145）在java.lang.Thread.run（Thread.java:745）

---

這是我的水槽配置文件：

# Name the components on this agent
QKDSK305.sources = HTTPSource
QKDSK305.sinks = PurePathSink UserActionSink VisitSink NullSink
QKDSK305.channels = PurePathChannel UserActionChannel VisitChannel NullChannel

# Describe/configure HTTPSource
QKDSK305.sources.HTTPSource.type = org.apache.flume.source.http.HTTPSource
QKDSK305.sources.HTTPSource.port = 4321
QKDSK305.sources.HTTPSource.handler = com.dynatrace.diagnostics.btexport.flume.BtExportHandler

# Describe sinks
QKDSK305.sinks.PurePathSink.type = hdfs
QKDSK305.sinks.PurePathSink.hdfs.path = hdfs://QKDSK303:9000/user/bts/pp
QKDSK305.sinks.PurePathSink.hdfs.fileType = DataStream
QKDSK305.sinks.PurePathSink.hdfs.filePrefix = export
QKDSK305.sinks.PurePathSink.hdfs.fileSuffix = .txt
QKDSK305.sinks.PurePathSink.hdfs.rollInterval = 120
QKDSK305.sinks.PurePathSink.hdfs.rollSize = 131072
QKDSK305.sinks.PurePathSink.serializer = com.dynatrace.diagnostics.btexport.flume.BtPurePathSerializerBuilder

QKDSK305.sinks.UserActionSink.type = hdfs
QKDSK305.sinks.UserActionSink.hdfs.path = hdfs://QKDSK303:9000/user/bts/pa
QKDSK305.sinks.UserActionSink.hdfs.fileType = DataStream
QKDSK305.sinks.UserActionSink.hdfs.filePrefix = export
QKDSK305.sinks.UserActionSink.hdfs.fileSuffix = .txt
QKDSK305.sinks.UserActionSink.hdfs.rollInterval = 120
QKDSK305.sinks.UserActionSink.hdfs.rollSize = 131072
QKDSK305.sinks.UserActionSink.serializer = com.dynatrace.diagnostics.btexport.flume.BtPageActionSerializerBuilder

QKDSK305.sinks.VisitSink.type = hdfs
QKDSK305.sinks.VisitSink.hdfs.path = hdfs://QKDSK303:9000/user/bts/visit
QKDSK305.sinks.VisitSink.hdfs.fileType = DataStream
QKDSK305.sinks.VisitSink.hdfs.filePrefix = export
QKDSK305.sinks.VisitSink.hdfs.fileSuffix = .txt
QKDSK305.sinks.VisitSink.hdfs.rollInterval = 120
QKDSK305.sinks.VisitSink.hdfs.rollSize = 131072
QKDSK305.sinks.VisitSink.serializer = com.dynatrace.diagnostics.btexport.flume.BtVisitSerializerBuilder
QKDSK305.sinks.VisitSink.serializer.charset = ISO-8859-2
QKDSK305.sinks.NullSink.type = null
QKDSK305.channels.NullChannel.type = memory

# Use a channel which buffers events in memory
QKDSK305.channels.PurePathChannel.type = memory
QKDSK305.channels.PurePathChannel.capacity = 1000
QKDSK305.channels.PurePathChannel.transactionCapactiy = 100

QKDSK305.channels.UserActionChannel.type = memory
QKDSK305.channels.UserActionChannel.capacity = 1000
QKDSK305.channels.UserActionChannel.transactionCapactiy = 100

QKDSK305.channels.VisitChannel.type = memory
QKDSK305.channels.VisitChannel.capacity = 1000
QKDSK305.channels.VisitChannel.transactionCapactiy = 100

# Bind the source and sink to the channel
QKDSK305.sources.HTTPSource.channels = PurePathChannel UserActionChannel VisitChannel NullChannel
QKDSK305.sinks.PurePathSink.channel = PurePathChannel
QKDSK305.sinks.UserActionSink.channel = UserActionChannel
QKDSK305.sinks.VisitSink.channel = VisitChannel
QKDSK305.sinks.NullSink.channel = NullChannel

QKDSK305.sources.HTTPSource.selector.type = multiplexing
QKDSK305.sources.HTTPSource.selector.header = btType
QKDSK305.sources.HTTPSource.selector.mapping.PUREPATH = PurePathChannel
QKDSK305.sources.HTTPSource.selector.mapping.PAGE_ACTION = UserActionChannel
QKDSK305.sources.HTTPSource.selector.mapping.VISIT = VisitChannel
QKDSK305.sources.HTTPSource.selector.default = NullChannel

---

請幫助。

謝謝Pranil

Answer 1

似乎我們的其他用戶之一遇到了類似的問題。 他們通過使用protobuf 2.5重新編譯Flume解決了該問題。 除了復制他們在dynatrace社區論壇上發布的內容外，您還可以在此處查看他們的發布內容： https ://community.compuwareapm.com/community/display/DL/Big+Data+Business+Transaction+Bridge?focusedCommentId=192087283# 評論-192087283

和我