PROSAGA码农传奇-Kafka-具有多个kafka输入的Logstash

具有多个kafka输入的Logstash

作者: 甲基蓝
发布时间: 2025-02-21 04:05:00 (1天前)
转自：

<div class =“post-text”itemprop =“text”>
  <P>
    这是一个非常晚的回复，但如果你想输入多个主题和输出到另一个kafka多输出，你可以做这样的事情：
  </p>
   <pre>
    <code>
          input {
  enter code herekafka {
    topics => ["topic1", "topic2"]
    codec => "json"
    bootstrap_servers => "kafka-broker-1:9092,kafka-broker-2:9092,kafka-broker-3:9092"
    decorate_events => true
    group_id => "logstash-multi-topic-consumers"
    consumer_threads => 5
  }
}

output {
   if [kafka][topic] == "topic1" {
     kafka {
       codec => "json"
       topic_id => "new_topic1"
       bootstrap_servers => "output-kafka-1:9092"
     }
   }
   else if [kafka][topic] == "topic2" {
      kafka {
       codec => "json"
       topic_id => "new_topic2"
       bootstrap_servers => "output-kafka-1:9092"
      }
    }
}

</code>
  </pre>
  <P>
    详细说明引导服务器时要小心，给出kafka广告听众的名称。
  </p>
  <P>
    REF-1：
    <a href="https://www.elastic.co/guide/en/logstash/current/plugins-inputs-kafka.html#plugins-inputs-kafka-group_id" rel="nofollow noreferrer">
      https://www.elastic.co/guide/en/logstash/current/plugins-inputs-kafka.html#plugins-inputs-kafka-group_id
    </A>
  </p>
  <P>
    REF-2：
    <a href="https://www.elastic.co/guide/en/logstash/current/plugins-inputs-kafka.html#plugins-inputs-kafka-decorate_events" rel="nofollow noreferrer">
      https://www.elastic.co/guide/en/logstash/current/plugins-inputs-kafka.html#plugins-inputs-kafka-decorate_events
    </A>
  </p>
</DIV>