
values values.yaml splunk-otel-collector-chart/splunk-otel-collector
KAFKA CONNECT PROMETHEUS EXPORTER INSTALL
$ helm install my-splunk-otel-connector -set splunkAccessToken=' ' -set="splunkRealm= ,clusterName=kafka-cluster" $ helm repo add splunk-otel-collector-chart Rule: type = "pod" & name matches "kafka"įinally deploy Splunk OpenTelemetry Connector using Helm: To configure the connector, create a file – values.yaml – and add the following configuration:
Splunk OpenTelemetry Connector can automatically discover Kafka deployments. Step 2: Deploying Splunk OpenTelemetry Connector as a DaemonSet In this example, we do so by setting the Pod IP as an environment variable called ‘MY_POD_IP’Įxample Kafka Broker deployment (requires a zookeeper deployment + service as well, reference): Thus, we need to set the IP of the pod as the server.hostname using the Downward API. the agent must be on the same machine or same container to access the JMX url on localhost.įor Kubernetes, since we have the Otel Connector running as a DaemonSet, it needs to connect via the Kafka Broker’s Pod IP address. If you provide the value to be “localhost”, the connection by an external service (like the Otel Connector) can only be made by specifying “localhost” in the agent config, i.e. Parameter local.only should be set to false unless you have the Otel Connector running as a sidecar or on the same instance as the host, where the host is reachable on ‘localhost’įinally, you want to set the server.hostname as the IP address that will be used to connect to the JMX Url. The port and the rmi.port should be set to the same value, which will allow the Splunk OpenTelemetry Connector to connect using a single port. You can enable JMX metrics by setting KAFKA_JMX_OPTS by one of the following methods depending on the choice of deployment:Įdit Kafka startup script, typically located at bin/kafka-run-class.sh, to include the following parameters to KAFKA_JMX_OPTS Kafka exposes health and performance metrics via Java Management Extensions (JMX), so the first step is to enable JMX metrics on Kafka brokers.

KAFKA CONNECT PROMETHEUS EXPORTER HOW TO
This blog is focused on how to collect and monitor Kafka performance metrics with Splunk Infrastructure Monitoring using OpenTelemetry, a vendor-neutral and open framework to export telemetry data. In a previous blog post, " Monitoring Kafka Performance with Splunk," we discussed key performance metrics to monitor different components in Kafka.
