{"id":7810,"date":"2021-05-12T14:53:28","date_gmt":"2021-05-12T19:53:28","guid":{"rendered":"https:\/\/www.rushworth.us\/lisa\/?p=7810"},"modified":"2021-05-12T14:53:28","modified_gmt":"2021-05-12T19:53:28","slug":"troubleshooting-kafka","status":"publish","type":"post","link":"https:\/\/www.rushworth.us\/lisa\/?p=7810","title":{"rendered":"Troubleshooting Kafka"},"content":{"rendered":"

Our server metrics are fed into a Kafka bus, and various applications are able to pick up and process this data. Problem is, however, that everything I’m sending doesn’t end up in the downstream system. The conflunce_kafka module I’m using in python reports that data is send along it’s merry way, but the primary system that is used to present metrics to end users says they’re not consistently<\/em> getting data across the channel. Not never like there’s something outright wrong, but long periods of time where there’s no data followed by a cycle where data shows up.<\/p>\n

I’ve exhausted all of the in-script debugging I can — the messages are<\/em> getting there. But I wondered if the async nature of Kafka might mean that the client’s “it got there” wouldn’t actually mean something arrived. So I had to figure out how to test a Kafka server the same way I test my MQTT server — how do I use a quick command line program to send a message and how do I use a quick command line program to subscribe to various topics.<\/p>\n

Turns out this is easier than anticipated — the binary build of Kafka includes windows batch files. Download the latest Kafka binary<\/a>. Untar\/unzip it somewhere. This is easy if you have the Win32 port of the GNU utilities<\/a> and can just run “tar vxfz kafka_2.13-2.8.0.tgz”.<\/p>\n

In the .\\kafka<version>\\bin\\windows folder, there are kafka-console-consumer.bat and kafka-console-producer.bat files that can be used for testing Kafka. You can open two command prompts — one for the producer (sending data to Kafka) and one for the consumer (watching Kafka for new messages). In the consumer window, run<\/p>\n

kafka-console-consumer.bat –bootstrap-server yourkafkaserver.example.com:Port <\/em>–topic Test<\/p>\n

Then, in the producer, run<\/p>\n

kafka-console-producer.bat –broker-list yourkafkaserver.example.com:Port <\/em>–topic Test<\/p>\n

The producer will bring you to a “>” prompt where you can type some strings and hit enter to send the message to Kafka. You should see the messages pop into the consumer window.<\/p>\n

\"\"<\/a><\/p>\n

To subscribe to multiple topics, use “–whitelist” followed by a pipe-bar delimited list of topics.<\/p>\n

\"\"<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Our server metrics are fed into a Kafka bus, and various applications are able to pick up and process this data. Problem is, however, that everything I’m sending doesn’t end up in the downstream system. The conflunce_kafka module I’m using in python reports that data is send along it’s merry way, but the primary system …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29],"tags":[1362,1361],"class_list":["post-7810","post","type-post","status-publish","format-standard","hentry","category-technology","tag-apache-kafka","tag-kafka"],"_links":{"self":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/7810","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=7810"}],"version-history":[{"count":1,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/7810\/revisions"}],"predecessor-version":[{"id":7813,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/7810\/revisions\/7813"}],"wp:attachment":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=7810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=7810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=7810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}