Skip to content

v0.4.0: Support for Kafka brokers >= v0.9 !!!
Compare
Choose a tag to compare
@rcasey212 rcasey212 released this 12 Jan 21:05
· 15 commits to master since this release
v0.4.0
c08f6e7

Big news!!

kafka-offset-monitor now supports Kafka brokers >= v0.9. This includes the added support for Kerberos / SASL_PLAINTEXT!

  • Upgraded Kafka bindings to 0.9.0.1 and changed kafka client to new Java-based client - supporting Kafka brokers >= v0.9 and also supporting authentication/authorization.
    • This will no longer work with versions of kafka pre-0.9.0.1, but has been tested to work on 0.9.0.1 and 0.10.
    • Re-factored usage of ZkUtils due to a significant API change from 0.8 to
      0.9.
    • Added two new command-line parameters: kafkaBrokers, and kafkaSecurityProtocol -- allowing users to choose SASL_PLAINTEXT for the security protocol when using kafka as the offset storage location, but defaulting to the original PLAINTEXT protocol when no option is chosen.
    • Replaced copy-pasted wire-protocol code that retrieves metadata from the kafka brokers with an implementation that uses the kafka provided AdminClient.
    • Replaced usage of the kafka Scala client from pre-0.9 with the new kafka java-based client.
    • NOTE: While I have tried to make all of the necessary changes, zookeeper and storm offset storage paths have not been tested outside of the existing unit-tests.
  • Refactored ZkUtilsWrapper due to underlying API change of ZkUtils.
  • Changed the headings on the group include html to be more representative of the actual data.
    • Offset becomes CommittedOffset.
    • logSize becomes LogEndOffset.
  • Upgraded Scala to 2.11.8
  • Upgraded SBT to 13.13
Assets 3
Loading