Consume Kafka topic from the beginning

HiveMQ Extensions
1

Hello,

I would like to know if it is possible to create a Kafka-To-MQTT mapping where the Kafka topic is consumed from the beginning. On a typical kafka consumer, this can be accomplished by setting the auto.offset.reset config to earliest, but I could not find anywhere in the docs where this type of configuration is exposed.

An overview of my use cases is as follows:

  • I have a Kafka topic that already contains some initial messages
  • Periodically, new messages are also published to the topic
  • I would like MQTT clients to be able to connect to HiveMQ and consume this topic from the beginning (so they will receive any messages that were published to the topic prior to when they subscribed, in addition to any new messages that are published to the topic)

I hope this makes sense. Thanks for the help!

2

Hello @tristan ,

Nice to see your interest in MQTT, HiveMQ, and Kafka — welcome to our community!

The HiveMQ Kafka Extension comes with a Customization SDK, which can be leveraged for what you are trying to achieve.

I suggest you reach out to our colleagues at sales@hivemq.com and schedule a meeting to dive deeper into your specific requirements.

Kind regards,
Dasha from HiveMQ team