Skip to content
This repository has been archived by the owner on Mar 17, 2024. It is now read-only.

Lag exporter failing on retrieval of offsets after topic was deleted and recreated with fewer partitions. #478

Open
manusuku opened this issue Jul 28, 2023 · 0 comments

Comments

@manusuku
Copy link

Describe the bug
the lag exporter ( now upgraded to seglo/kafka-lag-exporter:0.8.2 ) fails to get offsets after we deleted certain topics and recreated with fewer partitions. (NOTE: the lag exporter was working before this change)

Seems to give below DEBUG messages for partitions which are not existing any more:
DEBUG o.a.k.c.consumer.internals.Fetcher - [Consumer clientId=consumer-kafkalagexporter-39, groupId=kafkalagexporter] Leader for partition partition-72 is unknown for fetching offset -2

finally gets ERROR as below
023-07-28 05:38:17,027 ERROR c.l.k.ConsumerGroupCollector$ akka://kafka-lag-exporter/user/consumer-group-collector-kafka - Supervisor RestartSupervisor saw failure [1]: A failure occurred while retrieving offsets. Shutting down. java.lang.Exception: A failure occurred while retrieving offsets. Shutting down.

To Reproduce

Deleted an existing topic, recreated same topic with lesser partitions. Above DEBUG messages.

Environment

  • Version seglo/kafka-lag-exporter:0.8.2
  • Version of Apache Kafka cluster kafka_2.13-3.1.0
  • Run with Helm or Standalone stand alone (docker image)

Additional context
Add any other context about the problem here.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant